Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing data problem and data update question #71

Open
TaurusD opened this issue Aug 1, 2017 · 3 comments
Open

Missing data problem and data update question #71

TaurusD opened this issue Aug 1, 2017 · 3 comments

Comments

@TaurusD
Copy link

TaurusD commented Aug 1, 2017

Hi, I’m using logstash-input-mongodb to import my data from mongodb to ELK.
But when it was done, I found that there is one document missing (I have 17781 docs in mongodb but only got 17780 docs in ELK).

I used the “normal” way to install the plugin through command bin\logstash-plugin install logstash-input-mongo.
So can anyone help me on this problem?

Also, I found that when there is a change on the source db in mongo, this plugin can not detect it and import new data. And I didn’t found any schedule settings (like jdbc input plugin) which allow me to call my data regularly. So can anyone tell me how to keep data updated with mongodb using this plugin?

Thank you!

@alejandrobarrios07
Copy link

+1 but I have 399712 docs in mongodb but only got 399700 docs in ELK

@TaurusD
Copy link
Author

TaurusD commented Aug 3, 2017

now I had another try, which only 24 docs in mongo and 23 docs in ELK.
can anyone help us? @phutchins

I sorted by _id and found it was the first doc (smallest _id) didn't import into ELK

@topgun743
Copy link

What's been done in this issue's regard?
Its been a long time since this issue has been reported and still I am also getting the same problem i.e First record goes missing in ELK.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants