-
Notifications
You must be signed in to change notification settings - Fork 4.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Filebeat network shares support #19736
Comments
Pinging @elastic/integrations-services (Team:Services) |
CC @urso |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane) |
Hi! We're labeling this issue as |
The
log
input of Filebeat does not support reading files from network shares and cloud providers. There are two main issues that have to be addressed before we are ready.Filebeat identifies files based on inode and device ids. However, these two numbers might change from time to time when the files are located on a network share. Thus, Filebeat cannot tell apart files correctly. Users might end up with duplicated data as Filebeat believes it has found a new file and rereads whole content.
The offset returned from file readers are sometimes incorrect. Filebeat needs to check if the return bytes sequence is nil. If yes, it needs to revert back to the end of the file, as it has tried to read from an invalid area. A possible solution is described in this comment: Add initial support for configurable file identity tracking #18748 (comment)
The text was updated successfully, but these errors were encountered: