Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filebeat CloudWatch input misses events #28133

Closed
gbanasiak opened this issue Sep 27, 2021 · 1 comment · Fixed by #28509
Closed

Filebeat CloudWatch input misses events #28133

gbanasiak opened this issue Sep 27, 2021 · 1 comment · Fixed by #28509
Assignees
Labels
bug Team:Integrations Label for the Integrations team

Comments

@gbanasiak
Copy link
Contributor

In #20875 we added latency config parameter to Metricbeat to handle AWS CloudWatch API delay in exposing S3-related metrics. Without the fix Metricbeat could have returned no data when asking for metrics in <now - 2 x period, now> time interval for small period values.

A similar problem can happen in case of Filebeat CloudWatch input. Filebeat asks for events in <now - period, now> time interval so events that happen close to now timestamp might not be available via CloudWatch API yet. During the next cycle Filebeat asks for <now, now + period> events so the missing events are never retrieved.

@gbanasiak gbanasiak added the bug label Sep 27, 2021
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Sep 27, 2021
@andresrc andresrc added the Team:Integrations Label for the Integrations team label Sep 27, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations (Team:Integrations)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Sep 27, 2021
@kaiyan-sheng kaiyan-sheng self-assigned this Oct 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Team:Integrations Label for the Integrations team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants