Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kibana stats: less aggressive usage collection if failed #20771

Closed
afharo opened this issue Aug 25, 2020 · 4 comments · Fixed by #20772
Closed

Kibana stats: less aggressive usage collection if failed #20771

afharo opened this issue Aug 25, 2020 · 4 comments · Fixed by #20772
Labels
bug Feature:Stack Monitoring Metricbeat Metricbeat Team:Services (Deprecated) Label for the former Integrations-Services team

Comments

@afharo
Copy link
Member

afharo commented Aug 25, 2020

Metricbeat for Kibana collects usage stats once a day.

But, if the collection request fails (we've seen timeouts lately for requests taking longer than 10s default timeout), it will request the usage again on the next poll interval (10s later), overloading the server even more.

content, err = m.statsHTTP.FetchContent()
if err != nil {
return err
}
if shouldCollectUsage {
m.usageLastCollectedOn = now
}

Can we set up a backoff mechanism that will try to skip the collection of the usage for a few rounds (maybe for another day?), prioritising metric-stats over usage-collection?

@afharo afharo added bug Metricbeat Metricbeat labels Aug 25, 2020
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Aug 25, 2020
@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Aug 25, 2020
@andresrc andresrc added Team:Services (Deprecated) Label for the former Integrations-Services team and removed Team:Observability labels Aug 25, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-services (Team:Services)

@elasticmachine
Copy link
Collaborator

Pinging @elastic/stack-monitoring (Stack monitoring)

@afharo
Copy link
Member Author

afharo commented Aug 25, 2020

@andresrc thank you for amending the labels 😅
I've created a tentative PR in here: #20772

But I'm not a go developer so maybe there's a better way to implement it 😉

@andresrc
Copy link
Contributor

Thank you very much @afharo !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Feature:Stack Monitoring Metricbeat Metricbeat Team:Services (Deprecated) Label for the former Integrations-Services team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants