[Stack Monitoring] "Error fetching alert status"

[jasonrhodes]

Related:

• [Monitoring] More resilient against errors with alerting
• [Monitoring] Recreate alerts if necessary
• Alerting to re-create task manager tasks in the scenario they get deleted

When visiting the Stack Monitoring UI, customers sometimes see an error notification that says "Error fetching alert status". In these cases, it is often necessary to disable or delete the Stack Monitoring alerts and then visit the UI again to re-create them. There have been a few previous tickets where we've tried to make the error message more graceful, but we don't yet understand what causes it. We need to determine the root cause of this error and, if possible, fix or log more tickets to fix.

Notes:

• I just encountered this error in an Elastic Cloud cluster that is running 7.10.2 -- I'm not sure if it's the same problem or not but the notification appears on every data request (every 10s, by default)

[elasticmachine]

Pinging @elastic/logs-metrics-ui (Team:logs-metrics-ui)

[elasticmachine]

Pinging @elastic/stack-monitoring (Team:Monitoring)