We are continue to monitor the progress of processing the backlog in Events. The majority of the backlog has been processed. Event Monitor evaluation remains delayed while we finish processing the backlog.
Posted Jan 17, 2025 - 10:34 EST
Update
We've implemented a fix, and are currently working through the backlog of delayed Events. Event Monitor evaluation remains delayed while we work through the backlog. All other monitor types have recovered and are currently evaluating.
Posted Jan 17, 2025 - 09:31 EST
Identified
We have identified the issue causing delayed ingestion of Events. Alerting evaluation continues to be delayed for Event Monitors, Process Monitors, and Cloud Network monitors. All other monitor types have recovered and are currently evaluating.
Posted Jan 17, 2025 - 08:55 EST
Update
We are continuing to investigate this issue.
Posted Jan 17, 2025 - 08:46 EST
Investigating
We are investigating increased latency processing Events.
As a result of this issue, some users may see delays in the event stream or for event queries on dashboards, and event alert evaluation is delayed.
This issue also caused a delay in the processing of alerts across other products. We've implemented a fix for this, and are monitoring the recovery of the alert evaluation pipeline. As a result, a subset alerts may be delayed while the system recovers.
Posted Jan 17, 2025 - 08:42 EST
This incident affected: Metrics and Infra Monitoring and Monitors.