Resolved -
This incident has been resolved.
Jan 17, 11:50 EST
Monitoring -
We are continue to monitor the progress of processing the backlog in Events. The majority of the backlog has been processed. Event Monitor evaluation remains delayed while we finish processing the backlog.
Jan 17, 10:34 EST
Update -
We've implemented a fix, and are currently working through the backlog of delayed Events. Event Monitor evaluation remains delayed while we work through the backlog. All other monitor types have recovered and are currently evaluating.
Jan 17, 09:31 EST
Identified -
We have identified the issue causing delayed ingestion of Events. Alerting evaluation continues to be delayed for Event Monitors, Process Monitors, and Cloud Network monitors. All other monitor types have recovered and are currently evaluating.
Jan 17, 08:55 EST
Update -
We are continuing to investigate this issue.
Jan 17, 08:46 EST
Investigating -
We are investigating increased latency processing Events.
As a result of this issue, some users may see delays in the event stream or for event queries on dashboards, and event alert evaluation is delayed.
This issue also caused a delay in the processing of alerts across other products. We've implemented a fix for this, and are monitoring the recovery of the alert evaluation pipeline. As a result, a subset alerts may be delayed while the system recovers.
Jan 17, 08:42 EST