A fix has been implemented and we are monitoring the results.
Posted Jul 10, 2023 - 22:12 PDT
Update
We are continuing to investigate this issue. There has been a regression.
Posted Jul 10, 2023 - 21:31 PDT
Update
Most services should be operating normal. There may still be issues with alerting. We continue to investigate.
Posted Jul 10, 2023 - 20:21 PDT
Update
Ingest of all data is currently recovering. The web UI is back up. Queries should be working.
Posted Jul 10, 2023 - 19:10 PDT
Update
We are continuing to investigate this issue.
Posted Jul 10, 2023 - 19:09 PDT
Update
We are continuing to investigate this issue.
Posted Jul 10, 2023 - 18:46 PDT
Investigating
We are currently investigating this issue.
Posted Jul 10, 2023 - 18:20 PDT
This incident affected: US - Observability - Data Ingestion (US - Trace Assembly, US - Trace Statistics, US - Metrics), Observability - Third-Party Notification Methods (PagerDuty Events API, Slack Apps/Integrations, Slack Connections, Slack Messaging), US - Observability - Web UI (US - Service Directory, US - Dashboards, US - Notebooks, US - Change Intelligence, US - Explorer), US - Observability - Alerting (US - Unified Alerting, US - Streams Alerting), and US - Observability - API.