Postmortem -
Read details
Sep 15, 23:34 UTC
Resolved -
Hello Everyone,
Update: Incident Resolved.
Date/Time: September 11th, 12:40 pm UTC
We will review the findings and collected information from this incident to further improve our online services. There will be a postmortem published for Major (max 20 business days) and Critical (max 10 business days) incidents once a thorough investigation has been completed. For 'Critical incidents a preliminary postmortem will be published within 48 hours with initial findings).
We are sorry for the inconvenience this has caused.
Kind Regards
Online Operations Team
Sep 11, 12:41 UTC
Monitoring -
Update:
We are seeing that services are now recovering across the deployment.
Recovery of all services may take some time although we can already see a vast improvement.
We are now monitoring the recovery.
Next Update:
The next update will be in 1 hour.
Sep 11, 11:41 UTC
Update -
Update:
Mitigation controls are still being put in place.
Next Update:
The next update will be in 1 hour or as new information becomes available.
Sep 11, 11:10 UTC
Identified -
Update:
We have identified a possible cause and mitigation controls are currently being put in place.
Next Update:
The next update will be in 1 hour or as new information becomes available.
Sep 11, 10:09 UTC
Investigating -
Incident details:
We are investigating a performance issue which is reported from the field as tenants are slow or offline.
Start Time:
11th September 2023
8:30am (UTC) Approximately based on field reports and early telemetry review.
Incident Scope:
UK Deployment
Description:
Customers may have issues with access to their tenant and general service performance.
Next Update:
The next update will be in 1 hour.
Sep 11, 09:10 UTC