Postmortem -
Read details
Mar 17, 21:51 UTC
Resolved -
Hello Everyone,
Update: Incident Resolved.
Date/Time: March11th, 2:15 AM UTC
This incident is now resolved with all services back online and the resources all showing as normal. Preliminary investigation between the NT-ware Operations and Microsoft engineers point to a transient issue in the web role scaling. Currently this is being reviewed by the Microsoft back-end engineering team.
We will review the findings and collected information from this incident to further improve our online services. There will be a postmortem published for this incident rated 'Major' (within max 20 business days) once a thorough investigation has been completed.
We are sorry for the inconvenience this has caused.
Kind Regards
Online Operations Team
Mar 11, 02:24 UTC
Monitoring -
Update:
The Operations team are seeing a strong recovery across our service and devices should be already reconnecting.
Monitoring will continue as we validate and confirm the recovery process.
Next Update:
The next update will be in 30 minutes.
Mar 11, 02:06 UTC
Investigating -
Incident details: Our monitoring systems have alerted us to a performance degradation.
Start Time:
0:40 UTC 11-03-2024, Monday
Incident Scope:
Singapore Deployment.
Description:
The NT-ware Online Operations team are investigating this issue and the cause.
Recovery and remediation processes have started automatically.
The team is monitoring this closely to see if manual intervention is required.
Next Update:
The next update will be in 30 minutes.
Mar 11, 01:43 UTC