Incident with Codespaces
Incident
Report for GitHub
Resolved
On 2024-01-21 at 3:38 UTC, we experienced an incident that affected customers using Codespaces. Customers encountered issues creating and resuming Codespaces in multiple regions due to operational issues with compute and storage resources.
Around 25% of customers were impacted, primarily in East US and West Europe. We re-routed traffic for Codespace creations to less impacted regions, but existing Codespaces in these regions may have been unable to resume during the incident.
By 7:30 UTC, we had recovered connectivity to all regions except West Europe, which had an extended recovery time due to increased load in that particular region. The incident was resolved on 2024-01-21 at 9:34 UTC once Codespace creations and resumes were working normally in all regions.
Around 25% of customers were impacted, primarily in East US and West Europe. We re-routed traffic for Codespace creations to less impacted regions, but existing Codespaces in these regions may have been unable to resume during the incident.
By 7:30 UTC, we had recovered connectivity to all regions except West Europe, which had an extended recovery time due to increased load in that particular region. The incident was resolved on 2024-01-21 at 9:34 UTC once Codespace creations and resumes were working normally in all regions.
Update
We continue to work on mitigating the issues with Codespace resumes in West Europe.
Update
We continue to work on mitigating the issues with Codespace resumes in West Europe.
Update
We continue to work on mitigating the issues with Codespace resumes in West Europe.
Update
Codespace creation has fully recovered in all regions. We are still mitigating issues with Codespace resumes in West Europe.
Update
We continue to see recovery in most regions. We are still working on mitigating the issue impacting customers in West Europe.
Update
We are continuing to monitor recovery in the affected regions.
Update
We are seeing signs of recovery in the affected regions.
Update
Codespaces is experiencing degraded performance. We are continuing to investigate.
Update
We continue to work on mitigating the underlying the issue impacting Codespaces customers.
Update
We continue to work on mitigating the underlying the issue impacting Codespaces customers.
Update
Around 15% of Codespaces customers are unable to create or resume their codespaces. We are continuing efforts to mitigate the issue.
Update
Codespaces is experiencing degraded availability. We are continuing to investigate.
Update
We have identified the issue impacting Codespaces customers in multiple regions and are working on mitigation.
Update
We are experiencing elevated error rates in multiple regions and are currently investigating.
Investigating
We are investigating reports of degraded performance for Codespaces
This incident affected: Codespaces.
