GitHub header

Incident with Codespaces

Incident Report for GitHub

Resolved

On September 30th, 2024 from 10:43 UTC to 11:26 UTC Codespaces customers in the Central India region were unable to create new Codespaces. Resumes were not impacted. Additionally, there was no impact to customers in other regions.

The cause was traced to storage capacity constraints in the region and was mitigated by temporarily redirecting create requests to other regions. Afterwards, additional storage capacity was added to the region and traffic was routed back.

A bug was also identified that caused some available capacity to not be utilized, artificially constraining capacity and halting creations in the region prematurely. We have since fixed this bug as well, so that available capacity scales as expected according to our capacity planning projections.
Posted Sep 30, 2024 - 11:26 UTC

Update

Codespaces is operating normally.
Posted Sep 30, 2024 - 11:26 UTC

Update

We are seeing signs of recovery in Codespaces creations and starts. We are continuing to monitor for full recovery.
Posted Sep 30, 2024 - 11:25 UTC

Update

Codespaces is experiencing degraded performance. We are continuing to investigate.
Posted Sep 30, 2024 - 11:24 UTC

Update

We are investigating a high number of errors in Codespaces creation and start.
Posted Sep 30, 2024 - 11:09 UTC

Investigating

We are investigating reports of degraded availability for Codespaces
Posted Sep 30, 2024 - 11:08 UTC
This incident affected: Codespaces.