On March 19, 2026 between 16:10 UTC and 00:05 UTC (March 20), Git operations (clone, fetch, push) from the US west coast experienced elevated latency and degraded throughput. Users reported clone speeds dropping from typical speeds to under 1 MiB/s in extreme cases. The root cause was network transport link saturation at our Seattle edge site, where a fiber cut affecting our backbone transport resulted in saturation and packet loss. We had a planned scale-up in progress for the site that was accelerated to resolve the backbone capacity pressure. We also brought online additional edge capacity in a cloud region and redirected some users there. Current scale with the upgraded network capacity is sufficient to prevent reoccurrence, as we upgraded from 800Gbps to 3.2Tbps total capacity on this path. We will continue to monitor network health and respond to any further issues.
Posted Mar 20, 2026 - 00:05 UTC
Update
We have reached stability with git operations through our changes deployed today.
Posted Mar 20, 2026 - 00:05 UTC
Update
We are seeing early signs of improvement. We are working on one more small change to further improve traffic routing on the west coast.
Posted Mar 19, 2026 - 23:52 UTC
Update
We have completed the rollout of our new network path and are monitoring its impact.
Posted Mar 19, 2026 - 22:57 UTC
Update
We are beginning the rollout of our new network path. During this change, users will continue to see higher latency from the west coast. We will provide another update when the rollout is complete.
Posted Mar 19, 2026 - 21:59 UTC
Update
We are working to enable a new network path in the west coast to reduce load and will monitor the impact on latency for Git Operations
Posted Mar 19, 2026 - 18:27 UTC
Update
We are still seeing elevated latency for Git operations in the west coast and are continuing to investigate
Posted Mar 19, 2026 - 17:49 UTC
Update
We are redirecting traffic back to our Seattle region and customers should see a decrease in latency for Git operations
Posted Mar 19, 2026 - 17:01 UTC
Investigating
We are investigating reports of degraded performance for Git Operations