Increased Docker gen2 wait times

Timeline

1. 19:31 UTC CircleCI status page · Reported Increased Docker gen2 wait times
2. 19:31 UTC CircleCI status page · Identified Some users might see increased wait times for gen2 Docker jobs due to capacity issues.
3. 20:03 UTC CircleCI status page · Identified We are adding additional capacity to help mitigate the issue. Note: We are still seeing delays up to 20 minutes on 2xlarge.
4. 20:22 UTC CircleCI status page · Identified Wait times for 2xlarge docker jobs are recovering. We will continue to update as capacity comes online.
5. 20:35 UTC CircleCI status page · Identified Wait times for 2xlarge docker jobs are now under 60 seconds. Wait times for other resource sizes were not impacted by this incident and remain under 10 seconds.
6. 20:40 UTC CircleCI status page · Monitoring We have seen a full recovery of wait times for docker jobs.
7. 20:54 UTC CircleCI status page · Resolved Wait times for gen2 Docker jobs have recovered and jobs are running within normal wait times.
8. 23:29 UTC CircleCI status page · Postmortem ## Summary From 15:44 to 20:55 UTC on October 21, customers running Gen 2 Docker jobs saw increased wait times for their jobs to start. Delays were longest on the 2xlarge resource class, where jobs waited up to 20 minutes. The incident was caused by limited availability of the cloud instances we had configured to meet demand, particularly for 2xlarge jobs. In response, our engineering team configured additional instance types, configured additional Gen 2 Docker clusters. By 20:55 UTC, wait times had returned to normal and the incident was resolved. After the incident was resolved, we…