4.0 KiB
GitHub Availability Report: December 2020
- 期号: SRE Weekly Issue #252（2021-01-10）
- 作者: Keith Ballinger — GitHub
- 链接: https://github.blog/2021-01-06-github-availability-report-december-2020/
简介
This one has some additional detail on a November outage involving MySQL replication lag.
正文
GitHub Availability Report: December 2020
In December, we experienced no incidents resulting in service downtime. This month’s GitHub Availability Report will provide a summary and follow-up details on how we addressed an incident mentioned in November’s report.
|
|
1 minutes
Introduction
In December, we experienced no incidents resulting in service downtime. This month’s GitHub Availability Report will provide a summary and follow-up details on how we addressed an incident mentioned in November’s report.
Follow-up to November 27 16:04 UTC (lasting one hour and one minute)
Upon further investigation around one of the incidents mentioned in November’s Availability Report, we discovered an edge case that triggered a large number of GitHub App token requests. This caused abnormal levels of replication lag within one of our MySQL clusters, specifically affecting the GitHub Actions service. This particular scenario resulted in amplified queries and increased the database lag, which impacted the database nodes that process GitHub App token requests.
When a GitHub Action is invoked, the Action is passed a GitHub App token to perform tasks on GitHub. In this case, the database lag resulted in the failure of some of those token requests because the database replicas did not have up to date information.
To help avoid this class of failure, we are updating the queries to prevent large quantities of token requests from overloading the database servers in the future.
In summary
Whether we’re introducing a system to manage flaky tests or improving our CI workflow, we’ve continued to invest in our engineering systems and overall reliability. To learn more about what we’re working on, visit GitHub’s engineering blog.
Tags:
Written by
Related posts
[GitHub availability report: August 2026](https://github.blog/news-insights/company-news/github-availability-report-august-2026/)
In August, we experienced five incidents that resulted in degraded performance across GitHub services.
[The August 17 outage, and the work ahead](https://github.blog/news-insights/company-news/the-august-17-outage-and-the-work-ahead/)
An update on the August 17 outage and the steps we’re taking to improve reliability.
[Your guide to GitHub Universe 2026 is here: The schedule just launched!](https://github.blog/news-insights/company-news/your-guide-to-github-universe-2026-is-here-the-schedule-just-launched/)
The GitHub Universe session catalog is live. Explore interactive workshops, community talks, demos, and panels. Plus, register before August 19 to save $300.