95 lines
5.0 KiB
HTML
95 lines
5.0 KiB
HTML
<p><a class="email_only" href="https://sreweekly.com/sre-weekly-issue-535/">View on sreweekly.com</a></p>
|
||
|
||
<div class="sreweekly-sponsor-message" style="border: 1px solid #b0b0b0; width: 80%;">
|
||
<h2 style="text-align: center; font-size: 80%; color: #909090;">A message from our sponsor, <a href="https://sreweekly.com/link/535">Planetscale</a>:</h2>
|
||
<p>Neki brings horizontal sharding to Postgres. It handles the hard parts of running Postgres at scale:</p>
|
||
<ul>
|
||
<li>Online schema changes</li>
|
||
<li>Version upgrades with no downtime</li>
|
||
<li>Better connection pooling</li>
|
||
<li>Resharding</li>
|
||
<li>Graceful planned and unplanned failovers</li>
|
||
</ul>
|
||
<p>→ Neki is available today. <a href="https://sreweekly.com/link/535"><u>Learn more.</u></a></p>
|
||
</div>
|
||
|
||
|
||
<div class="wp-block-group"><div class="wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow">
|
||
<div class="sreweekly-entry">
|
||
<div class="sreweekly-title"><a href="https://incident.io/blog/interning-at-incident-io-rate-limiting-resiliently" target="_blank">Interning at incident.io: Rate Limiting, Resiliently</a></div>
|
||
<div class="sreweekly-description">
|
||
<p>The early-career perspective here is so valuable! I love the way they explain everything, and the extension on their project is really nifty.</p>
|
||
<p> <small>Anthony Oparaocha — incident.io</small></p>
|
||
</div>
|
||
</div>
|
||
|
||
|
||
|
||
<div class="sreweekly-entry">
|
||
<div class="sreweekly-title"><a href="https://surfingcomplexity.blog/2026/08/22/wild-ai-related-reliability-incidents-are-coming/" target="_blank">Wild AI-related reliability incidents are coming</a></div>
|
||
<div class="sreweekly-description">
|
||
<p>I enjoyed the evaluation of AI agents in the frame of control theory and Ashby’s law. When your control system is incredibly complex, it can be hard to reason about what it does.</p>
|
||
<p> <small>Lorin Hochstein</small></p>
|
||
</div>
|
||
</div>
|
||
|
||
|
||
|
||
<div class="sreweekly-entry">
|
||
<div class="sreweekly-title"><a href="https://blog.cloudflare.com/dns-cache-memory-optimization-1111/" target="_blank">How we saved 100 terabytes of memory by optimizing 1.1.1.1’s DNS cache</a></div>
|
||
<div class="sreweekly-description">
|
||
<p>Their scale is such that every byte shaved off each cache entry saves 250 GB fleet-wide.</p>
|
||
<p> <small>Sebastiaan Neuteboom — Cloudflare</small></p>
|
||
</div>
|
||
</div>
|
||
|
||
|
||
|
||
<div class="sreweekly-entry">
|
||
<div class="sreweekly-title"><a href="https://status.cloud.google.com/incidents/J5ia5t9p3g9Q5Wi7r8Ev" target="_blank">Incident details: Multiple products in us-central1-b are experiencing network service degradation</a></div>
|
||
<div class="sreweekly-description">
|
||
<p>Here’s a good one to dig into from GCP. It’s especially interesting to see what they knew when they wrote their preliminary report vs their final report.</p>
|
||
<p> <small>Google</small></p>
|
||
</div>
|
||
</div>
|
||
|
||
|
||
|
||
<div class="sreweekly-entry">
|
||
<div class="sreweekly-title"><a href="https://billduncan.org/latencylens/" rel="noopener" target="_blank">latencylens</a></div>
|
||
<div class="sreweekly-description">
|
||
<p>There’s a really cool idea in this article and the original post it refers to: overlaying histograms to show how a latency distribution has changed over time. I’m still wrapping my head around the kernel density graphs, though.</p>
|
||
<p> <small>Bill Duncan</small></p>
|
||
</div>
|
||
</div>
|
||
|
||
|
||
|
||
<div class="sreweekly-entry">
|
||
<div class="sreweekly-title"><a href="https://www.buildkitestatus.com/incidents/tm6746k61p73" target="_blank">Buildkite service disruption (August 27)</a></div>
|
||
<div class="sreweekly-description">
|
||
<p>A sudden scale-up put pressure on CoreDNS which didn’t have autoscaling configured. After reading this incident report, you may also want to check out <a href="https://surfingcomplexity.blog/2026/09/01/thoughts-on-the-buildkite-aug-25-incident/">Lorin Hochstein’s analysis</a>.</p>
|
||
<p> <small>Buildkite</small></p>
|
||
</div>
|
||
</div>
|
||
|
||
|
||
|
||
<div class="sreweekly-entry">
|
||
<div class="sreweekly-title"><a href="https://www.wearedevelopers.com/magazine/764-the-geometry-of-incidents-connecting-user-impact-to-architecture" target="_blank">The Geometry of Incidents: Connecting User Impact to Architecture</a></div>
|
||
<div class="sreweekly-description">
|
||
<p>What can the shape and progression of impact during an incident tell us about how our systems are working?</p>
|
||
<p> <small>Bala Subrahmanyam Kambala — WeAreDevelopers</small></p>
|
||
</div>
|
||
</div>
|
||
|
||
|
||
|
||
<div class="sreweekly-entry">
|
||
<div class="sreweekly-title"><a href="https://hackernoon.com/your-certificate-monitoring-can-work-perfectly-and-you-can-still-have-an-outage" target="_blank">Your Certificate Monitoring Can Work Perfectly and You Can Still Have an Outage</a></div>
|
||
<div class="sreweekly-description">
|
||
<p>Monitoring isn’t enough, you need to make sure the renewed TLS certificate actually gets deployed, and a lot can get in the way. I like this concept of “CertOps”.</p>
|
||
<p> <small>TokenTimer — HackerNoon</small></p>
|
||
</div>
|
||
</div>
|
||
</div></div> |