# If You’re Going to Fail, Fail Safely

- **期号**: SRE Weekly Issue #107（2018-01-28）
- **作者**: —
- **链接**: http://blog.launchdarkly.com/if-youre-going-to-fail-fail-safely/

## 简介

This article from LaunchDarkly is about assuming failure and mitigating harm, through the lens of feature-flag-based deployment.

## 正文

![Blog Landing Background Image](https://images.prismic.io/launchdarkly/aicPVgeQX7-eW_Ag_img-bg--blog-landing.png?auto=format%2Ccompress&fit=max&w=3840)

# LaunchDarkly Blog

Search

[Runtime Control](http://blog.launchdarkly.com/blog/control-panel-recap-six-product-updates/)

##### You can't control what you can't see

What LaunchDarkly showed live on the Control Panel: how to see what's happening in production, act on it in real time, and test on data you already trust.

Kellye King

![](https://images.prismic.io/launchdarkly/Yhm_pbB-7k7m4EAY_Blog_08-26_ControlPanelRecap_HeroImage_1920x1080.png?auto=format%2Ccompress&rect=0%2C0%2C1919%2C1080&w=3840&fit=max&q=80)

![](https://images.prismic.io/launchdarkly/058f1522-7f2e-4557-9219-60c86483357d_kellye-king.png?auto=compress%2Cformat&rect=0%2C0%2C512%2C512&w=3840&fit=max&q=80)

[AI Agents](http://blog.launchdarkly.com/blog/a-human-look-at-the-ai-future/)

##### A human look at the AI future

Honest reflections on the uncertainty, excitement, and opportunities of the agentic era.

![](https://images.prismic.io/launchdarkly/H3gIKWtgiJDaIIBy_Blog_08-28_AHumanLookattheAIFuture_1920x1080.png?auto=format%2Ccompress&rect=0%2C0%2C1919%2C1080&w=3840&fit=max&q=80)

[AI Agents](http://blog.launchdarkly.com/blog/introducing-the-launchdarkly-ai-sdk/)

##### Introducing the LaunchDarkly AI SDK

The LaunchDarkly AI SDK is available for Python and JavaScript and is the path we recommend for every new AgentControl integration.

![](https://images.prismic.io/launchdarkly/JpuPyIgZ5nbqE3aB_Blog_09-02_IntroducingtheLaunchDarklyAISDK.png?auto=format%2Ccompress&rect=0%2C0%2C1919%2C1080&w=3840&fit=max&q=80)


### Product Updates

See what's launched lately.

[Engineering](http://blog.launchdarkly.com/blog/building-a-self-driving-ops-triage-loop/)

##### Stories from the Factory Floor: Building a self-driving ops triage loop

How the Foundation team at LaunchDarkly automated ops triage with three Cursor agents that take an alert all the way to an open PR.

Ari Salem

![](https://images.prismic.io/launchdarkly/5Npj_4hkdjeJPA4x_T03NX240W-U08DLM4N2GN-2fd580736f52-512.jpeg?auto=format%2Ccompress&rect=0%2C0%2C512%2C512&w=3840&fit=max&q=80)

[AI Agents](http://blog.launchdarkly.com/blog/introducing-the-launchdarkly-ai-sdk/)

##### Introducing the LaunchDarkly AI SDK

The LaunchDarkly AI SDK is available for Python and JavaScript and is the path we recommend for every new AgentControl integration.

Kelvin Yap

![](https://images.prismic.io/launchdarkly/aQLDI7pReVYa30dB_KelvinYap.jpeg?auto=format%2Ccompress&rect=0%2C0%2C512%2C512&w=3840&fit=max&q=80)

[AI Agents](http://blog.launchdarkly.com/blog/a-human-look-at-the-ai-future/)

##### A human look at the AI future

Honest reflections on the uncertainty, excitement, and opportunities of the agentic era.

Sarah Day

![Sarah Day](https://images.prismic.io/launchdarkly/1b060405-4d30-4fdd-a77d-c2104c8a8969_sarahDay.png?auto=compress%2Cformat&rect=0%2C0%2C150%2C150&w=3840&fit=max&q=80)

[Engineering](http://blog.launchdarkly.com/blog/running-my-side-project-on-an-ai-software-factory/)

##### Stories from the Factory Floor: Running my baseball side project on an AI software factory

I turned my personal side project into a real-world testbed for our internal software factory implementation. Over a few weeks, the factory created and wired 21 flags for me—and changed how I ship.

Seth Payne

![](https://images.prismic.io/launchdarkly/agdwsaYofJOwHSV2_sp.png?auto=format%2Ccompress&rect=0%2C0%2C756%2C692&w=3840&fit=max&q=80)

[Runtime Control](http://blog.launchdarkly.com/blog/control-panel-recap-six-product-updates/)

##### You can't control what you can't see

What LaunchDarkly showed live on the Control Panel: how to see what's happening in production, act on it in real time, and test on data you already trust.

Kellye King

![](https://images.prismic.io/launchdarkly/058f1522-7f2e-4557-9219-60c86483357d_kellye-king.png?auto=compress%2Cformat&rect=0%2C0%2C512%2C512&w=3840&fit=max&q=80)

[Feature Flags](http://blog.launchdarkly.com/blog/launchdarkly-is-native-on-the-vercel-marketplace/)

##### LaunchDarkly is now native on the Vercel Marketplace

You can now install LaunchDarkly from the Vercel Marketplace and evaluate your first flag in minutes. Start on our free Developer plan and upgrade when you need to, all managed from Vercel.

Bhargav Brahmbhatt

![Bhargav](https://images.prismic.io/launchdarkly/aDcniydWJ-7kSpNK_Bhargav.jpeg?auto=format%2Ccompress&rect=0%2C0%2C800%2C800&w=3840&fit=max&q=80)

[Runtime Control](http://blog.launchdarkly.com/blog/best-ci-cd-pipelines-for-containerized-ai-development/)

##### Best CI/CD Pipelines for Containerized AI Development

Containerized AI applications require sophisticated deployment infrastructure to manage Docker images.

Scarlett Attensil

![Scarlett Attensil](https://images.prismic.io/launchdarkly/agFEgaYofJOwHDIq_casual.jpg?auto=format%2Ccompress&rect=0%2C0%2C946%2C946&w=3840&fit=max&q=80)

[Experimentation](http://blog.launchdarkly.com/blog/ml-experiment-tracking/)

##### ML Experiment Tracking: What to Track Across Models, Data, and Production

The vast majority of teams working on large language models (LLMs) and machine learning (ML) systems diligently track hyperparameters.

Scarlett Attensil

![Scarlett Attensil](https://images.prismic.io/launchdarkly/agFEgaYofJOwHDIq_casual.jpg?auto=format%2Ccompress&rect=0%2C0%2C946%2C946&w=3840&fit=max&q=80)

[Experimentation](http://blog.launchdarkly.com/blog/mlops-experiment-tracking/)

##### Best Practices for Experiment Tracking in MLOps

Machine learning experimentation scales quickly.

Scarlett Attensil

![Scarlett Attensil](https://images.prismic.io/launchdarkly/agFEgaYofJOwHDIq_casual.jpg?auto=format%2Ccompress&rect=0%2C0%2C946%2C946&w=3840&fit=max&q=80)

[Engineering](http://blog.launchdarkly.com/blog/our-ai-software-factory-saved-me-from-an-incident/)

##### Stories from the Factory Floor: Our AI software factory saved me from an incident and I lived to tell the tale

Last summer, I shipped what I thought was a routine cleanup to production. It turned out to be a bug. But before the vast majority of users ever saw it, our AI software factory caught it and rolled back my change automatically.

Alex Engelberg

![](https://images.prismic.io/launchdarkly/oemXSDA2Jx2uXVeB_alexengelberg.jpeg?auto=format%2Ccompress&rect=0%2C0%2C512%2C512&w=3840&fit=max&q=80)

[AI Agents](http://blog.launchdarkly.com/blog/podcast-recap-observability-wont-save-your-agents/)

##### Podcast recap: Observability won’t save your agents

On a recent episode of the MonkCast, Marek Poliks spoke with James Governor about why governing agents from the outside leaves teams perpetually one step behind.

LaunchDarkly

![](https://images.prismic.io/launchdarkly/7b3f1666-a0e7-44f8-96c4-061bbb699f00_LD+Avatar+Blog.png?auto=compress%2Cformat&rect=0%2C0%2C688%2C688&w=3840&fit=max&q=80)

[AI Agents](http://blog.launchdarkly.com/blog/agent-optimization-launchdarkly-agentcontrol/)

##### Agent Optimization: Define what better means, and let AgentControl find it

Agent Optimization, now in beta in AgentControl, automatically searches for a better agent configuration against criteria you define.

Kelvin Yap

![](https://images.prismic.io/launchdarkly/aQLDI7pReVYa30dB_KelvinYap.jpeg?auto=format%2Ccompress&rect=0%2C0%2C512%2C512&w=3840&fit=max&q=80)

[Engineering](http://blog.launchdarkly.com/blog/building-a-software-factory-on-our-scariest-code/)

##### Stories from the Factory Floor: Building a software factory on our scariest code

We pointed coding agents at our oldest, most business-critical frontend. Here’s what it taught me about what a healthy AI software factory actually looks like.

Alexis Georges

![](https://images.prismic.io/launchdarkly/86b0b824-9b1d-4ff0-abc4-e314df15b779_avatar-small.jpg?auto=compress%2Cformat&rect=0%2C0%2C1000%2C1000&w=3840&fit=max&q=80)

[Engineering](http://blog.launchdarkly.com/blog/stories-from-the-factory-floor-empowering-agents-with-launchdarkly-mcp-tools/)

##### Stories from the Factory Floor: Empowering agents with LaunchDarkly MCP tools

A new capability on the LaunchDarkly MCP server offers a practical look at what an automated software factory could look like in practice.

Ramon Niebla

![](https://images.prismic.io/launchdarkly/0dooFAGEHAFNZRlN_IMG_1352.jpg?auto=format%2Ccompress&rect=0%2C0%2C3428%2C3455&w=3840&fit=max&q=80)

[Runtime Control](http://blog.launchdarkly.com/blog/why-ai-model-deployments-break-standard-cicd/)

##### Why AI deployment breaks standard CI/CD

Learn why AI deployment can break standard CI/CD and how runtime controls, shadow testing, rollouts, and rollback reduce risk.

Scarlett Attensil

![Scarlett Attensil](https://images.prismic.io/launchdarkly/agFEgaYofJOwHDIq_casual.jpg?auto=format%2Ccompress&rect=0%2C0%2C946%2C946&w=3840&fit=max&q=80)

[AI Agents](http://blog.launchdarkly.com/blog/entering-the-ai-software-factory-era/)

##### Entering the AI software factory era

What automating the SDLC at LaunchDarkly taught me about speed, control, and the job of an engineer.

Jonathan Nolen

![Jonathan Nolen](https://images.prismic.io/launchdarkly/a1d73547-7def-4215-8c76-c4211dd57078_jnolen.jpeg?auto=compress%2Cformat&rect=0%2C0%2C96%2C96&w=3840&fit=max&q=80)

[Runtime Control](http://blog.launchdarkly.com/blog/observability-is-not-enough/)

##### Observability is not enough

With runtime control, teams can extend observability by moving beyond reactive monitoring and toward proactive remediation.

Betsy Sallee

![](https://images.prismic.io/launchdarkly/2hwmD1ZRrCbQ8MJi_headshot.jpeg?auto=format%2Ccompress&rect=0%2C0%2C800%2C800&w=3840&fit=max&q=80)

[Experimentation](http://blog.launchdarkly.com/blog/warehouse-native-experimentation-comes-to-bigquery-databricks-and-redshift/)

##### Warehouse-native experimentation comes to BigQuery, Databricks, and Redshift

Analyze your experiments on the same trusted data your business already runs on, so results never come with an asterisk.

Lavanya Sureka

![](https://images.prismic.io/launchdarkly/afjexMBOoF08xmGL_Screenshot2026-05-04at12.00.29PM.png?auto=format%2Ccompress&rect=0%2C0%2C256%2C250&w=3840&fit=max&q=80)

[Developer productivity](http://blog.launchdarkly.com/blog/feature-flags-aws-devops-agent/)

##### Feature flags were always important. SRE agents make them essential.

AI-powered SRE agents are getting very good at identifying when something is wrong in production. What they haven't solved, however, and what most teams have dramatically underinvested in, is what happens after the agent knows.

Cameron Etezadi

![](https://images.prismic.io/launchdarkly/ajCD2Y1P9HI4UigO_headshot--cameron-etezadi.jpeg?auto=format%2Ccompress&rect=0%2C0%2C512%2C512&w=3840&fit=max&q=80)

[Developer productivity](http://blog.launchdarkly.com/blog/why-launchdarkly-is-standardizing-on-new-relic/)

##### Why LaunchDarkly is standardizing on New Relic

Today, we are announcing that LaunchDarkly is officially moving its primary observability and telemetry workloads to New Relic.

Cameron Etezadi

![](https://images.prismic.io/launchdarkly/ajCD2Y1P9HI4UigO_headshot--cameron-etezadi.jpeg?auto=format%2Ccompress&rect=0%2C0%2C512%2C512&w=3840&fit=max&q=80)

[Runtime Control](http://blog.launchdarkly.com/blog/speed-isnt-the-risk-lack-of-control-is/)

##### Speed isn't the risk. Lack of control is.

Why controlling code and agents in the AI era matters—and why we built AgentControl.

Kellye King

![](https://images.prismic.io/launchdarkly/058f1522-7f2e-4557-9219-60c86483357d_kellye-king.png?auto=compress%2Cformat&rect=0%2C0%2C512%2C512&w=3840&fit=max&q=80)

[Experimentation](http://blog.launchdarkly.com/blog/ai-experimentation/)

##### The Complete AI Experimentation Guide: Test, compare, validate, and ship safely

Artificial intelligence tools aren’t like traditional software.

Scarlett Attensil

![Scarlett Attensil](https://images.prismic.io/launchdarkly/agFEgaYofJOwHDIq_casual.jpg?auto=format%2Ccompress&rect=0%2C0%2C946%2C946&w=3840&fit=max&q=80)

[Feature Flags](http://blog.launchdarkly.com/blog/release-management-tools/)

##### Release management tools: What they are and how they work

Understanding the control layer between your CI/CD pipeline and your users.

Jesse Sumrak

![Jesse Sumrak headshot](https://images.prismic.io/launchdarkly/ZlpOyaWtHYXtT_Ly_Jesse-Face-400x400.png?auto=format%2Ccompress%3Fauto%3Dcompress%2Cformat&rect=0%2C0%2C400%2C400&w=3840&fit=max&q=80)

[Feature Flags](http://blog.launchdarkly.com/blog/feature-flags-vs-feature-branching/)

##### Feature flags vs. feature branching: Why you need both for faster, safer releases

Learn where each fits into your delivery workflow.

Jesse Sumrak

![Jesse Sumrak headshot](https://images.prismic.io/launchdarkly/ZlpOyaWtHYXtT_Ly_Jesse-Face-400x400.png?auto=format%2Ccompress%3Fauto%3Dcompress%2Cformat&rect=0%2C0%2C400%2C400&w=3840&fit=max&q=80)

### Resources to get started.


### Check out the blog.

Blog
Read about LaunchDarkly news, product updates, and more.

![](https://images.prismic.io/launchdarkly-marketingsite/agtlhaYofJOwHWAR_img-res-card--BLOG.png?auto=format%2Ccompress&fit=max&w=3840)


### Explore our docs.

Docs
Learn best practices for getting started with LaunchDarkly.

![](https://images.prismic.io/launchdarkly-marketingsite/agtlhqYofJOwHWAS_img-res-card--DOCS.png?auto=format%2Ccompress&fit=max&w=3840)


### Watch on demand.

Videos
Check out demos and tutorials to see LaunchDarkly in action.

![](https://images.prismic.io/launchdarkly-marketingsite/agtliKYofJOwHWAU_img-res-card--VIDEOS.png?auto=format%2Ccompress&fit=max&w=3840)


### Connect at events.

Events
Explore ways to connect with us in person and virtually.

![](https://images.prismic.io/launchdarkly-marketingsite/agtlh6YofJOwHWAT_img-res-card--Events.png?auto=format%2Ccompress&fit=max&w=3840)