nexus/sreweekly/markdown/143/01-how-etsy-handles-peeking-in-a-b-testing.md

How Etsy Handles Peeking in A/B Testing

• 期号: SRE Weekly Issue #143（2018-10-14）
• 作者: Callie McRee and Kelly Shen — Etsy
• 链接: https://codeascraft.com/2018/10/03/how-etsy-handles-peeking-in-a-b-testing/

简介

There’s some great statistics theory in here. The challenge is: how can you have accurate, useful A/B tests without having to wait a long time to get a big enough sample size? Can you bail out early if you know the test has already failed? Can you refine the new feature mid-test?

正文

⚠️ 抓取失败：HTTP 403