---
title: "Statistical Significance"
type: concept
tags: [statistics, experimentation]
sources: [project-management-experiment-tracker]
last_updated: 2026-04-20
---

## Definition
Statistical Significance indicates that an observed effect is unlikely to have occurred by random chance under the null hypothesis, according to a predefined threshold.

## Core Principles
- Define the alpha level before testing
- Distinguish significance from business impact
- Guard against multiple comparison inflation
- Report confidence intervals and effect sizes

## Related Concepts
- [[Hypothesis Testing]]
- [[A/B Testing]]
- [[Power Analysis]]

## Related Entities
- [[Experiment Tracker]]