26 lines
683 B
Markdown
26 lines
683 B
Markdown
---
|
|
title: "Statistical Significance"
|
|
type: concept
|
|
tags: [statistics, experimentation]
|
|
sources: [project-management-experiment-tracker]
|
|
last_updated: 2026-04-20
|
|
---
|
|
|
|
## Definition
|
|
Statistical Significance indicates that an observed effect is unlikely to have occurred by random chance under the null hypothesis, according to a predefined threshold.
|
|
|
|
## Core Principles
|
|
- Define the alpha level before testing
|
|
- Distinguish significance from business impact
|
|
- Guard against multiple comparison inflation
|
|
- Report confidence intervals and effect sizes
|
|
|
|
## Related Concepts
|
|
- [[Hypothesis Testing]]
|
|
- [[A/B Testing]]
|
|
- [[Power Analysis]]
|
|
|
|
## Related Entities
|
|
- [[Experiment Tracker]]
|
|
|