Files
nexus/wiki/concepts/Statistical-Significance.md

683 B

title, type, tags, sources, last_updated
title type tags sources last_updated
Statistical Significance concept
statistics
experimentation
project-management-experiment-tracker
2026-04-20

Definition

Statistical Significance indicates that an observed effect is unlikely to have occurred by random chance under the null hypothesis, according to a predefined threshold.

Core Principles

  • Define the alpha level before testing
  • Distinguish significance from business impact
  • Guard against multiple comparison inflation
  • Report confidence intervals and effect sizes