Hypothesis testing is a statistical inference procedure for deciding, on the basis of sample data, whether to reject a null hypothesis in favour of an alternative, using a test statistic and a pre-specified significance level. It underpins experimental design by providing the formal framework for determining whether an observed effect is unlikely to have arisen by chance. Bayesian decision theory offers an alternative, probability-based framework for the same class of decisions.

Provenance