Resources What's New Support Download Contact Sales: Arthur-Industrial@outlook.com
Home › Resources › Hypothesis test chooser

Hypothesis test chooser

Which test to use for which question, with nonparametric alternatives.

The p-value is the chance of seeing a result at least this extreme if nothing were really different. If p is below α (usually 0.05), the difference is statistically significant. Always check whether the difference is large enough to matter.

QuestionDataTestNonparametric option
Is the mean equal to a target?1 group, measurements1-sample t1-sample Wilcoxon
Are two means different?2 independent groups2-sample t (Welch)Mann-Whitney
Did the same parts change?Before and after pairsPaired tWilcoxon signed rank
Are three or more means different?3+ groupsOne-way ANOVA, then TukeyKruskal-Wallis
Are the variances different?2+ groupsF test, Levene, BartlettLevene
Is a proportion equal to a target?Pass/fail counts1-proportion testExact binomial
Are two proportions different?Pass/fail, 2 groups2-proportion testFisher's exact
Are two categories related?Counts in a tableChi-squareFisher's exact
Are two measurements related?Paired measurementsPearson correlation, regressionSpearman
Is the data normal?1 groupAnderson-Darling-
TermMeaning
α (Type I error)Calling a difference real when it is not. Usually 0.05.
β (Type II error)Missing a real difference.
Power: the chance of detecting a real difference. Aim for 0.80 or more.
Null hypothesisThe starting assumption that there is no difference or effect.

← All articles