So you embark on a second analytical step: multiple two-group comparisons. A modest six-group experiment suddenly requires testing 15 hypotheses. To manage this multiplicity, you apply corrections like Bonferroni, which undermine your statistical power. What you posed as a focused research question has sprawled into a complex web of subsidiary tests, forced by the ANOVA ritual.
Our new preprint, "Getting over ANOVA: Estimation graphics for multi-group comparisons," makes the case for a better approach. Estimation statistics encourages you to compare each test group to a single control, focusing on the effect sizes that actually matter. A six-group experiment focuses attention on just five effect sizes with confidence intervals, showing magnitude and precision directly.
The preprint introduces estimation methods for a range of multi-group designs: repeated-measures experiments, 2×2 factorial designs, binary outcome data, and mini-meta analysis for internal replicates. Each can replace data-analysis practices used in thousands of studies every year.
Read our new preprint here: https://doi.org/10.64898/2026.01.26.701654
Also posted on LinkedIn. #Statistics#OpenScience#DataVisualization #Research
RSS Feed