Reporting transparency in analysis of variance assumption testing

Maxime Sainte-Marie, Asger Dalsgaard Pedersen, Philippe Mongeon

Research output: Contribution to book/anthology/report/proceedingArticle in proceedingsResearchpeer-review


ANOVA models in general are valid only insofar as both homoscedasticity and multiple comparisons between groups are controlled for. While recent studies suggest that researchers in various disciplines seldom comply with these requirements, lack of rigor in methodological reporting makes a proper, large-scale, and transdisciplinary assessment of the situation impossible. Given this situation, the present paper attempts a large-scale and transdisciplinary assessment of statistical reporting transparency in ANOVA-related papers, using customized regular expressions on the full-text of articles published in Elsevier journals. Results show that, beyond important variations at multiple disciplinary levels, reporting transparency in the testing of ANOVA statistical assumptions is generally lacking, as a minority of ANOVA-related papers refer to either homoscedasticity or multiplicity correction. Also, articles from higher-quartile journals tend to report statistical assumptions more thoroughly than those from lower-quartile journals, regardless of discipline or subdiscipline.

Original languageEnglish
Title of host publication18th Internaitonal Conference on Scientometrics & Informetrics ISSI2021, 12–15 July 2021 KU Leuven, Belgium, Proceedings
EditorsWolfgang Glanzel, Sarah Heeffer, Pei-Shan Chi, Ronald Rousseau
Number of pages12
PublisherInternational Society for Scientometrics and Informetrics
Publication date2021
ISBN (Print)9789080328228
Publication statusPublished - 2021
Event18th International Conference on Scientometrics and Informetrics Conference, ISSI 2021 - Leuven, Belgium
Duration: 12 Jul 202115 Jul 2021


Conference18th International Conference on Scientometrics and Informetrics Conference, ISSI 2021
SponsorDigital Science, Elsevier, et al, JDIS, Massachusetts Institute of Technology (MIT), RISIS
SeriesProceedings of the International Conference on Scientometrics and Informetrics




Dive into the research topics of 'Reporting transparency in analysis of variance assumption testing'. Together they form a unique fingerprint.

Cite this