The Danish Centre for Studies in Research and Research Policy

Reporting transparency in analysis of variance assumption testing

Research output: Contribution to book/anthology/report/proceedingArticle in proceedingsResearchpeer-review

ANOVA models in general are valid only insofar as both homoscedasticity and multiple comparisons between groups are controlled for. While recent studies suggest that researchers in various disciplines seldom comply with these requirements, lack of rigor in methodological reporting makes a proper, large-scale, and transdisciplinary assessment of the situation impossible. Given this situation, the present paper attempts a large-scale and transdisciplinary assessment of statistical reporting transparency in ANOVA-related papers, using customized regular expressions on the full-text of articles published in Elsevier journals. Results show that, beyond important variations at multiple disciplinary levels, reporting transparency in the testing of ANOVA statistical assumptions is generally lacking, as a minority of ANOVA-related papers refer to either homoscedasticity or multiplicity correction. Also, articles from higher-quartile journals tend to report statistical assumptions more thoroughly than those from lower-quartile journals, regardless of discipline or subdiscipline.

Original languageEnglish
Title of host publication18th Internaitonal Conference on Scientometrics & Informetrics ISSI2021, 12–15 July 2021 KU Leuven, Belgium, Proceedings
EditorsWolfgang Glanzel, Sarah Heeffer, Pei-Shan Chi, Ronald Rousseau
Number of pages12
PublisherInternational Society for Scientometrics and Informetrics
Publication year2021
Pages967-978
ISBN (print)9789080328228
Publication statusPublished - 2021
Event18th International Conference on Scientometrics and Informetrics Conference, ISSI 2021 - Leuven, Belgium
Duration: 12 Jul 202115 Jul 2021

Conference

Conference18th International Conference on Scientometrics and Informetrics Conference, ISSI 2021
LandBelgium
ByLeuven
Periode12/07/202115/07/2021
SponsorDigital Science, Elsevier, et al, JDIS, MIT Press, RISIS
SeriesProceedings of the International Conference on Scientometrics and Informetrics
ISSN2175-1935

    Research areas

  • ANOVA

See relations at Aarhus University Citationformats

ID: 224800123