TY - GEN
T1 - Reporting transparency in analysis of variance assumption testing
AU - Sainte-Marie, Maxime
AU - Pedersen, Asger Dalsgaard
AU - Mongeon, Philippe
PY - 2021
Y1 - 2021
N2 - ANOVA models in general are valid only insofar as both homoscedasticity and multiple comparisons between groups are controlled for. While recent studies suggest that researchers in various disciplines seldom comply with these requirements, lack of rigor in methodological reporting makes a proper, large-scale, and transdisciplinary assessment of the situation impossible. Given this situation, the present paper attempts a large-scale and transdisciplinary assessment of statistical reporting transparency in ANOVA-related papers, using customized regular expressions on the full-text of articles published in Elsevier journals. Results show that, beyond important variations at multiple disciplinary levels, reporting transparency in the testing of ANOVA statistical assumptions is generally lacking, as a minority of ANOVA-related papers refer to either homoscedasticity or multiplicity correction. Also, articles from higher-quartile journals tend to report statistical assumptions more thoroughly than those from lower-quartile journals, regardless of discipline or subdiscipline.
AB - ANOVA models in general are valid only insofar as both homoscedasticity and multiple comparisons between groups are controlled for. While recent studies suggest that researchers in various disciplines seldom comply with these requirements, lack of rigor in methodological reporting makes a proper, large-scale, and transdisciplinary assessment of the situation impossible. Given this situation, the present paper attempts a large-scale and transdisciplinary assessment of statistical reporting transparency in ANOVA-related papers, using customized regular expressions on the full-text of articles published in Elsevier journals. Results show that, beyond important variations at multiple disciplinary levels, reporting transparency in the testing of ANOVA statistical assumptions is generally lacking, as a minority of ANOVA-related papers refer to either homoscedasticity or multiplicity correction. Also, articles from higher-quartile journals tend to report statistical assumptions more thoroughly than those from lower-quartile journals, regardless of discipline or subdiscipline.
KW - ANOVA
UR - http://www.scopus.com/inward/record.url?scp=85112617475&partnerID=8YFLogxK
M3 - Article in proceedings
AN - SCOPUS:85112617475
SN - 9789080328228
T3 - Proceedings of the International Conference on Scientometrics and Informetrics
SP - 967
EP - 978
BT - 18th Internaitonal Conference on Scientometrics & Informetrics ISSI2021, 12–15 July 2021 KU Leuven, Belgium, Proceedings
A2 - Glanzel, Wolfgang
A2 - Heeffer, Sarah
A2 - Chi, Pei-Shan
A2 - Rousseau, Ronald
PB - International Society for Scientometrics and Informetrics
T2 - 18th International Conference on Scientometrics and Informetrics Conference, ISSI 2021
Y2 - 12 July 2021 through 15 July 2021
ER -