Sydney Medical School, University of Sydney, Sydney, NSW, Australia.
Neuroscience Research Australia (NeuRA), Randwick, NSW, Australia.
PLoS One. 2018 Aug 15;13(8):e0202121. doi: 10.1371/journal.pone.0202121. eCollection 2018.
The Journal of Physiology and British Journal of Pharmacology jointly published an editorial series in 2011 to improve standards in statistical reporting and data analysis. It is not known whether reporting practices changed in response to the editorial advice. We conducted a cross-sectional analysis of reporting practices in a random sample of research papers published in these journals before (n = 202) and after (n = 199) publication of the editorial advice. Descriptive data are presented. There was no evidence that reporting practices improved following publication of the editorial advice. Overall, 76-84% of papers with written measures that summarized data variability used standard errors of the mean, and 90-96% of papers did not report exact p-values for primary analyses and post-hoc tests. 76-84% of papers that plotted measures to summarize data variability used standard errors of the mean, and only 2-4% of papers plotted raw data used to calculate variability. Of papers that reported p-values between 0.05 and 0.1, 56-63% interpreted these as trends or statistically significant. Implied or gross spin was noted incidentally in papers before (n = 10) and after (n = 9) the editorial advice was published. Overall, poor statistical reporting, inadequate data presentation and spin were present before and after the editorial advice was published. While the scientific community continues to implement strategies for improving reporting practices, our results indicate stronger incentives or enforcements are needed.
《生理学杂志》和《英国药理学杂志》于 2011 年联合发表了一系列社论,以提高统计报告和数据分析的标准。目前尚不清楚这些社论建议是否会改变报告实践。我们对这两个期刊发表的研究论文进行了横断面分析,这些论文在社论建议发表之前(n=202)和之后(n=199)随机抽取。呈现描述性数据。没有证据表明在发表社论建议后报告实践有所改善。总体而言,76-84%的书面报告数据变异性的论文使用了均数的标准误差,90-96%的论文没有报告主要分析和事后检验的确切 p 值。76-84%的论文使用均数的标准误差来绘制汇总数据变异性的图表,只有 2-4%的论文绘制了用于计算变异性的原始数据。在报告 p 值在 0.05 和 0.1 之间的论文中,56-63%的论文将其解释为趋势或具有统计学意义。在社论建议发表之前(n=10)和之后(n=9)的论文中,偶然注意到隐含或明显的歪曲。总体而言,在社论建议发表前后,统计报告不佳、数据呈现不足和歪曲现象普遍存在。尽管科学界继续实施改善报告实践的策略,但我们的结果表明需要更强有力的激励或执行措施。