A randomized trial in a massive online open course shows people don't know what a statistically significant relationship looks like, but they can learn

PeerJ

Volumn 2014, Issue 1, 2014, Pages

  Fisher, Aaron ^a   Brooke Anderson, G ^b   Peng, Roger ^a   Leek, Jeff ^a  

^a JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^b Department of Environmental and Radiological Health Sciences   (United States)

Author keywords

Data visualization; Education; Evidenced based data analysis; MOOC; p values; Randomized trial; Statistical significance; Statistics

Indexed keywords

ARTICLE; CLASSIFICATION; DATA ANALYSIS; EDUCATION PROGRAM; EVIDENCE BASED PRACTICE; HUMAN; INTERVIEW; MASSIVE OPEN ONLINE COURSE; PERCEPTIVE DISCRIMINATION; PLOTS AND CURVES; SCATTER PLOT; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS; STATISTICAL CONCEPTS; STATISTICAL SIGNIFICANCE; STUDENT; THEORY-PRACTICE RELATIONSHIP;

EID: 84911363715     PISSN: None     EISSN: 21678359     Source Type: Journal    
DOI: 10.7717/peerj.589     Document Type: Article

References (20)

1. Belia S, Fidler F, Williams J, Cumming G. 2005. Researchers misunderstand confidence intervals and standard error bars. Psychological Methods 10:389-396 DOI 10.1037/1082-989X.10.4.389.
2. Berk R, Brown L, Zhao L. 2010. Statistical inference after model selection. Journal of Quantitative Criminology 26:217-236 DOI 10.1007/s10940-009-9077-7.
3. Beyth-Marom R, Fidler F, Cumming G. 2008. Statistical cognition: towards evidence-based practice in statistics and statistics education. Statistics Education Research Journal 7:20-39.
4. Cassidy J. 2013. The reinhart and rogoffcontroversy: a summing up. The New Yorker. Available at http://www.newyorker.com/news/john-cassidy/the-reinhart-and-rogoff-controversy-a-summingup (accessed 21 August 2014).
5. ClevelandWS, Diaconis P, McGill R. 1982. Variables on scatterplots look more highly correlated when the scales are increased. Science 216:1138-1141 DOI 10.1126/science.216.4550.1138.
6. ClevelandWS, McGill R. 1985. Graphical perception and graphical methods for analyzing scientific data. Science 229:828-833 DOI 10.1126/science.229.4716.828.
7. Do CB, Chen Z, Brandman R, Koller D. 2013. Self-driven mastery in massive open online courses. MOOCs Forum 1:14-16 DOI 10.1089/mooc.2013.0003.
8. Gastwirth JL. 1988. Statistical reasoning in law and public policy: volume 2: Tort law, evidence and health. San Diego, CA: Academic Press.
9. Heer J, Bostock M. 2010. Crowdsourcing graphical perception: using mechanical turk to assess visualization design. In: ACM human factors in computing systems (CHI), 203-212.
10. Jager LR, Leek JT. 2007. Empirical estimates suggest most published medical research is true. PLoS Medicine 4:e168 DOI 10.1371/journal.pmed.0040168.
11. Ledford H. 2011. Paper on genetics of longevity retracted. Nature. Available at http://www.nature.com/news/2011/110721/full/news.2011.429.html (accessed 21 August 2014).
12. Liyanagunawardena TR, Adams AA, Williams SA. 2013. MOOCs: a systematic study of the published literature 2008-2012. The International Review of Research in Open and Distance Learning 14:202-227.
13. Mak S, Fai J, Williams R, Mackness J. 2010. Blogs and forums as communication and learning tools in a MOOC. In: Networked learning conference, Aarlborg, 275-284. Available at http://www.lancs.ac.uk/fss/organisations/netlc/past/nlc2010/abstracts/Mak.html.
14. Meyer J, Shinar D. 1992. Estimating correlations from scatterplots. Human Factors: The Journal of the Human Factors and Ergonomics Society 34:335-349.
15. Nuzzo R. 2014. Scientific method: statistical errors. Nature 506:150-152 DOI 10.1038/506150a.
16. Pelley S. 2012. Deception at Duke: fraud in cancer care? CBS - 60 Minutes. Available at http://www.cbsnews.com/news/deception-at-duke-fraud-in-cancer-care (accessed 21 August 2014).
17. Rensink RA, Baldridge G. 2010. The perception of correlation in scatterplots. Computer Graphics Forum 29:1203-1210 DOI 10.1111/j.1467-8659.2009.01694.x.
18. Schwartz LM, Woloshin S, BlackWC, Welch HG. 1997. The role of numeracy in understanding the benefit of screening mammography. Annals of Internal Medicine 127:966-972 DOI 10.7326/0003-4819-127-11-199712010-00003.
19. Sheridan SL, Pignone MP, Lewis CL. 2003. A randomized comparison of patients' understanding of number needed to treat and other common risk reduction formats. Journal of General Internal Medicine 18:884-892 DOI 10.1046/j.1525-1497.2003.21102.x.
20. Tufte ER, Graves-Morris P. 1983. The visual display of quantitative information. Vol. 2. Cheshire, CT: Graphics press.