Sharing successes and hiding failures: ‘reporting bias’ in learning and teaching research

Studies in Higher Education

Volumn 43, Issue 8, 2018, Pages 1405-1416

  Dawson, Phillip ^a   Dawson, Samantha L ^a,b  

^a DEAKIN UNIVERSITY   (Australia)

^b ROYAL CHILDREN'S HOSPITAL   (Australia)

Author keywords

academic freedom; publication bias; Reporting bias; research synthesis; Scholarship of Teaching and Learning

Indexed keywords

EID: 84996946528     PISSN: 03075079     EISSN: 1470174X     Source Type: Journal    
DOI: 10.1080/03075079.2016.1258052     Document Type: Article

References (45)

1. Abdel Latif, Muhammad M. M., 2014. “Academic Freedom: Problems in Conceptualization and Research.” Higher Education Research & Development 33 (2): 399–401. doi:10.1080/07294360.2014.881766
2. Bearman, Margaret, and Phillip, Dawson. 2013. “Qualitative Synthesis and Systematic Review in Health Professions Education.” Medical Education 47 (3): 252–60. doi:10.1111/medu.12092
3. Bearman, Margaret, Calvin D., Smith, Angela, Carbone, Susan, Slade, Chi, Baik, Marnie, Hughes-Warrington, and David L., Neumann. 2012. “Systematic Review Methodology in Higher Education.” Higher Education Research & Development 31 (5): 625–40. doi:10.1080/07294360.2012.702735
4. Bhatia, Aatish., 2014. “Active Learning Leads to Higher Grades and Fewer Failing Students in Science, Math, and Engineering.” Wired. Accessed November 9, 2015. http://www.wired.com/2014/05/empzeal-active-learning/
5. Black, Erik W., Kara, Dawson, and Jason, Priem. 2008. “Data for Free: Using LMS Activity Logs to Measure Community in Online Courses.” The Internet and Higher Education 11 (2): 65–70. doi:10.1016/j.iheduc.2008.03.002
6. Bourgeois, Florence T., Srinivas, Murthy, and Kenneth D., Mandl. 2010. “Outcome Reporting among Drug Trials Registered in ClinicalTrials.gov.” Annals of Internal Medicine 153 (3): 158–66. doi:10.7326/0003–4819-153-3-201008030-00006 doi: 10.7326/0003-4819-153-3-201008030-00006
7. Clow, Doug, Rebecca, Ferguson, Leah, Macfadyen, Paul, Prinsloo, and Sharon, Slade. 2016. “LAK Failathon.” Proceedings of the sixth international conference on learning analytics & knowledge, Edinburgh, UK, April 25–29
8. Cohen, Jacob., 1988. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: L. Erlbaum Associates
9. Cooper, Harris, Kristina, DeNeve, and Kelly, Charlton. 1997. “Finding the Missing Science: The Fate of Studies Submitted for Review by a Human Subjects Committee.” Psychological Methods 2 (4): 447–52. doi:10.1037/1082-989X.2.4.447
10. Crossref. 2015a. “Fundref Search: Higher Education Academy.” Accessed November 10, 2015. http://search.crossref.org/fundref?q=501100000661
11. Crossref. 2015b. “Fundref Search: Joint Information Systems Committee.” Accessed November 10, 2015. http://search.crossref.org/fundref?q=501100000821
12. Crossref. 2015c. “Fundref Search: Office for Learning and Teaching.” Accessed November 10, 2015. http://search.crossref.org/fundref?q=501100000932
13. Davies, Mark., 2015. “Academic Freedom: A Lawyer’s Perspective.” Higher Education 70 (6): 987–1002. doi:10.1007/s10734-015-9884-8
14. Dawson, Phillip, Jacques, van der Meer, Jane, Skalicky, and Kym, Cowley. 2014. “On the Effectiveness of Supplemental Instruction: A Systematic Review of Supplemental Instruction and Peer-Assisted Study Sessions Literature Between 2001 and 2010.” Review of Educational Research 84 (4): 609–39. doi:10.3102/0034654314540007
15. Duval, Sue, and Richard, Tweedie. 2000. “Trim and Fill: A Simple Funnel-Plot-Based Method of Testing and Adjusting for Publication Bias in Meta-analysis.” Biometrics 56 (2): 455–63. doi:10.1111/j.0006-341X.2000.00455.x
16. Findley, Michael, Nathan Jensen, Edmund Malesky, and Thomas Pepinsky. 2014. “Special Issue of Comparative Political Studies on Transparency in the Social Sciences.” University of Texas at Austin. Accessed November 12, 2015. http://www.ipdutexas.org/cps-transparency-special-issue.html
17. Franco, Annie, Neil, Malhotra, and Gabor, Simonovits. 2014. “Publication Bias in the Social Sciences: Unlocking the File Drawer.” Science 345 (6203): 1502–5. doi:10.1126/science.1255484
18. Freeman, Scott, Sarah L., Eddy, Miles, McDonough, Michelle K., Smith, Nnadozie, Okoroafor, Hannah, Jordt, and Mary Pat, Wenderoth. 2014. “Active Learning Increases Student Performance in Science, Engineering, and Mathematics.” Proceedings of the National Academy of Sciences. doi:10.1073/pnas.1319030111
19. Greenwald, Anthony G., 1975. “Consequences of Prejudice Against the Null Hypothesis.” Psychological Bulletin 82 (1): 1–20. doi:10.1037/h0076157
20. Hattie, John., 2009. Visible Learning: A Synthesis of over 800 Meta-analyses Relating to Achievement. Abingdon: Routledge
21. Higgins, Julian P. T., and S., Green. 2011. Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration. http://www.cochrane-handbook.org
22. Higgins, Julian P. T., and Simon G., Thompson. 2002. “Quantifying Heterogeneity in a Meta-analysis.” Statistics in Medicine 21 (11): 1539–58. doi:10.1002/sim.1186
23. Higgins, Julian P. T., Simon G., Thompson, Jonathan J., Deeks, and Douglas G., Altman. 2003. “Measuring Inconsistency in Meta-analyses.” British Medical Journal 327 (7414): 557–60. doi:10.1136/bmj.327.7414.557
24. Ioannidis, John P. A., 2005. “Why Most Published Research Findings Are False.” PLoS Medicine 2 (8): e124. doi:10.1371/journal.pmed.0020124
25. Kreber, Carolin., 2002. “Teaching Excellence, Teaching Expertise, and the Scholarship of Teaching.” Innovative Higher Education 27 (1): 5–23. doi:10.1023/a:1020464222360
26. Lipsey, Mark W., and David B., Wilson. 1993. “The Efficacy of Psychological, Educational, and Behavioral Treatment: Confirmation from Meta-analysis.” American Psychologist 48 (12): 1181–1209. doi: 10.1037/0003-066X.48.12.1181
27. Macfarlane, Bruce., 2011. “The Morphing of Academic Practice: Unbundling and the Rise of the Para-academic.” Higher Education Quarterly 65 (1): 59–73. doi:10.1111/j.1468-2273.2010.00467.x
28. Makel, Matthew C., and Jonathan A., Plucker. 2014. “Facts Are More Important Than Novelty: Replication in the Education Sciences.” Educational Researcher 43 (6): 304–16. doi:10.3102/0013189×14545513 doi: 10.3102/0013189X14545513
29. Open Science Framework. 2016. OSF | Registered Reports Wiki. Center for Open Science. Accessed October 7, 2016. https://osf.io/8mpji/wiki/home/
30. Peters, Jaime L., Alex J., Sutton, David R., Jones, Keith R., Abrams, and Lesley, Rushton. 2008. “Contour-Enhanced Meta-analysis Funnel Plots Help Distinguish Publication Bias from Other Causes of Asymmetry.” Journal of Clinical Epidemiology 61 (10): 991–96. doi:10.1016/j.jclinepi.2007.11.010
31. Pigott, Therese D., Jeffrey C., Valentine, Joshua R., Polanin, Ryan T., Williams, and Dericka D., Canada. 2013. “Outcome-Reporting Bias in Education Research.” Educational Researcher 42 (8): 424–32. doi:10.3102/0013189×13507104 doi: 10.3102/0013189X13507104
32. Polanin, Joshua R., Emily E., Tanner-Smith, and Emily A., Hennessy. 2015. “Estimating the Difference Between Published and Unpublished Effect Sizes: A Meta-review.” Review of Educational Research. doi:10.3102/0034654315582067
33. R: A language and environment for statistical computing (Version 3.2.0). 2015. Vienna: R Foundation for Statistical Computing
34. Sandelowski, Margarete, Corrine I., Voils, Jennifer, Leeman, and Jamie L., Crandell. 2012. “Mapping the Mixed Methods–Mixed Research Synthesis Terrain.” Journal of Mixed Methods Research 6 (4): 317–31. doi:10.1177/1558689811427913
35. Seltzer, Wendy., 2010. “Free Speech Unmoored in Copyright’s Safe Harbor: Chilling Effects of the DMCA on the First Amendment.” Harvard Journal of Law & Technology 24 (1): 171–232
36. Selwyn, Neil., 2010. “Looking beyond Learning: Notes Towards the Critical Study of Educational Technology.” Journal of Computer Assisted Learning 26 (1): 65–73. doi:10.1111/j.1365-2729.2009.00338.x
37. Selwyn, Neil., 2011. “Editorial: In Praise of Pessimism–the Need for Negativity in Educational Technology.” British Journal of Educational Technology 42 (5): 713–18. doi:10.1111/j.1467-8535.2011.01215.x
38. Tight, Malcolm., 2012. “Higher Education Research 2000–2010: Changing Journal Publication Patterns.” Higher Education Research & Development 31 (5): 723–40. doi:10.1080/07294360.2012.692361
39. Tight, Malcolm., 2013. “Discipline and Methodology in Higher Education Research.” Higher Education Research & Development 32 (1): 136–51. doi:10.1080/07294360.2012.750275
40. “Times Higher Education World University Rankings: About.” 2015. Times Higher Education. TES Global. Accessed November 13, 2015. https://www.timeshighereducation.com/news/ranking-methodology-2016
41. Turner, E. H., A. M., Matthews, E., Linardatos, R. A., Tell, and R., Rosenthal. 2008. “Selective Publication of Antidepressant Trials and Its Influence on Apparent Efficacy.” New England Journal of Medicine 358 (3): 252–60. doi:10.1056/NEJMsa065779
42. Vardi, Iris., 2011. “The Changing Relationship Between the Scholarship of Teaching (and Learning) and Universities.” Higher Education Research & Development 30 (1): 1–7. doi:10.1080/07294360.2011.536968
43. Viechtbauer, Wolfgang., 2010. “Conducting Meta-analyses in R with the Metafor Package.” Journal of Statistical Software 36 (3): 48. doi:10.18637/jss.v036.i03
44. Wang, Feng, and Michael J., Hannafin. 2005. “Design-based Research and Technology-Enhanced Learning Environments.” Educational Technology Research and Development 53 (4): 5–23. doi:10.1007/BF02504682
45. Whittington, C. J., T., Kendall, P., Fonagy, D., Cottrell, A., Cotgrove, and E., Boddington. 2004. “Selective Serotonin Reuptake Inhibitors in Childhood Depression: Systematic Review of Published Versus Unpublished Data.” The Lancet 363 (9418): 1341–45. doi:10.1016/s0140-6736(04)16043-1