On-the-job evidence-based medicine training for clinician-scientists of the next generation

Clinical Biochemist Reviews

Volumn 34, Issue 2, 2013, Pages 93-103

  Leung, Elaine Y L ^a   Malick, Sadia M ^b   Khan, Khalid S ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b EAST SURREY HOSPITAL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84901980245     PISSN: 01598090     EISSN: 18380212     Source Type: Journal    
DOI: None     Document Type: Article

References (94)

1. Lundberg GD. The need for an outcomes research agendafor clinical laboratory testing. JAMA 1998;280:565-6.
2. Ross JS, Tse T, Zarin DA, Xu H, Zhou L, Krumholz HM. Publication of NIH funded trials registered inClinicalTrials.gov: cross sectional analysis. BMJ 2012;344:d7292.
3. Hart B, Lundh A, Bero L. Effect of reporting bias onmeta-analyses of drug trials: reanalysis of meta-analyses. BMJ 2012;344:d7202.
4. Phillips KA. The intersection of biotechnology andpharmacogenomics: health policy implications. HealthAff (Millwood) 2006;25:1271-80.
5. Singh H, Giardina TD, Meyer AN, Forjuoh SN, Reis MD, Thomas EJ. Types and origins of diagnostic errors inprimary care settings. JAMA Intern Med 2013;173:418-25.
6. Van Den Bos J, Rustagi K, Gray T, Halford M, Ziemkiewicz E, Shreve J. The $17.1 billion problem: the annual cost of measurable medical errors. Health Aff (Millwood) 2011;30:596-603.
7. Hayward RA, Asch SM, Hogan MM, Hofer TP, Kerr EA. Sins of omission: getting too little medical care maybe the greatest threat to patient safety. J Gen Intern Med 2005;20:686-91.
8. Price CP. Evidence-based laboratory medicine: is itworking in practice? Clin Biochem Rev 2012;33:13-9.
9. Price CP. Evidence-based laboratory medicine: supporting decision-making. Clin Chem 2000;46:1041-50.
10. McQueen MJ. Overview of evidence-based medicine: challenges for evidence-based laboratory medicine. ClinChem 2001;47:1536-46.
11. Hawkins RC. The Evidence Based Medicine approach to diagnostic testing: practicalities and limitations. ClinBiochem Rev 2005;26:7-18.
12. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Towards complete andaccurate reporting of studies of diagnostic accuracy: the STARD initiative. Clin Biochem 2003;36:2-7.
13. Whiting P, Rutjes AW, Dinnes J, Reitsma JB, Bossuyt PM, Kleijnen J. A systematic review finds that diagnosticreviews fail to incorporate quality despite available tools. J Clin Epidemiol 2005;58:1-12.
14. Siddiqui MA, Azuara-Blanco A, Burr J. The quality ofreporting of diagnostic accuracy studies published inophthalmic journals. Br J Ophthalmol 2005;89:261-5.
15. Fontela PS, Pant Pai N, Schiller I, Dendukuri N, Ramsay A, Pai M. Quality and reporting of diagnosticaccuracy studies in TB, HIV and malaria: evaluationusing QUADAS and STARD standards. PLoS One 2009;4:e7753.
16. Côté A-M, Brown MA, Lam E, von Dadelszen P, Firoz T, Liston RM, et al. Diagnostic accuracy ofurinary spot protein:creatinine ratio for proteinuria inhypertensive pregnant women: systematic review. BMJ 2008;336:1003-6.
17. Morris RK, Riley RD, Doug M, Deeks JJ, Kilby MD. Diagnostic accuracy of spot urinary protein and albuminto creatinine ratios for detection of significant proteinuriaor adverse pregnancy outcome in patients with suspectedpre-eclampsia: systematic review and meta-analysis. BMJ 2012;345:e4342.
18. Thangaratinam S, Coomarasamy A, O'Mahony F, Sharp S, Zamora J, Khan KS, et al. Estimation of proteinuria as apredictor of complications of pre-eclampsia: a systematicreview. BMC Med 2009;7:10.
19. Coomarasamy A, Khan KS. What is the evidence thatpostgraduate teaching in evidence based medicine changesanything? A systematic review. BMJ 2004;329:1017.
20. Khan KS, Coomarasamy A. A hierarchy of effectiveteaching and learning to acquire competence in evidencedbasedmedicine. BMC Med Educ 2006;6:59.
21. Kulier R, Gülmezoglu AM, Zamora J, Plana MN, Carroli G, Cecatti JG, et al. Effectiveness of a clinicallyintegrated e-learning course in evidence-based medicinefor reproductive health training: a randomized trial. JAMA 2012;308:2218-25.
22. Oude Rengerink K, Thangaratinam S, Barnfield G, Suter K, Horvath AR, Walczak J, et al. How can weteach EBM in clinical practice? An analysis of barriersto implementation of on-the-job EBM teaching andlearning. Med Teach 2011;33:e125-30.
23. Malick S, Das K, Khan KS. Tips for teaching evidencebasedmedicine in a clinical setting: lessons from adultlearning theory. Part two. J R Soc Med 2008;101:536-43.
24. Kitson A, Harvey G, McCormack B. Enabling theimplementation of evidence based practice: a conceptualframework. Qual Health Care 1998;7:149-58.
25. Grol R. Successes and failures in the implementation ofevidence-based guidelines for clinical practice. Med Care 2001;39:II46-54.
26. Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet 2003;362:1225-30.
27. Wensing M, Bal R, Friele R. Knowledge implementationin healthcare practice: a view from The Netherlands. BMJ Qual Saf 2012;21:439-42.
28. Australian Medical Council. Good Medical Practice: ACode of Conduct for Doctors in Australia. Section 14. Canberra: Australian Medical Council; 2009.
29. General Medical Council. Good Medical Practice (2013). Domain 1: Knowledge, Skills and Performance. GreatBritain: General Medical Council; 2013.
30. Davis D, Evans M, Jadad A, Perrier L, Rath D, Ryan D, et al. The case for knowledge translation: shortening thejourney from evidence to effect. BMJ 2003;327:33-5.
31. Davis D, O'Brien MA, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A. Impact of formalcontinuing medical education: do conferences, workshops, rounds, and other traditional continuingeducation activities change physician behavior or healthcare outcomes? JAMA 1999;282:867-74.
32. Grimshaw JM, Russell IT. Effect of clinical guidelineson medical practice: a systematic review of rigorousevaluations. Lancet 1993;342:1317-22.
33. Moscone F, Tosetti E, Costantini M, Ali M. The impactof scientific research on health care: Evidence from theOECD countries. Econ Model 2013;32:325-32.
34. Das K, Malick S, Khan KS. Tips for teaching evidencebasedmedicine in a clinical setting: lessons from adultlearning theory. Part one. J R Soc Med 2008;101:493-500.
35. Albanese MA, Mitchell S. Problem-based learning: areview of literature on its outcomes and implementationissues. Acad Med 1993;68:52-81.
36. Kulier R, Hadley J, Weinbrenner S, Meyerrose B, Decsi T, Horvath AR, et al. Harmonising evidence-basedmedicine teaching: a study of the outcomes of e-learningin five European countries. BMC Med Educ 2008;8:27.
37. Coppus SF, Emparanza JI, Hadley J, Kulier R, Weinbrenner S, Arvanitis TN, et al. A clinicallyintegrated curriculum in evidence-based medicine forjust-in-time learning through on-the-job training: the EUEBMproject. BMC Med Educ 2007;7:46.
38. Davis J, Chryssafidou E, Zamora J, Davies D, Khan K, Coomarasamy A. Computer-based teaching is as goodas face to face lecture-based teaching of evidence basedmedicine: a randomised controlled trial. BMC Med Educ 2007;7:23.
39. Davis J, Crabb S, Rogers E, Zamora J, Khan K. Computerbasedteaching is as good as face to face lecture-basedteaching of evidence based medicine: a randomizedcontrolled trial. Med Teach 2008;30:302-7.
40. Hadley J, Kulier R, Zamora J, Coppus SF, Weinbrenner S, Meyerrose B, et al. Effectiveness of an e-learning coursein evidence-based medicine for foundation (internship) training. J R Soc Med 2010;103:288-94.
41. Chretien KC, Azar J, Kind T. Physicians on Twitter. JAMA 2011;305:566-8.
42. Bahner DP, Adkins E, Patel N, Donley C, Nagel R, Kman NE. How we use social media to supplementa novel curriculum in medical education. Med Teach 2012;34:439-44.
43. DiVall MV, Kirwin JL. Using Facebook to facilitatecourse-related discussion between students and facultymembers. Am J Pharm Educ 2012;76:32.
44. Deenadayalan Y, Grimmer-Somers K, Prior M, Kumar S. How to run an effective journal club: a systematic review. J Eval Clin Pract 2008;14:898-911.
45. Harris J, Kearley K, Heneghan C, Meats E, Roberts N, Perera R, et al. Are journal clubs effective in supportingevidence-based decision making? A systematic review. BEME Guide No. 16. Med Teach 2011;33:9-23.
46. Taylor R, Reeves B, Ewings P, Binns S, Keast J, Mears R. A systematic review of the effectiveness of criticalappraisal skills training for clinicians. Med Educ 2000;34:120-5.
47. Parkes J, Hyde C, Deeks J, Milne R. Teaching criticalappraisal skills in health care settings. Cochrane DatabaseSyst Rev 2001;3,CD001270.
48. Flores-Mateo G, Argimon JM. Evidence based practice inpostgraduate healthcare education: a systematic review. BMC Health Serv Res 2007;7:119.
49. Afifi Y, Davis J, Khan K, Publicover M, Gee H. Thejournal club: a modern model for better service andtraining. Obstet Gynecol 2006;8:186-9.
50. American Association for Clinical Chemistry. JournalClub Articles. http://www.aacc.org/publications/clin_ chem/journalclub/pages/default.aspx (Accessed 2 June 2013).
51. Mandavilli A. Peer review: Trial by Twitter. Nature 2011;469:286-7.
52. Leung EY, Tirlapur SA, Siassakos D, Khan KS. #BlueJC: BJOG and Katherine Twining Network collaborateto facilitate post-publication peer review and enhanceresearch literacy via a Twitter journal club. BJOG 2013;120:657-60.
53. Eysenbach G. Can tweets predict citations? Metricsof social impact based on Twitter and correlation withtraditional metrics of scientific impact. J Med InternetRes 2011;13:e123.
54. Chretien KC, Kind T. Social media and clinical care: ethical, professional, and social implications. Circulation 2013;127:1413-21.
55. Cheston CC, Flickinger TE, Chisolm MS. Social mediause in medical education: a systematic review. Acad Med 2013;88:893-901.
56. Prasad K. Teaching evidence-based medicine in resourcelimitedcountries. JAMA 2012;308:2248-9.
57. Oude Rengerink K, Khan K, Horvath AR, Meyerrose B, Walczak J, Suter K, et al; EU EBM Unity. Who teachesthe evidence-based medicine teacher? Med Teach 2012;34:866.
58. Buckley S, Coleman J, Davison I, Khan KS, Zamora J, Malick S, et al. The educational effects of portfolios onundergraduate student learning: a Best Evidence MedicalEducation (BEME) systematic review. BEME Guide No. 11. Med Teach 2009;31:282-98.
59. Tochel C, Haig A, Hesketh A, Cadzow A, Beggs K, Colthart I, et al. The effectiveness of portfolios for postgraduateassessment and education: BEME Guide No 12. Med Teach 2009;31:299-318.
60. Shepard LA. The role of assessment in a learning culture. Educational Res 2000;29:4-14.
61. Boud D, Falchikov N. Aligning assessment with longtermlearning. Assess Eval High Educ 2006;31:399-413.
62. Jennings SF. Personal development plans and selfdirectedlearning for healthcare professionals: are theyevidence based? Postgrad Med J 2007;83:518-24.
63. Driessen E, van Tartwijk J, van der Vleuten C, Wass V. Portfolios in medical education: why do they meetwith mixed success? A systematic review. Med Educ 2007;41:1224-33.
64. Dekker H, Driessen E, Ter Braak E, Scheele F, Slaets J, Van Der Molen T, et al. Mentoring portfolio use inundergraduate and postgraduate medical education. MedTeach 2009;31:903-9.
65. Van Tartwijk J, Driessen EW. Portfolios for assessmentand learning: AMEE Guide no. 45. Med Teach 2009;31:790-801.
66. Coffield F, Moseley D, Hall E, Ecclestone K. Learningstyles and pedagogy in post-16 learning: a systematic andcritical review. London: Learning and Skills Research Centre; 2004.
67. Miller A, Archer J. Impact of workplace based assessmenton doctors' education and performance: a systematicreview. BMJ 2010;341:c5064.
68. Duque G, Finkelstein A, Roberts A, Tabatabai D, Gold SL, Winer LR; Members of the Division of GeriatricMedicine, McGill University. Learning while evaluating: the use of an electronic evaluation portfolio in a geriatricmedicine clerkship. BMC Med Educ 2006;6:4.
69. Lorenzo G, Ittelson J. An overview of e-portfolios. ELIPaper 1: 2005.
70. Pereira EA, Dean BJ. British surgeons' experiences ofmandatory online workplace-based assessment. J R SocMed 2009;102:287-93.
71. Tessmer M, Richey R. The role of context in learning andinstructional design. Educ Technol Res Dev 1997;45:85-115.
72. Roff S, McAleer S, Skinner A. Development andvalidation of an instrument to measure the postgraduateclinical learning and teaching educational environmentfor hospital-based junior doctors in the UK. Med Teach 2005;27:326-31.
73. Hoff TJ, Pohl H, Bartfield J. Creating a learningenvironment to produce competent residents: the roles ofculture and context. Acad Med 2004;79:532-9.
74. Slotnick HB. Physicians' learning strategies. Chest 2000;118(Suppl):18S-23S.
75. Bhandari M, Montori V, Devereaux PJ, Dosanjh S, Sprague S, Guyatt GH. Challenges to the practice ofevidence-based medicine during residents' surgicaltraining: a qualitative study using grounded theory. AcadMed 2003;78:1183-90.
76. Speck M. Best practice in professional development forsustained educational change. ERS Spectr 1996;14:33-41.
77. Kulier R, Khan KS, Gulmezoglu AM, Carroli G, Cecatti JG, Germar MJ, et al. A cluster randomized controlled trialto evaluate the effectiveness of the clinically integratedRHL evidence-based medicine course. Reprod Health 2010;7:8.
78. Burgers JS, Grol R, Klazinga NS, Mäkelä M, Zaat J; AGREE Collaboration. Towards evidence-based clinicalpractice: an international survey of 18 clinical guidelineprograms. Int J Qual Health Care 2003;15:31-45.
79. Horbar JD, Carpenter JH, Buzas J, Soll RF, Suresh G, Bracken MB, et al. Collaborative quality improvement topromote evidence based surfactant for preterm infants: acluster randomised trial. BMJ 2004;329:1004.
80. Rosenbaum SE, Glenton C, Cracknell J. Userexperiences of evidence-based online resources for healthprofessionals: user testing of The Cochrane Library. BMC Med Inform Decis Mak 2008;8:34.
81. Murthy L, Shepperd S, Clarke MJ, Garner SE, Lavis JN, Perrier L, et al. Interventions to improve the use ofsystematic reviews in decision-making by health systemmanagers, policy makers and clinicians. CochraneDatabase Syst Rev 2012;9:CD009401.
82. Pinkney T, Bartlett D, Hawkins W, Mak T, Youssef H, Futaba K, et al. Reduction of surgical site infection usinga novel intervention (ROSSINI): study protocol for arandomised controlled trial. Trials 2011;12:217.
83. Gheorghe A, Calvert M, Pinkney TD, Fletcher BR, Bartlett DC, Hawkins WJ, et al; West Midlands ResearchCollaborative; ROSSINI Trial Management Group. Systematic review of the clinical effectiveness of woundedgeprotection devices in reducing surgical site infectionin patients undergoing open abdominal surgery. AnnSurg 2012;255:1017-29.
84. Topping KJ. Trends in peer learning. Educ Psychol 2005;25:631-45.
85. Malick S. Peer assisted learning for doctors. BMJ Careers. July 2005. http://careers.bmj.com/careers/advice/viewarticle. html?id=1014 (Accessed 2 June 2013).
86. Matsui K, Ban N, Fukuhara S, Shimbo T, Koyama H, Nakamura S, et al. Poor English skills as a barrierfor Japanese health care professionals in learningand practising evidence-based medicine. Med Educ 2004;38:1204.
87. Letelier LM, Zamarin N, Andrade M, Gabrielli L, Caiozzi G, Viviani P, et al. Exploring language barriersto Evidence-based Health Care (EBHC) in post-graduatemedical students: a randomised trial. Educ Health (Abingdon) 2007;20:82.
88. Chen FM, Bauchner H, Burstin H. A call for outcomesresearch in medical education. Acad Med 2004;79:955-60.
89. Hemingway H, Croft P, Perel P, Hayden JA, Abrams K, Timmis A, et al; PROGRESS Group. Prognosis researchstrategy (PROGRESS) 1: a framework for researchingclinical outcomes. BMJ 2013;346:e5595.
90. Cook DA, West CP. Perspective: Reconsidering thefocus on "outcomes research" in medical education: acautionary note. Acad Med 2013;88:162-7.
91. Taylor R, Reeves B, Mears R, Keast J, Binns S, Ewings P, et al. Development and validation of a questionnaireto evaluate the effectiveness of evidence-based practiceteaching. Med Educ 2001;35:544-7.
92. Fritsche L, Greenhalgh T, Falck-Ytter Y, Neumayer H-H, Kunz R. Do short courses in evidence based medicineimprove knowledge and skills? Validation of Berlinquestionnaire and before and after study of courses inevidence based medicine. BMJ 2002;325:1338-41.
93. Ramos KD, Schafer S, Tracz SM. Validation of theFresno test of competence in evidence based medicine. BMJ 2003;326:319-21.
94. Mi M, Moseley JL, Green ML. An instrument tocharacterize the environment for residents' evidencebasedmedicine learning and practice. Fam Med 2012;44:98-104.