Challenges in systematic reviews of educational intervention studies

Annals of Internal Medicine

Volumn 142, Issue 12 II, 2005, Pages 1080-1089

  Reed, Darcy ^a,b   Price, Eboni G ^a   Windish, Donna M ^a   Wright, Scott M ^a   Gozu, Aysegul ^a   Hsu, Edbert B ^a   Beach, Mary Catherine ^a   Kern, David ^a   Bass, Eric B ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b Mayo Clinic College of Medicine   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA BASE; EVIDENCE BASED MEDICINE; HEALTH BEHAVIOR; HUMAN; MEDICAL EDUCATION; MEDICAL RESEARCH; METHODOLOGY; PHYSICAL ACTIVITY; PRACTICE GUIDELINE; PRIORITY JOURNAL; PUBLICATION; RELIABILITY; REVIEW; SYSTEMATIC REVIEW; VALIDATION PROCESS;

EID: 20544470961     PISSN: 00034819     EISSN: None     Source Type: Journal    
DOI: 10.7326/0003-4819-142-12_part_2-200506211-00008     Document Type: Review

References (53)

1. Harden RM. BEME guide no. 1: best evidence medical education. Medical Teacher. 1999;21:553-62.
2. Torgerson CJ. Educational research and randomised trials. Med Educ. 2002; 36:1002-3. [PMID: 12406259]
3. Chen FM, Bauchner H, Burstin H. A call for outcomes research in medical education. Acad Med. 2004;79:955-60. [PMID: 15383351]
4. Dauphinee WD, Wood-Dauphinee S. The need for evidence in medical education: the development of best evidence medical education as an opportunity to inform, guide, and sustain medical education research. Acad Med. 2004;79: 925-30. [PMID: 15383347]
5. Prystowsky JB, Bordage G. An outcomes research perspective on medical education: the predominance of trainee assessment and satisfaction. Med Educ. 2001;35:331-6. [PMID: 11318995]
6. Lang TA. The value of systematic reviews as research activities in medical education. Acad Med. 2004;79:1067-72. [PMID: 15504773]
7. Bowen JL, Irby DM. Assessing quality and costs of education in the ambulatory setting: a review of the literature. Acad Med. 2002;77:621-80. [PMID: 12114139]
8. Hebert RS, Levine RB, Smith CG, Wright SM. A systematic review of resident research curricula. Acad Med. 2003;78:61-8. [PMID: 12525411]
9. Coomarasamy A, Taylor R, Khan KS. A systematic review of postgraduate teaching in evidence-based medicine and critical appraisal. Med Teach. 2003;25: 77-81. [PMID: 14741863]
10. Taylor R, Reeves B, Ewings P, Binns S, Keast J, Mears R. A systematic review of the effectiveness of critical appraisal skills training for clinicians. Med Educ. 2000;34:120-5. [PMID: 10652064]
11. Winemiller DR, Mitchell ME, Sutliff J, Cline DJ. Measurement strategies in social support: a descriptive review of the literature. J Clin Psychol. 1993;49:638-48. [PMID: 8254070]
12. Torgerson CJ, Elbourne D. A systematic review and meta-analysis of the effectiveness of information and communication technology (ICT) on the teaching of spelling. Journal of Research in Reading. 2002;25:129-43.
13. Coren E, Barlow J, Stewart-Brown S. The effectiveness of individual and group-based parenting programmes in improving outcomes for teenage mothers and their children: a systematic review. J Adolesc. 2003;26:79-103. [PMID: 12550823]
14. Mytton JA, DiGuiseppi C, Gough DA, Taylor RS, Logan S. School-based violence prevention programs: systematic review of secondary prevention trials. Arch Pediatr Adolesc Med. 2002;156:752-62. [PMID: 12144364]
15. Riemsma RP, Taal E, Kirwan JR, Rasker JJ. Systematic review of rheumatoid arthritis patient education. Arthritis Rheum. 2004;51:1045-59. [PMID: 15593105]
16. Warsi A, Wang PS, LaValley MP, Avorn J, Solomon DH. Self-management education programs in chronic disease: a systematic review and methodologic critique of the literature. Arch Intern Med. 2004;164:1641-9. [PMID: 15302634]
17. Loveman E, Cave C, Green C, Royle P, Dunn N, Waugh N. The clinical and cost-effectiveness of patient education models for diabetes: a systematic review and economic evaluation. Health Technol Assess. 2003;7:iii, 1-190. [PMID: 13678547]
18. Valk GD, Kriegsman DM, Assendelft WJ. Patient education for preventing diabetic foot ulceration. A systematic review. Endocrinol Metab Clin North Am. 2002;31:633-58. [PMID: 12227125]
19. Niedermann K, Fransen J, Knols R, Uebelhart D. Gap between short- and long-term effects of patient education in rheumatoid arthritis patients: a systematic review. Arthritis Rheum. 2004;51:388-98. [PMID: 15188324]
20. Sudre P, Jacquemet S, Uldry C, Perneger TV. Objectives, methods and content of patient education programmes for adults with asthma: systematic review of studies published between 1979 and 1998. Thorax. 1999;54:681-7. [PMID: 10413719]
21. Morrison JM, Sullivan F, Murray E, Jolly B. Evidence-based education: development of an instrument to critically appraise reports of educational interventions. Med Educ. 1999;33:890-3. [PMID: 10583810]
22. Guidelines for evaluating papers on educational interventions. BMJ. 1999; 318:1265-7. [PMID: 10231261]
23. Green ML. Identifying, appraising, and implementing medical education curricula: a guide for medical educators. Ann Intern Med. 2001;135:889-96. [PMID: 11712879]
24. Kern DE, Thomas PA, Howard D, Bass E. Curriculum Development for Medical Education: A Six-Step Approach. Baltimore, MD: Johns Hopkins Univ Pr, 1998.
25. Haig A, Dozier M. BEME Guide no 3: systematic searching for evidence in medical education-Part 1: Sources of information. Med Teach. 2003;25:352-63. [PMID: 12893544]
26. Thomas PA, Kern DE. Internet resources for curriculum development in medical education: an annotated bibliography. J Gen Intern Med. 2004;19:599-605. [PMID: 15109332]
27. Haig A, Dozier M. BEME guide no. 3: systematic searching for evidence in medical education-part 2: constructing searches. Med Teach. 2003;25:463-84. [PMID: 14522667]
28. Smits PB, de Buisonje CD, Verbeek JH, van Dijk FJ, Metz JC, ten Cate OJ. Problem-based learning versus lecture-based learning in postgraduate medical education. Scand J Work Environ Health. 2003;29:280-7. [PMID: 12934721]
29. Mazmanian PE, Daffron SR, Johnson RE, Davis DA, Kantrowitz MP. Information about barriers to planned change: a randomized, controlled trial involving continuing medical education lectures and commitment to change. Acad Med. 1998;73:882-6. [PMID: 9736848]
30. Madan AK, Aliabadi-Wahle S, Babbo AM, Posner M, Beech DJ. Education of medical students in clinical breast examination during surgical clerkship. Am J Surg. 2002;184:637-40; discussion 641. [PMID: 12488198]
31. Chart P, Franssen E, Darling G, Macphail J, Tipping J, Poldre P, et al. Breast disease and undergraduate medical education: a randomized trial to assess the effect of a home study module on medical student performance. J Cancer Educ. 2001;16:129-33. [PMID: 11603873]
32. Wilkes M, Bligh J. Evaluating educational interventions. BMJ. 1999;318: 1269-72. [PMID: 10231263]
33. Carline JD. Funding medical education research: opportunities and issues. Acad Med. 2004;79:918-24. [PMID: 15383346]
34. Prideaux D. Researching the outcomes of educational interventions: a matter of design. RTCs have important limitations in evaluating educational interventions [Editorial]. BMJ. 2002;324:126-7. [PMID: 11799017]
35. Hsu EB, Jenckes MW, Catlett CL, Robinson KA, Feuerstein CJ, Cosgrove SE, et al. Training of hospital staff to respond to a mass casualty incident. Evidence Report/Technology Assessment No. 95 (Prepared by The Johns Hopkins University Evidence-based Practice Center under contract 290-02-0018). Rockville, MD: Agency for Healthcare Research and Quality; April 2004. AHRQ publication no. 04-E015-1.
36. Viswanathan M, Ammerman A, Eng E, Gartlehner G, Lohr KN, Griffith D, et al. Community-based participatory research: assessing the evidence. Evidence Report/Technology Assessment No. 99 (Prepared by RTI-University of North Carolina Evidence-based Practice Center under contract 290-02-0016). Rockville, MD: Agency for Healthcare Research and Quality; August 2004. AHRQ publication no. 04-E022-1.
37. Carney PA, Nierenberg DW, Pipas CF, Brooks WB, Stukel TA, Keller AM. Educational epidemiology: applying population-based design and analytic approaches to study medical education. JAMA. 2004;292:1044-50. [PMID: 15339895]
38. West S, King V, Carey TS, Lohr KN, McKoy N, Sutton SF, et al. Systems to rate the strength of scientific evidence. Evidence Report/Technology Assessment No. 47 (Prepared by the Research Triangle Institute-University of North Carolina Evidence-based Practice Center under contract 290-97-0011). Rockville, MD: Agency for Healthcare Research and Quality, April 2002. AHRQ publication no. 02-E016.
39. Beach MC, Cooper LA, Robinson KA, Price EG, Gary TL, Jenckes MW, et al. Strategies for improving minority healthcare quality. Evidence Report/Technology Assessment No. 90 (Prepared by the Johns Hopkins University Evidence-based Practice Center under contract 290-02-0018). Rockville, MD: Agency for Healthcare Research and Quality; January 2004. AHRQ publication no. 04-E008-01.
40. Beach MC, Price EG, Gary TL, Robinson KA, Gozu A, Palacio A, et al. Cultural competence: a systematic review of health care provider educational interventions. Med Care. 2005; [In press].
41. Juni P, Witschi A, Bloch R, Egger M. The hazards of scoring the quality of clinical trials for meta-analysis. JAMA. 1999;282:1054-60. [PMID: 10493204]
42. Berkman ND, DeWalt DA, Pignone MP, Sheridan SL, Lohr KN, Lux L, et al. Literacy and health outcomes. Evidence Report/Technology Assessment No. 87 (Prepared by RTI International-University of North Carolina Evidence-based Practice Center under contract 290-02-0016). Rockville, MD: Agency for Healthcare Research and Quality; January 2004. AHRQ publication no. 04-E007-1.
43. Cauffman JG, Forsyth RA, Clark VA, Foster JP, Martin KJ, Lapsys FX, et al. Randomized controlled trials of continuing medical education: what makes them most effective? J Contin Educ Health Prof. 2002;22:214-21. [PMID: 12613056]
44. Price E, Beach M, Gary T, Robinson K, Gozu A, Palacio A, et al. A systematic review of the methodological rigor of studies evaluating cultural competence training of health professionals. Acad Med. 2005; [In press].
45. Gozu A, Beach MC, Price EG, Gary TL, Robinson KA, Palacio A, et al. Validity and reliability of instruments used to measure cultural competence of health professionals [Abstract]. J Gen Intern Med. 2004;19(Suppl 1):234.
46. Mulrow C, Langhorne P, Grimshaw J. Integrating heterogeneous pieces of evidence in systematic reviews. Ann Intern Med. 1997;127:989-95. [PMID: 9412305]
47. Thomas J, Harden A, Oakley A, Oliver S, Sutcliffe K, Rees R, et al. Integrating qualitative research with trials in systematic reviews. BMJ. 2004;328: 1010-2. [PMID: 15105329]
48. Holtzman J, Schmitz K, Babes G, Kane RL, Duval S, Wilt TJ, et al. Effectiveness of behavioral interventions to modify physical activity behaviors in general populations and cancer patients and survivors. Evidence Report/Technology Assessment No. 102 (Prepared by the University of Minnesota Evidence-based Practice Center under contract 290-02-0009). Rockville, MD: Agency for Healthcare Research and Quality; June 2004. AHRQ publication no. 04-E027-1.
49. Lau J, Ioannidis JP, Schmid CH. Quantitative synthesis in systematic reviews. Ann Intern Med. 1997;127:820-6. [PMID: 9382404]
50. Morton SC, Adams JL, Suttorp MJ, Shekelle PG. Meta-regression approaches: what, why, when, and how? Technical Review No. 8 (Prepared by Southern California-RAND Evidence-based Practice Center under contract 290-97-0001), Rockville, MD: Agency fot Healthcare Research and Quality; March 2004. AHRQ publication no. 04-0033.
51. Chang JT, Morton SC, Rubenstein LZ, Mojica WA, Maglione M, Suttorp MJ, et al. Interventions for the prevention of falls in older adults: systematic review and meta-analysis of randomised clinical trials. BMJ. 2004;328:680. [PMID: 15031239]
52. Stone EG, Morton SC, Hulscher ME, Maglione MA, Roth EA, Grimshaw JM, et al. Interventions that increase use of adult immunization and cancer screening services: a meta-analysis. Ann Intern Med. 2002;136:641-51. [PMID: 11992299]
53. Ellis SE, Speroff T, Dittus RS, Brown A, Pichert JW, Elasy TA. Diabetes patient education: a meta-analysis and meta-regression. Patient Educ Couns. 2004;52:97-105. [PMID: 14729296]