Quantitative Research Methods in Medical Education

Understanding Medical Education: Evidence, Theory and Practice

Volumn , Issue , 2010, Pages 301-322

  Norman, Geoff ^a   Eva, Kevin W ^a  

^a MCMASTER UNIVERSITY   (Canada)

Author keywords

'Discovery,' thinking about potential contributions of a research study; Choice of appropriate outcome difficult part of study designs; Control group choice in educational research, rarely given attention; Cronbach's 'Two Disciplines'; One group pre test post test and post test only; Perils of pre tests one variant on RCT, two group, pre test post test design; Quantitative research methods central to physical science; Quantitative research methods in medical education; Randomisation, quasi randomisation and intact groups; Three or more groups and factorial designs

Indexed keywords

EID: 84858603190     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781444320282.ch21     Document Type: Chapter

References (87)

1. Dolmans D (2003) The effectiveness of PBL: the debate continues. Some concerns about the BEME movement. Medical Education. 37: 1129-30.
2. Norman G (2002) Research in medical education: three decades of progress. British Medical Journal. 324: 1560-2.
3. Bordage G (2007) Moving the field forward: going beyond quantitative-qualitative. Academic Medicine. 82: S126-8.
4. Meltzoff J (1998) Research questions and hypotheses. In: Critical Thinking About Research, pp. 13-30. American Psychological Association, Washington, DC.
5. Eva KW and Lingard L (2008) What's next? A guiding question for educators engaged in educational research. Medical Education. 42 (8): 752-4.
6. Albert M, Hodges B and Regehr G (2007) Research in medical education: balancing service and science. Advances in Health Sciences Education: Theory and Practice. 12: 103-15.
7. Cook D, Beckman TJ and Bordage GE (2007) Quality of reporting of experimental studies in medical education: a systematic review. Medical Education. 41: 737-45.
8. Popper K (1959) The Logic of Scientific Discovery. Hutchinson and Co., London.
9. Norman GR (1999) The adult learner: a mythical species. Academic Medicine. 74: 886-9.
10. Regehr G (2010) It's NOT rocket science: rethinking our metaphors for research in health professions education. Medical Education. 44 (1): 31-9.
11. Stokes DE (1997) Pasteur's Quadrant: basic science and technological innovation. Brookings Institution Press, Washington, DC.
12. Cook TD and Campbell DT (1979) Quasi-experimentation: design and analysis for field settings. Rand McNally, Chicago, IL.
13. Papadakis MA, Teherani A, Banach MA et al. (2005) Disciplinary action by medical boards and prior behavior in medical school. New England Journal of Medicine. 353: 2673-82.
14. Hojat M, Paskin DL, Callahan CA et al. (2007) Components of postgraduate competence: analyses of thirty years of longitudinal data. Medical Education. 41: 982-9.
15. Rose G (2001) Sick individuals and sick populations. International Journal of Epidemiology. 30: 427-32.
16. Norman GR (2003) RCT = results confounded and trivial. Medical Education. 37: 582-4.
17. Schuwirth LW and van der Vleuten CP (2006) Challenges for educationalists. British Medical Journal. 333: 544-6.
18. Norman GR, Eva KW and Schmidt HG (2005) Implications of psychology-type theories for full curriculum interventions. Medical Education. 39: 247-9.
19. Campbell DT and Stanley JC (1963) Experimental and Quasi-experimental Designs for Research on Teaching. Rand McNally, Chicago, IL.
20. Goldacre B (2007) A kind of magic? (www.guardian.co.uk/science/2007/nov/16/sciencenews.g2; accessed 26 February 2008).
21. Norman GR and Shannon SI (1998) Effectiveness of instruction in critical appraisal (evidence-based medicine) skills: a critical appraisal. Canadian Medical Association Journal. 158: 177-81.
22. Schmidt HG and Moust JHC (1995) What makes a tutor effective? A structural equations modeling approach to learning in problem-based curricula. Academic Medicine. 70: 708-14.
23. Lipsey MW and Wilson DB (1993) The efficacy of psychological, educational, and behavioral treatment. Confirmation from meta-analysis. American Psychologist. 48: 1181-209.
24. Meyer GJ, Finn SE, Eyde LD et al. (2001) Psychological testing and psychological assessment: a review of evidence and issues. American Psychologist. 56: 128-65.
25. Woodward CA, Cohen M, Ferrier BM et al. (1989) Correlates of certification in family medicine in the billing patterns of Ontario general practitioners. Canadian Medical Association Journal. 141: 897-904.
26. Koh GC-H, Khoo HE, Wong ML and Koh D (2008) The effects of problem-based learning during medical school on physician competency: a systematic review. Canadian Medical Association Journal. 178: 34-41.
27. Colliver JA and Markwell SJ (2007) Research on problem-based learning: the need for critical analysis of methods and findings. Medical Education. 41: 533-5.
28. Cook DA (2005) The research we still are not doing: an agenda for the study of computer-based learning. Academic Medicine. 80: 541-8.
29. Ehrenberg RG, Brewer DJ, Gamoran A and Willms JD (2001) Does class size matter? Scientific American. 285: 79-84.
30. Norman GR and Streiner DL (2007) Biostatistics: the bare essentials (3e). BC Decker, Hamilton, ON.
31. Larsen DP, Butler AC and Roediger HL (2008) Test-enhanced learning in medical education. Medical Education. 42: 959-66.
32. Whitcomb ME (2002) Research in medical education: what do we know about the link between what doctors are taught and what they do? Academic Medicine. 77: 1067-8.
33. Bligh J (2003) Editorial. Medical Education. 37: 184-5.
34. Colliver JA (2003) The research enterprise in medical education. Teaching and Learning in Medicine. 15: 154-5.
35. Norman GR (2006) Outcomes, objectives and the seductive appeal of simple solutions. Advances in Health Sciences Education. 11: 217-20.
36. Werner LS and Bull BS (2003) The effect of three commercial coaching courses on Step One USMLE performance. Medical Education. 37: 527-31.
37. Gruppen L (2007) Improving medical education research. Teaching and Learning in Medicine. 19: 331-5.
38. Eva KW, Reiter HI, Rosenfeld J and Norman GR (2008) Predictive validity of the multiple mini-interview for selecting medical trainees. Medical Education. 43 (8): 767-75.
39. Tamblyn R, Abrahamowicz M, Dauphinee D et al. (2007) Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities. Journal of the American Medical Association. 298: 993-1001.
40. Cohen PA (1981) Student rating of instruction and student achievement: a meta-analysis of multisection validity studies. Review of Educational Research. 51: 281-309.
41. Eva KW and Regehr G (2005) Self-assessment in the health professions: a reformulation and research agenda. Academic Medicine. 80: S46-54.
42. Gordon MJ (1991) A review of the validity and accuracy of self-assessments in health professions training. Academic Medicine. 66: 762-9.
43. Davis DA, Mazmanian PE, Fordis M et al. (2006) Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. Journal of the American Medical Association. 296: 1094-102.
44. Levinson AJ, Weaver B, Garside S et al. (2007) Virtual reality and brain anatomy: a randomised trial of e-learning instructional designs. Medical Education. 41: 495-501.
45. Cohen JJ (1988) Statistical Power Analysis for the Behavioral Sciences. Erlbaum, Hillsdale, NJ.
46. Colliver JA, Markwell SJ, Verhulst SJ and Robbs RS (2007) The prognostic value of documented unprofessional behavior in medical school records for predicting and preventing subsequent medical board disciplinary action: the Papadakis studies revisited. Teaching and Learning in Medicine. 19: 213-15.
47. Swanson DB, Norman GR and Linn RL (1995) Performance based assessment: lessons from the professions. Educational Research. 24: 5-11.
48. Harden RM and Gleeson FA (1979) Assessment of clinical competence using an objective structured clinical examination (OSCE). Medical Education. 13: 41-54.
49. Streiner DL and Norman GR (2003) Health Measurement Scales: a practical guide to their development and use (3e). Oxford University Press, Oxford.
50. Eva KW, Rosenfeld J, Reiter HI and Norman GR (2004) An admissions OSCE: the multiple mini-interview. Medical Education. 38: 314-26.
51. Hodgson CS, Teherani A, Gough HG et al. (2007) The relationship between measures of unprofessional behavior during medical school and indices on the California Psychological Inventory. Academic Medicine. 82: S4-7.
52. Mamede S and Schmidt HG (2004) The structure of reflective practice in medicine. Medical Education. 38: 1302-8.
53. Messick S (1989) Validity. In: Linn RL (ed.) Educational Measurement, pp. 103-4. Macmillan, New York, NY.
54. Downing SM (2003) Validity on the meaningful interpretation of assessment data. Medical Education. 37: 830-7.
55. Newble DI and Jaeger K (1983) The effect of assessments and examinations on the learning of medical students. Medical Education. 17: 165-71.
56. Harasym PH, Woloschuk W, Mandin H and Brundin-Mather R (1996) Reliability and validity of interviewers'judgements of medical school candidates. Academic Medicine. 71: S40-2.
57. Paul A (2004) The Cult of Personality: how personality tests are leading us to miseducate our children, mismanage our companies, and misunderstand ourselves. Free Press, New York, NY.
58. Hodges B, Turnbull J, Cohen R et al. (1996) Evaluating communication skills in the OSCE format: reliability and generalizability. Medical Education. 30: 38-43.
59. Hodges B, Regehr G, McNaughton N et al. (1999) OSCE checklists do not capture increasing levels of expertise. Academic Medicine. 74: 1129-34.
60. Ramsey PG, Carline JD, Inui TS et al. (1989) Predictive validity of certification by the American Board of Internal Medicine. Annals of Internal Medicine. 110: 719-26.
61. Davis DA, Mazmanian PE, Fordis M et al. (2006) Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. Journal of the American Medical Association. 296: 1094-102.
62. Norman GR (2004) The morality of medical school admissions. Advances in Health Sciences Education. 9: 79-82.
63. Bargh JA and Chartrand TL (1999) The unbearable automaticity of being. American Psychologist. 54: 462-79.
64. Jamieson S (2004) Likert scales: how to (ab)use them. Medical Education. 38: 1217-18.
65. Wainer H (1976) Estimating coefficients in linear models: it don't make no nevermind. Psychological Bulletin. 83: 213-17.
66. Glass GV and Stanley JC (1970) Statistical Methods in Education and Psychology. Prentice Hall, Englewood Cliffs, NJ.
67. Wikipaedia (2010) Bonferroni correction http://en.wikipedia.org/wiki/Bonferroni_correction Accessed 1st April 2010.
68. Cronbach LJ (1957) The two disciplines of scientific psychology. American Psychologist. 12: 671-84.
69. Harden R, Grant J, Buckley G and Hart I (2000) Best Evidence Medical Education. Advances in Health Sciences Education. 5: 71-90.
70. Smith ML and Glass GV (1977) Meta-analysis of psychotherapy outcome studies. American Psychologist. 32: 752-60.
71. Vernon DT and Blake RL (1993) Does problem-based learning work? A meta-analysis of evaluative research. Academic Medicine. 68: 550-63.
72. Hamdy H, Prasad K, Anderson MB et al. (2006) BEME guide no. 5: predictive values of assessment measurements obtained in medical schools and future performance in practice. Medical Teacher. 28: 103-16.
73. Bordage G (2001) Reasons reviewers reject and accept manuscripts: the strengths and weaknesses in medical education reports. Academic Medicine. 76: 889-96.
74. Driessen E, van Tartwijk J, van der Vleuten C and Wass V (2007) Portfolios in medical education: why do they meet with mixed success? A systematic review. Medical Education. 41: 1224-33.
75. Issenberg SB, McGaghie WC, Petrusa ER et al. (2005) Features and uses of high-fidelity simulation that lead to effective learning: a BEME systematic review. Medical Teacher. 27: 10-28.
76. Dornan T, Littlewood S, Margolis S et al. (2006) How can experience in clinical and community settings contribute to early medical education? A BEME systematic review. Medical Teacher. 28: 3-18.
77. Hammick M, Freeth D, Koppel I et al. (2007) BEME guide no. 9: a best evidence systematic review of interprofessional education. Medical Teacher. 29: 735-51.
78. Albanese MA and Mitchell S (1993) Problem-based learning: a review of literature on its outcomes and implementation issues. Academic Medicine. 68: 52-81.
79. Norman GR and Schmidt HG (1992) The psychological basis of problem-based learning. Academic Medicine. 67: 557-65.
80. Garg A, Norman GR, Spero L and Maheshwari P (1999) Do virtual computer models hinder anatomy learning? Academic Medicine. 74: S87-9.
81. Cronbach LJ (1975) Beyond the two disciplines of scientific psychology. American Psychologist. 30: 116-27.
82. Schmidt HG (2005) Influence of research on practices in medical education: the case of problem-based learning. Paper presented at the Association for Medical Education in Europe, Amsterdam, The Netherlands, September.
83. Cook DA, Bordage G and Schmidt HG (2008) Description, justification and clarification: a framework for classifying the purposes of research in medical education. Medical Education. 42: 128-33.
84. Norman GR, van der Vleuten CPM and Newble DI (eds) (2002) International Handbook of Research in Medical Education, vol. 7. Springer International Handbooks of Education, New York.
85. Bowling A (1997) Research Methods in Health: investigating health and health services. Open University Press, Philadelphia, PA.
86. Chalmers A (1999) What Is This Thing Called Science? (3e). Open University Press, Buckingham.
87. Streiner D and Norman GR (2003) Health Measurement Scales: a practical guide to their development and use (3e). Oxford University Press, Oxford.