Selection for Medical Education and Training

Understanding Medical Education: Evidence, Theory and Practice

Volumn , Issue , 2010, Pages 352-365

  Patterson, Fiona ^a   Ferguson, Eamonn ^b  

^a CITY UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Adult intellectual ability a function of process; Assessment for selection different from that in end point examinations; Assessment paradigm in selection context different from professional college examinations; Candidates' reactions to different methods; Evaluative criteria for selection procedures; General mental ability and aptitude tests; Predictive validity, acceptability and use of selection method; Selecting the wrong person for a job serious consequences for organisations; Selection for medical education and training; Tests of general mental ability (GMA) and tests of specific cognitive abilities (numerical, verbal, spatial)

Indexed keywords

EID: 84857005692     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781444320282.ch24     Document Type: Chapter

References (114)

1. Klehe UC (2004) Choosing how to choose: institutional pressures affecting the adoption of personnel selection procedures. International Journal of Selection. 12: 327-42.
2. Jefferis T (2007) Selection for specialist training: what can we learn from other countries? British Medical Journal. 334: 1302-4.
3. Greengross S (1997) What patients want from their doctors. In: Allen I, Brown P and Hughes P (eds) Choosing Tomorrow's Doctors, pp. 12-19. Policy Studies Institute, London.
4. Hughes P (2002) Can we improve on how we select medical students? Journal of the Royal Society of Medicine. 95: 18-22.
5. Reede JY (1999) Predictors of success in medicine. Clinical Orthopaedics and Related Research. 362: 72-7.
6. McManus IC (2003) Commentary: how to derive causes from correlations in educational studies. British Medical Journal. 326: 432.
7. Eva KW and Reiter HI (2005) Reflecting the relative values of community, faculty and students in the admissions tools of medical school. Teaching and Learning in Medicine. 17: 4-8.
8. Wiley A and Koenig JA (1996) The validity of the Medical College Admission Test for predicting performance in the first two years of medical school. Academic Medicine. 71: S83-5.
9. Aldous CJ, Leeder SR, Price J et al. (1997) A selection test for Australian graduate-entry medical schools. Medical Journal of Australia. 166: 247-50.
10. Tutton P and Price M (2002) Selection of medical students: affirmative action goes beyond the selection process. British Medical Journal. 324: 1170-1.
11. Albanese MA, Snow MH, Skochelak SE et al. (2003) Assessing personal qualities in medical schools admissions. Academic Medicine. 78: 313-21.
12. Cohen J (2001) Facing the future. President's address, 112th Annual Meeting of the Association of American Medical Colleges, 4 November, Washington, DC.
13. Mitchell KJ (1990) Traditional predictors of performance in medical schools. Academic Medicine. 65: 149-58.
14. Arnold DM, Coe RM and Pepper M (1984) Structure and function of medical school admission committees. Journal of Medical Education. 59: 131-2.
15. Kulatunga-Moruzi C and Norman GR (2002) Validity of admission measures in predicting performance outcomes: the contribution of cognitive and non-cognitive dimensions. Teaching and Learning in Medicine. 14: 34-42.
16. Norman G (2004) The morality of medical school admissions. Advances in Health Sciences Education. 9: 79-82.
17. Salvatori P (2001) Reliability and validity of admission tools used to select students for the health professions. Advances in Health Sciences Education. 6: 159-75.
18. Harris S and Owen C (2007) Discerning quality: using the multiple mini-interview in student selection for the Australian National University Medical School. Medical Education. 41: 234-41.
19. Hulsman RL, van der Ende JS, Oort FJ et al. (2007) Effectiveness of selection in medical school admissions: evaluation of the outcomes among freshmen. Medical Education. 41: 369-77.
20. Silver B and Hodgson CS (1997) Evaluating GPAs and MCAT scores as predictors of NBME I and clerkship performances based on students'data from one undergraduate institution. Academic Medicine. 72: 394-6.
21. Puryear JB and Lewis LA (1981) Description of the interview process in selecting students for admission to US medical schools. Journal of Medical Education. 56: 881-5.
22. Turnbull D, Buckley P, Robinson JS et al. (2003) Increasing the evidence base for selection for undergraduate medicine: four case studies investigating process and interim outcomes. Medical Education. 37: 1115-20.
23. Dutch Ministry of Education, Culture and Science [Dutch Higher Education and Scientific Research Act] (1999) Wet van 3 April 1999 tot wijziging van de Wet op het hoger onderwijs en wetenschappelijk onderzoek, houdende aanpassingen in het systeem van selectie voor opleidingen waarvoor een toelatingsbeperking is vastgesteld. The Hague. 170: 1-8.
24. Miller JB, Schaad DC, Crittenden RA et al. (2003) Communication between programs and applicants during residency selection: effects of the match on medical students'professional development. Academic Medicine. 78: 403-11.
25. Bell JG, Kanellitsas I and Shaffer L (2001) Selection of obstetrics and gynecology residents on the basis of medical school performance. American Journal of Obstetrics and Gynecology. 186: 1091-4.
26. Brandenburg S, Kruzick T, Lin CT et al. (2005) Residency selection criteria: what medical students perceive as important. Medical Education Online. 10: 1-6.
27. Wagoner NE and Gray GT (1979) Report on a survey of program directors regarding selection factors in graduate medical education. Journal of Medical Education. 54: 445-52.
28. Wagoner NE and Suriano JR (1999) Program directors'responses to a survey on variables used to select residents in a time of change. Academic Medicine. 74: 51-8.
29. Adams LJ, Brandenburg S and Blake M (2000) Factors influencing internal medicine program directors'decisions about applicants. Academic Medicine. 75: 542-3.
30. Crane JT and Ferraro CM (2000) Selection criteria for emergency medicine residency applicants. Academic Emergency Medicine. 7: 54-60.
31. Travis C, Taylor CA and Mayhew HE (1999) Evaluating residency applicants: stable values in a changing market. Family Medicine. 31: 252-6.
32. Villanueva AM, Kaye D, Abdelhak SS and Morahan PS (1995) Comparing selection criteria of residency directors and physicians'employers. Academic Medicine. 70: 261-71.
33. Grantham JR (1993) Radiology resident selection: results of a survey. Investigative Radiology. 28: 99-101.
34. Wagoner NE and Suriano JR (1992) Recommendations for changing the residency selection process based on a survey of program directors. Academic Medicine. 67: 459-64.
35. Patterson F, Ferguson E, Lane PW et al. (2000) Competency model for general practice: implications for selection, training and development. British Journal of General Practice. 50: 188-93.
36. Ferguson E, James D and Madeley L (2002) Factors associated with success in medical school: systematic review of the literature. British Medical Journal. 324: 952-7.
37. Salgado JF, Viswesvaran C and Ones D (2001) Predictors used for personnel selection: an overview of constructs, methods, and techniques. In: Anderson N, Ones DS, Sinangil HK and Viswesvaran C (eds) Handbook of Industrial, Work and Organizational Psychology, pp. 165-99. Sage, London, New York.
38. Anastasia A and Urbina S (1997) Psychological Testing (7e). Prentice Hall, Upper Saddle River, NJ.
39. Hausknecht JP, Day DV and Thomas SC (2004) Applicant reactions to selection procedures: an updated model and meta-analysis. Personnel Psychology. 57: 639-83.
40. Anderson N, Born M and Cunningham-Snell N (2001) Recruitment and selection: applicant perspectives and outcomes. In: Anderson N, Ones DS, Sinangil HK and Viswesvaran C (eds) Handbook of Industrial, Work and Organizational Psychology, pp. 200-18. Sage, London, New York.
41. Campion MA, Palmer DK and Campion JE (1997) A review of structure in the selection interview. Personnel Psychology. 50: 655-702.
42. Lievens F and Thornton III GC (2005) Assessment centers: recent developments in practice and research. In: Evers A, Smit-Voskuijl O and Anderson N (eds) Handbook of Personnel Selection, pp. 243-64. Blackwell Publishing, Oxford.
43. Salgado JF and Anderson N (2002) Cognitive and GMA testing in the European Community: issues and evidence. Human Performance. 15: 75-96.
44. Campion MA, Pursell ED and Brown BK (1988) Structured interviewing: raising the psychometric properties of the employment interview. Personnel Psychology. 41: 25-42.
45. Goho J and Blackman A (2006) The effectiveness of academic admission interviews: an exploratory meta-analysis. Medical Teacher. 28: 335-40.
46. McDaniel MA, Whetzel DL, Schmidt FL and Maurer S (1994) The validity of employment interviews: a comprehensive review and meta-analysis. Journalof Applied Psychology. 79: 599-615.
47. Wiesner WH and Cronshaw SF (1988) A meta-analytic investigation of the impact of interview format and the degree of structure on the validity of the employment interview. Journal of Occupational Psychology. 61: 275-90.
48. Huffcutt AI and Arthur Jr W (1994) Hunter and Hunter (1984) revisited: interview validity for entry-level jobs. Journal of Applied Psychology. 79: 184-90.
49. Cortina JM, Goldstein NB, Payne SC et al. (2000) The incremental validity of interview scores over and above cognitive ability and conscientiousness scores. Personnel Psychology. 53: 325-51.
50. Schmidt FL and Hunter JE (1998) The validity and utility of selection methods in personnel psychology: practical and theoretical implications of 85 years of research findings. Psychological Bulletin. 124: 262-74.
51. Bobko P, Roth PL and Potosky D (1999) Derivation and implications of meta-analytic matrix incorporating cognitive ability, alternative predictors and job performance. Personnel Psychology. 52: 561-89.
52. Huffcutt AI and Roth PL (1998) Racial group differences in employment interview evaluations. Journal of Applied Psychology. 83: 179-89.
53. Posthuma RA, Morgeson FP and Campion MA (2002) Beyond employment interview validity: a comprehensive narrative review of recent research and trends over time. Personnel Psychology. 55: 1-81.
54. Terpstra DE, Mohamed AA and Kethley RB (1999) An analysis of federal court cases involving nine selection devices. International Journal of Selection and Assessment. 7: 26-34.
55. Williamson LG, Campion JE, Malos SB et al. (1997) Employment interview on trial: linking interview structure with litigation outcomes. Journal of Applied Psychology. 82: 900-12.
56. Edwards JC, Johnson EK and Molidor JB (1990) The interview in the admission process. Academic Medicine. 65: 167-77.
57. McCarthy JM and Goffin RD (2001) Improving the validity of letters of recommendation: an investigation of three standardized reference forms. Military Psychology. 13: 199-222.
58. Ferguson E, James D, O'Hehir F and Sanders A (2003) A pilot study of the roles of personality, references and personal statements in relation to performance over the 5 years of a medical degree. British Medical Journal. 326: 429-31.
59. Muchinsky PM (1979) The use of reference reports in personnel selection: a review and evaluation. Journal of Occupational Psychology. 52: 287-97.
60. IRS Employment Review (2002) Of good character: supplying references and providing access. IRS Employment Review. 754: 34-6.
61. Ryan AM, McFarland L, Baron H and Page R (1999) An international look at selection practices: nation and culture as explanations for variability in practice. Personnel Psychology. 52: 359-93.
62. Parry JM, Mathers JM, Stevens AJ et al. (2006) Admissions processes for five year medical courses at English schools: review. British Medical Journal. 332: 1005-9.
63. British Medical Association Board of Medical Education (2006) Selection for specialty training (http://www.bma.org.uk/ap.nsf/Content/selectionforspecialtytraining; accessed 23 August 2007).
64. McManus IC, Powis DA, Wakeford R et al. (2005) Intellectual aptitude tests and A levels for selecting UK school leaver entrants for medical school. British Medical Journal. 331: 555-9.
65. Nicholson S (2005) The benefits of aptitude testing for selecting medical students. British Medical Journal. 331: 559-60.
66. McManus IC and Richards P (1986) Prospective survey of performance of medical students during preclinical years. British Medical Journal. 293: 124-7.
67. Arulampalam W, Naylor RA and Smith JP (2004) A hazard model of the probability of medical school dropout in the United Kingdom. Journal of the Royal Statistical Society: Series A (Statistics in Society). 167: 157-78.
68. McManus IC (1997) From selection to qualification: how and why medical students change. In: Allen I, Brown P and Hughes P (eds) Choosing Tomorrow's Doctors, pp. 60-79. Policy Studies Institute, London.
69. McManus IC, Smithers E, Partridge P et al. (2003) A-levels and intelligence as predictors of medical careers in UK doctors: 20-year prospective study. British Medical Journal. 327: 139-42.
70. Lumb AB and Vail A (2004) Comparison of academic, application form and social factors in predicting early performance on the medical course. Medical Education. 38: 1002-5.
71. Hodgkinson GP and Payne RL (1998) Graduate selection in three European countries. Journal of Occupational and Organizational Psychology. 71: 359-65.
72. Bertua C, Anderson N and Salgado JF (2005) The predictive validity of cognitive ability tests: a UK meta-analysis. Journal of Occupational and Organizational Psychology. 78: 387-409.
73. Salgado JF, Anderson N, Moscoso S et al. (2003) A meta-analytic study of general mental ability validity for different occupations in the European community. Journal of Applied Psychology. 88: 1068-81.
74. Murphy KR (2002) Can conflicting perspectives on the role of g in personnel selection be resolved? Human Performance. 15: 173-86.
75. Kehoe JF (2002) General mental ability and selection in private sector organizations: a commentary. Human Performance. 15: 97-106.
76. Outtz J (2002) The role of cognitive ability tests in employment selection. Human Performance. 15: 161-71.
77. Cronbach LJ (1984) Essentials of Psychological Testing (4e). Harper & Row, New York.
78. Ackerman PL and Heggestad ED (1997) Intelligence, personality, and interests: evidence for overlapping traits. Psychological Bulletin. 121: 219-45.
79. Blair C (2006) How similar are fluid cognition and general intelligence? A developmental neuroscience perspective on fluid cognition as an aspect of human cognitive ability. Behavioral and Brain Sciences. 29: 109-60.
80. Barrick MR, Mount MK and Judge TA (2001) Personality and performance at the beginning of the new millennium: what do we know and where do we go next? International Journal of Selection and Assessment. 9: 9-30.
81. Lievens F, Coetsier P, De Fruyt F and De Maeseneer J (2002) Medical students'personality characteristics and academic performance: a five-factor model perspective. Medical Education. 36: 1050-6.
82. Ferguson E, Sanders A, O'Hehir F and James D (2000) Predictive validity of personal statements and the role of the five factor model of personality in relation to medical training. Journal of Occupational and Organizational Psychology. 73: 321-44.
83. Tett RP, Jackson DN, Rothstein M and Reddon JR (1999) Meta-analysis of bi-directional relations in personality-job performance research. Human Performance. 12: 1-29.
84. Murphy KR and Dzieweczynski JL (2005) Why don't measures of broad dimensions of personality perform better as predictors of job performance? Human Performance. 18: 343-57.
85. Birkeland SA, Manson TM, Kisamore JL et al. (2006) A meta-analytic investigation of job applicant faking on personality measures. International Journal of Selection and Assessment. 14: 317-35.
86. Rosse JG, Stecher MD, Miller JL and Levin RA (1998) The impact of response distortion on pre-employment personality testing and hiring decisions. Journal of Applied Psychology. 83: 634-44.
87. Scarpello VG, Ledvinka J and Bergmann TJ (1995) Human Resource Management, Environments and Functions (2e). South-Western College Publishing, Cincinnati, OH.
88. Hough LM, Eaton NK, Dunnette MD et al. (1990) Criterion related validities of personality constructs and effect of response distortion on those validities. Journal of Applied Psychology. 75: 581-95.
89. Li A and Bagger J (2006) Using the BIDR to distinguish the effects of impression management and self-deception on the criterion validity of personality measures: a meta-analysis. International Journal of Selection and Assessment. 14: 131-41.
90. Chartered Institute of Personnel and Development (2004) Recruitment, Retention and Turnover 2004: a survey of the UK and Ireland. CIPD, London.
91. IRS Employment Review (2004) Graduate recruitment 2004/05: upturn and optimism. IRS Employment Review. 811: 40-8.
92. Patterson F, Ferguson E, Lane P and Norfolk T (2001) A new competency based selection system for general practitioners. Paper presented at the 10th International Conference of the International Society for the Study of Individual Differences, Edinburgh, July.
93. Patterson F, Ferguson E, Norfolk T and Lane P (2005) A new selection system to recruit general practice registrars: preliminary findings from a validation study. British Medical Journal. 330: 711-14.
94. Randall R, Davies H, Patterson F and Farrell K (2006) Selecting doctors for postgraduate training in paediatrics using a competency based assessment centre. Archives of Diseases of Childhood. 91: 444-8.
95. Randall R, Stewart P, Farrell K and Patterson F (2006) Using an assessment centre to select doctors for postgraduate training in obstetrics and gynaecology. The Obstetrician and Gynaecologist. 8: 257-62.
96. Kidd J, Fuller J, Patterson F and Carter Y (2006) Selection centres: initial description of a collaborative pilot project. Proceedings for the Association for Medical Education in Europe (AMEE) Conference, Genoa, Italy.
97. Damitz M, Manzey D, Kleinmann M and Severin K (2003) Assessment center for pilot selection: construct and criterion validity and the impact of assessor type. Applied Psychology: An International Review. 52: 193-212.
98. Lievens F, Van Keer E and De Witte M (2005) Assessment centers in Belgium: the results of a study on their validity and fairness [French]. Psychologie du Travail et des Organisations. 11: 25-33.
99. Schmitt N, Gooding RZ, Noe RA and Kirsch M (1984) Meta-analyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology. 37: 407-22.
100. Dayan, K, Kasten R and Fox S (2002) Entry-level police candidate assessment center: an efficient tool or a hammer to kill a fly? Personnel Psychology. 55: 827-49.
101. Krause DE, Kersting M, Heggestad E and Thornton GC (2006) Incremental validity of assessment center ratings over cognitive ability tests: a study at the executive management level. International Journal of Selection and Assessment. 14: 360-71.
102. Lievens F, Harris MM, Van Keer E and Bisqueret C (2003) Predicting cross-cultural training performance: the validity of personality, cognitive ability, and dimensions measured by an assessment center and a behaviour description interview. Journal of Applied Psychology. 88: 476-89.
103. Macan TH, Avedon MJ, Paese M and Smith DE (1994) The effects of applicants'reactions to cognitive ability tests and an assessment center. Personnel Psychology. 47: 715-38.
104. Rynes SL and Connerley ML (1993) Applicant reactions to alternative selection procedures. Journal of Business and Psychology. 7: 261-77.
105. Woodruffe C (2000) Development and Assessment Centres: identifying and developing competence. Institute of Personnel and Development, London.
106. Algera J and Grueter MAM (1989) Job analysis for personnel selection. In: Smith M and Robertson I (eds) Advances in Selection and Assessment, pp. 7-30. John Wiley and Sons, Chichester.
107. Skarlicki PD and Folger R (1997) Retaliation in the workplace: the roles of distributive, procedural and interactional justice. Journal of Applied Psychology. 82: 434-43.
108. Ackerman PL (1996) A theory of adult intellectual development: process, personality, interests and knowledge. Intelligence. 22: 227-57.
109. Ackerman PL (1996) A theory of adult intellectual development: process, personality, interests and knowledge. Intelligence. 22: 227-57.
110. Arnold J, Silvester J, Patterson F et al. (2004) Work Psychology (4e). Financial Times: Prentice Hall, London.
111. Ferguson E, James D and Madeley L (2002) Factors associated with success in medical school: systematic review of the literature. British Medical Journal. 324: 952-7.
112. Patterson F and Lane P (2007) Assessment for recruitment. In: Jackson N, Jamieson F and Khan A (eds) Assessment in Medical Education and Training, pp. 62-73. Radcliffe Publishing, Oxford.
113. Patterson F, Ferguson E, Norfolk T and Lane P (2005) A new selection system to recruit general practice registrars: preliminary findings from a validation study. British Medical Journal. 330: 711-14.
114. Patterson F and Rowley D (2007) The right choice: a pilot selection centre to select future surgeons. Surgeons News.