Predictive validity of a selection centre testing non-technical skills for recruitment to training in anaesthesia

British Journal of Anaesthesia

Volumn 105, Issue 5, 2010, Pages 603-609

  Gale, T C E ^a   Roberts, M J ^a,b   Sice, P J ^a   Langton, J A ^a,c   Patterson, F C ^d   Carr, A S ^a   Anderson, I R ^a   Lam, W H ^a   Davies, P R F ^a  

^a PLYMOUTH HOSPITALS NHS TRUST   (United Kingdom)

^b PENINSULA MEDICAL SCHOOL   (United Kingdom)

^c South West Peninsula Deanery ^*  (United Kingdom)

^d CITY UNIVERSITY   (United Kingdom)

Author keywords

anaesthesia; assessment, educational; education, training; patient simulation; personnel selection

Indexed keywords

ANESTHESIST; ARTICLE; EXPERT SYSTEM; JOB PERFORMANCE; MEDICAL EDUCATION; PERSONNEL MANAGEMENT; POSTGRADUATE EDUCATION; PREDICTIVE VALIDITY; PRIORITY JOURNAL; RATING SCALE; SIMULATION; SKILL; STRUCTURED INTERVIEW; TRAINING; ANESTHESIOLOGY; CLINICAL COMPETENCE; EDUCATION; HUMAN; PROCEDURES; REPRODUCIBILITY; TEACHING; UNITED KINGDOM; VALIDATION STUDY;

ANESTHESIOLOGY; CLINICAL COMPETENCE; EDUCATION, MEDICAL, GRADUATE; EDUCATIONAL MEASUREMENT; ENGLAND; HUMANS; PATIENT SIMULATION; PERSONNEL SELECTION; REPRODUCIBILITY OF RESULTS;

EID: 77958164706     PISSN: 00070912     EISSN: 14716771     Source Type: Journal    
DOI: 10.1093/bja/aeq228     Document Type: Article

References (39)

1. Jefferis T. Selection for specialist training: what can we learn from other countries. Br Med J 2007;334:1302-4
2. BMA. Selection for Specialty Training. British Medical Association Board of Medical Education, 2006
3. Cook M. Traditional ways of selecting medical staff. Career focus. Br Med J 1998;316: classified suppl: 2-3
4. International Task Force on Assessment Center Guidelines. Guidelines and ethical considerations for assessment center operations. Public Pers Manage 2000;29:315-31
5. Thornton GC III, Gibbons AM. Validity of assessment centers for personnel selection. Hum Resour Manage Rev 2009;19:169-87
6. Gaugler BB, Rosenthal DB, Thornton GC III, Bentson C. Meta-analysis of assessment center validity. J Appl Psychol 1987;72:493-511
7. Hermelin E, Lievens F, Robertson IT. The validity of assessment centres for the prediction of supervisory performance ratings: a meta-analysis. Int J Select Assess 2007;15:405-11
8. Mitchison H. Assessment centres for core medical training: how do the assessors feel this compares with the traditional interview? Clin Med 2009;9:147-50
9. Patterson F, Ferguson E, Norfolk T, Lane P. A new selection system to recruit general practice registrars: preliminary findings from a validation study. Br Med J 2005;330:711-4
10. Randall R, Davies H, Patterson F, Farrell K. Selecting doctors for postgraduate training in paediatrics using a competency based assessment centre. Arch Dis Child 2006;91:444-8
11. Ziv A, Rubin O, Moshinsky A, et al. MOR: a simulation-based assessment centre for evaluating the personal and interpersonal qualities of medical school candidates. Med Educ 2008;42:991-8
12. Glavin RJ. Excellence in anesthesiology: the role of nontechnical skills. Anesthesiology 2009;110:201-3
13. Smith AF, Greaves JD. Beyond competence: defining and promoting excellence in anaesthesia. Anaesthesia 2010;65:184-91
14. Fletcher G C L, Flin RH, McGeorge P, Glavin RJ, Maran NJ, Patey R. Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system. Br J Anaesth 2003;90:580-8
15. Flin R, Patey R, Glavin R, Maran N. Anaesthetists' non-technical skills. Br J Anaesth 2010;105:38-44
16. Patterson F, Ferguson E, Thomas S. Using job analysis to identify core and specific competencies: implications for selection and recruitment. Med Educ 2008;42:1195-204
17. Fletcher G C L, McGeorge P, Flin RH, Glavin RJ, Maran NJ. The role of non-technical skills in anaesthesia: a review of current literature. Br J Anaesth 2002;88:418-29
18. Fleiss JL. Statistical Methods for Rates and Proportions. New York: John Wiley & Sons, 1981
19. Siegel S, Castellan NJ Jr. Nonparametric Statistics for the Behavioural Sciences. New York: McGraw-Hill, 1988
20. Lee R, Miller KJ, Graham WK. Corrections for restriction of range and attenuation in criterion-related validation studies. J Appl Psychol 1982;67:637-9
21. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159-74
22. Downing SM. Reliability: on the reproducibility of assessment data. Med Educ 2004;38:1006-12
23. McDonald J S M D, Lingam R P M, Gupta BM, Jacoby J M D P, Gough H G P, Bradley P M A. Psychologic testing as an aid to selection of residents in anesthesiology. Anesth Analg 1994;78:542-7
24. Self DJ, Baldwin DC Jr. Should moral reasoning serve as a criterion for student and resident selection? Clin Orthopaed Relat Res 2000;378:115-23
25. Humphrey S, Dowson S, Wall D, Diwakar V, Goodyear HM. Multiple mini-interviews: opinions of candidates and interviewers. Med Educ 2008;42:207-13
26. Eva KW, Rosenfeld J, Reiter HI, Norman GR. An admissions OSCE: the multiple mini-interview. Med Educ 2004;38:314-26
27. Harris S, Owen C. Discerning quality: using the multiple miniinterview in student selection for the Australian National University Medical School. Med Educ 2007;41:234-41
28. Lemay J-F, Lockyer JM, Collin VT, Keith A, Brownell W. Assessment of non-cognitive traits through the admissions multiple miniinterview. Med Educ 2007;41:573-9
29. Reiter HI, Eva KW, Rosenfeld J, Norman GR. Multiple miniinterviews predict clerkship and licensing examination performance. Med Educ 2007;41:378-84
30. Weller JM, Bloch M, Young S, et al. Evaluation of high fidelity patient simulator in assessment of performance of anaesthetists. Br J Anaesth 2003;90:43-7
31. Flin RH, Maran NJ. Identifying and training non-technical skills for teams in acute medicine. Qual Saf Health Care 2004;13: i80-4
32. Bion JF, Abrusci T, Hibbert P. Human factors in the management of the critically ill patient. Br J Anaesth 2010;105:26-33
33. Flin RH, Martin L, Goeters K, et al. Development of the NOTECHS system for assessing pilots' CRM skills. Hum Fact Aerospace Saf 2003;3:95-117
34. Toff NL. Human factors in anaesthesia: lessons from aviation. Br J Anaesth 2010;105:21-5
35. Gaba DM, Howard SK, Flanagan B, Smith BE, Fish KJ, Botney R. Assessment of clinical performance during simulated crises using both technical and behavioral ratings. Anesthesiology 1998;89:8-18
36. Murray DJ, Boulet JR, Kras JF, McAllister JD, Cox TE. A simulationbased acute skills performance assessment for anesthesia training. Anesth Analg 2005;101:1127-34
37. Smith AF, Mishra K. Interaction between anaesthetists, their patients, and the anaesthesia team. Br J Anaesth 2010;105:60-8
38. Kearney RA. Defining professionalism in anaesthesiology. Med Educ 2005;39:769-76
39. Cook M. Personnel Selection: Adding Value Through People. Chichester: Wiley, 2004