Testing non-cognitive attributes in selection centres: How to avoid being reliably wrong

Medical Education

Volumn 46, Issue 3, 2012, Pages 240-242

  Patterson, Fiona ^a   Ferguson, Eamonn ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL COMPETENCE; EDUCATION; EDUCATIONAL MODEL; FEMALE; HUMAN; MALE; MEDICAL EDUCATION; MEDICAL STUDENT; METHODOLOGY; NOTE; PERSONNEL MANAGEMENT; PSYCHOLOGICAL ASPECT; SOCIAL JUSTICE; STANDARD; WORK;

CLINICAL COMPETENCE; EDUCATION, MEDICAL, UNDERGRADUATE; EDUCATIONAL MEASUREMENT; FEMALE; HUMANS; JOB DESCRIPTION; MALE; MODELS, EDUCATIONAL; PERSONNEL SELECTION; SCHOOL ADMISSION CRITERIA; SOCIAL JUSTICE; STUDENTS, MEDICAL;

EID: 84857017882     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2923.2011.04193.x     Document Type: Note

References (19)

1. Gafni N, Moshinsky A, Eisenberg O, Zeigler D, Ziv A. Reliability estimates: behavioural stations and questionnaires in medical school admissions. Med Educ 2012;46:277-88.
2. Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull 1959;56:81-105.
3. Patterson F, Ferguson E. Selection for medical education and training. In: Swanick T, ed. Understanding Medical Education: Evidence, Theory and Practice. Chichester, UK: Wiley-Blackwell 2009;352-65.
4. Patterson F, Zibarras L, Carr V, Irish B, Gregory S. Evaluating candidate reactions to selection practices using organisational justice theory. Med Educ 2011;45:289-97.
5. Koczwara A, Patterson F, Zibarras L, Kerrin M, Irish B, Wilkinson M. Evaluating cognitive ability, knowledge tests and situational judgement tests for postgraduate selection. Med Educ 2012;46: In press.
6. Ferguson E, James D, Madeley L. Factors associated with success in medical school: systematic review of the literature. BMJ 2002;324:952-7.
7. Lievens F, Patterson F. The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced level high-stakes selection. J Appl Psychol 2011;96:927-40.
8. Patterson F, Ferguson E, Lane P, Norfolk T. A new selection system to recruit GPRS. BMJ 2005;330:711-4.
9. International Task Force on Assessment Centre Guidelines. Guidelines and ethical considerations for assessment center operations. Int J Sel Ass 2009;17 (3):243-53.
10. Patterson F, Ferguson E, Thomas S. Using job analyses to identify core and specific competencies for three secondary care specialties: implications for selection and recruitment. Med Educ 2008;42:1195-204.
11. Lievens F. Assessor training strategies and their effects on accuracy, inter-rater reliability, and discriminant validity. J Appl Psychol 2001;86:255-64.
12. Crossley J, Russell J, Jolly B, Ricketts C, Schuwirth L, Norcini J. 'I'm picking up good regressions': the governance of generalisability analysis. Med Educ 2007;41:926-34.
13. Viswesvaran C, Ones DS, Schmidt FL. Comparative analysis of reliability of job performance ratings. J Appl Psychol 1996;81:557-64.
14. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med 2003;15:270-92.
15. Kogan JR, Holmboe ES, Hauer KK. Tools for direct observation and assessment of clinical skills of medical trainees. JAMA 2009;302:1316-26.
16. Gale T, Roberts M, Sice P, Langton J, Patterson F, Carr A, Anderson F, Lam W, Davies P. Predictive validity of a new selection centre testing non-technical skills for recruitment to training in anaesthesia. Br J Anaesth 2010;105 (5):603-9.
17. Reckase MD. The reliability of ratings versus the reliability of scores. Educ Meas Issues Pract 1995;14:31.
18. Goldstein H, McDonald RP. A general model for the analysis of multilevel data. Psychometrika 1988;53:455-67.
19. Jeon MJ, Lee GM, Hwang JW, Kang SJ. Estimating reliability of school level scores using multilevel and generalisability theory models. Asia Pacific Educ Rev 2009;10:149-58.