Resitting a high-stakes postgraduate medical examination on multiple occasions: Nonlinear multilevel modelling of performance in the MRCP(UK) examinations

BMC Medicine

Volumn 10, Issue , 2012, Pages

  McManus, I C ^a   Ludka, Katarzyna ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL EXAMINATION; HUMAN; LICENSING; MODEL; PERFORMANCE MEASUREMENT SYSTEM; PHYSICIAN; POSTGRADUATE EDUCATION; PRACTICAL ASSESSMENT OF CLINICAL EXAMINATION SKILLS; SKILL; UNITED KINGDOM; EDUCATION; EDUCATIONAL MODEL; LONGITUDINAL STUDY; MEDICAL EDUCATION; METHODOLOGY; PROFESSIONAL COMPETENCE; STATISTICS;

EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; GREAT BRITAIN; HUMANS; LONGITUDINAL STUDIES; MODELS, EDUCATIONAL; PHYSICIANS; PROFESSIONAL COMPETENCE;

EID: 84862230738     PISSN: None     EISSN: 17417015     Source Type: Journal    
DOI: 10.1186/1741-7015-10-60     Document Type: Article

References (35)

1. General Medical Council Postgraduate Board: Minutes of meeting of 20th April 2011 2011, London: General Medical Council, General Medical Council., http://www.gmc-uk.org/5___National_Professional_Examinations.pdf_40785025.pdf
2. Ricketts C. A new look at resits: Are they simply a second chance?. Assessment & Evaluation in Higher Education 2010, 35:351-356. 10.1080/02602931003763954, 3354938, 22701856.
3. McManus IC. Does performance improve when candidates resit a post-graduate examination?. Med Educ 1992, 26:157-162. 10.1111/j.1365-2923.1992.tb00142.x, 1565033.
4. Pell G, Boursicot K, Roberts T. The trouble with resits... Assessment & Evaluation in Higher Education 2009, 34:2-243. 3354938, 22701856.
5. Raymond MR, Luciw-Dubas UA. The second time around: accounting for retest effects on oral examinations. Eval Health Prof 2010, 33:386-403.
6. Raymond MR, Kahraman N, Swygert KA, Balog KP. Evaluating construct equivalence and criterion-related validity evidence for repeat examinees on a standardized patient examination. Acad Med 2011, 86:1253-1259. 10.1097/ACM.0b013e31822bc0a4, 21869669.
7. Hays R, Gupta TS, Veitch J. The practical value of the standard error of measurement in borderline pass/fail decisions. Med Educ 2008, 42:810-815. 10.1111/j.1365-2923.2008.03103.x, 18564094.
8. Raymond MR, Swygert KA, Kahraman N. Measurement precision for repeat examinees on a standardized patient examination. Adv Health Sci Educ
9. Federation of State Medical Boards State-specific requirements of initial medical licensure 2010, Accessed Feb 26th 2012, Federation of State Medical Boards., http://www.fsmb.org/usmle_eliinitial.html
10. Dodds C. Christopher Merrett, F.R.C.P. (1614-1695), First Harveian Librarian. Proc R Soc Med 1954, 47:1053-1055. 1919154, 13237193.
11. Newman CE. Royal College of Physicians of London: 450 years. Br Med J 1968, 4:111. 10.1136/bmj.4.5623.111, 1912141, 5696539.
12. Clark G. History of the Royal College of Physicians of London. Br Med l 1965, 1:79-82.
13. PACES: Practical Assessment of Clinical Examination Skills. The new MRCP(UK) clinical examination. J R Coll Physicians Lond 2000, 34:57-60.
14. Dacre J, Besser M, White P. MRCP(UK) Part 2 Clinical Examination (PACES): a review of the first four examination sessions (June 2001-July 2002). Clin Med 2003, 3:452-459.
15. Tighe J, McManus IC, Dewhurst NG, Chis L, Mucklow J. The Standard Error of Measurement is a more appropriate measure of quality in postgraduate medical assessments than is reliability: an analysis of MRCP(UK) written examinations. BMC Med Educ 2010, 10:40. 10.1186/1472-6920-10-40, 2893515, 20525220.
16. Elder A, McAlpine L, Bateman N, Dacre J, Kopelman P, McManus IC. Changing PACES: developments ot the examination in 2009. Clin Med 2011, 11:231-234.
17. Ghiselli EE, Campbell JP, Zedeck S. Measurement Theory for the Behavioural Sciences 1981, San Francisco: W H Freeman.
18. Grimm KJ, Ram N. Nonlinear growth models in Mplus and SAS. Structural Equation Modelling 2009, 16:676-701.
19. Kreft I, De Leeuw J. Introducing Multilevel Modelling 1998, London: Sage.
20. Goldstein H. Multilevel Statistical Models 1995, London: Arnold, 2.
21. Duncan TE, Duncan SC, Strycker LA. An Introduction to Latent Variable Growth Curve Modelling: Concepts, Issues and Applications 2006, Mahwah, NJ: Lawrence Erlbaum Associates.
22. Bollen KA, Curran PJ. Autoregressive latent trajectory (ALT) models: a synthesis of two traditions. Sociol Methods Res 2004, 32:336-383.
23. Enders CK, Tighi D. Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychol Methods 2012, 12:121-138.
24. Biesanz JC, Deeb-Sossa N, Papadakis AA, Bollen KA, Curran PJ. The role of coding time in estimating and interpreting growth curve models. Psychol Methods 2004, 9:30-52.
25. Kreft IGG, De Leeuw J, Aiken LS. The effect of different forms of centering in hierarchical linear models. Multivariate Behav Res 1995, 30:1-21.
26. Raudenbush SW. Comparing personal trajectories and drawing causal inferences from longitudinal data. Annu Rev Psychol 2001, 50:501-525.
27. Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ 2003, 37:830-837. 10.1046/j.1365-2923.2003.01594.x, 14506816.
28. McManus IC, Mollon J, Duke OL, Vale JA. Changes in standard of candidates taking the MRCP(UK) Part 1 examination, 1985 to 2002: analysis of marker questions. BMC Med 2005, 3:13. 10.1186/1741-7015-3-13, 1185541, 16026607.
29. Hutchinson L, Aitken P, Hayes T. Are medical postgraduate certification processes valid? A systematic review of the published evidence. Med Educ 2002, 36:73-91. 10.1046/j.1365-2923.2002.01120.x, 11849527.
30. Mehrens WA, Popham WJ. How to evaluate the legal defensibility of high-stakes tests. ApplMeas Educ 1992, 5:265-283.
31. Case SM, Swanson DB. Constructing Written Test Questions for the Basic and Clinical Sciences 1996, Philadelphia: National Board of Medical Examiners.
32. Mattick K, Dennis I, Bradley P, Bligh J. Content specificity: is it the full story? Statistical modelling of a clinical skills examination. Med Educ 2008, 42:589-599. 10.1111/j.1365-2923.2008.03020.x, 18482090.
33. Norman G, Bordage G, Page G, Keane D. How specific is case specificity?. Med Educ 2006, 40:618-623. 10.1111/j.1365-2929.2006.02511.x, 16836533.
34. Dory V, Gagnon R, Charlin B. Is case-specificity content-specificity? An analysis of data from extended-matching questions. Adv Health Sci Educ 2011, 15:55-63.
35. McManus IC, Mooney-Somers J, Dacre JE, Vale JA. Reliability of the MRCP(UK) Part I Examination, 1984-2001. Med Educ 2003, 37:609-611. 10.1046/j.1365-2923.2003.01568.x, 12834418.