PLAB and UK graduates' performance on MRCP(UK) and MRCGP examinations: Data linkage study

BMJ (Online)

Volumn 348, Issue , 2014, Pages

  McManus, I C ^a   Wakeford, Richard ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; COMPARATIVE STUDY; DATA ANALYSIS; DEMOGRAPHY; ETHNICITY; FEMALE; GENERAL PRACTICE; HUMAN; INTERNAL MEDICINE; MALE; MEDICAL EDUCATION; MEDICAL SCHOOL; OUTCOME ASSESSMENT; PHYSICIAN; POSTGRADUATE STUDENT; PRIORITY JOURNAL; PROFESSIONAL KNOWLEDGE; UNITED KINGDOM;

ADULT; CERTIFICATION; CLINICAL COMPETENCE; DATA COLLECTION; EDUCATIONAL MEASUREMENT; FEMALE; FOREIGN MEDICAL GRADUATES; GREAT BRITAIN; HUMANS; MALE; YOUNG ADULT;

EID: 84899012807     PISSN: None     EISSN: 17561833     Source Type: Journal    
DOI: 10.1136/bmj.g2621     Document Type: Article

References (43)

1. IELTS. International English Language Testing System. 2013. www.ielts.org/.
2. General Medical Council. Report of the working party on the PLAB tests [January 1986; chair Sir David Innes Williams]. GMC, 1986.
3. General Medical Council. Steering group on the review of the PLAB test. Report: November 1999. GMC, 1999.
4. PLAB Test Review Group. Final report [July 2004; chair Lord Patel]. General Medical Council, 2004.
5. General Medical Council. Broad themes of the review and members of the working group. GMC, 2013. www.gmc-uk.org/static/documents/content/Broad-themes- of-the-review-and-members-of-the-working-group.pdf.
6. Esmail A, Roberts C. Independent review of the Membership of the Royal College of General Practitioners (MRCGP) examination. General Medical Council, 2013. www.gmcuk. org/MRCGP-Final-Report-18th-September-2013.pdf-53516840.pdf.
7. Esmail A, Roberts C. Academic performance of ethnic minority candidates and discrimination in the MRCGP examinations between 2010 and 2012: analysis of data. BMJ 2013;347:f5662.
8. Woolf K, Potts HWW, McManus IC. The relationship between ethnicity and academic performance in UK-trained doctors and medical students: a systematic review and meta-analysis. BMJ 2011;342:d901.
9. Woolf K, McManus IC, Potts HWW, Dacre JE. The mediators of minority ethnic underperformance in final medical school examinations: a longitudinal study. Br J Educ Psychol (forthcoming).
10. Woolf K, Potts HWW, Patel S, McManus IC. The hidden medical school: a longitudinal study of how social networks form, and how they relate to academic performance. Med Teacher 2012;34:577-86.
11. Denney ML, Freeman A, Wakeford R. MRCGP Clinical Skills Assessment: are the examiners biased, favouring their own by sex, ethnicity and degree source? Br J Gen Pract 2013; doi:10.3399/bjgp13X674396.
12. Dewhurst NG, McManus IC, Mollon J, Dacre JE, Vale JA. Performance in the MRCP(UK) examination 2003-4: analysis of pass rates of UK graduates in the clinical examination in relation to self-reported ethnicity and gender. BMC Med 2007;5:8. doi:10.1186/1741- 7015-5-8.
13. McManus IC, Elder AT, Dacre J. Investigating possible ethnicity and sex bias in clinical examiners: an analysis of data from the MRCP(UK) PACES and nPACES examinations. BMC Med Educ (forthcoming).
14. MRCP(UK). MRCP(UK) annual review 2011/2012. Federation of Royal Colleges of Physicians, 2013. www.mrcpuk.org/SiteCollectionDocuments/MRCP(UK)%20Annual% 20Review%202011.pdf.
15. Tyrer SP, Leung W-C, Smalss J, Katona C. The relationship between medical school of training, age, gender and success in the MRCPsych examinations. Psychiatric Bull 2002;26:257-63. (Pubitemid 34727383)
16. Rushd S, Landau AB, Khan JA, Allgar V, Lindow SW. An analysis of the performance of UK medical graduates in the MRCOG Part 1 and Part 2 written examinations. Postgrad Med J 2012;88:249-54.
17. Rushd S, Landau AB, Lindow SW. An evaluation of the first time performance of international medical graduates in the MRCOG Part 1 and Part 2 written examinations. Eur J Obstet Gynecol Reprod Biol 2013;166:126.
18. General Medical Council. Annual specialty report for 2010/11 [Royal College of Paediatrics and Child Health]. GMC, 2011. www.gmc-uk.org/RCPCH-ASR. pdf-48272553.pdf.
19. General Medical Council. Review of the routes of the GP and specialist register: final report. GMC, 2012.
20. Rogers JL, Howard KI, Vessey JT. Using significance tests to evaluate equivalence between two experimental groups. Psychol Bull 1993;113:553-65.
21. Cleland J, Dowell J, McLachlan J, Nicholson S, Patterson F. Identifying best practice in the selection of medical students (literature review and interview survey). General Medical Council, 2012. www.gmc-uk.org/Identifying- best-practice-in-the-selection-of-medical-students.pdf-51119804.pdf.
22. Kolen MJ, Brennan RL. Test equating: methods and practices . Springer-Verlag; 1995.
23. Newton P, Baird J-A, Goldstein H, Patrick H, Tymms P. Techniques for monitoring the comparability of examination standards. Qualifications and Curriculum Authority, 2007.
24. McManus IC, Elder AT, De Champlain A, Dacre JE, Mollon J, Chis L. Graduates of different UK medical schools show substantial differences in performance on MRCP(UK) Part 1, Part 2 and PACES examinations. BMC Med 2008;6:5.
25. Tiffin PA, Illing J, Kasim AS, McLachlan JC. Annual Review of Competence Progression (ARCP) performance of doctors who passed Professional and Linguistic Assessments Board (PLAB) tests compared with UK medical graduates: national data linkage study. BMJ 2014;348:g2622.
26. Kane M. Validating the performance standards associated with passing scores. Rev Educ Res 1994;64:425-61.
27. Verheggen MM, Muijtens AMM, Van Os J, Schuwirth LWT. Is an Angoff standard an indication of minimal competence of examinees or of judges? Adv Health Sci Educ 2008;13:211.
28. PACES: Practical Assessment of Clinical Examination Skills. The new MRCP(UK) clinical examination. J R Coll Physicians Lond 2000;34:57-60.
29. Elder A, McAlpine L, Bateman N, Dacre J, Kopelman P, McManus IC. Changing PACES: developments to the examination in 2009. Clin Med 2011;11:231-4.
30. Tighe J, McManus IC, Dewhurst NG, Chis L, Mucklow J. The standard error of measurement is a more appropriate measure of quality in postgraduate medical assessments than is reliability: An analysis of MRCP(UK) written examinations. BMC Med Educ 2010;10:40.
31. McManus IC, Ludka K. Resitting a high-stakes postgraduate medical examination on multiple occasions: nonlinear multilevel modelling of performance in the MRCP(UK) examinations. BMC Med 2012;10:60.
32. McManus IC, Woolf K, Dacre J, Paice E, Dewberry C. The academic backbone: longitudinal continuities in educational achievement from secondary school and medical school to MRCP(UK) and the specialist register in UK medical students and doctors. BMC Med 2013;11:242.
33. Wakeford R, Denney ML, Ludka-Stempien K, Dacre J, McManus IC. Cross-validation of MRCGP and MRCP(UK): a database linkage study of 2,284 candidates taking both assessments. BMC Med Educ (submitted).
34. Wakeford R, Foulkes J, McManus IC, Southgate L. MRCGP pass rate by medical school and region of postgraduate training. BMJ 1993;307:542-3. (Pubitemid 23250771)
35. Royal College of General Practitioners. MRCGP annual reports. RCGP, 2013. www.rcgp. org.uk/gp-training-and-exams/mrcgp-exam-overview/mrcgp-annual- reports.aspx.
36. Bowhay AR, Watmough SD. An evaluation of the performance in the UK Royal College of Anaesthetists primary examination by UK medical school and gender. BMC Med Educ 2009;9(38).
37. Wakeford RE. International medical graduates' relative under-performance in the MRCGP AKT and CSA examinations. Educ Primary Care 2012;23:148-52.
38. Wembridge HA. Experiment and statistics in the selection of employees: methods used in the selection of machine operators in a clothing plant. J Am Stat Assoc 1923;18:600-6.
39. Downing SM, Tekian A, Yudkowsky R. Procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teaching Learning Med 2006;18:50-7. (Pubitemid 43440082)
40. Ricker KL. Setting cut-scores: a critical review of the Angoff and modified Angoff methods. Alberta J Educ Res 2013;52:53-64.
41. Clauser BE, Mee J, Baldwin SG, Margolis MJ, Dillon GF. Judges' use of examinee performance data in an Angoff standard-setting exercise for a medical licensing examination: an experimental study. J Educ Measure 2009;46:390-407.
42. Mee J, Clauser BE, Margolis MJ. The impact of process instructions on judges' use of examinee performance data in Angoff standard setting exercises. Educ Measure Issues Pract 2013;32:27-35.
43. Margolis MJ, Clauser BE. The impact of examinee performance information on judges'cut scores in modified Angoff standard-setting exercises. Educ Measure Issues Pract 2014;33:15-22.