The validity of the Annual Review of Competence Progression: a qualitative interview study of the perceptions of junior doctors and their trainers

Journal of the Royal Society of Medicine

Volumn 110, Issue 3, 2017, Pages 110-117

  Viney, Rowena ^a   Rich, Antonia ^a   Needleman, Sarah ^b   Griffin, Ann ^a   Woolf, Katherine ^a  

^a ROYAL FREE HOSPITAL   (United Kingdom)

^b ST BARTHOLOMEW S HOSPITAL   (United Kingdom)

Author keywords

ARCP; assessment; medical education; medical training; Qualitative; validity; workplace based assessment

Indexed keywords

ENGLAND; GENERAL PRACTICE; GYNECOLOGY; HUMAN; INFORMATION PROCESSING; INSTRUMENT VALIDATION; INTERVIEW; LEARNING; MAJOR CLINICAL STUDY; MEDICAL EDUCATION; NONHUMAN; OBSTETRICS; PERCEPTION; POSITIVE FEEDBACK; POSTGRADUATE STUDENT; PSYCHIATRY; RADIOLOGY; SURGERY; TICK; VALIDITY; WALES; WORKPLACE; CLINICAL COMPETENCE; EDUCATION; FEMALE; HEALTH CARE QUALITY; HEALTH PERSONNEL ATTITUDE; MALE; MEDICINE; PHYSICIAN; QUALITATIVE RESEARCH; STANDARDS;

ATTITUDE OF HEALTH PERSONNEL; CLINICAL COMPETENCE; EDUCATION, MEDICAL, GRADUATE; EDUCATIONAL MEASUREMENT; ENGLAND; FEMALE; GENERAL PRACTICE; HUMANS; LEARNING; MALE; MEDICINE; PHYSICIANS; QUALITATIVE RESEARCH; QUALITY ASSURANCE, HEALTH CARE; WALES;

EID: 85015074776     PISSN: 01410768     EISSN: 17581095     Source Type: Journal    
DOI: 10.1177/0141076817690713     Document Type: Article

References (30)

1. The UK Foundation Programme Office. Guide to the Foundation Annual Review of Competence Progression (ARCP) Progress – 2016, Birmingham, http://www.foundationprogramme.nhs.uk/pages/home/foundation-ARCP (2016, accessed 9 June 2016)
2. National Health Service. The gold guide: a reference guide for postgraduate specialty training in the UK. 6th edn., London, http://www.copmed.org.uk/publications/the-gold-guide (2016, accessed 10 June 2016)
3. Massie J, Ali JM. Workplace-based assessment: a review of user perceptions and strategies to address the identified shortcomings. Adv Health Sci Educ 2016; 21: 455–473.
4. O’Leary D, Al-Taiar H, Brown N, Bajorek T, Ghazirad M, Shaddel F. Workplace assessment in crisis? The way forward. BJPsych Bull 2016; 40: 61–63.
5. Rees CE, Cleland JA, Dennis A, Kelly N, Mattick K, Monrouxe LV. Supervised learning events in the Foundation Programme: a UK-wide narrative interview study. BMJ Open 2014; 4: e005980.
6. Black D. An end to box ticking: an overhaul of competency based education. BMJ Careers. http://careers.bmj.com/careers/advice/An_end_to_box_ticking%3A_an_overhaul_of_competency_based_education (2016, accessed 12 August 2016).
7. Talbot M. Monkey see, monkey do: a critique of the competency model in graduate medical education. Med Educ 2004; 38: 587–592.
8. Miller A, Archer J. Impact of workplace based assessment on doctors’ education and performance: a systematic review. BMJ 2010; 341: c5064–c5064.
9. Castanelli DJ, Jowsey T, Chen Y, Weller JM. Perceptions of purpose, value, and process of the mini-Clinical Evaluation Exercise in anesthesia training. Can J Anesth 2016; 63: 1345–1356.
10. Brazil V, Ratcliffe L, Zhang JZ, Davin L. Mini-CEX as a workplace-based assessment tool for interns in an emergency department – does cost outweigh value? Med Teach 2012; 34: 1017–1023.
11. Brown JM, Lowe K, Fillingham J, Murphy PN, Bamforth M, Shaw NJ. An investigation into the use of multi-source feedback (MSF) as a work-based assessment tool. Med Teach 2014; 36: 997–1004.
12. Vance G, Williamson A, Frearson R, O'Connor N, Davison J, Steele C. Evaluation of an established learning portfolio. Clin Teach 2013; 10: 21–26.
13. Eynon-Lewis A, Price M. Reviewing the ARCP process: experiences of users in one English deanery. BMJ Careers. http://careers.bmj.com/careers/advice/view-article.html?id=20008262 (2012, accessed 4 April 2016).
14. Tiffin PA, Illing J, Kasim AS, McLachlan JC. Annual Review of Competence Progression (ARCP) performance of doctors who passed Professional and Linguistic Assessments Board (PLAB) tests compared with UK medical graduates: national data linkage study. BMJ 2014; 348: g2622–g2622.
15. Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ 2003; 37: 830–837.
16. Messick S. Validity. In: Linn RL, ed. Educational measurement. 3rd edn. New York, NY: American Council on Education and Macmillan, 1989:13–103
17. American Educational Research Association, American Psychological Association and National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Educational Research Association, 2014
18. Cook DA, Kuper A, Hatala R, Ginsburg S. When assessment data are words: validity evidence for qualitative educational assessments. Acad Med 2016; 91: 1359–1369.
19. Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 2006; 119: 166.e7–166.e16–166.e7–166.e16.
20. Woolf K, Rich A, Viney R, Rigby M, Needleman S, Griffin A. Fair training pathways for all: understanding experiences of progression, London: General Medical Council, 2016.
21. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006; 3: 77–101.
22. Mountford-Zimdars A, Sabri D, Moore J, Sanders J, Jones S and Higham L. Causes of differences in student outcomes. Higher Education Funding Council for England, Bristol, 2015
23. QSR. NVivo qualitative data analysis Software Version 10. Version 10 ed. QSR International Pty Ltd. See http://www.qsrinternational.com/ (2012, accessed 4 November 2015)
24. Laskaratos F-M, Gkotsi D, Panteliou E. A critical review of the core medical training curriculum in the UK: a medical education perspective. JRSM Open 2014; 5: 2042533313514049.
25. Dormandy L, Laycock K. Triumph of process over practice: changes to assessment of physicians. BMJ Careers. http://careers.bmj.com/careers/advice/Triumph_of_process_over_practice:_changes_to_assessment_of_physicians (2015, accessed 4 April 2016).
26. Goodyear H, Wall D, Bindal T. Annual review of competence: trainees’ perspective. Clin Teach 2013; 10: 394–398.
27. Reid W. Transforming postgraduate medical training in the NHS. BMJ Careers. http://careers.bmj.com/careers/advice/Transforming_postgraduate_medical_training_in_the_NHS (2016, accessed 12 September 2016).
28. ten Cate O. Nuts and bolts of entrustable professional activities. J Grad Med Educ 2013; 5: 157–158.
29. Lavelle-Jones M. Letter to Secretary of State for Health Jeremy Hunt. Royal College of Surgeons of Edinburgh. See https://www.rcsed.ac.uk/media/414502/hunt.pdf (2016, accessed 12 August 2016)
30. Tooke J. Aspiring to excellence: final report of the independent inquiry into modernising medical careers, London: MMC Inquiry, 2008.