Psychometric evaluation of a direct observation of procedural skills assessment tool for ultrasound-guided regional anaesthesia

Anaesthesia

Volumn 69, Issue 6, 2014, Pages 604-612

  Watson, M J ^a   Wong, D M ^b   Kluger, R ^b   Chuan, A ^c,d   Herrick, M D ^e   Ng, I ^f   Castanelli, D J ^d,g   Lin, L ^h   Lansdown, A K ^i,j   Barrington, M J ^b,k  

^a UNIVERSITY OF NEWCASTLE   (Australia)

^b ST VINCENT S HOSPITAL   (Australia)

^c MACQUARIE UNIVERSITY   (Australia)

^d UNIVERSITY OF MELBOURNE   (Australia)

^e DARTMOUTH MEDICAL SCHOOL   (United States)

^f ROYAL MELBOURNE HOSPITAL   (Australia)

^g MONASH MEDICAL CENTRE   (Australia)

^h AUSTIN HEALTH   (Australia)

ⁱ ROYAL PRINCE ALFRED HOSPITAL   (Australia)

^j UNIVERSITY OF SYDNEY   (Australia)

^k UNIVERSITY OF MELBOURNE   (Australia)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; ARTICLE; CONSTRUCT VALIDITY; CORRELATION COEFFICIENT; FEMALE; HUMAN; INTERNAL CONSISTENCY; INTERRATER RELIABILITY; MALE; MEDICAL STUDENT; PSYCHOMETRY; REGIONAL ANESTHESIA; SKILL; ULTRASOUND GUIDED REGIONAL ANESTHESIA; VIDEORECORDING;

ADULT; AGED; AGED, 80 AND OVER; ANESTHESIA, CONDUCTION; CLINICAL COMPETENCE; FEMALE; HUMANS; MALE; MIDDLE AGED; PSYCHOMETRICS; ULTRASONOGRAPHY, INTERVENTIONAL;

EID: 84900504219     PISSN: 00032409     EISSN: 13652044     Source Type: Journal    
DOI: 10.1111/anae.12625     Document Type: Article

References (33)

1. Wallenburg I, Helderman J-K, de Bont A, Scheele F, Meurs P,. Negotiating authority: a comparative study of reform in medical training regimes. Journal of Health Politics, Policy and Law 2012; 37: 439-67.
2. Drazen JM, Epstein AM,. Rethinking medical training-the critical work ahead. New England Journal of Medicine 2002; 347: 1271-72.
3. Ludmerer KM, Johns MM,. Reforming graduate medical education. Journal of the American Medical Association 2005; 294: 1083-87.
4. Fleet LJ, Kirby F, Cutler S, Dunikowski L, Nasmith L, Shaughnessy R,. Continuing professional development and social accountability: a review of the literature. Journal of Interprofessional Care 2008; 22: 15-29.
5. Bould MD, Crabtree NA, Naik VN,. Assessment of procedural skills in anaesthesia. British Journal of Anaesthesia 2009; 103: 472-83.
6. Darzi A, Smith S, Taffinder N,. Assessing operative skill. British Medical Journal 1999; 318: 887-8.
7. Hays RB, Davies HA, Beard JD, et al. Selecting performance assessment methods for experienced physicians. Medical Education 2002; 36: 910-7.
8. Fromme HB, Karani R, Downing SM,. Direct observation in medical education: a review of the literature and evidence for validity. Mount Sinai Journal of Medicine 2009; 76: 365-71.
9. Meyers FJ, Weinberger SE, Fitzgibbons JP, et al. Redesigning residency training in internal medicine: The Consensus Report of the Alliance for Academic Internal Medicine Education Redesign Task Force. Academic Medicine 2007; 82: 1211-9.
10. Wragg A, Wade W, Fuller G, Cowan G, Mills P,. Assessing the performance of specialist registrars. Clinical Medicine 2003; 3: 131-4.
11. Anaesthesia Training Program: Curriculum. Regional And Local Anaesthesia. Melbourne: Australian and New Zealand College of Anaesthetists, 2012. http://www.anzca.edu.au/training/2013-training-program/pdfs/anaesthesia- training-program-curriculum.pdf (accessed 18/03/2013).
12. Australian and New Zealand College of Anaesthetists. ANZCA Handbook for Training and Accreditation. Melbourne: Australian and New Zealand College of Anaesthetists, 2012. http://www.anzca.edu.au/training/2013-training-program/ pdfs/training-accreditation-handbook (accessed 18/03/2013).
13. General Medical Council. Standards for Curricula and Assessment Systems. Delivery. London: General Medical Council, 2010. http://www.gmc-uk.org/ Standards-for-Curricula-Assessment-Systems.pdf-31300458.pdf (accessed 14/06/2013).
14. Van Der Vleuten CP,. The assessment of professional competence: developments, research and practical implications. Advances in Health Sciences Education 1996; 1: 41-67.
15. McGraw KO, Wong SP,. Forming inferences about some intraclass correlation coefficients. Psychological Methods 1996; 1: 30-46.
16. Sultan SF, Iohom G, Saunders J, Shorten G,. A clinical assessment tool for ultrasound-guided axillary brachial plexus block. Acta Anaesthesiologica Scandinavica 2012; 56: 616-23.
17. Naik VN, Perlas A, Chandra DB, Chung DY, Chan VW,. An assessment tool for brachial plexus regional anesthesia performance: establishing construct validity and reliability. Regional Anesthesia and Pain Medicine 2007; 32: 41-5.
18. Shaw M,. Road-testing Workplace-based Assessments. Melbourne: Australian and New Zealand College of Anaesthetists, 2011. http://www.anzca.edu.au/ training/2013-training-program/pdfs/Road-testing%20workplace-based%20assessment. pdf (accessed 18/03/2013).
19. Schuwirth LW, Van der Vleuten CP,. Programmatic assessment: from assessment of learning to assessment for learning. Medical Teacher 2011; 33: 478-85.
20. Landis JR, Koch GG,. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 1977; 33: 363-74.
21. Gliem JA, Gliem RR,. Calculating, interpreting, and reporting Cronbach's alpha reliability coefficient for Likert-type scales. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education, 2003 (Conference Proceedings). http://hdl.handle.net/1805/344 (accessed 07/02/2013).
22. Barrington MJ, Wong DM, Slater B, Ivanusic JJ, Ovens M,. Ultrasound-guided regional Anesthesia: how much practice do novices require before achieving competency in ultrasound needle visualization using a cadaver model. Regional Anesthesia and Pain Medicine 2012; 37: 334-9.
23. de Oliveira Filho GR,. The construction of learning curves for basic skills in anesthetic procedures: an application for the cumulative sum method. Anesthesia and Analgesia 2002; 95: 411-6.
24. Driscoll PJ, Paisley AM, Paterson-Brown S,. Video assessment of basic surgical trainees' operative skills. American Journal of Surgery 2008; 196: 265-72.
25. van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J,. Objective assessment of technical surgical skills. British Journal of Surgery 2010; 97: 972-87.
26. Wilkinson JR, Crossley JG, Wragg A, Mills P, Cowan G, Wade W,. Implementing workplace-based assessment across the medical specialties in the United Kingdom. Medical Education 2008; 42: 364-73.
27. Bindal N, Goodyear H, Bindal T, Wall D,. DOPS assessment: a study to evaluate the experience and opinions of trainees and assessors. Medical Teacher 2013; 35: e1230-4.
28. Cohen SN, Farrant PB, Taibjee SM,. Assessing the assessments: U.K. dermatology trainees' views of the workplace assessment tools. British Journal of Dermatology 2009; 161: 34-9.
29. Finall A,. Trainers' perceptions of the direct observation of practical skills assessment in histopathology training: a qualitative pilot study. Journal of Clinical Pathology 2012; 65: 538-40.
30. DOPS WBA Form. Melbourne: Australian and New Zealand College of Anaesthetists, 2012. http://www.anzca.edu.au/training/2013-training-program/ pdfs/direct-obervation-of-procedural-skills.pdf (accessed 02/02/2013).
31. Harris FC, Lahey BB,. Recording system bias in direct observational methodology: a review and critical analysis of factors causing inaccurate coding behavior. Clinical Psychology Review 1982; 2: 539-56.
32. Margolis MJ, Clauser BE, Cuddy MM, et al. Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station clinical skills examination: a validity study. Academic Medicine 2006; 81: S56-60.
33. Yeates P, O'Neill P, Mann K, Eva KW,. Effect of exposure to good vs poor medical trainee performance on attending physician ratings of subsequent performances. Journal of the American Medical Association 2012; 308: 2226-32.