Reliable and valid assessment of clinical bronchoscopy performance

Respiration

Volumn 83, Issue 1, 2012, Pages 53-60

  Konge, Lars ^a,b   Larsen, Klaus Richter ^a   Clementsen, Paul ^a   Arendrup, Henrik ^a   Von Buchwald, Christian ^a   Ringsted, Charlotte ^a  

^a UNIVERSITY OF COPENHAGEN   (Denmark)

^b NONE   (Denmark)

Author keywords

Assessment; Bronchoscopy; Education; Procedural training

Indexed keywords

ARTICLE; BRONCHOSCOPY; CLINICAL ASSESSMENT; CONSTRUCT VALIDITY; CONSULTATION; HUMAN; PRIORITY JOURNAL; RELIABILITY; RESIDENT;

EID: 84855999976     PISSN: 00257931     EISSN: 14230356     Source Type: Journal    
DOI: 10.1159/000330061     Document Type: Article

References (40)

1. Epstein RM, Hundert EM: Defining and assessing professional competence. JAMA 2002; 287:226-235. (Pubitemid 34251949)
2. McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. N Engl J Med 2003; 348: 2635-2645. (Pubitemid 36741592)
3. Kohn LT, Corrigan JM, Donaldson MS (eds): To Err Is Human-Building a Safer Health System. Washington DC, National Academy Press, 1999.
4. Rhodes RS, Biester TW: Certification and maintenance of certification in surgery. Surg Clin North Am 2007; 87:825-836, vi. (Pubitemid 47411656)
5. Larsen CR, Grantcharov T, Schouenborg L, Ottosen C, Soerensen JL, Ottesen B: Objective assessment of surgical competence in gynaecological laparoscopy: development and validation of a procedure-specific rating scale. BJOG 2008; 11 5: 908-916. (Pubitemid 351693011)
6. Black SA, Nestel DF, Kneebone RL, Wolfe J H: Assessment of surgical competence at carotid endarterectomy under local anaesthesia in a simulated operating theatre. Br J Surg 2010; 97: 511-516.
7. Grober ED, Roberts M, Shin EJ, Mahdi M, Bacal V: Intraoperative assessment of technical skills on live patients using economy of hand motion: establishing learning curves of surgica l competence. Am J Surg 2010; 19 9: 81-85.
8. Lipman JM, Marderstein EL, Zeinali F, Phitayakorn R, Ponsky JL, Delaney CP: Objective evaluation of the performance of surgical trainees on a porcine model of open col-ectomy. Br J Surg 2010; 97: 391-395.
9. Aggarwal R, Grantcharov T, Moorthy K, Milland T, Darzi A: Toward feasible, valid, and reliable video-based assessments of technical surgical skills in the operating room. Ann Surg 20 08; 247: 372-379. (Pubitemid 351156784)
10. Vassiliou MC, Kaneva PA, Poulose BK, Dunkin BJ, Marks JM, Sadik R, Sroka G, Anvari M, Thaler K, Adrales GL, Hazey JW, Lightdale JR, Velanovich V, Swanstrom LL, Mellinger JD, Fried GM: Global Assessment of Gastrointestinal Endoscopic Skills (GAGES): a valid measurement tool for technical skills in flexible endoscopy. Surg En-dosc 2010;24:1834-1841.
11. Laeeq K, Infusino S, Lin SY, Reh DD, Ishii M, Kim J, Lane AP, Bhatti NI: Video-based assessment of operative competency in endo-scopic sinus surgery. Am J Rhinol Allergy 2010;24:234-237.
12. Ouellette DR: The safety of bronchoscopy in a pulmonary fellowship program. Chest 2006; 130: 1185-1190. (Pubitemid 44583751)
13. Knight RK, Clarke SW: An analysis of the first 300 fibreoptic bronchoscopies at the Brompton Hospital. Br J Dis Chest 1979; 73: 113-120. (Pubitemid 9162041)
14. Ernst A, Silvestri GA, Johnstone D: Interventional pulmonary procedures: guidelines from the American College of Chest Physicians. Chest 2003; 123: 1693-1717. (Pubitemid 36549793)
15. British Thoracic Society guidelines on diagnostic flexible bronchoscopy. Thorax 2001; 56(suppl 1):i1-i21.
16. Wahidi MM, Silvestri GA, Coakley RD, Ferguson JS, Shepherd RW, Moses L, Conforti J, Que LG, Anstrom KJ, McGuire F, Colt H, Downie GH: A prospective multicenter study of competency metrics and educational interventions in the learning of bronchoscopy among new pulmonary fellows. Chest 2010; 137:1040-1049.
17. Vassiliou MC, Kaneva PA, Poulose BK, Dunkin BJ, Marks JM, Sadik R, Sroka G, Anvari M, Thaler K, Adrales GL, Hazey JW, Lightdale JR, Velanovich V, Swanstrom LL, Mellinger JD, Fried GM: How should we establish the clinical case numbers required to achieve proficiency in flexible endoscopy? Am J Surg 2010; 199: 121-125.
18. Blum MG, Powers TW, Sundaresan S: Bronchoscopy simulator effectively prepares junior residents to competently perform basic clinical bronchoscopy. Ann Thorac Surg 2004; 78:287-291. (Pubitemid 38833949)
19. Ost D, DeRosiers A, Britt EJ, Fein AM, Lesser ML, Mehta AC: Assessment of a bronchoscopy simulator. Am J Respir Crit Care Med 2001; 164: 2248-2255. (Pubitemid 34032943)
20. Bronchoscopy Skills and Tasks 10 Point Assessment Tool. http://bronchoscopy.org/downloads/tools/SkillsAndTasksAssess-mentTool.pdf.
21. Davoudi M, Osann K, Colt HG: Validation of two instruments to assess technical bron-choscopic skill using virtual reality simulation. Respiration 2008; 76:92-101. (Pubitemid 351914145)
22. Yudkowsky R: Performance Tests; in Downing SM, Yudkowsky R (eds): Assessment in Health Professions Education. New York, Routledge, 2010, pp 119-148.
23. Streiner DL, Norman GR: Reliability; in Streiner DL, Norman GR (eds): Health Measurement Scales-A Practical Guide to Their Development and Use. Oxford, Oxford University Press, 2008, pp 167-210.
24. Thompson AB, Huerta G, Robbins RA, Sisson JH, Spurzem JR, von ES, Rickard KA, Romberger DJ, Rubinstein I, Ghafouri M: The bronchitis index. A semiquantitative visual scale for the assessment of airways inflammation. Chest 1993; 103:1482-1488. (Pubitemid 23145607)
25. Cicchetti DV, Fleiss JL: Comparison of the null distributions of weighted K and the C ordinal statistic. Appl Psychol Meas 1977; 195-201.
26. Brennan RL: Generalizability Theory, ed 1. New York, Springer-Verlag, 2001.
27. Cronbach LJ, Gleser GC, Nanda H, Rajarat-nam N: The Dependability of Behavioral Measurements, ed 1. New York, John Wiley and Sons, 1972.
28. Moorthy K, Smith S, Brown T, Bann S, Darzi A: Evaluation of virtual reality bronchosco-py as a learning and assessment tool. Respiration 2003; 70: 195-199. (Pubitemid 36578789)
29. Crawford SW, Colt HG: Virtual reality and written assessments are of potential value to determine knowledge and skill in flexible bronchoscopy. Respiration 2004; 71: 269-275. (Pubitemid 38608345)
30. Quadrelli S, Davoudi M, Galindez F, Colt HG: Reliability of a 25-item low-stakes multiple-choice assessment of bronchoscopic knowledge. Chest 2009; 135:315-321.
31. Konge L, Arendrup H, von Buchwald C, Ringsted C: Using performance in multiple simulated scenarios to assess bronchoscopy skills. Respiration 2011;81:483-490.
32. McGaghie WC, Butter J, Kaye M: Observational Assessment; in Downing SM, Yud-kowsky R (eds): Assessment in Health Professions Education. New York, Routledge, 2009, pp 185-215.
33. Haponik EF, Russell GB, Beamis JF Jr, Britt EJ, Kvale P, Mathur P, Mehta A: Bronchos-copy training: current fellows' experiences and some concerns for the future. Chest 2000; 118: 625-630.
34. Multisociety guideline on reprocessing flexible gastrointestinal endoscopes: 2009. http://www.immersion.com/markets/medi-cal/products/endoscopy/ bronchoscopy.html.
35. Di DS, Simonassi C, Chessa L: Inexpensive anatomical trainer for bronchoscopy. Interact Cardiovasc Thorac Surg 2007; 6: 567-569. (Pubitemid 47403969)
36. Goldberg R, Colt HG, Davoudi M, Cherrison L: Realistic and affordable lo-fidelity model for learning bronchoscopic transbronchial need le aspiration. Surg Endosc 2009; 23: 2047-2052.
37. Davoudi M, Wahidi MM, Zamanian RN, Colt HG: Comparative effectiveness of low-and high-fidelity bronchoscopy simulation for training in conventional transbronchial needle aspiration and user preferences. Respiration 2010; 80:327-334.
38. Chen JS, Hsu HH, Lai IR, Tai HC, Lai HS, Lee YC, Shaw JS, Hung YP, Lee PH, Chang KJ: Validation of a computer-based bronchos-copy simulator developed in Taiwan. J For-mos Med Assoc 2006; 10 5: 569-576.
39. GI-BRONCH Mentor. http://www simbion-ix com/BRONCH/BRONCH.html.
40. Baker P: Airway Skills Bronchoscopy Simulator. http://www. airwayskillscom/files/downloads/airwayskills-bronchoscopy- simulator.pdf.