Psychometric characteristics of simulation-based assessment in anaesthesia and accuracy of self-assessed scores

Anaesthesia

Volumn 60, Issue 3, 2005, Pages 245-250

  Weller, J M ^a   Robinson, B J ^b   Jolly, B ^c   Watterson, L M ^d   Joseph, M ^e   Bajenov, S ^d   Haughton, A J ^e   Larsen, P D ^f  

^a THE UNIVERSITY OF AUCKLAND   (New Zealand)

^b National Patient Simulation Centre   (New Zealand)

^c MONASH UNIVERSITY   (Australia)

^d ROYAL NORTH SHORE HOSPITAL   (Australia)

^e MONASH MEDICAL CENTRE   (Australia)

^f UNIVERSITY OF OTAGO   (New Zealand)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ANESTHESIA; ANESTHESIST; ARTICLE; CONTROLLED STUDY; CORRELATION ANALYSIS; HUMAN; JOB PERFORMANCE; PSYCHOMETRY; RELIABILITY; SCORING SYSTEM; SELF EVALUATION; SIMULATION; STANDARDIZATION; THEORY; VARIANCE;

ANESTHESIOLOGY; CLINICAL COMPETENCE; EDUCATION, MEDICAL, GRADUATE; EDUCATIONAL MEASUREMENT; EMERGENCIES; HUMANS; PATIENT SIMULATION; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; SELF ASSESSMENT (PSYCHOLOGY); VIDEOTAPE RECORDING;

EID: 14644442282     PISSN: 00032409     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1365-2044.2004.04073.x     Document Type: Article

References (23)

1. Gaba D, Howard S, Flanagan B, Fish K. Assessment of clinical performance during simulated crises using both technical and behavioral ratings. Anesthesiology 1998; 89: 8-18.
2. Weller J, Bloch M, Young S, et al. Evaluation of the high fidelity patient simulator in the assessment of performance of anaesthetists. British Journal of Anaesthesia 2003; 90: 43-7.
3. Devitt J, Kurrek M, Cohen M, et al. Testing the raters: Inter-rater reliability of standardized anaesthesia simulator performance. Canadian Journal of Anaesthesia 1997; 44: 924-8.
4. Byrne AJ, Jones JG. Responses to simulated anaesthetic emergencies by anaesthetists with different durations of clinical experience. British Journal of Anaesthesia 1997; 78: 553-6.
5. Devitt JH, Kurrek MM, Cohen MM, et al. Testing internal consistency and construct validity during evaluation of performance in a patient simulator. Anesthesia and Analgesia 1998; 86: 1160-4.
6. Devitt JH, Kurrek MM, Cohen MM, Cleave-Hogg D. The validity of performance assessments using simulation. Anesthesiology 2001; 95: 36-42.
7. Regehr G, MacRae H, Reznick RK, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Academic Medicine 1998; 73: 993-7.
8. Newble DI, Swanson DB. Psychometric characteristics of the objective structured clinical examination. Medical Education 1988; 22: 325-34.
9. Boulet JR, Murray D, Kras J, Woodhouse J, McAllister J, Ziv A. Reliability and validity of a simulation-based acute care skills assessment for medical students and residents. Anesthesiology 2003; 99: 1270-80.
10. Crossley J, Davies H, Humphris G, Jolly B. Generalisability: a key to unlock professional assessment. Medical Education 2002; 36: 972-8.
11. Waas V, Jones R, Van der Vleuten C. Standardized or real patients to test clinical competence? The long case revisited. Medical Education 2001; 35: 321-5.
12. Norcini JJ, Swanson DB, Webster GD. Reliability, validity and efficiency of various item formats in assessment of physician competence. Proceedings of the Annual Conference on Research in Medical Education. Washington DC, 1983; 22: 53-8.
13. Norman G, Muzzin L, Williams R, Swanson D. Simulation in health science education. Journal of Instructional Development 1985; 8: 11-17.
14. Stillman PL, Swanson DB, Smee S, et al. Assessing clinical skills in residents with standardized patients. Annals of Internal Medicine 1986; 105: 762-71.
15. Morgan PJ, Cleave-Hogg DM, Guest CB, Herold J. Validity and reliability of undergraduate performance assessments in an anesthesia simulator. Canadian Journal of Anesthesia 2001; 48: 225-33.
16. Gray JD. Global rating scales in residency education. Academic Medicine 1996; 71: S55-S63.
17. Byrne AJ, Greaves JD. Assessment instruments used during anaesthetic simulation: review of published studies. British Journal of Anaesthesia 2001; 86: 445-50.
18. DeAnda A, Gaba D. Role of experience in the response to simulated critical incidents. Anesthesia and Analgesia 1991; 72 308-15.
19. MacDonald J, Williams RG, Rogers DA. Self-assessment in simulation-based surgical skills training. The American Journal of Surgery 2003; 185: 319-22.
20. Boud D. Enhancing Learning Through Self Assessment, 1st edn. London: Kogan Page, 1995.
21. Gordon MJ. A review of the validity and accuracy of self-assessments in health professions training. Academic Medicine 1991; 66: 762-9.
22. Martin D, Regehr G, Hodges McNaughton N. Using videotaped benchmarks to improve the self-assessment ability of family practice residents. Academic Medicine 1998; 73: 1201-6.
23. Gordon MJ. Self-assessment programs and their implications for health professions training. Academic Medicine 1992; 67: 672-9.