Continued Validation of the O-SCORE (Ottawa Surgical Competency Operating Room Evaluation): Use in the Simulated Environment

Teaching and Learning in Medicine

Volumn 28, Issue 1, 2016, Pages 72-79

  MacEwan, Matthew J ^a   Dudek, Nancy L ^b   Wood, Timothy J ^a   Gofton, Wade T ^a  

^a UNIVERSITY OF OTTAWA   (Canada)

^b UNIVERSITY OF OTTAWA   (Canada)

Author keywords

evaluation; O SCORE; postgraduate; surgery; validation

Indexed keywords

CHECKLIST; CLINICAL COMPETENCE; FEMALE; HUMAN; MALE; MEDICAL EDUCATION; OPERATING ROOM; ORTHOPEDICS; QUESTIONNAIRE; SIMULATION TRAINING; STANDARDS; SURGEON; VALIDATION STUDY;

CHECKLIST; CLINICAL COMPETENCE; FEMALE; HUMANS; INTERNSHIP AND RESIDENCY; MALE; OPERATING ROOMS; ORTHOPEDICS; SIMULATION TRAINING; SURGEONS; SURVEYS AND QUESTIONNAIRES;

EID: 84954567125     PISSN: 10401334     EISSN: None     Source Type: Journal    
DOI: 10.1080/10401334.2015.1107483     Document Type: Article

References (29)

1. R.S.Sidhu, E.D.Grober, L.J.Musselman, R.K.Reznick. Assessing competency in surgery: Where to begin? Surgery 2004;135:6–20.
2. G.L.Savoldelli, V.N.Naik, H.S.Joo. Evaluation of patient simulator performance as an adjunct to the oral examination for senior anesthesia residents. Anesthesiology 2006;104:475–81.
3. H.M.MacRae, R.Cohen, G.Regehr, R.Reznick, M.Burnstein. A new assessment tool: The patient assessment and management examination. Surgery 1997;122:335–43.
4. J.A.Martin, G.Regehr, R.Reznick, H.MacRae, J.Murnaghan, C.Hutchison, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. British Journal of Surgery 1997;84:273–8.
5. W.Gofton, N.Dudek, T.Wood, F.Balaa, S.Hamstra. The Ottawa Surgical Competency Operating Room Evaluation (O-SCORE): A tool to assess surgical competence. Academic Medicine 2012;87:1401–7.
6. Accreditation Council for Graduate Medical Education. Case Log Guidelines for Orthopedic Surgery. Available at http://www.acgme.org/acgmeweb/Portals/0-/PFAssets/ProgramResources/260_Case_Log_Guidelines.pdf. Accessed September272015.
7. R.K.Reznick Teaching and testing technical skills. American Journal of Surgery 1993;165:358–61.
8. A.Cuschieri, N.Francis, J.Crosby, G.B.Hanna. What do master surgeons think of surgical competence and revalidation? American Journal of Surgery 2001;182:110–6.
9. J.Turnbull, C.Van Barneveld. Assessment of clinical performance: In-training evaluation. In G.R.Norman, C.P.M.Van der Vleuten, D.I.Newble (Eds.), International handbook of research in medical education. London, UK: Kluwer Academic, 2002:793–810.
10. N.Dudek, M.Marks, G.Regehr. Failure to fail: the perspective of clinical supervisors. Academic Medicine. 2005;80(10, Suppl.):S84–7
11. C.P.M.Van der Vleuten, D.B.Swanson. Assessment of clinical skills with standardized patients: State of the art. Teaching and Learning in Medicine 1990;2:58–76.
12. H.Faulkner, G.Regehr, J.Martin, R.Reznick. Validation of an objective structured assessment of technical skill for surgical residents. Academic Medicine 1996;71:1363–5.
13. D.A.Cook, R.Brydges, B.Zendejas, S.J.Hamstra, R.Hatala. Technology-enhanced simulation to assess health professionals: A systematic review of validity evidence, research methods, and reporting quality. Academic Medicine 2013;88:872–83.
14. P.D.Van Hove, G.J.M.Tuijthof, E.G.G.Verdaasdonk, L.P.S.Stassen, J.Dankelman. Objective assessment of technical surgical skills. British Journal of Surgery 2010;97:972–87.
15. R.Hatala, D.A.Cook, R.Brydges, R.Hawkins. Constructing a validity argument for the Objective Structured Assessment of Technical Skills (OSATS): A systematic review of validity evidence. Advances in Health Sciences Education Theory and Practice 2015 Feb 22. [Epub ahead of print]
16. A.Cuschieri, N.Francis, J.Crosby, G.B.Hanna. What do master surgeons think of surgical competence and revalidation? American Journal of Surgery 2001;182:110–16.
17. H.Niitsu, N.Hirabayashi, M.Yoshimitsu, T.Mimura, J.Taomoto, Y.Sugiyama, et al. Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room. Surgery Today 2013;43:271–5.
18. K.Catchpole Spreading human factors expertise in healthcare: Untangling the knots in people and systems. Quality and Safety in Health Care 2013:1–5.
19. E.Hiemstra, W.Kolkman, R.Wolterbeek, B.Trimbos, F.W.Jansen. Value of an objective assessment tool in the operating room. Canadian Journal of Surgery 2011;54:116.
20. R.K.Reznick Teaching and testing technical skills. American Journal of Surgery 1993;165:358–61.
21. D.A.Cook, R.Brydges, S.Ginsburg, R.Hatala. A contemporary approach to validity arguments: A practical guide to Kane's framework. Medical Education 2015;49:560–75.
22. T.J.Beckman, D.A.Cook, J.N.Mandrekar. What is the validity evidence for assessments of clinical teaching? Journal of General Internal Medicine 2005;20:1159–64.
23. C.J.Hopmans, P.T.den Hoed, L.van der Laan, E.van der Hast, M.van der Elst, G.H.Mannaerts, et al. Assessment of surgery resident's operative skill in the operating theatre using a modified OSATS: A prospective multicenter study. Surgery 2014;156:1078–88.
24. American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Educational Research Association, 1999.
25. J.Sherbino. Key Literature in Medical Education (KeyLIME) Podcast Edition 32. Available at: http://www.royalcollege.ca/portal/page/portal/rc/canmeds/keylime/podcasts/archives#episode32. 2012.
26. S.E.Maxwell, H.D.Delaney. Designing experiments and analyzing data: A model comparison perspective (2nd ed.). Mahwah, NJ: Erlbaum, 2004.
27. S.M.Downing. Validity: On the meaningful interpretation of assessment data. Medical Education 2003;37:830–7.
28. D.A.Cook, T.J.Beckman. Current concepts in validity and reliability for psychometric instruments: Theory and application. The American Journal of Medicine 2006;119:166.e7-16.
29. J.Crossley, G.Humphris, B.Jolly. Assessing health professionals. Medical Education 2002;36:800–4.