Providing metrics and performance feedback in a surgical simulator

Computer Aided Surgery

Volumn 13, Issue 2, 2008, Pages 63-81

  Sewell, Christopher ^a,c   Morris, Dan ^a   Blevins, Nikolas H ^b   Dutta, Sanjeev ^b   Agrawal, Sumit ^b   Barbagli, Federico ^a   Salisbury, Kenneth ^a,b  

^a Stanford University   (United States)

^b STANFORD UNIVERSITY   (United States)

^c NONE   (United States)

Author keywords

Feedback; Mastoidectomy; Metrics; Performance evaluation; Simulation; Validation

Indexed keywords

ALGORITHM; AUTOMATION; COMPUTER SIMULATION; FEEDBACK SYSTEM; MASTOIDECTOMY; PRIORITY JOURNAL; REVIEW; SIMULATOR; SURGICAL TRAINING;

ALGORITHMS; CLINICAL COMPETENCE; COMPUTER SIMULATION; COMPUTER-ASSISTED INSTRUCTION; EDUCATIONAL MEASUREMENT; FEEDBACK; HUMANS; INTERNSHIP AND RESIDENCY; MASTOID; MATHEMATICAL COMPUTING; OTOLARYNGOLOGY; REPRODUCIBILITY OF RESULTS; SOFTWARE; SURGERY, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE;

EID: 40149110366     PISSN: 10929088     EISSN: 10970150     Source Type: Journal    
DOI: 10.1080/10929080801957712     Document Type: Review

References (40)

1. Luperfoy S. Intelligent tutoring technology: Accelerating change in medical instruction. Plenary session at Medicine Meets Virtual Reality 14 (MMVR14), Long Beach, CA, January 2006.
2. Bridges M, Diamond DL. The financial impact of teaching surgical residents in the operating room. Am J Surg 1999;177:28-32.
3. Anastakis DJ, Wanzel KR, Brown M, Herold J, McIllroy J, Hamstra S, Ali J, Hutchison C, Murnaghan J, Reznick R, Regehr G. Evaluating the effectiveness of a 2-year curriculum in a surgical skills center. Am J Surg 2003;185:378-385.
4. Paisley AM, Baldwin PJ, Paterson-Brown S. Accuracy of medical staff assessment of trainees' operative performance. Med Teach 2005;27:634-638.
5. Gates EA. New surgical procedures: Can our patients benefit while we learn? Am J Obstet Gynecol 1997;176:1293-1298; discussion 98-99.
6. Sidhu RS, Grober ED, Musselman LJ, Reznick RK. Assessing competency in surgery: Where to begin? Surgery 2004;135:6-20.
7. Reznick R, Regehr G, MacRae H, Martin J, McCulloch W. Testing technical skill via an innovative "bench station" examination. Am J Surg 1996;172:226-230.
8. Tuchschmid S, Bajka M, Bachofen D, Szekely G, Harders M. Objective surgical performance assessment for virtual hysteroscopy. In: Westwood JD, Haluck RS, Hoffman HM, Mogel GT, Phillips R, Robb RA, Vosburgh KG, editors. Proceedings of Medicine Meets Virtual Reality 15 (MMVR15), Long Beach, CA, February 2007. Studies in Health Technology and Informatics 125. Amsterdam: IOS Press; 2007. pp 473-478.
9. Cotin S, Stylopoulos N, Ottensmeyer M, Neumann P, Rattner D, Dawson S. Metrics for laparoscopic skills trainers: The weakest link! In: Dohi T, Kikinis R, editors. Proceedings of the 5th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2002), Tokyo, Japan, September 2002. Lecture Notes in Computer Science 2488. Berlin: Springer; 2002. pp 35-43.
10. Rosen J, Hannaford B, Richards CG, Sinanan MN. Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills. IEEE Trans Biomed Eng 2001;48(5):579-591.
11. Dosis A, Bello F, Gillies D, Undre S, Aggarwal R, Darzi A. Laparoscopic task recognition using Hidden Markov Models. In: Proceedings of Medicine Meets Virtual Reality 13 (MMVR13), Long Beach, CA, January 2005. Studies in Health Technology and Informatics 111. Amsterdam: IOS Press; 2005. pp 115-122.
12. Mackel T, Rosen J, Pugh C. Data mining of the E-pelvis simulator database: A quest for a generalized algorithm for objectively assessing medical skill. In: Proceedings of Medicine Meets Virtual Reality 14 (MMVR14), Long Beach, CA, January 2006. Studies in Health Technology and Informatics 119. Amsterdam: IOS Press; 2006. pp 355-360.
13. Murphy T. Towards objective surgical skill evaluation with Hidden Markov Model-based motion recognition. M.S. thesis, Department of Mechanical Engineering, The Johns Hopkins University, August 2004.
14. Ritter EM, McClusky DA, Gallagher AG, Smith CK. Real-time objective assessment of knot quality with a portable tensiometer is superior to execution time for assessment of laparoscopic knot-tying performance. Surgical Innovation 2005;12(3):233-237.
15. Rothstein AL, Arnold RK. Bridging the gap: Application of research on videotape feedback and bowling. Motor Skills: Theory Into Practice 1976;1:35-62.
16. Kernodle MW, Carlton LG. Information feedback and the learning of multiple-degree-of-freedom activities. J Motor Behavior 1992;24:187-196.
17. Feygin D, Keehner M, Tendick F. Haptic guidance: Experimental evaluation of a haptic training method for a perceptual motor skill. In: Proceedings of the 10th IEEE Haptics Symposium, Orlando, FL, March 2002.
18. Yang U, Kim GJ. Implementation and evaluation of Just Follow Me: An immersive, VR-based, motion-training system. Presence: Teleoperators and Virtual Environments 2002;11(3):304-323.
19. Morris D, Tan HZ, Barbagli F, Chang T, Salisbury K. Haptic feedback enhances force skill learning. In: Proceedings of the IEEE World Haptics Conference, Tsukuba, Japan, March 2007. pp 21-26.
20. Kahol K, Tripathi P, Panchanathan S. Documenting motion sequences: Development of a personalized annotation system. IEEE Multimedia Magazine 2007 (in press).
21. Rissanen MJ, Kuroda Y, Nakao M, Kuroda T, Nagase K, Yoshihara H. A novel approach for training of surgical procedures based on visualization and annotation of behavioural parameters in simulators. In: Westwood JD, Haluck RS, Hoffman HM, Mogel GT, Phillips R, Robb RA, Vosburgh KG, editors. Proceedings of Medicine Meets Virtual Reality 15 (MMVR15), Long Beach, CA, February 2007. Studies in Health Technology and Informatics 125. Amsterdam: IOS Press; 2007. pp 388-393.
22. Silverstein J, Selkov G, Salud L, Pugh C. Developing performance criteria for the E-Pelvis Simulator using visual analysis. In: Westwood JD, Haluck RS, Hoffman HM, Mogel GT, Phillips R, Robb RA, Vosburgh KG, editors. Proceedings of Medicine Meets Virtual Reality 15 (MMVR15), Long Beach, CA, February 2007. Studies in Health Technology and Informatics 125. Amsterdam: IOS Press; 2007. pp 436-438.
23. Agus M, Giachetti A, Gobbetti E, Zanetti G, Zorcolo A. A multiprocessor decoupled system for the simulation of temporal bone surgery. Computing and Visualization in Science 2002;5(1):35-43.
24. Agus M, Brelstaff GJ, Giachetti A, Gobbetti E, Zanetti G, Zorcolo A, Picasso B, Franceschini SS. Physics-based burr haptic simulation: Tuning and evaluation. In: Proceedings of the 12th IEEE Haptics Symposium, Chicago, IL, March 2004. pp 128-135.
25. Pflesser B, Petersik A, Tiede U, Höhne KH, Leuwer R. Volume cutting for virtual petrous bone surgery. Comput Aided Surg 2002;7(2):74-83.
26. Petersik A, Pflesser B, Tiede U, Höhn KH, Leuwer R. Haptic volume interaction with anatomic models at sub-voxel resolution. In: Proceedings of IEEE Virtual Reality (VR 2002), Orlando, FL, March 2002.
27. Renz M, Preusche C, Potke M, Kriegel HP, Hirzinger G. Stable haptic interaction with virtual environments using an adapted voxmap-pointshell algorithm. In: Proceedings of Eurohaptics, Birmingham, England, July 2001. pp 149-154.
28. Bryan J, Stredney D, Wiet G, Sessanna D. Virtual temporal bone dissection: A case study. In: Ertl T, Joy KI, Varshney A, editors. Proceedings of IEEE Visualization 2001, San Diego, CA, October 2001. pp 497-500.
29. Stredney D, Bryan J, Sessanna D, Weit G. Integration of an intelligent tutor in interactive medical simulation. Presentation at Ohio Learning Network Windows on the Future 2003, Columbus, OH, March 2003.
30. Morris D, Sewell C, Barbagli F, Blevins N, Girod S, Salisbury K. Visuohaptic simulation of bone surgery for training and evaluation. IEEE Trans Comput Graph Appl 2006;26(6):48-57.
31. Sewell C, Morris D, Blevins N, Barbagli F, Salisbury K. Quantifying risky behavior in surgical simulation. In: Proceedings of Medicine Meets Virtual Reality 13 (MMVR13), Long Beach, CA, January 2005. Studies in Health Technology and Informatics 111. Amsterdam: IOS Press; 2005. pp 451-457.
32. Sewell C, Morris D, Blevins N, Barbagli F, Salisbury K. Achieving proper exposure in surgical simulation. In: Proceedings of Medicine Meets Virtual Reality 14 (MMVR14), Long Beach, CA, January 2006. Studies in Health Technology and Informatics 119. Amsterdam: IOS Press; 2006. pp 497-502.
33. Sewell C, Morris D, Blevins N, Barbagli F, Salisbury K. Evaluating drilling and suctioning technique in a mastoidectomy simulator. In: Westwood JD, Haluck RS, Hoffman HM, Mogel GT, Phillips R, Robb RA, Vosburgh KG, editors. Proceedings of Medicine Meets Virtual Reality 15 (MMVR15), Long Beach, CA, February 2007. Studies in Health Technology and Informatics 125. Amsterdam: IOS Press; 2007. pp 427-432.
34. Morris D. Algorithms and data structures for haptic rendering: Curve constraints, distance maps, and data logging. Stanford University Department of Computer Science Technical Report 2006-06.
35. http://www.wischik.com/lu/programmer/avi_utils.html
36. http://www.chai3d.org
37. Baum LE, Egon JA. An inequality with applications to statistical estimation for probabilistic functions of a Markov process and to a model for ecology. Bull Amer Meteorol Soc 1967;73:360-363.
38. Baum LE, Petrie T, Soules G, Weiss N. A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann Math Statist 1970;41(1):164-171.
39. http://www.cs.ubc.ca/~murphyk/Software/HMM/hmm.html
40. Winstein CJ, Schmidt RA. Reduced frequency of knowledge of results enhances motor skill learning. J Exp Psych: Learning, Memory and Cognition 1990;16:677-691.