Current Status of Simulation-based Training Tools in Orthopedic Surgery: A Systematic Review

Journal of Surgical Education

Volumn 74, Issue 4, 2017, Pages 698-716

  Morgan, Michael ^a   Aydin, Abdullatif ^b   Salih, Alan ^c   Robati, Shibby ^c   Ahmed, Kamran ^b  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b GUY S HOSPITAL   (United Kingdom)

^c EAST SUSSEX HEALTHCARE NHS TRUST   (United Kingdom)

Author keywords

Interpersonal and Communication Skills; orthopedic surgery; Patient Care; Practice Based Learning and Improvement; simulation; systematic review; training

Indexed keywords

AMPUTATION; ARTICLE; EMBASE; EVIDENCE BASED MEDICINE; FRACTURE FIXATION; HIP ARTHROSCOPY; HUMAN; KNEE ARTHROSCOPY; KNEE REPLACEMENT; MEDLINE; ORTHOPEDIC SURGERY; PRIORITY JOURNAL; SHOULDER ARTHROSCOPY; SIMULATION TRAINING; SIMULATOR; SPINE SURGERY; SURGICAL TRAINING; SYSTEMATIC REVIEW; VALIDATION STUDY; ARTHROSCOPY; CLINICAL COMPETENCE; EDUCATION; ORTHOPEDICS; PROCEDURES;

ARTHROSCOPY; CLINICAL COMPETENCE; HUMANS; ORTHOPEDICS; SIMULATION TRAINING;

EID: 85011923309     PISSN: 19317204     EISSN: 18787452     Source Type: Journal    
DOI: 10.1016/j.jsurg.2017.01.005     Document Type: Article

References (98)

1. McDougall, E.M., Validation of surgical simulators. J Endourol 21:3 (2007), 244–247.
2. Aydin, A., Raison, N., Khan, M.S., Dasgupta, P., Ahmed, K., Simulation-based training and assessment in urological surgery. Nat Rev Urol 13:9 (2016), 503–519.
3. Kneebone, R., Aggarwal, R., Surgical training using simulation. Br Med J, 338, 2009, b1001.
4. Tay, C., Khajuria, A., Gupte, C., Simulation training: a systematic review of simulation in arthroscopy and proposal of a new competency-based training framework. Int J Surg 12:6 (2014), 626–633.
5. Thomas, G.W., Johns, B.D., Marsh, J.L., Anderson, D.D., A Review of the role of simulation in developing and assessing orthopaedic surgical skills. Iowa Orthop J 34 (2014), 181–189.
6. Frank, R., Erickson, B., Frank, J., et al. Utility of modern arthroscopic simulator training models. Arthroscopy 30:1 (2014), 121–133.
7. Samia, H., Khan, S., Lawrence, J., Delaney, C.P., Simulation and its role in training. Clin Colon Rectal Surg 26:1 (2013), 47–55.
8. Panic, N., Leoncini, E., de Belvis, G., Ricciardi, W., Boccia, S., Evaluation of the endorsement of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement on the quality of published systematic review and meta-analyses. PLoS ONE, 8(12), 2013 e83138.
9. Van Nortwick, S.S., Lendvay, T.S., Jensen, A.R., Wright, A.S., Horvath, K.D., Kim, S., Methodologies for establishing validity in surgical simulation studies. Surgery 147:5 (2010), 622–630.
10. Carter, F.J., Schijven, M.P., Aggarwal, R., et al. Consensus guidelines for validation of virtual reality surgical simulators. Surg Endosc 19:12 (2005), 1523–1532.
11. Akhtar, K., Wijendra, A., Bayona, S., et al. Assessing skills decay on a knee arthroscopy simulator. Arthroscopy, 29(Suppl 10), 2013, e139.
12. Chang, J., Banaszek, D.C., Gambrel, J., Bardana, D., Global Rating Scales and motion analysis are valid proficiency metrics in virtual and benchtop knee arthroscopy simulators. Clin Orthop Relat Res 474:4 (2016), 956–964.
13. Jacobsen, M.E., Andersen, M.J., Hansen, C.O., Konge, L., Testing basic competency in knee arthroscopy using a virtual reality simulator: exploring validity and reliability. J Bone Joint Surg Am 97:9 (2015), 775–781.
14. Rebolledo, B., Leali, A., Hammann, J., Ranawat, A., Arthroscopy skills development with a surgical simulator: a comparative study in orthopaedic surgery residents. Arthroscopy, 30(6), 2014, e36.
15. Butler, A., Olson, T., Koehler, R., Nicandri, G., Do the skills acquired by novice surgeons using anatomic dry models transfer effectively to the task of diagnostic knee arthroscopy performed on cadaveric specimens?. J Bone Joint Surg, 95(3), 2013, e15.
16. Howells, N.R., Gill, H.S., Carr, A.J., Price, A.J., Rees, J.L., Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. J Bone Joint Surg 90:4 (2008), 494–499.
17. Jackson, W.F., Khan, T., Alvand, A., et al. Learning and retaining simulated arthroscopic meniscal repair skills. J Bone Joint Surg 94:17 (2012), 131–138.
18. Tashiro, Y., Miura, H., Nakanishi, Y., Okazaki, K., Iwamoto, Y., Evaluation of skills in arthroscopic training based on trajectory and force data. Clin Orthop Relat Res 467:2 (2009), 546–552.
19. Camp, C.L., Krych, A.J., Stuart, M.J., Regnier, T.D., Mills, K.M., Turner, N.S., Improving resident performance in knee arthroscopy: a prospective value assessment of simulators and cadaveric skills laboratories. J Bone Joint Surg Am 98:3 (2016), 220–225.
20. Cowan, J.B., Seeley, M.A., Irwin, T.A., Caird, M.S., Computer-simulated arthroscopic knee surgery: effects of distraction on resident performance. Orthopedics 39:2 (2016), e240–e245.
21. Cannon, W.D., Garrett, W.E. Jr, Hunter, R.E., et al. Improving residency training in arthroscopic knee surgery with use of a virtual-reality simulator. A randomized blinded study. J Bone Joint Surg 96:21 (2014), 1798–1806.
22. Cannon, W.D., Nicandri, G.T., Reinig, K., Mevis, H., Wittstein, J., Evaluation of skill level between trainees and community orthopaedic surgeons using a virtual reality arthroscopic knee simulator. J Bone Joint Surg 96:7 (2014), 51–57.
23. Dwyer, T., Slade Shantz, J., Chahal, J., et al. Simulation of anterior cruciate ligament reconstruction in a dry model. Am J Sports Med 43:12 (2015), 2997–3004.
24. Escoto, A., Le Ber, F., Trejos, A.L., Naish, M.D., Patel, R.V., Lebel, M.E., A knee arthroscopy simulator: design and validation. Conf Proc IEEE Eng Med Biol Soc 2013 (2013), 5715–5718.
25. Ferguson, J., Middleton, R., Alvand, A., Rees, J., Newly acquired arthroscopic skills: are they transferable during simulator training of other joints?. Knee Surg Sports Traumatol Arthrosc, 2015, 1–8 [ahead of print].
26. Fucentese, S.F., Rahm, S., Wieser, K., Spillmann, J., Harders, M., Koch, P.P., Evaluation of a virtual-reality-based simulator using passive haptic feedback for knee arthroscopy. Knee Surg Sports Traumatol Arthrosc 23:4 (2015), 1077–1085.
27. Rahm, S., Wieser, K., Wicki, I., Holenstein, L., Fucentese, S.F., Gerber, C., Performance of medical students on a virtual reality simulator for knee arthroscopy: an analysis of learning curves and predictors of performance. BMC Surg 16:1 (2016), 1–8.
28. Stunt, J.J., Kerkhoffs, G.M., van Dijk, C.N., Tuijthof, G.J., Validation of the ArthroS virtual reality simulator for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc 23:11 (2015), 3436–3442.
29. Heng, P.A., Cheng, C.Y., Wong, T.T., et al. A virtual-reality training system for knee arthroscopic surgery. IEEE Trans Inf Technol Biomed 8:2 (2004), 217–227.
30. Heng, P.A., Cheng, C.Y., Wong, T.T., et al. Virtual reality techniques. Application to anatomic visualization and orthopaedics training. Clin Orthop Relat Res 442 (2006), 5–12.
31. Mabrey, J.D., Gillogly, S.D., Kasser, J.R., et al. Virtual reality simulation of arthroscopy of the knee. Arthroscopy, 18(6), 2002, E28.
32. Poss, R., Mabrey, J.D., Gillogly, S.D., et al. Development of a virtual reality arthroscopic knee simulator. J Bone Joint Surg 82-A:10 (2000), 1495–1499.
33. Martin, R.K., Gillis, D., Leiter, J., Shantz, J.S., MacDonald, P., A Porcine Knee Model is valid for use in the evaluation of arthroscopic skills: a pilot study. Clin Orthop Relat Res 474:4 (2016), 965–970.
34. McCarthy, A.D., Moody, L., Waterworth, A.R., Bickerstaff, D.R., Passive haptics in a knee arthroscopy simulator: is it valid for core skills training?. Clin Orthop Relat Res 442 (2006), 13–20.
35. Megali, G., Tonet, O., Dario, P., Vascellari, A., Marcacci, M., Computer-assisted training system for knee arthroscopy. Int J Med Robot 1:3 (2005), 57–66.
36. Peres, L.R., Junior, W.M., Coelho, G., Lyra, M., A new simulator model for knee arthroscopy procedures. Knee Surg Sports Traumatol Arthrosc, 2016 [ahead of print].
37. Garfjeld Roberts, P., Guyver, P., Baldwin, M., et al. Validation of the updated ArthroS simulator: face and construct validity of a passive haptic virtual reality simulator with novel performance metrics. Knee Surg Sports Traumatol Arthrosc, 2016, 1–10.
38. Sabri, H., Cowan, B., Kapralos, B., Porte, M., Backstein, D., Dubrowskie, A., Serious games for knee replacement surgery procedure education and training. Procedia 2:2 (2010), 3483–3488.
39. Spillmann, J., Tuchschmid, S., Harders, M., Adaptive space warping to enhance passive haptics in an arthroscopy surgical simulator. IEEE Trans Vis Comput Graph 19:4 (2013), 626–633.
40. Strom, P., Kjellin, A., Hedman, L., Wredmark, T., Fellander-Tsai, L., Training in tasks with different visual-spatial components does not improve virtual arthroscopy performance. Surg Endosc 18:1 (2004), 115–120.
41. Tsai, M.D., Hsieh, M.S., Jou, S.B., Virtual reality orthopedic surgery simulator. Comput Biol Med 31:5 (2001), 333–351.
42. Tuijthof, G.J., van Sterkenburg, M.N., Sierevelt, I.N., van Oldenrijk, J., van Dijk, C.N., Kerkhoffs, G.M., First validation of the PASSPORT training environment for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc 18:2 (2010), 218–224.
43. Unalan, P.C., Akan, K., Orhun, H., et al. A basic arthroscopy course based on motor skill training. Knee Surg Sports Traumatol Arthrosc 18:10 (2010), 1395–1399.
44. Ziegler, R., Fischer, G., Muller, W., Gobel, M., Virtual reality arthroscopy training simulator. Comput Biol Med 25:2 (1995), 193–203.
45. Conditt, M.A., Noble, P.C., Thompson, M.T., Ismaily, S.K., Moy, G.J., Mathis, K.B., A computerized bioskills system for surgical skills training in total knee replacement. Proc Inst Mech Eng H 221:1 (2007), 61–69.
46. Jun, Y., Lee, K.-Y., Gwak, K.-W., Lim, D., Anatomic basis 3-D surgical simulation system for custom fit knee replacement. Int J Precision Eng Manufacturing 13:5 (2012), 709–715.
47. Pollard, T.C., Khan, T., Price, A.J., Gill, H.S., Glyn-Jones, S., Rees, J.L., Simulated hip arthroscopy skills: learning curves with the lateral and supine patient positions: a randomized trial. J Bone Joint Surg, 94(10), 2012, e68.
48. Andersen, C., Winding, T.N., Vesterby, M.S., Development of simulated arthroscopic skills. Acta Orthop 82:1 (2011), 90–95.
49. Dunn, J.C., Belmont, P.J., Lanzi, J., et al. Arthroscopic shoulder surgical simulation training curriculum: transfer reliability and maintenance of skill over time. J Surg Educ 72:6 (2015), 1118–1123.
50. Martin, K.D., Belmont, P.J. Jr., Schoenfeld, A.J., et al. Arthroscopic basic task performance in shoulder simulator model correlates with similar task performance in cadavers. J Bone Joint Surg 93:21 (2011), e1271–e1275.
51. Martin, K.D., Cameron, K., Belmont, P.J., Schoenfeld, A., Owens, B.D., Shoulder arthroscopy simulator performance correlates with resident and shoulder arthroscopy experience. J Bone Joint Surg, 94(21), 2012, e160.
52. Waterman, B.R., Martin, K.D., Cameron, K.L., Owens, B.D., Belmont, P.J. Jr, Simulation training improves surgical proficiency and safety during diagnostic shoulder arthroscopy performed by residents. Orthopedics 39:3 (2016), e479–e485.
53. Howells, N.R., Auplish, S., Hand, G.C., Gill, H.S., Carr, A.J., Rees, J.L., Retention of arthroscopic shoulder skills learned with use of a simulator: demonstration of a learning curve and loss of performance level after a time delay. J Bone Joint Surg 91:5 (2009), 1207–1213.
54. Gomoll, A.H., O'Toole, R.V., Czarnecki, J., Warner, J.J., Surgical experience correlates with performance on a virtual reality simulator for shoulder arthroscopy. Am J Sports Med 35:6 (2007), 883–888.
55. Gomoll, A.H., Pappas, G., Forsythe, B., Warner, J.J., Individual skill progression on a virtual reality simulator for shoulder arthroscopy: a 3-year follow-up study. Am J Sports Med 36:6 (2008), 1139–1142.
56. Henn Iii, R.F., Shah, N., Warner, J.J.P., Gomoll, A.H., Shoulder arthroscopy simulator training improves shoulder arthroscopy performance in a cadaveric model. Arthroscopy 29:6 (2013), 982–985.
57. Pedowitz, R.A., Esch, J., Snyder, S., Evaluation of a virtual reality simulator for arthroscopy skills development. Arthroscopy, 18(6), 2002, E29.
58. Srivastava, S., Youngblood, P.L., Rawn, C., Hariri, S., Heinrichs, W.L., Ladd, A.L., Initial evaluation of a shoulder arthroscopy simulator: establishing construct validity. J Shoulder Elbow Surg 13:2 (2004), 196–205.
59. Rahm, S., Germann, M., Hingsammer, A., Wieser, K., Gerber, C., Validation of a virtual reality-based simulator for shoulder arthroscopy. Knee Surg Sports Traumatol Arthrosc 24:5 (2016), 1730–1737.
60. Brubacher, J.W., Karg, J., Weinstock, P., Bae, D.S., A novel cast removal training simulation to improve patient safety. J Surg Educ 73:1 (2016), 7–11.
61. Beth Grossman, L., Komatsu, D.E., Badalamente, M.A., Braunstein, A.M., Hurst, L.C., Microsurgical simulation exercise for surgical training. J Surg Educ 73:1 (2016), 116–120.
62. Tsai, M.D., Hsieh, M.S., Accurate visual and haptic burring surgery simulation based on a volumetric model. J Xray Sci Technol 18:1 (2010), 69–85.
63. Vankipuram, M., Kahol, K., McLaren, A., Panchanathan, S., A virtual reality simulator for orthopedic basic skills: a design and validation study. J Biomed Inform 43:5 (2010), 661–668.
64. Lin, Y., Wang, X., Wu, F., Chen, X., Wang, C., Shen, G., Development and validation of a surgical training simulator with haptic feedback for learning bone-sawing skill. J Biomed Inform 48 (2014), 122–129.
65. Hsieh, M.S., Tsai, M.D., Yeh, Y.D., An amputation simulator with bone sawing haptic interaction. Biomed Eng 18:5 (2006), 229–236.
66. Blyth, P., Stott, N.S., Anderson, I.A., A simulation-based training system for hip fracture fixation for use within the hospital environment. Injury 38:10 (2007), 1197–1203.
67. Egan, C., Egan, R., Curran, P., Bryan, K., Fleming, P., Development of a model for teaching manipulation of a distal radial fracture. J Bone Joint Surg 95:5 (2013), 433–438.
68. Froelich, J.M., Milbrandt, J.C., Novicoff, W.M., Saleh, K.J., Allan, D.G., Surgical simulators and hip fractures: a role in residency training?. J Surg Educ 68:4 (2011), 298–302.
69. Pedersen, P., Palm, H., Ringsted, C., Konge, L., Virtual-reality simulation to assess performance in hip fracture surgery. Acta Orthop 85:4 (2014), 403–407.
70. LeBlanc, J., Hutchison, C., Hu, Y., Donnon, T., A comparison of orthopaedic resident performance on surgical fixation of an ulnar fracture using virtual reality and synthetic models. J Bone Joint Surg, 95(9), 2013, e60 S1-S5.
71. Mayne, I.P., Brydges, R., Moktar, J., Murnaghan, M.L., Development and assessment of a distal radial fracture model as a clinical teaching tool. J Bone Joint Surg Am 98:5 (2016), 410–416.
72. Moktar, J., Popkin, C.A., Howard, A., Murnaghan, M.L., Development of a cast application simulator and evaluation of objective measures of performance. J Bone Joint Surg, 96(9), 2014, e76.
73. Nousiainen, M.T., Omoto, D.M., Zingg, P.O., Weil, Y.A., Mardam-Bey, S.W., Eward, W.C., Training femoral neck screw insertion skills to surgical trainees: computer-assisted surgery versus conventional fluoroscopic technique. J Orthop Trauma 27:2 (2013), 87–92.
74. Rambani, R., Viant, W., Ward, J., Mohsen, A., Computer-assisted orthopedic training system for fracture fixation. J Surg Educ 70:3 (2013), 304–308.
75. Sugand, K., Mawkin, M., Gupte, C., Validating Touch Surgery™: a cognitive task simulation and rehearsal app for intramedullary femoral nailing. Injury 46:11 (2015), 2212–2216.
76. Sugand, K., Mawkin, M., Gupte, C., Training effect of using Touch Surgery™ for intramedullary femoral nailing. Injury 47:2 (2016), 448–452.
77. Yehyawi, T.M., Thomas, T.P., Ohrt, G.T., et al. A simulation trainer for complex articular fracture surgery. J Bone Joint Surg 95:13 (2013), e921–e928.
78. Adermann, J., Geissler, N., Bernal, L.E., Kotzsch, S., Korb, W., Development and validation of an artificial wetlab training system for the lumbar discectomy. Eur Spine J 23:9 (2014), 1978–1983.
79. Fuerst, D., Hollensteiner, M., Schrempf, A., Assessment parameters for a novel simulator in minimally invasive spine surgery. Conf Proc IEEE Eng Med Biol Soc 2015 (2015), 5110–5113.
80. Gottschalk, M.B., Yoon, S.T., Park, D.K., Rhee, J.M., Mitchell, P.M., Surgical training using three-dimensional simulation in placement of cervical lateral mass screws: a blinded randomized control trial. Spine J 15:1 (2015), 168–175.
81. Podolsky, D.J., Martin, A.R., Whyne, C.M., Massicotte, E.M., Hardisty, M.R., Ginsberg, H.J., Exploring the role of 3-dimensional simulation in surgical training: feedback from a pilot study. J Spinal Disord Tech 23:8 (2010), e70–e74.
82. Riehl, J., Widmaier, J., A simulator model for sacroiliac screw placement. J Surg Educ 69:3 (2012), 282–285.
83. Rush, R., Ginsberg, H.J., Jenkinson, R., Whyne, C.M., Beyond the operating room: a simulator for sacroiliac screw insertion. Surg Innov 15:4 (2008), 321–323.
84. Tonetti, J., Vadcard, L., Girard, P., Dubois, M., Merloz, P., Troccaz, J., Assessment of a percutaneous iliosacral screw insertion simulator. Orthop Traumatol Surg Res 95:7 (2009), 471–477.
85. Tortolani, P.J., Moatz, B.W., Parks, B.G., Cunningham, B.W., Sefter, J., Kretzer, R.M., Cadaver training module for teaching thoracic pedicle screw placement to residents. Orthopedics 36:9 (2013), e1128–e1133.
86. Yeo, C.T., Ungi, T., U-Thainual, P., Lasso, A., McGraw, R.C., Fichtinger, G., The effect of augmented reality training on percutaneous needle placement in spinal facet joint injections. IEEE Trans Biomed Eng 58:7 (2011), 2031–2037.
87. Stunt, J., Wulms, P., Kerkhoffs, G., Dankelman, J., van Dijk, C., Tuijthof, G., How valid are commercially available medical simulators?. Adv Med Educ Pract 5 (2014), 385–395.
88. Martin, J.A., Regehr, G., Reznick, R., et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:2 (1997), 273–278.
89. Schout, B.M., Hendrikx, A.J., Scherpbier, A.J., Bemelmans, B.L., Update on training models in endourology: a qualitative systematic review of the literature between January 1980 and April 2008. Eur Urol 54:6 (2008), 1247–1261.
90. Aydin, A., Shafi, A.M., Khan, M.S., Dasgupta, P., Ahmed, K., Current status of simulation and training models in urological surgery: a systematic review. J Urol 196:92 (2016), 312–320.
91. Madan, S.S., Pai, D.R., Role of simulation in arthroscopy training. Simul Healthc 9:2 (2014), 127–135.
92. Yule, S., Flin, R., Maran, N., Rowley, D., Youngson, G., Paterson-Brown, S., Surgeons’ non-technical skills in the operating room: reliability testing of the NOTSS behavior rating system. World J Surg 32:4 (2008), 548–556.
93. Gawande, A.A., Zinner, M.J., Studdert, D.M., Brennan, T.A., Analysis of errors reported by surgeons at three teaching hospitals. Surgery 133:6 (2003), 614–621.
94. Hull, L., Arora, S., Aggarwal, R., Darzi, A., Vincent, C., Sevdalis, N., The impact of nontechnical skills on technical performance in surgery: a systematic review. J Am Coll Surg 214:2 (2012), 214–230.
95. Arora, S., Miskovic, D., Hull, L., et al. Self vs expert assessment of technical and non-technical skills in high fidelity simulation. Am J Surg 202:4 (2011), 500–506.
96. Brunckhorst, O., Shahid, S., Aydin, A., et al. Simulation-based ureteroscopy skills training curriculum with integration of technical and non-technical skills: a randomised controlled trial. Surg Endosc 29:9 (2015), 2728–2735.
97. Kneebone, R., Arora, S., King, D., et al. Distributed simulation—accessible immersive training. Med Teach 32:1 (2010), 65–70.
98. Bridges, M., Diamond, D.L., The financial impact of teaching surgical residents in the operating room. Am J Surg 177:1 (1999), 28–32.