How valid are commercially available medical simulators?

Advances in Medical Education and Practice

Volumn 5, Issue , 2014, Pages 385-395

  Stunt, J J ^a   Wulms, P H ^b   Kerkhoffs, G M ^a   Dankelman, J ^b   van Dijk, C N ^a   Tuijthof, G J M ^a,b  

^a ACADEMIC MEDICAL CENTER   (Netherlands)

^b DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Medical education; Medical skills training; Training modality; Validation studies; Validity level

Indexed keywords

EID: 84973423502     PISSN: None     EISSN: 11797258     Source Type: Journal    
DOI: 10.2147/AMEP.S63435     Document Type: Review

References (151)

1. Wilfong DN, Falsetti DJ, McKinnon JL, Daniel LH, Wan QC. The effects of virtual intravenous and patient simulator training compared to the traditional approach of teaching nurses: a research project on peripheral iv catheter insertion. J Infus Nurs. 2011;34(1):55–62.
2. Gorman PJ, Meier AH, Krummel TM. Simulation and virtual reality in surgical education: real or unreal? Arch Surg. 1999;134(11): 1203–1208.
3. Ahmed R, Naqvi Z, Wolfhagen I. Psychomotor skills for the undergraduate medical curriculum in a developing country – Pakistan. Educ Health (Abingdon). 2005;18(1):5–13.
4. Wolpert DM, Ghahramani Z. Computational principles of movement neuroscience. Nat Neurosci. 2005;3 Suppl:1212–1217.
5. Wolpert DM, Ghahramani Z, Flanagan JR. Perspectives and problems in motor learning. Trends Cogn Sci. 2001;5(11):487–494.
6. Kunkler K. The role of medical simulation: an overview. Int J Med Robot. 2006;2(3):203–210.
7. Cannon WD, Eckhoff DG, Garrett WE Jr, Hunter RE, Sweeney HJ. Report of a group developing a virtual reality simulator for arthroscopic surgery of the knee joint. Clin Orthop Relat Res. 2006;442:21–29.
8. Heng PA, Cheng CY, Wong TT, et al. Virtual reality techniques. Application to anatomic visualization and orthopaedics training. Clin Orthop Relat Res. 2006;442:5–12.
9. Howells NR, Gill HS, Carr AJ, Price AJ, Rees JL. Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. J Bone Joint Surg Br. 2008;90(4):494–499.
10. McCarthy AD, Moody L, Waterworth AR, Bickerstaff DR. Passive haptics in a knee arthroscopy simulator: is it valid for core skills training? Clin Orthop Relat Res. 2006;442:13–20.
11. Michelson JD. Simulation in orthopaedic education: an overview of theory and practice. J Bone Joint Surg Am. 2006;88(6): 1405–1411.
12. Poss R, Mabrey JD, Gillogly SD, Kasser JR, et al. Development of a virtual reality arthroscopic knee simulator. J Bone Joint Surg Am. 2000;82-A(10):1495–1499.
13. Safir O, Dubrowski A, Mirksy C, Backstein D, Carnahan H. What skills should simulation training in arthroscopy teach residents? Int J CARS. 2008;3:433–437.
14. Tuijthof GJ, van Sterkenburg MN, Sierevelt IN, van OJ, Van Dijk CN, Kerkhoffs GM. First validation of the PASSPORT training environment for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc. 2010;18(2):218–224.
15. Frost and Sullivan. Return on Investment Study for Medical Simulation Training: Immersion Medical, Inc. Laparoscopy AccutouchÚ System; 2012. Available from: http://www.healthleadersmedia.com/content/138774.pdf. Accessed June 23, 2014.
16. Insel A, Carofino B, Leger R, Arciero R, Mazzocca AD. The development of an objective model to assess arthroscopic performance. J Bone Joint Surg Am. 2009;91(9):2287–2295.
17. Tuijthof GJ, Visser P, Sierevelt IN, van Dijk CN, Kerkhoffs GM. Does perception of usefulness of arthroscopic simulators differ with levels of experience? Clin Orthop Relat Res. 2011;469(6):1701–1708.
18. Horeman T, Rodrigues SP, Jansen FW, Dankelman J, van den Dobbelsteen JJ. Force measurement platform for training and assessment of laparoscopic skills. Surg Endosc. 2010;24(12): 3102–3108.
19. Issenberg SB, McGaghie WC, Hart IR, et al. Simulation technology for health care professional skills training and assessment. JAMA. 1999;282(9):861–866.
20. Goodman W. The world of civil simulators. Flight International Magazine. 1978;18:435.
21. Streufert S, Pogash R, Piasecki M. Simulation-based assessment of managerial competence: reliability and validity. Personnel Psychology. 1988;41(3):537–557.
22. Rolfe JM, Staples KJ, editors. Flight simulation. Cambridge University Press; 1988.
23. Keys B, Wolfe J. The Role of Management Games and Simulations in Education and Research. Journal of Management. 1990;16(2): 307–336.
24. Schijven MP, Jakimowicz JJ. Validation of virtual reality simulators: Key to the successful integration of a novel teaching technology into minimal access surgery. Minim Invasive Ther Allied Technol. 2005;14(4):244–246.
25. Chmarra MK, Klein S, de Winter JC, Jansen FW, Dankelman J. Objective classification of residents based on their psychomotor laparoscopic skills. Surg Endosc. 2010;24(5):1031–1039.
26. van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J. Objective assessment of technical surgical skills. Br J Surg. 2010; 97(7):972–987.
27. Alinier G, Hunt WB, Gordon R. Determining the value of simulation in nurse education: study design and initial results. Nurse Educ Pract. 2004;4(3):200–207.
28. Donoghue AJ, Durbin DR, Nadel FM, Stryjewski GR, Kost SI, Nadkarni VM. Effect of high-fidelity simulation on Pediatric Advanced Life Support training in pediatric house staff: a randomized trial. Pediatr Emerg Care. 2009;25(3):139–144.
29. Monsieurs KG, De RM, Schelfout S, et al. Efficacy of a self-learning station for basic life support refresher training in a hospital: a randomized controlled trial. Eur J Emerg Med. 2012;19(4):214–219.
30. European Society for Emergency Medicine [homepage on the Internet]. Emergency Medicine; 2012. Available from: http://www.eusem.org/whatisem/. Accessed June 23, 2014.
31. Handley AJ. Basic life support. Br J Anaesth. 1997;79(2):151–158.
32. Oropesa I, Sanchez-Gonzalez P, Lamata P, et al. Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery. J Surg Res. 2011;171(1):e81–e95.
33. Carter FJ, Schijven MP, Aggarwal R, et al. Consensus guidelines for validation of virtual reality surgical simulators. Surg Endosc. 2005;19(12):1523–1532.
34. Issenberg SB, McGaghie WC, Waugh RA. Computers and evaluation of clinical competence. Ann Intern Med. 1999;130(3):244–245.
35. Martin JT, Reda H, Dority JS, Zwischenberger JB, Hassan ZU. Surgical resident training using real-time simulation of cardiopulmonary bypass physiology with echocardiography. J Surg Educ. 2011;68(6):542–546.
36. Tan GM, Ti LK, Suresh S, Ho BS, Lee TL. Teaching first-year medical students physiology: does the human patient simulator allow for more effective teaching? Singapore Med J. 2002;43(5):238–242.
37. Nehring WM, Lashley FR. Current use and opinions regarding human patient simulators in nursing education: an international survey. Nurs Educ Perspect. 2004;25(5):244–248.
38. Fernandez GL, Lee PC, Page DW, D’Amour EM, Wait RB, Seymour NE. Implementation of full patient simulation training in surgical residency. J Surg Educ. 2010;67(6):393–399.
39. Bath J, Lawrence P, Chandra A, et al. Standardization is superior to traditional methods of teaching open vascular simulation. J Vasc Surg. 2011;53(1):229–234.
40. Uppal V, Kearns RJ, McGrady EM. Evaluation of M43B Lumbar puncture simulator-II as a training tool for identification of the epidural space and lumbar puncture. Anaesthesia. 2011;66(6):493–496.
41. Uppal JK, Varshney R, Hazari PP, Chuttani K, Kaushik NK, Mishra AK. Biological evaluation of avidin-based tumor pretargeting with DOTA-Triazole-Biotin constructed via versatile Cu(I) catalyzed click chemistry. J Drug Target. 2011;19(6):418–426.
42. Laerdal, helping saves lives. 2012. Available from: http://www.laerdal. com/nl/. Accessed August 8, 2014.
43. Verdaasdonk EG, Stassen LP, Monteny LJ, Dankelman J. Standardization is superior to traditional methods of teaching open vascular simulation. Surg Endosc. 2006;20(3):511–518.
44. Verdaasdonk EG, Stassen LP, Schijven MP, Dankelman J. Construct validity and assessment of the learning curve for the SIMENDO endoscopic simulator. Surg Endosc. 2007;21(8):1406–1412.
45. Verma A, Bhatt H, Booton P, Kneebone R. The Ventriloscope(R) as an innovative tool for assessing clinical examination skills: appraisal of a novel method of simulating auscultatory findings. Med Teach. 2011;33(7):e388–e396.
46. Wilson M, Shepherd I, Kelly C, Pitzner J. Assessment of a low-fidelity human patient simulator for the acquisition of nursing skills. Nurse Educ Today. 2005;25(1):56–67.
47. Kruger A, Gillmann B, Hardt C, Doring R, Beckers SK, Rossaint R. Vermittlung von „soft skills“ für Belastungssituationen. [Teaching nontechnical skills for critical incidents: Crisis resource management training for medical students]. Anaesthesist. 2009;58(6):582–588. German.
48. Shukla A, Kline D, Cherian A, et al. A simulation course on lifesaving techniques for third-year medical students. Simul Healthc. 2007;2(1):11–15.
49. Pascual JL, Holena DN, Vella MA, et al. Short simulation training improves objective skills in established advanced practitioners managing emergencies on the ward and surgical intensive care unit. J Trauma. 2011;71(2):330–337.
50. Karnath B, Thornton W, Frye AW. Teaching and testing physical examination skills without the use of patients. Acad Med. 2002; 77(7):753.
51. Nadler I, Liley HG, Sanderson PM. Clinicians can accurately assign Apgar scores to video recordings of simulated neonatal resuscitations. Simul Healthc. 2010;5(4):204–212.
52. Chou DS, Abdelshehid C, Clayman RV, McDougall EM. Comparison of results of virtual-reality simulator and training model for basic ureteroscopy training. J Endourol. 2006;20(4):266–271.
53. Lucas S, Tuncel A, Bensalah K, et al. Virtual reality training improves simulated laparoscopic surgery performance in laparoscopy naive medical students. J Endourol. 2008;22(5):1047–1051.
54. Korets R, Mues AC, Graversen JA, et al. Validating the use of the Mimic dV-trainer for robotic surgery skill acquisition among urology residents. Urology. 2011;78(6):1326–1330.
55. Adler MD, Trainor JL, Siddall VJ, McGaghie WC. Development and evaluation of high fidelity simulation case scenarios for pediatric resident education. Ambul Pediatr. 2007;7(2):182–186.
56. Schout BM, Ananias HJ, Bemelmans BL, et al. Transfer of cysto-urethroscopy skills from a virtual-reality simulator to the operating room: a randomized controlled trial. BJU Int. 2010;106(2): 226–231.
57. Schout BM, Muijtjens AM, et al. Acquisition of flexible cystoscopy skills on a virtual reality simulator by experts and novices. BJU Int. 2010;105(2):234–239.
58. Knoll T, Trojan L, Haecker A, Alken P, Michel MS. Validation of computer-based training in ureterorenoscopy. BJU Int. 2005;95(9): 1276–1279.
59. Clayman RV. Assessment of basic endoscopic performance using a virtual reality simulator. J Urol. 2003;170(2 Pt 1):692.
60. Inspectie voor de Gezondheidszorg [homepage on the Internet]. Rapport ‘Risico’s minimaal invasieve chirurgie onderschat, kwaliteitssysteem voor laparoscopische operaties ontbreekt’ [Healthcare Inspectorate. Risks minimally invasive surgery underestimated.]; 2012. Available from: http://www.igz.nl/zoeken/document.aspx?doc=Rapport+’Risic o’s+minimaal+invasieve+chirurgie+onderschat%2C+kwaliteitssystee m+voor+laparoscopische+operaties+ontbreekt’&docid=475. Accessed June 23, 2014.
61. Issenberg SB, McGaghie WC, Petrusa ER, Lee GD, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27(1): 10–28.
62. Rosenthal R, Gantert WA, Hamel C, et al. Assessment of construct validity of a virtual reality laparoscopy simulator. J Laparoendosc Adv Surg Tech A. 2007;17(4):407–413.
63. Kuduvalli PM, Jervis A, Tighe SQ, Robin NM. Construct validity and assessment of the learning curve for the SIMENDO endoscopic simulator. Anaesthesia. 2008;63(4):364–369.
64. Oddone EZ, Waugh RA, Samsa G, Corey R, Feussner JR. Teaching cardiovascular examination skills: results from a randomized controlled trial. Am J Med. 1993;95(4):389–396.
65. Jones JS, Hunt SJ, Carlson SA, Seamon JP. Assessing bedside cardiologic examination skills using “Harvey,” a cardiology patient simulator. Acad Emerg Med. 1997;4(10):980–985.
66. Giovanni de GD, Roberts T, Norman G. Relative effectiveness of highversus low-fidelity simulation in learning heart sounds. Med Educ. 2009;43(7):661–668.
67. Ende A, Zopf Y, Konturek P, et al. Strategies for training in diagnostic upper endoscopy: a prospective, randomized trial. Gastrointest Endosc. 2012;75(2):254–260.
68. Ferlitsch A, Glauninger P, Gupper A, et al. Evaluation of a virtual endoscopy simulator for training in gastrointestinal endoscopy. Endoscopy. 2002;34(9):698–702.
69. Ritter EM, McClusky DA III, Lederman AB, Gallagher AG, Smith CD. Objective psychomotor skills assessment of experienced and novice flexible endoscopists with a virtual reality simulator. J Gastrointest Surg. 2003;7(7):871–877.
70. Eversbusch A, Grantcharov TP. Learning curves and impact of psychomotor training on performance in simulated colonoscopy: a randomized trial using a virtual reality endoscopy trainer. Surg Endosc. 2004;18(10):1514–1518.
71. Felsher JJ, Olesevich M, Farres H, et al. Validation of a flexible endoscopy simulator. Am J Surg. 2005;189(4):497–500.
72. Grantcharov TP, Carstensen L, Schulze S. Objective assessment of gastrointestinal endoscopy skills using a virtual reality simulator. JSLS. 2005;9(2):130–133.
73. Koch AD, Buzink SN, Heemskerk J, et al. Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy. Surg Endosc. 2008;22(1):158–162.
74. Shirai Y, Yoshida T, Shiraishi R, et al. Prospective randomized study on the use of a computer-based endoscopic simulator for training in esophagogastroduodenoscopy. J Gastroenterol Hepatol. 2008;23(7 Pt 1): 1046–1050.
75. Buzink SN, Goossens RH, Schoon EJ, de RH, Jakimowicz JJ. Do basic psychomotor skills transfer between different image-based procedures? World J Surg. 2010;34(5):933–940.
76. Fayez R, Feldman LS, Kaneva P, Fried GM. Testing the construct validity of the Simbionix GI Mentor II virtual reality colonoscopy simulator metrics: module matters. Surg Endosc. 2010;24(5):1060–1065.
77. Van Sickle KR, Buck L, Willis R, et al. A multicenter, simulationbased skills training collaborative using shared GI Mentor II systems: results from the Texas Association of Surgical Skills Laboratories (TASSL) flexible endoscopy curriculum. Surg Endosc. 2011;25(9): 2980–2986.
78. Gettman MT, Le CQ, Rangel LJ, Slezak JM, Bergstralh EJ, Krambeck AE. Analysis of a computer based simulator as an educational tool for cystoscopy: subjective and objective results. J Urol. 2008;179(1):267–271.
79. Ogan K, Jacomides L, Shulman MJ, Roehrborn CG, Cadeddu JA, Pearle MS. Virtual ureteroscopy predicts ureteroscopic proficiency of medical students on a cadaver. J Urol. 2004;172(2):667–671.
80. Shah J, Montgomery B, Langley S, Darzi A. Validation of a flexible cystoscopy course. BJU Int. 2002;90(9):833–885.
81. Shah J, Darzi A. Virtual reality flexible cystoscopy: a validation study. BJU Int. 2002;90(9):828–832.
82. Mishra S, Kurien A, Patel R, et al. Validation of virtual reality simulation for percutaneous renal access training. J Endourol. 2010;24(4): 635–640.
83. Vitish-Sharma P, Knowles J, Patel B. Acquisition of fundamental laparoscopic skills: is a box really as good as a virtual reality trainer? Int J Surg. 2011;9(8):659–661.
84. Zhang A, Hunerbein M, Dai Y, Schlag PM, Beller S. Construct validity testing of a laparoscopic surgery simulator (Lap Mentor): evaluation of surgical skill with a virtual laparoscopic training simulator. Surg Endosc. 2008;22(6):1440–1444.
85. Yamaguchi S, Konishi K, Yasunaga T, et al. Construct validity for eye-hand coordination skill on a virtual reality laparoscopic surgical simulator. Surg Endosc. 2007;21(12):2253–2257.
86. Ayodeji ID, Schijven M, Jakimowicz J, Greve JW. Face validation of the Simbionix LAP Mentor virtual reality training module and its applicability in the surgical curriculum. Surg Endosc. 2007;21(9):1641–1649.
87. Andreatta PB, Woodrum DT, Birkmeyer JD, et al. Laparoscopic skills are improved with LapMentor training: results of a randomized, double-blinded study. Ann Surg. 2006;243(6):854–860.
88. Hall AB. Randomized objective comparison of live tissue training versus simulators for emergency procedures. Am Surg. 2011;77(5):561–565.
89. Dayan AB, Ziv A, Berkenstadt H, Munz Y. A simple, low-cost platform for basic laparoscopic skills training. Surg Innov. 2008;15(2): 136–142.
90. Boon JR, Salas N, Avila D, Boone TB, Lipshultz LI, Link RE. Construct validity of the pig intestine model in the simulation of laparoscopic urethrovesical anastomosis: tools for objective evaluation. J Endourol. 2008;22(12):2713–2716.
91. Youngblood PL, Srivastava S, Curet M, Heinrichs WL, Dev P, Wren SM. Comparison of training on two laparoscopic simulators and assessment of skills transfer to surgical performance. J Am Coll Surg. 2005;200(4):546–551.
92. Taffinder N, Sutton C, Fishwick RJ, McManus IC, Darzi A. Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. Stud Health Technol Inform. 1998;50: 124–130.
93. Jordan JA, Gallagher AG, McGuigan J, McClure N. Virtual reality training leads to faster adaptation to the novel psychomotor restrictions encountered by laparoscopic surgeons. Surg Endosc. 2001;15(10): 1080–1084.
94. McNatt SS, Smith CD. A computer-based laparoscopic skills assessment device differentiates experienced from novice laparoscopic surgeons. Surg Endosc. 2001;15(10):1085–1089.
95. Kothari SN, Kaplan BJ, DeMaria EJ, Broderick TJ, Merrell RC. Training in laparoscopic suturing skills using a new computer-based virtual reality simulator (MIST-VR) provides results comparable to those with an established pelvic trainer system. J Laparoendosc Adv Surg Tech A. 2002;12(3):167–173.
96. Seymour NE, Gallagher AG, Roman SA, et al. Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg. 2002;236(4):458–463.
97. Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P. Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg. 2004; 91(2):146–150.
98. Maithel S, Sierra R, Korndorffer J, et al. Construct and face validity of MIST-VR, Endotower, and CELTS: are we ready for skills assessment using simulators? Surg Endosc. 2006;20(1):104–112.
99. Hackethal A, Immenroth M, Burger T. Evaluation of target scores and benchmarks for the traversal task scenario of the Minimally Invasive Surgical Trainer-Virtual Reality (MIST-VR) laparoscopy simulator. Surg Endosc. 2006;20(4):645–650.
100. Tanoue K, Ieiri S, Konishi K, et al. Effectiveness of endoscopic surgery training for medical students using a virtual reality simulator versus a box trainer: a randomized controlled trial. Surg Endosc. 2008;22(4):985–990.
101. Debes AJ, Aggarwal R, Balasundaram I, Jacobsen MB. A tale of two trainers: virtual reality versus a video trainer for acquisition of basic laparoscopic skills. Am J Surg. 2010;199(6):840–845.
102. Botden SM, de Hingh IH, Jakimowicz JJ. Meaningful assessment method for laparoscopic suturing training in augmented reality. Surg Endosc. 2009;23(10):2221–2228.
103. Srivastava S,Youngblood PL, Rawn C, Hariri S, Heinrichs WL, LaddAL. Initial evaluation of a shoulder arthroscopy simulator: establishing construct validity. J Shoulder Elbow Surg. 2004;13(2):196–205.
104. Brewin J, Nedas T, Challacombe B, Elhage O, Keisu J, Dasgupta P. Face, content and construct validation of the first virtual reality laparoscopic nephrectomy simulator. BJU Int. 2010;106(6):850–854.
105. Torkington J, Smith SG, Rees B, Darzi A. The role of the basic surgical skills course in the acquisition and retention of laparoscopic skill. Surg Endosc. 2001;15(10):1071–1075.
106. Schijven MP, Jakimowicz J. The learning curve on the Xitact LS 500 laparoscopy simulator: profiles of performance. Surg Endosc. 2004;18(1):121–127.
107. Schijven M, Jakimowicz J. Face-, expert, and referent validity of the Xitact LS500 laparoscopy simulator. Surg Endosc. 2002;16(12): 1764–1770.
108. Schijven M, Jakimowicz J. Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. Surg Endosc. 2003;17(5):803–810.
109. Bajka M, Tuchschmid S, Fink D, Szekely G, Harders M. Establishing construct validity of a virtual-reality training simulator for hysteroscopy via a multimetric scoring system. Surg Endosc. 2010;24(1):79–88.
110. Bajka M, Tuchschmid S, Streich M, Fink D, Szekely G, Harders M. Evaluation of a new virtual-reality training simulator for hysteroscopy. Surg Endosc. 2009;23(9):2026–2033.
111. Buzink SN, Botden SM, Heemskerk J, Goossens RH, de RH, Jakimowicz JJ. Camera navigation and tissue manipulation; are these laparoscopic skills related? Surg Endosc. 2009;23(4):750–757.
112. Buzink SN, Goossens RH, de RH, Jakimowicz JJ. Training of basic laparoscopy skills on SimSurgery SEP. Minim Invasive Ther Allied Technol. 2010;19(1):35–41.
113. van der Meijden OA, Broeders IA, Schijven MP. The SEP “robot”: a valid virtual reality robotic simulator for the Da Vinci Surgical System? Surg Technol Int. 2010;19:51–58.
114. Wohaibi EM, Bush RW, Earle DB, Seymour NE. Surgical resident performance on a virtual reality simulator correlates with operating room performance. J Surg Res. 2010;160(1):67–72.
115. Bayona S, Fernández-Arroyo JM, Martín I, Bayona P. Assessment study of insight ARTHRO VR arthroscopy virtual training simulator: face, content, and construct validities. Journal of Robotic Surgery. 2008;2(3):151–158.
116. Hasson HM, Kumari NV, Eekhout J. Training simulator for developing laparoscopic skills. JSLS. 2001;5(3):255–256.
117. Fichera A, Prachand V, Kives S, Levine R, Hasson H. Physical reality simulation for training of laparoscopists in the 21st century. A multispecialty, multi-institutional study. JSLS. 2005;9(2):125–129.
118. Hasson HM. Simulation training in laparoscopy using a computerized physical reality simulator. JSLS. 2008;12(4):363–367.
119. Hung AJ, Zehnder P, Patil MB, et al. Face, content and construct validity of a novel robotic surgery simulator. J Urol. 2011;186(3): 1019–1024.
120. Lerner MA, Ayalew M, Peine WJ, Sundaram CP. Does training on a virtual reality robotic simulator improve performance on the da Vinci surgical system? J Endourol. 2010;24(3):467–472.
121. Kenney PA, Wszolek MF, Gould JJ, Libertino JA, Moinzadeh A. Face, content, and construct validity of dV-trainer, a novel virtual reality simulator for robotic surgery. Urology. 2009;73(6):1288–1292.
122. Iwata N, Fujiwara M, Kodera Y, et al. Construct validity of the LapVR virtual-reality surgical simulator. Surg Endosc. 2011;25(2): 423–428.
123. Sethi AS, Peine WJ, Mohammadi Y, Sundaram CP. Validation of a novel virtual reality robotic simulator. J Endourol. 2009;23(3): 503–508.
124. Mahmood T, Darzi A. A study to validate the colonoscopy simulator. Surg Endosc. 2003;17(10):1583–1589.
125. Ahlberg G, Hultcrantz R, Jaramillo E, Lindblom A, Arvidsson D. Virtual reality colonoscopy simulation: a compulsory practice for the future colonoscopist? Endoscopy. 2005;37(12):1198–1204.
126. Rowe R, Cohen RA. An evaluation of a virtual reality airway simulator. Anesth Analg. 2002;95(1):62–66.
127. Broe D, Ridgway PF, Johnson S, Tierney S, Conlon KC. Construct validation of a novel hybrid surgical simulator. Surg Endosc. 2006;20(6):900–904.
128. Van Sickle KR, McClusky DA III, Gallagher AG, Smith CD. Construct validation of the ProMIS simulator using a novel laparoscopic suturing task. Surg Endosc. 2005;19(9):1227–1231.
129. Pellen MG, Horgan LF, Barton JR, Attwood SE. Construct validity of the ProMIS laparoscopic simulator. Surg Endosc. 2009;23(1): 130–139.
130. Botden SM, Berlage JT, Schijven MP, Jakimowicz JJ. Face validity study of the ProMIS augmented reality laparoscopic suturing simulator. Surg Technol Int. 2008;17:26–32.
131. Jonsson MN, Mahmood M, Askerud T, et al. ProMIS can serve as a da Vinci(R) simulator – a construct validity study. J Endourol. 2011;25(2):345–350.
132. Chandra V, Nehra D, Parent R, et al. A comparison of laparoscopic and robotic assisted suturing performance by experts and novices. Surgery. 2010;147(6):830–839.
133. Feifer A, Delisle J, Anidjar M. Hybrid augmented reality simulator: preliminary construct validation of laparoscopic smoothness in a urology residency program. J Urol. 2008;180(4):1455–1459.
134. Cesanek P, Uchal M, Uranues S, et al. Do hybrid simulator-generated metrics correlate with content-valid outcome measures? Surg Endosc. 2008;22(10):2178–2183.
135. Neary PC, Boyle E, Delaney CP, Senagore AJ, Keane FB, Gallagher AG. Construct validation of a novel hybrid virtual-reality simulator for training and assessing laparoscopic colectomy; results from the first course for experienced senior laparoscopic surgeons. Surg Endosc. 2008;22(10):2301–2309.
136. Ritter EM, Kindelan TW, Michael C, Pimentel EA, Bowyer MW. Concurrent validity of augmented reality metrics applied to the fundamentals of laparoscopic surgery (FLS). Surg Endosc. 2007;21(8): 1441–1445.
137. Woodrum DT, Andreatta PB, Yellamanchilli RK, Feryus L, Gauger PG, Minter RM. Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg. 2006;191(1):28–32.
138. Duffy AJ, Hogle NJ, McCarthy H, et al. Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc. 2005;19(3): 401–405.
139. Verdaasdonk EG, Dankelman J, Lange JF, Stassen LP. Transfer validity of laparoscopic knot-tying training on a VR simulator to a realistic environment: a randomized controlled trial. Surg Endosc. 2008;22(7):1636–1642.
140. Dayal R, Faries PL, Lin SC, et al. Computer simulation as a component of catheter-based training. J Vasc Surg. 2004;40(6):1112–1117.
141. Nicholson WJ, Cates CU, Patel AD, et al. Face and content validation of virtual reality simulation for carotid angiography: results from the first 100 physicians attending the Emory NeuroAnatomy Carotid Training (ENACT) program. Simul Healthc. 2006;1(3):147–150.
142. Willoteaux S, Lions C, Duhamel A, et al. Réalité virtuelle en radiologie vasculaire interventionnelle: évaluation des performances. [Virtual interventional radiology: evaluation of performances as a function of experience]. J Radiol. 2009;90:37–41. French.
143. Van Herzeele I, Aggarwal R, Neequaye S, Darzi A, Vermassen F, Cheshire NJ. Cognitive training improves clinically relevant outcomes during simulated endovascular procedures. J Vasc Surg. 2008;48(5):1223–1230.
144. Van Herzeele I, Aggarwal R, Choong A, Brightwell R, Vermassen FE, Cheshire NJ. Virtual reality simulation objectively differentiates level of carotid stent experience in experienced interventionalists. J Vasc Surg. 2007;46(5):855–863.
145. Patel AD, Gallagher AG, Nicholson WJ, Cates CU. Learning curves and reliability measures for virtual reality simulation in the performance assessment of carotid angiography. J Am Coll Cardiol. 2006;47(9):1796–1802.
146. Berry M, Reznick R, Lystig T, Lonn L. The use of virtual reality for training in carotid artery stenting: a construct validation study. Acta Radiol. 2008;49(7):801–805.
147. Tedesco MM, Pak JJ, Harris EJ Jr, Krummel TM, Dalman RL, Lee JT. Simulation-based endovascular skills assessment: the future of credentialing? J Vasc Surg. 2008;47(5):1008–1111.
148. Sotto JA, Ayuste EC, Bowyer MW, et al. Exporting simulation technology to the Philippines: a comparative study of traditional versus simulation methods for teaching intravenous cannulation. Stud Health Technol Inform. 2009;142:346–351.
149. Britt RC, Novosel TJ, Britt LD, Sullivan M. The impact of central line simulation before the ICU experience. Am J Surg. 2009;197(4): 533–536.
150. Cavaleiro AP, Guimaraes H, Calheiros F. Training neonatal skills with simulators? Acta Paediatr. 2009;98(4):636–639.
151. St Clair EW, Oddone EZ, Waugh RA, Corey GR, Feussner JR. Assessing housestaff diagnostic skills using a cardiology patient simulator. Ann Intern Med. 1992;117(9):751–756.