An augmented reality haptic training simulator for spinal needle procedures

IEEE Transactions on Biomedical Engineering

Volumn 60, Issue 11, 2013, Pages 3009-3018

  Sutherland, Colin ^a   Hashtrudi Zaad, Keyvan ^b   Sellens, Rick ^b   Abolmaesumi, Purang ^c   Mousavi, Parvin ^b  

^a Grantek Systems Integration   (Canada)

^b QUEEN S UNIVERSITY   (Canada)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Augmented reality; haptics; medical simulator

Indexed keywords

FINITE-ELEMENT MODELS; HAPTIC SIMULATION SYSTEM; HAPTICS; MEDICAL SIMULATORS; NEEDLE INSERTION; OPTICAL TRACKING SYSTEMS; PHANTOM HAPTIC DEVICES; VISUAL FEEDBACK;

FINITE ELEMENT METHOD; GRAPHICAL USER INTERFACES; HAPTIC INTERFACES; NEEDLES; VISUAL COMMUNICATION;

AUGMENTED REALITY;

ARTICLE; AUGMENTED REALITY HAPTIC TRAINING SIMULATOR; COMPUTER INTERFACE; FINITE ELEMENT ANALYSIS; HAPTIC DEVICE; OPTICAL TRACKING SYSTEM; SIMULATOR; SPINAL NEEDLE; TORSO MANNEQUIN; VISUAL FEEDBACK;

COMPUTER SIMULATION; COMPUTER-ASSISTED INSTRUCTION; EDUCATION, MEDICAL; FINITE ELEMENT ANALYSIS; HUMANS; INJECTIONS, SPINAL; MODELS, ANATOMIC; PILOT PROJECTS; SPINE; TORSO; USER-COMPUTER INTERFACE;

EID: 84886700073     PISSN: 00189294     EISSN: 15582531     Source Type: Journal    
DOI: 10.1109/TBME.2012.2236091     Document Type: Article

References (42)

1. K. Kunkler, "The role of medical simulation: An overview," Int. J. Med. Robot. Comput. Assist. Surg., vol. 2, pp. 203-210, 2006. (Pubitemid 44580017)
2. C. Basdogan, M. Sedef, M. Hardens, and S. Wesarg, "VR-based simulators for training in minimally invasive surgery," IEEE Comput. Graph. Appl., vol. 27, no. 2, pp. 54-66, Mar./Apr. 2007. (Pubitemid 46523118)
3. A. Tahmasebi, K. Hashtrudi-Zaad, D. Thompson, and P. Abolmaesumi, "A framework for the design of a novel haptic-based medical training simulator," IEEE Trans. Inf. Technol. Biomed., vol. 12, no. 5, pp. 658-666, Sep. 2008.
4. T. Coles, D. Melange, and N. John, "The role of haptic in medical training simulators: A survey of the state of the art," IEEE Trans. Hapt., vol. 4, no. 1, pp. 51-66, Jan./Feb. 2011.
5. M. Farber, J. Heller, F. Hummel, C. Gerloff, and H. Handels, "Virtual reality based training of lumbar punctures using a 6 degree of freedom haptic device," Adv. Med. Eng., vol. 114, pp. 236-240, 2007.
6. F. P. Vidal, N. W. John, A. E. Healey, and D. A. Gould, "Simulation of ultrasound guided needle puncture using patient specific data with 3D textures and volume haptic," Comput. Animat. Virt. Worlds, vol. 19, no. 2, pp. 111-127, 2008.
7. W. Chan, D. Ni, W. Pang, J. Qin, Y. Chui, S. Yu, and P. Heng, "Learning ultrasound-guided needle insertion skills through an edutainment game," Trans. Edutainm. IV, vol. 6250, pp. 200-214, 2010.
8. C. Chui, J. S. K. Ong, Z. Lian, Z. Wang, J. Teo, J. Zhang, C. Yan, S. Ong, S. Wang, H. Wong, C. Teo, and S. Teoh, "Haptic in computer-mediated simulation: Training in vertebroplasty surgery," Simul. Gaming, vol. 37, no. 4, pp. 438-451, 2006. (Pubitemid 44698048)
9. D. Magee, Y. Zhu, R. Ratnalingam, P. Gardner, and D. Kessel, "An augmented reality simulator for ultrasound guided needle placement training," Med. Biol. Eng. Comput., vol. 45, pp. 957-967, 2007. (Pubitemid 47423285)
10. P. Gorman, T. Krummel, R. Webster, M. Smith, and D. Hutchens, "A prototype haptic lumbar puncture simulator," Stud. Health Technol. Inf., vol. 70, pp. 106-109, 2000.
11. J. B. Ra, S. M. Kwon, J. K. Kim, J. Yi, K. H. Kim, H. W. Park, K.-U. Kyung, D.-S. Kwon, H. S. Kang, S. T. Kwon, L. Jiang, J. Zeng, K. Geary, and S. K. Mun, "Spine needle biopsy simulator using visual and force feedback," Comput. Aided Surg., vol. 7, no. 6, pp. 353-363, 2002. (Pubitemid 36542392)
12. M. Harders, G. Bianchi, B. Knoerlein, and G. Szkely, "Calibration, registration, and synchronization for high precision augmented reality haptic," Trans. Vis. Comput. Graph., vol. 15, no. 1, pp. 138-149, Jan./Feb. 2009.
13. A. Tahmasebi, "A haptic-based ultrasound examination/training system," M. Sc. thesis, Queen's Univ., Kingston, ON, Canada, 2005.
14. T. Blum, S. Heining, O. Kutter, and N. Navab, "Advanced training methods usinganaugmented reality ultrasound simulator," inProc. IEEE Int. Symp. Mixed Augment. Real., Oct. 2009, pp. 177-178.
15. T. Sielhorst, T. Obst, R. Burgkart, R. Riener, and N. Navab, "An augmented reality delivery simulator for medical training," in Proc. Int. Worksh. Augment. Envir. Med. Imag.-MICCAI Satellite Worksh., 2004.
16. M. Rosenthal, A. State, J. Lee, G. Hirota, J. Ackerman, K. Keller, E. Pisano, M. Jiroutek, K. Muller, and H. Fuchs, "Augmented reality guidance for needle biopsies: An initial randomized, controlled trial in phantoms," Med. Imag. Anal., vol. 6, no. 3, pp. 313-320, 2002. (Pubitemid 35282836)
17. S. Nicolau, X. Pennec, L. Soler, X. Buy, A. Gang, N. Ayache, and J. Marescaux, "An augmented reality system for liver thermal ablation: Design and evaluation on clinical cases," Med. Imag. Anal., vol. 13, no. 3, pp. 494-506, 2009.
18. A. State, M. Livingston, W. Garrett, G. Hirota, M. Whitton, E. Pisano, and H. Fuchs, "Technologies for augmented reality systems: Realizing ultrasound-guided needle biopsies," in Proc. Conf. Comput. Graph. Interact. Tech., 1996, pp. 439-446.
19. J. Colgate and J. Brown, "Factors affecting the z-width of a haptic display," in Proc. IEEE Int. Conf. Robot. Autom., May 1994, vol. 4, pp. 3205-3210.
20. W. Schroeder, K. Martin, and W. Lorensen, The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics. Englewood Cliffs, NJ: Prentice-Hall, 1998.
21. L. Ibanez, W. Schroeder, L. Ng, and J. Cates, The ITK Software Guide, 2nd ed. New York: Kitware, 2005.
22. J. Blanchette and M. Summerfield, C++ GUI Programming with Qt 4, 2nd Ed., Prentice Hall, p. 752, 2008. ISBN 978-0-13-235416-5.
23. N. Abolhassani, R. Patel, and M. Moallem, "Needle insertion into soft tissue: A survey," Med. Eng. Phys., vol. 29, no. 4, pp. 413-431, 2007. (Pubitemid 46074441)
24. S. Cotin, H. Delingette, and N. Ayache, "A hybrid elastic model for realtime cutting, deformations, and force feedback for surgery training and simulation," Vis. Comput., vol. 16, pp. 437-452, 2000. (Pubitemid 32077030)
25. Y. C. Fung, Mechanical Properties of Living Tissues. New York: Springer-Verlag, 1993.
26. B. Sitzman and D. Uncles, "The effects of needle type gauge and tip bend on spinal needle deflection," Anesthesia Analgesia, vol. 82, no. 2, pp. 297-301, 1996. (Pubitemid 26055017)
27. S. DiMaio and S. Salcudean, "Interactive simulation of needle insertion models," IEEE Trans. Biomed. Eng., vol. 52, no. 7, pp. 1167-1179, Jul. 2005. (Pubitemid 40961367)
28. M. Bro-Nielsen, "Finite element modeling in surgery simulation," Proc. IEEE, vol. 86, no. 3, pp. 490-503, Mar. 1998. (Pubitemid 128720212)
29. E. J. Chen, J. Novakofski, W. K. Jenkins, and W. D. O'Brien Jr., "Young's modulus measurements of soft tissues with application to elasticity imaging," IEEE Trans. Ultrason. Ferroelectr. Freq. Contr., vol. 43, no. 1, pp. 191-194, Jan. 1996. (Pubitemid 126781008)
30. A. Nachemson and J. Evans, "Some mechanical properties of the third human lumbar interlaminar ligament (ligamentum flavum)," J. Biomech., vol. 1, no. 3, pp. 211-220, 1968.
31. R. Waters and J. Morris, "An in vitro study of normal and scoliotic inter-spinous ligaments," J. Biomech., vol. 6, no. 4, pp. 343-348, 1973.
32. S. DiMaio and S. Salcudean, "Needle insertion modeling and simulation," IEEE Trans. Robot. Autom., vol. 19, no. 5, pp. 864-875, Oct. 2003.
33. P. Brett, T. Parker, A. Harrison, T. Thomas, and A. Carr, "Simulation of resistance forces acting on surgical needles," Proc. Inst. Mech. Eng., vol. 211, pp. 225-347, 1997.
34. A. Okamura, C. Simone, and M. O'Leary, "Force modeling for needle insertion into soft tissue," IEEE Trans. Biomed. Eng., vol. 51, no. 10, pp. 1707-1716, Oct. 2004. (Pubitemid 39274418)
35. A. Haddadi and K. Hashtrudi-Zaad, "Development of a dynamic model for bevel-tip flexible needle insertion into soft tissues," in Proc. Int. IEEE Eng. Med. Biol. Soc. Conf., Aug./Sep. 2011, pp. 7478-7482.
36. A. Watt and M. Watt, Advanced Animation and Rendering Techniques: Theory and Practice. Reading, MA: Addison-Wesley, 1992.
37. R. Shams, R. Hartley, and N. Navab, "Real-time simulation of medical ultrasound from ct images," Med. Imag. Comput. Comput.-Assist. Intervent., vol. 5242, pp. 734-741, Sep. 2008.
38. S. Gill, P. Abolmaesumi, G. Fichtinger, J. Boisvert, D. Pichora, D. Borshneck, and P. Mousavi, "Biomechanically constrained group-wise ultrasound to ct registration of the lumbar spine," Med. Imag. Anal., vol. 5761, pp. 803-810, 2010.
39. K. Naemura and H. Saito, "Needle insertion test by porcine ligamentum flavum," in Proc. World Congr. Med. Phys. Biomed. Eng., Springer-Verlag, 2009, pp. 28-31.
40. N. Chentanez, R. Alterovitz, D. Ritchie, L. Cho, K. Hauser, K. Goldberg, J. Sewchuk, and J. O'Brien, "Interactive simulation of surgical needle-insertion and steering," ACM Trans. Graph., vol. 88, pp. 1-10, 2009.
41. I. Peterlik, M. Noucier, C. Duriez, S. Cotin, and A. Kheddar, "Constraint-based haptic rendering of multirate compliant mechanisms," IEEE Trans. Hapt., vol. 4, no. 3, pp. 175-187, May/Jun. 2011.
42. C. Duriez, C. Guebert, M. Marchal, S. Cotin, and L. Grisoni, "Interative simulation of flexible needle insertions on constraint models," in Proc. Med. Imag. Comput. Comput.-Assist. Intervent., vol. 5762, Sep. 2009, pp. 291-299.