Multi-modal imaging, model-based tracking, and mixed reality visualisation for orthopaedic surgery

Healthcare Technology Letters

Volumn 4, Issue 5, 2017, Pages 168-173

  Lee, Sing Chun ^a   Fuerst, Bernhard ^b   Tateno, Keisuke ^c,d   Johnson, Alex ^e   Fotouhi, Javad ^a   Osgood, Greg ^e   Tombari, Federico ^c   Navab, Nassir ^a,c  

^a Johns Hopkins University   (United States)

^b Verb Surgical Inc   (United States)

^c TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^d CANON INC   (Japan)

^e JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTERIZED TOMOGRAPHY; DATA FUSION; IMAGE REGISTRATION; ITERATIVE METHODS; MIXED REALITY; MODAL ANALYSIS; ORTHOPEDICS; SCREWS; THREE DIMENSIONAL COMPUTER GRAPHICS; TRANSPLANTATION (SURGICAL);

CONE-BEAM COMPUTED TOMOGRAPHY; INTUITIVE UNDERSTANDING; ITERATIVE CLOSEST POINT ALGORITHM; MIXED-REALITY ENVIRONMENT; ORTHOPAEDIC SURGEONS; RECONSTRUCTED SURFACES; SURGICAL TOOL TRACKING; TARGET REGISTRATION ERRORS;

SURGICAL EQUIPMENT;

ALGORITHM; CALIBRATION; CONE BEAM COMPUTED TOMOGRAPHY; CONFERENCE PAPER; DATA PROCESSING; FLUOROSCOPY; IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; MEASUREMENT ACCURACY; MULTIMODAL IMAGING; ORTHOPEDIC SURGERY; VIRTUAL REALITY;

EID: 85056225324     PISSN: None     EISSN: 20533713     Source Type: Journal    
DOI: 10.1049/htl.2017.0066     Document Type: Conference Paper

References (24)

1. Parker P.J., Copeland C.: 'Percutaneous fluoroscopic screw fixation of acetabular fractures', Injury, 1997, 28, (9), pp. 597-600
2. Starr A., Jones A., Reinert C., et al.: 'Preliminary results and complications following limited open reduction and percutaneous screw fixation of displaced fractures of the actabulum', Injury, 2001, 32, pp. 45-50
3. Matthews F., Hoigne D., Weiser M., et al.: 'Navigating the fluoro-scope's C-arm back into position: an accurate and practicable solution to cut radiation and optimize intraoperative workflow', J. Orthop. Trauma, 2007, 21, pp. 687-692
4. Liu L., Ecker T., Schumann S., et al.: 'Computer assisted planning and navigation of periacetabular osteotomy with range of motion optimization' (Springer International Publishing, Cham, 2014), pp. 643-650
5. Boszczyk B.M., Bierschneider M., Panzer S., et al.: 'Fluoroscopic radiation exposure of the kyphoplasty patient', Eur. Spine J., 2006, 15, (3), pp. 347-355
6. Synowitz M., Kiwit J.: 'Surgeon's radiation exposure during percutaneous vertebroplasty', J. Neurosurg., Spine, 2006, 4, (2), pp. 106-109
7. Navab N, Heining S.M., Traub J.: 'Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications', IEEE Trans. Med. Imaging, 2010, 29, pp. 1412-1423
8. Navab N, Blum T., Wang L., et al.: 'First deployments of augmented reality in operating rooms', Computer, 2012, 45, pp. 48-55
9. Diotte B., Fallavollita P., Wang L., et al.: 'Radiation-free drill guidance in interlocking of intramedullary nails' (Springer Berlin Heidelberg, Berlin, Heidelberg, 2012), pp. 18-25
10. Habert S., Gardiazabal J., Fallavollita P., et al.: 'Rgbdx: first design and experimental validation of a mirror-based RGBD X-ray imaging system'. 2015 IEEE Int. Symp. Mixed and Augmented Reality (ISMAR), September 2015, pp. 13-18
11. Reaungamornrat S., Otake Y., Uneri A., et al.: 'An on-board surgical tracking and video augmentation system for C-arm image guidance', Int. J. Comput. Assist. Radiol. Surg., 2012, 7, (5), pp. 647-665
12. Grützner P.A., Zheng G., Langlotz U., et al.: 'C-arm based navigation in total hip arthroplasty background and clinical experience', Injury, 2004, 35, (1), pp. 90-95, supplement
13. Siewerdsen J.H., Moseley DJ, Burch S., et al.: 'Volume CT with a flat-panel detector on a mobile, isocentric C-arm: pre-clinical investigation in guidance of minimally invasive surgery', Med. Phys., 2005, 32, (1), pp. 241-254
14. Held R., Gupta A., Curless B., et al.: '3d puppetry: a kinect-based interface for 3d animation'. Proc. 25th Annual ACM Symp. User Interface Software and Technology, UIST '12, New York, NY, USA, 2012, pp. 423-434
15. Fotouhi J., Fuerst B., Johnson A., et al.: 'Pose-aware C-arm for automatic re-initialization of interventional 2d/3d image registration', Int. J. Comput. Assist. Radiol. Surg., 2017, 12, (7), pp. 1221-1230
16. Fotouhi J., Fuerst B., Wein W., et al.: 'Canreal-time RGBD enhance intraoperative cone-beam CT?', Int. J. Comput. Assist. Radiol. Surg., 2017, 12, (7), pp. 1211-1219
17. Lee S.C., Fuerst B., Fotouhi J., et al.: 'Calibration of RGBD camera and cone-beam CT for 3d intra-operative mixed reality visualization', Int. J. Comput. Assist. Radiol. Surg., 2016, 11, (6), pp. 967-975
18. Fischer M., Fuerst B., Lee S.C., et al.: 'Preclinical usability study of multiple augmented reality concepts for k-wire placement', Int. J. Comput. Assist. Radiol. Surg., 2016, 11, (6), pp. 1007-1014
19. Tateno K., Tombari F., Navab N.: 'Real-time and scalable incremental segmentation on dense slam'. 2015 IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS), September 2015, pp. 4465-4472
20. Tateno K., Tombari F., Navab N.: 'Large scale and long standing simultaneous reconstruction and segmentation', Comput. Vis. Image Underst., 2017, 157, pp. 138-150
21. Rusu R.B., Blodow N, Beetz M.: 'Fast point feature histograms (FPFH) for 3d registration'. Proc. 2009 IEEE Int. Conf. Robotics and Automation, ICRA'09, Piscataway, NJ, USA, 2009, pp. 1848-1853
22. Uckermann A., Elbrechter C, Haschke R., et al.: '3D scene segmentation for autonomous robot grasping'. 2012 IEEE/RSJ Int. Conf. Intelligent Robots and Systems, October 2012, pp. 1734-1740
23. Rusinkiewicz S., Levoy M.: 'Efficient variants of the ICP algorithm. 3D digital imaging and modeling'. Int. Conf. 3D Digital Imaging and Modeling, 2001
24. Fotouhi J., Fuerst B., Lee S., et al.: 'Interventional 3d augmented reality for orthopedic and trauma surgery'. 16th Annual Meeting of the International Society for Computer Assisted Orthopedic Surgery (CAOS), 2016