Reality augmentation for medical procedures: System architecture, single camera marker tracking, and system evaluation

International Journal of Computer Vision

Volumn 70, Issue 2, 2006, Pages 179-190

  Vogt, Sebastian ^a   Khamene, Ali ^a   Sauer, Frank ^a  

^a SIEMENS CORPORATE RESEARCH   (United States)

Author keywords

AR system architecture; Augmented reality; Computer assisted surgery; In situ visualization; Real time system; Single camera marker tracking

Indexed keywords

FEEDBACK; GRAPHIC METHODS; INFORMATION RETRIEVAL SYSTEMS; JITTER; MEDICAL APPLICATIONS; PERSONAL COMPUTERS; REAL TIME SYSTEMS; SOFTWARE PROTOTYPING; SPECIAL EFFECTS;

AR SYSTEM ARCHITECTURE; COMPUTER ASSISTED SURGERY; IN-SITU VISUALIZATION; SINGLE CAMERA MARKER TRACKING;

VIRTUAL REALITY;

EID: 33746471660     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-006-7938-1     Document Type: Article

References (26)

1. Bajura, M., Fuchs, H., and Ohbuchi, R. 1992. Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. ACM SIGGRAPH Computer Graphics, 26(2):203-210.
2. State, A., Livingston, M.A., Hirota, G., Garrett, W.F., Whitton, M.C., Fuchs, H., and Pisano, E.D. 1996. Technologies for augmented-reality systems: realizing ultrasound-guided needle biopsies, in SIGGRAPH 96 Computer Graphics Proceedings, Annual Conference Series, pp. 439-446.
3. Rosenthal, M., State, A., Lee, J., Hirota, G., Ackerman, J., Keller, K., Pisano, E.D., Jiroutek, M., Muller, K., and Fuchs, H. 2002. Augmented reality guidance for needle biopsies: An initial randomized, controlled trial in phantoms. Medical Image Analysis, 6(2):313-320.
4. Fuchs, H., Livingston, M.A., Raskar, R., Colucci, D., Keller, K., State, A., Crawford, J.R., Rademacher, P., Drake, S.H., and Meyer, A.A. 1998. Augmented reality visualization for laparoscopic surgery, in Proceedings of the 1st International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 934-943.
5. Grimson, W.E.L., Kikinis, R., Jolesz, F.A., and Black, P.M. 1999. Image-guided surgery. Scientific American, 280(6):62-69.
6. Edwards, P.J., Hawkes, D.J., Hill, D.L.G., Jewell, D., Spink, R., Strong, A.J., and Gleeson, M.J., 1995. Augmentation of reality in the stereo operating microscope for otolaryngology and neurosurgical guidance. Computer Assisted Surgery, 1(3):172-178.
7. King, A.P., Edwards, P., Maurer Jr., C.R., de Cunha, D.A., Gaston, R.P., Clarkson, M., Hill, D.L.G., Hawkes, D.J., Fenlon, M.R., Strong, A.J., Cox, T.C.S., and Gleeson, M.J. 2000. Stereo augmented reality in the surgical microscope. Presence: Teleoperators and Virtual Environments, 9(4):360-368.
8. Edwards, P.J., King, A.P., Maurer, Jr., C.R., de Cunha, D.A., Hawkes, D.J., Hill, D.L.G., Gaston, R.P., Fenlon, M.R., Jusczyzck, A., Strong, A.J., Chandler, C.L., and Gleeson, M.J. 2000. Design and evaluation of a system for microscope-assisted guided interventions (MAGI). IEEE Transactions on Medical. Imaging, 19(11):1082-1093.
9. Birkfellner, W., Huber, K., Watzinger, F., Figl, M., Wanschitz, F., Hanel, R., Rafolt, D., Ewers, R., and Bergmann, H. 2000. Development of the Varioscope AR, a see-through HMD for computer-aided surgery, in Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR), pp. 54-59.
10. Rolland, J. and Fuchs, H. 2000. Optical versus video see-through head-mounted displays in medical visualization. Presence: Teleoperators and Virtual Environments, 9(3):287-309.
11. Azuma, R.T. 1997. A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4):355-385.
12. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., and MacIntyre, B. 2001. Recent advances in augmented reality. IEEE Computer Graphics and Applications, 21(6):34-47.
13. Sauer, F., Wenzel, F., Vogt, S., Tao, Y., Gene, Y., and Bani-Hashemi, A. 2000. Augmented workspace: Designing an AR testbed. in Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR), pp. 47-53.
14. Vogt, S., Khamene, A., Sauer, F., and Niemann, H. 2002. Single camera tracking of marker clusters: Multiparameter cluster optimization and experimental verification, in Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), pp. 127-136.
15. Sauer, F., Khamene, A., and Vogt, S. 2002. An augmented reality navigation system with a single-camera tracker: System design and needle biopsy phantom trial, in Proceedings of the 5th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 116-124.
16. Wang, J., Chi, V., and Fuchs, H. 1990. A real-time optical 3D tracker for head-mounted display systems. ACM SIGGRAPH Computer Graphics, 24(2):205-215.
17. Hoff, W.A. 1998. Fusion of data from head-mounted and fixed sensors, in Proceedings of the 1st International Workshop on Augmented Reality (IWAR), pp. 167-182.
18. Haralick, R. and Shapiro, L. 1993. Computer and Robot Vision. Reading, MA: Adison-Wesley,
19. Tsai, R.Y. 1987. A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Journal of Robotics and Automation, 3(4):323-344.
20. Haralick, R.M., Lee, C., Ottenberg, K., and Nolle, M. 1991. Analysis and solutions of the three point perspective pose estimation problem, in Proceedings of the IEEE Computer Vision and Pattern Recognition Conference. (CVPR), pp. 592-598.
21. Quan, L. and Lan, Z. 1999. Linear n-point camera pose determination. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(8):774-780.
22. Sauer, F., Schoepf, U.J., Khamene, A., Vogt, S., Das, M., and Silverman, S.G. 2003. Augmented reality system for CT-guided interventions: System description and initial phantom trials, in Proceedings of SPIE's Conference of Medical Imaging 2003: Visualization, Image-Guided Procedures, and Display, vol. 5029, pp. 384-394.
23. Vogt, S., Wacker, F., Khamene, A., Elgort, D.R., Sielhorst, T., Niemann, H., Duerk, J., Lewin, J., and Sauer, F. 2004. Augmented reality system for MR-guided interventions: Phantom studies and first animal test, in Proceedings of SPIE's Conference of Medical Imaging 2004: Visualization, Image-Guided Procedures, and Display, vol. 5367, pp. 100-109.
24. Khamene, A., Vogt, S., Azar, F., Sielhorst, T., Sauer, F., and Niemann, H. 2003. Local 3D reconstruction and augmented reality visualization of free-hand ultrasound for needle biopsy procedures, in Proceedings of the 6th International Conference, on Medical Image Computing and Computer-Assisted Intervention (MICCAI), ser. Lecture Notes in Computer Science, Springer-Verlag, vol. 2879, pp. 344-355.
25. Vogt, S., Khamene, A., Niemann, H., and Sauer, F. 2004. An AR system with intuitive user interface for manipulation and visualization of 3D medical data, in Proceedings of the 12th Annual Medicine Meets Virtual Reality Conference (MMVR), pp. 397-403.
26. Rubino, G.J., Farahani, K., McGill, D., Van de Wiele, B., Villablanca, J.P., and Wang-Mathieson, A. 2000. Magnetic resonance imaging-guided neurosurgery in the magnetic fringe fields: the next step in neuronavigation. Neurosurgery, 46(3):643-653.