Advanced graphics behind medical virtual reality: Evolution of algorithms, hardware, and software interfaces

Proceedings of the IEEE

Volumn 86, Issue 3, 1998, Pages 531-553

  Soferman, Ziv ^a   Blythe, David ^a   John, Nigel W ^a  

^a HEWLETT PACKARD ENTERPRISE   (United States)

Author keywords

Augmented reality; Computer graphics; Evolution; Graphics accelerator; Graphics algorithms; Graphics hardware; Hardware evolution; History; Medical imaging; Medicine; Opengl; Surgery; Virtual reality; Volume rendering

Indexed keywords

COMPUTER GRAPHICS; COMPUTER HARDWARE; COMPUTER SOFTWARE; GENETIC ALGORITHMS; GRAPHICAL USER INTERFACES; MEDICAL IMAGING; REAL TIME SYSTEMS; SURGERY; VIRTUAL REALITY;

AUGMENTED REALITY; OFF THE SHELF (OTS) EQUIPMENT;

BIOMEDICAL ENGINEERING;

EID: 0032024947     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/5.662878     Document Type: Article

References (74)

1. S. J. Weghorst, H. B. Sicburg, and K. S. Morgan, Eds., Proceedings of Medicine Meets Virtual Realitv 4. San Diego, ÇA: IOS Press, 1996.
2. K. S. Morgan, H. M. Hoffman, D. Stredney, and S. J. Weghorst, Eds., Proceedings of Medicine Meets Virtual Reality 5. San Diego, CA: IDS Press, 1997.
3. J. Proccaz, E. Crimson, and R. Mosges, Eds., Proceedings of the First Joint Conference on Computer Vision, Virtual Reality and Robotics in Medicine and Medical Robotics and Computer-Assisted Surgery. Grenoble, France: Springer, 1997.
4. K. Akeley, "Reality engine graphics," in Proc. SICGRAPH'93, Anaheim, CA, 1993, pp. 109-116.
5. M. L. Rhodes, "Computer graphics in medicine: The past decade," IEEE Compiit. Graphics Applicat. Mag., vol. 11, no. 1, pp. 52-54, 1991.
6. G. J. Wiet, D. Strendney, R. Yagel, J. E. Swan, N. Sharcef, P. Schmalbrock, K. Wright, J. Smith, and D. E. Schuller, "Cranial base tumor visualization through high performance computing," in Proceedings of Medicine Meets Virtual Reality 4, S. J. Weghorst, H. B. Sieburg, and K. S. Morgan, Eds. San Diego, CA: IDS Press, 1996, pp. 43-59.
7. J. Rolland, R. Holloway, and H. Fuchs, "A comparison of optical and video see-through head-mounted displays," in Proc. SPIE: Telemanipulalor and Telepresence Technologies, Boston, MA, Oct. 31-Nov. 4, 1994, vol. 2351, pp. 293-307.
8. R. T. Azuma, "A survey of augmented reality," Presence: Teleoperators Virtual Environ., vol. 6, no. 4, pp. 355-385, Aug. 1997.
9. A. State, M. A. Livingston, G. Hirota, W. F. Garret, M. C. Witton, H. Fuchs, and E. Pissano, 'Techniques for augmented reality systems: Realising ultrasound-guided needle biopsies," in Proc. SIGGRAPH'96, New Orleans, LA, Aug. 4-9, 1996 pp. 439-146.
10. G. J. Wiet, R. Yagcl, D. Strcdney, P. Schmalbrock, D. J Sessanna, Y. Kurzion, L. Rosenberg, M. Levin, and K. Martin "A volumetric approach to virtual simulation of functional endoscopie sinus surgery," in Proceedings of Medicine Meets Virtual Reality 5, K. S. Morgan, H. M. Huffman, D. Strcdney and S. J. Weghorst, Eds. San Diego, ÇA: 1OS Press, 199?' pp. 167-179.
11. C. V. Edmond, D. Heskamp, D. Sluis, D. Stredney, G. J. Wiet, D. J. Sessanna, R. Yagel, S. J. Weghorst, P. Oppenheimer, J. Miller, M. Levin, and L. Rosenberg, "Simulation for ENT endoscopie surgical training," in Proceedings of Medicine Meets Virtual Reality 5, K. S. Morgan, H. M. Hoffman, D. Strcdney, and S. J. Weghorst, Eds. San Diego, ÇA: IOS Press, 1997 pp. 518-528.
12. E. Promayon, P. Baconnier, and C. Puech, "Physically-based model for simulating the human trunk respiration movements," in Proceedings of the First Joint Conference on Computer Vision, Virtual Reality and Robotics in Medicine and Medical Robotics and Computer-Assisted Surgery, J. Proccaz, E. Grimson, and R. Mosgcs, Eds. Grenoble, France: Springer, 1997, pp. 379-388.
13. J. Kaye, D. N. Metaxas, and F. P. Primiano, Jr., "A 3D virtual environment for modeling mechanical cardiopulmonary interactions," in Proceedings of the First Joint Conference on Computer Vision, Virtual Reality and Robotics in Medicine and Medical Robotics and Computer-Assisted Surgery, J. Proccaz, E. Crimson, and R. Mosges, Eds. Grenoble, France: Springer, 1997, pp. 389-398.
14. C. Johnson. (June 1997). Compuational steering. [Online]. Available: http://www.cs.utah.edu/sci/projects/sci_comp.html.
15. W. Lorensen. Marching through the visible man. [Online]. Available: http://www.crd.ge.com/esl/cgsp/projects/vmJ.
16. J. Foley, A. van Dam, S. Feiner, and J. Hughes, Computer Graphics, Principles and Practice, 2nd ed. Reading, MA: Addison-Wesley, 1990.
17. A. Watt, 3D Computer Graphics. Reading, MA: Addison-Wcsley, 1993.
18. W. E. Lorensen and H. E. Cline, "Marching cubes: A high resolution 3D surface construction algorithm," Comput. Graphics, vol. 21, no. 4, pp. 163-169, 1987.
19. C. Wylie, G. W. Romney, D. C. Evans, and A. Erdahl, "Half- i tone perspective drawing by computer," in Proc. AFIPS, Fall ' Joint Computer Conf. 31, 1967, pp. 49-58.
20. B. Phong, "Illumination for computer-generated pictures," Com- ! mini. ACM, vol. 18, no. 6, pp. 311-317, 1975.
21. W. J. Bouknight, "A procedure for the generation of threedimensional half-toned computer graphic presentations," Commini. ACM, vol. 13, no. 9, pp. 527-536, 1970.
22. H. Gouraud, "Continuous shading of curved surfaces," IEEE Trans. Computers, vol. C-20, pp. "623-629, June 1971.
23. E. Catmull, "Computer display of curved surfaces," in Proc. IEEE Conf. Computer Graphics, Pattern Recognition and Data Structures, Los Angeles, CA, May 1975, pp. 11-17;
24. reprinted in H. Freeman, Ed., Tutorial and Selected Readings in Interactive Computer Graphics. New York: IEEE, 1980, pp. 309-315.
25. _, "Subdivision algorithm for the display of curved surfaces," Ph.D. dissertation, University of Utah, Salt Lake City, 1974.
26. D. R. Peachy, "Solid tcxturing of complex surfaces," Comput. Graphics, vol. 19, no. 3, pp. 279-286, 1985.
27. K. Perlin, "An image synthesizer," Comput. Graphics, vol. 19, no. 3, pp. 287-296, 1985.
28. A. V. Oppenheim and R. W. Shafer, Digital Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1975.
29. E. Catmull, "A hidden surface algorithm with anti-aliasing," Comput. Graphics, vol. 12, no. 3, pp. 6-10, 1978.
30. L. C. Carpenter, "The /1-buffer, an anti-aliased hidden surface method," Comput. Graphics, vol. 18, no. 3, pp. 103-108, 1984.
31. E. Fiume, A. Fournier, and L. Rudolph, "A parallel scan conversion algorithm with anti-aliasing for a general purpose ultracomputer," Comput. Graphics, vol. 17, no. 3, pp. 141-150, 1983.
32. R. L. Cook, "Stochastic sampling in computer graphics," ACM Trans. Comput. Graphics, vol. 5, no. 1, pp. 51-72, 1986.
33. R. L. Cook, T. Porter, and L. Carpenter, "Distributed ray tracing," Comput. Graphics, vol. 18, no. 3, pp. 137-145, 1984.
34. J- F- Blinn M- E. Newell, "Texture and reflection in computer generated images," Commun. ACM, vol. 19, no. 10, pp. 362-367, 1976.
35. E. A. Feibush, M. and R. L. Cook, "Synthetic texturing using dicital filters," Compiit. Graphics, vol. 14, no. 3, pp. 294-301, 1980.
36. M. Ganget, D. Perny, and P. Coueignoux, "Perspective mapping 1 of plannar textures," in Proceedings of EUROGRAPHICS'82. Amsterdam, The Netherlands: North-Holland, 1982, pp. 57-71.
37. N. Greene and P. S. Heckbert, "Creating raster omnimax images using the elliptically weighted average filter," IEEE Compiit. Graphics and Applications Mag., vol. 6, no. 6, pp. 21-27, 1986.
38. L. Williams, "Pyramid parametrics," Compiit. Graphics, vol. 1 17, no. 3, pp. 1-11, 1983.
39. T. Porter and T. Duff, "Compositing digital images," in Proc. SIGGRAPH'84, Minneapolis, MM, Aug. 1984, pp. 253-259.
40. R. A. Harris, D. Lowell, et. al., "Non-invasive numerical dissection and display of anatomic structure using computerized X-ray tomography," in Proc. SPIE, vol. 152, 1978, pp. 10-18.
41. K. H. Hoehne, R. L. Delapaz, R. B. Stein, and R. C. Taylor, "Combined surface display and reformatting for the three-dimensional analysis of tomographic data," in Investigative Radiology, vol. 27, no. 7, pp. 658-664, July 1987.
42. S. M. Jaffey and K. Dutta, "Digital perspective correction for cylindrical holographic stereogram," in Proc. SPIE., Aug. 1982, vol. 367, pp. 130-140.
43. D. S. Schlusselberg, W. K. Smith, D. J. Woodward, "Three-dimensional display of medical image volumes," in Proc. NCGA, Mar. 1986.
44. R. A. Drebin, L. Carpenter, and P. Hanrahan, "Volume rendering," in Proc. SIGGRAPH'88, J. Dill, Ed., Atlanta, GA, Aug. 1988, vol. 22, pp. 65-74.
45. M. Levoy, "Display of surfaces from volume data," Compiit. Graphics Applicat., vol. 8, no. 3, pp. 29-37, May 1988.
46. S. M. Jaffey, M. Stephen, and K. Dutta, "Digital reconstruction methods for three-dimensional image visualization," in Proc. SPIE: Processing and Display of Tliree-Dimensional Data II, vol. 507, 1984, pp. 155-163.
47. M. Levoy, "Efficient ray tracing of volume data," ACM Trans. Graphics, vol. 9, no. 3, pp. 245-261, 1990.
48. H. Fuchs, J. Poulton, J. Eyles, T. Gréer, J. Goldfeather, D. Ellsworth, S. Molnar, G. Turk, B. Tcbbs, and L. Israel, "Pixelplanes 5: A heterogeneous multiprocessor graphics system using processor-enhanced memories," in Proc. SIGGRAPH'89, Boston, MA, pp. 79-88.
49. T. McReynoIds, D. BIythe, C. Fowler, P. Womack, S. Hui, and B. Grantham, "Programming with OpenGL: Advanced techniques," SIGGRAPH'97 Course Notes, Los Angeles, CA, 1997, pp. 71-80.
50. B. Cabrai, N. Cam, and J. Foran, "Accelerated volume rendering and tomographic reconstruction using texture mapping hardware," in Proceedings of the ACM/IEEE Symposium on Volume Visualization. New York: IEEE Press, 1994, pp. 91-98.
51. M. Bunker and R. Economy, "Evolution of the GE CIG systems," General Electric Company, Daytona Beach, FL, SCSD Doc., 1989.
52. R. Schumacker, "A new visual system architecture," in Proc. 2nd Inlerservice/Industry Training Equipment Conf., Salt Lake City, UT, Nov. 1980, pp. 16-20.
53. C. Machover, "A brief, personal history of computer graphics," Computer, pp. 3845, Nov. 1978.
54. W. Myers, "Interactive computer graphics: Poised for takeoff?" Computer, pp. 60-74, Jan. 1978.
55. C. Harell and F. Fouladi, "Graphics rendering architecture for a high performance desktop workstation," in Proc. SIGGRAPH'93, Anaheim, CA, Aug. 1993, pp. 93-100.
56. M. Deering and S. R. Nelson, "Leo: A system for cost effective 3D shaded graphics," in Proc. SIGGRAPH'93, Aug. 1993, pp. 101-108.
57. D. Kirk and D. Voorhies, "The rendering architecture of the DN10000VS," in Proc. SIGGRAPH'90, Dallas, TX, Aug. 1990, pp. 299-308.
58. J. Clark, "The geometry engine: A VLSI geometry subsystem for graphics," in Proc. SIGGRAPH'82, Boston, MA, Aug. 1982, pp. 127-133.
59. K. Akeley, "The silicon graphics 4D/240GTX superworkstation," Compiit. Graphics Applicat., vol. 9, no. 4, pp. 71-83, July 1989.
60. J. Grimes, L. Kohn, and R. Bharadhwaj, "The Intel i860 64-bit processor: A general purpose CPU with 3D graphics capabilities," Comput. Graphics Applicat., vol. 9, no. 4, pp. 85-94, July 1989.
61. J. Clark and M. Hannah, "Distributed processing in a highperformance smart image memory," Lambda(VLSIDesign), vol. 1, no. 3, pp. 40-45, 1980.
62. H. Fuchs and J. Poulton, "Pixel-planes: A VLSI-oriented design for a raster graphics engine," LambdafVLSl Design), vol. 2, no. 3, pp. 20-28, 1981.
63. R. Pinkham, M. Novak, and K. Guttag, "Video RAM exceeds at fast graphics," Electron. Design, vol. 31, no. 17, pp. 161-182, Aug. 18, 1983.
64. M. Deering, S. Schlapp, and M. Lavellé, "FBRAM: A new form of memory optimized for 3D graphics," in Proc. SIGGRAPH'94, Orlando, FL, Aug. 1994, pp. 167-174.
65. A. Peleg, S. Wilkie, and U. Weiser, "Intel MMX for multimedia PC's," Commun. ACM, vol. 40, no. I, pp. 25-38, Jan. 1997.
66. A. Schilling, G. Knittel, and W. Strasser, 'Texram: A smart memory for texturing," Comput. Graphics Applicat., vol. 16, pp. 32-41, May 1996.
67. P. LoPiccolo, D. Phillips Mahoney, A. Vasilopoulis, and S. Porter, 'The visible volume," Comput. Graphics World, vol. 14, no. 4, pp. 44-80, Apr. 1991.
68. M. Kilgard, "Realizing OpenGL: Two implementations of one architecture," in Proc. 1997 SIGGRAPH Eurographics Workshop, Los Angeles, CA, Aug. 1997, pp. 45-55.
69. J. S. Montrym, D. R. Baum, D. L. Dignam, and C. J. Migdal, "InfiniteReality: A real-time graphics system," in Proc. SIGGRAPH'97, Los Angeles, CA, Aug. 1997, pp. 293-302.
70. J. Neider, T. Davis, and M. Woo, OpenGL Programming Guide. Reading, MA: Addison-Wcsley, 1993.
71. M. A. Cosman and R. L. Grange, "CIG scene realism: The world tomorrow," in Proc. 18th I/ITSEC Conf., Orlando, FL, Dec. 1996, pp. 627-639.
72. M. Lucente, "Interactive three-dimensional holographic displays: Seeing the future in depth," Comput. Graphics, vol. 31, no. 2, pp. 63-67, May 1997.
73. S. Jones and R. M. Satava, "Virtual endoscopy of the head and neck," in Proc. MMVR'96, San Diego, CA, pp. 152-156.
74. R. M. Satava, "Medical virtual reality: The current status of the future," in Proc. MMVR'96, San Diego, CA, pp. 100-106.