Calibration-free augmented reality

IEEE Transactions on Visualization and Computer Graphics

Volumn 4, Issue 1, 1998, Pages 1-20

  Kutulakos, Kiriakos N ^a   Vallino, James R ^a  

^a University of Rochester   (United States)

Author keywords

3d interaction techniques; Affine representations; Augmented reality; Calibration, registration; Feature tracking; Real time computer vision

Indexed keywords

CALIBRATION; COLOR COMPUTER GRAPHICS; COMPUTER VISION; FEATURE EXTRACTION; GRAPHICAL USER INTERFACES; INTERACTIVE COMPUTER GRAPHICS; REAL TIME SYSTEMS; THREE DIMENSIONAL COMPUTER GRAPHICS;

AFFINE REPRESENTATIONS; AUGMENTED REALITY;

VIRTUAL REALITY;

EID: 0031650744     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/2945.675647     Document Type: Article

References (67)

1. R.T. Azuma, A Survey of Augmented Reality, Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355-385,1997.
2. T.P. Caudell and D. Mizell, Augmented Reality: An Application of Heads-Up Display Technology to Manual Manufacturing Processes, Proc. Int'l Conf. System Sciences, vol. 2, pp. 659-669, Hawaii, 1992.
3. S. Feiner, B. Maclntyre, and D. Soligmann, Knowledge-Based Augmented Reality, Comm. ACM, vol. 36, no. 7, pp. 53-62,1993.
4. W. Crimson et al., An Automatic Registration Method for Frameless Stereotaxy, Image Guided Surgery, and Enhanced Reality Visualization, Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 430-436,1994.
5. W.E.L. Grimson et al., Evaluating and Validating an Automated Registration System for Enhanced Reality Visualization in Surgery, Proc. CVRMED 95, pp. 3-12,1995.
6. M. Uenohara and T. Kanade, Vision-Based Object Registration for Real-Time Image Overlay, Proc. CVRMED 95, pp. 14-22,1995.
7. M. Bajura, H. Fuchs, and R. Ohbuchi, Merging Virtual Objects With the Real World: Seeing Ultrasound Imagery Within the Patient, Proc. SIGGRAPH 92, pp. 203-210,1992.
8. A. State, M.A. Livingston, W.F. Garrett, G. Hirota, M.C. Whitton, E.D. Pisano, and H. Fuchs, Technologies for Augmented Reality Systems: Realizing Ultrasound-Guided Needle Biopsies, Proc. SIGGRAPH 96, pp. 439-446,1996.
9. P. Wellner, Interacting With Paper on the DigitalDesk, Comm. ACM, vol. 36, no. 7, pp. 86-95,1993.
10. T. Darrell, P. Maes, B. Blumberg, and A.P. Pentland, A Novel Environment for Situated Vision and Action, IEEE Workshop Visual Behaviors, pp. 68-72,1994.
11. M.M. Wloka and E.G. Anderson, Resolving Occlusion in Augmented Reality, Proc. Symp. Interactive 3D Graphics, pp. 5-12, 1995.
12. M. Tuceyran, D.S. Greer, R.T. Whitaker, D.E. Breen, C. Crampton, E. Rose, and K.H. Ahlers, Calibration Requirements and Procedures for a Monitor-Based Augmented Reality System, IEEE Trans. Visualization and Computer Graphics, vol. 1, no. 3, pp. 255273,1995.
13. R.L. Holloway, Registration Errors in Augmented Reality Systems, PhD thesis, Univ. of North Carolina, Chapel Hill, 1995.
14. J. Mellor, Enhanced Reality Visualization in a Surgical Environment, Master's thesis, Massachusetts Inst. of Technology, 1995.
15. M. Bajura and U. Neumann, Dynamic Registration Correction in Video-Based Augmented Reality Systems, IEEE Computer Graphics and Applications, vol. 15, no. 5, pp. 52-60,1995.
16. A. State, G. Hirota, D.T. Chen, W.F. Garrett, and M.A. Livingston, Superior Augmented Reality Registration by Integrating Landmark Tracking and Magnetic Tracking, Proc. SIGGRAPH 96, pp. 429-438,1996.
17. S. Ravela, B. Draper, J. Lim, and R. Weiss, Adaptive Tracking and Model Registration Across Distinct Aspects, Proc. 1995 IEEE/RSJ Int'l Conf. Intelligent Robotics and Systems, pp. 174-180,1995.
18. D.G. Lowe, Robust Model-Based Tracking Through the Integration of Search and Estimation, Int'l J. Computer Vision, vol. 8, no. 2, pp. 113-122,1992.
19. D.G. Lowe, Fitting Parameterized Three-Dimensional Models to Images, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 5, pp. 441-449, May 1991.
20. G. Verghese, K.L. Gale, and C.R. Dyer, Real-Time Motion Tracking of Three-Dimensional Objects, Proc. IEEE Conf. Robotics and Automation, pp. 1,998-2,003,1990.
21. J.J. Koenderink and A.J. van Doom, Affine Structure From Motion, J. Optical Soc. Am., vol. A, no. 2, pp. 377-385,1991.
22. S. Ullman and R. Basri, Recognition by Linear Combinations of Models, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 10, pp. 992-1,006, Oct. 1991.
23. O.D. Faugeras, Stratification of Three-Dimensional Vision: Projective, Affine, and Metric Representations, J. Optical Soc. Am., vol. A, vol. 12, no. 3, pp. 465-484,1995.
24. Geometric Invariance in Computer Vision, J.L. Mundy and A. Zisserman, eds. MIT Press, 1992.
25. O.D. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint. MIT Press, 1993.
26. D. Weinshall and C. Tomasi, Linear and Incremental Acquisition of Invariant Shape Models From Image Sequences, Proc. Fourth Int'l Conf. Computer Vision, pp. 675-682,1993.
27. Y. Lamdan, J.T. Schwartz, and H.J. Wolfson, Object Recognition by Affine Invariant Matching, Proc. Computer Vision and Pattern Recognition, pp. 335-344,1988.
28. R. Cipolla, P.A. Hadfield, and N.J. Hollinghurst, Uncalibrated Stereo Vision With Pointing for a Man-Machine Interface, Proc. IAPR Workshop on Machine Vision Applications, 1994.
29. A. Azarbayejani, T. Starner, B. Horowitz, and A. Pentland, Visually Controlled Graphics, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 602-605, June 1993.
30. J.D. Foley, A. van Dam, S.K. Feiner, and J.F. Hughes, Computer Graphics Principles and Practice. Addison-Wesley, 1990.
31. Y. Bar-Shalom and T.E. Fortmann, Tracking and Data Association. Academic Press, 1988.
32. J.-R. Wu and M. Ouhyoung, A 3D Tracking Experiment on Latency and Its Compensation Methods in Virtual Environments, Proc. Eighth ACM Symp. User Interface Software and Technology, pp. 41-49,1995.
33. R. Azuma and G. Bishop, Improving Static and Dynamic Registration in an Optical See-Through HMD, Proc. SIGGRAPH 94, pp. 197-204,1994.
34. M. Gleicher and A. Witkin, Through-the-Lens Camera Control, Proc. SIGGRAPH 92, pp. 331-340,1992.
35. L.S. Shapiro, A. Zisserman, and M. Brady, 3D Motion Recovery Via Affine Epipolar Geometry, Int'l }. Computer Vision, vol. 16, no. 2, pp. 147-182,1995.
36. W.B. Thompson and J.L. Mundy, Three-Dimensional Model Matching From An Unconstrained Viewpoint, Proc. IEEE Conf. Robotics and Automation, pp. 208-220,1987.
37. A. Shashua, A Geometric Invariant for Visual Recognition and 3D Reconstruction From Two Perspective/Orthographic Views, Proc. IEEE Workshop Qualitative Vision, pp. 107-117,1993.
38. E.B. Barrett, M.H. Brill, N.N. Haag, and P.M. Payton, Invariant Linear Methods in Photogrammetry and Model-Matching, Geometric Invariance in Computer Vision, pp. 277-292. MIT Press, 1992.
39. S.M. Seitz and C.R. Dyer, Complete Scene Structure From Four Point Correspondences, Proc. Fifth Int'l Conf. Computer Vision, pp. 330-337,1995.
40. G.D. Hager, Calibration-Free Visual Control Using Projective Invariance, Proc. fifth Int'l Conf. Computer Vision, pp. 1,009-1,015, 1995.
41. Active Vision, A. Blake and A. Yuille, eds. MIT Press, 1992.
42. Real-Time Computer Vision, C.M. Brown and D. Terzopoulos, eds. Cambridge Univ. Press, 1994.
43. A. Blake and M. Isard, 3D Position, Attitude and Shape Input Using Video Tracking of Hands and Lips, Proc. ACM SIGGRAPH 94, pp. 185-192,1994.
44. G.D. Hager and P.N. Belhumeur, Real-Time Tracking of Image Regions With Changes in Geometry and Illumination, Proc. Computer Vision and Pattern Recognition, pp. 403-410,1996.
45. D.H. Ballard and C.M. Brown, Computer Vision. Prentice Hall, 1982.
46. C. Tomasi and T. Kanade, Shape and Motion From Image Streams Under Orthography: A Factorization Method, Int'l }. Computer Vision, vol. 9, no. 2, pp. 137-154,1992.
47. K. Jack, Video Demystified: A Handbook for the Digital Engineer. HighText Publications Inc., 1993.
48. R.Y. Tsai, A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision Metrology Using Off-the Shelf TV Cameras and Lenses, IEEE Trans. Robotics and Automation, vol. 3, no. 4, pp. 323-344,1987.
49. B. Boufama, D. Weinshall, and M. Werman, Shape From Motion Algorithms: A Comparative Analysis of Scaled Orthography and Perspective, Proc. European Conf. Computer Vision, J.-O. Eklundh, éd., pp. 199-204,1994.
50. G. Turk and M. Levoy, Zippered Polygon Meshes From Range Images, Proc. SIGGRAPH 94, pp. 311-318,1994.
51. E.K.-Y. Jeng and Z. Xiang, Moving Cursor Plane for Interactive Sculpting, ACM Trans. Graphics, vol. 15, no. 3, pp. 211-222,1996.
52. S.W. Wang and A.E. Kaufman, Volume Sculpting, Proc. Symp. Interactive 3D Graphics, pp. 151-156,1995.
53. H. Qin and D. Terzopoulos, D-Nurbs: A Physics-Based Framework for Geometric Design, IEEE Trans. Visualization and Computer Graphics, vol. 2, no. 1, pp. 85-96, Mar. 1996.
54. P.E. Debevec, C.J. Taylor, and J. Malik, Modeling and Rendering Architecture From Photographs: A Hybrid Geometry- and ImageBased Approach, Proc. SIGGRAPH 96, pp. 11-20,1996.
55. S.A. Tebo, D.A. Leopold, D.M. Long, S.J. Zinreich, and D.W. Kennedy, An Optical 3D Digitizer for Frameless Stereotactic Surgery, IEEE Computer Graphics and Applications, vol. 16, pp. 55-64, Jan. 1996.
56. M. Agrawala, A.C. Beers, and M. Levoy, 3D Painting on Scanned Surfaces, Proc. Symp. Interactive 3D Graphics, pp. 145-150,1995.
57. K.M. Kutulakos and J. Vallino, Affine Object Representations for Calibration-Free Augmented Reality: Example MPEG Sequences. http://www.es. rochester.edu:/u/kyros/mpegs/TVCG.html, 1996.
58. C. Wiles and M. Brady, On the Appropriateness of Camera Models, Proc. Fourth European Conf. Computer Vision, pp. 228-237, 1996.
59. O.D. Faugeras, What Can Be Seen in Three Dimensions With an Uncalibrated Stereo Rig?, Proc. Second European Conf. Computer Vision, pp. 563-578,1992.
60. R. Mohr, B. Boufama, and P. Brand, Accurate Projective Reconstruction, Applications of Invariance in Computer Vision,}. Mundy, A. Zisserman, and D. Forsyth, eds., pp. 257-276. Springer-Verlag, 1993.
61. J. Dorsey, J. Arvo, and D. Greenberg, Interactive Design of Complex Time Dependent Lighting, IEEE Computer Graphics and Applications, vol. 15, pp. 26-36, Mar. 1996.
62. A. Shashua, Geometry and Photometry in 3D Visual Recognition, PhD thesis, Massachusetts Inst. of Technology, 1992.
63. P.N.B.D.J. Kriegman, What is the Set of Images of an Object Under All Possible Lighting Conditions, Proc. Computer Vision and Pattern Recognition, pp. 270-277,1996.
64. P.P. McLauchlan, I.D. Reid, and D.W. Murray, Recursive Affine Structure and Motion From Image Sequences, Proc. Third European Conf. Computer Vision, pp. 217-224,1994.
65. L.O. Gorman, Subpixel Precision of Straight-Edged Shapes for Registration and Measurement, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 7, pp. 746-751, July 1996.
66. K. Toyama and G.D. Hager, Incremental Focus of Attention for Robust Visual Tracking, Proc. Computer Vision and Pattern Recognition, pp. 189-195,1996.
67. S.K. Nayar, Catadioptric Omnidirectional Camera, Proc. Conf. Computer Vision and Pattern Recognition, pp. 482-488,1997.