Registration using natural features for augmented reality systems

IEEE Transactions on Visualization and Computer Graphics

Volumn 12, Issue 4, 2006, Pages 569-580

  Yuan, M L ^a   Ong, S K ^a,b   Nee, A Y C ^a,b,c  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b CIRP ^*  (China)

^c SOCIETY OF MANUFACTURING ENGINEERS   (Singapore)

Author keywords

Augmented reality; Natural feature tracking; Projective reconstruction; Registration

Indexed keywords

NATURAL FEATURE TRACKING; PROJECTIVE MATRIX; PROJECTIVE RECONSTRUCTION; REGISTRATION;

COMPUTER SYSTEMS; COORDINATE MEASURING MACHINES; FEATURE EXTRACTION; IMAGE RECONSTRUCTION; MATRIX ALGEBRA; ROBUSTNESS (CONTROL SYSTEMS);

VIRTUAL REALITY;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER INTERFACE; EVALUATION; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; PHOTOGRAPHY; SIGNAL PROCESSING; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COMPUTER GRAPHICS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUBTRACTION TECHNIQUE; USER-COMPUTER INTERFACE; VIDEO RECORDING;

EID: 33744720750     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2006.79     Document Type: Conference Paper

References (38)

1. R.T. Azuma, "A Survey of Augmented Reality," Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355-385, 1997.
2. R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre, "Recent Advances in Augmented Reality," IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 34-47, Nov.-Dec. 2001.
3. M. Rosenthal, A. State, H. Lee, G. Hirota, J. Ackerman, K. Keller, E.D. Pisano, M. Jiroutek, K. Muller, and H. Fuchs, "Augmented Reality Guidance for Needle Biopsies: An Initial Randomized, Controlled Trial in Phantoms," Medical Image Analysis, vol. 6, no. 3, pp. 313-320, 2002.
4. S. Julier, M. Lanzagorta, Y. Baillot, L. Rosenblum, and S. Feiner, "Information Filtering for Mobile Augmented Reality," Proc. IEEE Int'l Symp. Augmented Reality, pp. 3-11, 2000.
5. M. Utsumi, "Development for Teleoperation Underwater Grasping System in Unclear Environment," Proc. 2002 Int'l Symp. Underwater Technology, pp. 349-353, Apr. 2002.
6. B. MacIntyre, M. Lohse, J.D. Bolter, and E. Moreno, "Integrating 2-D Video Actors into 3-D Augmented-Reality Systems," Presence, vol. 11, no. 2, pp. 189-20, 2002.
7. W. Barfield, K. Baird, J. Shewchuk, and G. Ioannou, "Applications of Wearable Computers and Augmented Reality to Manufacturing," Fundamentals of Wearable Computers and Augmented Reality, pp. 695-724, 2001.
8. W.A. Hoff and K. Nguyen, "Computer Vision-Based Registration Techniques for Augmented Reality," Proc. Intelligent Robots and Computer Vision XV, SPIE, vol. 2904, pp. 538-548, 1996.
9. R. Behringer, "Registration for Outdoor Augmented Reality Applications Using Computer Vision Techniques and Hybrid Sensors," Proc. Virtual Reality Ann. Int'l Symp., pp. 244-251,1999.
10. Y. Suya, U. Neumann, and R. Azuma, "Hybrid Inertial and Vision Tracking for Augmented Reality Registration," Proc. IEEE Symp. Virtual Reality (VR '99), pp. 260-267, 1999.
11. R. Behringer, "Registration for Outdoor Augmented Reality Applications Using Computer Vision Techniques and Hybrid Sensors," Proc. Virtual Reality Ann. Int'l Symp., pp. 244-251, 1999.
12. K. Satoh, M. Anabuki, H. Yamamoto, and H. Tamura, "A Hybrid Registration Method for Outdoor Augmented Reality," Proc. IEEE and ACM Int'l Symp. Augmented Reality, pp. 67-76, 2001.
13. L. Chai, W.A. Hoff, and T. Vincent, "Three-Dimensional Motion and Structure Estimation Using Inertial Sensors and Computer Vision for Augmented Reality," Presence: Teleoperators and Virtual Environments, vol. 11, no. 5, pp. 474-492, 2002.
14. H. Kalo and M. Billinghurst, "Marker Tracking and HMD Calibration for a Video-based Augmented Reality Conferencing System," Proc. Second IEEE and ACM Int'l Workshop Augmented Reality, pp. 85-94 Oct. 1999.
15. P. Sinclair, "Integrating Hypermedia Techniques with Augmented Reality Environments," PhD thesis, Univ. of Southampton, 2004.
16. Y.D. Seo and K.S. Hong, "Calibration-Free Augmented Reality in Perspective," IEEE Trans. Visualization and Computer Graphics, vol. 6, no. 4, pp. 346-359, Nov.-Dcc. 2000.
17. R. Vijaimukund, J. Molineros, and R. Sharma, "Interactive Evaluation of Assembly Sequence Using Augmented Reality," IEEE Trans. Robotics and Automation, vol. 15, no. 3, pp. 435-449, 1999.
18. S.J.D. Prince, K. Xu, and A.D. Check, "Augmented Reality Camera Tracking with Homographies," IEEE Computer Graphics and Applications, vol. 22, no. 6, pp. 39-45, 2002.
19. G. Simon and M.O. Berger, "Pose Estimation for Planar Structure," IEEE Computer Graphics and Applications, vol. 22, no. 6, pp. 46-53, 2002.
20. U. Neumann and Y. Suya, "Natural Feature Tracking for Augmented Reality," IEEE Trans. Multimedia, vol. 1, no. 1, pp. 53-64, 1999.
21. A.I. Comport, E. Marchand, and F. Chaumette, "A Real-Time Tracker for Markerless Augmented Reality," Proc. IEEE and ACM Int'l Symp. Mixed and Augmented Reality, pp. 36-45, 2003.
22. V. Ferrari, T. Tuytelaars, and L. Van Gool, "Markerless Augmented Reality with a Real-Time Affine Region Tracker," Proc. IEEE and ACM Int'l Symp. Augmented Reality, pp. 87-96, 2001.
23. J. Shi and C. Tomasi, "Good Features to Track," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 593-600, 1994.
24. M.L. Yuan, S.K. Ong, and A.Y. C. Nee, "Registration Using Projective Reconstruction Technique for Augmented Reality Systems," IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 3, pp. 254-264, May-June 2005.
25. N. Kiriakos and J.R. Vallino, "Calibration-Free Augmented Reality," IEEE Trans. Visualization and Computer Graphics, vol. 4, no. 1, pp. 1-20, Oct.-Dec. 1998.
26. C. Tomasi and T. Kanade, "Detection and Tracking of Point Features," Technical Report CMU-CS-91-132, Carnegie Mellon Univ., 1991.
27. G.D. Hager and P.N. Belhumeur, "Real-Time Tracking of Image Regions with Changes in Geometry and Illumination," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 403-410, 1996.
28. B. Georgescu and P. Meer, "Point Matching under Larger Image Deformations and Illumination Changes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, pp. 674-689, 2004.
29. T. Tommasini, A. Fusiello, E. Trucco, and V. Roberta, "Making Good Features Track Better," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 178-183, 1998.
30. K. Shafique and M.A. Shah, "Noniterative Greedy Algorithm for Multiframe Point Correspondence," Proc. Int'l Conf. Computer Vision, pp. 110-115, 2003.
31. H. Jin, P. Favaro, and S. Soatto, "Real-Time Feature Tracking and Outlier Rejection with Changes in Illumination," Proc. Int'l Conf. Computer Vision, pp. 684-689, 2001.
32. Y. Gene, S. Riedel, F. Souvannavong, C. Akinlar, and N. Navab, "Marker-Less Tracking for AR: A Learning-Based Approach," Proc. IEEE and ACM Int'l Symp. Augmented Reality, pp. 295-305, 2002.
33. R.I. Hartley, "In Defense of the Eight-Point Algorithm," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 6, pp. 580-593, June 1997.
34. Z. Zhang, R. Deriche, O. Faugeras, and Q.T. Luong, "A Robust Technique for Matching Two Uncalibrated Images through the Recovery of the Unknown Epipolar Geometry," Artificial Intelligence J., vol. 78, pp. 87-119, 1995.
35. G.H. Golub and C.F. Van Loan, Matrix Computations. The Johns Hopkins Univ. Press, 1989.
36. B. Jiang, S. You, and U. Neumann, "A Robust Tracking System for Outdoor Augmented Reality," Proc. IEEE Virtual Reality Conf., pp. 3-10, 2004.
37. D. Koller, G. Klinker, E. Rose, D. Breen, R. Whitaker, and M. Tuceryan, "Real-Time Vision-Based Camera Tracking for Augmented Reality Applications," Proc. ACM Virtual Reality Software and Technology Conf., pp. 87-94, 1997.
38. M. Ribo, P. Lang, H. Ganstar, M. Brandner, C. Stock, and A. Pinz, "Hybrid Tracking for Outdoor Augmented Reality Applications," IEEE Computer Graphics and Applications, vol. 22, no. 6, pp. 54-63, 2002.