Registration combining wide and narrow baseline feature tracking techniques for markerless AR systems

Sensors

Volumn 9, Issue 12, 2009, Pages 10097-10116

  Duan, Liya ^a   Guan, Tao ^a   Yang, Bo ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Augmented reality; Narrow baseline; Natural features; Registration; Scale invariant feature transform; Wide baseline

Indexed keywords

NARROW BASELINE; NATURAL FEATURES; REGISTRATION; SCALE INVARIANT FEATURE TRANSFORMS; WIDE BASELINES;

AUGMENTED REALITY;

EID: 77949808506     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s91210097     Document Type: Article

References (42)

1. Shi, J.; Tomasi, C. Good features to track. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'94), Seattle, WA, USA, June, 1994; pp. 593-600.
2. Fusiello, A.; Trucco, E.; Tommasini, T.; Roberto, V. Improving feature tracking with robust statistics. Pattern Anal. Appl. 1999, 2, 312-320.
3. Berthold, K.P.H.; Brian, G.S. Determining optical flow. Artif. Intel. 1981, 17, 185-203.
4. Simon, G.; Berger, M. Reconstructing while registering: a novel approach for markerless augmented reality. In Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR 2002), Darmstadt, Germany, September, 2002; pp. 285-294.
5. Simon, G.; Berger, M.O. Real time registration known or recovered multi-planar structures: application to AR. In Proceedings of British Machine Vision Conference (BMVC'02), Cardiff, UK, September, 2002; pp. 567-576.
6. Li, J.; Laganière, R.; Roth, G. Online estimation of trifocal tensors for augmenting live video. In Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR'04), Arlington, VA, USA, November, 2004; pp. 182-190.
7. Eade, E.; Drummond, T. Scalable monocular slam. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'06), New York, NY, USA, June, 2006; pp. 469-476.
8. Davison, A.; Reid, I.; Molton, N.D.; Stasse, O. MonoSLAM: Realtime single camera SLAM. IEEE Trans. Patt. Anal. Mach. Int. 2007, 29, 1052-1067.
9. Davison, A.; Mayol, W.; Murray, D. Real-time localization and mapping with wearable active vision. In Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR'03), Tokyo, Japan, October, 2003; pp. 18-25.
10. Pupilli, M.; Calway, A. Real-time camera tracking using a particle filters. In Proceedings of British Machine Vision Conference (BMVC'05), Oxford, UK, September, 2005; pp. 519-528.
11. Molton, N.; Ried, I.; Davison, A. Locally planar patch features for real-time structure from motion. In Proceedings of British Machine Vision Conference (BMVC'04), London, UK, September, 2004.
12. Pupilli, M.; Calway, A. Real-time visual slam with resilience to erratic motion. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'06), New York, NY, USA, June, 2006; pp. 1244-1249.
13. Yuan, M.L.; Ong, S.K.; Nee, A.Y.C. Registration based on projective reconstruction technique for augmented reality systems. IEEE Trans. Vis. Comput. Graph. 2005, 11, 254-264.
14. Yuan, M.L.; Ong, S.K.; Nee, A.Y.C. Registration using natural features for augmented reality systems. IEEE Trans. Vis Comput. Graph. 2006, 12, 569-580.
15. Yuan, M.L.; Ong, S.K.; Nee, A.Y.C. A generalized registration method for augmented reality systems. Comput. Graph. 2005, 29, 980-997.
16. Nistér, D.; Naroditsky, O.; Bergen, J.R. Visual odometry. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA, June, 2004; pp. 652-659.
17. Engels, C.; Stewénius, H.; Nistér, D. Bundle adjustment rules. In Photogrammetric Computer Vision (PCV'06), Bonn, Germany, September, 2006.
18. Akbarzadeh, A.; Frahm, J.M.; Mordohai, P.; Clipp, B. Towards urban 3D reconstruction from video. In Proceedings of the 3rd International Symposium on 3D Data Processing, Visualization and Transmission, Chapel Hill, NC, USA, June, 2006.
19. Klopschitz, M.; Schmalstieg, D. Automatic reconstruction of wide-area fiducial marker models. In Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR'07), Nara, Japan, November, 2007; pp. 1-4.
20. Bleser, G.; Wuest, H.; Stricker, D. Online camera pose estimation in partially known and dynamic scenes. In Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR'06), San Diego, CA, USA, October, 2006; pp. 56-65.
21. Harris, C.; Stephens, M. A combined corner and edge detector. In Proceedings of the 4th Alvey Vision Conference, Manchester, UK, September, 1988; pp. 189-192.
22. Mikolajczyk, K.; Schmid, C. An affine invariant interest point detector. In Proceedings of the 7th European Conference on Computer Vision, Copenhagen, Denmark, 2002; pp. 128-142.
23. Lowe, D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 2004, 60, 91-110.
24. Ke, Y.; Sukthankar, R. PCA-SIFT: A more distinctive representation for local image descriptors. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA, June, 2004; pp. 506-513.
25. Lepetit, V; Pilet, J.; Fua, P. Point matching as a classification problem for fast and robust object pose estimation. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'04), Washington, DC, USA, June, 2004; pp. 244-250.
26. Mikolajczyk, K.; Schmid, C. A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Int. 2005, 27, 1625-1630.
27. Skrypnyk, I.; Lowe, D. Scene modeling, recognition and tracking with invariant image features. In Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR'04), Arlington, VA, USA, November, 2004; pp. 110-119.
28. Wagner, D.; Reitmayr, G.; Mulloni, A.; Drummond, T.; Schmalstieg, D. Pose tracking from natural features on mobile phones. In Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR'07); Cambridge, UK, September, 2008; pp. 125-134.
29. Lepetit, V.; Fua, P. Keypoint recognition using randomized trees. IEEE Trans. Pattern Anal. Mach. Int. 2006, 28, 1465-1479.
30. Ozuysal, M.; Fua, P.; Lepetit, V. Fast keypoint recognition in ten lines of code. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07), Minneapolis, MN, USA, June, 2007; pp. 1-8.
31. Hartley, R.; Zisserman, A. Multiple View Geometry in Computer Vision, 1st ed; Cambridge University: Cambridge, UK, 2000.
32. Guofeng, Z.; Xueying, Q.; Wei, H. Robust metric reconstruction from challenging video sequences. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07), Minneapolis, MN, USA, June, 2007.
33. Szeliski, R.; Kang, S. B. Recovering 3D Shape and Motion from Image Streams Using Non-Linear Least Squares; Technical Report No. CRL 93/3; Digital Equipment Corporation, Cambridge Research Laboratory: Cambridge, UK, March, 1993.
34. Brown, M.; Lowe, D.G.; Unsupervised 3D object recognition and reconstruction in unordered datasets. In Proceedings of 5th International Conference on 3D Digital Imaging and Modeling, Ottawa, Ontario, Canada, June, 2005; pp. 56-63.
35. Triggs, W.; McLauchlan, P.; Hartley, R.; Fitzgibbon, A. Bundle adjustment: A modern synthesis. In Vision Algorithms: Theory and Practice; Springer Verlag: Corfu, Greece, 2000; pp.298-373.
36. d,d test. Image Vision Comput. 2004, 22, 837-842.
37. Williams, B.; Smith, P.; Reid, I. Automatic relocalisation for a single-camera simultaneous localisation and mapping system. In Proceedings of International Conference on Robotics and Automation, (ICRA 07), Roma, Italy, April, 2007; pp. 2784-2790.
38. Rosten, E.; Drummond, T. Machine learning for high-speed corner detection. In Proceedings of European Conference on Computer Vision Graz, Austria, May, 2006; pp. 430-443.
39. Fischler, M.A.; Bolles, R.C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. CACM 1981, 24, 381-395.
40. Philip, J. Critical Point Configurations of the 5-, 6-, 7-, and 8-point Algorithms for Relative Orientation; Technical Report No. TRITA-MAT-1998-MA-13; Department of Mathematics, Royal Institute of Technology: Stockholm, Sweden, 1998.
41. GML Camera Calibration Toolbox downloads resource. Available online: http://research.graphic on.ru/calibration/gml-c-camera-calibration-toolbox-5.html (accessed on 2 December 2009).
42. Klein, G.; Murray, D. Parallel tracking and mapping for small ar workspaces. In Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR'07), Nara, Japan, November, 2007; pp. 225-234.