Pose Estimation for Augmented Reality: A Hands-On Survey

IEEE Transactions on Visualization and Computer Graphics

Volumn 22, Issue 12, 2016, Pages 2633-2651

  Marchand, Eric ^a   Uchiyama, Hideaki ^b   Spindler, Fabien ^c  

^a UNIVERSITÉ DE RENNES 1   (France)

^b KYUSHU UNIVERSITY   (Japan)

^c INRIA   (France)

Author keywords

augmented reality; code examples; homography; keypoint matching; motion estimation; PnP; pose estimation; SLAM; Survey; vision based camera localization

Indexed keywords

AUGMENTED REALITY; CAMERAS; SURVEYING; SURVEYS;

CAMERA LOCALIZATION; CODE EXAMPLES; HOMOGRAPHIES; KEY POINT MATCHING; POSE ESTIMATION; SLAM;

MOTION ESTIMATION;

EID: 84994797655     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2015.2513408     Document Type: Review

References (151)

1. A. Alahi, R. Ortiz, P. Vandergheynst, "Freak: Fast retina keypoint, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2012, pp. 510-517.
2. P. Alcantarilla, A. Bartoli, A. Davison, "KAZE features, " in Proc. Eur. Conf. Comput. Vis., 2012, pp. 214-227.
3. P. F. Alcantarilla, J. Nuevo, A. Bartoli, "Fast explicit diffusion for accelerated features in nonlinear scale spaces, " in Proc. Brit. Mach. Vis. Conf., 2013, pp. 1-11.
4. M. Ambai and Y. Yoshida, "CARD: Compact and real-time descriptors, " in Proc. Int. Conf. Comput. Vis., 2011, pp. 97-104.
5. M.-A. Ameller, B. Triggs, L. Quan, "Camera pose revisited-new linear algorithms, " in Proc. Eur. Conf. Comput. Vis., 2000.
6. C. Arth, D. Wagner, M. Klopschitz, A. Irschara, D. Schmalstieg, "Wide area localization on mobile phones, " in Proc. IEEE Int. Symp. Mixed Augmented Real., 2009, pp. 73-82.
7. R. Azuma, "A survey of augmented reality, " Presence: Teleoperators Virtual Environ., vol. 6, no. 4, pp. 355-385, Aug. 1997.
8. R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, B. MacIntyre, "Recent advances in augmented reality, " IEEE Comput. Graph. Appl., vol. 21, no. 6, pp. 34-47, Nov. 2001.
9. M. Bajura and U. Neumann, "Dynamic registration correction in video-based augmented reality systems, " IEEE Comput. Graph. Appl., vol. 15, no. 5, pp. 52-60, Sep. 1995.
10. S. Baker and I. Matthews, "Lucas-kanade 20 years on: A unifying framework, " Int. J. Comput. Vis., vol. 56, no. 3, pp. 221-255, 2004.
11. A. Bationo-Tillon, J. Laneurit, E. Marchand, F. Servant, I. Marchal, P. Houlier, "A day at the museum: An augmented fine-art exhibit, " in Proc. IEEE Int. Symp. Mixed Augmented Real. (Art, Media Humanities), Oct. 2010, pp. 69-70.
12. H. Bay, A. Ess, T. Tuytelaars, L. Van Gool, "Speeded-up robust features (SURF), " Comput. Vis. Image Understanding, vol. 110, no. 3, pp. 346-359, 2008.
13. S. Benhimane and E. Malis, "Real-time image-based tracking of planes using efficient second-order minimization, " in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Oct. 2004, vol. 943-948, p. 1.
14. F. Bergamasco, A. Albarelli, E. Rodola, A. Torsello, "RUNETag: A high accuracy fiducial marker with strong occlusion resilience, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 113-120.
15. F. Bergamasco, A. Albarelli, A. Torsello, "Pi-tag: A fast image-space marker design based on projective invariants, " Mach. Vis. Appl., vol. 24, no. 6, pp. 1295-1310, 2013.
16. P. J. Besl and N. D. McKay, "A method for registration of 3-d shapes, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 2, pp. 239-256, Feb. 1992.
17. G. Blais and M. D. Levine, "Registering multiview range data to create 3d computer objects, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 8, pp. 820-824, Aug. 1995.
18. G. Bleser, Y. Pastarmov, D. Stricker, "Real-time 3d camera tracking for industrial augmented reality applications, " J. WSCG, pp. 47-54, 2005.
19. G. Bleser, H. Wuest, D. Stricker, "Online camera pose estimation in partially known and dynamic scenes, " in Proc. IEEE/ACM Int. Symp. Mixed Augmented Real., 2006, pp. 56-65.
20. G. Bradski and A. Kaehler. Learning OpenCV: Computer Vision with the OpenCV Library. Sebastopol, CA, USA: O'Reilly Media, Inc., 2008.
21. M. Calonder, V. Lepetit, M. Ozuysal, T. Trzcinski, C. Strecha, P. Fua, "BRIEF: Computing a local binary descriptor very fast, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1281-1298, Jul. 2012.
22. F. Chaumette and S. Hutchinson, "Visual servo control, Part I: Basic approaches, " IEEE Robot. Autom. Mag., vol. 13, no. 4, pp. 82-90, Dec. 2006.
23. C. Choi and H. I. Christensen, "Robust 3d visual tracking using particle filtering on the special euclidean group: A combined approach of keypoint and edge features, " Int. J. Robot. Res., vol. 31, no. 4, pp. 498-519, Apr. 2012.
24. A. I. Comport, E. Marchand, M. Pressigout, F. Chaumette, "Real-time markerless tracking for augmented reality: The virtual visual servoing framework, " IEEE Trans. Vis. Comput. Graph., vol. 12, no. 4, pp. 615-628, Jul. 2006.
25. A. Dame and E. Marchand, "Accurate real-time tracking using mutual information, " in Proc. IEEE Int. Symp. Mixed Augmented Real., Oct. 2010, pp. 47-56.
26. A. Dame and E. Marchand, "Second order optimization of mutual information for real-time image registration, " IEEE Trans. Image Process., vol. 21, no. 9, pp. 4190-4203, Sep. 2012.
27. A. J. Davison, "Real-time simultaneous localisation and mapping with a single camera, " in Proc. IEEE Int. Conf. Comput. Vis., 2003, pp. 1403-1410.
28. D. Dementhon and L. Davis, "Model-based object pose in 25 lines of codes, " Int. J. Comput. Vis., vol. 15, pp. 123-141, 1995.
29. M. Donoser, P. Kontschieder, H. Bischof, "Robust planar target tracking and pose estimation from a single concavity, " in Proc. IEEE Int. Symp. Mixed Augmented Real., 2011, pp. 9-15.
30. K. Dorfmuller, "Robust tracking for augmented reality using retroreflective markers, "Comput. Graph., vol. 23, no. 6, pp. 795-800, 1999.
31. T. Drummond and R. Cipolla, "Real-time visual tracking of complex structures, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 932-946, Jul. 2002.
32. E. Eade and T. Drummond, "Scalable monocular slam, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., Jun. 2006, vol. 1, pp. 469-476.
33. J. Engel, T. Schops, D. Cremers, "LSD-SLAM: Large-scale direct monocular SLAM, " in Proc. Eur. Conf. Comput. Vis., Sep. 2014, pp. 834-849.
34. J. Engel, J. Sturm, D. Cremers, "Semi-dense visual odometry for a monocular camera, " in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1449-1456.
35. B. Fan, F. Wu, Z. Hu, "Rotationally invariant descriptors using intensity order pooling, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 10, pp. 2031-2045, Oct. 2012.
36. O. Faugeras and F. Lustman, "Motion and structure from motion in a piecewise planar environment, " Int. J. Pattern Recog. Artif. Intell., vol. 2, no. 3, pp. 485-508, 1988.
37. M. Fiala, "Artag, a fiducial marker system using digital techniques, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., Jun. 2005, pp. 590-596.
38. M. Fiala, "Designing highly reliable fiducial markers, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 7, pp. 1317-1324, Jul. 2010.
39. N. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with application to image analysis and automated cartography, " Commun. ACM, vol. 24, no. 6, pp. 381-395, Jun. 1981.
40. A. W. Fitzgibbon, "Robust registration of 2d and 3d point sets, " Image Vis. Comput., vol. 21, nos. 12-13, pp. 1145-1153, Dec. 2003.
41. X.-S. Gao, X.-R. Hou, J. Tang, H.-F. Cheng, "Complete solution classification for the perspective-three-point problem, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 8, pp. 930-943, Aug. 2003.
42. S. Gauglitz, M. Turk, T. Hollerer, "Improving keypoint orientation assignment, " in Proc. Brit. Mach. Vis. Conf., 2011, pp. 1-11.
43. V. Gay-Bellile, A. Bartoli, P. Sayd, "Deformable surface augmentation in spite of self-occlusions, " in Proc. ACM/IEEE Int. Symp. Mixed Augmented Real., Nov. 2007, pp. 235-238.
44. Y. Genc, S. Riedel, F. Souvannavong, C. Akinlar, N. Navab, "Marker-less tracking for AR: A learning-based approach, " in Proc. IEEE Int. Symp. Mixed Augmented Real., Sep. 2002, pp. 3-6.
45. M. Haag and H. H. Nagel, "Combination of edge element and optical flow estimates for 3D-model-based vehicle tracking in traffic image sequences, " Int. J. Comput. Vis., vol. 35, no. 3, pp. 295-319, Dec. 1999.
46. G. Hager and P. Belhumeur, "Efficient region tracking with parametric models of geometry and illumination, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 10, pp. 1025-1039, Oct. 1998.
47. C. Harris and M. Stephens, "A combined corner and edge detector, " in Proc. Alvey Conf., 1988, pp. 147-151.
48. R. Hartley and A. Zisserman, "Multiple View Geometry in Computer Vision. Cambridge, U. K. : Cambridge Univ. Press, 2001.
49. B. Horn, "Closed-form solution of absolute orientation using unit quaternions, " J. Optical Soc. Am., vol. 4, no. 4, p. 629-642, 1987.
50. P.-J. Huber, Robust Statistics. New York, NY, USA: Wiley, 1981.
51. M. Irani and P. Anandan, "Robust multi-sensor image alignment, " in Proc. IEEE Int. Conf. Comput. Vis., 1998, pp. 959-966.
52. E. Ito, T. Okatani, K. Deguchi, "Accurate and robust planar tracking based on a model of image sampling and reconstruction process, " in Proc. IEEE Int. Symp. Mixed Augmented Real., Oct. 2011, pp. 1-8.
53. S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, A. Fitzgibbon, "Kinectfusion: Real-time 3d reconstruction and interaction using a moving depth camera, " in Proc. ACM Symp. User Interface Softw. Technol., Oct. 2011, pp. 559-568.
54. H. Kato and M. Billinghurst, "Marker tracking and HMD calibration for a video-based augmented reality conferencing system, " in Proc. ACM/IEEE Int. Workshop Augmented Real., Oct. 1999, pp. 85-95.
55. K. Kim, V. Lepetit, W. Woo, "Scalable real-time planar targets tracking for digilog books, " The Vis. Comput., vol. 26, no. 6-8, pp. 1145-1154, 2010.
56. G. Klein and T. Drummond, "Tightly integrated sensor fusion for robust visual tracking, " Image Vis. Comput., vol. 22, no. 10, pp. 769-776, Sep. 2004.
57. G. Klein and D. Murray, "Parallel tracking and mapping for small AR workspaces, " in Proc. IEEE/ACM Int. Symp. Mixed Augmented Real., Nov. 2007, pp. 225-234.
58. G. Klein and D. Murray, "Parallel tracking and mapping on a camera phone, " in Proc. IEEE/ACM Int. Symp. Mixed Augmented Real., Oct. 2009, pp. 83-86.
59. L. Kneip and P. Furgale, "Opengv: A unified and generalized approach to real-time calibrated geometric vision, " in Proc. IEEE Int. Conf. Robot. Autom., May 2014, pp. 1-8.
60. L. Kneip, P. Furgale, R. Siegwart, "Using multi-camera systems in robotics: Efficient solutions to the npnp problem, " in Proc. IEEE Int. Conf. Robot. Autom., May 2013, pp. 3770-3776.
61. L. Kneip, H. Li, Y. Seo, "Upnp: An optimal o (n) solution to the absolute pose problem with universal applicability, " in Proc. Eur. Conf. Comput. Vis., 2014, pp. 127-142.
62. L. Kneip, D. Scaramuzza, R. Siegwart, "A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2011, pp. 2969-2976.
63. D. Kurz and S. Benhimane, "Handheld augmented reality involving gravity measurements, " Comput. Graph., vol. 36, no. 7, pp. 866-883, Jul. 2012.
64. V. Kyrki and D. Kragic, "Integration of model-based and modelfree cues for visual object tracking in 3d, " in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2005, pp. 1566-1572.
65. V. Lepetit and P. Fua, "Monocular model-based 3d tracking of rigid objects: A survey, " Found. Trends Comput. Graph. Vis., vol. 1, no. 1, pp. 1-89, Oct. 2005.
66. V. Lepetit and P. Fua, "Keypoint recognition using randomized trees, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1465-1479, Sep. 2006.
67. V. Lepetit, F. Moreno-Noguer, P. Fua, "EPnP: An accurate O(n) solution to the PnP problem, " Int. J. Comput. Vis., vol. 81, no. 2, pp. 155-166, 2009.
68. V. Lepetit, L. Vacchetti, T. Thalmann, P. Fua, "Fully automated and stable registration for augmented reality applications, " in Proc. ACM/IEEE Int. Symp. Mixed Augmented Real., Oct. 2003, pp. 93-102.
69. S. Leutenegger, M. Chli, R. Siegwart, "BRISK: Binary robust invariant scalable keypoints, " in Proc. Int. Conf. Comput. Vis., 2011, pp. 2548-2555.
70. T. Lindeberg. Scale-Space Theory in Computer Vision. New York, NY, USA: Springer, 1993.
71. T. Lindeberg, "Feature detection with automatic scale selection, " Int. J. Comput. Vis., vol. 30, no. 2, pp. 79-116, 1998.
72. D. Lowe, "Distinctive image features from scale-invariant keypoints, " Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
73. D. G. Lowe, "Fitting parameterized three-dimensional models to images, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 5, pp. 441-450, May 1991.
74. C. P. Lu, G. D. Hager, E. Mjolsness, "Fast and globally convergent pose estimation from video images, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 6, pp. 610-622, Jun. 2000.
75. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision, " in Proc. Int. Joint Conf. Artif. Intell., 1981, pp. 674-679.
76. Y. Ma, S. Soatto, J. Ko-seck-a, S. Sastry, An Invitation to 3-D Vision. New York, NY, USA: Springer, 2004.
77. E. Mair, G. Hager, D. Burschka, M. Suppa, G. Hirzinger, "Adaptive and generic corner detection based on the accelerated segment test, " in Proc. Eur. Conf. Comput. Vis., 2010, pp. 183-196.
78. E. Marchand and F. Chaumette, "Virtual visual servoing: A framework for real-time augmented reality, " in Proc. Conf. Comput. Graph. Forum, Sep. 2002, pp. 289-298.
79. E. Marchand, F. Spindler, F. Chaumette, "ViSP for visual servoing: A generic software platform with a wide class of robot control skills, " IEEE Robot. Autom. Mag., vol. 12, no. 4, pp. 40-52, Dec. 2005.
80. S. Martedi, B. Thomas, H. Saito, "Region-based tracking using sequences of relevance measures, " in Proc. IEEE Int. Symp. Mixed Augmented Real., 2013, pp. 1-6.
81. P. Martin, E. Marchand, P. Houlier, I. Marchal, "Mapping and re-localization for mobile augmented reality, " in Proc. IEEE Int. Conf. Image Process., Oct. 2014, pp. 3352-3356.
82. J. Matas, O. Chum, M. Urban, T. Pajdla, "Robust wide-baseline stereo from maximally stable extremal regions, " Image Vis. Comput., vol. 22, no. 10, pp. 761-767, Oct. 2004.
83. E. Molla and V. Lepetit, "Augmented reality for board games, " in Proc. IEEE Int. Symp. Mixed Augmented Real., 2010, pp. 253-254.
84. E. Mouragnon, M. Lhuillier, M. Dhome, F. Dekeyser, P. Sayd, "Real time localization and 3d reconstruction, " in Proc. IEEE Int. Conf. Comput. Vis., 2006, vol. 1, pp. 363-370.
85. M. Muja and D. Lowe, "Scalable nearest neighbor algorithms for high dimensional data, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 11, pp. 2227-2240, Nov. 2014.
86. L. Naimark and E. Foxlin, "Circular data matrix fiducial system and robust image processing for a wearable vision-inertial selftracker, " in Proc. Int. Symp. Mixed Augmented Real., 2002, p. 27.
87. N. Navab, "Developing killer apps for industrial augmented reality, " IEEE Comput. Graph. Appl., vol. 24, no. 3, pp. 16-20, May 2004.
88. A. Neubeck and L. Van Gool, "Efficient non-maximum suppression, " in Proc. IAPR Int. Conf. Pattern Recog., 2006, vol. 3, pp. 850-855.
89. R. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A. J. Davison, P. Kohi, J. Shotton, S. Hodges, A. Fitzgibbon, "Kinectfusion: Real-time dense surface mapping and tracking, " in Proc. IEEE/ACM Int. Symp. Mixed Augmented Real., Oct. 2011, pp. 127-136.
90. R. Newcombe, S. Lovegrove, A. Davison, "Dtam: Dense tracking and mapping in real-time, " in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 2320-2327.
91. D. Nist-er, "An efficient solution to the five-point relative pose problem, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 6, pp. 756-770, Jun. 2004.
92. D. Nister, O. Naroditsky, J. Bergen, "Visual odometry, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2004, p. 652.
93. D. Oberkampf, D. F. Dementhon, L. S. Davis, "Iterative pose estimation using coplanar feature points, " Comput. Vis. Image Understanding, vol. 63, no. 3, pp. 495-511, May 1996.
94. C. Olsson, F. Kahl, M. Oskarsson, "Branch-and-bound methods for euclidean registration problems, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 5, pp. 783-794, May 2009.
95. M. Ozuysal, M. Calonder, V. Lepetit, P. Fua, "Fast keypoint recognition using random ferns, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 3, pp. 448-461, Mar. 2010.
96. Y. Park, V. Lepetit, W. Woo, "Multiple 3d object tracking for augmented reality, " in Proc. IEEE/ACM Int. Symp. Mixed Augmented Real., 2008, pp. 117-120.
97. Y. Park, V. Lepetit, W. Woo, "Handling motion-blur in 3d tracking and rendering for augmented reality, " IEEE Trans. Vis. Comput. Graph., vol. 18, no. 9, pp. 1449-1459, Sep. 2012.
98. A. Petit, E. Marchand, A. Kanani, "Combining complementary edge, point and color cues in model-based tracking for highly dynamic scenes, " in Proc. IEEE Int. Conf. Robot. Autom., Jun. 2014, pp. 4115-4120.
99. A. Petit, E. Marchand, K. Kanani, "Tracking complex targets for space rendezvous and debris removal applications, " in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Oct. 2012, pp. 4483-4488.
100. A. Petit, E. Marchand, K. Kanani, "Augmenting markerless complex 3d objects by combining geometrical and color edge information, " in Proc. IEEE Int. Symp. Mixed Augmented Real., Oct. 2013, pp. 287-288.
101. T. Pintaric and H. Kaufmann, "Affordable infrared-optical posetracking for virtual and augmented reality, " in Proc. IEEE Trends Issues Tracking Virtual Environ. Workshop, 2007, pp. 44-51.
102. M. Pressigout and E. Marchand, "Model-free augmented reality by virtual visual servoing, " in Proc. IAPR Int. Conf. Pattern Recog., Aug. 2004, vol. 2, pp. 887-891.
103. M. Pressigout and E. Marchand, "Hybrid tracking algorithms for planar and non-planar structures subject to illumination changes, " in Proc. ACM/IEEE Int. Symp. Mixed Augmented Real., Oct. 2006, pp. 52-55.
104. M. Pressigout and E. Marchand, "Real-time hybrid tracking using edge and texture information, " Int. J. Robot. Res., vol. 26, no. 7, pp. 689-713, Jul. 2007.
105. L. Quan and Z. Lan, "Linear n-point camera pose determination, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 8, pp. 774-780, Aug. 1999.
106. J. Rekimoto, "Matrix: A realtime object identification and registration method for augmented reality, " in Proc. 3rd Asia Pacific Comput. Human Interaction, 1998, pp. 63-68.
107. R. Richa, R. Sznitman, R. Taylor, G. Hager, "Visual tracking using the sum of conditional variance, " in Proc. IEEE Conf. Intell. Robots Syst., Sep. 2011, pp. 2953-2958.
108. E. Rosten, R. Porter, T. Drummond, "Faster and better: A machine learning approach to corner detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 105-119, Jan. 2010.
109. P. J. Rousseeuw, "Least median of squares regression, " J. Am. Statist. Assoc., vol. 79, pp. 871-880, 1984.
110. E. Royer, M. Lhuillier, M. Dhome, J. M. Lavest, "Monocular vision for mobile robot localization and autonomous navigation, " Int. J. Comput. Vis., vol. 74, no. 3, pp. 237-260, 2007.
111. E. Rublee, V. Rabaud, K. Konolige, G. Bradski, "ORB: An efficient alternative to SIFT or SURF, " in Proc. Int. Conf. Comput. Vis., 2011, pp. 2564-2571.
112. R. Rusu, N. Blodow, M. Beetz, "Fast point feature histograms (fpfh) for 3d registration, " in Proc. IEEE Int. Conf. Robot. Autom., 2009, pp. 3212-3217.
113. G. Schall, H. Grabner, M. Grabner, P. Wohlhart, D. Schmalstieg, H. Bischof, "3d tracking in unknown environments using on-line keypoint learning for mobile augmented reality, " in Proc. IEEE Conf. Comput Vis. Pattern Recog. Workshops, Jun. 2008, pp. 1-8.
114. T. Schops, J. Engel, D. Cremers, "Semi-dense visual odometry for AR on a smartphone, " in Proc. Int. Symp. Mixed Augmented Real., Sep. 2014, pp. 145-150.
115. G. Schweighofer and A. Pinz, "Robust pose estimation from a planar target, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2024-2030, Dec. 2006.
116. F. Servant, E. Marchand, P. Houlier, I. Marchal, "Visual planes-based simultaneous localization and model refinement for augmented reality, " in Proc. IAPR, Int. Conf. Pattern Recog., Dec. 2008, pp. 1-4.
117. A. Shahrokni, L. Vacchetti, V. Lepetit, P. Fua, "Polyhedral object detection and pose estimation for augmented reality applications, " in Proc. Comput. Animation, 2002, pp. 65-69.
118. J. Shi and C. Tomasi, "Good features to track, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., Jun. 1994, pp. 593-600.
119. H.-Y. Shum and R. Szeliski, "Construction of panoramic image mosaics with global and local alignment, " Int. J. Comput. Vis., vol. 36, no. 2, pp. 101-130, 2000.
120. G. Simon and M.-O. Berger, "A two-stage robust statistical method for temporal registration from features of various type, " in Proc. IEEE Int. Conf. Comput. Vis., Jan. 1998, pp. 261-266.
121. G. Simon and M.-O. Berger, "Reconstructing while registering: A novel approach for markerless augmented reality, " in Proc. IEEE Int. Symp. Mixed Augmented Real., Sep. 2002, pp. 285-294.
122. G. Simon, A. Fitzgibbon, A. Zisserman, "Markerless tracking using planar structures in the scene, " in Proc. IEEE/ACM Int. Symp. Augmented Real., Oct. 2000, pp. 120-128.
123. S. Sinha, J.-M. Frahm, M. Pollefeys, Y. Genc, "Gpu-based video feature tracking and matching, " in Proc. Workshop Edge Comput. Using New Commodity Archit., 2006, vol. 278, p. 4321.
124. I. Skrypnyk and D. G. Lowe, "Scene modelling, recognition and tracking with invariant image features, " in Proc. ACM/IEEE Int. Symp. Mixed Augmented Real., Nov. 2004, pp. 110-119.
125. S. Smith and J. M. Brady, "SUSAN-A new approach to low level image processing, " Int. J. Comput. Vis., vol. 23, no. 1, pp. 45-78, 1997.
126. C. Stewart, "Robust parameter estimation in computer vision, " SIAM Rev., vol. 41, no. 513-537, 1999.
127. H. Strasdat, J. M. M. Montiel, A. Davison, "Real-time monocular slam: Why filter, " in Proc. Int. Conf. Robot. Autom., 2010, pp. 2657-2664.
128. C. Strecha, A. Bronstein, M. Bronstein, P. Fua, "LDAHash: Improved matching with smaller descriptors, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 66-78, Jan. 2012.
129. I. E Sutherland, "Three-dimensional data input by tablet, " Proc. IEEE, vol. 62, no. 4, pp. 453-461, Apr. 1974.
130. G. Takacs, V. Chandrasekhar, S. Tsai, D. Chen, R. Grzeszczuk, B. Girod, "Unified real-time tracking and recognition with rotation-invariant fast features, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 934-941.
131. M. Tamaazousti, V. Gay-Bellile, S. Collette, S. Bourgeois, M. Dhome, "Nonlinear refinement of structure from motion reconstruction by taking advantage of a partial knowledge of the environment, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 3073-3080.
132. G. Taylor and L. Kleeman, "Fusion of multimodal visual cues for model-based object tracking, " in Proc. Aust. Conf. Robot. Autom., Dec. 2003, pp. 1-8.
133. C. Teuli-ere, L. Eck, E. Marchand, N. Guenard, "3d modelbased tracking for UAV position control, " in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Oct. 2010, pp. 1084-1089.
134. B. Triggs, P. McLauchlan, R. Hartley, A. Fitzgibbon, "Bundle adjustment: A modern synthesis, " in Proc. Int. Vis. Algorithms: Theory Practice, 2000, pp. 298-372.
135. T. Trzcinski, M. Christoudias, P. Fua, V. Lepetit, "Boosting binary keypoint descriptors, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 2874-2881.
136. T. Tuytelaars and K. Mikolajczyk, "Local invariant feature detectors: A survey, " Found. Trends Comput. Graph. Vis., vol. 3, no. 3, pp. 177-280, 2008.
137. T. Tykkala, H. Hartikainen, A. I Comport, J. Kamarainen, "Rgb-d tracking and reconstruction for tv broadcasts, " in Proc. Int. Conf. Comput. Vis. Theory Appl., 2013, vol. 2, pp. 247-252.
138. H. Uchiyama and E. Marchand, "Toward augmenting everything: Detecting and tracking geometrical features on planar objects, " in Proc. IEEE Int. Symp. Mixed Augmented Real., Oct. 2011, pp. 17-25.
139. H. Uchiyama and H. Saito, "Random dot markers, " in Proc. IEEE Virtual Real. Conf., 2011, pp. 35-38.
140. L. Vacchetti, V. Lepetit, P. Fua, "Combining edge and texture information for real-time accurate 3d camera tracking, " in Proc. ACM/IEEE Int. Symp. Mixed Augmented Real., Nov. 2004, vol. 2, pp. 48-57.
141. L. Vacchetti, V. Lepetit, P. Fua, "Stable real-time 3d tracking using online and offline information, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 10, pp. 1385-1391, Oct. 2004.
142. A. Vedaldi and B. Fulkerson. (2008). VLFeat: An open and portable library of computer vision algorithms [Online]. Available: http://www. vlfeat. org/
143. J. Ventura and T. Hollerer, "Wide-area scene mapping for mobile visual tracking, " in Proc. IEEE Int. Symp. Mixed Augmented Real., 2012, pp. 3-12.
144. D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, D. Schmalstieg, "Pose tracking from natural features on mobile phones, " in Proc. IEEE/ACM Int. Symp. Mixed Augmented Real., 2008, pp. 125-134.
145. D. Wagner and D. Schmalstieg, "Artoolkitplus for pose tracking on mobile devices, " in Proc. 12th Comput. Vis. Winter Workshop, Feb. 2007.
146. G. Welch and E. Foxlin, "Motion tracking: No silver bullet, but a respectable arsenal, " IEEE Comput. Graph. Appl., vol. 22 no. 6, pp. 24-38, Nov. 2002.
147. H. Wuest and D. Stricker, "Tracking of industrial objects by using cad models, " J. Virtual Real. Broadcasting, vol. 4, no. 1, Apr. 2007.
148. X. Yang and K.-T. Cheng, "LDB: An ultra-fast feature for scalable augmented reality on mobile devices, " in Proc. IEEE Int. Symp. Mixed Augmented Real., 2012, pp. 49-57.
149. Z. Zhang, "A flexible new technique for camera calibration, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 11, pp. 1330-1334, Nov. 2000.
150. Y. Zheng, Y. Kuang, S. Sugimoto, K. Astrom, M. Okutomi, "Revisiting the PNP problem: A fast, general and optimal solution, " in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 2344-2351.
151. F. Zhou, H. B.-L. Duh, M. Billinghurst, " Trends in augmented reality tracking, interaction and display: A review of ten years of ismar, " in Proc. IEEE/ACM Int. Symp. Mixed Augmented Real., 2008, pp. 193-202.