Efficient, causal camera tracking in unprepared environments

Computer Vision and Image Understanding

Volumn 99, Issue 2, 2005, Pages 259-290

  Lourakis, Manolis I A ^a   Argyros, Antonis A ^a  

^a INSTITUTE OF COMPUTER SCIENCE   (Greece)

Author keywords

3D structure and motion estimation; Augmented reality; Camera tracking; Corner matching; Egomotion estimation; Matchmoving; Plane tracking

Indexed keywords

CAMERAS; COMPUTATIONAL METHODS; IMAGE CODING; MOTION ESTIMATION; PATTERN MATCHING; PROBLEM SOLVING; TRACKING (POSITION); VIRTUAL REALITY;

3D STRUCTURE AND MOTION ESTIMATION; CAMERA TRACKING; CORNER MATCHING; EGOMOTION ESTIMATION; MATCHMOVING; PLANE TRACKING;

IMAGE PROCESSING;

EID: 19744373902     PISSN: 10773142     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cviu.2005.02.001     Document Type: Article

References (53)

1. G. Welch, and E. Foxlin Motion tracking: no silver bullet, but a respectable arsenal IEEE Comput. Graph. Appl. 22 6 2002 24 38
2. R. Azuma Tracking requirements for augmented reality Commun. ACM 36 7 1993 50 51
3. G. Thomas, J. Jin, T. Niblett, C. Urquhart, A versatile camera position measurement system for virtual reality TV production, in: Proc. Internat. Broadcasting Convention (IBC'97), 1997, pp. 284-289
4. R. Hartley, and A. Zisserman Multiple view geometry in computer vision 2000 Cambridge University Press Cambridge
5. K. Kutulakos, and J. Vallino Calibration-free augmented reality IEEE Trans. Vis. Comput. Graph. 4 1 1998 1 20
6. D. Koller, G. Klinker, E. Rose, D. Breen, R. Whitaker, M. Tuceryan, Real-time vision-based camera tracking for augmented reality applications, in: Proc. VRST'97, 1997, pp. 87-94
7. M. Lourakis, Egomotion estimation using quadruples of collinear image points, in: Proc. ECCV'00, vol. 2, 2000, pp. 834-848
8. T. Viéville, O. Faugeras, and Q. Luong Motion of points and lines in the uncalibrated case Int. J. Comput. Vision 17 1 1996 7 41
9. P. Sturm, B. Triggs, A factorization based algorithm for multi-image projective structure and motion, in: Proc. ECCV'96, vol. 1065, 1996, pp. 709-720
10. K. Cornelis, M. Pollefeys, M. Vergauwen, F. Verbiest, L.V. Gool, Tracking based structure and motion recovery for augmented video productions, in: Proc. VRST'01, 2001, pp. 17-24
11. A. Fitzgibbon, A. Zisserman, Automatic camera recovery for closed or open image sequences, in: Proc. ECCV'98, 1998, pp. 311-326
12. C. Rother, and S. Carlsson Linear multi view reconstruction and camera recovery using a reference plane Int. J. Comput. Vision 49 2/3 2002 117 141
13. R. Kaucic, R. Hartley, N. Dano, Plane-based projective reconstruction, in: Proc. ICCV'01, vol. I, 2001, pp. 420-427
14. B. Triggs, P. McLauchlan, R. Hartley, A. Fitzgibbon, Bundle adjustment-a modern synthesis, in: Proc. Internat. Workshop on Vision Algorithms: Theory and Practice, 1999, pp. 298-372
15. P. Beardsley, A. Zisserman, and D. Murray Sequential updating of projective and affine structure from motion Int. J. Comput. Vision 23 1997 235 259
16. G. Simon, A. Fitzgibbon, A. Zisserman, Markerless tracking using planar structures in the scene, in: Proc. Internat. Symp. on Augmented Reality, 2000, pp. 120-128
17. P. McLauchlan, A batch/recursive algorithm for 3D scene reconstruction, in: Proc. CVPR'00, vol. 2, 2000, pp. 738-743
18. S. Avidan, and A. Shashua Threading fundamental matrices IEEE Trans. Pattern Anal. Mach. Intell. 23 1 2001 73 77
19. S. Prince, K. Xu, and A. Cheok Augmented reality camera tracking with homographies IEEE Comput. Graph. Appl. 22 6 2002 39 45
20. D. Nistér An efficient solution to the five-point relative pose problem IEEE Trans. Pattern Anal. Mach. Intell. 26 6 2004 756 777
21. A. Davison, Real-time simultaneous localisation and mapping with a single camera, in: Proc. ICCV'03, 2003, pp. 1403-1410
22. P. Torr, and A. Zisserman Robust parameterization and computation of the trifocal tensor Image Vision Comput. 15 8 1997 591 607
23. A. Shashua, S. Avidan, The rank-4 constraint in multiple view geometry, in: Proc. ECCV'96, vol. 2, 1996, pp. 196-206
24. S. Avidan, A. Shashua, Tensor embedding of the fundamental matrix, in: Proc. post-ECCV SMILE'98, LNCS, vol. 1506, Springer, Berlin, 1998, pp. 47-62
25. A. Shashua, and N. Navab Relative affine structure: canonical model for 3D from 2D geometry and applications IEEE Trans. Pattern Anal. Mach. Intell. 18 9 1996 873 883
26. R. Hartley In defense of the 8-point algorithm IEEE Trans. Pattern Anal. Mach. Intell. 19 6 1997 580 593
27. P. Rousseeuw Least median of squares regression J. Am. Stat. Assoc. 79 1984 871 880
28. Z. Zhang, R. Deriche, O. Faugeras, and Q.-T. Luong A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry AI J. 78 1995 87 119 detailed version in INRIA RR-2273
29. M. Fischler, and R. Bolles Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography Commun. ACM 24 1981 381 395
30. J. Moré, B. Garbow, K. Hillstrom, User guide for MINPACK-1, Tech. Rep. ANL-80-74, Argonne National Laboratory, 1980
31. M. Lourakis, R. Deriche, Camera self-calibration using the singular value decomposition of the fundamental matrix, in: Proc. ACCV'00, 2000, pp. 403-408, detailed version in INRIA RR-3748
32. R. Hartley, and P. Sturm Triangulation Comput. Vision Image Understand. 68 2 1997 146 157
33. R. Goldman Intersection of two lines in three-space A. Glassner Graphics gems i 1990 Academic Press San Diego 304
34. S.-J. Ko, Y. Lee, and A. Fam Efficient implementation of one-dimensional recursive median filters IEEE Trans. Circuits Syst. 37 11 1990 1447 1450
35. J. Dennis, D. Gay, and R. Welsch An adaptive nonlinear least-squares algorithm ACM Trans. Math. Software 7 3 1981 348 368
36. M. Lourakis, A. Argyros, S. Orphanoudakis, Detecting planes in an uncalibrated image pair, in: Proc. BMVC'02, vol. 2, 2002, pp. 587-596
37. E. Anderson, Z. Bai, C. Bischof, S. Blackford, J. Demmel, J. Dongarra, J.D. Croz, A. Greenbaum, S. Hammarling, A. McKenney, and D. Sorensen LAPACK users' guide 3rd ed. 1999 SIAM Philadelphia, PA
38. P. Smith, D. Sinclair, R. Cipolla, K. Wood, Effective corner matching, in: Proc. BMVC'98, vol. 2, 1998, pp. 545-556
39. M. Lourakis, A. Argyros, K. Marias, A graph-based approach to corner matching using mutual information as a local similarity measure, in: Proc. ICPR'04, vol. 2, 2004, pp. 827-830
40. B. Boufama, and R. Mohr A stable and accurate algorithm for computing epipolar geometry Int. J. Pattern Recogn. Artif. Intell. 12 6 1998 817 840
41. W. Press, S. Teukolsky, A. Vetterling, and B. Flannery Numerical recipes in C: The art of scientific computing 1992 Cambridge University Press New York
42. D. Nistér, Frame decimation for structure and motion, in: 3D Structure from Images-SMILE 2000, LNCS, vol. 2018, 2000, pp. 17-34
43. T. Thormaehlen, H. Broszio, A. Weissenfeld, Keyframe selection for camera motion and structure estimation from multiple views, in: Proc. ECCV'04, vol. 1, 2004, pp. 523-535
44. C.-P. Lu, G. Hager, and E. Mjolsness Fast and globally convergent pose estimation from video images IEEE Trans. Pattern Anal. Mach. Intell. 22 6 2000 610 622
45. R. Hartley Kruppa's equations derived from the fundamental matrix IEEE Trans. Pattern Anal. Mach. Intell. 19 2 1997 133 135
46. U. Nowak, L. Weimann, A family of Newton codes for systems of highly nonlinear equations, Tech. Rep. 91-10, Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB), 1991. Available from: < http://www.zib.de/ >
47. J.-Y. Bouguet, Camera calibration toolbox for Matlab. Available from: < http://www.vision.caltech.edu/bouguetj/calib_doc/ > [Accessed on 1 Dec. 2004] (2004)
48. A. Fitzgibbon, A. Zisserman, Automatic 3D model acquisition and generation of new images from video sequences, in: Proc. EUSIPCO '98, 1998, pp. 1261-1269
49. M. Lourakis, A. Argyros, The design and implementation of a generic sparse bundle adjustment software package based on the Levenberg-Marquardt algorithm, Tech. Rep. 340, Institute of Computer Science-FORTH, Heraklion, Crete, Greece, 2004. Available with source code from: < http://www.ics.forth. gr/~lourakis/sba >
50. Discreet (Autodesk Inc.), 3ds max. Available from: < http://www.discreet.com/3dsmax > [Accessed on 8 Jul. 2004] (2004)
51. J. Fung, S. Mann, Computer vision signal processing on graphics processing units, in: Proc. ICASSP'04, 2004, pp. 93-96
52. M. Pollefeys, F. Verbiest, L.V. Gool, Surviving dominant planes in uncalibrated structure and motion recovery, in: Proc. ECCV'00, vol. 2, 2002, pp. 837-851
53. K. Cornelis, F. Verbiest, and L.V. Gool Drift detection and removal for sequential structure from motion algorithms IEEE Trans. Pattern Anal. Mach. Intell. 26 10 2004 1249 1259