Rotation estimation and vanishing point extraction by omnidirectional vision in urban environment

International Journal of Robotics Research

Volumn 31, Issue 1, 2012, Pages 63-81

  Bazin, Jean Charles ^a   Demonceaux, Cédric ^b   Vasseur, Pascal ^c   Kweon, Inso ^d  

^a INSTITUTE OF INDUSTRIAL SCIENCE   (Japan)

^b UNIVERSITÉ DE BOURGOGNE   (France)

^c UNIVERSITÉ DE ROUEN   (France)

^d Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

catadioptric vision; omnidirectional vision; parallel lines; rotation estimation; vanishing points

Indexed keywords

3D RECONSTRUCTION; CATADIOPTRIC VISION; COMPUTATIONAL COSTS; CONTROL SOLUTIONS; DATA SETS; EXECUTION TIME; FEATURE MATCHING; FIELD OF VIEWS; FREQUENCY DOMAINS; ILLUMINATION CHANGES; INERTIAL MEASUREMENT UNIT; NAVIGATION EQUIPMENT; OMNI-DIRECTIONAL VISION; OMNIDIRECTIONAL IMAGE; ORTHOGONAL VANISHING POINTS; ORTHOGONALITY; PARALLEL LINE; ROBOTIC APPLICATIONS; TOP-DOWN APPROACH; URBAN ENVIRONMENTS; VANISHING POINT; VISION BASED;

AUTOMATION; CONTROL; ESTIMATION; MOTION ESTIMATION; ROBOTICS; THREE DIMENSIONAL; TRACKING (POSITION); UNITS OF MEASUREMENT;

ROTATION;

EID: 84856507964     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364911421954     Document Type: Article

References (66)

1. Agarwal S, Snavely N, Simon I, Seitz SM, Szeliski R. Building Rome in a day. International Conference on Computer Vision (ICCV'09) ; 2009 ; 2009..
2. Aguilera DG, Lahoz JG, Codes JF. A new method for vanishing point detection in 3D reconstruction from a single view. Proceedings of ISPRS Comission. 2005 ;: 197-210
3. Akbarzadeh A, Frahm J-M, Mordohai P, Clipp B, Engels C, Gallup D. Towards urban 3D reconstruction from video. International Symposium on 3D Data Processing Visualization and Transmission (3DPVT'06) ; 2006 ; 2006. 1.
4. Albrecht T, Tan T, West G, Ly T. Omnidirectional video stabilisation on a virtual camera using sensor fusion. International Conference on Control, Automation, Robotics and Vision (ICARCV'10) ; 2010 ; 2010..
5. Antone ME, Teller SJ. Automatic recovery of relative camera rotations for urban scenes. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'00) ; 2000 ; 2000. 282.
6. Banno A, Ikeuchi K. Omnidirectional texturing based on robust 3D registration through Euclidean reconstruction from two spherical images. Computer Vision and Image Understanding (CVIU'09). 2009 ;:
7. Barnard ST. Interpreting perspective image. Artificial Intelligence Journal. 1983 ; 21: 435-462
8. Barreto JP, Araujo H. Geometric properties of central catadioptric line images and their application in calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2005 ; 27: 1327-1333 (Pubitemid 41245061)
9. Bazin JC, Demonceaux C, Vasseur P, Kweon I. Motion estimation by decoupling rotation and translation in catadioptric vision. Computer Vision and Image Understanding (CVIU'09). 2009 ;:
10. Bazin JC, Kweon I, Demonceaux C, Vasseur P. Rectangle extraction in catadioptric images. ICCV Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras (OMNIVIS'07) ; 2007 ; 2007..
11. Bazin JC, Kweon I, Demonceaux C, Vasseur P. A robust top down approach for rotation estimation and vanishing points extraction by catadioptric vision in urban environment. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'08) ; 2008a ; 2008a..
12. Bazin JC, Kweon I, Demonceaux C, Vasseur P. Spherical region-based matching of vanishing points in catadioptric images. ECCV Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras (OMNIVIS'08) ; 2008b ; 2008b..
13. Benhimane S, Malis E. A new approach to vision-based robot control with omni-directional cameras. IEEE International Conference on Robotics and Automation (ICRA'06) ; 2006 ; 2006..
14. Bosse M, Rikoski R, Leonard J, Teller S. Vanishing points and 3D lines from omnidirectional video. The Visual Computer. 2003 ; 19: 417-430
15. Campbell J, Sukthankar R, Nourbakhsh I, Pahwa A. A robust visual odometry and precipice detection system using consumergrade monocular vision. IEEE International Conference on Robotics and Automation (ICRA'05) ; 2005 ; 2005. 3421.
16. Chang P, Hebert M. Omni-directional visual servoing for human-robot interaction. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'98) ; 1998 ; 1998. 1801.
17. Corke P, Strelow D, Singh S. Omnidirectional visual odometry for a planetary rover. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'04) ; 2004 ; 2004. 4007.
18. Coughlan J, Yuille A. The Manhattan world assumption: Regularities in scene statistics which enable Bayesian inference. NIPS. 2000 ;:
19. Coughlan J, Yuille A. Manhattan world: Orientation and outlier detection by Bayesian inference. Neural Computation (NC'03). 2003 ;:
20. Davison A. Real-time simultaneous localisation and mapping with a single camera. IEEE International Conference on Computer Vision (ICCV'03) ; 2003 ; 2003. 1403.
21. Davison A, Calway A, Mayol W. Visual SLAM. BMVC 2007 Visual SLAM Tutorial. 2007 ;:
22. Dellaert F, Seitz S, Thorpe C, Thrun S. Structure from motion without correspondence. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'00) ; 2000 ; 2000. 557.
23. Demonceaux C, Vasseur P, Pégard C. Robust attitude estimation with catadioptric vision. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'06) ; 2006 ; 2006..
24. Denis P, Elder JH, Estrada FJ. Efficient edge-based methods for estimating manhattan frames in urban imagery. Proceedings of the European Conference on Computer Vision (ECCV'08) ; 2008 ; 2008. 197.
25. Doubek P, Svoboda T. Reliable 3D reconstruction from a few catadioptric images. ECCV Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras (OMNIVIS'02) ; 2002 ; 2002. 71.
26. Ettinger SM, Nechyba MC, Ifju PG, Waszak M. Vision-guided flight stability and control for micro air vehicles. Advanced Robotics. 2003 ; 17: 617-640
27. Fischler MA, Bolles RC. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM. 1981 ; 24: 1769-1786
28. Geyer C, Daniilidis K. Catadioptric projective geometry. International Journal of Computer Vision. 2001 ; 45: 223-243
29. Hartley RI, Zisserman A Multiple View Geometry in Computer Vision. 2nd edn. Cambridge: Cambridge University Press ; 2004 :
30. Horn BKP. Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America A. 1987 ; 4: 629-642
31. Hrabar S, Sukhatme G. Omnidirectional vision for an autonomous helicopter. IEEE International Conference on Robotics and Automation (ICRA'03) ; 2003 ; 2003. 557.
32. Hrabar S, Sukhatme G. A comparison of two camera configurations for optic-flow based navigation of a UAV through urban canyons. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'04) ; 2004 ; 2004..
33. Jeong Y, Nister D, Steedly D, Szeliski R, Kweon I. Pushing the envelope of modern methods for bundle adjustment. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'10) ; 2010 ; 2010. 1474.
34. Jones E, Fulkerson B, Frazzoli E, Kumar D, Walters R, Radford J, et al. Autonomous off-road driving in the DARPA grand challenge. IEEE/ION Position, Location, And Navigation Symposium 2006 ; 2006 ; 2006. 25.
35. The vSLAM algorithm for robust localization and mapping. IEEE International Conference on Robotics and Automation (ICRA'05) ; 2005 ; 2005..
36. Kim J, Hwangbo M, Kanade T. Spherical approximation for multiple cameras in motion estimation: its applicability and advantages. Computer Vision and Image Understanding. 2010 ; 114: 1068-1083
37. Kim J-H, Hartley R, Frahm J, Pollefeys M. Visual odometry for non-overlapping views using second-order cone programming. Proceedings of the Asian Conference on Computer Vision (ACCV'07) ; 2007 ; 2007. 353.
38. Kim J-H, Li H, Hartley R. Motion estimation for multi-camera systems using global optimization. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'08) ; 2008 ; 2008..
39. Kosecka J, Zhang W. Video compass. Proceedings of European Conference on Computer Vision (ECCV'02) ; 2002 ; 2002. 657.
40. Lemaire T, Lacroix S. SLAM with panoramic vision. Journal of Field Robotics. 2007 ; 24: 1-2
41. Lhuillier M. Toward flexible 3D modeling using a catadioptric camera. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'07) ; 2007 ; 2007. 1.
42. Lobo J, Dias J. Relative pose calibration between visual and inertial sensors. The International Journal of Robotics Research. 2007 ; 26: 561-575 (Pubitemid 47011239)
43. Magee MJ, Aggarwal JK. Determining vanishing points from perspective images. Proceedings of Computer Vision, Graphics and Image Processing. 1984 ;: 256-267 (Pubitemid 14591481)
44. Makadia A, Daniilidis K. Rotation recovery from spherical images without correspondences. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2006 ; 28: 1170-1175
45. Martins A, Aguiar P, Figueiredo M. Orientation in Manhattan: Equiprojective classes and sequential estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2005 ; 27: 822-826
46. MeiC (2007) Laser-augmented Omnidirectional Vision for 3D Localisation and Mapping. PhD Thesis.
47. Mei C, Rives P. Single view point omnidirectional camera calibration from planar grids. IEEE International Conference on Robotics and Automation (ICRA'07) ; 2007 ; 2007. 3945.
48. Miuík B, Martinec D, Pajdla T. 3D metric reconstruction from uncalibrated omnidirectional images. Proceedings of the Asian Conference on Computer Vision (ACCV '04) ; 2004 ; 2004. 545.
49. Mouragnon E, Lhuillier M, Dhome M, Dekeyser F, Sayd P. Real time localization and 3D reconstruction. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06) ; 2006 ; 2006. 363.
50. Nistér D, Stewénius H. A minimal solution to the generalized 3-point pose problem. Journal of Mathematical Imaging and Vision. 2006 ; 27 (1). 67-69
51. Quan L, Mohr R. Determining perspective structures using hierarchical Hough transform. Pattern Recognition Letters. 1989 ; 9: 279-286
52. Rives P, Azinheira JR. Linear structures following by an airship using vanishing point and horizon line in a visual servoing scheme. IEEE International Conference on Robotics and Automation (ICRA'04) ; 2004 ; 2004. 255.
53. Rondon E, Garcia-Carrillo L-R, Fantoni I. Vision-based altitude, position and speed regulation of a quadrotor rotorcraft. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'10) ; 2010 ; 2010. 628.
54. Rother C. A new approach for vanishing point detection in architectural environments. Proceedings of the British Conference on Machine Vision (BMVC'00) ; 2000 ; 2000. 382.
55. Rother C. A new approach for vanishing point detection in architectural environments. Journal Image and Vision Computing. 2002 ; 20: 647-656
56. Scaramuzza D, Fraundorfer F, Siegwart R. Real-time monocular visual odometry for on-road vehicles with 1-point RANSAC. IEEE International Conference on Robotics and Automation (ICRA'09) ; 2009 ; 2009. 4293.
57. Scaramuzza D, Siegwart R. Appearance guided monocular omnidirectional visual odometry for outdoor ground vehicles. IEEE Transactions on Robotics. 2008 ; 24: 1015-1026
58. Shufelt JA. Performance evaluation and analysis of vanishing point detection techniques. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1999 ; 21: 282-288
59. Tardif J, Pavlidis Y, Daniilidis K. Monocular visual odometry in urban environments using an omnidirectional camera. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'08) ; 2008 ; 2008. 2531.
60. Torii A, Havlena M, Pajdla T. From Google street view to 3D city models. ICCV Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras (OMNIVIS'09) ; 2009 ; 2009. 2188.
61. Torii A, Havlena M, Pajdla T. Omnidirectional image stabilization for visual object recognition. International Journal of Computer Vision. 2010 ; 91 (2). 157-174
62. Wang LK, Hsieh S, Hsueh EC, Hsaio F, Huang K. Complete pose determination for low altitude unmanned aerial vehicle using stereo vision. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'05) ; 2005 ; 2005. 316.
63. Wildenauer H, Vincze M. Vanishing point detection in complex man-made worlds. International Conference on Image Analysis and Processing (ICIAP'07) ; 2007 ; 2007. 615.
64. Winters N, Gaspar J, Lacey G, Santos-Victor J. Omni-directional vision for robot navigation. ICCV Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras (OMNIVIS'00) ; 2000 ; 2000. 21.
65. Ying X, Hu Z. Can we consider central catadioptric cameras and fisheye cameras within a unified imaging model?. Proceedings of the European Conference on Computer Vision (ECCV'04) ; 2004 ; 2004. 442.
66. Zhang Q, Pless R. Extrinsic calibration of a camera and laser range finder improves camera intrinsic calibration. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'04) ; 2004 ; 2004. 2301.