Easy calibration of a blind-spot-free fisheye camera system using a scene of a parking space

IEEE Transactions on Intelligent Transportation Systems

Volumn 12, Issue 1, 2011, Pages 232-242

  Li, Shigang ^a   Hai, Ying ^a  

^a TOTTORI UNIVERSITY   (Japan)

Author keywords

Blind spot; camera pose; driving assistance; fisheye camera; vanishing point

Indexed keywords

BLIND SPOTS; CALIBRATION PATTERNS; CAMERA SYSTEMS; DRIVING ASSISTANCE; FISH-EYE CAMERAS; FISHEYE CAMERA; INTERACTIVE INTERFACES; LINE PATTERN; OVERLAPPING REGIONS; PARKING SPACES; RELATIVE POSE; VANISHING POINT;

CALIBRATION; PARKING;

CAMERAS;

EID: 79952069755     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2010.2085435     Document Type: Article

References (49)

1. A. Ansar and K. Daniilidis, "Linear pose estimation from points and lines," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 578- 589, May 2003.
2. S. Baker and S. Nayar, "A theory of catadioptric image formation," in Proc. IEEE Int. Conf. Comput. Vis., 1998, pp. 35-42.
3. J. P. Barreto and H. Araujo, "Geometric properties of central catadioptric line and images and their application in calibration," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1327-1333, Aug. 2005. (Pubitemid 41245061)
4. J. Bazin, I. Kweon, C. Demonceaux, and P. Vasseur, "A robust top-down approach for rotation estimation and vanishing points extraction by catadioptric vision in urban environment," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2008, pp. 346-353.
5. M. Brown and D. G. Lowe, "Automatic panoramic image stitching using invariant features," Int. J. Comput. Vis., vol. 74, no. 1, pp. 59-73, Aug. 2007. (Pubitemid 46673104)
6. A. Broggi, M. Bertozzi, and A. Fascioli, "Self-calibration of a stereo system for automotive applications," in Proc. IEEE Conf. Robot. Autom., 2001, pp. 3698-3703. (Pubitemid 32815436)
7. M. Bujnak, Z. Kukelova, and T. Pajdla, "A general solution to the P4P problem for camera with unknown focal length," in Proc. CVPR, 2008, pp. 1-8.
8. C. Caraffi, S. Cattani, and P. Grisleri, "Off-road and obstacle detection using decision networks and stereo vision," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 4, pp. 607-618, Dec. 2007. (Pubitemid 350231638)
9. A. Catala-Part, J. Rataj, and R. Reulke, "Self-calibration system for the orientation of a vehicle camera," in Proc. ISPR Commission V Symp. Image Eng. Vis. Metrology, 2006, pp. 68-73.
10. H. H. Chen, "Pose determination from line-to-plane correspondences: Existence condition and closed-form solutions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 6, pp. 530-541, Jun. 1991.
11. S. Y. Chen and M. M. Trivedi, "Lane tracking with omnidirectional cameras: Algorithm and evaluation," EURASIP J. Embedded Syst., vol. 2007, p. 46 972, 2007.
12. J. M. Clanton, D. M. Bevly, and A. S. Hodel, "A low-cost solution for an integrated multisensor lane departure warning system," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 1, pp. 47-59, Mar. 2009.
13. S. Coorg and S. Teller, "Spherical mosaics with quaternion and dense correlation," Int. J. Comput. Vis., vol. 37, no. 3, pp. 259-273, Jun. 2000.
14. A. Conrady, "Decentering lens system," Mon. Not. R. Astronom. Soc., vol. 79, pp. 384-390, 1919.
15. R. Danescu and S. Nedevschi, "Probabilistic lane tracking in difficult road scenarios using stereovision," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 2, pp. 272-282, Jun. 2009.
16. M. Dhome, M. Richetin, and J. T. Lapreste, "Determination of the attitude of 3D objects from a single perspective view," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 12, pp. 1265-1278, Dec. 1989. (Pubitemid 20642575)
17. T. Ehlgen, T. Pajdla, and D. Ammon, "Eliminating blinding spots for assisted driving," IEEE Trans. Intell. Transp. Syst., vol. 9, no. 4, pp. 657-665, Dec. 2008.
18. S. Esquivel, F. Woelk, and R. Koch, "Calibration of a multi-camera rig from non-overlapping views," in Proc. DAGM, F. A. Hamprecht, B. F. A. Hamprecht, Schnorr, and B. Jahne, Eds., 2007, pp. 82-91.
19. T. Gandhi and M. M. Trivedi, "Vehicle surround capture: Survey of techniques and a novel omni-video-based approach for dynamic panoramic surround maps," IEEE Trans. Intell. Transp. Syst., vol. 7, no. 3, pp. 293-308, Sep. 2006. (Pubitemid 44376116)
20. S. Hold, C. Nunn, A. Kummert, and S. Muller-Schnerders, "Efficient and robust extrinsic camera calibration procedure for lane departure warning," in Proc. Intell. Veh. Symp., 2009, pp. 382-387.
21. K. Ishikawa, K. Kobayashi, and K. Watanabe, "A lane detection method for intelligent ground vehicle competition," in Proc. SICE Annu. Conf., 2003, vol. 1, pp. 1086-1089.
22. Z. Kim, "Robust lane detection and tracking in challenging scenarios," IEEE Trans. Intell. Transp. Syst., vol. 9, no. 1, pp. 16-26, Mar. 2008. (Pubitemid 351337427)
23. S. Li, "Sky-ground representation for local scene description," in Proc. 17th ICPR, 2004, vol. 3, pp. 252-255.
24. S. Li, "Monitoring around a vehicle by a spherical image sensor," IEEE Trans. Intell. Transp. Syst., vol. 7, no. 4, pp. 541-550, Dec. 2006. (Pubitemid 44925824)
25. S. Li and K. Fukumori, "Spherical stereo for the construction of immersive VR environment," in Proc. IEEE VR Conf., 2005, pp. 217-222.
26. S. Li and T. Kitamura, "Extracting road information from a fisheye image of lane marking and stop line marking," in Proc. 16th World Congr. Exhib. Intell. Transp. Syst. Services, 2009, paper ID:3032.
27. S. Li and Y. Shimomura, "Lane marking detection by side fisheye camera," in Proc. IEEE Int. Conf. Intell. Robot Syst., 2008, pp. 541-550.
28. D. Liebowitz, A. Criminisi, and A. Zisserman, "Creating architectural models from images," in Proc. EuroGraphics, 1999, vol. 18, pp. 39-50.
29. Y. Liu, T. S. Huang, and O. D. Faugeras, "Determination of camera location from 2-D to 3-D line and point correspondences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 28-37, Jan. 1990. (Pubitemid 20653596)
30. Y. Liu, K. Lin, and Y. Chen, "Bird's-eye view vision system for vehicle surrounding monitoring," in Proc. Robvis, vol. 4931, Lecture Notes in Computer Science, G. Sommer and R. Klette, Eds., 2008, pp. 207-218.
31. M. Miksch, B. Yang, and K. Zimmermann, "Homography-based extrinsic self-calibration for cameras in automotive applications," in Proc. Workshop Intell. Transp., 2010, pp. 17-22.
32. F. Moreno-Noguer, V. Lepetit, and P. Fua, "Accurate non-iterative o(n) solution to the PnP problems," in Proc. ICCV, 2007, pp. 1-8.
33. K. Miyamoto, "Fisheye eye lens," J. Opt. Soc. Amer., vol. 54, no. 8, pp. 1060-1061, 1964.
34. M. Nakano, S. Li, and N. Chiba, "Calibrating fisheye camera by stripe pattern based upon spherical model," IEICE Trans. Inf. Syst. D, vol. J90-D, no. 1, pp. 73-82, 2007.
35. S. Nedevschi, S. Bota, and C. Tomiuc, "Stereo-based pedestrian detection for collision-avoidance applications," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 3, pp. 380-391, Sep. 2009.
36. S. Nedevschi, C. Vancea, T. Marita, and T. Graf, "Online extrinsic parameters for stereovision systems used in far-range detection vehicle applications," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 4, pp. 651-660, Dec. 2007. (Pubitemid 350231642)
37. J. A. Nelder and R.Mead, "A simplex method for minimization," Comput. J., vol. 7, pp. 308-313, 1965.
38. L. Oliveira, U. Nunes, and P. Peixoto, "On exploration of classifier ensembles synergism in pedestrian detection," IEEE Trans. Intell. Transp. Syst., vol. 11, no. 1, pp. 16-27, Mar. 2010.
39. P. Parodi and G. Piccioli, "3D shape reconstruction by using vanishing points," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 2, pp. 211- 217, Feb. 1996. (Pubitemid 126772808)
40. T. Ruland, T. Paidla, and L. Krüger, "Extrinsic autocalibration of vehicle mounted cameras for maneuvering assistance," in Proc. Comput. Vis. Winter Workshop, L. Spacek and V. Franc, Eds., 2010, pp. 44-51.
41. A. D. Sappa, F. Dornaika, D. Ponsa, D. Geronimo, and A. Lopez, "An efficient approach to onboard stereo vision system pose estimation," IEEE Trans. Intell. Transp. Syst., vol. 9, no. 3, pp. 476-490, Sep. 2008.
42. P. Smith, M. Shah, and N. da Vitoria Lobo, "Determining driving visual attention with one camera," IEEE Trans. Intell. Transp. Syst., vol. 4, no. 4, pp. 205-218, Dec. 2003.
43. R. Swaminathan and S. K. Nayar, "Nonmetric calibration of wild-angle lenses and polycameras," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, pp. 1172-1178, Oct. 2000. (Pubitemid 32066968)
44. R. Szeliski, "Image alignment and stitching: A tutorial," Found. Trends Comput. Graph. Comput. Vis., vol. 2, no. 1, pp. 1-103, 2006.
45. M. M. Trivedi, T. Gandhi, and J. McCall, "Looking-in and looking-out of a vehicle: Computer-vision-based enhanced vehicle safety," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 1, pp. 108-120, Mar. 2007. (Pubitemid 46376159)
46. G.Wang, J.Wu, and Z. Ji, "Single view based pose estimation from circle or parallel plane," Pattern Recognit. Lett., vol. 29, no. 7, pp. 977-985, May 2008.
47. Y. Wu and Z. Hu, "PnP problem revisited," J. Math. Imag. Vis., vol. 24, no. 1, pp. 131-141, Jan. 2006. (Pubitemid 43269379)
48. [Online]. Available: http://www.nissanglobal.com/EN/TECHNOLOGY/ INTRODUCTION/DETAILS/AVM/
49. [Online]. Available: http://www.skybird.ele.tottori-u.ac.jp/BSFCamera SystemTV