Sensor fusion-based vacant parking slot detection and tracking

IEEE Transactions on Intelligent Transportation Systems

Volumn 15, Issue 1, 2014, Pages 21-36

  Suhr, Jae Kyu ^a   Jung, Ho Gi ^a  

^a Hanyang University   (South Korea)

Author keywords

Around View Monitor (AVM); in vehicle motion sensor; occupancy classification; parking assist system; parking slot marking detection and tracking; ultrasonic sensor

Indexed keywords

EID: 84894082813     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2013.2272100     Document Type: Article

References (54)

1. S. Hiramatsu, A. Hibi, Y. Tanaka, T. Kakinami, Y. Iwata, and M. Nakamura, "Rearview camera based parking assist system with voice guidance," presented at the Proc. SAE World Congr. Exhib., Detroit, MI, USA, Apr. 2002, Paper 2002-01-0759.
2. M. Furutani, "Obstacle detection systems for vehicle safety," presented at the Proc. SAE Converg. Int. Congr. Expo. Transp. Electron., Detroit, MI, USA, Oct. 2004, Paper 2004-21-0057.
3. Y. Kageyama, Look, No Hand! New Toyota Parks Itself, Jan. 14, 2004. [Online]. Available: http://www.cnn.com/
4. H. G. Jung, C. G. Choi, P. J. Yoon, and J. Kim, "Novel user interface for semi-automatic parking assistance system," in Proc. 31st FISITA World Autom. Congr., Oct. 2006, pp. 1-10.
5. H. Satonaka,M. Okuda, S. Hayasaka, T. Endo, Y. Tanaka, and T. Yoshida, "Development of parking space detection using an ultrasonic sensor," in Proc. 13th World Congr. Intell. Transp. Syst. Serv., Oct. 2006, pp. 1-10.
6. P. Degerman, J. Pohl, and M. Sethson, "Hough transform for parking space estimation using long range ultrasonic sensors," presented at the Proc. SAE World Congr. Exhib., Detroit, MI, USA, Apr. 2006, Paper 2006-01-0810.
7. W. J. Park, B. S. Kim, D. E. Seo, D. S. Kim, and K. H. Lee, "Parking space detection using ultrasonic sensor in parking assistance system," in Proc. IEEE Intell. Veh. Symp., Jun. 2008, pp. 1039-1044.
8. S. H. Jeong, C. G. Choi, J. N. Oh, P. J. Yoon, B. S. Kim, M. Kim, and K. H. Lee, "Low cost design of parallel parking assist system based on an ultrasonic sensor," Int. J. Autom. Technol., vol. 11, no. 3, pp. 409-416, Jun. 2010.
9. Ford 2013 TAURUS. [Accessed: Mar. 2013]. [Online]. Available: http://www.ford.com/cars/taurus/features/#page=Feature18
10. BMW 7 Series Sedan. [Accessed: Mar. 2013]. [Online]. Available: http://www.bmw.com/com/en/newvehicles/7series/sedan/2012/showroom/convenience/ park-assistant.html
11. Lexus 2013 LS. [Accessed: Mar. 2013]. [Online]. Available: http://www. lexus.com/models/LS/features/
12. Hyundai 2013 AZERA (GRANDEUR). [Accessed: Mar. 2013]. [Online]. Available: http://www.hyundai.com/kr/showroom.do?carCd1=RD014
13. A. Hashizume, S. Ozawa, and H. Yanagawa, "An approach to detect vacant parking space in a parallel parking area," in Proc. 5th Eur. Congr. Exhib. Intell. Transp. Syst. Serv., Jun. 2005, pp. 1-5.
14. C. Vestri, S. Bougnoux, R. Bendahan, K. Fintzel, S. Wybo, F. Abad, and T. Kakinami, "Evaluation of a vision-based parking assistance system," in Proc. 8th Int. IEEE Conf. Intell. Transp. Syst., Sep. 2005, pp. 131-135.
15. J. K. Suhr, H. G. Jung, K. Bae, and J. Kim, "Automatic free parking space detection by using motion stereo-based 3D reconstruction," Mach. Vis. Appl., vol. 21, no. 2, pp. 163-176, Feb. 2010.
16. C. Unger, E. Wahl, and S. Ilic, "Parking assistance using dense motionstereo: Real-time parking slot detection, collision warning and augmented parking," Mach. Vis. Appl., to be published.
17. N. Kaempchen, U. Franke, and R. Ott, "Stereo vision based pose estimation of parking lots using 3-D vehicle models," in Proc. IEEE Intell. Veh. Symp., Jun. 2002, pp. 459-464.
18. H. G. Jung, D. S. Kim, P. J. Yoon, and J. H. Kim, "3D vision system for the recognition of free parking site location," Int. J. Autom. Technol., vol. 7, no. 3, pp. 361-367, May 2006. (Pubitemid 43966790)
19. H. G. Jung, D. S. Kim, and J. Kim, "Light stripe projection-based target position designation for intelligent parking-assist system," IEEE Trans. Intell. Transp. Syst., vol. 11, no. 4, pp. 942-953, Dec. 2010.
20. F. Abad, R. Bendahan, S. Wybo1, S. Bougnoux, C. Vestri, and T. Kakinami, "Parking space detection," in Proc. 14thWorld Congr. Intell. Transp. Syst., Oct. 2007, pp. 1-8.
21. H. G. Jung, Y. H. Cho, P. J. Yoon, and J. Kim, "Scanning laser radarbased target position designation for parking aid system," IEEE Trans. Intell. Transp. Syst., vol. 9, no. 3, pp. 406-424, Sep. 2008.
22. J. Zhou, L. E. Navarro-Serment, and M. Hebert, "Detection of parking spots using 2D range data," in Proc. 15th Int. IEEE Conf. Intell. Transp. Syst., Sep. 2012, pp. 1280-1287.
23. S. Görner and H. Rohling, "Parking lot detection with 24 GHz radar sensor," in Proc. 3rd Int. Workshop Intell. Transp., Mar. 2006, pp. 1-6.
24. M. R. Schmid, S. Ates, J. Dickmann, F. Hundelshausen, and H. J. Wuensche, "Parking space detection with hierarchical dynamic occupancy grids," in Proc. IEEE Intell. Veh. Symp., Jun. 2011, pp. 254-259.
25. U. Scheunert, B. Fardi, N. Mattern, G. Wanielik, and N. Keppeler, "Free space determination for parking slots using a 3D PMD sensor," in Proc. IEEE Intell. Veh. Symp., Jun. 2007, pp. 154-159.
26. H. G. Jung, D. S. Kim, P. J. Yoon, and J. Kim, "Structure analysis based parking slot marking recognition for semi-automatic parking system," in Proc. Lect. Notes Comput. Sci., Aug. 2006, vol. 4109, pp. 384-393. (Pubitemid 44543128)
27. H. G. Jung, Y. H. Lee, and J. Kim, "Uniform user interface for semiautomatic parking slot marking recognition," IEEE Trans. Veh. Technol., vol. 59, no. 2, pp. 616-626, Feb. 2010.
28. J. Xu, G. Chen, and M. Xie, "Vision-guided automatic parking for smart car," in Proc. IEEE Intell. Veh. Symp., Oct. 2000, pp. 725-730. (Pubitemid 32135753)
29. H. G. Jung, D. S. Kim, P. J. Yoon, and J. Kim, "Parking slot markings recognition for automatic parking assist system," in Proc. IEEE Intell. Veh. Symp., Jun. 2006, pp. 106-113.
30. Y. Tanaka, M. Saiki, M. Katoh, and T. Endo, "Development of image recognition for a parking assist system," in Proc. 14th World Congr. Intell. Transp. Syst. Serv., Oct. 2006, pp. 1-7.
31. J. K. Suhr and H. G. Jung, "Full-automatic recognition of various parking slot markings using a hierarchical tree structure," Opt. Eng., vol. 52, no. 3, pp. 037203-1-037203-14, Mar. 2013.
32. M. Y. I. Idris, Y. Y. Leng, E. M. Tamil, N. M. Noor, and Z. Razk, "Car park system: A review of smart parking system and its technology," Inf. Technol. J., vol. 8, no. 2, pp. 101-113, 2009.
33. G. Yan, W. Yang, D. B. Rawat, and S. Olariu, "SmartParking: A secure and intelligent parking system," IEEE Trans. Intell. Transp. Syst. Mag., vol. 3, no. 1, pp. 18-30, Spring 2011.
34. Y. Suzuki, M. Koyamaishi, T. Yendo, T. Fujii, and M. Tanimoto, "Parking assistance using multi-camera infrastructure," in Proc. IEEE Intell. Veh. Symp., Jun. 2005, pp. 106-111. (Pubitemid 44055110)
35. M. Wada, K. S. Yoon, and H. Hashimoto, "Development of advanced parking assistance system," IEEE Trans. Ind. Electron., vol. 50, no. 1, pp. 4-17, Feb. 2003.
36. M. Wada, X. Mao, H. Hashimoto, M. Mizutani, and M. Saito, "iCAN: Pursuing technology for near-future ITS," IEEE Intell. Syst., vol. 19, no. 1, pp. 18-23, Jan./Feb. 2004.
37. K. An, J. Choi, and D. Kwak, "Automatic valet parking system Incorporating a Nomadic device and parking servers," in Proc. IEEE Int. Conf. Consum. Electron., Jan. 2011, pp. 111-112.
38. K. Sung, J. Choi, and D. Kwak, "Vehicle control system for automatic valet parking with infrastructure sensors," in Proc. IEEE Int. Conf. Consum. Electron., Jan. 2011, pp. 567-568.
39. V-Charge: Autonomous Valet Parking and Charging for e-Mobility. [Accessed: Mar. 2013]. [Online]. Available: http://www.v-charge.eu/
40. Nissan-Around View Monitor System. [Accessed: Mar. 2013]. [Online]. Available: http://www.nissan-global.com/EN/TECHNOLOGY/OVERVIEW/avm.html
41. Honda-Multi-View Camera System. [Accessed: Mar. 2013]. [Online]. Available: http://world.honda.com/news/2008/4080918Multi-View-Camera-System
42. BMW-Surround View System. [Accessed: Mar. 2013]. [Online]. Available: http://www.bmw.com/com/en/insights/technology/connecteddrive/2010/convenience/ parking/surround-view-information.html
43. Hyundai Mobis-Around View Monitoring System. [Accessed: Mar. 2013]. [Online]. Available: http://www.mobis.co.kr/Eng/PR/News/View. aspx?idx=219
44. J. K. Suhr and H. G. Jung, "Fully-automatic recognition of various parking slot markings in Around View Monitor (AVM) image sequences," in Proc. 15th Int. IEEE Conf. Intell. Transp. Syst., Sep. 2012, pp. 1294-1299.
45. C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. 4th Alvey Vis. Conf., Sep. 1988, pp. 147-151.
46. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 2003.
47. J. C. Gower and G. B. Dijksterhuis, Procrustes Problems. NewYork, NY, USA: Oxford Univ. Press, 2004.
48. R. C. Gonzalez and R. E. Woods, Digital Image Processing, 3rd ed. Englewood Cliffs, NJ, USA: Prentice-Hall, 2008.
49. M. Fischler and R. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, Jun. 1981. (Pubitemid 12444102)
50. R. J. Radke, S. Andra, O. Al-Kofahi, and B. Roysam, "Image change detection algorithms: A systematic survey," IEEE Trans. Image Process., vol. 14, no. 3, pp. 294-307, Mar. 2005. (Pubitemid 40351907)
51. A. K. Jain, K. Nandakumar, and A. Ross, "Score normalization in multimodal biometric systems," Pattern Recognit., vol. 38, no. 12, pp. 2270-2285, Dec. 2005. (Pubitemid 41336698)
52. S. Thrun, W. Burgard, and D. Fox, Probabilistic Robotics. Cambridge, MA, USA: MIT Press, 2005.
53. B. Stenger, A. Thayananthan, P. H. S. Torr, and R. Cipolla, "Model-based hand tracking using a hierarchical bayesian filter," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1372-1384, Sep. 2006. (Pubitemid 44132645)
54. R. Rajamani, Vehicle Dynamics and Control, 2nd ed. New York, NY, USA: Springer-Verlag, 2012.