Multiband image segmentation and object recognition for understanding road scenes

IEEE Transactions on Intelligent Transportation Systems

Volumn 12, Issue 4, 2011, Pages 1423-1433

  Kang, Yousun ^a   Yamaguchi, Koichiro ^b   Naito, Takashi ^b   Ninomiya, Yoshiki ^b  

^a TOKYO POLYTECHNIC UNIVERSITY   (Japan)

^b Rd Management Section   (Japan)

Author keywords

Bag of textons; object recognition; road scene; semantic segmentation; vehicle environment perception

Indexed keywords

BAG-OF-TEXTONS; CONTEXTUAL INFORMATION; DRIVING ASSISTANCE SYSTEMS; MULTISCALES; NEAR INFRARED; ROAD ENVIRONMENT; ROAD SCENE; SCENE INTERPRETATION; SEGMENTATION ACCURACY; SEMANTIC SEGMENTATION; SPATIAL CONFIGURATION; SPATIAL CONTEXT; TEXTONS;

INFRARED IMAGING; OBJECT RECOGNITION; ROADS AND STREETS; SEMANTICS;

IMAGE SEGMENTATION;

EID: 82455164336     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2011.2160539     Document Type: Article

References (48)

1. T. Kato, Y. Ninomiya, and I. Masaki, "An obstacle detection method by fusion of radar and motion stereo," IEEE Trans. Intell. Transp. Syst., vol. 3, no. 3, pp. 182-188, Sep. 2002.
2. Y. Wang, L. Bai, and M. Fairhurst, "Robust road modeling and tracking using condensation," IEEE Trans. Intell. Transp. Syst., vol. 9, no. 4, pp. 570-579, Dec. 2008.
3. A. Broggi, P. Cerri, S. Ghidoni, P. Grisleri, and H. Jung, "A new approach to urban pedestrian detection for automatic braking," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 4, pp. 594-605, Dec. 2009.
4. M. Bertozzi, A. Broggi, M. Cellario, A. Fascioli, P. Lombardi, and M. Porta, "Artificial vision in road vehicles," Proc. IEEE, vol. 90, no. 7, pp. 1258-1271, Jul. 2002.
5. H. Cheng, N. Zheng, X. Zhang, J. Qin, and H. Wetering, "Interactive road situation analysis for driver assistance and safety warning systems: Framework and algorithms," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 1, pp. 157-167, Mar. 2007.
6. C. Wojek and B. Schiele, "A dynamic conditional random field model for joint labeling of object and scene classes," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 733-747.
7. G. Brostow, J. Shotton, J. Fauqueur, and R. Cipolla, "Segmentation and recognition using structure from motion point clouds," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 44-57.
8. B. Julesz, "Textons, the elements of texture perception and their interactions," Nature, vol. 290, pp. 91-97, Mar. 1981.
9. B. Luzheng, O. Tsimhoni, and L. Yili, "Using image-based metrics to model pedestrian detection performance with night-vision systems," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 1, pp. 155-164, Mar. 2009.
10. L. Bergasa, J. Nuevo, M. Sotelo, R. Barea, and M. Lopez, "Real-time system for monitoring driver vigilance," IEEE Trans. Intell. Transp. Syst., vol. 7, no. 1, pp. 63-77, Mar. 2006.
11. K. Yamada and M. Soga, "A compact integrated visual motion sensor for its applications," IEEE Trans. Intell. Transp. Syst., vol. 4, no. 1, pp. 35-42, Mar. 2003.
12. S. Maldonado-Bascon, S. Lafuente-Arroyo, P. Gil-Jimenez, H. Gomez-Moreno, and F. Lopez-Ferreras, "Road-sign detection and recognition based on support vector machines," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 2, pp. 264-278, Jun. 2007.
13. J. Shotton, J. Winn, C. Rother, and A. Criminisi, "Textonboost for image understanding: Multi-class object recognition and segmentation by jointly modeling texture, layout, and context," Int. J. Comput. Vis., vol. 81, no. 1, pp. 2-23, Jan. 2009.
14. M. Bertozzi, A. Broggi, A. Fascioli, T. Graf, and M. Meinecke, "Pedestrian detection for driver assistance using multiresolution infrared vision," IEEE Trans. Veh. Technol., vol. 53, no. 6, pp. 1666-1678, Nov. 2004.
15. N. Morris, S. Avidan, W. Matusik, and H. Pfister, "Statistics of infrared images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-7.
16. A. Broggi, R. Isabella, F. Andrea, T. Graf, and M. Meinecke, "Pedestrian detection on a moving vehicle: An investigation about near infra-red images," in Proc. IEEE Intell. Veh. Symp., 2006, pp. 431-436.
17. T. Tsuji, H. Hattori, M. Watanabe, and N. Nagaoka, "Development of night-vision system," IEEE Trans. Intell. Transp. Syst., vol. 3, no. 3, pp. 203-209, Sep. 2002.
18. N. Gobron, B. Pinty, and M. Verstraete, "Theoretical limits to the estimation of the leaf area index on the basis of visible and near-infrared remote sensing data," IEEE Trans. Geosci. Remote Sens., vol. 35, no. 6, pp. 1438-1445, Nov. 1997.
19. C. Ciamberlini, G. Innocenti, and G. Longobardi, "An optoelectronic prototype for the detection of road surface conditions," Rev. Sci. Instrum., vol. 66, no. 3, pp. 2684-2689, Mar. 1995.
20. R. Chu, S. Liao, and L. Zhang, "Illumination invariant face recognition using near-infrared images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 4, pp. 627-639, Apr. 2007.
21. J.Winn, A. Criminisi, and T. Minka, "Categorization by learned universal visual dictionary," in Proc. Int. Conf. Comput. Vis., 2005, pp. 1800-1807.
22. C. Schmid, "Constructing models for content-based image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2001, pp. II-39-II-45.
23. J. Malik, S. Belongie, T. Leung, and J. Shi, "Contour and texture analysis for image segmentation," Int. J. Comput. Vis., vol. 43, no. 1, pp. 7-27, Jun. 2001.
24. H. Du, X. Tong, X. Cao, and S. Lin, "A prism-based system for multispectral video acquisition," in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 175-182.
25. A. C. Bovik, M. Clark, and W. S. Geisler, "Multichannel texture analysis using localized spatial filters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 55-73, Jan. 1990.
26. A. K. Jain and F. Farrokhnia, "Unsupervised texture segmentation using gabor filters," Pattern Recognit., vol. 24, no. 12, pp. 1167-1189, Dec. 1991.
27. C. Pun and M. Lee, "Log-polar wavelet energy signatures for rotation and scale invariant texture classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 590-603, May 2003.
28. M. Varma and A. Zisserman, "A statistical approach to texture classification from single images," Int. J. Comput. Vis., vol. 62, no. 1/2, pp. 61-81, Apr. 2005.
29. T. Randen and J. H. Husoy, "Filtering for texture classification: A comparative study," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 4, pp. 291-310, Apr. 1999.
30. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. Data Mining, Inference, and Prediction. New York: Springer-Verlag, 2001.
31. Y. Kang, K. Kidono, T. Naito, and Y. Ninomiya, "Multiband image segmentation and object recognition using texture filter banks," in Proc. Int. Conf. Pattern Recognit., 2008, pp. 1-4.
32. G. Csurka, C. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. Workshop Stat. Learn. Comput. Vis., Prague, Czech Republic, 2004.
33. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
34. C. Harris and M. Stephens, "A combined corner and edge detection," in Proc. 4th Alvey Vis. Conf., 1988, pp. 147-151.
35. J. Beis and D. Lowe, "Shape indexing using approximate nearestneighbour search in highdimensional spaces," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 1997, pp. 1000-1006.
36. J. Shotton. [Online]. Available: http://jamie.shotton.org/work/code.html
37. X. He, R. Zemel, and M. Carreira-Perpinan, "Multiscale conditional random fields for image labeling," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, pp. II-695-II-702.
38. MSRC21, The Microsoft Research Cambridge 21 Class Database. [Online]. Available: http://research.microsoft.com/vision/cambridge/recognition/
39. T. Toyoda and O. Hasegawa, "A random field model for integration of local information and global information," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 8, pp. 1483-1489, Aug. 2008.
40. M. Varma and A. Zisserman, "A statistical approach to material classification using image patch exemplars," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 11, pp. 2032-2047, Nov. 2009.
41. A. Torralba, P. Murphy, and W. T. Freeman, "Sharing visual features for multiclass and multiview object detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 5, pp. 854-869, May 2007.
42. S. Kumar and M. Hebert, "A hierarchical field framework for unified context-based classification," in Proc. Int. Conf. Comput. Vis., 2005, pp. 1284-1291.
43. P. Kohli, L. Ladicky, and P. Torr, "Robust higher order potentials for enforcing label consistency," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
44. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001.
45. P. Felzenszwalb, D. McAllester, and D. Ramanan, "A discriminatively trained, multiscale, deformable part model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
46. B. Leibe, N. Cornelis, K. Cornelis, and V. Gool, "Dynamic 3d scene analysis from a moving vehicle," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
47. N. Cornelis, B. Leibe, K. Cornelis, and V. Gool, "3d urban scene modeling integrating recognition and reconstruction," Int. J. Comput. Vis., vol. 78, no. 2/3, pp. 121-141, Jul. 2008.
48. Y. Kang, K. Yamaguchi, T. Naito, and Y. Ninomiya, "Road scene labeling using sfm module and 3D bag of textons," in Proc. Int. IEEE Workshop 3D Represent. Recognit., 2009, pp. 657-664.