Semantic parsing of street scenes from video

International Journal of Robotics Research

Volumn 31, Issue 4, 2012, Pages 484-497

  Micusik, Branislav ^a   Košecká, Jana ^b   Singh, Gautam ^b  

^a AIT AUSTRIAN INSTITUTE OF TECHNOLOGY   (Austria)

^b George Mason University   (United States)

Author keywords

navigation; recognition; segmentation; Semantic mapping

Indexed keywords

BENCHMARK DATASETS; CO-OCCURRENCE; CONTEXTUAL CUE; ENCOUNTERED OBJECTS; EXPLICIT MODELS; GLOBAL SEGMENTATION; INTERMEDIATE IMAGE; PROBABILISTIC FRAMEWORK; RECOGNITION; ROBOT INTERACTIONS; SCENE IMAGE; SEMANTIC MAPPING; SEMANTIC MODEL; SEMANTIC PARSING; SEMANTIC SEGMENTATION; SUPERPIXELS; VISUAL VOCABULARIES; VISUAL WORD;

BENCHMARKING; HUMAN ROBOT INTERACTION; NAVIGATION; SEMANTICS;

IMAGE SEGMENTATION;

EID: 84859563273     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364912437903     Document Type: Article

References (45)

1. Berg A, Grabler F, Malik J. Parsing images of architectural scenes. Proceedings of the International Conference on Computer Vision ; 2007 ; 2007..
2. Blake A, Rother C, Brown M, Perez P, Torr P. Interactive image segmentation using an adaptive GMMRF model. Proceedings of the European Computer Vision Conference ; 2004 ; 2004..
3. Brostow G, Fauqueur J, Cipolla R. Semantic object classes in video: A high-definition ground truth database. Pattern Recognition Letters. 2009 ; 30 (2). 88-97
4. Brostow G, Shotton J, Fauqueur J, Cipolla R. Segmentation and recognition using structure from motion point clouds. Proceedings of the European Computer Vision Conference ; 2008 ; 2008. 44.
5. Chandraker M, Lim J, Kriegman D. Moving in stereo: Efficient structure and motion using lines. Proceedings of the International Conference on Computer Vision ; 2009 ; 2009..
6. Cummins M, Newman P. FAB-MAP: probabilistic localization and mapping in the space of appearance. The International Journal of Robotics Research. 2008 ; 27: 647-665
7. Davison A, Reid I, Molton N, Stasse O. Monoslam: Real-time single camera SLAM. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2007 ; 29: 1052-1067 (Pubitemid 46667415)
8. Deng H, Zhang W, Mortensen E, Dietterich T, Shapiro L. Principal curvature-based region detector for object recognition. IEEE Conference on Computer Vision and Pattern Recognition ; 2007 ; 2007. 1.
9. Douillard B, Fox D, Ramos F, Durrant-Whyte H. Classification and semantic mapping of urban environments. The International Journal of Robotics Research. 2011 ; 30: 5-32
10. Felzenszwalb P, Huttenlocher D. Efficient graph-based image segmentation. International Journal on Computer Vision. 2004 ; 59: 167-181
11. Fulkerson B, Vedaldi A, Soatto S. Localizing objects with smart dictionaries. Proceedings of the European Computer Vision Conference ; 2008 ; 2008. 179.
12. Gould S, Rodgers J, Cohen D, Elidan G, Koller D. Multi-class segmentation with relative location prior. International Journal on Computer Vision. 2008 ; 80: 300-316
13. Kohli P, Ladicky L, Torr P. Robust higher order potentials for enforcing label consistency. IEEE Conference on Computer Vision and Pattern Recognition ; 2008 ; 2008..
14. Konolige K, Colander M, Bowman J, Michelich P, Chen J, Fua P, et al. View-based maps. Proceedings of Robotics Science and Systems. 2009 ;:
15. Ladicky L, Sturgess P, Russell C, Sengupta S, Bastanlar Y, Clocksin W, et al. Joint optimisation for object class segmentation and dense stereo reconstruction. Proceedings of the British Machine Vision Conference ; 2010 ; 2010..
16. Lepetit V, Fua P. Keypoint recognition using randomized trees. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2006 ; 28: 1465-1479 (Pubitemid 44132652)
17. Lowe D. Distinctive image features from scale-invariant keypoints. International Journal on Computer Vision. 2004 ; 60 (2). 91-110
18. Martin D, Fowlkes C, Malik J. Learning to detect natural image boundaries using local brightness, color and texture cues. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2004 ; 26: 530-549
19. Martnez-Mozos O, Triebel R, Jensfelt P, Rottmann A, Burgard W. Supervised semantic labeling of places using information extracted from sensor data. Robotics and Autonomous Systems. 2007 ; 55: 391-402 (Pubitemid 46601832)
20. Matas J, Chum O, Urban M, Pajdla T. Robust wide baseline stereo from maximally stable extremal regions. Proceedings of the British Machine Vision Conference ; 2002 ; 2002. 384.
21. Mori G. Guiding model search using segmentation. Proceedings of the 10th International Conference on Computer Vision ; 2005 ; 2005. 1417.
22. Nistér D, Stewénius H. Scalable recognition with a vocabulary tree. IEEE Conference on Computer Vision and Pattern Recognition ; 2006 ; 2006. 2161.
23. Oliva A, Torralba A. Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal on Computer Vision. 2001 ; 42: 145-175 (Pubitemid 32680801)
24. Philbin J, Chum O, Isard M, Sivic J, Zisserman A. Object retrieval with large vocabularies and fast spatial matching. IEEE Conference on Computer Vision and Pattern Recognition ; 2007 ; 2007..
25. Posner I, Cummins M, Newman P. Fast probabilistic labeling of city maps. Robotics Science and Systems. 2008a ;:
26. Posner I, Cummins M, Newman P. A generative framework for fast urban labeling using spatial and temporal context. Autonomous Robots. 2008b ; 27: 647-665
27. Posner I, Schröter D, Newman PM. Describing composite urban workspaces. IEEE Conference on Robotics and Automation ; 2007 ; 2007. 4962.
28. Rabinovich A, Vedaldi A, Galleguillos C, Wiewiora E, Belongie S. Objects in context. Proceedings of the International Conference on Computer Vision ; 2007 ; 2007..
29. Rohan P, Newman P. FAB-MAP 3D: topological mapping with spatial and visual appearance. IEEE Conference on Robotics and Automation ; 2010 ; 2010..
30. Russell B, Torralba A, Liu C, Fergus R. Learning hierarchical models of scenes, objects, and parts. Proceedings of the International Conference on Computer Vision ; 2005 ; 2005..
31. Russell B, Torralba A, Liu C, Fergus R. Object recognition by scene alignment. NIPS. 2007 ;:
32. Savarese S, Winn J, Criminisi A. Discriminative object class models of appearance and shape by correlatons. IEEE Conference on Computer Vision and Pattern Recognition ; 2006 ; 2006. 2033.
33. Se S, Lowe D, Little J. Mobile robot localization and mapping with uncertainty using scale-invariant features. The International Journal of Robotics Research. 2002 ; 21: 735-758
34. Shi J, Malik J. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2000 ; 22: 888-905
35. Shotton J, Johnson M, Cipolla R. Semantic texton forests for image categorization and segmentation. IEEE Conference on Computer Vision and Pattern Recognition ; 2008 ; 2008. 1.
36. Shotton J, Winn J, Rother C, Criminisi A. Textonboost for image understanding: Multi-class object recognition and segmentation by jointly modeling texture, layout, and context. International Journal on Computer Vision. 2009 ; 81: 2-23
37. Sivic J, Russell B, Efros A, Zisserman A, Freeman W. Discovering object categories in image collections. Proceedings of the International Conference on Computer Vision ; 2005 ; 2005..
38. Sivic J, Zisserman A. Video Google: A text retrieval approach to object matching in videos. Proceedings of the International Conference on Computer Vision ; 2003 ; 2003. 1470.
39. Stachniss C, Martinez-Mozos O, Rottman A, Burgard W. Semantic labeling of places. ISRR. 2005 ;:
40. Sturgess P, Alahari K, Ladicky L, Torr PHS. Combining appearance and structure from motion features for road scene understanding. Proceedings of the British Machine Vision Conference ; 2009 ; 2009..
41. VedaldiAFulkersonB (2008) VLFeat: An open and portable library of computer vision algorithms. http://www.vlfeat.org/.
42. Werner T. A linear programming approach to Max-sum problem: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2007 ; 29: 1165-1179 (Pubitemid 46825067)
43. Wildenauer H, Micusik B, Vinze M. Efficient texture representation using multi-scale regions. Proceedings of the Asian Computer Vision Conference ; 2007 ; 2007. 65.
44. Xiao J, Quan L. Multiple view semantic segmentation for street view images. Proceedings of the International Conference on Computer Vision ; 2009 ; 2009. 1.
45. Zhang Z, Jia Z, Chen T. Image retrieval with geometry preserving visual phrases. IEEE CVPR. 2011 ;: