Semantic object classes in video: A high-definition ground truth database

Pattern Recognition Letters

Volumn 30, Issue 2, 2009, Pages 88-97

  Brostow, Gabriel J ^a,b   Fauqueur, Julien ^a   Cipolla, Roberto ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b ETH ZURICH   (Switzerland)

Author keywords

Label propagation; Object recognition; Semantic segmentation; Video database; Video understanding

Indexed keywords

CAMERAS; COMPUTER GRAPHICS; IMAGE ENHANCEMENT; IMAGE SEGMENTATION; INFORMATION THEORY; LABELS; METADATA; OBJECT RECOGNITION; PIXELS; SEMANTICS; THREE DIMENSIONAL; VIDEO RECORDING;

3D CAMERAS; CAMBRIDGE; COLOR VIDEO IMAGES; DO-MAINS; EXPERIMENTAL DATUMS; GROUND TRUTHS; HIGH QUALITIES; LABEL PROPAGATION; LABEL PROPAGATIONS; LABELED IMAGES; MOTION CUES; OBJECT ANALYSES; OBJECT CLASSES; PEDESTRIAN DETECTIONS; SEMANTIC CLASSES; SEMANTIC LABELS; SEMANTIC OBJECTS; SEMANTIC SEGMENTATION; SEMANTIC SEGMENTATIONS; VIDEO DATABASE; VIDEO DATABASES; VIDEO UNDERSTANDING; VISUAL OBJECTS;

DATABASE SYSTEMS;

EID: 56049086147     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2008.04.005     Document Type: Article

References (36)

1. Agarwala A., Hertzmann A., Salesin D.H., and Seitz S.M. Keyframe-based tracking for rotoscoping and animation. ACM Trans. Graphics 23 3 (2004) 584-591
2. Bileschi, S., 2006. CBCL Streetscenes: towards scene understanding in still images, Tech. Rep. MIT-CBCL-TR-2006, Massachusetts Institute of Technology. .
3. Bouguet, J.-Y., 2004. Camera Calibration Toolbox for MATLAB. .
4. Boujou, 2007. 2d3 Ltd. .
5. Burt P., Hong T., and Rosenfeld A. Segmentation and estimation of image region properties through cooperative hierarchical computation. IEEE Syst. Man Cybern. (SMC) 11 12 (1981) 802-809
6. Comaniciu D., and Meer P. Robust analysis of feature spaces: Color image segmentation. IEEE Conf. Comput. Vision Pattern Recognition (CVPR), Puerto Rico (1997) 750-755
7. Dalal, N., Triggs, B., 2005. Histograms of oriented gradients for human detection. In: IEEE Comput. Vision Pattern Recognition (CVPR).
8. Dalal, N., Triggs, B., Schmid, C., 2006. Human detection using oriented histograms of flow and appearance. In: Eur. Conf. Computer Vision (ECCV).
9. Deng Y., and Manjunath B.S. Unsupervised segmentation of color-texture regions in images and video. IEEE Trans. Pattern Anal. Machine Intell. (PAMI) (2001) 800-810
10. Efros, A.A., Berg, A.C., Mori, G., Malik, J., 2003. Recognizing action at a distance. In: IEEE Internat. Conf. Comput. Vision, Nice, France, pp. 726-733.
11. Facebook homepage, 2007. .
12. Fauqueur, J., Brostow, G., Cipolla, R., 2007. Assisted video object labeling by joint tracking of regions and keypoints. In: Interactive Comput. Vision Workshop (ICV) held with IEEE ICCV.
13. Fei-Fei L., Fergus R., and Perona P. One-shot learning of object categories. IEEE Trans. Pattern Anal. Machine Intell. (PAMI) (2006) 594-611
14. Felzenszwalb P., and Huttenlocher D. Efficient graph-based image segmentation. Internat. J. Comput. Vision (IJCV) 59 2 (2004) 167-181
15. Griffin, G., Holub, A., Perona, P., 2007. Caltech-256 object category dataset, Tech. Rep. 7694, California Institute of Technology. .
16. Hoiem, D., Efros, A.A., Hebert, M., 2006. Putting objects in perspective. In: Proc. IEEE Comput. Vision Pattern Recognition (CVPR), vol. 2, pp. 2137-2144.
17. Lazebnik, S., Schmid, C., Ponce, J., 2006. Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: IEEE Comput. Vision Pattern Recognition, vol. 2, pp. 2169-2178.
18. Leibe, B., Cornelis, N., Cornelis, K., Van Gool, L., 2007. Dynamic 3d scene analysis from a moving vehicle. In: IEEE Comput. Vision Pattern Recognition (CVPR), pp. 1-8.
19. Leung T.K., and Malik J. Representing and recognizing the visual appearance of materials using three-dimensional textons. Internat. J. Comput. Vision (IJCV) 43 1 (2001) 29-44
20. Müller, H., Marchand-Maillet, S., Pun, T., 2002. The truth about Corel - evaluation in image retrieval. In: Proc. Challenge of Image and Video Retrieval (CIVR2002).
21. Marcotegui, B., Zanoguera, F., Correia, P., Rosa, R., Marques, F., Mech, R., Wollborn, M., 1999. A video object generation tool allowing friendly user interaction. In: IEEE Internat. Conf. Image Processing (ICIP).
22. Martin, D., Fowlkes, C., Tal, D., Malik, J., 2001. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proc. Eighth IEEE Internat. Conf. Computer Vision (ICCV), vol. 2, pp. 416-423.
23. Oliva A., and Torralba A. Modeling the shape of the scene: a holistic representation of the spatial envelope. Internat. J. Comput. Vision 42 3 (2001) 145-175
24. PASCAL visual object classes challenge (VOC). .
25. Patras I., Hendriks E., and Lagendijk R. Semi-automatic object-based video segmentation with labeling of color segments. Signal Process.: Image Comm. 18 1 (2003) 51-65
26. Piroddi, R., Vlachos, T., 2002. Multiple-feature spatiotemporal segmentation of moving sequences using a rule-based approach. In: BMVC.
27. Rabinovich, A., Vedaldi, A., Galleguillos, C., Wiewiora, E., Belongie, S., in press. Objects in context. In: IEEE Internat. Conf. on Computer Vision (ICCV).
28. Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T., 2005. LabelMe: a database and web-based tool for image annotation. In: MIT AI Lab Memo AIM-2005-025.
29. Shotton, J., Winn, J., Rother, C., Criminisi, A., 2006. Textonboost: joint appearance, shape and context modeling for multi-class object recognition and segmentation. In: Eur. Conf. Comput. Vision (ECCV), Graz, Austria.
30. Smeaton A.F., Over P., and Kraaij W. Evaluation campaigns and TRECVid. MIR'06: Proc. Eighth ACM Internat. Workshop on Multimedia Information Retrieval (2006), ACM Press, New York, NY, USA 321-330
31. Snavely N., Seitz S.M., and Szeliski R. Photo tourism: exploring photo collections in 3d. SIGGRAPH Conf. Proc. (2006), ACM Press, New York, NY, USA 835-846
32. The OpenCV Library. .
33. The PETS, 2007. Benchmark dataset. .
34. Wang J., Bhat P., Colburn A., Agrawala M., and Cohen M. Interactive video cutout. ACM Trans. Graphics (SIGGRAPH) (2005) 585-594
35. Yao, B., Yang, X., Zhu, S.C., 2007. Introduction to a large-scale general purpose ground truth database: methodology, annotation tool and benchmarks. In: EMMCVPR, pp. 169-183.
36. Yuan, J., Li, J., Zhang, B., 2007. Exploiting spatial context constraints for automatic image region annotation. In: MULTIMEDIA'07: Proc. 15th Internat. Conf. on Multimedia, ACM, pp. 595-604.