Improved scene identification and object detection on egocentric vision of daily activities

Computer Vision and Image Understanding

Volumn 156, Issue , 2017, Pages 92-103

  Vaca Castano, Gonzalo ^a   Das, Samarjit ^b   Sousa, Joao P ^b   Lobo, Niels D ^a   Shah, Mubarak ^a  

^a UNIVERSITY OF CENTRAL FLORIDA   (United States)

^b ROBERT BOSCH GMBH   (Germany)

Author keywords

First camera person vision; Object detection; Scene classification; Scene understanding

Indexed keywords

LONG SHORT-TERM MEMORY; OBJECT RECOGNITION;

ACTIVITIES OF DAILY LIVING; INTRINSIC CHARACTERISTICS; OBJECT DETECTION METHOD; PUBLIC DATASET; SCENE CLASSIFICATION; SCENE IDENTIFICATIONS; SCENE UNDERSTANDING; VISUAL APPEARANCE;

OBJECT DETECTION;

EID: 84993939773     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2016.10.016     Document Type: Article

References (47)

1. Andriyenko, A., Schindler, K., Multi-target tracking by continuous energy minimization. CVPR, 2011.
2. Boykov, Y., Kolmogorov, V., An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern. Anal. Mach. Intell. 26:9 (2004), 1124–1137.
3. Boykov, Y., Veksler, O., Zabih, R., Efficient approximate energy minimization via graph cuts. IEEE Trans. Pattern. Anal. Mach. Intell. 20:12 (2001), 1222–1239.
4. Carbonetto, P., de Freitas, N., Barnard., K., A statistical model for general contextual object recognition. ECCV, 2004.
5. Cheng, M.-M., Zhang, Z., Lin, W.-Y., Torr, P., Bing: Binarized normed gradients for objectness estimation at 300fps. CVPR, 2014.
6. Csurka, G., Dance, C., Fan, L., Willamowski, J., Bray, C., Visual categorization with bags of keypoints. ECCV Workshop on Statistical Learning in Computer Vision., 2004.
7. Divvala, S.K., Hoiem, D., Hays, J.H., Efros, A.A., Hebert, M., An empirical study of context in object detection. CVPR, 2009.
8. Everingham, M., Eslami, S.M.A., Gool, L.V., Williams, C.K.I., Winn, J., Zisserman, A., The pascal visual object classes challenge a retrospective. Int. J. Comput. Vis., 2014.
9. Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A., The pascal visual object classes (voc) challenge. Int. J. Comput. Vis. 88 (2010), 303–338.
10. Fathi, A., Ren, X., Rehg, J.M., Learning to recognize objects in egocentric activities. CVPR, 2011.
11. Felzenszwalb, P., Girshick, R., McAllester, D., Ramanan, D., Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell., 32(9), 2010.
12. Forsyth, D., Malik, J., Fleck, M., Greenspan, H., L.T., Belongie, S., Carson, C., Bregler, C., Finding pictures of objects in large collections of images. Object Representation in Computer Vision, 1996.
13. Girshick, R., Fast r-cnn. International Conference on Computer Vision (ICCV), 2015.
14. Girshick, R., Donahue, J., Darrell, T., Malik, J., Rich feature hierarchies for accurate object detection and semantic segmentation. CVPR, 2014.
15. Gong, Y., Wang, L., Guo, R., Lazebnik, S., Multi-scale orderless pooling of deep convolutional activation features. ECCV, 2014.
16. Grauman, K., Darrell, T., The pyramid match kernel: Discriminative classificationcation with sets of image features. ICCV, 2005.
17. Han, W., Khorrami, P., Paine, T.L., Ramachandran, P., Babaeizadeh, M., Shi, H., Li, J., Yan, S., Huang, T.S., Seq-NMS for Video Object Detection. Technical Report, 2016, Technical Report for Imagenet VID Competition 2015.
18. Heitz, G., Koller, D., Learning spatial context: Using stuff to find things. ECCV, 2008.
19. Hochreiter, S., Schmidhuber, J., Long short-term memory. Neural Comput. 9:8 (1997), 1735–1780.
20. Jegou, H., Douze, M., Schmid, C., Perez., P., Aggregating local descriptors into a compact image representation. CVPR, 2010.
21. Jia, Y., 2013. Caffe: an open source convolutional architecture for fast feature embedding.
22. Kolmogorov, V., Zabih, R., What energy functions can be minimized via graph cuts?. IEEE Trans Pattern Anal Mach Intell 26:2 (2004), 147–159.
23. Krizhevsky, A., Sutskever, I., Hinton, G.E., Imagenet classification with deep convolutional neural networks. NIPS, 2012.
24. Lazebnik, S., Schmid, C., Ponce, J., Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. CVPR, 2006.
25. Oliva, A., Torralba, A., The role of context in object recognition. TRENDS Cogn. Sci. 11:12 (2007), 520–527.
26. Oquab, M., Bottou, L., Laptev, I., Sivic, J., Learning and transferring mid-level image representations using convolutional neural networks. CVPR, 2014.
27. Park, D., Ramanan, D., Fowlkes, C., Multiresolution models for object detection. ECCV, 2010.
28. Perronnin, F., Dance, C., Fisher kernels on visual vocabularies for image categorization. CVPR, 2007.
29. Perronnin, F., Snchez, J., Mensink, T., Improving the fisher kernel for large-scale image classification. ECCV, 2010.
30. Pirsiavash, H., Ramanan, D., Detecting activities of daily living in first-person camera views. CVPR, 2012.
31. Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S., Cnn features off-the-shelf: An astounding baseline for recognition. CVPR DeepVision Workshop, 2014.
32. Ren, X., Philipose, M., Egocentric recognition of handled objects: Benchmark and analysis. CVPR Workshop, 2009.
33. Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A. C., Fei-Fei., L., 2014. Imagenet large scale visual recognition challenge. ArXiv: 1409.0575.
34. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., LeCun, Y., Overfeat: Integrated recognition, localization and detection using convolutional networks. ICLR, 2014.
35. Simonyan, K., Zisserman, A., Very deep convolutional networks for large-scale image recognition. ICLR, 2015.
36. Sivic, J., Zisserman, A., Video google: A text retrieval approach to object matching in videos. ICCV, 2003.
37. Song, Z., Chen, Q., Huang, Z., Hua, Y., Yan, S., Contextualizing object detection and classification. CVPR, 2010.
38. Soomro, K., Idrees, H., Shah, M., Action localization in videos through context walk. IEEE International Conference on Computer Vision, 2015.
39. Stauffer, C., Estimating tracking sources and sinks. CVPR Workshop, 4, 2003.
40. Torralba, A., Murphy, K., Freeman, W.T., Using the forest to see the trees: Object recognition in contex. Comm. of the ACM, 2010.
41. Torralba, A., Murphy, K.P., Freeman, W.T., Rubin, M.A., Context-based vision system for place and object recognition. ICCV, 2003.
42. Uijlings, J.R.R., van de Sande, K.E.A., Gevers, T., Smeulders, A.W.M., Selective search for object recognition. Int. J. Comput. Vis. 104 (2013), 154–171.
43. Vaca-Castano, G., Das, S., Sousa, J.P., Improving egocentric vision of daily activities. IEEE International Conference on Image Processing (ICIP), 2015.
44. Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., Gong, Y., Locality-constrained linear coding for image classification. CVPR, 2010.
45. Zamir, A.R., Dehghan, A., Shah, M., GMCP-Tracker: Global Multi-object Tracking Using Generalized Minimum Clique Graphs. ECCV, 2012.
46. Zhang, L., Li, Y., Nevatia, R., Global data association for multi-object tracking using network flows. CVPR, 2008.
47. Zitnick, C.L., Dollr, P., Edge boxes: Locating object proposals from edges. ECCV, 2014.