Counting everyday objects in everyday scenes

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 4428-4437

  Chattopadhyay, Prithvijit ^a   Vedantam, Ramakrishna ^a   Selvaraju, Ramprasaath R ^a   Batra, Dhruv ^b   Parikh, Devi ^b  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; OBJECT DETECTION; OBJECT RECOGNITION; SECURITY SYSTEMS;

DIVIDE AND CONQUER; NATURAL SCENES; OBJECT CLASS; PROOF OF CONCEPT; QUESTION ANSWERING; RESTRICTED-DOMAIN; SURVEILLANCE VIDEO;

PATTERN RECOGNITION;

EID: 85043790150     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.471     Document Type: Conference Paper

References (46)

1. A. Agrawal, D. Batra, and D. Parikh. Analyzing the behavior of visual question answering models. CoRR, abs/1606.07356, 2016.
2. S. Antol, A. Agrawal, J. Lu, M. Mitchell, D. Batra, C. L. Zitnick, and D. Parikh. VQA: visual question answering. In 2015 IEEE International Conference on Computer Vision, ICCV 2015, Santiago, Chile, December 7-13, 2015, pages 2425-2433, 2015.
3. C. Arteta, V. Lempitsky, and A. Zisserman. Counting in the wild. In European Conference on Computer Vision, 2016.
4. J. Carreira, R. Caseiro, J. Batista, and C. Sminchisescu. Semantic segmentation with second-order pooling. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 7578 LNCS, pages 430-443, 2012.
5. A. B. Chan and N. Vasconcelos. Privacy preserving crowd monitoring: Counting people without people models or tracking. In 2008 IEEE Conference on Computer Vision and Pattern Recognition, pages 1-7. IEEE, 6 2008.
6. A. B. Chan and N. Vasconcelos. Bayesian poisson regression for crowd counting. In 2009 IEEE 12th International Conference on Computer Vision, pages 545-551. IEEE, 9 2009.
7. P. Chattopadhyay, R. Vedantam, R. S. Ramprasaath, D. Batra, and D. Parikh. Counting everyday objects in everyday scenes. CoRR, abs/1604.03505, 2016.
8. D. H. Clements. Subitizing: What is it? why teach it? Teaching children mathematics, 5(7):400, 1999.
9. R. Collobert, K. Kavukcuoglu, and C. Farabet. Torch7: A matlab-like environment for machine learning. In BigLearn, NIPS Workshop, 2011.
10. S. Cutini and M. Bonato. Subitizing and visual shortterm memory in human and non-human species: a common shared system? Frontiers in Psychology, 3, 2012.
11. S. Dehaene, V. Izard, E. Spelke, and P. Pica. Log or linear? distinct intuitions of the number scale in western and amazonian indigene cultures. Science, 320(5880):1217-1220, 2008.
12. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell. Decaf: A deep convolutional activation feature for generic visual recognition. 10 2013.
13. M. Everingham, S. M. A. Eslami, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The pascal visual object classes challenge: A retrospective. International Journal of Computer Vision, 111(1):98-136, Jan. 2015.
14. P. Felzenszwalb, D. McAllester, and D. Ramanan. A discriminatively trained, multiscale, deformable part model. In 26th IEEE Conference on Computer Vision and Pattern Recognition, CVPR, 2008.
15. A. Fukui, D. H. Park, D. Yang, A. Rohrbach, T. Darrell, and M. Rohrbach. Multimodal compact bilinear pooling for visual question answering and visual grounding. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, Austin, Texas, USA, November 1-4, 2016, pages 457-468, 2016.
16. F. Galton. One Vote, One Value. 75:414, Feb. 1907.
17. S. Gidaris and N. Komodakis. Object detection via a multiregion and semantic segmentation-aware cnn model. In Proceedings of the IEEE International Conference on Computer Vision, pages 1134-1142, 2015.
18. R. Girshick. Fast r-cnn. In International Conference on Computer Vision (ICCV), 2015.
19. H. Idrees, I. Saleemi, C. Seibert, and M. Shah. Multi-source multi-scale counting in extremely dense crowd images. In Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, CVPR '13, pages 2547-2554, Washington, DC, USA, 2013. IEEE Computer Society.
20. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proceedings of The 32nd International Conference on Machine Learning, pages 448-456, 2015.
21. D. B. Jiasen Lu, Xiao Lin and D. Parikh. Deeper lstm and normalized cnn visual question answering model. https://github.com/VT-vision-lab/VQA-LSTM-CNN, 2015.
22. J. Johnson, B. Hariharan, L. van der Maaten, L. Fei-Fei, C. L. Zitnick, and R. Girshick. CLEVR: A diagnostic dataset for compositional language and elementary visual reasoning. In CVPR, 2017.
23. S. Kazemzadeh, V. Ordonez, M. Matten, and T. L. Berg. Referit game: Referring to objects in photographs of natural scenes. In EMNLP, 2014.
24. D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. CoRR, abs/1412.6980, 2014.
25. A. Klein and P. Starkey. Universals in the development of early arithmetic cognition. New Directions for Child and Adolescent Development, 1988(41):5-26, 1988.
26. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, pages 1097-1105, 2012.
27. V. Lempitsky and A. Zisserman. Learning To Count Objects in Images. In Advances in Neural Information Processing Systems, pages 1324-1332, 2010.
28. T. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick. Microsoft COCO: Common objects in context. In ECCV, 2014.
29. W. Liu, D. Anguelov, D. Erhan, C. Szegedy, and S. E. Reed. SSD: single shot multibox detector. CoRR, abs/1512.02325, 2015.
30. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3431-3440, 2015.
31. M. Malinowski, M. Rohrbach, and M. Fritz. Ask your neurons: A neural-based approach to answering questions about images. In Proceedings of the IEEE International Conference on Computer Vision, pages 1-9, 2015.
32. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed Representations of Words and Phrases and their Compositionality. In Advances in Neural Information Processing Systems, pages 3111-3119, 2013.
33. D. Oñoro Rubio and R. J. López-Sastre. Towards perspective-free object counting with deep learning. In ECCV, 2016.
34. J. Redmon, S. Divvala, R. Girshick, and A. Farhadi. You only look once: Unified, real-time object detection. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016.
35. M. Ren, R. Kiros, and R. Zemel. Exploring models and data for image question answering. In Advances in Neural Information Processing Systems, pages 2953-2961, 2015.
36. M. Ren and R. S. Zemel. End-to-end instance segmentation and counting with recurrent attention. CoRR, abs/1605.09410, 2016.
37. S. Ren, K. He, R. Girshick, and J. Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. In C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett, editors, Advances in Neural Information Processing Systems 28, pages 91-99. Curran Associates, Inc., 2015.
38. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision (IJCV), 115(3):211-252, 2015.
39. A. Sadovnik, A. C. Gallagher, and T. Chen. It's not polite to point: Describing people with uncertain attributes. In CVPR, pages 3089-3096. IEEE, 2013.
40. M. Schuster and K. K. Paliwal. Bidirectional recurrent neural networks. IEEE Trans. Signal Processing, 45:2673-2681, 1997.
41. S. Seguí, O. Pujol, and J. Vitrià. Learning to count with deep object features. may 2015.
42. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. 9 2014.
43. P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features.computer Vision and Pattern Recognition (CVPR), 1:I-511-I-518, 2001.
44. L. Wan, D. Eigen, and R. Fergus. End-to-end integration of a convolution network, deformable parts model and nonmaximum suppression. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 851-859, 2015.
45. C. Zhang, H. Li, X.Wang, and X. Yang. Cross-Scene Crowd Counting via Deep Convolutional Neural Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 833-841, 2015.
46. J. Zhang, S. Ma, M. Sameki, S. Sclaroff, M. Betke, Z. Lin, X. Shen, B. Price, and R. M?ech. Salient object subitizing. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.