Hyper-class augmented and regularized deep learning for fine-grained image classification

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 2645-2654

  Xie, Saining ^a   Yang, Tianbao ^b   Wang, Xiaoyu ^c   Lin, Yuanqing ^d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b University of Iowa   (United States)

^c SNAP INC   (United States)

^d NEC LABORATORIES AMERICA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER VISION; IMAGE RECOGNITION; NEURAL NETWORKS; OBJECT RECOGNITION; PATTERN RECOGNITION; SEARCH ENGINES;

CLASSIFICATION TASKS; CONVOLUTIONAL NEURAL NETWORK; EXTERNAL SOURCES; GENERIC OBJECT RECOGNITION; IMAGE SEARCH ENGINE; MULTITASK LEARNING; RECOGNITION MODELS; SYSTEMATIC FRAMEWORK;

IMAGE CLASSIFICATION;

EID: 84959248782     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298880     Document Type: Conference Paper

References (43)

1. C. M. Bishop et al. Pattern recognition and machine learning, volume 4. springer New York, 2006
2. L. Bourdev and J. Malik. Poselets: Body part detectors trained using 3d human pose annotations. In Computer Vision, 2009 IEEE 12th International Conference on, pages 1365-1372. IEEE, 2009
3. R. Caruana. Multitask learning. Machine learning, 28(1):41-75, 1997
4. J. Chen, L. Tang, J. Liu, and J. Ye. A convex formulation for learning shared structures from multiple tasks. In Proceedings of the 26th Annual International Conference on Machine Learning, pages 137-144. ACM, 2009
5. R. Collobert and J. Weston. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th international conference on Machine learning, pages 160-167. ACM, 2008
6. G. Csurka, C. Dance, L. Fan, J. Willamowski, and C. Bray. Visual categorization with bags of keypoints. In Workshop on statistical learning in computer vision, ECCV, volume 1, pages 1-2. Prague, 2004
7. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In Computer Vision and Pattern Recognition (CVPR), 2005 IEEE Computer Society Conference on, volume 1, pages 886-893. IEEE, 2005
8. J. Deng, N. Ding, Y. Jia, A. Frome, K. Murphy, S. Bengio, Y. Li, H. Neven, and H. Adam. Largescale object classification using label relation graphs. In Proceedings of the European Conference on Computer Vision (ECCV) 2014, pages 48-64. Springer, 2014
9. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In Computer Vision and Pattern Recognition (CVPR) 2009, IEEE Conference on, pages 248-255. IEEE, 2009
10. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell. Decaf: A deep convolutional activation feature for generic visual recognition, 2014
11. K. Duan, L. Marchesotti, and D. J. Crandall. Attributebased vehicle recognition using viewpoint-aware multiple instance svms. In Applications of Computer Vision (WACV), 2014 IEEEWinter Conference on, pages 333-338. IEEE, 2014
12. T. Evgeniou and M. Pontil. Regularized multi-task learning. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 109-117. ACM, 2004
13. A. Farhadi, I. Endres, D. Hoiem, and D. Forsyth. Describing objects by their attributes. In Computer Vision and Pattern Recognition (CVPR), 2009 IEEE Conference on, pages 1778-1785. IEEE, 2009
14. R. Farrell, O. Oza, N. Zhang, V. I. Morariu, T. Darrell, and L. S. Davis. Birdlets: Subordinate categorization using volumetric primitives and pose-normalized appearance. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 161-168. IEEE, 2011
15. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan. Object detection with discriminatively trained part-based models. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 32(9):1627-1645, 2010
16. E. Gavves, B. Fernando, C. G. Snoek, A. W. Smeulders, and T. Tuytelaars. Local alignments for finegrained categorization. International Journal of Computer Vision, pages 1-22, 2014
17. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 580-587. IEEE, 2014
18. M. S. Jonathan Krause, Jia Deng and L. Fei-Fei. Collecting a large-scale dataset of fine-grained cars. The SecondWorkshop on Fine-Grained Visual Categorization, 2013
19. C. Kanan. Fine-grained object recognition with gnostic fields. In Applications of Computer Vision (WACV), 2014 IEEEWinter Conference on, pages 23-30. IEEE, 2014
20. J. Krause, T. Gebru, J. Deng, L.-J. Li, and L. Fei-Fei. Learning features and parts for fine-grained recognition. In Pattern Recognition (ICPR), 2014 22nd International Conference on, pages 26-33. IEEE, 2014
21. J. Krause, M. Stark, J. Deng, and L. Fei-Fei. 3d object representations for fine-grained categorization. In Computer Vision Workshops (ICCVW), 2013 IEEE International Conference on, pages 554-561. IEEE, 2013
22. A. Krizhevsky and G. Hinton. Learning multiple layers of features from tiny images. Computer Science Department, University of Toronto, Tech. Rep, 1(4):7, 2009
23. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information process-ing systems (NIPS), pages 1097-1105, 2012
24. C.-H. Kuo and R. Nevatia. Robust multi-view car detection using unsupervised sub-categorization. In Ap-plications of Computer Vision (WACV), 2009 Work-shop on, pages 1-8. IEEE, 2009
25. C. H. Lampert, H. Nickisch, and S. Harmeling. Learning to detect unseen object classes by between-class attribute transfer. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 951-958. IEEE, 2009
26. C.-Y. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu. Deeply-supervised nets. In Proceedings of the In-ternational Conference on Artificial Intelligence and Statistics (AISTATS), 2015
27. M. Lin, Q. Chen, and S. Yan. Network in network. arXiv preprint arXiv:1312. 4400, 2013
28. D. G. Lowe. Distinctive image features from scaleinvariant keypoints. International journal of computer vision, 60(2):91-110, 2004
29. M. L. Seltzer and J. Droppo. Multi-task learning in deep neural networks for improved phoneme recognition. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pages 6965-6969. IEEE, 2013
30. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun. Overfeat: Integrated recognition, localization and detection using convolutional networks. arXiv preprint arXiv:1312. 6229, 2013
31. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409. 1556, 2014
32. N. Srivastava and R. R. Salakhutdinov. Discriminative transfer learning with tree-based priors. In Advances in Neural Information Processing Systems (NIPS), pages 2094-2102, 2013
33. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. arXiv preprint arXiv:1409. 4842, 2014
34. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf. Deepface: Closing the gap to human-level performance in face verification. In Computer Vision and Pat-tern Recognition (CVPR), 2014 IEEE Conference on, pages 1701-1708. IEEE, 2014
35. A. Toshev and C. Szegedy. Deeppose: Human pose estimation via deep neural networks. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Confer-ence on, pages 1653-1660. IEEE, 2014
36. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong. Locality-constrained linear coding for image classification. In Computer Vision and Pattern Recogni-tion (CVPR), 2010 IEEE Conference on, pages 3360-3367. IEEE, 2010
37. Y. Wang and G. Mori. A discriminative latent model of object classes and attributes. In Proceedings of the Eu-ropean Conference on Computer Vision (ECCV) 2010, pages 155-168. Springer, 2010
38. J. Yang, K. Yu, Y. Gong, and T. Huang. Linear spatial pyramid matching using sparse coding for image classification. In Computer Vision and Pattern Recogni-tion (CVPR), 2009 IEEE Conference on, pages 1794-1801. IEEE, 2009
39. S. Yang, L. Bo, J. Wang, and L. G. Shapiro. Unsupervised template learning for fine-grained object recognition. In Advances in Neural Information Processing Systems (NIPS), pages 3122-3130, 2012
40. B. Yao, A. Khosla, and L. Fei-Fei. Combining randomization and discrimination for fine-grained image categorization. In Computer Vision and Pat-tern Recognition (CVPR), 2011 IEEE Conference on, pages 1577-1584. IEEE, 2011
41. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In Proceedings of the European Conference on Computer Vision (ECCV) 2014, pages 818-833. Springer, 2014
42. N. Zhang, R. Farrell, F. Iandola, and T. Darrell. Deformable part descriptors for fine-grained recognition and attribute prediction. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 729-736. IEEE, 2013
43. N. Zhang, M. Paluri, M. Ranzato, T. Darrell, and L. Bourdev. Panda: Pose aligned networks for deep attribute modeling. In Computer Vision and Pat-tern Recognition (CVPR), 2014 IEEE Conference on, pages 1637-1644. IEEE, 2014.