Convolutional recurrent neural networks: Learning spatial dependencies for image representation

IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

Volumn 2015-October, Issue , 2015, Pages 18-26

  Zuo, Zhen ^a   Shuai, Bing ^a   Wang, Gang ^a,b   Liu, Xiao ^a   Wang, Xingxing ^a   Wang, Bing ^a   Chen, Yushi ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b ADVANCED DIGITAL SCIENCES CENTER   (Singapore)

^c HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Computational modeling; Context; Image representation; Mathematical model; Recurrent neural networks; Visualization

Indexed keywords

COMPUTER VISION; CONVOLUTION; FLOW VISUALIZATION; IMAGE ENHANCEMENT; MATHEMATICAL MODELS;

COMPETITIVE PERFORMANCE; COMPUTATIONAL MODEL; CONTEXT; CONVOLUTIONAL NEURAL NETWORK; DISCRIMINATIVE POWER; IMAGE REPRESENTATIONS; RECURRENT NEURAL NETWORK (RNNS); SPATIAL STRUCTURE INFORMATION;

RECURRENT NEURAL NETWORKS;

EID: 84937153918     PISSN: 21607508     EISSN: 21607516     Source Type: Conference Proceeding    
DOI: 10.1109/CVPRW.2015.7301268     Document Type: Conference Paper

References (55)

1. Y. Bengio, L. Yao, G. Alain, and P. Vincent. Generalized denoising auto-encoders as generative models. In NIPS, 2013. 2
2. N. Boulanger-Lewandowski, Y. Bengio, and P. Vincent. Modeling temporal dependencies in high-dimensional sequences: Application to polyphonic music generation and transcription. In ICML, 2012. 2
3. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman. Return of the devil in the details: Delving deep into convolutional nets. In BMVC, 2014. 1, 2
4. D. Ciresan, U. Meier, and J. Schmidhuber. Multi-column deep neural networks for image classification. In CVPR, 2012. 1, 2
5. J. Deng, W. Dong, R. Socher, L. J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, 2009. 1, 5
6. C. Doersch, A. Gupta, and A. A. Efros. Mid-level visual element discovery as discriminative mode seeking. In NIPS, 2013. 7
7. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell. Decaf: A deep convolutional activation feature for generic visual recognition. In ICML, 2014. 2
8. D. Eigen, J. Rolfe, R. Fergus, and Y. LeCun. Understanding deep architectures using a recursive convolutional network. arXiv preprint arXiv:1312.1847, 2013. 2
9. J. L. Elman. Finding structure in time. Cognitive science, 14(2):179-211, 1990. 1, 2
10. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014. 1, 2
11. Y. Gong, L. Wang, R. Guo, and S. Lazebnik. Multi-scale orderless pooling of deep convolutional activation features. In ECCV, 2014. 1, 2
12. A. Graves and N. Jaitly. Towards end-to-end speech recognition with recurrent neural networks. In ICML, 2014. 2, 3
13. A. Graves and J. Schmidhuber. Offline handwriting recognition with multidimensional recurrent neural networks. In Advances in Neural Information Processing Systems, pages 545-552, 2009. 3
14. K. He, X. Zhang, S. Ren, and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. In ECCV, 2014. 1, 2
15. G. E. Hinton, S. Osindero, and Y. W. Teh. A fast learning algorithm for deep belief nets. Neural computation, 2006. 2
16. G. E. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313(5786):504-507, 2006. 2
17. H. Jaeger. Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the "echo state network" approach. GMD-Forschungszentrum Informationstechnik, 2002. 1, 2
18. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014. 4, 5
19. M. Juneja, A. Vedaldi, C. Jawahar, and A. Zisserman. Blocks that shout: Distinctive parts for scene classification. In CVPR, 2013. 7
20. J. Koutník, K. Greff, F. Gomez, and J. Schmidhuber. A clockwork rnn. In ICML, 2014. 2, 3
21. A. Krizhevsky, I. Sutskever, and G. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012. 1, 2, 3, 5, 6, 7
22. M. Lapin, B. Schiele, and M. Hein. Scalable multitask representation learning for scene classification. In CVPR, 2014. 6
23. B. B. Le Cun, J. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel. Handwritten digit recognition with a back-propagation network. In NIPS, 1990. 1, 2
24. C.-Y. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu. Deeplysupervised nets. arXiv preprint arXiv:1409.5185, 2014. 1, 2
25. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In ICML, 2009. 2
26. L.-J. Li, H. Su, L. Fei-Fei, and E. P. Xing. Object bank: A high-level image representation for scene classification & semantic feature sparsification. In NIPS, 2010. 7
27. Q. Li, J. Wu, and Z. Tu. Harvesting mid-level visual concepts from large-scale internet images. In CVPR, 2013. 7
28. D. Lin, C. Lu, R. Liao, and J. Jia. Learning important spatial pooling regions for scene classification. In CVPR, 2014. 7
29. J. Lu, V. E. Liong, G. Wang, and P. Moulin. Joint feature learning for face recognition. Information Forensics and Security, IEEE Transactions on, 2015. 1
30. T. Mikolov. Statistical language models based on neural networks. PhD thesis, Brno University of Technology, 2012. 2, 4
31. T. Mikolov, M. Karafiát, L. Burget, J. Cernocky, and S. Khudanpur. Recurrent neural network based language model. In INTERSPEECH, 2010. 2, 3
32. V. Nair and G. E. Hinton. 3d object recognition with deep belief nets. In NIPS, 2009. 2
33. M. Oquab, L. Bottou, I. Laptev, J. Sivic, et al. Learning and transferring mid-level image representations using convolutional neural networks. In CVPR, 2014. 2
34. W. Ouyang, P. Luo, X. Zeng, S. Qiu, Y. Tian, H. Li, S. Yang, Z. Wang, Y. Xiong, C. Qian, et al. Deepid-net: multi-stage and deformable deep convolutional neural networks for object detection. arXiv preprint arXiv:1409.3505, 2014. 1
35. P. Pinheiro and R. Collobert. Recurrent convolutional neural networks for scene labeling. In ICML, 2014. 3
36. A. Quattoni and A. Torralba. Recognizing indoor scenes. In CVPR, 2009. 5, 6, 7
37. J. T. Rolfe and Y. LeCun. Discriminative recurrent sparse auto-encoders. arXiv preprint arXiv:1301.3775, 2013. 3
38. J. Sánchez, F. Perronnin, T. Mensink, and J. Verbeek. Image classification with the fisher vector: Theory and practice. International journal of computer vision, 105(3):222-245, 2013. 6
39. M. Schuster and K. K. Paliwal. Bidirectional recurrent neural networks. Signal Processing, IEEE Transactions on, 45(11):2673-2681, 1997. 4
40. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun. Overfeat: Integrated recognition, localization and detection using convolutional networks. arXiv preprint arXiv:1312.6229, 2013. 1, 2
41. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014. 1, 2
42. Y. Sun, X. Wang, and X. Tang. Deep learning face representation from predicting 10,000 classes. In CVPR, 2014. 1
43. I. Sutskever. Training recurrent neural networks. PhD thesis, University of Toronto, 2013. 2, 3
44. I. Sutskever, G. E. Hinton, and G. W. Taylor. The recurrent temporal restricted boltzmann machine. In NIPS, 2009. 2
45. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. arXiv preprint arXiv:1409.4842, 2014. 1, 2
46. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf. Deepface: Closing the gap to human-level performance in face verification. In CVPR, 2014. 1, 2
47. L. Wang, T. Liu, G. Wang, K. L. Chan, and Q. Yang. Video tracking using learned hierarchical features. Image Processing, IEEE Transactions on, 24(4):1424-1435, 2015. 1
48. X. Wang, B. Wang, X. Bai, W. Liu, and Z. Tu. Max-margin multiple-instance dictionary learning. In ICML, 2013. 7
49. J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba. Sun database: Large-scale scene recognition from abbey to zoo. In CVPR, 2010. 5, 6
50. X. Yan, H. Chang, S. Shan, and X. Chen. Modeling video dynamics with deep dynencoder. In ECCV, 2014. 2
51. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional neural networks. arXiv preprint arXiv:1311.2901, 2013. 3, 4
52. X. Zeng, W. Ouyang, M. Wang, and X. Wang. Deep learning of scene-specific classifier for pedestrian detection. In ECCV, 2014. 1
53. J. Zhang, S. Shan, M. Kan, and X. Chen. Coarse-to-fine auto-encoder networks (cfan) for real-time face alignment. In ECCV, 2014. 2
54. Z. Zuo and G. Wang. Learning discriminative hierarchical features for object recognition. Signal Processing Letters, 21(9):1159-1163, 2014. 1
55. Z. Zuo, G. Wang, B. Shuai, L. Zhao, Q. Yang, and X. Jiang. Learning discriminative and shareable features for scene classification. In ECCV, 2014. 1