Sparsifying neural network connections for face recognition

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 4856-4864

  Sun, Yi ^a   Wang, Xiaogang ^b,c   Tang, Xiaoou ^b,c  

^a SENSETIME RESEARCH   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; PATTERN RECOGNITION;

BASELINE MODELS; FACE RECOGNITION PERFORMANCE; INITIAL WEIGHTS; NETWORK CONNECTION; NEURAL CORRELATIONS; SELECTION CRITERIA; SPARSER MODELS; TRAINING DATA;

FACE RECOGNITION;

EID: 84986290471     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.525     Document Type: Conference Paper

References (29)

1. S. Arora, A. Bhaskara, R. Ge, and T. Ma. Provable bounds for learning some deep representations. CoRR, abs/1310.6343, 2013.
2. J. Ba and R. Caruana. Do deep nets really need to be deep? In Proc. NIPS. 2014.
3. L. Best-Rowden, H. Han, C. Otto, B. Klare, and A. K. Jain. Unconstrained face recognition: Identifying a person of interest from a media collection. TR MSUCSE-14-1, 2014.
4. C. Blundell, J. Cornebise, K. Kavukcuoglu, and D. Wierstra. Weight uncertainty in neural networks. In Proc. ICML. 2015.
5. D. Chen, X. Cao, L. Wang, F. Wen, and J. Sun. Bayesian face revisited: A joint formulation. In Proc. ECCV, 2012.
6. M. D. Collins and P. Kohli. Memory bounded deep convolutional networks. CoRR, abs/1412.1442, 2014.
7. Y. L. Cun, J. S. Denker, and S. A. Solla. Optimal brain damage. In Proc. NIPS, 1990.
8. E. L. Denton, W. Zaremba, J. Bruna, Y. LeCun, and R. Fergus. Exploiting linear structure within convolutional networks for efficient evaluation. In Proc. NIPS. 2014.
9. B. Hassibi, D. G. Stork, and S. C. R. Com. Second order derivatives for network pruning: Optimal brain surgeon. In Proc. NIPS, 1993.
10. G. Hinton, O. Vinyals, and J. Dean. Distilling the knowledge in a neural network. CoRR, abs/1503.02531, 2014.
11. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Improving neural networks by preventing co-adaptation of feature detectors. CoRR, abs/1207.0580, 2012.
12. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller. Labeled Faces in the Wild: A database for studying face recognition in unconstrained environments. Technical Report 07-49, University of Massachusetts, Amherst, 2007.
13. M. Jaderberg, A. Vedaldi, and A. Zisserman. Speeding up convolutional neural networks with low rank expansions. In Proc. BMVC, 2014.
14. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014.
15. B. F. Klare, B. Klein, E. Taborsky, A. Blanton, J. Cheney, K. Allen, P. Grother, A. Mah, M. Burge, and A. K. Jain. Pushing the frontiers of unconstrained face detection and recognition: IARPA Janus Benchmark A. In Proc. CVPR, 2015.
16. J. C. Klontz, B. F. Klare, S. Klum, A. K. Jain, and M. J. Burge. Open source biometric recognition. In Biometrics: Theory, Applications and Systems (BTAS), 2013.
17. V. Nair and G. E. Hinton. Rectified linear units improve restricted Boltzmann machines. In Proc. ICML, 2010.
18. O. M. Parkhi, A. Vedaldi, and A. Zisserman. Deep face recognition. In Proc. BMVC, 2015.
19. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. IJCV, 2015.
20. F. Schroff, D. Kalenichenko, and J. Philbin. Facenet: A unified embedding for face recognition and clustering. In Proc. CVPR, 2015.
21. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. Technical report, arXiv:1409.1556, 2014.
22. S. Srinivas and R. V. Babu. Data-free parameter pruning for deep neural networks. CoRR, abs/1507.06149, 2015.
23. Y. Sun, Y. Chen, X.Wang, and X. Tang. Deep learning face representation by joint identification-verification. In Proc. NIPS, 2014.
24. Y. Sun, X. Wang, and X. Tang. Deeply learned face representations are sparse, selective, and robust. In Proc. CVPR, 2015.
25. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In Proc. CVPR, 2015.
26. Y. Taigman, M. Yang, M. Ranzato, and L.Wolf. Webscale training for face identification. In Proc. CVPR, 2015.
27. P. M. Williams. Bayesian regularisation and pruning using a laplace prior. Neural Computation, 7:117-143, 1994.
28. L. Wolf, T. Hassner, and I. Maoz. Face recognition in unconstrained videos with matched background similarity. In Proc. CVPR, 2011.
29. X. Zhang, J. Zou, K. He, and J. Sun. Accelerating very deep convolutional networks for classification and detection. CoRR, abs/1505.06798, 2015.