Learning Structure and Strength of CNN Filters for Small Sample Size Training

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2018, Pages 9349-9358

  Keshari, Rohit ^a   Vatsa, Mayank ^a   Singh, Richa ^a   Noore, Afzel ^b  

^a INDRAPRASTHA INSTITUTE OF INFORMATION TECHNOLOGY   (India)

^b TEXAS A AND M UNIVERSITY KINGSVILLE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DATABASE SYSTEMS; LEARNING ALGORITHMS; NEURAL NETWORKS; SAMPLING; SILICON COMPOUNDS;

COMPUTER VISION PROBLEMS; CONVOLUTIONAL NEURAL NETWORK; IDENTIFICATION ACCURACY; LEARNING STRUCTURE; SMALL SAMPLE SIZE; SMALL SAMPLE SIZE PROBLEMS; STATE OF THE ART; TRAINING DATABASE;

FACE RECOGNITION;

EID: 85062829783     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2018.00974     Document Type: Conference Paper

References (50)

1. J. Andén and S. Mallat. Multiscale scattering for audio classification. In ISMIR, pages 657-662, 2011. 2, 5, 6, 7
2. S. Bharadwaj, H. S. Bhatt, R. Singh, M. Vatsa, and S. K. Singh. Face recognition for newborns: A preliminary study. In IEEE BTAS, pages 1-6, 2010. 1
3. S. Bharadwaj, H. S. Bhatt, M. Vatsa, and R. Singh. Domain specific learning for newborn face recognition. IEEE TIFS, 11 (7): 1630-1641, 2016. 1, 2, 5, 7, 8
4. T.-H. Chan, K. Jia, S. Gao, J. Lu, Z. Zeng, and Y. Ma. PCANet: A simple deep learning baseline for image classification IEEE TIP, 24 (12): 5017-5032, 2015. 2, 5, 6
5. M. Cogswell, F. Ahmed, R. Girshick, L. Zitnick, and D. Batra. Reducing overfitting in deep networks by decorrelating representations. ArXiv preprint arXiv: 1511. 06068, 2015. 2
6. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. ImageNet: A Large-Scale Hierarchical Image Database. In CVPR, 2009. 8
7. T. I. Dhamecha, A. Nigam, R. Singh, and M. Vatsa. Disguise detection and face recognition in visible and thermal spectrums. In ICB, pages 1-8, 2013. 8
8. K. Engan, S. O. Aase, and J. Hakon Husoy. Method of optimal directions for frame design. In ICASSP, pages 2443-2446. IEEE Computer Society, 1999. 3
9. D. Erhan, Y. Bengio, A. Courville, P.-A. Manzagol, P. Vincent, and S. Bengio. Why does unsupervised pre-training help deep learning JMLR, 11 (Feb): 625-660, 2010. 1
10. J. Feng and T. Darrell. Learning the structure of deep convolutional networks. In ICCV, pages 2749-2757, 2015. 2
11. Z. Feng, L. Jin, D. Tao, and S. Huang. Dlanet: A manifoldlearning-based discriminative feature learning network for scene classification. Neurocomputing, 157: 11-21, 2015. 2
12. Y. Gan, J. Liu, J. Dong, and G. Zhong. A PCA-based convolutional network. ArXiv preprint arXiv: 1505. 03703, 2015. 2
13. X. Glorot and Y. Bengio. Understanding the difficulty of training deep feedforward neural networks. In AISTATS, volume 9, pages 249-256, 2010. 4, 5
14. G. Goswami, R. Bhardwaj, R. Singh, and M. Vatsa. MDLFace: Memorability augmented deep learning for video face recognition. In IEEE IJCB, pages 1-7, 2014. 8
15. B. Hariharan and R. Girshick. Low-shot visual recognition by shrinking and hallucinating features. In ICCV, 2017. 7, 8
16. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In ICCV, pages 1026-1034, 2015. 4, 5
17. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In IEEE CVPR, pages 770-778, 2016. 1, 3, 4, 5, 7
18. G. Huang, Z. Liu, L. van der Maaten, and K. Q. Weinberger. Densely connected convolutional networks. In CVPR, 2017. 1, 4, 7
19. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical report, 07-49, University of Massachusetts, Amherst, 2007. 7
20. K. Jarrett, K. Kavukcuoglu, Y. LeCun, et al. What is the best multi-stage architecture for object recognition In IEEE ICCV, pages 2146-2153, 2009. 2
21. G. Koch, R. Zemel, and R. Salakhutdinov. Siamese neural networks for one-shot image recognition. In ICML Deep Learning Workshop, volume 2, 2015. 8
22. A. Krizhevsky and G. Hinton. Learning multiple layers of features from tiny images. Technical report, 2009. 2, 5
23. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, pages 1097-1105, 2012. 1
24. B. Lake, R. Salakhutdinov, J. Gross, and J. Tenenbaum. One shot learning of simple visual concepts. In Proceedings of the Annual Meeting of the Cognitive Science Society, volume 33, 2011. 2, 5, 7, 8
25. Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel. Backpropagation applied to handwritten zip code recognition. Neural computation, 1 (4): 541-551, 1989. 1
26. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceedings of the IEEE, 86 (11): 2278-2324, 1998. 2, 5
27. Y. LeCun, F. J. Huang, and L. Bottou. Learning methods for generic object recognition with invariance to pose and lighting. In IEEE CVPR, volume 2, pages II-104, 2004. 2, 5
28. Y. LeCun, D. Touresky, G. Hinton, and T. Sejnowski. A theoretical framework for back-propagation. In Proceedings of the connectionist models summer school, pages 21-28. CMU, Pittsburgh, Pa: Morgan Kaufmann, 1988. 4
29. D. D. Lee and H. S. Seung. Learning the parts of objects by nonnegative matrix factorization. Nature, 401: 788-791, 1999. 3
30. J. Mairal, F. Bach, J. Ponce, and G. Sapiro. Online learning for matrix factorization and sparse coding. JMLR, 11 (Jan): 19-60, 2010. 3
31. R. Mao, H. Zhu, L. Zhang, and A. Chen. A new method to assist small data set neural network learning. In ISDA, volume 1, pages 17-22. IEEE, 2006. 2
32. D. Mishkin and J. Matas. All you need is a good init. ArXiv preprint arXiv: 1511. 06422, 2015. 1
33. S. Nagpal, M. Singh, R. Singh, M. Vatsa, A. Noore, and A. Majumdar. Face sketch matching via coupled deep transform learning. In IEEE ICCV, pages 5429-5438, 2017. 8
34. J. Ngiam, Z. Chen, D. Chia, P. W. Koh, Q. V. Le, and A. Y. Ng. Tiled convolutional neural networks. In NIPS, pages 1279-1287, 2010. 2
35. E. Oyallon, E. Belilovsky, and S. Zagoruyko. Scaling the scattering transform: Deep hybrid networks. ArXiv preprint arXiv: 1703. 08961, 2017. 2, 5, 6, 7
36. O. M. Parkhi, A. Vedaldi, and A. Zisserman. Deep face recognition. In BMVC, 2015. 7
37. A. Santoro, S. Bartunov, M. Botvinick, D. Wierstra, and T. Lillicrap. Meta-learning with memory-augmented neural networks. In ICML, pages 1842-1850, 2016. 8
38. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. ArXiv preprint arXiv: 1409. 1556, 2014. 1, 7
39. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In CVPR, pages 1-9, 2015. 1
40. S. Tariyal, A. Majumdar, R. Singh, and M. Vatsa. Deep dictionary learning. IEEE Access, 4: 10096-10109, 2016. 2, 3
41. I. Tosic and P. Frossard. Dictionary learning. IEEE SPM, 28 (2): 27-38, 2011. 2, 3
42. O. Vinyals, C. Blundell, T. Lillicrap, D. Wierstra, et al. Matching networks for one shot learning. In Advances in Neural Information Processing Systems, pages 3630-3638, 2016. 7, 8
43. L. Wan, M. Zeiler, S. Zhang, Y. L. Cun, and R. Fergus. Regularization of neural networks using dropconnect. In ICML, pages 1058-1066, 2013. 5
44. L. Wolf, T. Hassner, and I. Maoz. Face recognition in unconstrained videos with matched background similarity. In CVPR, pages 529-534. IEEE, 2011. 7
45. D. Wu, J. Wu, R. Zeng, L. Jiang, L. Senhadji, and H. Shu. Kernel principal component analysis network for image classification. ArXiv preprint arXiv: 1512. 06337, 2015. 2
46. X. Wu, R. He, Z. Sun, and T. Tan. A light CNN for deep face representation with noisy labels. ArXiv preprint arXiv: 1511. 02683, 2015. 7
47. W. Xiong, B. Du, L. Zhang, R. Hu, and D. Tao. Regularizing deep convolutional neural networks with a structured decorrelation constraint. In ICDM, 519-528. IEEE, 2016. 2
48. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In ECCV, 818-833. Springer, 2014. 5
49. R. Zeng, J. Wu, L. Senhadji, and H. Shu. Tensor object classification via multilinear discriminant analysis network. In IEEE ICASSP, 2015. 2
50. H. Zou and T. Hastie. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 67 (2): 301-320, 2005. 5