Matrix backpropagation for deep networks with structured layers

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2015 International Conference on Computer Vision, ICCV 2015, Issue , 2015, Pages 2965-2973

  Ionescu, Catalin ^b,c   Vantzos, Orestis ^c   Sminchisescu, Cristian ^a,c  

^a LUND UNIVERSITY   (Sweden)

^b INSTITUTE OF MATHEMATICS   (Romania)

^c UNIVERSITY OF BONN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BACKPROPAGATION; CALCULATIONS; COMPUTATION THEORY; COMPUTER VISION; NETWORK ARCHITECTURE; NETWORK LAYERS; NEURAL NETWORKS;

DEEP NEURAL NETWORKS; GRADIENT DESCENT TRAINING; MATHEMATICAL APPARATUS; STRUCTURED MATRIXES; SYMMETRIC POSITIVE DEFINITE MATRICES; THEORY AND PRACTICE; TRAINING FRAMEWORK; VISUAL RECOGNITION;

MATRIX ALGEBRA;

EID: 84973922889     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2015.339     Document Type: Conference Paper

References (42)

1. P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik. Contour detection and hierarchical image segmentation. PAMI, 33 (5): 898-916, May 2011.
2. V. Arsigny, P. Fillard, X. Pennec, and N. Ayache. Geometric means in a novel vector space structure on symmetric positivedefinite matrices. SIAM Journal on Matrix Analysis and Applications, 29 (1): 328-347, 2007.
3. F. R. Bach and M. I. Jordan. Learning spectral clustering, with application to speech separation. JMLR, 7: 1963-2001, 2006.
4. M. Belkin and P. Niyogi. Laplacian Eigenmaps for Dimensionality Reduction and Data Representation. Neural Computation, 15 (6): 1373-1396, 2003.
5. L. Bottou, Y. Bengio, and Y. Le Cun. Global training of document processing systems using graph transformer networks. In CVPR, pages 489-494. IEEE, 1997.
6. J. Carreira, R. Caseiro, J. Batista, and C. Sminchisescu. Semantic segmentation with second-order pooling. In ECCV, pages 430-443. Springer, 2012.
7. J. Carreira and C. Sminchisescu. CPMC: Automatic Object Segmentation Using Constrained Parametric Min-Cuts. PAMI, 2012.
8. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. Semantic image segmentation with deep convolutional nets and fully connected crfs. In ICLR, 2015.
9. L. C. Chen, A. G. Schwing, A. L. Yuille, and R. Urtasun. Learning deep structured models. In ICML, 2015.
10. T. Cour, F. Benezit, and J. Shi. Spectral segmentation with multiscale graph decomposition. In CVPR, 2005.
11. J. Dai, K. He, and J. Sun. Convolutional feature masking for joint object and stuff segmentation. In CVPR, 2015.
12. P. S. Dwyer and M. MacPhail. Symbolic matrix derivatives. The Annals of Mathematical Statistics, pages 517-534, 1948.
13. M. Everingham, L. Van Gool, C. K. Williams, J. Winn, and A. Zisserman. The Pascal visual object classes (VOC) challenge. IJCV, 88 (2): 303-338, 2010.
14. M. B. Giles. Collected matrix derivative results for forward and reverse mode algorithmic differentiation. In Advances in Automatic Differentiation, pages 35-44. Springer, 2008.
15. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, pages 580-587. IEEE, 2014.
16. G. H. Golub and C. F. Van Loan. Matrix Computations (3rd Ed.). Johns Hopkins University Press, USA, 1996.
17. B. Hariharan, P. Arbelaez, R. Girshick, and J. Malik. Simultaneous detection and segmentation. In ECCV. 2014.
18. C. Harris and M. Stephens. A combined corner and edge detector. In Alvey vision conference, volume 15, page 50. Manchester, UK, 1988.
19. R. Hartley and A. Zisserman. Multiple view geometry in computer vision. Cambridge university press, 2003.
20. K. He, X. Zhang, S. Ren, and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. PAMI, 2015.
21. A. Ion, J. Carreira, and C. Sminchisescu. Probabilistic Joint Image Segmentation and Labeling. In Advances in Neural Information Processing Systems, December 2011.
22. C. Ionescu, O. Vantzos, and C. Sminchisescu. Training deep networks with structured layers by matrix backpropagation. CoRR, abs/1509. 07838, 2015.
23. S. Jayasumana, R. Hartley, M. Salzmann, H. Li, and M. Harandi. Kernel methods on the riemannian manifold of symmetric positive definite matrices. In CVPR. IEEE, 2013.
24. I. Jolliffe. Principal Component Analysis. Springer Series in Statistics. Springer, 2002.
25. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, pages 1097-1105, 2012.
26. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceedings of the IEEE, 86 (11): 2278-2324, 1998.
27. F. Li, J. Carreira, G. Lebanon, and C. Sminchisescu. Composite statistical inference for semantic segmentation. In CVPR, pages 3302-3309. IEEE, 2013.
28. G. Lin, C. Shen, I. D. Reid, and A. v. d. Hengel. Efficient piecewise training of deep structured models for semantic segmentation. CoRR, abs/1504. 01013, 2015.
29. T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollr, and C. Zitnick. Microsoft COCO: Common Objects in Context. In ECCV, 2014.
30. J. Long, E. Shelhamer, and T. Darrell. Fully Convolutional Networks for Semantic Segmentation. In CVPR, 2015.
31. D. G. Lowe. Object recognition from local scale-invariant features. In ICCV, volume 2, pages 1150-1157. Ieee, 1999.
32. J. R. Magnus and H. Neudecker. Matrix differential calculus with applications in statistics and econometrics. J. Wiley & Sons, Chichester, New York, Weinheim, 1999.
33. J. Peng, L. Bo, and J. Xu. Conditional neural fields. In NIPS, pages 1419-1427, 2009.
34. K. B. Petersen and M. S. Pedersen. The matrix cookbook, nov 2012. Version 20121115.
35. J. Schmidhuber. Deep learning in neural networks: An overview. Neural Networks, 61: 85-117, 2015.
36. J. Shi and J. Malik. Normalized cuts and image segmentation. PAMI, 22 (8): 888-905, Aug 2000.
37. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409. 1556, 2014.
38. C. Tomasi and T. Kanade. Shape and motion from image streams under orthography: A factorization method. IJCV, 9 (2): 137-154, 1992.
39. S. Turaga, K. Briggman, M. N. Helmstaedter, W. Denk, and S. Seung. Maximin affinity learning of image segmentation. In NIPS, pages 1865-1873, 2009.
40. J. R. Uijlings, K. E. van de Sande, T. Gevers, and A. W. Smeulders. Selective search for object recognition. IJCV, 2013.
41. A. Vedaldi and K. Lenc. MatConvNet-Convolutional Neural Networks for MATLAB. In Int. Conf. Multimedia, 2015.
42. S. Zheng, S. Jayasumana, B. Romera-Paredes, V. Vineet, Z. Su, D. Du, C. Huang, and P. H. S. Torr. Conditional random fields as recurrent neural networks. ICCV, 2015.