Capturing correlations of local features for image representation

Neurocomputing

Volumn 184, Issue , 2016, Pages 99-106

  Hong, Xiaopeng ^a   Zhao, Guoying ^a   Zafeiriou, Stefanos ^b   Pantic, Maja ^b   Pietikäinen, Matti ^a  

^a UNIVERSITY OF OULU   (Finland)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Covariance matrix; Feature pooling; Local feature

Indexed keywords

COVARIANCE MATRIX; TEXTURES;

EXPRESSION RECOGNITION; FEATURE POOLING; GLOBAL DESCRIPTORS; IMAGE REPRESENTATIONS; LOCAL FEATURE; PAIRWISE CORRELATION; SPATIAL TEMPORALS; TEXTURE CLASSIFICATION;

MEDICAL IMAGING;

ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; CLASSIFIER; DIAGNOSTIC IMAGING; FACIAL EXPRESSION; IMAGE ANALYSIS; IMAGE PROCESSING; PAIN INTENSITY; PRIORITY JOURNAL;

EID: 84955603725     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.07.134     Document Type: Article

References (52)

1. K. Mikolajczyk, C. Schmid, A performance evaluation of local descriptors, IEEE Trans. Pattern Anal. Mach. Intell. 27 (10) (2005) 1615-1630.
2. L. Seidenari, G. Serra, A. Bagdanov, A. DelBimbo, Local pyramidal descriptors for image recognition, IEEE Trans, Pattern Anal. Mach. Intell. 31 (5) (2014).
3. T. Ojala, M. Pietikäinen, T. Mäenpää, Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Trans. Pattern Anal. Mach. Intell. 24 (7) (2002) 971-987, http://dx.doi.org/10.1109/TPAMI.2002.1017623.
4. D. Lowe, Distinctive image features from scale-invariant keypoints, Int. J. Comput. Vis. 60 (2) (2004) 91-110.
5. M. Varma, A. Zisserman, A statistical approach to material classification using image patch exemplars, IEEE Trans. Pattern Anal. Mach. Intell. 31 (11) (2009) 2032-2047, http://dx.doi.org/10.1109/TPAMI.2008.182.
6. X. Tan, B. Triggs, Enhanced local texture feature sets for face recognition under difficult lighting conditions, IEEE Trans. Image Process. 19 (6) (2010) 1635-1650.
7. J. Zhang, J. Liang, H. Zhao, Local energy pattern for texture classification using self-adaptive quantization thresholds, IEEE Trans. Image Process. 22 (1) (2013) 31-42.
8. Y.-L. Boureau, J. Ponce, Y. LeCun, A theoretical analysis of feature pooling in visual recognition, in: Proceedings of the 27th International Conference on Machine Learning (ICML-10), 2010, pp. 111-118.
9. Y.-L. Boureau, Y.L. Cun, et al., Sparse feature learning for deep belief networks, in: Advances in Neural Information Processing Systems, 2008, pp. 1185-1192.
10. J. Yang, K. Yu, Y. Gong, T. Huang, Linear spatial pyramid matching using sparse coding for image classification, in: IEEE Conference on Computer Vision and Pattern Recognition, 2009 (CVPR 2009), IEEE, 2009, pp. 1794-1801, Miami, Florida, USA.
11. J. Yang, K. Yu, T. Huang, Supervised translation-invariant sparse coding, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2010, pp. 3517-3524, San Francisco, CA, USA.
12. J. Carreira, R. Caseiro, J. Batista, C. Sminchisescu, Free-form region description with second-order pooling, IEEE Trans. Pattern Anal. Mach. Intell. 37 (6) (2015) 1177-1189.
13. C. Ionescu, J. Carreira, C. Sminchisescu, Iterated second-order label sensitive pooling for 3d human pose estimation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1661-1668. IEEE, 2014, Columbus, Ohio, USA.
14. B. Ni, M. Xu, T. Nguyen, M. Wang, C. Lang, Z. Huang, S. Yan, Touch saliency: characteristics and prediction, IEEE Transactions on Multimedia 16 (6) (2014) 1179-1791.
15. R. Huang, M. Ye, P. Xu, T. Li, Y. Dou, Learning to pool high-level features for face representation, Vis. Comput. (2014) 1-13.
16. O. Tuzel, F. Porikli, P. Meer, Region covariance: a fast descriptor for detection and classification, in: Proceedings of the European Conference on Computer Vision, 2006, pp. 589-600.
17. V. Arsigny, P. Fillard, X. Pennec, N. Ayache, Geometric means in a novel vector space structure on symmetric positive-definite matrices, SIAM J. Matrix Anal. Appl. 29 (1) (2007) 328-347.
18. S. Jayasumana, R. Hartley, M. Salzmann, H. Li, M. Harandi, Kernel methods on the Riemannian manifold of symmetric positive definite matrices.
19. R. Sivalingam, D. Boley, V. Morellas, N. Papanikolopoulos, Positive definite dictionary learning for region covariances, in: Proceedings of the ICCV, 2011.
20. O. Tuzel, F. Porikli, P. Meer, Pedestrian detection via classification on Rie-mannian manifolds, IEEE Trans. Pattern Anal. Mach. Intell. 30 (10) (2008) 1713-1727, http://dx.doi.org/10.1109/TPAMI.2008.75.
21. W. Feller, An Introduction to Probability Theory and its Applications, vol. 2, John Wiley & Sons, 2008.
22. X. Pennec, P. Fillard, N. Ayache, A Riemannian framework for tensor com- puting, Int. J. Comput. Vis. 66 (2006) 41-66.
23. F. Perronnin, J. Sánchez, T. Mensink, Improving the Fisher kernel for large-scale image classification, in: Computer Vision-ECCV 2010, Springer, 2010, pp. 143-156, Crete, Greece.
24. F. Porikli, Integral histogram: a fast way to extract histograms in Cartesian spaces, in: Proceedings of the CVPR, vol. 1, IEEE, 2005, pp. 829-836, San Diego, CA, USA.
25. N. Ahmed, T. Natarajan, K. Rao, Discrete cosine transform, IEEE Trans. Comput.(1) (1974) 90-93.
26. R. Bracewell, R. Bracewell, The Fourier Transform and its Applications, vol. 31999, McGraw-Hill, New York, 1986.
27. P. Li, Q. Wang, Local Log-Euclidean covariance matrix (L2ECM) for image representation and its applications, in: Proceedings of the ECCV, 2012.
28. Y. Lui, Advances in matrix manifolds for computer vision, Image Vis. Comput. (6-7) (2012) 380-388.
29. B. Caputo, E. Hayman, P. Mallikarjuna, Class-specific material categorisation, in: Proceedings of the ICCV, 2005, pp. 1597-1604.
30. B. Caputo, E. Hayman, M. Fritz, J.-O. Eklundh, Classifying materials in the real world, Image Vis. Comput. 28 (1) (2010) 150-163, http://dx.doi.org/10.1016/j.imavis.2009.05.005.
31. J. Zhang, S. Lazebnik, C. Schmid, Local features and kernels for classification of texture and object categories: a comprehensive study, Int. J. Comput. Vis. 73 (2) (2007) 213-238.
32. K. Simonyan, O.M. Parkhi, A. Vedaldi, A. Zisserman, Fisher vector faces in the wild, in: Proceedings of the BMVC, vol. 1, 2013, p. 7.
33. J. Sánchez, F. Perronnin, T. Mensink, J. Verbeek, Image classification with the Fisher vector: theory and practice, Int. J. Comput. Vis. 105 (3) (2013) 222-245.
34. Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition, Proc. IEEE 86 (11) (1998) 2278-2324.
35. A. Krizhevsky, I. Sutskever, G. E. Hinton, ImageNet classification with deep convolutional neural networks, in: Advances in neural information processing systems, 2012, pp. 1097-1105.
36. K. Chatfield, K. Simonyan, A. Vedaldi, A. Zisserman, Return of the devil in the details: delving deep into convolutional nets, in: Proceedings of the British Machine Vision Conference, 2014.
37. A. Vedaldi, B. Fulkerson, VLFeat: an open and portable library of computer vision algorithms, in: Proceedings of the International Conference on Multi- media, ACM, 2010, pp. 1469-1472, Firenze, Italy.
38. A. Vedaldi, K. Lenc, Matconvnet-convolutional neural networks for matlab, CoRR abs/1412.4564.
39. L. Liu, P. Fieguth, D. Clausi, G. Kuang, Sorted random projections for robust rotation-invariant texture classification, Pattern Recognit. 45 (6) (2012) 2405-2418, http://dx.doi.org/10.1016/j.patcog.2011.10.027.
40. M. Crosier, L.D. Griffin, Using basic image features for texture classification, Int. J. Comput. Vis. 88 (3) (2010) 447-460.
41. M. Boland, R. Murphy, A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells, BMC Bioinform. 17 (12) (2001) 1213-1223.
42. L. Nanni, A. Lumini, S. Brahnam, Local binary patterns variants as texture descriptors for medical image analysis, Artif. Intell. Med. 49 (2) (2010) 117-125.
43. L. Nanni, S. Brahnam, A. Lumini, Selecting the best performing rotation invariant patterns in local binary/ternary patterns, in: Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition, 2010.
44. A. Chebira, Y. Barbotin, C. Jackson, T. Merryman, G. Srinivasa, R. Murphy, J. Kovacevic, A multiresolution approach to automated classification of pro-tein subcellular location images, BMC Bioinform. 8 (1) (2007) 210.
45. Y. Guo, G. Zhao, M. Pietikäinen, Discriminative features for texture description, Pattern Recognit. 45 (10) (2012) 3834-3843.
46. P. Lucey, J.F. Cohn, K.M. Prkachin, P.E. Solomon, S. Chew, I. Matthews, Painful monitoring: automatic pain monitoring using the UNBC-McMaster shoulder pain expression archive database, Image Vis. Comput. 30 (3) (2012) 197-205.
47. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, M. Pantic, A semi-automatic methodology for facial landmark annotation, in: Proceedings of the CVPRW, 2013.
48. S. Kaltwang, O. Rudovic, M. Pantic, Continuous pain intensity estimation from facial expressions, in: Advances in Visual Computing, Springer, 2012, pp. 368- 377, Crete, Greece.
49. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, C.-J. Lin, Liblinear: a library for large linear classification, J. Mach. Learn. Res. 9 (2008) 1871-1874.
50. X. Li, T. Pfister, X. Huang, G. Zhao, M. Pietikäinen, A spontaneous micro- expression database: inducement, collection and baseline, in: Proceedings of the FG, 2013.
51. Z. Zhou, G. Zhao, M. Pietikäinen, Towards a practical lipreading system, in: Proceedings of the CVPR, 2011.
52. G. Zhao, M. Pietikäinen, Dynamic texture recognition using local binary pat- terns with an application to facial expressions, IEEE Trans. Pattern Anal. Mach. Intell. 29 (6) (2007) 915-928, http://dx.doi.org/10.1109/TPAMI.2007.1110.