A regularized correntropy framework for robust pattern recognition

Neural Computation

Volumn 23, Issue 8, 2011, Pages 2074-2100

  He, Ran ^a,b   Zheng, Wei Shi ^c,d   Hu, Bao Gang ^a   Kong, Xiang Wei ^b  

^a INSTITUTE OF AUTOMATION   (China)

^b DALIAN UNIVERSITY OF TECHNOLOGY   (China)

^c SUN YAT SEN UNIVERSITY   (China)

^d QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79959633868     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00155     Document Type: Letter

References (66)

1. Bengio, Y. (2009). Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2(1), 1-127.
2. Black, M., & Jepson, A. (1998). Eigentracking: Robust matching and tracking of articulated objects using a view-based representation. International Journal of Computer Vision, 26(1), 63-84.
3. Boyd, S., & Vandenberghe, L. (2004). Convex optimization. Cambridge: Cambridge University Press.
4. Candes, E., & Romberg, J. (2005). l1-magic: Recovery of sparse signals via convex programming. http://www.acm.caltech.edu/l1magic/.
5. Candes, E., & Tao, T. (2005). Decoding by linear programming. IEEE Trans. on Information Theory, 51(12), 4203-4215.
6. Chien, J., &Wu, C. (2002). Discriminant waveletfaces and nearest feature classifiers for face recognition. IEEE Trans. on Pattern Analysis andMachine Intelligence, 24(12), 1644-1649.
7. Cover, T., & Thomas, J. (2005). Elements of information theory (2nd ed.). Hoboken, NJ: Wiley.
8. Croux, C., & Dehon, C. (2001). Robust linear discrimination analysis using sestimators. Canadian J. Statistics, 29, 473-492.
9. Ding, C., Zhou, D., He, X., & Zha, H. (2006). R1-PCA: Rotational invariant l1-norm principal component analysis for robust subspace factorization. In Proceedings of the 23rd International Conference on Machine Learning. New York: ACM.
10. Donoho, D. (2006a). Compressed sensing. IEEE Trans. on Information Theory, 52(4), 1289-1306.
11. Donoho, D. (2006b). For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution. Communications on Pure and Applied Mathematics, 59(6), 797-829.
12. Georghiades, A., Belhumeur, P., & Kriegman, D. (2001). From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. on Pattern Analysis and Machine Intelligence, 23(6), 643-660.
13. Grandvalet,Y.,&Bengio,Y. (2006). Entropy regularization. http://www.iro.umontreal.ca/~lisa/pointeurs/entropy regularization 2006.pdf.
14. Hawkins, D.,&McLachlan, G. (1997). High-breakdown linear discriminant analysis. J. Am. Statistical Assoc., 92, 136-143.
15. He, R., Ao, M., Xiang, S., & Li, S. (2008). Nearest feature line: A tangent approximation. In Proceedings of the Chinese Conference on Pattern Recognition. San Mateo, CA: IEEE Computer Society.
16. He, R., Hu, B., & Yuan, X. (2009). Robust discriminant analysis based on nonparametric maximum entropy. In Proceedings of the 1st Asian Conference on Machine Learning. Berlin: Springer.
17. He, R., Hu, B., Yuan, X., & Zheng,W. (2010). Principal component analysis based on nonparametric maximum entropy. Neurocomputing, 73, 1840-1852.
18. He, X., & Fung, W. (2000). High breakdown estimation for multiple populations with applications to discriminant analysis. Multivariate Analysis, 72(2), 151-162.
19. Hester, C., & Casasent, D. (1980). Multivariant technique for multiclass pattern recognition. Appl. Opt., 19, 1758-1761.
20. Huber, P. (1981). Robust statistics. Hoboken, NJ:Wiley.
21. Hubert, M., & Driessen, K. V. (2003). Fast and robust discriminant analysis. Computational Statistics and Data Analysis, 45, 301-320.
22. Jeong, K., Liu, W., Han, S., Hasanbelliu, E., & Principe, J. (2009). The correntropy MACE filter. Pattern Recognition, 42(5), 871-885.
23. Jeong, K., & Principe, J. (2008). Enhancing the correntropy MACE filter with random projections. Neurocomputing, 72, 102-111.
24. Jia, H., & Martinez, A. (2008). Face recognition with occlusions in the training and testing sets. In Proceedings of the 8th IEEE International Conference on Automatic Face and Gesture Recognition. Piscataway, NJ: IEEE.
25. Jia, H., & Martinez, A. (2009). Support vector machines in face recognition with occlusions. In Proceedings of the 8th 2009 IEEE Conference on Computer Vision and Pattern Recognition. San Mateo, CA: IEEE Computer Society.
26. Kumar, B. (1986). Minimum variance synthetic discriminant functions. J. Opt. Soc. Am., A3(10), 1579-1584.
27. Kumar, B.V. (1992). Tutorial survey of composite filter designs for optical correlators. Appl. Opt., 31, 4773-4801.
28. Kumar, B. V., Savvides, M., & Xie, C. (2006). Correlation pattern recognition for face recognition. Proc. IEEE, 94(11), 1963-1976.
29. Kwak, N. (2008). Principal component analysis based on l1-norm maximization. IEEE Trans. on Pattern Analysis and Machine Intelligence, 30(9), 1672-1677.
30. LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278-2324.
31. Lee, H., Battle, A., Raina, R., & Ng, A. (2006). Efficient sparse coding algorithms. In B. Schólkopf, J. Platt, & T. Hoffman (Eds.), Neural information processing systems, 19 (pp. 801-808). Cambridge, MA: MIT Press.
32. Lee, K. C., Ho, J., & Kriegman, D. (2005). Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. on Pattern Analysis and Machine Intelligence, 27(5), 684-698.
33. Leonardis, A.,& Bischof, H. (2000). Robust recognition using eigenimages. Computer Vision and Image Understanding, 78(1), 99-118.
34. Li, S. (1998). Face recognition based on nearest linear combinations. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, (pp. 839-844). San Mateo, CA: IEEE Computer Society Press.
35. Li, S., & Lu, J. (1999). Face recognition using nearest feature linemethod. IEEE Trans. Neural Network, 10(2), 439-443.
36. Liu, W., Pokharel, P. P., & Principe, J. C. (2006). Correntropy: A localized similarity measure. In Proceedings of the International Joint Conference on Neural Networks. San Mateo, CA: IEEE, Computer Society Press.
37. Liu,W., Pokharel, P., & Principe, J. (2007). Correntropy: Properties and applications in nongaussian signal processing. IEEE Trans. on Signal Processing, 55(11), 5286-5298.
38. Mahalanobis, A., Kumar, B., & Casasent, D. (1987). Minimum average correlation energy filters. Appl. Opt., 26(17), 3633-3640.
39. Mairal, J., Elad, M., & Sapiro, G. (2008). Sparse representation for color image restoration. IEEE Trans. on Image Processing, 17(1), 53-69.
40. Mangasarian, O.,&Musicant,D. (2000). Robust linear and support vector regression. IEEE Trans. on Pattern Analysis and Machine Intelligence, 22(9), 950-955.
41. Martinez, A. (2002). Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans. on Pattern Analysis and Machine Intelligence, 24(6), 748-763.
42. Martinez, A., & Benavente, R. (1998). The AR face database (Tech. Rep.). Barcelona: Computer Vision Center, Autonomous University of Barcelona.
43. Meer, P., Stewart, C., & Tyler, D. (2000) Robust computer vision: An interdisciplinary challenge. Computer Vision and Image Understanding, 78, 1-7.
44. Naseem, I., Togneri, R., & Bennamoun, M. (2010). Linear regression for face recognition. IEEE Trans. on Pattern Analysis and Machine Intelligence, 32, 2106-2112.
45. Nene, S., Nayar, S., & Murase, H. (1996). Columbia Object Image Library (COIL-20) (Tech. Rep. CUCS-005-96). New York: Columbia University.
46. Ohba, K., & Ikeuchi, K. (1997). Detectability, uniqueness, and reliability of eigen windows for stable verification of partially occluded objects. IEEE Trans. on Pattern Analysis and Machine Intelligence, 9, 1043-1047.
47. Pentland, A., Moghaddam, B.,&Straner, T. (1994). View-based and modular eigenspaces for face recognition (Tech. Rep. 245). Cambridge, MA: MIT Media Lab.
48. Pokharel, P., Liu, W., & Principe, J. (2009). A low complexity robust detector in impulsive noise. Signal Processing, 89(10), 1902-1909.
49. Principe, J. C. (2010). Information theoretic learning: Renyi's entropy and kernel perspectives. NewYork: Springer.
50. Principe, J. C., Xu, D. X., & Fisher, J. W. (2000). Information-theoretic learning. In S. Haykin (Ed.), Unsupervised adaptive filtering (pp. 265-319). Hoboken, NJ: Wiley.
51. Principe, J., Xu, D., Zhao, Q., & Fisher, J. (2000). Learning from examples with information theoretic criteria. VLSI Signal Processing Systems, 26, 61-77.
52. Refregier, P., & Figue, J. (1991). Optimal trade-off filter for pattern recognition and their comparison with Weiner approach. Opt. Comput. Process., 1, 3-10.
53. Sanja, F., Skocaj, D., & Leonardis, A. (2006). Combining reconstructive and discriminative subspacemethods for robust classification and regression by subsampling. IEEE Trans. on Pattern Analysis and Machine Intelligence, 28(3), 337-350.
54. Santamaria, I., Pokharel, P. P., & Principe, J. C. (2006). Generalized correlation function: Definition, properties, and application to blind equalization. IEEE Trans. on Signal Processing, 54(6), 2187-2197.
55. Silverman, B. W. (1986). Density estimation for statistics and data analysis. London: Chapman and Hall.
56. Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society B, 58(1), 267-288.
57. Torkkola, K. (2003). Feature extraction by nonparametric mutual information maximization. Journal of Machine Learning Research, 3, 1415-1438.
58. Torre, F., & Black, M. (2003). A framework for robust subspace learning. International Journal of Computer Vision, 54(1-3), 117-142.
59. Vapnik, V. (1995). The nature of statistical learning theory. New York: Springer-Verlag.
60. Viola, P., Schraudolph, N., & Sejnowski, T. (1995). Empirical entropy manipulation for real-world problems. In M. Mozer, M. I. Jordan, & T. Petsche (Eds.), Neural information processing systems, 9 (pp. 851-857). Cambridge, MA: MIT Press.
61. Wright, J., Ma, Y., Mairal, J., Sapiro, G., Huang, T. S., & Yan, S. (2010). Sparse representation for computer vision and pattern recognition. Proceedings of IEEE, 98(6), 1031-1044.
62. Wright, J., Yang, A., Ganesh, A., Sastry, S., & Ma, Y. (2009). Robust face recognition via sparse representation. IEEE Trans. on Pattern Analysis andMachine Intelligence, 31(2), 210-227.
63. Xu, D. (1999). Energy, entropy and information potential for neural computation. Unpublished doctoral dissertation, University of Florida.
64. Yang, S., Zha, H., Zhou, S.,&Hu, B. (2009). Variational graph embedding for globally and locally consistent feature extraction. In Proceedings of the Europe Conference on Machine Learning (pp. 538-553). Berlin: Springer.
65. Yi, D., Liu, R., Chu, R., Lei, Z., & Li, S. (2007). Face matching from near infrared to visual images. In S. Li & S. W. Lee (Eds.), Proceedings of IAPR/IEEE International Conference on Biometrics (pp. 523-530). Berlin: Springer.
66. Yuan, X., & Hu, B. (2009). Robust feature extraction via information theoretic learning. In Proceedings of the International Conference on Machine Learning. New York: ACM.