Nonlinear non-negative component analysis algorithms

IEEE Transactions on Image Processing

Volumn 19, Issue 4, 2010, Pages 1050-1066

  Zafeiriou, Stefanos ^a   Petrou, Maria ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Face recognition; Facial expression recognition; Kernel methods; Non negative matrix factorization; Subspace techniques

Indexed keywords

DATA REPRESENTATIONS; FACIAL EXPRESSION RECOGNITION; FEATURE SPACE; FIXED-POINT ALGORITHMS; GAUSSIAN RADIAL BASIS FUNCTIONS; GENERAL SOLUTIONS; KERNEL METHODS; KERNEL THEORY; LIMIT POINTS; NEGATIVE COMPONENTS; NON-NEGATIVE MATRIX FACTORIZATION ALGORITHMS; NONNEGATIVE MATRIX FACTORIZATION; OPTIMIZATION PROBLEMS; POSITIVE DEFINITE KERNELS; PROJECTED GRADIENT; STATIONARY POINTS; SUBSPACE TECHNIQUES;

BLIND SOURCE SEPARATION; FACTORIZATION; FEATURE EXTRACTION; GESTURE RECOGNITION; LIGHT MEASUREMENT; NONLINEAR ANALYSIS; RADIAL BASIS FUNCTION NETWORKS;

FACE RECOGNITION;

EID: 77949767628     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2009.2038816     Document Type: Article

References (57)

1. K. Fukunaga, Statistical Pattern Recognition. San Diego, CA: Academic, 1990.
2. M. Kirby and L. Sirovich, "Application of the karhunen-loeve procedure for the characterization of human faces," IEEE Trans. Pattern Anal. Mach. Intell., vol.12, no.1, pp. 103-108, Jan. 1990.
3. M. Turk and A. P. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol.3, no.1, pp. 71-86, 1991.
4. A. Hyvarinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
5. L. Chengjun and H. Wechsler, "Independent component analysis of gabor features for face recognition," IEEE Trans. Neural Netw., vol.14, no.7, pp. 919-928, Jul. 2003.
6. M. S. Bartlett, J. R. Movellan, and T. J. Sejnowski, "Face recognition by independent component analysis," IEEE Trans. Neural Netw., vol.13, pp. 1450-1464, 2002.
7. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Proc. NIPS, 2000, pp. 556-562.
8. D. D. Lee and H. S. Seung, "Learning the parts of objects by nonnegative matrix factorization," Nature, vol.401, pp. 788-791, 1999.
9. S. Z. Li, X. W. Hou, and H. J. Zhang, "Learning spatially localized, parts-based representation," in Proc. CVPR, Kauai, HI, Dec. 8-14, 2001, pp. 207-212.
10. I. Buciu and I. Pitas, "Application of non-negative and local non negative matrix factorization to facial expression recognition," in Proc. ICPR, Cambridge, U.K., Aug. 23-26, 2004, pp. 288-291.
11. I. Buciu and I. Pitas, "A new sparse image representation algorithm applied to facial expression recognition," presented at the MLSP, Sao Lus, Brazil, Oct. 1, 2004.
12. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol.5, pp. 1457-1469, 2004.
13. Y. Wang, Y. Jia, C. Hu, and M. Turk, "Non-negative matrix factorization framework for face recognition," Int. J. Pattern Recognit. Artif. Intell., vol.19, no.4, pp. 1-17, 2005.
14. A. Pascual-Montano, J. M. Carazo, K. Kochi, D. Lehmann, and R. D. Pascual-Marqui, "Nonsmooth non-negative matrix factorization (nsNMF)," IEEE Trans. Pattern Anal. Mach. Intell., vol.28, no.3, pp. 403-415, Mar. 2006.
15. S. Sra and I. S. Dhillon, non-negative Matrix Approximation: Algorithms and Applications, Dept. Comput. Sci., Univ. Texas, Austin, 2006, TR-06-27.
16. S. Zafeiriou, A. Tefas, I. Buciu, and I. Pitas, "Exploiting discriminant information in non-negative matrix factorization with application to frontal face verification," IEEE Trans. Neural Netw., vol.17, pp. 683-695, 2006.
17. A. Scholkopf, B. Smola, and K. R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol.10, pp. 1299-1319, 1998.
18. F. R. Bach and M. J. Jordan, "Kernel independent component analysis," J. Mach. Learn. Res., vol.3, pp. 1-48, 2002.
19. I. Buciu, N. Nikolaidis, and I. Pitas, "Non-negative matrix factorization in polynomial feature space," IEEE Trans. Neural Netw., vol.19, pp. 1090-1100, 2007.
20. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
21. E. P. Simoncelli, "Vision and the statistics of the visual enviroment," Curr. Opin. Neurobiol., vol.13, pp. 144-149, 2003.
22. J. Touryan, G. Felsen, and Y. Dan, "Spatial structure of complex cell receptive fields measured with natural images," Neuron, vol.45, pp. 781-791, 2005.
23. J. Rapela, J. M. Mendel, and N. M. Grzywacz, "Estimation nonlinear receptive fields from natural images," J. Vis., vol.6, no.4, pp. 441-474, 2006.
24. B. Scholkopf and A. Smola, Learning with Kernels. Cambridge, MA: MIT Press, 2002.
25. B. Scholkopf, S. Mika, C. J. C. Burges, P. Knirsch, K.-R. Muller, G. Ratsch, and A. J. Smola, "Input space vs. feature space in kernel-based methods," IEEE Trans. Neural Netw., vol.10, pp. 1000-1017, 1999.
26. J. T.-Y. Kwok and I. W.-H. Tsang, "The pre-image problem in kernel methods," IEEE Trans. Neural Netw., vol.15, pp. 1517-1525, 2004.
27. E. Gonzalez and Y. Zhang, Accelerating the Lee-Seung Algorithm for non-negative Matrix Factorization, Rice Univ., Houston, TX, 2005, Tr-05-102
28. L. Finesso and C. Spreij, "non-negative matrix factorization and i-divergence alternative minimization," Linear Algebra Appl., vol.416, no.2-3, pp. 270-286, 2006.
29. C. J. Lin, "On the convergence of multiplicative update for non-negative matrix factorization," IEEE Trans. Neural Netw., vol.18, no.6, pp. 1589-1596, Nov. 2007.
30. C. J. Lin, "Projected gradients for non-negative matrix factorization," Neural Comput., vol.19, no.10, pp. 2756-2779, Oct. 2007.
31. D. Zhang, Z.-H. Zhou, and S. Chen, "Non-negative matrix factorization on kernels," presented at the 9th Pacific Rim Int. Conf. Artificial Intelligence, 2006, LANI 4099.
32. S. Zafeiriou and M. Petrou, "Nonlinear non-negative component analysis," presented at the CVPR2009, Miami Beach, FL, Jun. 20-25, 2009.
33. E. Pekalska, P. Paclik, and R. P. W. Duin, "A generalized kernel approach to dissimilarity-based classification," J. Mach. Learn. Res., vol.2, pp. 175-211, 2002.
34. B. Haasdonk, "Feature space interpretation of SVMs with indefinite kernels," IEEE Trans. Pattern Anal. Mach. Intell., pp. 482-492, 2005.
35. E. Pekalska and B. Haasdonk, "Kernel discriminant analysis for positive definite and indefinite kernels," IEEE Trans. Pattern Anal. Mach. Intell., vol.31, no.6, pp. 1017-1032, Jun. 2009.
36. I. S. Dhillon, Y. Guan, and B. Kulis, "Kernel k-means: Spectral clustering and normalized cuts," in Proc. 10th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, 2004, pp. 551-556.
37. C. Ding, X. He, and H. D. Simon, "On the equivalence of non-negative matrix factorization and spectral clustering," in Proc. SIAM Data Mining Conf., 2005, pp. 606-610.
38. C.-J. Lin and J. J. More, "Newton's method for large-scale bound constrained problems," SIAM J. Optim., vol.9, pp. 1100-1127, 1999.
39. P. H. Calamai and J. J. More, "Projected gradient methods for linearly constrained problems," Math. Programm., vol.39, pp. 93-116, 1987.
40. C. Ding, T. Li, and M. I. Jordan, "Convex and semi-non-negative matrix factorizations," IEEE Trans. Pattern Anal. Mach. Intell., unpublished.
41. D. P. Bertsekas, Nonlinear Programming, 2nd ed. Belmont, MA: Athena Scientific, 1999.
42. M. S. Barlett, H. M. Lades, and T. K. Sejnowski, "Independent component representations for face recognition," in Proc. SPIE Conf. Human Vision and Electronic Imageing III, 1998, vol.3299, pp. 528-539.
43. J. C. Platt, "Fast training of support vector machines using sequential minimal optimization," Adv. Kernel Meth.-Support Vector Learn., vol.12, pp. 185-208, 1999.
44. J. C. Platt, N. Cristianini, and J. S. Taylor, "Large margin dags for mutliclass classification," Adv. Neural Inf. Proces. Syst., vol.12, pp. 547-553, 2000.
45. T. Kanade, J. Cohn, and Y. Tian, "Comprehensive database for facial expression analysis," in Proc. IEEE Int. Conf. Face and Gesture Recognit., Mar. 2000, pp. 46-53.
46. M. Pantic and L. J. M. Rothkrantz, "Expert system for automatic analysis of facial expressions," Image Vis. Comput., vol.18, no.11, pp. 881-905, Aug. 2000.
47. G. Donato, M. S. Bartlett, J. C. Hager, P. Ekman, and T. J. Sejnowski, "Classifying facial actions," IEEE Trans. Pattern Anal. Mach. Intell., vol.21, no.10, pp. 974-989, Oct. 1999.
48. P. Jonathan, W. J. Krzanowski, and W. V. McCarthy, "On the use of cross-validation to assess performance in multivariate prediction," Statist. Comput., vol.10, no.3, 2000.
49. M. Stone, "Cross-validatory choice and assessment of statistical predictions," J. Roy. Statist. Soc. B, pp. 111-147, 1974.
50. M. J. Lyons, S. Akamatsu, M. Kamachi, and J. Gyoba, "Coding facial expressions with gabor wavelets," in Proc. 3rd IEEE Int. Conf. Automatic Face and Gesture Recognition, 1998, pp. 200-205.
51. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol.23, no.6, pp. 643-660, Jun. 2001.
52. K. Messer, J. Matas, J. V. Kittler, J. Luettin, and G. Maitre, "XM2VTSDB: The extended M2VTS database," in Proc. AVBPA, Washington, DC, Mar. 22-23, 1999, pp. 72-77.
53. S. Srisuk, M. Petrou, W. Kurutach, and A. Kadyrov, "A face authentication system using the trace transform," Pattern Anal. Appl., vol.8, pp. 50-61, 2005.
54. S. Barsky and M. Petrou, "The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows," IEEE Trans. Pattern Anal. Mach. Intell., vol.25, pp. 1239-1252, 2003.
55. S. Barsky and M. Petrou, "Design issues for a colour photometric stereo system," J. Math. Imag. Vis., vol.24, pp. 143-162, 2006.
56. V. Argyriou and M. Petrou, "Photometric stereo: An overview," Adv. Imag. Electron. Phys., vol.156, pp. 1-55, 2008.
57. R. T. Frankot and R. Chellappa, "A method for enforcing integrability in shape from shading algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol.10, pp. 439-451, 1988.