Maximum Margin Projection Subspace Learning for Visual Data Analysis

IEEE Transactions on Image Processing

Volumn 23, Issue 10, 2014, Pages 4413-4425

  Nikitidis, Symeon ^a,b   Tefas, Anastasios ^a   Pitas, Ioannis ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

face recognition; facial expression recognition; Maximum margin projections; object recognition; support vector machines

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); ITERATIVE METHODS; OBJECT RECOGNITION; OPTIMIZATION; PATTERN RECOGNITION; SUPPORT VECTOR MACHINES; VECTOR SPACES; VECTORS;

CLASSIFICATION ALGORITHM; DIMENSIONALITY REDUCTION; DIMENSIONALITY REDUCTION ALGORITHMS; DIMENSIONALITY REDUCTION METHOD; FACIAL EXPRESSION RECOGNITION; MAXIMUM MARGIN; SUPPORT VECTOR MACHINE CLASSIFIERS; VISUAL PATTERN RECOGNITION;

FACE RECOGNITION;

EID: 84913537478     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2348868     Document Type: Article

References (50)

1. I. T. Jolliffe, Principal Component Analysis. New York, NY, USA: Springer-Verlag, 1986.
2. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, 2000.
3. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, 2000.
4. X. He and P. Niyogi, "Locality preserving projections," in Advances in Neural Information Processing Systems, vol. 16. Cambridge, MA, USA: MIT Press, 2003.
5. D. Cai, X. He, J. Han, and H.-J. Zhang, "Orthogonal laplacianfaces for face recognition," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3608-3614, Nov. 2006.
6. X. He, D. Cai, S. Yan, and H.-J. Zhang, "Neighborhood preserving embedding," in Proc. Int. Conf. Comput. Vis. (ICCV), Oct. 2005, pp. 1208-1213.
7. P. N. Belhumeur, J. P. Hespanha, and D. Kriegman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
8. X. He, D. Cai, and J. Han, "Learning a maximum margin subspace for image retrieval," IEEE Trans. Knowl. Data Eng., vol. 20, no. 2, pp. 189-201, Feb. 2008.
9. T. J. F. Wang, B. Zhao, and C. Zhang, "Unsupervised large margin discriminative projection," IEEE Trans. Neural Netw., vol. 22, no. 9, pp. 1446-1456, Sep. 2011.
10. A. Zien and J. Q. Candela, "Large margin non-linear embedding," in Proc. 22nd Int. Conf. Mach. Learn. (ICML), Aug. 2005, pp. 1060-1067.
11. V. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 1995.
12. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
13. A. Majumdar and R. K. Ward, "Robust classifiers for data reduced via random projections," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 5, pp. 1359-1371, Oct. 2010.
14. Q. Shi, C. Shen, R. Hill, and A. van den Hengel, "Is margin preserved after random projection?" in Proc. 29th Int. Conf. Mach. Learn. (ICML), 2012, pp. 1-8.
15. S. Paul, C. Boutsidis, M. Magdon-Ismail, and P. Drineas, "Random projections for support vector machines," in Proc. Int. Conf. Artif. Intell. (AISTATS), 2013, pp. 498-509.
16. J. K. Pillai, V. M. Patel, R. Chellappa, and N. K. Ratha, "Secure and robust iris recognition using random projections and sparse representations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 9, pp. 1877-1893, Sep. 2011.
17. M. Zhu and A. M. Martinez, "Subclass discriminant analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 8, pp. 1274-1286, Aug. 2006.
18. X.-W. Chen and T. Huang, "Facial expression recognition: A clusteringbased approach," Pattern Recognit. Lett., vol. 24, nos. 9-10, pp. 1295-1302, 2003.
19. R. Fletcher, Practical Methods of Optimization, 2nd ed. New York, NY, USA: Wiley, 1987.
20. K. R. Varshney and A. S. Willsky, "Learning dimensionality-reduced classifiers for information fusion," in Proc. 12th Int. Conf. Inf. Fusion, Jul. 2009, pp. 1881-1888.
21. D.-S. Pham and S. Venkatesh, "Robust learning of discriminative projection for multicategory classification on the Stiefel manifold," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-7.
22. K. Torkkola, "Feature extraction by non parametric mutual information maximization," J. Mach. Learn. Res., vol. 3, pp. 1415-1438, Mar. 2003.
23. D. P. Bertsekas, Nonlinear Programming, 2nd ed. Belmont, MA, USA: Athena Scientific, 1999.
24. C.-J. Lin, "Projected gradient methods for nonnegative matrix factorization," Neural Comput., vol. 19, no. 10, pp. 2756-2779, 2007.
25. C. Lin and J. J. Moré, "Newton's method for large bound-constrained optimization problems," SIAM J. Optim., vol. 9, no. 4, pp. 1100-1127, 1999.
26. J. C. Platt, N. Cristianini, and J. Shawe-Taylor, "Large margin DAGs for multiclass classification," in Advances in Neural Information Processing Systems, vol. 12. Cambridge, MA, USA: MIT Press, 2000, pp. 547-553.
27. J. Weston and C. Watkins, "Support vector machines for multi-class pattern recognition," in Proc. Eur. Symp. Artif. Neural Netw., Apr. 1999, pp. 1-6.
28. V. N. Vapnik, Statistical Learning Theory. New York, NY, USA: Wiley, 1998.
29. K. Crammer and Y. Singer, "On the learnability and design of output codes for multiclass problems," Mach. Learn., vol. 47, nos. 2-3, pp. 201-233, May 2002.
30. K. Crammer and Y. Singer, "On the algorithmic implementation of multiclass kernel-based vector machines," J. Mach. Learn. Res., vol. 2, pp. 265-292, Mar. 2001.
31. S. Nikitidis, N. Nikolaidis, and I. Pitas, "Multiplicative update rules for incremental training of multiclass support vector machines," Pattern Recognit., vol. 45, no. 5, pp. 1838-1852, May 2012.
32. B. Schölkopf et al., "Input space versus feature space in kernel-based methods," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1000-1017, Sep. 1999.
33. K. R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf, "An introduction to kernel-based learning algorithms," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 181-201, Mar. 2001.
34. B. Schölkopf and A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA, USA: MIT Press, 2002.
35. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
36. T. Kanade, J. F. Cohn, and Y. Tian, "Comprehensive database for facial expression analysis," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., Mar. 2000, pp. 46-53.
37. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database for studying face recognition in unconstrained environments," Univ. Massachusetts, Amherst, MA, USA, Tech. Rep. 7-49, 2007.
38. A. S. Georghiades, P. N. Belhumeur, and D. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
39. A. M. Martinez and R. Benavente, "The AR face database," CVC, Tech. Rep. 24, 1998.
40. B. Leibe and B. Schiele, "Analyzing appearance and contour based methods for object categorization," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2003, pp. 409-415.
41. C. Liu and H. Wechsler, "Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition," IEEE Trans. Image Process., vol. 11, no. 4, pp. 467-476, Apr. 2002.
42. A. M. Martinez and M. Zhu, "Where are linear feature extraction methods applicable?" IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 12, pp. 1934-1944, Dec. 2005.
43. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification," J. Mach. Learn. Res., vol. 9, pp. 1871-1874, Jun. 2008.
44. MATLAB, Version R2012b. MathWorks Inc., Natick, MA, USA, 2012.
45. F. De la Torre and T. Kanade, "Multimodal oriented discriminant analysis," in Proc. Int. Conf. Mach. Learn. (ICML), Aug. 2005, pp. 177-184.
46. T. Joachims, "Training linear SVMS in linear time," in Proc. 12th ACM Int. Conf. Knowl. Discovery Data Mining, Aug. 2006, pp. 217-226.
47. T. Joachims, T. Finley, and C.-N. J. Yu, "Cutting-plane training of structural SVMS," Mach. Learn., vol. 77, no. 1, pp. 27-59, 2009.
48. J. A. K. Suykens and J. Vandewalle, "Least squares support vector machine classifiers," Neural Process. Lett., vol. 9, no. 3, pp. 293-300, 1999.
49. E. Meyers and L. Wolf, "Using biologically inspired features for face processing," Int. J. Comput. Vis., vol. 76, no. 1, pp. 93-104, 2008.
50. L. Wolf, T. Hassner, and Y. Taigman, "Effective unconstrained face recognition by combining multiple descriptors and learned background statistics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 1978-1990, Oct. 2011.