Ensemble-based discriminant learning with boosting for face recognition

IEEE Transactions on Neural Networks

Volumn 17, Issue 1, 2006, Pages 166-178

  Lu, Juwei ^a   Plataniotis, K N ^a   Venetsanopoulos, A N ^a   Li, Stan Z ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b INSTITUTE OF AUTOMATION   (China)

Author keywords

Boosting; Face recognition (FR); Linear discriminant analysis; Machine learning; Mixture of linear models; Small sample size (SSS) problem; Strong learner

Indexed keywords

DATA PROCESSING; LEARNING SYSTEMS; MATHEMATICAL MODELS; STATISTICAL METHODS;

ENSEMBLE-BASED APPROACH; LINEAR DISCRIMINANT ANALYSIS; LINEAR MODELS MIXTURE; SMALL-SAMPLE-SIZE (SSS) PROBLEM;

FACE RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; FACE; FACTUAL DATABASE;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DATABASES, FACTUAL; FACE; PATTERN RECOGNITION, AUTOMATED;

EID: 33144466471     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2005.860853     Document Type: Article

References (59)

1. A. Samal and P. A. Iyengar, "Automatic recognition and analysis of human faces and facial expressions: A survey," Pattern Recognit., vol. 25, pp. 65-77, 1992.
2. D. Valentin, H. A. Alice, J. O. Toole, and G. W. Cottrell, "Connectionist models of face processing: A survey," Pattern Recognit., vol. 27, no. 9, pp. 1209-1230, 1994.
3. R. Chellappa, C. L. Wilson, and S. Sirohey, "Human and machine recognition of faces: A survey," Proc. IEEE, vol. 83, no. 5, pp. 705-740, May 1995.
4. S. Gong, S. J. McKenna, and A. Psarrou, Dynamic Vision From Images to Face Recognition, Singapore: World Scientific, May 2000.
5. M. Turk, "A random walk through eigenspace," IEICE Trans. Inf. Syst., vol. E84-D, no. 12, pp. 1586-1695, Dec. 2001.
6. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Comput. Surv., vol. 35, no. 4, pp. 399-458, Dec. 2003.
7. M. A. Turk and A. P. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
8. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
9. B. Moghaddam, T. Jebara, and A. Pentland, "Bayesian face recognition," Pattern Recognit., vol. 33, pp. 1771-1782, 2000.
10. W. Zhao, R. Chellappa, and J. Phillips, "Subspace linear discriminant analysis for face recognition," Univ. Maryland, College Park, MD, Tech. Rep., CS-TR4009, 1999.
11. L.-F. Chen, H.-Y. M. Liao, M.-T. Ko, J.-C. Lin, and G.-J. Yu, "A new LDA-based face recognition system which can solve the small sample size problem," Pattern Recognit., vol. 33, pp. 1713-1726, 2000.
12. H. Yu and J. Yang, "A direct LDA algorithm for high-dimensional data - With application to face recognition," Pattern Recognit., vol. 34, pp. 2067-2070, Oct. 2001.
13. C. Liu and H. Wechsler, "Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition," IEEE Trans. Image Process., vol. 11, no. 4, pp. 467-476, Apr. 2002.
14. J. Ye and Q. Li, "LDA/QR: An efficient and effective dimension reduction algorithm and its theoretical foundation," Pattern Recognit., vol. 37, no. 4, pp. 851-854, Apr. 2004.
15. M. J. Er, W. Chen, and S. Wu, "High-speed face recognition based on discrete cosine transform and rbf neural networks," IEEE Trans. Neural Netw., vol. 16, no. 3, pp. 679-691, May 2005.
16. S. J. Raudys and A. K. Jain, "Small sample size effects in statistical pattern recognition: Recommendations for practitioners," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 3, pp. 252-264, Mar. 1991.
17. M. Bichsel and A. P. Pentland, "Human face recognition and the face image set's topology," CVGIP: Image Understanding, vol. 59, pp. 254-261, 1994.
18. S. Kutin, "Algorithmic Stability and Ensemble-Based Learning," Ph.D. Thesis, Faculty Div. Phys. Sci., Univ. Chicago, June 2002.
19. B. Schölkopf, A. Smola, and K. R. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, pp. 1299-1319, 1999.
20. G. Baudat and F. Anouar, "Generalized discriminant analysis using a kernel approach," Neural Comput., vol. 12, pp. 2385-2404, 2000.
21. K.-R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf, "An introduction to kernel-based learning algorithms," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 181-201, Mar. 2001.
22. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using feature optimization and v-support vector learning," in Proc. IEEE Int. Workshop Neural Networks for Signal Processing, Falmouth, MA, Sep. 2001, pp. 373-382.
23. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using kernel direct discriminant analysis algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 117-126, Jan. 2003.
24. M. Wang and S. Chen, "Enhanced fmam based on empirical kernel map," IEEE Trans. Neural Netw., vol. 16, no. 3, pp. 557-564, May 2005.
25. S. Pang, D. Kim, and S. Y. Bang, "Face membership authentication using svm classification tree generated by membership-based lle data partition," IEEE Trans. Neural Netw., vol. 16, no. 2, pp. 436-446, Mar. 2005.
26. H. Xiong, M. N. S. Swamy, and M. O. Ahmad, "Optimizing the kernel in the empirical feature space," IEEE Trans. Neural Netw., vol. 16, no. 2, pp. 460-474, Mar. 2005.
27. A. Pentland, B. Moghaddam, and T. Starner, "View-based and modular eigenspaces for face recognition," in Proc. Computer Vision and Pattern Recognition Conf., June 1994, pp. 1-7.
28. K.-K. Sung and T. Poggio, "Example-based learning for view-based human face detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 1, pp. 39-51, Jan. 1998.
29. B. J. Frey, A. Colmenarez, and T. S. Huang, "Mixtures of local linear subspaces for face recognition," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Santa Barbara, CA, Jun. 1998, pp. 32-37.
30. J. Lu and K. N. Plataniotis, "Boosting face recognition on a large-scale database," in Proc. IEEE Int. Conf. Image Processing, Rochester, NY, Sep. 2002, pp. II.109-II.112.
31. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, no. 1, pp. 119-139, 1997.
32. R. E. Schapire, "The boosting approach to machine learning: An overview," MSRI Workshop Nonlinear Estimation and Classification, pp. 149-172, 2002.
33. H. Drucker and C. Cortes, "Boosting decision trees," Adv. Neural Inform. Process. Syst. 8, pp. 479-485, 1996.
34. R. E. Schapire, Y. Freund, P. Bartlett, and W. S. Lee, "Boosting the margin: A new explanation for the effectiveness of voting methods," in Proc. 14th Int. Conf. Machine Learning, 1997, pp. 322-330.
35. L. Breiman, "Arcing classifiers," Ann. Statistics, vol. 26, no. 3, pp. 801-849, 1998.
36. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
37. L. Breiman, "Population theory for boosting ensembles," Ann. Statistics, vol. 32, no. 1, pp. 1-11, 2004.
38. L. Breiman, "Bagging predictors," Mach. Learn., vol. 24, no. 2, pp. 123-140, 1996.
39. M. Skurichina and R. P. W. Duin, "Bagging, boosting and the random subspace method for linear classifiers," Pattern Anal. Appl., vol. 5, no. 2, pp. 121-135, Jun. 2002.
40. A. Murua, "Upper bounds for error rates of linear combinations of classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 591-602, May 2002.
41. P. Viola, M. J. Jones, and D. Snow, "Detecting pedestrians using patterns of motion and appearance," in Proc. 9th IEEE Int. Conf. Computer Vision, vol. 2, Oct. 2003, pp. 734-741.
42. K. Tieu and P. Viola, "Boosting image retrieval," Int. J. Comput. Vis., vol. 56, no. 1, pp. 17-36, 2004.
43. P. Viola and M. J. Jones, "Robust real-time face detection," Int. J. Comput. Vis., vol. 57, pp. 137-154, May 2004.
44. Y. Freund and R. E. Schapire, "A discussion of "process consistency for adaboost" by wenxin jiang, "on the bayes-risk consistency of regularized boosting methods" by gbor lugosi and nicolas vayatis, "statistical behavior and consistency of classification methods based on convex risk minimization" by tong zhang," Ann. Statist., vol. 32, no. 1, 2004.
45. A. J. Grove and D. Schuurmans, "Boosting in the limit: Maximizing the margin of learned ensembles," in Proc. 15th Nat. Conf. Artifical Intelligence, July 1998, pp. 692-699.
46. C. Rudin, R. E. Schapire, and I. Daubechies, "Boosting based on a smooth margin," in COLT (Computational Learning Theory), J. Shawe-Taylor and Y. Singer, Eds. New York: Springer-Verlag, 2004.
47. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using LDA based algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 195-200, Jan. 2003.
48. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Regularized discriminant analysis for the small sample size problem in face recognition," Pattern Recognit. Lett., vol. 24, no. 16, pp. 3079-3087, Dec. 2003.
49. R. Lotlikar and R. Kothari, "Fractional-step dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 6, pp. 623-627, Jun. 2000.
50. Out-of-Bag Estimation, L. Breiman. (1996). [Online]. Available: ftp:// ftp.stat.berkeley.edu/pub/users/breiman/OOBestimation.ps.Z
51. J. Lu, "Discriminant learning for face recognition," Ph.D. Dissertation, The Edward S. Rogers Sr. Dept. Elect. Comp. Eng., Univ. Toronto, Toronto, Canada, Jun. 2004.
52. Image Group, Information Access Division, ITL, NIST (2004, Jan.). [Online]. Available: http://www.itl.nist.gov/iad/humanid/feret/
53. P. J. Phillips, H. Moon, S. A. Rizvi, and P. J. Rauss, "The FERET evaluation methodology for face-recognition algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
54. P. J. Phillips, H. Wechsler, J. Huang, and P. Rauss, "The FERET database and evaluation procedure for face recognition algorithms," Image Vis. Comput. J., vol. 16, no. 5, pp. 295-306, 1998.
55. L.-F. Chen, H.-Y. M. Liao, J.-C. Lin, and C.-C. Han, "Why recognition in a statistics-based face recognition system should be based on the pure face portion: A probabilistic decision-based proof," Pattern Recognit., vol. 34, no. 7, pp. 1393-1403, 2001.
56. P. J. Phillips and E. M. Newton, "Meta-analysis of face recognition algorithms," in Proc. 5th IEEE Int. Conf. Automatic Face and Gesture Recognition, Washinton, DC, May 20-21, 2002, pp. 235-241.
57. B. Moghaddam, "Principal manifolds and probabilistic subspaces for visual recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 6, pp. 780-788, Jun. 2002.
58. Evaluation of Face Recognition Algorithms Website, R. Beveridge and B. Draper. (2004, Dec.). [Online]. Available: http://www.cs.colostate.edu/ evalfacerec
59. R. Xu and D. Wunsch II, "Survey of clustering algorithms," IEEE Trans. Neural Netw., vol. 16, no. 3, pp. 645-678, May 2005.