Dynamic multi-objective evolution of classifier ensembles for video face recognition

Applied Soft Computing Journal

Volumn 13, Issue 6, 2013, Pages 3149-3166

  Connolly, Jean Francois ^a   Granger, Eric ^a   Sabourin, Robert ^a  

^a Laboratoire d'Imagerie de Vision et d'Intelligence Artificielle (LIVIA)   (Canada)

Author keywords

Adaptive biometrics; ARTMAP neural networks; Dynamic multi objective optimization; Ensemble methods; Face recognition in video; Incremental learning; Multi classifier systems

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPLEX NETWORKS; EVOLUTIONARY ALGORITHMS; MULTIOBJECTIVE OPTIMIZATION; PARTICLE SWARM OPTIMIZATION (PSO); PATTERN RECOGNITION; PATTERN RECOGNITION SYSTEMS; VIDEO STREAMING;

DYNAMIC MULTIOBJECTIVE OPTIMIZATION; ENSEMBLE METHODS; FACE RECOGNITION SYSTEMS; HETEROGENEOUS CLASSIFIERS; INCREMENTAL LEARNING; MULTICLASSIFIER SYSTEM; NEURAL NETWORK CLASSIFIER; VIDEO-BASED FACE RECOGNITION;

FACE RECOGNITION;

EID: 84881541695     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2012.08.039     Document Type: Article

References (67)

1. H. Abdulsalam, D. Skillicorn, P. Martin, Classification using streaming random forests, IEEE Transactions on Knowledge and Data Engineering 23 (1) (2011) 22-36.
2. O. Arandjelovic, R. Cipolla, A methodology for rapid illumination- invariant face recognition using image processing filters, Computer Vision and Image Understanding 113 (2) (2009) 159-171.
3. M. Barry, E. Granger, Comparison of ARTMAP neural networks for classification for face recognition from video, in: Proceedings of the IEEE International Joint Conference on Neural Networks, Orlando, USA, August, 2007, pp. 2256-2261.
4. A. Bifet, E. Frank, G. Holmes, B. Pfahringer, Accurate ensembles for data streams: combining restricted hoeffding trees using stacking, in: Proceedings of the Asian Conference on Machine Learning, Tokyo, Japan, 2010, pp. 225-240.
5. T. Blackwell, J. Branke, Multi-swarm optimization in dynamic environments, in: Proceedings of the Conference Applications of Evolutionary Computing, Coimbra, Portugal, April, 2004, pp. 489-500.
6. A. Blum, Empirical support for winnow and weighted-majority algorithms: results on a calendar scheduling domain, Machine Learning 26 (1) (1997) 5-23. (Pubitemid 127722997)
7. L. Breiman, Pasting small votes for classification in large databases and on-line, Machine Learning 36 (1) (1999) 85-103.
8. A. Carlisle, G. Dozier, Tracking changing extrema with adaptive particle swarm optimizer, in: Proceedings of the World Automation Congress, Orlando, FL, USA, June, 2002, pp. 265-270.
9. G.A. Carpenter, S. Grossberg, N. Markuzon, J.H. Reynolds, D.B. Rosen, Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multidimensional maps, IEEE Transactions on Systems, Man, and Cybernetics C 3 (5) (1992) 698-713. (Pubitemid 23555782)
10. L.-F. Chen, H.-Y. Liao, J.-C. Lin, Person identification using facial motion, in: Proceedings on Image Processing, vol. 2, 2001, pp. 677-680. (Pubitemid 33057796)
11. C. Coello, G. Pulido, M. Lechuga, Handling multiple objectives with particle swarm optimization, IEEE Transactions on Evolutionary Computation 8 (3) (2004) 256-279.
12. J.-F. Connolly, E. Granger, R. Sabourin, An adaptive ensemble of fuzzy ARTMAP neural networks for video-based face classification, in: Proceedings of the IEEE Congress on Evolutionary Computation, July, 2010, pp. 1-8.
13. J.-F. Connolly, E. Granger, R. Sabourin, An adaptive classification system for video-based face recognition, Information Sciences 192 (1) (2012) 50-70.
14. J.-F. Connolly, E. Granger, R. Sabourin, Evolution of heterogeneous ensembles through dynamic particle swarm optimization for video-based face recognition, Pattern Recognition 45 (7) (2012) 2460-2477.
15. K. Deb, A. Pratap, S. Agarwal, T. Meyarivan, A fast and elitist multiobjective genetic algorithm: NSGA. ii. Evolutionary Computation, IEEE Transactions on 6 (2) (2002) 182-197. (Pubitemid 34555372)
16. W. Du, B. Li, Multi-strategy ensemble particle swarm optimization for dynamic optimization, Information Science 178 (15) (2008) 3096-3109.
17. G. Edwards, C. Taylor, T. Cootes, Improving identification performance by integrating evidence from sequences, in: IEEE Proceedings on Computer Vision and Pattern Recognition, 1999, pp. 486-491.
18. H. Ekenel, L. Szasz-Toth, R. Stiefelhagen, Open-set face recognition-based visitor interface system, in: M. Fritz, B. Schiele, J. Piater (Eds.), Computer Vision Systems, Volume 5815 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, 2009, pp. 43-52.
19. A.P. Engelbrecht, Fundamental of Computational Swarm Intelligence, John Wiley &Sons, Chichester, UK, 2005 (Chapter 7.2).
20. J. Gama, P. Medas, G. Castillo, P. Rodrigues, Learning with drift detection, in: Advances in Artificial Intelligence, Springer-Verlag, New York, 1999, pp. 286-295. (Pubitemid 39751638)
21. V. Ganti, J. Gehrke, R. Ramakrishnan, Mining data streams under block evolution, ACM SIGKDD Explorations Newsletter 3 (1) (2002) 1-10.
22. D.O. Gorodnichy, Video-based framework for face recognition in video, in: Second Workshop on Face Processing in Video in Proceedings of the Conference on Computer and Robot Vision, Victoria, Canada, May, 2005, pp. 325-344.
23. E. Granger, P. Henniges, L.S. Oliveira, R. Sabourin, Supervised learning of fuzzy ARTMAP neural networks through particle swarm optimization, Journal of Pattern Recognition Research 2 (1) (2007) 27-60.
24. E. Granger, D. Prieur, J.-F. Connolly, Evolving ARTMAP neural networks using multi-objective particle swarm optimization, in: 2010 IEEE Congress on Evolutionary Computation (CEC), july 2010, vol. 1, pp. 1-8.
25. E. Granger, M.A. Rubin, S. Grossberg, P. Lavoie, A what-and-where fusion neural network for recognition and tracking of multiple radar emitters, Neural Networks 14 (2001) 325-344. (Pubitemid 32288861)
26. R. Gross, J. Shi, The CMU motion of body (MoBo) database, 2001, Technical Report CMU-RI-TR-01-18, Carnegie Mellon University, 2001.
27. S. Grossberg, Nonlinear neural networks: principles, mechanisms, and architectures, IEEE Transactions on Neural Networks 1 (1) (1988) 17-61.
28. X. Hu, R.C. Eberhart, Adaptive particle swarm optimization: detection and response to dynamic systems, in: Proceedings of the IEEE Congress on Evolutionary Computation, vol. 2, Honolulu, USA, May, 2002, pp. 1666-1670.
29. A.K. Jain, A. Ross, S. Pankanti, Biometrics: a tool for information security, IEEE Transactions on Information Forensics and Security 1 (2) (2006) 125-143. (Pubitemid 43824625)
30. X. Jiang, W. Ser, Online fingerprint template improvement, IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (8) (2002) 1121-1126.
31. M. Kapp, R. Sabourin, P. Maupin, Adaptive incremental learning with an ensemble of support vector machines, in: International Conference on Pattern Recognition, Istanbul, Turkey, August, 2010, pp. 4048-4051.
32. J. Kennedy, Some issues and practices for particle swarms, in: Proceedings of the IEEE International on Swarm Intelligence, Honolulu, USA, April, 2007, pp. 162-169. (Pubitemid 47431835)
33. J.Z. Kolter, M.A. Maloof, Dynamic weighted majority: an ensemble method for drifting concepts, Journal of Machine Learning Research 8 (1) (2007) 2755-2790.
34. L.I. Kuncheva, Classifier ensembles for changing environments, in: Proceedings of the International Workshop on Multiple Classifier Systems, Cagliari, Italy, 2004, pp. 1-15.
35. R. Li, T.R. Mersch, O.X. Wen, A. Kaylani, G.C. Anagnostopoulos, Multi-objective memetic evolution of art-based classifiers, in: Proceedings of the IEEE Congress on Evolutionary Computation, Barcelona, Spain, July, 2010, pp. 1-8.
36. X. Li, J. Branke, T. Blackwell, Particle swarm with speciation and adaptation in a dynamic environment, in: Proceedings of the Genetic and Evolutionary Computation Conference, Seattle, USA, July, 2006, pp. 51-58. (Pubitemid 44611294)
37. F. Matta, J.-L. Dugelay, Person recognition using facial video information: a state of the art, Journal of Visual Language and Computing 20 (3) (2009) 180-187.
38. L.L. Minku, A.P. White, X. Yao, The impact of diversity on online ensemble learning in the presence of concept drift, IEEE Transactions on Knowledge and Data Engineering 22 (5) (2010) 730-742.
39. A. Nickabadi, M.M. Ebadzadeh, R. Safabakhsh, DNPSO: a dynamic niching particle swarm optimizer for multi-modal optimization, in: Proceedings of the IEEE Congress on Evolutionary Computation, Hong Kong, China, May, 2008, pp. 26-32.
40. A. Nickabadi, M.M. Ebadzadeh, R. Safabakhsh, Evaluating the performance of DNPSO in dynamic environments, in: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Singapore, October, 2008, pp. 12-15.
41. K. Nishida, Learning and detecting concept drift, PhD Thesis, Hokkaido University, Sapporo, Japan, 2008.
42. D.F. Olivieira, A.M.P. Canuto, M.C.P. de Souto, Use of multi-objective genetic algorithms to investigate the diversity/accuracy dilemma in heterogeneous ensembles, in: Proceedings of the IEEE International Joint Conference on Neural Networks, Atlanta, USA, June, 2009, pp. 1238-1245.
43. N.C. Oza, Online ensemble learning, PhD Thesis, University of California, Berkeley, CA, 2000.
44. E. Ozcan, M. Yylmaz, Particle swarms for multimodal optimization, in: Proceedings of the International Conference on Adaptive and Natural Computing Algorithms, Warsaw, Poland, April, 2007, pp. 366-375.
45. N. Poh, W. Rita, J. Kittler, F. Roli, Challenges and research directions for adaptive biometric recognition systems, in: M. Tistarelli, M. Nixon (Eds.), Advances in Biometrics, Volume 5558 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, 2009, pp. 753-764.
46. R. Polikar, L. Udpa, S.S. Udpa, V. Honavar, Learn++: an incremental learning algorithm for supervised neural networks, IEEE Transactions on Systems, Man, and Cybernetics C 31 (4) (2001) 497-508. (Pubitemid 34191829)
47. M.A. Potter, K.A.D. Jong, Cooperative coevolution: an architecture for evolving coadapted subcomponents, Evolutionary Computation 8 (2000) 1-29.
48. T. Rashid, A heterogeneous ensemble network using machine learning techniques, International Journal of Computer Science an Network Security 9 (8) (2009) 335-339.
49. A. Rattani, Adaptive biometric system based on template update procedures, PhD Thesis, University of Cagliari, Cagliari, Italy, 2010.
50. M. Reyes-Sierra, C.A.C. Coello, Multi-objective particle swarm optimizers: a survey of the state-of-the-art, International Journal of Computational Intelligence Research 2 (3) (2006) 287-308.
51. F. Roli, L. Didaci, G. Marcialis, Adaptive biometric systems that can improve with use, in: N.K. Ratha, V. Govindaraju (Eds.), Advances in Biometrics, Springer, London, 2008, pp. 447-471.
52. M. Scholz, R. Klinkenberg, Boosting classifiers for drifting concepts, Intelligent Data Analysis (IDA) 11 (1) (2006) 1-28 (special issue on Knowledge Discovery from Data Streams).
53. J. Stallkamp, H. Ekenel, R. Stiefelhagen, Video-based face recognition on realworld data, in: IEEE 11th International Conference on Computer Vision 2007, ICCV 2007, vol. 1, October, 2007, pp. 1-8.
54. W.N. Street, Y.S. Kim, A streaming ensemble algorithm (SEA) for large-scale classification, in: Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2001, pp. 377-382.
55. A. Tsymbla, M. Pechenizkiy, P. Cunningham, S. Puuronen, Dynamic integration of classifiers for handling concept drift, Information Fusion 9 (1) (2008) 56-68. (Pubitemid 47589061)
56. M.A. Turk, A.P. Pentland, Eigenfaces for recognition, Journal of Cognitive Neurosicence 1 (3) (1991) 71-86.
57. U. Uludag, A. Ross, A. Jain, Biometric template selection and update: a case study in fingerprints, Pattern Recognition 37 (7) (2004) 1533-1542. (Pubitemid 38653380)
58. G. Valentini, Ensemble methods based on bias-variance analysis, PhD Thesis, University of Genova, Genova, Switzerland, 2003.
59. H. Wang, W. Fan, P.S. Yu, J. Han, Mining concept drifting data streams using ensemble classifiers, Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2003) 226-235.
60. H. Wang, D. Wang, S. Yang, Triggered memory-based swarm optimization in dynamic environments, in: Applications of Evolutionary Computing, Valencia, Spain, April, 2007, pp. 637-646.
61. G. Widmer, M. Kubat, Learning in the presence of concept drift and hidden contexts, Machine Learning 23 (1) (1996) 69-101. (Pubitemid 126737384)
62. Z. Xingquan, W. Xindong, Y. Ying, Dynamic classifier selection for effective mining from noisy data streams, in: IEEE Proceedings of the International Conference on Data Mining, 2004, pp. 305-312.
63. X. Zhang, Y. Gaoa, Face recognition across pose: a review, Pattern Recognition 42 (11) (2009) 2876-2896.
64. W.Y. Zhao, R. Chellappa, P.J. Phillips, A.P. Rosenfeld, Face recognition: a literature survey, ACM Computing Surveys 35 (4) (2003) 399-458.
65. S. Zhou, V. Krueger, R. Chellappa, Probabilistic recognition of human faces from video, Computer Vision and Image Understanding 91 (2003) 214-245.
66. E. Zitzler, L. Thiele, Multiobjective evolutionary algorithms: a comparative case study and the strength pareto approach, IEEE Transactions on Evolutionary Computation, 3 (November (4)) (1999) 257-271. (Pubitemid 30544879)
67. I. Zliobaite, Learning under concept drift: an overview, CoRR, abs/1010.4784, 2010.