An evaluation of video-to-video face verification

IEEE Transactions on Information Forensics and Security

Volumn 5, Issue 4, 2010, Pages 781-801

  Poh, Norman ^a   Chan, Chi Ho ^a   Kittler, Josef ^a   Marcel, Sébastien ^b   Mc Cool, Christopher ^b   Rúa, Enrique Argones ^c   Alba Castro, José Luis ^c   Villegas, Mauricio ^d   Paredes, Roberto ^d   Štruc, Vitomir ^e   Pavešić, Nikola ^e   Salah, Albert Ali ^f   Fang, Hui ^g   Costen, Nicholas ^h  

^a UNIVERSITY OF SURREY   (United Kingdom)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

^c UNIVERSITY OF VIGO   (Spain)

^d INSTITUTO TECNOLÓGICO DE INFORMÁTICA   (Spain)

^e UNIVERSITY OF LJUBLJANA   (Slovenia)

^f UNIVERSITY OF AMSTERDAM   (Netherlands)

^g SWANSEA UNIVERSITY   (United Kingdom)

^h MANCHESTER METROPOLITAN UNIVERSITY   (United Kingdom)

Author keywords

Biometric authentication; face video recognition

Indexed keywords

ACADEMIC INSTITUTES; BIOMETRIC AUTHENTICATION; FACE AUTHENTICATION; FACE VERIFICATION; FACIAL FEATURE; FEATURE REPRESENTATION; IDENTITY DOCUMENTS; IDENTITY VERIFICATION; PERSON RECOGNITION; QUALITY INFORMATION; QUERY SELECTION; STILL IMAGES; SYSTEM ACCURACY; VIDEO DATA; VIDEO RECOGNITION;

AUTHENTICATION; BIOMETRICS; FEATURE EXTRACTION; MOBILE DEVICES; QUERY PROCESSING; VIDEO RECORDING;

FACE RECOGNITION;

EID: 78649480786     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2010.2077627     Document Type: Article

References (106)

1. D. O. Gorodnichy, "Introduction to the first IEEE workshop on face processing in video", in Proc. Conf. Computer Vision and Pattern Recognition Workshop (CVPRW '04), Jun. 2004, pp. 61-61.
2. D. O. Gorodnichy, "Video-based framework for face recognition in video", in Proc. 2nd Canadian Conf. Computer and Robot Vision, May 2005, pp. 330-338.
3. L. Itti and C. Koch, "Computational modelling of visual attention", Nature Rev. Neurosci., vol. 2, no. 3, pp. 194-203, Mar. 2001.
4. D. O. Gorodnichy, "Seeing faces in video by computers. editorial for special issue on face processing in video sequences", Image Vision Comput., vol. 24, no. 6, pp. 551-556, Jun. 2006.
5. P. Sinha, B. Balas, Y. Ostrovsky, and R. Russell, "Face recognition by humans: Nineteen results all computer vision researchers should know about", Proc. IEEE, vol. 94, no. 11, pp. 1948-1962, Nov. 2006.
6. H. Wechsler, Reliable Face Recognition Methods: System Design, Implementation and Evaluation. New York: Springer, 2007.
7. M. Everingham, J. Sivic, and A. Zisserman, "Taking the bite out of automated naming of characters in tv video", Image Vision Comput., vol. 27, no. 5, pp. 545-559, 2009.
8. D. O. Gorodnichy and O. P. Gorodnichy, "Using associative memory principles to enhance perceptual ability of vision systems", in Proc. 2004 Conf. Computer Vision and Pattern Recognition Workshop (CVPRW'04), Washington, DC, 2004, vol. 5, p. 79, IEEE Computer Society.
9. A. J. O'Toole, P. J. Phillips, F. Jiang, J. H. Ayyad, N. Penard, and H. Abdi, "Face recognition algorithms surpass humans matching faces over changes in illumination", IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 9, pp. 1642-1646, Sep. 2007.
10. K. Messer, J. Kittler, M. Sadeghi, M. Hamouz, A. Kostyn, S. Marcel, S. Bengio, F. Cardinaux, C. Sanderson, N. Poh, Y. Rodriguez, K. Kryszczuk, J. Czyz, L. Vandendorpe, J. Ng, H. Cheung, and B. Tang, "Face authentication competition on the BANCA database", in Intl. Conf. Biometric Authentication, 2004, pp. 8-15.
11. K. Messer, J. Kittler, M. Sadeghi, M. Hamouz, A. Kostin, F. Cardinaux, S. Marcel, S. Bengio, C. Sanderson, N. Poh, Y. Rodriguez, J. Czyz, L. Vandendorpe, C. McCool, S. Lowther, S. Sridharan, V. Chandran, R. P. Palacios, E. Vidal, L. Bai, L.-L. Shen, Y. Wang, C. Yueh-Hsuan, H.-C. Liu, Y.-P. Hung, A. Heinrichs, M. Muller, A. Tewes, C. vd Malsburg, R. Wurtz, Z. Wang, F. Xue, Y. Ma, Q. Yang, C. Fang, X. Ding, S. Lucey, R. Goss, and H. Schneiderman, "Face authentication test on the BANCA database", in Int. Conf. Pattern Recognition (ICPR), 2004, vol. 4, pp. 523-532.
12. P. J. Phillips, P. J. Flynn, T. Scruggs, K. W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the face recognition grand challenge", in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2005, pp. 947-954.
13. R. Stiefelhagen, K. Bernardin, R. Bowers, R. T. Rose, M. Michel, and J. Garofolo, "The CLEAR 2007 evaluation", in Proc. Multimodal Technologies for Perception of Humans: Int. Evaluation Workshops (CLEAR 2007 and RT 2007), Baltimore, MD, May 8-11, 2007, pp. 3-34, Revised Selected Papers.
14. B. Moghaddam and A. Pentland, "Probabilistic visual learning for object representation", IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 696-710, Jul. 1997.
15. A. Fourney and R. Laganiere, "Constructing face image logs that are both complete and concise", in Proc. 4th Canadian Conf. Computer and Robot Vision, 2007, pp. 488-494.
16. M. Turk and A. Pentland, "Eigenfaces for recognition", J. Cogn. Neurosci., vol. 3, pp. 72-86, 1991.
17. K. Okada, J. Steffans, T. Maurer, H. Hong, E. Elagin, H. Neven, and C. Von der Malsburg, "The bochum/USC face recognition system and how it fared in the FERET phase iii test", in Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, Eds. Berlin: Springer-Verlag, 1998, pp. 186-205.
18. L. Wiskott, J.-M. Fellous, and C. Von der Malsburg, "Face recognition by elastic bunch graph matching", IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 775-779, Jul. 1997. (Pubitemid 127762270)
19. S. Lin, S. Y. Kung, and L. J. Lin, "Face recognition/detection by probabilistic decision based neural network", IEEE Trans. Neural Netw., vol. 8, no. 1, pp. 114-132, Jan. 1997.
20. B. V. K. Vijaya Kumar, M. Savides, C. Xie, K. Venkataramani, J. Thornton, and A. Mahalanobis, "Biometric verification with correlation filters", Appl. Opt., vol. 43, no. 2, pp. 391-402, 2004.
21. C. Xie, B. V. K. Vijaya Kumar, S. Palanivel, and B. Yegnanarayana, "A still-to-video face verification system using advanced correlation filters", in Proc. Int. Conf. Biometric Authentication, 2004, vol. 3072, Springer LNCS, pp. 102-108.
22. P. Refregier, "Optimal trade-off filters for noise robustness, sharpness of the correlation peak, and horner efficiency", Opt. Lett., vol. 16, pp. 829-831, 1991.
23. B. V. K. Vijaya Kumar, A. Mahalanobis, and A. Takessian, "Optimal trade-off circular harmonic function correlation filter methods providing controlled in-plane rotation response", IEEE Trans. Image Process., vol. 9, no. 6, pp. 1025-1034, 2000.
24. B. V. K. Vijaya Kumar and A. Mahalanobis, "Recent advances in composite correlation filter designs", Asian J. Phys., vol. 8:4, pp. 407-420, 1999.
25. C. H. Chan, J. Kittler, N. Poh, T. Ahonen, and M. Pietikainen", (Multiscale) local phase quantization histogram discriminant analysis with score normalisation for robust face recognition", in Proc. 1st IEEE Workshop Video-Oriented Object and Event Classification, Kyoto, Japan, 2009.
26. Y.-L. Wu, L. Jiao, G. Wu, E. Y. Chang, and Y.-F. Wang, "Invariant feature extraction and biased statistical inference for video surveillance", in Proc. IEEE Conf. Advanced Video and Signal Based Surveillance, 2003, pp. 284-289.
27. A. R. Dick and M. J. Brooks, "Issues in automated visual surveillance", in Proc. 7th Digital Image Comp. Tech. and Appl., 2003, pp. 195-204.
28. W. Liu, Z. F. Li, and X. Tang, "Spatio-temporal embedding for statistical face recognition from video", in Proc. Eur. Conf. Computer Vision, 2006, vol. 3952, Pt. II, Springer LNCS, pp. 374-388.
29. Y. Zhang and A. M. Martinez, "A weighted probabilistic approach to face recognition from multiple images and video sequences", Image Vision Comput., vol. 24, pp. 626-638, 2006.
30. Y. Xu, A. Roy Chowdhury, and K. Patel, "Pose and illumination invariant face recognition in video", in Proc. CVPR, 2007, pp. 1-7.
31. V. Blanz and T. Vetter, "A morphable model for the synthesis of 3D faces", in Proc. SIGGRAPH99, 1999, pp. 187-194.
32. V. Blanz and T. Vetter, "Face recognition based on fitting a 3D morphable model", IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1063-1074, Sep. 2003.
33. A. Georghiades, P. N. Belhumeur, and D. Kriegman, "From few to many: Generative models for recognition under variable pose and illumination", in Proc. Automatic Face and Gesture Recognition, 2000, pp. 277-284.
34. U. Park and A. K. Jain, "3D model-based face recognition in video", in Proc. Int. Conf. Biometrics, 2007, pp. 1085-1094.
35. D. De Carlo and D. Metaxas, "Optical flow constraints on deformable models with applications to face tracking", Int. J. Comput. Vis., vol. 38, pp. 99-127, 2000.
36. K. C. Lee, J. Ho, M. H. Yang, and D. Kriegman, "Video-based face recognition using probabilistic appearance manifolds", in IEEE Int. Conf. Computer Vision and Pattern Recognition, 2003, pp. 313-320.
37. B. Triggs, P. F. McLauchlan, R. I. Hartley, and A. W. Fitzgibbon, "Bundle adjustment - A modern synthesis", in Proc. Int. Workshop on Vision Algorithms (ICCV '99), 2000, pp. 298-372, Springer-Verlag.
38. Y. Li, S. Gong, and H. Liddell, "Modelling face dynamics across views and over time", in Proc. Int. Conf. Computer Vision, 2000, pp. 554-559.
39. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models", IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001.
40. G. J. Edwards, C. J. Taylor, and T. F. Cootes, "Learning to identify and track faces in image sequences", in Proc. 6th Int. Conf. Computer Vision, Jan. 1998, pp. 317-322.
41. J. Xiao, S. Baker, I. Matthews, and T. Kanade, "Real-time combined 2D+3D active appearance models", in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004, vol. 2, pp. 535-542.
42. R. Gross, I. Matthews, and S. Baker, "Constructing and fitting active appearance models with occlusion", in Proc. Conf. Computer Vision and Pattern Recognition Workshop, 2004 (CVPRW '04), Jun. 2004, p. 72.
43. R. Gross, I. Matthews, and S. Baker, "Generic vs. person specific active appearance models", Image Vision Comput., vol. 23, no. 1, pp. 1080-1093, 2005.
44. J. M. Saragih, S. Lucey, and J. F. Cohn, "Face alignment through subspace constrained mean-shifts", in Proc. Int. Conf. Computer Vision, 2009, pp. 1034-1041.
45. D. Beymer and T. Poggio, "Face recognition from one example view", in Proc. IEEE Int. Conf. Computer Vision, 1995, pp. 500-507.
46. J. Heo and M. Savides, "In between 3D active appearance models and 3D morphable models", in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition Workshops, 2009 (CVPR Workshops 2009), Jun. 2009, pp. 20-26.
47. A. Roy Chowdhury and R. Chellappa, "Face reconstruction from monocular video using uncertainty analysis and a generic model", Comput. Vision Image Understanding, vol. 91, no. 1-2, pp. 188-213, 2003.
48. A. Pentland, B. Moghaddam, and T. Starner, "View-based and modular eigenspaces for face recognition", in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 1994 (CVPR '94), Jun. 1994, pp. 84-91.
49. Y. Li, S. Gong, and H. Liddell, "Constructing facial identity surfaces in a nonlinear discriminating space", in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2001 (CVPR 2001), 2001, vol. 2, pp. II-258-II-263.
50. X. Chai, S. Shan, X. Chen, and W. Gao, "Local linear regression (llr) for pose invariant face recognition", in Proc. Automatic Modeling of Face and Gesture, 2006, pp. 631-636. (Pubitemid 44711419)
51. S. J. McKenna and S. Gong, "Non-intrusive person authentication for access control by visual tracking and face recognition", in Proc. Int. Conf. Audio- and Video-Based Person Authentication, 1997, pp. 177-183.
52. B. Li and R. Chellappa, "Face verification through tracking facial features", J. Opt. Soc. Amer., vol. 18, pp. 2969-2981, 2001.
53. M. Isard and A. Blake, "Contour tracking by stochastic propagation of conditional density", in Proc. Eur. Conf. Computer Vision, 1996, pp. 343-356.
54. J. Liu and R. Chen, "Sequential monte carlo methods for dynamic systems", J. Amer. Statist. Assoc., vol. 93, pp. 1031-1041, 1998.
55. S. Zhou, V. Krueger, and R. Chellappa, "Probabilistic recognition of human faces from video", Comput. Vision Image Understanding, vol. 91, no. 1, pp. 214-245, 2003.
56. J. M. Buenaposada, J. Bekios, and L. Baumela, "Apperance-based tracking and face identification in video sequences", in Proc. AMDO, 2008, pp. 349-358.
57. J. M. Buenaposada, E. Munoz, and L. Baumela, "Efficiently estimating facial expression and illumination in appearance-based tracking", in Proc. British Machine Vision Conf., 2006, pp. 57-66.
58. K. C. Lee and D. Kriegman, "Online learning of probabilistic appearance manifolds for video-based recognition and tracking", in Proc. CVPR, 2005, vol. I, pp. 852-859. (Pubitemid 43897282)
59. F. Matta and J.-L. Dugelay, "Video face recognition: A physiological and behavioural multimodal approach", in Proc. ICIP (4), 2007, pp. 497-500.
60. G. Aggarwal, A. K. Roy Chowdhury, and R. Chellappa, "A system identification approach for video-based face recognition", in Proc. ICPR (4), 2004, pp. 175-178.
61. G. Shakhnarovich, J. W. Fisher, and T. Darrel, "Face recognition from long-term observations", in Proc. Eur. Conf. Computer Vision, 2002, Springer LNCS, pp. 851-868.
62. O. Arandjelović, G. Shakhnarovich, J. Fisher, R. Cipolla, and T. Darrell, "Face recognition with image sets using manifold density divergence", in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2005 (CVPR 2005), Jun. 2005, vol. 1, pp. 581-588.
63. S. Satoh, "Comparative evaluation of face sequence matching for content-based video access", in Proc. Fourth IEEE Int. Conf. Automatic Face and Gesture Recognition, 2000, 2000, pp. 163-168.
64. O. Yamaguchi, K. Fukui, and K. Maeda, "Face recognition using temporal image sequence", in Proc. Int. Conf. Automatic Face and Gesture Recognition, 10, 1998, pp. 318-323.
65. M. Nishiyama, O. Yamaguchi, and K. Fukui, "Face recognition with the multiple constrained mutual subspace method", in Lecture Notes in Computer Science, 2005, vol. 3546/2005, pp. 71-80.
66. L. Wolf and A. Shashua, "Learning over sets using kernel principal angles", J. Mach. Learning Res., vol. 4, no. 10, pp. 913-931, 2003.
67. T. K. Kim, O. Arandjelović, and R. Cipolla, "Learning over sets using boosted manifold principal angles (BoMPA)", in Proc. IAPR British Machine Vision Conf. (BMVC), Oxford, U. K., Sep. 2005, pp. 779-788.
68. K. Fukui and O. Yamaguchi, "Face recognition using multi-viewpoint patterns for robot vision", in Robotics Research, Springer Tracts in Advanced Robotics, 2003, vol. 15/2005, pp. 192-201.
69. T.-K. Kim, J. Kittler, and R. Cipolla, "Discriminative learning and recognition of image set classes using canonical correlations", IEEE Trans. Patern Anal. Mach. Intell., vol. 29, no. 6, pp. 1005-1018, Jun. 2007.
70. E. Kokiopoulou and P. Frossard, "Video face recognition with graphbased semi-supervised learning", in Proc. ICME, 2009, pp. 1564-1565.
71. A. Mian, "Unsupervised learning from local features for video-based face recognition", in Proc. 8th IEEE Int. Conf. Automatic Face Gesture Recognition, 2008 (FG '08), Sep. 2008, pp. 1-6.
72. D. Lowe, "Distinctive image features from scale-invariant key points", Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, 2004.
73. X. Liu and T. Chen, "Video-based face recognition using adaptive hidden markov models", in IEEE Int. Conf. Computer Vision and Pattern Recognition, 2003, pp. 340-345.
74. R. Gross and V. Brajovic, "An image preprocessing algorithm for illumination invariant face recognition", in Audio- and Video-Based Biometric Person Authentication. Berlin/Heidelberg: Springer, Jun. 2003, vol. 2688/2003, Lecture Notes in Computer Science, pp. 10-18.
75. L. Wiskott, J.-M. Fellous, N. Krüger, and C. von der Malsburg, "Face recognition by elastic bunch graph matching", IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 775-779, Jul. 1997. (Pubitemid 127762270)
76. Y. Linde, A. Buzo, and R. M. Gray, "An algorithm for vector quantizer design", IEEE Trans. Commun., vol. 28, no. 1, pp. 84-94, Jan. 1980.
77. J.-L. Gauvain and C. H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains", IEEE Trans. Speech Audio Process., vol. 2, pp. 291-298, Apr. 1994.
78. J. L. Alba Castro, D. González Jiménez, E. A. Rúa, E. González Agulla, and E. Otero Muras, "Pose-corrected face processing on video sequences for webcam-based remote biometric authentication", J. Electron. Imaging, vol. 17, no. 1, p. 011004, Jan. 2008.
79. F. Cardinaux, C. Sanderson, and S. Marcel, "Comparison of MLP and GMM classifiers for face verification on XM2VTS", in Lecture Notes in Computer Science, 2003, vol. 2688/2003, pp. 1058-1059, Springer.
80. G. Heusch, Y. Rodriguez, and S. Marcel, "Local binary patterns as an image preprocessing for face authentication", in IEEE Int. Conf. Automatic Face and Gesture Recognition (AFGR), 2006, pp. 9-14. (Pubitemid 44711320)
81. F. Cardinaux, C. Sanderson, and S. Bengio, "User authentication via adapted statistical models of face images", IEEE Trans. Signal Process., vol. 54, no. 1, pp. 361-373, Jan. 2005.
82. S. Baker, I. Matthews, and J. Schneider, "Automatic construction of active appearance models as an image coding problem", IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 10, pp. 1380-1384, Oct. 2004.
83. T. F. Cootes, S. Marsland, C. J. Twining, K. Smith, and C. J. Taylor, "Groupwise diffeomorphic non-rigid registration for automatic model building", in Proc. ECCV, 2004, pp. 316-327.
84. T. F. Cootes, C. J. Twining, V. Petrovic, R. Schestowitz, and C. J. Taylor, "Groupwise construction of appearance model using piece-wise affine deformations", in Proc. BMVC, 2005, pp. 879-888.
85. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models", IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001.
86. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection", IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
87. H. Fang and N. Costen, "Behavioral consistency extraction for face verification", in Revised Selected and Invited Papers, Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions: COST Action 2102 Int. Conf., Prague, Czech Republic, Oct. 15-18, 2008, pp. 291-305.
88. M. Villegas and R. Paredes, "Simultaneous learning of a discriminative projection and prototypes for nearest-neighbor classification", in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2008), 2008, pp. 1-8.
89. R. Paredes, J. C. Pérez, A. Juan, and E. Vidal, "Local representations and a direct voting scheme for face recognition", in Proc. Workshop on Pattern Recognition in Information Systems (PRIS 01), Setúbal, Portugal, Jul. 2001.
90. M. Villegas and R. Paredes, "Illumination invariance for local feature face recognition", in Proc. 1st Spanish Workshop on Biometrics, Girona, Spain, Jun. 2007.
91. M. Villegas, R. Paredes, A. Juan, and E. Vidal, "Face verification on color images using local features", in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition Workshops (CVPR Workshops 2008), Jun. 2008, pp. 1-6.
92. V. Štruc, B. Vesnicer, and N. Pavešić, "The phase-based gabor fisher classifier and its application to face recognition under varying illumination conditions", in Proc. 2nd Int. Conf. Signal Processing and Communication Systems, Gold Coast, Australia, Dec. 15-17, 2008.
93. C. Liu, "Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance", IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 725-737, May 2006.
94. V. Štruc and N. Pavešić, "The corrected normalized correlation coefficient: A novel way of matching score calculation for lda-based face verification", in Proc. 5th Int. Conf. Fuzzy Systems and Knowledge Discovery, Jinan, China, Oct. 18-20, 2008, pp. 110-115.
95. H. K. Ekenel and R. Stiefelhagen, "Local appearance based face recognition using discrete cosine transform", in Proc. 13th Eur. Signal Processing Conf. (EUSIPCO), Antalya, Turkey, 2005.
96. K. Nandakumar, Y. Chen, S. C. Dass, and A. K. Jain, "Likelihood ratiobased biometric score fusion", IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 342-347, Feb. 2008.
97. E. Bailly-Baillière, S. Bengio, F. Bimbot, M. Hamouz, J. Kittler, J. Mariéthoz, J. Matas, K. Messer, V. Popovici, F. Porée, B. Ruiz, and J.-P. Thiran, "The BANCA database and evaluation protocol", in Proc. 4th Int. Conf. Audio- and Video-Based Biometric Person Authentication (AVBPA 2003), 2003, vol. 2688, Springer-Verlag LNCS, p. 1057.
98. N. Poh, C. H. Chan, J. Kittler, S. Marcel, C. Mc Cool, E. A. Rúa, J. L. Alba Castro, M. Villegas, R. Paredes, V. Štruc, N. Pavešić, A. A. Salah, H. Fang, and N. Costen, "Face video competition", in Proc. 3rd Int. Conf. Biometrics, Sardinia, 2009, pp. 715-724.
99. A. Martin, G. Doddington, T. Kamm, M. Ordowsk, and M. Przybocki, "The DET curve in assessment of detection task performance", in Proc. Eurospeech'97, Rhodes, 1997, pp. 1895-1898.
100. S. Bengio and J. Mariéthoz, "The expected performance curve: A new assessment measure for person authentication", in Proc. Speaker and Language Recognition Workshop (Odyssey), Toledo, 2004, pp. 279-284.
101. N. Poh and S. Bengio, "Database, protocol and tools for evaluating score-level fusion algorithms in biometric authentication", Pattern Recognit., vol. 39, no. 2, pp. 223-233, Feb. 2005.
102. A. Martin, M. Przybocki, and J. P. Campbell, The NIST Speaker Recognition Evaluation Program. New York: Springer, 2005, ch. 8.
103. N. Poh, G. Heusch, and J. Kittler, "On combination of face authentication experts by a mixture of quality dependent fusion classifiers", in Multiple Classifiers System (MCS), Prague, 2007, vol. 4472, LNCS, pp. 344-356.
104. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas, "On combining classifiers", IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 3, pp. 226-239, Mar. 1998.
105. Digital Image Processing, R. C. Gonzalez and R. E. Woods, Eds., 3rd ed. Englewood Cliffs, NJ: Prentice-Hall, 2008.
106. M. Villegas and R. Paredes, "Fusion of qualities for frame selection in video face verification", in 20th Int. Conf. Pattern Recognition (ICPR 2010), Istanbul, Turkey, Aug. 23-26, 2010, pp. 1-4.