Audio-visual biometrics

Proceedings of the IEEE

Volumn 94, Issue 11, 2006, Pages 2025-2044

  Aleksic, Petar S ^a   Katsaggelos, Aggelos K ^a  

^a Northwestern University   (United States)

Author keywords

Audio visual biometrics; Audio visual databases; Audio visual fusion; Audio visual person recognition; Face tracking; Hidden Markov models; Multimodal recognition; Visual feature extraction

Indexed keywords

COMPUTER SIMULATION; DATABASE SYSTEMS; FACE RECOGNITION; FEATURE EXTRACTION; HIDDEN MARKOV MODELS; INFORMATION FUSION;

AUDIO-VISUAL BIOMETRICS; AUDIO-VISUAL DATABASES; AUDIO-VISUAL FUSION; AUDIO-VISUAL PERSON RECOGNITION; MULTIMODAL RECOGNITION; VISUAL FEATURE EXTRACTION;

BIOMETRICS;

EID: 33947384963     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2006.886017     Document Type: Article

References (137)

1. A. K. Jain, A. Ross, and S. Prabhakar, "An introduction to biometric recognition," IEEE Trans. Circuits Systems Video Technol., vol. 14, no. 1, pp. 4-20, Jan. 2004.
2. N. K. Ratha, A. W. Senior, and R. M. Bolle, "Automated biometrics," in Proc. Int. Conf. Advances Pattern Recognition, Rio de Janeiro, Brazil, 2001, pp. 445-474.
3. Financial crimes report to the public. Fed. Bur. Investigation, Financial Crimes Section, Criminal Investigation Division. [Online]. Available: http://www.fbi.gov/publications/financial/fcs_report052005/fcs_report052005.htm
4. A. K. Jain and U. Uludag, "Hiding biometric data," IEEE Trans. Pattern Anal. Machine Intell., vol. 25, no. 11, pp. 1494-1498, Nov. 2003.
5. C. C. Chibelushi, F. Deravi, and J. S. Mason, "Voice and facial image integration for speaker recognition," in Proc. IEEE Int. Symp. Multimedia Technologies Future Appl., Southampton, U.K., 1993.
6. R. Brunelli and D. Falavigna, "Person identification using multiple cues," IEEE Trans. Pattern Anal. Machine Intell., vol. 10, pp. 955-965, Oct. 1995.
7. S. Ben-Yacoub, Y. Abdeljaoued, and E. Mayoraz, "Fusion of face and speech data for person identity verification," IEEE Trans. Neural Networks, vol. 10, pp. 1065-1074, 1999.
8. C. Sanderson and K. K. Paliwal, "Identity verification using speech and face information," Digital Signal Processing, vol. 14, no. 5, pp. 449-480, 2004.
9. T. J. Hazen, E. Weinstein, R. Kabir, A. Park, and B. Heisele, "Multi-modal face and speaker identification on a handheld device," in Proc. Works. Multimodal User Authentication, Santa Barbara, CA, 2003, pp. 113-120.
10. P. Jourlin, J. Luettin, D. Genoud, and H. Wassner, "Integrating acoustic and labial information for speaker identification and verification," in Proc. 5th Eur. Conf. Speech Communication Technology, Rhodes, Greece, 1997, pp. 1603-1606.
11. T. Wark, S. Sridharan, and V. Chandran, "Robust speaker verification via fusion of speech and lip modalities," in Proc. Inf. Conf. Acoustics, Speech Signal Processing, Phoenix, AZ, 1999, pp. 3061-3064.
12. _, "Robust speaker verification via asynchronous fusion of speech and lip information," in Proc. 2th Int. Conf. Audio- and Video-Based Biometric Person Authentication, Washington, DC, 1999, pp. 37-42.
13. _, "The use of temporal speech and lip information for multi-modal speaker identification via multi-stream HMMs," in Proc. Int. Conf. Acoustics, Speech Signal Processing, Istanbul, Turkey, 2000, pp. 2389-2392.
14. P. S. Aleksic and A. K. Katsaggelos, "An audio-visual person identification and verification system using FAPs as visual features," in Proc. Works. Multimedia User Authentication, Santa Barbara, CA, 2003, pp. 80-84.
15. U. V. Chaudhari, G. N. Ramaswamy, G. Potamianos, and C. Neti, "Information fusion and decision cascading for audio-visual speaker recognition based on time-varying stream reliability prediction," in Proc. Int. Conf. Multimedia Expo, Baltimore, MD, Jul. 6-9, 2003, pp. 9-12.
16. U. Dieckmann, P. Plankensteiner, and T. Wagner, "SESAM: A biometric person identification system using sensor fusion," Pattern Recogn. Lett., vol. 18, pp. 827-833, 1997.
17. J. P. Campbell, "Speaker recognition: A tutorial," Proc. IEEE, vol. 85, no. 9, pp. 1437-1462, Sep. 1997.
18. W.-Y. Zhao, R. Chellappa, P. J. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Computing Survey, pp. 399-458, 2003, Dec. Issue.
19. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cognitive Neuroscience, vol. 3, no. 1, pp. 586-591, Sep. 1991.
20. M. Kirby and L. Sirovich, "Application of the Karhunen-Loeve procedure for the characterization of human faces," IEEE Trans. Pottem Anal. Mach. Intell., vol. 12, no. 1, pp. 103-108, Jan. 1990.
21. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces versus fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, pp. 711-720, 1997.
22. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," Proc. ACM Computing Surverys (CSUR), vol. 35, no. 4, pp. 399-458, 2003.
23. J. Luettin, "Visual speech and speaker recognition," Ph.D. dissertation, Dept. Computer Science, Univ. Sheffield, Sheffield, U.K., 1997.
24. C. C. Chibelushi, F. Deravi, and J. S. Mason, "Audio-visual person recognition: An evaluation of data fusion strategies," in Proc. Eur. Conf. Security Detection, London, U.K., 1997, pp. 26-30.
25. R. Brunelli, D. Falavigna, T. Poggio, and L. Stringa, "Automatic person recognition using acoustic and geometric features," Machine Vision Appl., vol. 8, pp. 317-325, 1995.
26. C. Sanderson and K. K. Paliwal, "Noise compensation in a person verification system using face and multiple speech features," Pattern Recognition, vol. 36, no. 2, pp. 293-302, Feb. 2003.
27. P. Jourlin, J. Luettin, D. Genoud, and H. Wassner, "Acoustic-labial speaker verification," Pattern Recogn. Lett., vol. 18, pp. 853-858, 1997.
28. U. V. Chaudhari, G. N. Ramaswamy, G. Potamianos, and C. Neti, "Audio-visual speaker recognition using time-varying stream reliability prediction," in Proc. Int. Conf. Acoustics, Speech Signal Processing, Hong Kong, China, 2003, pp. V-712-V-715.
29. S. Bengio, "Multimodal authentication using asynchronous HMMs," in Proc. 4th Int. Conf. Audio- and Video-Based Biometric Person Authentication, Guildford, U.K., 2003, pp. 770-777.
30. A. V. Nefian, L. H. Liang, T. Fu, and X. X. Liu, "A Bayesian approach to audio-visual speaker identification," in Proc. 4th Int. Conf. Audio- and Video-Based Biometric Person Authentication, Guildford, U.K., 2003, pp. 761-769.
31. T. Fu, X. X. Liu, L. H. Liang, X. Pi, and A. V. Nefian, "An audio-visual speaker identification using coupled hidden Markov models," in Proc. Int. Conf. Image Processing, Barcelona, Spain, 2003, pp. 29-32.
32. S. Bengio, "Multimodal authentication using asynchronous HMMs," in Proc. 4th Int. Conf. Audio- and Video-Based Biometric Person Authentication, Guildford, U.K., 2003, pp. 770-777.
33. _, "Multimodal speech processing using asynchronous hidden Markov models," Information Fusion, vol. 5, pp. 81-89, 2004.
34. N. A. Fox, R. Gross, P. de Chazal, J. F. Cohn, and R. B. Reilly, "Person identification using automatic integration of speech, lip. and face experts," in Proc. ACM SIGMM 2003 Multimedia Biometrics Methods and Applications Workshop (WBMA'03), Berkeley, CA, 2003, pp. 25-32.
35. N. A. Fox and R. B. Reilly, "Audio-visual speaker identification based on the use of dynamic audio and visual features," in Proc. 4th Int. Conf. Audio- and Video-Based Biometric Person Authentication, Guildford, U.K., 2003, pp. 743-751.
36. Y. Abdeljaoued, "Fusion of person authentication probabilities by Bayesian statistics," in Proc. 2nd Int. Conf. Audio- and Video-Based Biometric Person Authentication, Washington, DC, 1999, pp. 172-175.
37. Y. Yemez, A. Kanak, E. Erzin, and A. M. Tekalp, "Multimodal speaker identification with audio-video processing," in Proc. Int. Conf. Image Processing, Barcelona, Spain, 2003, pp. 5-8.
38. A. Kanak, E. Erzin, Y. Yemez, and A. M. Tekalp, "Joint audio-video processing for biometric speaker identification," in Proc. Int. Conf. Acoustic, Speech Signal Processing, Hong Kong, China, 2003, pp. 561-564.
39. E. Erzin, Y. Yemez, and A. M. Tekalp, "Multimodal speaker identification using an adaptive classifier cascade based on modality reliability," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 840-852, Oct. 2005.
40. M. E. Sargin, E. Erzin, Y. Yemez, and A. M. Tekalp, "Multimodal speaker identification using canonical correlation analysis," in IEEE Proc. Int. Conf. Acoustics, Speech Signal Processing, Toulouse, France, May 2006, pp. 613-616.
41. J. Kittler, J. Matas, K. Johnsson, and M. U. Ramos-Sánchez, "Combining evidence in personal identity verification systems," Pattern Recogn. Lett., vol. 18, pp. 845-852, 1997.
42. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 226-239, 1998.
43. J. Kittler and K. Messer, "Fusion of multiple experts in multimodal biometric personal identity verification systems," in Proc. 12th IEEE Workshop Neural Networks Sig. Processing, Switzerland, 2002, pp. 3-12.
44. E. S. Bigun, J. Bigun, B. Due, and S. Fisher, "Expert conciliation for multi modal person authentication systems by Bayesian statistics," in Proc. 1st Int. Conf. Audio- and Video-Based Biometric Person Authentication, Crans-Montana, Switzerland, Mar. 1997, pp. 291-300.
45. R. W. Frischholz and U. Dieckmann, "BiolD: A multimodal biometric identification system," Computer, vol. 33, pp. 64-68, 2000.
46. S. Basu, H. S. M. Beigi, S. H. Maes, M. Ghislain, E. Benoit, C. Neti, and A. W. Senior, "Methods and apparatus for audio-visual speaker recognition and utterance verification," U.S. Patent 6 219 640, 1999.
47. L. Hong and A. Jain, "Integrating faces and fingerprints for personal identification," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 1295-1307, 1998.
48. V. Radova and J. Psutka, "An approach to speaker identification using multiple classifiers," in Proc. IEEE Conf. Acoustics, Speech Signal Processing, Munich, Germany, 1997, vol. 2, pp. 1135-1138.
49. A. Ross and A. Jain, "Information fusion in biometrics," Pattern Rccogn. Lett., vol. 24, pp. 2115-2125, 2003.
50. V. Chatzis, A. G. Bors, and I. Pitas, "Multimodal decision-level fusion for person authentication," IEEE Trans. Systems, Man, Cybernetics, Part A: Syst. Humans, vol. 29, no. 5, pp. 674-680, Nov. 1999.
51. N. Fox, R. Gross, J. Cohn, and R. B. Reilly, "Robust automatic human identification using face, mouth, and acoustic information," in Proc. Int. Workshop Analysis Modeling of Faces and Gestures, Beijing, China, Oct. 2005, pp. 263-277.
52. F. J. Huang and T. Chen, "Consideration of Lombard effect for speechreading," in Proc. Works. Multimedia Signal Process, 2001, pp. 613-618.
53. J. D. Woodward, "Biometrics: Privacy's foe or privacy's friend?" Proc. IEEE, vol. 85, pp. 1480-1492, 1997.
54. R. P. Lippmann, "Speech recognition by machines and humans," Speech Commun., vol. 22, no. 1, pp. 1-15, 1997.
55. H. Yehia, P. Rubin, and E. Vatikiotis-Bateson, "Quantitative association of vocal-tract and facial behavior," Speech Commun., vol. 26, no. 1-2, pp. 23-43, 1998.
56. J. Jiang, A. Alwan, P. A. Keating, E. T. Auer, Jr., and L. E. Bernstein, "On the relationship between face movements, tongue movements, and speech acoustics," EURASIP J. Appl. Signal Processing, vol. 2002, no. 11, pp. 1174-1188, Nov. 2002.
57. J. P. Barker and F. Berthommier, "Estimation of speech acoustics from visual speech features: A comparison of linear and non-linear models," in Proc. Int. Conf. Auditory Visual Speech Processing, Santa Cruz, CA, 1999, pp. 112-117.
58. H. C. Yehia, T. Kuratate, and E. Vatikiotis-Bateson, "Using speech acoustics to drive facial motion," in Proc. 14th Int. Congr. Phonetic Sciences, San Francisco, CA, 1999, pp. 631-634.
59. A. V. Barbosa and H. C. Yehia, "Measuring the relation between speech acoustics and 2-D facial motion," in Proc. Int. Conf. Acoustics, Speech Signal Processing, Salt Lake City, UT, 2001, vol. 1, pp. 181-184.
60. P. S. Aleksic and A. K. Katsaggelos, "Speech-to-video synthesis using MPEG-4 compliant visual features," IEEE Trans. CSVT, Special Issue Audio Video Analysis for Multimedia Interactive Sea-ices, pp. 682-692, May 2004.
61. A. Q. Summerfield, "Some preliminaries to a comprehensive account of audio-visual speech perception," in Hearing by Eye: The Psychology of Lip-Reading, R. Campbell and B. Dodd, Eds. London, U.K.: Lawrence Erlbaum, 1987, pp. 3-51.
62. D. W. Massaro and D. G. Stork, "Speech recognition and sensory integration," Amer. Scientist, vol. 86, no. 3, pp. 236-244, 1998.
63. J. J. Williams and A. K. Katsaggelos, "An HMM-based speech-to-video synthesizer," IEEE Trans. Neural Networks, Special Issue Intelligent Multimedia, vol. 13, no. 4, pp. 900-915, Jul. 2002.
64. Q. Summerfield, "Use of visual information in phonetic perception," Phonetica, vol. 36, pp. 314-331, 1979.
65. _, "Lipreading and audio-visual speech perception," Phil. Trans. R. Soc. Lond. B., vol. 335, pp. 71-78, 1992.
66. K. W. Grant and L. D. Braida, "Evaluating the articulation index for auditory-visual input," J. Acoustical Soc. Amer., vol. 89, pp. 2950-2960, Jun. 1991.
67. G. Fant, Acoustic Theory of Speech Production, S-Gravenhage. Amsterdam, The Netherlands: Mouton, 1960.
68. J. L. Flanagan, Speech Analysis Synthesis and Perception. Berlin, Germany: Springer-Verlag, 1965.
69. S. Narayanan and A. Alwan, "Articulatory-acoustic models for fricative consonants," IEEE Trans. Speech Audio Processing, vol. 8, no. 3, pp. 328-344, Jun. 2000.
70. J. Schroeter and M. Sondhi, "Techniques for estimating vocal-tract shapes from the speech signal," IEEE Trans. Speech Audio Processing, vol. 2, no. 1, pp. 133-150, Feb. 1994.
71. H. McGurk and J. MacDonald, "Hearing lips and seeing voices," Nature, vol. 264, pp. 746-748, 1976.
72. T. Chen and R. R. Rao, "Audio-visual integration in multimodal communication," Proc. IEEE, vol. 86, no. 5, pp. 837-852, May 1998.
73. S. Oviatt, P. Cohen, L. Wu, J. Vergo, L. Duncan, B. Suhm, J. Bers, T. Holzman, T, Winograd, J. Landay, J. Larson, and D. Ferro, "Designing the user interface for multimodal speech and pen-based gesture applications: State-of-the-art systems and research directions," Human-Computer Interaction, vol. 15, no. 4, pp. 263-322, Aug. 2000.
74. J. Schroeter, J. Ostermann, H. P. Graf, M. Beutnagel, E. Cosatto, A. Syrdal, A. Conkie, and Y. Stylianou, "Multimodal Speech synthesis," in Proc. Int. Conf. Multimedia Expo, New York, 2000, pp. 571-574.
75. C. C. Chibelushi, F. Deravi, and J. S. D. Mason, "A review of speech-based bimodal recognition," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 23-37, Mar. 2002.
76. D. G. Stork and M. E. Hennecke, Eds., Speechreading by Humans and Machines. Berlin, Germany: Springer, 1996.
77. P. S. Aleksic, G. Potamianos, and A. K. Katsaggelos, "Exploiting visual information in automatic speech processing," in Handbook of Image and Video Processing, A. Bovik, Ed. New York: Academic, Jun. 2005, pp. 1263-1289.
78. E. Petajan, "Automatic lipreading to enhance speech recognition," Ph.D. dissertation, Univ. Illinois at Urbana-Champaign, Urbana, IL, 1984.
79. S. Dupont and J. Luettin, "Audio-visual speech modeling for continuous speech recognition," IEEE Trans. Multimedia, vol. 2, no. 3, pp. 141-151, Sep. 2000.
80. G. Potamianos, C. Neti, G. Gravier, A. Garg, and A. W. Senior, "Recent advances in the automatic recognition of audiovisual speech," Proc. IEEE, vol. 91, no. 9, pp. 1306-1326, Sep. 2003.
81. G. Potamianos, C. Neti, J. Luettin, and I. Matthews, "Audio-visual automatic speech recognition: An overview," in Issues in Visual and Audio-Visual Speech Processing, G. Bailly, E. Vatikiotis-Bateson, and P. Perrier, Eds. Cambridge, MA: MIT Press, 2004.
82. P. S. Aleksic, J. J. Williams, Z. Wu, and A. K. Katsaggelos, "Audio-visual speech recognition using MPEG-4 compliant visual features," EURASIP J. Appl. Signal Processing, vol. 2002, no. 11, pp. 1213-1227, Nov. 2002.
83. T. Chen, "Audiovisual speech processing. Lip reading and lip synchronization," IEEE Signal Processing Mag., vol. 18, no. 1, pp. 9-21, Jan. 2001.
84. J. R. Deller, Jr., J. G. Proakis, and J. H. L. Hansen, Discrete-Time Processing of Speech Signals. Englewood Cliffs, NJ: Macmillan, 1993.
85. R. Campbell, B. Dodd, and D. Burnham, Eds., Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory Visual Speech. Hove, U.K.: Psychology Press, 1998.
86. S. Young, G. Evermann, T. Hain, D. Kershaw, G. Moore, J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. Woodland, The HTK Book. London, U.K.: Entropic, 2005.
87. A. J. Goldschen, O. N. Garcia, and E. D. Petajan, "Rationale for phoneme-viseme mapping and feature selection in visual speech recognition," in Speechreading by Humans and Machines, D. G. Stork and M. E. Hennecke, Eds. Berlin, Germany: Springer, 1996, pp. 505-515.
88. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice Hall, 1993.
89. D.-S. Kim, S.-Y. Lee, and R. M. Kil, "Auditory processing of speech signals for robust speech recognition in real-world noisy environments," IEEE Trans. Speech Audio Processing, vol. 7, no. 1, pp. 55-69, Jan. 1999.
90. K. K. Paliwal, "Spectral subband centroids features for speech recognition," in Proc. Int. Conf. Acoustics, Speech and Signal Processing, Seattle, WA, 1998, vol. 2, pp. 617-620.
91. M. Akbacak and J. H. L. Hansen, "Environmental sniffing: Noise knowledge estimation for robust speech systems," in Proc. Int. Conf. Acoustics, Speech and Signal Processing, Hong Kong, China, 2003, vol. 2, pp. 113-116.
92. H. A. Rowley, S. Baluja, and T. Kanade, "Neutral networks-based face detection," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, no. 1, pp. 23-38, Jan. 1998.
93. A. W. Senior, "Face and feature finding for a face recognition system," in Proc. Int. Conf. Audio Video-based Biometric Person Authentication, Washington, DC, 1999, pp. 154-159.
94. K. Sung and T. Poggio, "Example-based learning for view-based human face detection," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, no. 1, pp. 39-51, 1998.
95. E. Hjelmas and B. K. Low, "Face detection: A survey," Computer Vision and Image Understanding, vol. 83, no. 3, pp. 236-274, Sep. 2001.
96. M.-H. Yang, D. Kriegman, and N. Ahuja, "Detecting faces in images: A survey," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, no. 1, pp. 34-58, Jan. 2002.
97. V. Blanz, P. Grother, P. J. Phillips, and T. Vetter, "Face recognition based on frontal views generated from non-frontal images," in Proc. Computer Vision Pattern Recognition, 2005, pp. 454-461.
98. C. Sanderson, S. Bengio, and Y. Gao, "On transforming statistical models for non-frontal face verification," Pattern Recognition, vol. 39, no. 2, pp. 288-302, 2006.
99. K. W. Bowyer, K. Chang, and P. Flynn, "A survey of approaches and challenges in 3-D and multi-modal 3-D face recognition," Computer Vision Image Understanding, vol. 101, no. 1, pp. 1-15, 2006.
100. S. G. Kong, J. Heo, B. R. Abidi, J. Paik, and M. A. Abidi, "Recent advances in visual and infrared face recognition - A review," Computer Vision Image Understanding, vol. 97, no. 1, pp. 103-135, 2005.
101. M. E. Hennecke, D. G. Stork, and K. V. Prasad, "Visionary speech: Looking ahead to practical speechreading systems," in Speechreading by Humans and Machines, D. G. Stork and M. E. Hennecke, Eds. Berlin, Germany: Springer, 1996, pp. 331-349.
102. P. S. Aleksic and A. K. Katsaggelos, "Comparison of low- and high-level visual features for audio-visual continuous automatic speech recognition," in Proc. Jnt. Conf. Acoustics, Speech Signal Processing, Montreal, Canada, 2004, pp. 917-920.
103. I. Matthews, G. Potamianos, C. Neti, and J. Luettin, "A comparison of model and transform-based visual features for audio-visual LVCSR," in Proc. Int. Conf. Multimedia Expo, 2001, pp. 22-25.
104. H. A. Rowley, S. Baluja, and T. Kanade, "Neural network based face detection," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, no. 1, pp. 23-38, Jan. 1998.
105. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. Conf. Computer Vision Pattern Recognition, Kauai, HI, Dec. 11-13, 2001, pp. 511-518.
106. H. P. Graf, E. Cosatto, and G. Potamianos, "Robust recognition of faces and facial features with a multi-modal system," in Proc. Jnt. Conf. Systems, Man, Cybernetics, Orlando, FL, 1997, pp. 2034-2039.
107. M. T. Chan, Y. Zhang, and T. S. Huang, "Real-time lip tracking and bimodal continuous speech recognition," in Proc. Workshop Multimedia Signal Processing, Redondo Beach, CA, 1998, pp. 65-70.
108. G. Chetty and M. Wagner, '"Liveness" verification in audio-video authentication," in Proc. Int. Conf. Spoken Language Processing, Jeju Island, Korea, 2004, pp. 2509-2512.
109. M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active contour models," Int. J. Computer Vision, vol. 4, no. 4, pp. 321-331, 1988.
110. A. L. Yuille, P. W. Hallinan, and D. S. Cohen, "Feature extraction from faces using deformable templates," Int. J. Computer Vision, vol. 8, no. 2, pp. 99-111, 1992.
111. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," in Proc. Eur. Conf. Computer Vision, Freiburg, Germany, 1998, pp. 484-498.
112. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. Hoboken, NJ: Wiley, 2001.
113. B. Maison, C. Neti, and A. Senior, "Audio-visual speaker recognition for broadcast news: Some fusion techniques," in Proc. Works. Multimedia Signal Processing, Copenhagen, Denmark, 1999, pp. 161-167.
114. P. Duchnowski, U. Meier, and A. Waibel, "See me, hear me: Integrating automatic speech recognition and lip-reading," in Proc. Jnt. Conf. Spoken Long. Processing, Yokohama, Japan, Sep. 18-22, 1994, pp. 547-550.
115. G. Potamianos, H. P. Graf, and E. Cosatto, "An image transform approach for HMM based automatic lipreading," in Proc. Int. Conf. Image Processing, Chicago, IL, Oct. 4-7, 1998, vol. 1, pp. 173-177.
116. P. S. Aleksic and A. K. Katsaggelos, "Comparison of MPEG-4 facial animation parameter groups with respect to audio-visual speech recognition performance," in Proc. Int. Conf. Image Processing. Italy, Sep. 2005, vol. 5, pp. 501-504.
117. X. Zhang, C. C. Broun, R. M. Mersereau, and M. Clements, "Automatic speechreading with applications to human-computer interfaces," EURASIP J. Appl. Signal Processing, vol. 2002, no. 11, pp. 1228-1247, 2002.
118. M. Gordan, C. Kotropoulos, and I. Pitas, "A support vector machine-based dynamic network for visual speech recognition applications," EURASIP J. Appl. Signal Processing, vol. 2002, no. 11, pp. 1248-1259, 2002.
119. F. Cardinaux, C. Sanderson, and S. Bengio, "User authentication via adapted statistical models of face images," IEEE Trans. Signal Processing, vol. 54, no. 1, pp. 361-373, Jan. 2006.
120. G. R. Doddington, M. A. Przybycki, A. F. Martin, and D. A. Reynolds, "The NIST speaker recognition evaluation - Overview, methodology, systems, results, perspective," Speech Commun., vol. 31, no. 2-3, pp. 225-254, 2000.
121. S. Bengio, J. Mariethoz, and M. Keller, "The expected performance curve," in Int. Conf. Machine Learning, Workshop ROC Analysis Machine Learning, Bonn, Germany, 2005.
122. S. Bengio and J. Mariethoz, "The expected performance curve: A new assessment measure for person authentication," in Proc. Speaker Language Recognition Works. (Odyssey), Toledo, OH, 2004, pp. 279-284.
123. D. L. Hall and J. Llinas, "Multisensor data fusion," in Handbook of Multisensor Data Fusion, D. L. Hall and J. Llinas, Eds. Boca Raton, FL: CRC, 2001, pp. 1-10.
124. T. K. Ho, J. J. Hull, and S. N. Srihari, "Decision combination in multiple classifier systems," IEEE Trans. Pattern Anal. Machine Intell., vol. 16, pp. 66-75, 1994.
125. R. C. Luo and M. G. Kay, "Introduction," in Multisensor Integration and Fusion for Intelligent Machines and Systems, R. C. Luo and M. G. Kay, Eds. Norwood, NJ: Ablex, 1995, pp. 1-26.
126. S. Pigeon and L. Vandendorpe, "The M2VTS multimodal face database (release 1.00)," in Proc. 1st Int. Conf. Audio- and Video-Based Biometric Person Authentication, Crans-Montana, Switzerland, 1997, pp. 403-409.
127. K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre, "XM2VTSDB: Te extended M2VTS database," in Proc. 2nd Int. Conf. Audio- and Video-Based Biometric Person Authentication, Washington, DC, 1999, pp. 72-77.
128. E. Bailly-Bailliere, S. Bengio, F. Bimbot, M. Hamouz, J. Kittler, J. Mariethoz, J. Matas, K. Messer, V. Popovici, F. Poree, B. Ruiz, and J.-P. Thiran, "The BANCA database and evaluation protocol," in Proc. Audio- and Video-Based Biometric Person Authentication, Guilford, 2003, pp. 625-638.
129. C. C. Chibelushi, F. Deravi, and J. S. Mason, BT DAVID Database - Internal Rep., Speech and Image Processing Research Group, Dept. of Electrical and Electronic Engineering, Univ, les Swansea, 1996.
130. N. Fox, B. O'Mullane, and R. B. Reilly, "The realistic multi-modal VALID database and visual speaker identification comparison experiments," in Lecture Notes in Computer Science, T. Kanade, A. K. Jain, and N. K. Ratha, Eds. New York: Springer-Verlag, 2005, vol. 3546, p. 777.
131. B. Lee, M. Hasegawa-Johnson, C. Goudeseune, S. Kamdar, S. Borys, M. Liu, and T. Huang, "AVICAR: Audio-visual speech corpus in a car environment," in Proc. Conf. Spoken Language, Jeju, Korea, 2004.
132. E. K. Patterson, S. Gurbuz, Z. Tufekci, and J. N. Gowdy, "CUAVE: A new audio-visual database for multimodal human-computer interface research," in Proc. Int. Conf. Acoustics, Speech and Signal Processing, Orlando, FL, 2002.
133. T. Chen, "Audiovisual speech processing," IEEE Signal Processing Mag., vol. 18, pp. 9-21, Jan. 2001.
134. J. R. Movellan, "Visual speech recognition with stochastic networks," in Advances in Neural Information Processing Systems, G. Tesauro, D. Toruetzky, and T. Leen, Eds. Cambridge, MA: MIT Press, 1995, vol. 7.
135. J. Luettin, N. Thacker, and S. Beet, "Speaker identification by lipreading," in Proc Int. Conf. Speech and Language Processing, Philadelphia, PA, 1996, pp. 62-64.
136. S. Bengio and J. Mariethoz, "A statistical significance test for person authentication," in Proc. Speaker and Language Recognition Workshop (Odyssey), Toledo, 2004, pp. 237-244.
137. N. Poh and J. Korczak, "Biometric authentication in the e-World," in Automated Authentication Using Hybrid Biometric System, D. Zhang, Ed. Boston, MA: Kluwer, 2003, ch. 16.