Person identification using automatic integration of speech, lip, and face experts

Proceedings of the 2003 ACM SIGMM Workshop on Biometrics Methods and Applications, WBMA 2003

Volumn , Issue , 2003, Pages 25-32

  Fox, Niall A ^a   Gross, Ralph ^b   DeChazal, Philip ^a   Cohn, Jeffery F ^b   Reilly, Richard B ^a  

^a UNIVERSITY COLLEGE DUBLIN   (Ireland)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Audio; Automatic weighting; Face; Late integration; Lips; Multi expert; Person identification

Indexed keywords

AUDIO ACOUSTICS; AUDIO SYSTEMS; BIOMETRICS; HIDDEN MARKOV MODELS; INTEGRATION; MARKOV PROCESSES; PROBABILITY DENSITY FUNCTION; TRELLIS CODES;

AUDIO; AUTOMATIC WEIGHTING; FACE; LIPS; MULTI-EXPERT; PERSON IDENTIFICATION;

IMAGE PROCESSING;

EID: 84921606034     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/982507.982512     Document Type: Conference Paper

References (29)

1. P. Belhumeur and J. Hespanha and D. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, no. 7, pp. 711-720, 1997.
2. Fox, N., Reilly, R.B., "Audio-Visual Speaker Identification Based on the Use of Dynamic Audio and Visual Features", Proc. 4th International Conference on Audio and Video Based Biometric Person Authentication, June 2003.
3. D. Blackburn and M. Bone and P.J. Philips, "Facial Recognition Vendor Test 2000", Evaluation report, 2000.
4. Brunelli, R. and Falavigna, D., "Person identification using multiple cues", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 17, no. 10, pp. 955-966, Oct. 1995.
5. Chen, T., "Audiovisual Speech Processing", IEEE Signal Processing Magazine, Vol. 18, no. 1, pp. 9-21, Jan. 2001.
6. Davis, S. and Mermelstein, P., "Comparison of Parametric Representations for Monosyllabic Word Recognition in Continuously Spoken Sentences", IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol. 28, no. 4, pp. 357-366, 1980.
7. R. Gross and J. Shi and J. Cohn, "Quo Vadis Face Recognition", Third Workshop on Empirical Evaluation Methods in Computer Vision, 2001.
8. Heckmann, M.; Berthommier, F.; Kristian, K., "Noise Adaptive Stream Weigting in Audio-Visual Speech Recognition", EURASIP Journal on Applied Signal Processing, Special Issue on Joint Audio-Visual Speech Processing", Vol. 2002, no. 11, pp. 1260-1273, Nov. 2002.
9. Identix corp., www.identix.com, 5600 Rowland Road, Minnetonka, MN 55343.
10. A Lanitis and C. Taylor and T. Cootes, "Automatic Interpretation and Coding of Face Images Using Flexible Models", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, no. 7, pp. 743-756, 1997.
11. S. Lawrence and C. Giles and A. Tsoi and A. Back. "Face Recognition: A Convolutional Neural Network Approach", IEEE Transactions on Neural Networks, Vol. 8, no. 1, pp. 98-113, 1998.
12. Y. Li and S Gong and H Liddell, "Support vector regression and classification based multi-view face detection and recognition", IEEE International Conference on Automatic Face and Gesture Recognition, 2000.
13. Lucey, S., Audio-Visual Speech Processing. PhD thesis, Queensland University of Technology, Brisbane, Australia, Apr. 2002.
14. Luettin, J. and Maitre, G., "Evaluation Protocol for the XM2VTSDB Database (Lausanne Protocol)", In IDIAP Communication 98-05, IDIAP, Martigny, Switzerland, Oct. 1998.
15. Luettin J., "Speaker verification experiments on the XM2VTS database", In IDIAP Communication 98-02, IDIAP, Martigny, Switzerland, Aug. 1999.
16. Messer, K., Matas, J., Kittler, J., Luettin J., and Maitre, G.: XM2VTSDB: "The Extended M2VTS Database", The Proceedings of the Second International Conference on Audio and Video-based Biometric Person Authentication (AVBPA'99), Washington D.C., pp. 72-77, Mar. 1999.
17. Netravali, A. N. and Haskell, B. G., Digital Pictures, Plenum Press, pp. 408-416, 1998.
18. P. Penev and J. Atick, "Local feature analysis: A general statistical theory for object representation", Network: Computation in Neural Systems, Vol. 7, no. 3, pp. 477-500, 1996.
19. P.J. Phillips and P. Grother and R. Michaels and D. Blackburn and E. Tabassi and M. Bone, "Face Recognition Vendor Test 2002", Evaluation Report.
20. Rabiner, L. R., "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition", Proceedings of the IEEE, Vol. 77, no. 2, pp. 257-286, Feb. 1989.
21. Reynolds, D. A. and Rose, R. C., "Robust Text-Independent Speaker Identification Using Gaussian Mixture Speaker Models", IEEE Transactions on Speech and Audio Processing, Vol. 3, no. 1, Jan. 1995.
22. B.D. Ripley, Pattern Recognition and Neural Networks. Cambridge: Cambridge University Press, 1996.
23. L. Sirovich and M. Kirby, "Low-dimensional procedure for the characterization of human faces", Journal of the Optical Society of America A. 4, pp. 519-524, 1987.
24. Scanlon, P. and Reilly, R., "Visual Feature Analysis For Automatic Speechreading", DSP Research Group, UCD, Dublin, Ireland, 2001.
25. M. Turk and A. Pentland, "Eigenfaces for Recognition", Journal of Cognitive Neuroscience, Vol. 3, no. 1, pp. 71-86, 1991.
26. Vapnik, V, The nature of statistical learning theory, Springer Verlag, 1995.
27. L. Wiskott and J-M. Fellous and N. Krueger and C. von der Malsburg, "Face Recognition by Elastic Bunch Graph Matching", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, no. 7, pp. 775-779, 1997.
28. Young, S., Evermann, G., Kershaw, D., Moore, G., Odell, J., Ollason, D., Valtchev, V., and Woodland, P., The HTK Book (for HTK Version 3.1), Microsoft Corporation, Cambridge University Engineering Department, Nov. 2001.
29. A. Yuille, "Deformable Templates for Face Recognition", Journal of Cognitive Neuroscience, Vol. 3, no. 1, pp. 59-70, 1991.