Biometric person authentication with liveness detection based on audio-visual fusion

International Journal of Biometrics

Volumn 1, Issue 4, 2009, Pages 463-478

  Chetty, Girija ^a   Wagner, Michael ^a  

^a UNIVERSITY OF CANBERRA   (Australia)

Author keywords

Audio lip correlation; Audio visual; Biometrics; Canonical correlation analysis; CCA; Lip motion; Liveness verification; Speaker authentication; Speech recognition; Tensor analysis

Indexed keywords

AUTHENTICATION; BIOMETRICS; SPEECH RECOGNITION; TENSORS;

AUDIO-VISUAL; CANONICAL CORRELATION ANALYSIS; LIP MOTIONS; LIVENESS VERIFICATIONS; TENSOR ANALYSIS;

AUDIO SYSTEMS;

EID: 70350111306     PISSN: 17558301     EISSN: 1755831X     Source Type: Journal    
DOI: 10.1504/IJBM.2009.027306     Document Type: Article

References (23)

1. Bigun, B., Granlund, F. and Wiklund, J. (1991) 'Multidimensional orientation estimation with applications to texture analysis of optical flow', IEEE Transansactions Pattern Analysis and Machine Intelligence, Vol.13, No.8, pp.775-790
2. Bredin, H. and Chollet, G. (2007) 'Audiovisual speech synchrony measure: application to biometrics', EURASIP Journal on Applied Signal Processing, p.179
3. Burges, C.J. (1998) 'A tutorial on support vector machines for pattern recognition', Data Mining and Knowledge Discovery, Vol.2, No.2, pp.121-167
4. Callan, D., Jones, J.A., Munhall, K.G., Kroos, C., Callan, A. and Vatikiotis-Bateson, E. (2003) 'Neural processes underlying perceptual enhancement by visual speech gestures', Neuroreport, Vol.14, pp.2213-2218
5. Chaudhari, U.V., Ramaswamy, G.N., Potamianos, G. and Neti, C. (2003) 'Information fusion and decision cascading for audio-visual speaker recognition based on time-varying stream reliability prediction', IEEE International Conference on Multimedia Expo, Vol.III, pp.9-12
6. Chetty, G. and Wagner, M. (2004) 'Liveness verification in audio-video speaker authentication', Proceedings of the 10th Australian International Conference on Speech Science & Technology, pp.358-363
7. Chetty, G. and Wagner, M. (2005) 'Audio-visual multimodal fusion for biometric person authentication and liveness verification', Proceedings of the 2005 Nicta-Hcsnet Multimodal User interaction Workshop, Vol.57, Sydney, Australia; Chen, F. and Epps, J. (Eds), ACM International Conference Proceeding Series, Vol.163, Australian Computer Society, Darlinghurst, Australia, pp.17-24
8. Chetty, G. and Wagner, M. (2006, September) 'Multi-level liveness verification for face-voice biometric authentication', Proceedings of the IEEE Biometric Symposium, Baltimore, Maryland
9. Chibelushi, C., Deravi, F. and Mason, J. (2002) 'A review of peech-based bimodal recognition', IEEE Transactions on Multimedia, Vol.4, No.1, pp.23-37
10. Eveno, N. and Besacier, L. (2005) 'A speaker independent liveness test for audio-video biometrics', Paper presented at 9th European Conference on Speech Communication and Technology, pp.232-239
11. Goecke, R. and Millar, J.B. (2004) 'The audio-video Australian English speech data corpus AVOZES', Proceedings of the 8th International Conference on Spoken Language Processing INTERSPEECH (ICSLP), Vol.III, pp.2525-2528
12. Gurbuv, S., Tufekci, Z., Patterson, E. and Gowdy, J. (2002) 'Multi-stream product modal audiovisual integration strategy for robust adaptive speech recognition', Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Orlando, pp.357-360
13. Lucas, B.D. and Kanade, T. (1981) 'An iterative image registration technique with an application to stereo vision', Paper presented at DARPA Image Understanding Workshop, pp.121-130
14. Liu, X., Liang, L., Zhaa, Y., Xiaobo, P. and Nefian, A.V. (2002) 'Audio-visual continuous speech recognition using coupled hidden Markov model', Proceedings of the International Conference on Spoken Language Processing
15. Mase, K. and Pentland, A. (1991) 'Automatic lip-reading by optical-flow analysis', Systems and Computers in Japan, Vol.22, No.6, pp.67-76
16. Pan, H., Zhi-Pei, L. and Huang, T.S. (2000) 'A new approach to integrate audio and visual features of speech', Proceedings of the IEEE International Conference on Multimedia and Expo, pp.1093-1096
17. Potamianos, G., Neti, C., Luettin, J. and Matthews, I. (1998) 'Audio-visual automatic speech recognition: an overview', in Bailly, G., Vatikiotis-Bateson, E. and Perrier, P. (Eds): Issues in Visual and Audio-Visual Speech Processing, MIT Press, Cambridge, MA
18. Reynolds, D. and Rose, R. (1995) 'Robust text-independent speaker identification using Gaussian mixture models', IEEE Transactions on Speech and Audio Processing, Vol.3, No.1, pp.72-83
19. Sanderson, C. (2008) Biometric Person Recognition: Face, Speech and Fusion, VDM-Verlag, Germany, ISBN 978-3-639-02769-3.
20. Santi, A., Servos, P., Vatikiotis-Bateson, E., Kuratate, T. and Munhall, K. (2003) 'Perceiving biological motion: dissociating talking from walking', Journal of Cognitive Neuroscience, Vol.15, pp.800-809
21. Vapnik, V.N. (1995) The Nature of Statistical Learning Theory, Springer-Verlag, Berlin.
22. Wan, V. and Campbell, W. (2000) 'Support vector machines for speaker verification and identification', Proceedings of the IEEE Signal Processing Society Workshop Neural Networks for Signal Processing X, Vol.2, pp.775-784
23. Yamamoto, E., Nakamura, S. and Shikano, K. (1998) 'Lip movement synthesis from speech based on hidden Markov models', Journal of Speech Communication, Vol.26, No.1, pp.105-115