Identity verification using speech and face information

Digital Signal Processing: A Review Journal

Volumn 14, Issue 5, 2004, Pages 449-480

  Sanderson, Conrad ^a,b   Paliwal, Kuldip K ^a  

^a GRIFFITH UNIVERSITY   (Australia)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

Biometrics; Face recognition; Identity verification; Multi modal; Noise resistance; Speaker recognition

Indexed keywords

ACOUSTIC NOISE; ALGORITHMS; DATABASE SYSTEMS; DIGITAL SIGNAL PROCESSING; FACE RECOGNITION; INFORMATION ANALYSIS; MODAL ANALYSIS; VECTORS;

BIOMETRICS; IDENTIFY VERIFICATION; MULTI-MODAL ANALYSIS; NOISE RESISTANCE; SPEAKER RECOGNITION;

SPEECH RECOGNITION;

EID: 4544228318     PISSN: 10512004     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dsp.2004.05.001     Document Type: Article

References (80)

1. Y. Abdeljaoued Fusion of person authentication probabilities by Bayesian statistics Proc. 2nd Int. Conf. Audio- and Video-Based Biometric Person Authentication, Washington, DC 1999 172 175
2. W. Atkins A testing time for face recognition technology Biomet. Technol. Today 9 3 2001 8 11
3. B. Achermann, H. Bunke, Combination of classifiers on the decision level for face recognition, Technical report IAM-96-002, Institut für Informatik und angewandte Mathematik, Universität Bern, 1996
4. A. Adjoudani, and C. Benoît Audio-visual speech recognition compared across two architectures Proc. 4th European Conf. Speech Communication and Technology, Madrid, Spain, vol. 2 1995 1563 1567
5. L.A. Alexandre, A.C. Campilho, and M. Kamel On combining classifiers using sum and product rules Pattern Recogn. Lett. 22 2001 1283 1289
6. H. Altiay, and M. Demirekler An information theoretic framework for weight estimation in the combination of probabilistic classifiers for speaker identification Speech Commun. 30 2000 255 272
7. H. Altiay, and M. Demirekler Comparison of different objective functions for optimal linear combination of classifiers for speaker identification Proc. IEEE International Conf. Acoustics, Speech and Signal Processing, Salt Lake City, vol. 1 2001 401 404
8. Y. Barniv, and D. Casasent Multisensor image registration: Experimental verification Proc. SPIE 292 1981 160 171
9. S. Bengio Multimodal authentication using asynchronous HMMs Proc. 4th International Conf. Audio- and Video-Based Biometric Person Authentication, Guildford 2003 770 777
10. S. Bengio Multimodal speech processing using asynchronous hidden Markov models Inform. Fusion 5 2004 81 89
11. S. Ben-Yacoub, Y. Abdeljaoued, and E. Mayoraz Fusion of face and speech data for person identity verification IEEE Trans. Neural Netw. 10 1999 1065 1074
12. R.M. Bolle, J.H. Connell, and N.K. Ratha Biometric perils and patches Pattern Recogn. 35 2002 2727 2738
13. R. Brunelli, D. Falavigna, T. Poggio, and L. Stringa Automatic person recognition using acoustic and geometric features Machine Vision Appl. 8 1995 317 325
14. R. Brunelli, and D. Falavigna Person identification using multiple cues IEEE Trans. Pattern Anal. Machine Intell. 10 1995 955 965
15. C.J.C. Burges A tutorial on support vector machines for pattern recognition Data Mining Knowledge Discov. 2 1998 121 167
16. F. Cardinaux, C. Sanderson, and S. Bengio Face verification using adapted generative models Proc. 6th IEEE Int. Conf. Automatic Face and Gesture Recognition, Seoul 2004 825 830
17. E. Caulcott Significance Tests 1973 Routledge & Kegan Paul London
18. L.-F. Chen, H.-Y. Liao, J.-C. Lin, and C.-C. Han Why recognition in a statistics-based face recognition system should be based on the pure face portion: a probabilistic decision-based proof Pattern Recogn. 34 2001 1393 1403
19. C.C. Chibelushi, F. Deravi, and J.S. Mason Voice and facial image integration for speaker recognition IEEE International Symposium and Multimedia Technologies and Future Applications, Southampton, UK 1993
20. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm J. Roy. Statist. Soc. Ser. B 39 1977 1 38
21. U. Dieckmann, P. Plankensteiner, and T. Wagner SESAM: A biometric person identification system using sensor fusion Pattern Recogn. Lett. 18 1997 827 833
22. G.R. Doddington, M.A. Przybycki, A.F. Martin, and D.A. Reynolds The NIST speaker recognition evaluation - overview, methodology, systems, results, perspective Speech Commun. 31 2000 225 254
23. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2001 Wiley
24. J.-L. Dugelay, J.-C. Junqua, C. Kotropoulos, R. Kuhn, F. Perronnin, and I. Pitas Recent advances in biometric person authentication Proc. International Conf. Acoustics, Speech and Signal Processing, Orlando, vol. IV 2002 4060 4063
25. S. Furui Cepstral analysis technique for automatic speaker verification IEEE Trans. Acoust. Speech Signal Process. 29 2 1981 254 272
26. S. Furui Recent advances in speaker recognition Pattern Recogn. Lett. 18 1997 859 872
27. J.-L. Gauvain, and C.-H. Lee Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains IEEE Trans. Speech Audio Process. 2 1994 291 298
28. D. Genoud, F. Bimbot, G. Gravier, and G. Chollet Combining methods to improve speaker verification Proc. 4th International Conf. Spoken Language Processing, Philadelphia, vol. 3 1996 1756 1759
29. R.C. Gonzales, and R.E. Woods Digital Image Processing 1993 Addison-Wesley Reading, MA
30. J.A. Haigh, and J.S. Mason A voice activity detector based on cepstral analysis Proc. European Conf. Speech Communication and Technology, vol. 2 1993 1103 1106
31. J.A. Haigh, Voice activity detection for conversational analysis, MA thesis, University of Wales, 1994
32. D.L. Hall, and J. Llinas Multisensor data fusion D.L. Hall J. Llinas Handbook of Multisensor Data Fusion 2001 CRC Press 1 10
33. T.K. Ho, J.J. Hull, and S.N. Srihari Decision combination in multiple classifier systems IEEE Trans. Pattern Anal. Machine Intell. 16 1994 66 75
34. L. Hong, and A. Jain Integrating faces and fingerprints for personal identification IEEE Trans. Pattern Anal. Machine Intell. 20 1998 1295 1306
35. S.S. Iyengar, L. Prasad, and H. Min Advances in Distributed Sensor Technology 1995 Prentice Hall/PTR New Jersey
36. A. Jain, and U. Uludag Hiding biometric data IEEE Trans. Pattern Anal. Machine Intell. 25 2003 1494 1498
37. C. Jankowski, A. Kalyanswamy, S. Basson, and J. Spitz NTIMIT: A phonetically balanced, continuous speech telephone bandwidth speech database Proc. International Conf. Acoustics, Speech and Signal Processing, Albuquerque, vol. 1 1990 109 112
38. T. Joachims Making large-scale SVM learning practical B. Schölkopf C. Burges A. Smola Advances in Kernel Methods - Support Vector Learning 1999 MIT Press
39. P. Jourlin, J. Luettin, D. Genoud, and H. Wassner Acoustic-labial speaker verification Pattern Recogn. Lett. 18 1997 853 858
40. P. Jourlin, J. Luettin, D. Genoud, and H. Wassner Integrating acoustic and labial information for speaker identification and verification Proc. 5th European Conf. Speech Communication and Technology, Rhodes, Greece, vol. 3 1997 1603 1606
41. J. Kittler, J. Matas, K. Johnsson, and M.U. Ramos-Sánchez Combining evidence in personal identity verification systems Pattern Recogn. Lett. 18 1997 845 852
42. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas On combining classifiers IEEE Trans. Pattern Anal. Machine Intell. 20 1998 226 239
43. J. Luettin, Visual speech and speaker recognition, PhD thesis, Department of Computer Science, University of Sheffield, 1997
44. R.C. Luo, and M.G. Kay Introduction R.C. Luo M.G. Kay Multisensor Integration and Fusion for Intelligent Machines and Systems 1995 Ablex Publishing Corporation Norwood, NJ 1 26
45. A.V. Nefian, L.H. Liang, T. Fu, and X.X. Liu A Bayesian approach to audio-visual speaker identification Proc. 4th International Conf. Audio- and Video-Based Biometric Person Authentication, Guildford 2003 761 769
46. J.A. Nelder, and R. Mead A simplex method for function minimization Comput. J. 7 1965 308 313
47. J. Ortega-Garcia, J. Bigun, D. Reynolds, and J. Gonzales-Rodriguez Authentication gets personal with biometrics IEEE Signal Process. Mag. 21 2004 50 62
48. L.F. Pau Fusion of multisensor data in pattern recognition J. Kittler K.S. Fu L.F. Pau Pattern Recognition Theory and Applications (Proceedings of NATO Advanced Study Institute) 1982 Reidel Dordrecht
49. J. Picone Signal modeling techniques in speech recognition Proc. IEEE 81 1993 1215 1247
50. N. Poh, and S. Bengio Non-linear variance reduction techniques in biometric authentication Proc. Workshop on Multimodal User Authentication, Santa Barbara 2003 123 130
51. G. Potamianos, and H. Graf Discriminative training of HMM stream exponents for audio-visual speech recognition Proc. International Conf. Acoustics, Speech and Signal Processing, Seattle 1998 3733 3736
52. W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery Numerical Recipes in C: The Art of Scientific Computing 1992 Cambridge Univ. Press Cambridge
53. L. Rabiner, and B.-H. Juang Fundamentals of Speech Recognition 1993 Prentice Hall Englewood Cliffs, NJ
54. V. Radová, and J. Psutka An approach to speaker identification using multiple classifiers Proc. IEEE Conf. Acoustics, Speech and Signal Processing, Munich, vol. 2 1997 1135 1138
55. D. Reynolds, A Gaussian mixture modeling approach to text-independent speaker identification, Technical report 967, Lincoln Laboratory, Massachusetts Institute of Technology, 1993
56. D. Reynolds Experimental evaluation of features for robust speaker identification IEEE Trans. Speech Audio Process. 2 1994 639 643
57. D. Reynolds, T. Quatieri, and R. Dunn Speaker verification using adapted Gaussian mixture models Digital Signal Process. 1-3 2000 19 41
58. A. Ross, and A. Jain Information fusion in biometrics Pattern Recogn. Lett. 24 2003 2115 2125
59. V. Roth, V. Steinhage, Nonlinear discriminant analysis using kernel functions, Technical report No. IAI-TR-99-7 (ISSN 0944-8535), University of Bonn, 1999
60. C. Sanderson, and K.K. Paliwal Noise compensation in a person verification system using face and multiple speech features Pattern Recogn. 36 2 2003 293 302
61. C. Sanderson, and K.K. Paliwal Fast features for face authentication under illumination direction changes Pattern Recogn. Lett. 24 14 2003 2409 2419
62. C. Sanderson, and S. Bengio Statistical transformations of frontal models for non-frontal face verification Proc. IEEE Int. Conf. Image Processing, Singapore 2004
63. P. Silsbee, and A. Bovik Computer lipreading for improved accuracy in automatic speech recognition IEEE Trans. Speech Audio Process. 4 1996 337 351
64. F.K. Soong, and A.E. Rosenberg On the use of instantaneous and transitional spectral information in speaker recognition IEEE Trans. Acoust. Speech Signal Process. 36 1988 871 879
65. E.W. Swokowski Calculus fifth ed. 1991 PWS-Kent
66. R.R. Tenney, and N.R. Sandell Jr. Detection with distributed sensors IEEE Trans. Aerospace Electron. Syst. 17 1981 98 101
67. R.R. Tenney, and N.R. Sandell Jr. Strategies for distributed decision making IEEE Trans. Systems Man Cybernet. 11 1981 527 537
68. T. Thong, and Y.C. Jenq Hardware and architecture S.K. Mitra J.F. Kaiser Handbook for Digital Signal Processing 1993 Wiley 721 781
69. M. Turk, and A. Pentland Eigenfaces for recognition J. Cognitive Neurosci. 3 1991 71 86
70. V.N. Vapnik The Nature of Statistical Learning Theory 1995 Springer-Verlag New York
71. A. Varga, H.J.M. Steeneken, M. Tomlinson, D. Jones, The NOISEX-92 study on the effect of additive noise on automatic speech recognition, Technical report, Defence Evaluation and Research Agency (DERA), Speech Research Unit, Malvern, United Kingdom, 1992
72. P.K. Varshney Distributed Detection and Data Fusion 1997 Springer-Verlag New York
73. P. Verlinde, A contribution to multi-modal identity verification using decision fusion, PhD thesis, Department of Signal and Image Processing, Telecom Paris, France, 1999
74. T. Wark, S. Sridharan, and V. Chandran Robust speaker verification via fusion of speech and lip modalities Proc. International Conf. Acoustics, Speech and Signal Processing, Phoenix, vol. 6 1999 3061 3064
75. T. Wark, S. Sridharan, and V. Chandran Robust speaker verification via asynchronous fusion of speech and lip information Proc. 2nd International Conf. Audio- and Video-Based Biometric Person Authentication, Washington, DC 1999 37 42
76. T. Wark, S. Sridharan, and V. Chandran The use of temporal speech and lip information for multi-modal speaker identification via multi-stream HMM's [sic] Proc. International Conf. Acoustics, Speech and Signal Processing, Istanbul 2000 2389 2392
77. T. Wark, Multi-modal speech processing for automatic speaker recognition, PhD thesis, School of Electrical & Electronic Systems Engineering, Queensland University of Technology, Brisbane, 2000
78. J.L. Wayman Digital signal processing in biometric identification: a review Proc. IEEE Int. Conf. Image Processing, Rochester, vol. 1 2002 37 40
79. B. Wildermoth, and K.K. Paliwal Use of voicing and pitch information for speaker recognition Proc. 8th Australian International Conf. Speech Science and Technology, Canberra 2000 324 328
80. J.D. Woodward Biometrics: privacy's foe or privacy's friend? Proc. IEEE 85 1997 1480 1492