Automatic speaker age and gender recognition using acoustic and prosodic level information fusion

Computer Speech and Language

Volumn 27, Issue 1, 2013, Pages 151-167

  Li, Ming ^a   Han, Kyu J ^a   Narayanan, Shrikanth ^a  

^a University of Southern California ^*  (United States)

Author keywords

Age recognition; Formant; Gender recognition; GMM; Harmonic structure; Maximum likelihood linear regression; Pitch; Polynomial expansion; Prosodic features; Score level fusion; Sparse representation; SVM; UBM weight posterior probability supervectors

Indexed keywords

AGE RECOGNITION; FORMANT; GENDER RECOGNITION; GMM; HARMONIC STRUCTURES; MAXIMUM LIKELIHOOD LINEAR REGRESSION; PITCH; POLYNOMIAL EXPANSION; POSTERIOR PROBABILITY; PROSODIC FEATURES; SCORE-LEVEL FUSION; SPARSE REPRESENTATION; SVM;

PROBABILITY; SOCIAL SCIENCES; SPEECH ANALYSIS; SPEECH RECOGNITION; TIME DOMAIN ANALYSIS;

SUPPORT VECTOR MACHINES;

EID: 84867336595     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2012.01.008     Document Type: Article

References (47)

1. Ajmera J.; and Burkhardt F. Age and gender classification using modulation cepstrum Proc. Odyssey 2008 025
2. Black M.; Katsamanis A.; Lee C.; Lammert A.; Baucom B.; Christensen A.; Georgiou P.; and Narayanan S. Automatic classification of married couples' behavior using audio features Proc. INTERSPEECH 2010 2030 2033
3. Bocklet T.; Maier A.; Bauer J.; Burkhardt F.; and Nöth E. Age and gender recognition for telephone applications based on GMM supervectors and support vector machines Proc. ICASSP 2008 1605 1608
4. Bocklet T.; Stemmer G.; Zeissler V.; and Nöth E. Age and gender recognition based on multiple systems - early vs. late fusion Proc. INTERSPEECH 2010 2830 2833
5. Brümmer, N.; 2007. Focal multi-class: toolkit for evaluation, fusion and calibration of multi-class recognition scorestutorial and user manual. Software available at http://sites.google.com/site/nikobrummer/focalmulticlass.
6. Burkhardt F.; Eckert M.; Johannsen W.; and Stegmann J. A database of age and gender annotated telephone speech Proc. 7th International Conference on Language Resources and Evaluation (LREC) 2010 1562 1565
7. Campbell W.; Campbell J.; Reynolds D.; Singer E.; and Torres-Carrasquillo P. Support vector machines for speaker and language recognition Computer Speech & Language 20 2006 210 229
8. Campbell W.; Sturim D.; Reynolds D.; and Solomonoff A. SVM based speaker verification using a GMM supervector kernel and NAP variability compensation Proc. ICASSP 2006 97 100
9. Cao C.; Li M.; Liu J.; and Yan Y. Multiple f0 estimation in polyphonic music Third Music Information Retrieval Evaluation eXchange (MIREX) 2007
10. Chang, C.C.; Lin, C.J.; 2001. LIBSVM: A Library for Support Vector Machines. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
11. Collobert R.; and Bengio S. SVMTorch: support vector machines for large-scale regression problems The Journal of Machine Learning Research 1 2001 143 160
12. Dehak N.; Dumouchel P.; and Kenny P. Modeling prosodic features with joint factor analysis for speaker verification IEEE Transactions on Audio, Speech, and Language Processing 15 2007 2095 2103
13. Dehak N.; Kenny P.; Dehak R.; Dumouchel P.; and Ouellet P. Front-end factor analysis for speaker verification IEEE Transactions on Audio, Speech, and Language Processing 19 2011 788 798
14. Dehak N.; Kenny P.; and Dumouchel P. Continuous prosodic features and formant modeling with joint factor analysis for speaker verification Proc. INTERSPEECH 2007 1234 1237
15. Dobry G.; Hecht R.; Avigal M.; and Zigel Y. Dimension reduction approaches for SVM based speaker age estimation Proc. INTERSPEECH 2009 2031 2034
16. Eyben F.; Wollmer M.; and Schuller B. OpenEAR introducing the Munich open-source emotion and affect recognition toolkit Affective Computing and Intelligent Interaction and Workshops, ACII 2009 1 6
17. Gajšek R.; Žibert J.; Justin T.; Štruc V.; Vesnicer B.; and Mihelič F. Gender and affect recognition based on GMM and GMM-UBM modeling with relevance MAP estimation Proc. INTERSPEECH 2010 2810 2813
18. van Heerden C.; Barnard E.; Davel M.; van der Walt C.; van Dyk E.; Feld M.; and Müller C. Combining regression and classification methods for improving automatic speaker age recognition Proc. ICASSP 2010 5174 5177
19. Hermes D. Measurement of pitch by subharmonic summation Journal of the Acoustical Society of America 83 1988 257 264
20. Jebara T.; Kondor R.; and Howard A. Probability product kernels The Journal of Machine Learning Research 5 2004 819 844
21. Kockmann M.; and Burget L. Contour modeling of prosodic and acoustic features for speaker recognition Proc. Spoken Language Technology Workshop, IEEE 2008 45 48
22. Kockmann M.; Burget L.; and Černocký J. Brno university of technology system for interspeech 2010 paralinguistic challenge Proc. INTERSPEECH 2010 2822 2825
23. Lee C.; Black M.; Katsamanis A.; Lammert A.; Baucom B.; Christensen A.; Georgiou P.; and Narayanan S. Quantification of prosodic entrainment in affective spontaneous spoken interactions of married couples Proc. INTERSPEECH 2010 793 796
24. Leggetter C.; and Woodland P. Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models Computer Speech and Language 9 1995 171
25. Li M.; Cao C.; Di Wang P.; Fu Q.; and Yan Y. Cochannel speech separation using multi-pitch estimation and model based voiced sequential grouping Proc. INTERSPEECH 2008 151 154
26. Li M.; Jung C.S.; and Han K.J. Combining five acoustic level methods for automatic speaker age and gender recognition Proc. INTERSPEECH 2010 2826 2829
27. Li M.; and Narayanan S. Robust talking face video verification using joint factor analysis and sparse representation on GMM mean shifted supervectors Proc. ICASSP 2011 1481 1484
28. Li M.; Suo H.; Wu X.; Lu P.; and Yan Y. Spoken language identification using score vector modeling and support vector machine Proc. INTERSPEECH 2007 350 353
29. Li M.; Zhang X.; Yan Y.; and Narayanan S. Speaker verification using sparse representations on total variability i-vectors Proc. INTERSPEECH 2011
30. Lin C.; and Wang H. Language identification using pitch contour information Proc. ICASSP 2005 601 604
31. Lingenfelser F.; Wagner J.; Vogt T.; Kim J.; and André E. Age and gender classification from speech using decision level fusion and ensemble based techniques Proc. INTERSPEECH 2010 2798 2801
32. Meinedo H.; and Trancoso I. Age and gender classification using fusion of acoustic and prosodic features Proc. INTERSPEECH 2010 2818 2821
33. Metze F.; Ajmera J.; Englert R.; Bub U.; Burkhardt F.; Stegmann J.; Muller C.; Huber R.; Andrassy B.; Bauer J.; and Littel B. Comparison of four approaches to age and gender recognition for telephone applications Proc. ICASSP 2007 1089 1092
34. Müller C.; and Burkhardt F. Combining short-term cepstral and long-term pitch features for automatic recognition of speaker age Proc. INTERSPEECH 2007 2277 2280
35. Nguyen P.; Le T.; Tran D.; Huang X.; and Sharma D. Fuzzy support vector machines for age and gender classification Proc. INTERSPEECH 2010 2806 2809
36. Porat R.; Lange D.; and Zigel Y. Age recognition based on speech signals using weights supervector Proc. INTERSPEECH 2010 2814 2817
37. Reynolds D.; Quatieri T.; and Dunn R. Speaker verification using adapted Gaussian mixture models Digital Signal Processing 10 2000 19 41
38. Schötz S. Acoustic analysis of adult speaker age. Speaker classification I Lecture Notes in Computer Science 2007 88 107
39. Schuller B.; Steidl S.; Batliner A.; Burkhardt F.; Devillers L.; Mueller C.; and Narayanan S. The INTERSPEECH 2010 paralinguistic challenge Proc. INTERSPEECH 2010 2794 2797
40. Schwarz, P.; Matejka, P.; Cernocky, J.; 2006. Hierarchical structures of neural networks for phoneme. In: Proc. ICASSP, pp. 325-328. Software available at http://speech.fit.vutbr.cz/software/phoneme-recognizer-based-long-temporal- context.
41. Sjölander K.; and Beskow J. Wavesurfer-an open source speech tool Proc. ICSLP 2000 464 467
42. Spiegl W.; Stemmer G.; Lasarcyk E.; Kolhatkar V.; Cassidy A.; Potard B.; Shutn S.; Song Y.; Xu P.; Beyerlein P.; Harnsberger J.; and Nöth E. Analyzing features for automatic age estimation on cross-sectional data Proc. INTERSPEECH 2009 2923 2926
43. Stolcke A.; Ferrer L.; Kajarekar S.; Shriberg E.; and Venkataraman A. MLLR transforms as features in speaker recognition Proc. INTERSPEECH 2005 2425 2428
44. Stolcke A.; Kajarekar S.; Ferrer L.; Shrinberg E.; Int S.; and Park M. Speaker recognition with session variability normalization based on MLLR adaptation transforms IEEE Transactions on Audio, Speech, and Language Processing 15 2007 1987 1998
45. Wolters M.; Vipperla R.; and Renals S. Age recognition for spoken dialogue systems: Do we need it? Proc. INTERSPEECH 2009 1435 1438
46. Wright J.; Yang A.; Ganesh A.; Sastry S.; and Ma Y. Robust face recognition via sparse representation IEEE Transactions on Pattern Analysis and Machine Intelligence 31 2008 210 227
47. Zhang X.; Suo H.; Zhao Q.; and Yan Y. Using a kind of novel phonotactic information for SVM based speaker recognition IEICE Transactions on Information and Systems 92 2009 746 749