The distribution of calibrated likelihood-ratios in speaker recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 1619-1623

  Van Leeuwen, David A ^a   Brümmer, Niko ^b  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^b Agnitio Research   (South Africa)

Author keywords

[No Author keywords available]

Indexed keywords

PROBABILITY DENSITY FUNCTION; SPEECH RECOGNITION;

AUTOMATIC SPEAKER RECOGNITION; CLOSED-FORM EXPRESSION; LINEAR CALIBRATION; LOG LIKELIHOOD RATIO; LOG-LIKELIHOOD RATIOS; LOGISTIC REGRESSIONS; PROBABILITY DENSITY FUNCTIONS (PDFS); SPEAKER RECOGNITION;

CALIBRATION;

EID: 84897405905     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. N. Brümmer, "Application-independent evaluation of speaker detection, " in Proc. Odyssey 2004 Speaker and Language recognition workshop. ISCA, June 2004, pp. 33-40.
2. N. Brümmer and J. du Preez, "Application-independent evaluation of speaker detection, " Computer Speech and Language, vol. 20, pp. 230-275, 2006.
3. N. Brümmer and D. A. van Leeuwen, "On calibration of language recognition scores, " in Proc. Odyssey 2006 Speaker and Language recognition workshop, San Juan, June 2006.
4. D. Ramos-Castro, J. González-Rodríguez, and J. Ortega- Garcia, "Likelihood ratio calibration in a transparent and testable forensic speaker recognition framework, " in Proc. Odyssey 2006 Speaker and Language Recognition Workshop, 2006.
5. D. Ramos, "Forensic evaluation of the evidence using automatic speaker recognition systems, " Ph.D. dissertation, Universidad Autonoma de Madrid, November 2007.
6. N. Brümmer, L. Burget, J. Černocký, O. Glembek, F. Grezl, M. Karafiát, P. Matějka, D. A. van Leeuwen, P. Schwarz, and A. Strassheim, "Fusion of heterogeneous speaker recognition systems in the STBU submission for the NIST speaker recognition evaluation 2006, " IEEE Transactions on Speech, Audio and Language Processing, vol. 15, no. 7, pp. 2072-2084, 2007.
7. Z. Jancik, O. Plchot, N. Brummer, L. Burget, O. Glembek, V. Hubeika, M. Karafiát, P. Matejka, T. Mikolov, A. Strasheim et al., "Data selection and calibration issues in automatic language recognition-investigation with BUT-AGNITIO NIST LRE 2009 system, " in Proc. Speaker and Language Odyssey, 2010.
8. M. I. Mandasari, M. McLaren, and D. A. van Leeuwen, "Evaluation of i-vector speaker recognition systems for forensic application, " in Proc. Insterspeech. Firenze: ISCA, August 2011.
9. D. A. van Leeuwen and N. Brümmer, "A speaker line-up for the likelihood ratio, " in Proc. Interspeech. Firenze: ISCA, August 2011.
10. M. I. Mandasari, M. McLaren, and D. A. van Leeuwen, "The effect of noise on modern automatic speaker recognition systems, " in Proc. ICASSP. Kyoto: IEEE, March 2012.
11. G. R. Doddington, "The role of score calibration in speaker recognition, " in Proc. Interspeech, 2012.
12. G. R. Doddington, M. A. Przybocki, A. F. Martin, and D. A. Reynolds, "The NIST speaker recognition evaluation-Overview, methodology, systems, results, perspective, " Speech Communication, vol. 31, pp. 225- 254, 2000.
13. A. Martin, G. Doddington, T. Kamm, M. Ordowski, and M. Przybocki, "The DET curve in assessment of detection task performance, " in Proc. Eurospeech 1997, Rhodes, Greece, 1997, pp. 1895-1898.
14. D. A. van Leeuwen and N. Brümmer, "An introduction to application-independent evaluation of speaker recognition systems, " in Speaker Classification, ser. Lecture Notes in Computer Science/Artificial Intelligence, C. Müller, Ed. Springer, 2007, vol. 4343.
15. A. F. Martin and A. N. Le, "NIST 2007 language recognition evaluation, " in Proc. Speaker and Language Odyssey. Stellenbosch, South Afrika: IEEE, 2008.
16. R. Wallace, M. McLaren, C. McCool, and S. Marcel, "Cross-pollination of normalization techniques from speaker to face authentication using gaussian mixture models, " Information Forensics and Security, IEEE Transactions on, vol. 7, no. 2, pp. 553-562, 2012.
17. M. DeGroot and S. Fienberg, "The comparison and evaluation of forecasters, " The Statistician, pp. 12-22, 1983.
18. J. Gonzalez-Rodriguez, P. Rose, D. Ramos, D. T. Toledano, and J. Ortega-Garcia, "Emulating DNA: Rigorous quantification of evidential weight in transparent and testable forensic speaker recognition, " IEEE Transactions on Audio, Speech and Language Processing, vol. 15, no. 7, pp. 2104-2115, September 2007.
19. C. S. Greenberg, "The NIST year 2012 speaker recognition evaluation plan, " 2012. [Online]. Available: http://www.nist.gov/itl/iad/mig/upload/ NISTSRE12evalplan-v17-r1.pdf.
20. D. A. van Leeuwen and R. Saeidi, "Knowing the nontarget speakers: The effect of the i-vector population for PLDA training in speaker recognition, " in Proc ICASSP. Vancouver: IEEE, 2013.
21. R. Auckenthaler, M. Carey, and H. Lloyd-Thomas, "Score normalization for text-independent speaker verification systems, " Digital Signal Processing, vol. 10, pp. 42-54, 2000.
22. J. Navrátil and G. N. Ramsawamy, "The awe and mistery of t-norm, " in Proc. Eurospeech, 2003, pp. 2009-2012.
23. N. Brümmer, "Measuring, refining and calibrating speaker and language information extracted from speech, " Ph.D. dissertation, Stellenbosch University, 2010.
24. K. Slooten and R. Meester, "Forensic identification: Database likelihood ratios and familial DNA searching, " arXiv:1201.4261 [stat.AP], 2012.
25. J. L. W. V. Jensen, "Sur les fonctions convexes et les inégalités entre les valeurs moyennes, " Acta Mathematica, vol. 30, no. 1, pp. 175-193, 1906.
26. N. Brümmer and G. Doddington, "Likelihood-ratio calibration using prior-weighted proper scoring rules, " in Proc. Interspeech. ISCA, 2013.
27. D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted gaussian mixture models, " Digital Signal Processing, vol. 10, pp. 19-41, 2000.
28. S. J. D. Prince and J. H. Elder, "Probabilistic linear discriminant analysis for inferences about identity, " in IEEE International Conference on Computer Vision (ICCV). IEEE, 2007, pp. 1-8.
29. N. Brümmer, FoCal-II: Toolkit for calibration of multiclass recognition scores, August 2006, software available at http://www.dsp.sun.ac.za/ nbrummer/focal/index.htm.
30. E. de Villiers and N. Brümmer, The Bosaris Toolkit, BOSARIS, 2010, software available at https://sites.google.com/site/bosaristoolkit/.