Likelihood-ratio calibration using prior-weighted proper scoring rules

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 1976-1980

  Brümmer, Niko ^a   Doddington, George ^b  

^a Agnitio Research   (South Africa)

^b NONE

Author keywords

Calibration; Proper scoring rule; Speaker recognition

Indexed keywords

REGRESSION ANALYSIS;

DECISION THRESHOLD; EXPECTED VALUES; FALSE-ALARM RATES; LOGISTIC REGRESSIONS; PARAMETRIC FAMILY; PROPER SCORING RULES; SPEAKER RECOGNITION; STANDARD TOOLS;

CALIBRATION;

EID: 84906269425     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Niko Brümmer et al. "Fusion of Heterogeneous Speaker Recognition Systems in the STBU Submission for the NIST Speaker Recognition Evaluation 2006", IEEE Transactions on Audio, Speech, and Language Processing, September 2007.
2. Niko Brümmer and Johan du Preez, "Application-Independent Evaluation of Speaker Detection", Computer Speech and Language, 2006.
3. Niko Brümmer and Edward de Villiers, "The BOSARIS Toolkit: Theory, Algorithms and Code for Surviving the New DCF", NIST SRE'11 Analysis Workshop, Atlanta, December 2011. Online: http://sites.google.com/site/ bosaristoolkit.
4. George Doddington, "The Role of Score Calibration in Speaker Recognition", Interspeech, Portland, September 2012.
5. Tilmann Gneiting and Adrian E. Raftery, "Strictly proper scoring rules, prediction, and estimation", Journal of the American Statistical Association, vol. 102, no. 477, pp. 359-378, March 2007.
6. Niko Brümmer, "The Role of Proper Scoring Rules in Training and Evaluating Probabilistic Speaker and Language Recognizers", Invited Talk, Odyssey 2012: The Speaker and Language Recognition Workshop, Singapore, 2012. Online: http://www.odyssey2012.org/plenary.html.
7. Morris H. DeGroot, Optimal Statistical Decisions, McGraw-Hill, 1970.
8. Niko Brümmer, "Measuring, refining and calibrating speaker and language information extracted from speech", Ph.D. dissertation, University of Stellenbosch, December 2010.
9. Andreas Buja, Werner Stuetzle, and Yi Shen, "Loss functions for binary class probability estimation and classification: Structure and applications", Technical report, Statistics Department, The Wharton School, University of Pennsylvania, November 2005.
10. Glenn W. Brier, "Verification of Forecasts Expressed in Terms of Probability", MonthlyWeather Review, vol.78, no.1, pp. 1-3, January 1950.
11. Jorge Nocedal and Stephen J. Wright, Numerical Optimization, 2nd edition, Springer 2006.
12. AGNITIO, BUT, CRIM, "ABC SRE'12 Presentation", NIST SRE 2012 Workshop, Orlando, December 2012.
13. "The NIST Year 2012 Speaker Recognition Evaluation Plan" 2012. Online: http://www.nist.gov/itl/iad/mig/upload/NIST-SRE12-evalplan-v17-r1.pdf.
14. Bianca Zadrozny and Charles Elkan, "Transforming classifier scores into accurate multiclass probability estimates", in Proceedings of the Eighth International Conference on Knowledge Discovery and Data Mining, Edmonton, Alberta, Canada, 2002, pp. 694-699.
15. Burget, L. et al., "Discriminatively Trained Probabilistic Linear Discriminant Analysis for Speaker Verification", IEEE ICASSP, Prague, 2011.