Discrimination and confidence error in detector reported scores

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 5427, Issue , 2004, Pages 342-353

  Ross, Timothy D ^a   Minardi, Mark E ^a  

^a AIR FORCE RESEARCH LABORATORY   (United States)

Author keywords

ATR; Confidence; Cross entropy; Detection; Evaluation; Performance assessment; ROC

Indexed keywords

CONFIDENCE; CROSS-ENTROPY; DETECTION; PERFORMANCE ASSESSMENT;

COMPUTER SIMULATION; DATA ACQUISITION; DECISION MAKING; ENTROPY; ERROR ANALYSIS; MONTE CARLO METHODS; PROBABILITY;

DECISION SUPPORT SYSTEMS;

EID: 10444225487     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.542161     Document Type: Conference Paper

References (9)

1. C. M. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, 1995
2. D. A. G. Williams, "Knowing What You Don't Know: Roles for Confidence Measures in Automatic Speech Recognition", Dissertation, Department of Computer Science, University of Sheffield, May, 1999
3. D. R. Parker, S. C. Gustafson, and T. D. Ross, "Integrated Receiver Operating Characteristic and Confidence Error Metrics for Assessing the Performance of Automatic Target Recognition Systems", Proc. SPIE, Vol. 5427, Algorithms for SAR Imagery XI, April 2004
4. M. Siu and H. Gish, "Evaluation of word confidence for speech recognition systems", in Computer Speech & Language, Volume 13, Issue 4, October 1999, pp.299-319
5. The 2001 NIST Evaluation Plan for Recognition of Conversational Speech over the Telephone, Version 1.1, 30-Oct-00, http://www.nist.gov/speech/tests/ctr/h5_2001/h5-01v1.1.pdf
6. A. R. Wise, D. Fitzgerald, T. D. Ross, "The Adaptive SAR ATR problem set (AdaptSAPS)", Proc. SPIE, Vol. 5427, Algorithms for SAR Imagery XI, April 2004
7. Math Works, http://www.mathworks.com/
8. P. L. Meyer, Introductory Probability and Statistical Applications, Addison-Wesley, Reading, 1970
9. F. Wessel, R. Schluter, K. Macherey, and H. Ney, "Confidence Measures for Large Vocabulary Continuous Speech Recognition", IEEE Trans, on Speech and Audio Processing, Vol. 9, No. 3, March 2001