Multiparameter receiver operating characteristic analysis for signal detection and classification

IEEE Sensors Journal

Volumn 10, Issue 3, 2010, Pages 423-442

  Chang, Chein I ^a,b  

^a University of Marylandw Baltimore County   (United States)

^b NATIONAL CHUNG HSING UNIVERSITY   (Taiwan)

Author keywords

3 D ROC; Detection rate (DR); False alarm (FA) rate; Neyman Pearson (NP) detection; Receiver operating characteristic (ROC); Signal classification; Signal detection

Indexed keywords

DETECTION RATES; FALSE ALARMS; NEYMAN-PEARSON (NP) DETECTION; RECEIVER OPERATING CHARACTERISTICS; SIGNAL CLASSIFICATION;

ALARM SYSTEMS; BIOMETRICS; DETECTORS; DIAGNOSIS; ERRORS; LEARNING ALGORITHMS; RADAR TARGET RECOGNITION; SIGNAL PROCESSING; SIGNAL RECEIVERS; THREE DIMENSIONAL;

SIGNAL DETECTION;

EID: 77649099036     PISSN: 1530437X     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSEN.2009.2038120     Document Type: Article

References (35)

1. H. Poor, An Introduction to Signal Detection and Estimation. New York: Springer-Verlag, 1985, ch. 2.
2. J. A. Swets and R. M. Pickett, Evaluation of Diagnostic Systems: Methods From Signal Detection Theory. New York: Academic, 1982.
3. C. E. Metz, "ROC methodology in radiological imaging," Invest. Ra-diol., vol. 21, pp. 720-723, 1978.
4. D. R. Parker, S. C. Gustafson, and T. D. Ross, "Bayesian confidence intervals for ROC curves," Electron. Lett., vol. 41, no. 5, pp. 279-280, Mar. 2005.
5. D. R. Parker, S. C. Gustafson, and T. D. Ross, "Receiver operating characteristic and confidence error metrics for assessing the performance of automatic target recognition systems," Opt. Eng., vol. 44, no. 9, pp. 097202-1-097202-9, 2005.
6. E. P. Blasch, S. Alsing, and R. Bauer, "Comparison of bootstrap and prior probability synthetic data balancing method for SAR target recognition," in Proc. SPIE Int. Symp. Aerosp./Defense Sim. Control, Orlando, FL, Apr. 1999, vol. 3721, pp. 740-747.
7. E. Blasch and R. Broussard, "Physiologically motivated computational visual target recognition beta selection," in Proc. SPIE Int. Symp. Aerosp./Defense Sim. Control, App. Sci. Comp. Intell., Orlando, FL, Apr. 2000, vol. 4055, pp. 442-451.
8. J. Bauman, E. Blasch, J. Jackson, and G. Sterling, "Real-time ROC: A near-real-time performance evaluation tool," Proc. SPIE 2005, vol. 5807, pp. 380-390, Apr. 2005.
9. E. P. Blasch, J. Hoffman, and J. Petty, "Defininga fusion gain - System operation characteristic curve," in Proc. SPIE Int. Symp. Aerosp./Defense Simul. Control, Conf - Sens. Fusion X, Orlando, FL, Apr. 2001, vol. 4380, pp. 397-405.
10. E. Blasch and S. Plano, "Level 5: User refinement to aid the fusion process," Proc. SPIE 2003, vol. 5095, pp. 288-297, Apr. 2003.
11. E. Blasch, "User refinement in information fusion," in Chapter 19 in Handbook of Multisensor Data Fusion, D. Hall and J. Llinas, Eds., 2 ed. Boca Raton, FL: CRC Press, 2008.
12. S. Alsing, E. P. Blasch, and R. Bauer, "3D ROC surface concepts for evaluation of target recognition algorithms faced with the unknown target detection problem," in Proc. SPIE Int. Symp. Aerosp./Defense Simul. Control, Orlando, FL, Apr. 1999, vol. 3718, pp. 449-458.
13. S. Plano and E. Blasch, "User fusion to constrain SAR targeting for TSTs," Proc. SPIE 2003, vol. 5095, pp. 315-324, Apr. 2003.
14. C.-I Chang, H. Ren, Q. Du, S.-S. Chiang, and A. Ifarraguerri, "An ROC analysis for subpixel detection," in Proc. IEEE 2001 Int. Geosci. Remote Sens. Symp., Sydney, Australia, Jul. 2001, pp. 2355-2357.
15. C.-I Chang, X. Zhao, M. L. G. Althouse, and J.-J. Pan, "Least squares subspace projection approach to mixed pixel classification in hyperspectral images," IEEE Trans. Geosci. Remote Sens., vol. 36, no. 3, pp. 898-912, May 1998.
16. C.-I Chang, "Target signature-constrained mixed pixel classification for hyperspectral imagery," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 2, pp. 1065-1081, May 2002.
17. C.-I Chang, Hyperspectral Imaging: Techniques for Spectral Detection and Classification. New York: Kluwer/Plenum, 2003.
18. C. M. Wang, C. C. Chen, Y.-N. Chung, S.-C. Yang, P. C. Chung, C. W. Yang, and C.-I Chang, "Detection of spectral signatures in MR images for classification," IEEE Trans. Med. Imag., vol. TMI-22, no. 1, pp. 50-61, Jan. 2003.
19. C. C. Chen, C.-M. Wang, C.-I Chang, C.-W. Yang, J. W. Chai, Y.-N. Chung, and P.-C. Chung, "Chapter 9: Techniques in detection of spectral signatures in MR images and their applications," in Medical Imaging Systems: Technology and Applications, C. T. Leondes, Ed. Singapore: World Scientific, 2005, vol. 4, pp. 297-327.
20. J. Wang, C.-I Chang, H.-M. Chen, C. C. C. Chen, J. W. Chai, and Y. C. Ouyang, "3D ROC analysis for medical diagnosis evaluation," in Proc. 27th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. (EMBS), Shanghai, China, Sep. 2005, pp. 7545-7548.
21. C.-I Chang, Hand held device detects chemical and biological warfare agents Dec. 2006 [Online]. Available: http://newsroom.spie.org/x5237.xml, 10.1117/2.1200612.0507, ISSN 1818-2559
22. W. Liu, C.-I Chang, S. Wang, J. Jensen, J. Jensen, H. Hnapp, R. Daniel, and R. Yin, "3D ROC analysis for detection software used in water monitoring," presented at the presented at the OpticsEast, Chem. Biol. Standoff Detection III (SA03), Boston, MA, Oct. 2005.
23. Y. Du and C.-I Chang, Rethinking the effective assessment of biometric systems [Online]. Available: http://newsroom.spie.org/x17545.xml 10.1117/2.1200711.0815
24. Y. Du and C.-I Chang, "3D combination curves for accuracy and performance analysis of positive biometrics identification," Opt. Lasers Eng., vol. 46, no. 6, pp. 477-490, Jun. 2008.
25. C. Y. Suen, M. Berthod, and S. Mori, "Automatic recognition of handprinted characters - The state of the art," Proc. IEEE, vol. 68, no. 4, pp. 469-487, Apr. 1980.
26. Y. Du, C.-I Chang, and P. Thouin, "An automatic system for text detection in single video images," J. Electron. Imag., vol. 12, no. 3, pp. 410-422, Jul. 2003.
27. B. Thai and G. Healey, "Invariant subpixel material detection in hyper-spectral imagery," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 3, pp. 599-608, Mar. 2002.
28. Q. Du and C.-I Chang, "A signal-decomposed and interference- annihilated approach to hyperspectral target detection," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 4, pp. 892-906, Apr. 2004.
29. J. C. Harsanyi, Detection and classification of subpixel spectral signatures in hyperspectral image sequences Dept. Electr. Eng., Univ. Maryland. Baltimore County, Aug. 1993.
30. C.-I Chang and H. Ren, "An experiment-based quantitative and comparative analysis of hyperspectral target detection and image classification algorithms," IEEE Trans. Geosci. Remote Sens., vol. 38, no. 2, pp. 1044-1063, Mar. 2000.
31. C.-I Chang, X. Zhao, M. L. G. Althouse, and J.-J. Pan, "Least squares subspace projection approach to mixed pixel classification in hyperspectral images," IEEE Trans Geosci. Remote Sens., vol. 36, no. 3, pp. 898-912, May 1998.
32. C.-I Chang and D. Heinz, "Constrained subpixel detection for remotely sensed images," IEEE Trans. Geosci. Remote Sens., vol. 38, no. 3, pp. 1144-1159, May 2000.
33. D. Heinz and C.-I Chang, "Fully constrained least squares linear mixture analysis for material quantification in hyperspectral imagery," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 3, pp. 529-545, Mar. 2001.
34. J. C. Harsanyi and C.-I Chang, "Hyperspectral image classification and dimensionality reduction: An orthogonal subspace projection approach," IEEE Trans. Geosci. Remote Sens., vol. 32, no. 4, pp. 779-785, Jul. 1994.
35. [Online]. Available: www.bic.mni.mcgill.ca/brainweb/