Error analysis of pattern recognition systems - The subsets bootstrap

Computer Vision and Image Understanding

Volumn 93, Issue 1, 2004, Pages 1-33

  Bolle, Ruud M ^a   Ratha, Nalini K ^a   Pankanti, Sharath ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DECISION MAKING; ERROR ANALYSIS; EVALUATION; IMAGE PROCESSING; PATTERN RECOGNITION; STATISTICAL METHODS;

BIOMETRIC SYSTEMS; SUBSETS BOOTSTRAP;

PATTERN RECOGNITION SYSTEMS;

EID: 0346686126     PISSN: 10773142     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cviu.2003.08.002     Document Type: Article

References (33)

1. R.M. Bolle, S. Pankanti, and N.K. Ratha. Evaluating authentication systems using bootstrap confidence intervals, in: Proc. IEEE AutoID'99 (1999) 9-13.
2. R.M. Bolle, J.H. Connell, S. Pankanti, N.K. Ratha, A.W. Senior, Guide to Biometrics: Selection and System Design, Springer, Boston, MA, 2003.
3. R.M. Bolle, N.K. Ratha, S. Pankanti. Evaluation techniques for biometrics-based authentication systems (FRR), in: Proc. 15th Internat. Conf. Pattern Recogn. (2000) 835-841.
4. K. Cho, P. Meer, J. Cabrera, Performance assessment through bootstrap, IEEE Trans. Pattern Anal. Mach. Intell. 19 (11) (1997) 1185-1198.
5. H. Cummins, C. Midlo, Finger Prints, Palms and Soles, Dover Publications Inc, New York, 1961.
6. J.G. Daugman, G.O. Williams, A proposed standard for biometric decidability, in: CardTechSecureTech, Atlanta, GA, 1996, pp. 223-234.
7. R.O. Duda, P.E. Hart, Pattern Classification and Scene Analysis, Wiley, New York, NY, 1973.
8. B. Efron, Bootstrap methods: another look at the Jackknife, Ann. Statistics 7 (1979) 1-26.
9. R. Germain, et al., Issues in large scale automatic biometric identification, in: IEEE Workshop on Automatic Identification Advanced Technologies, Stony Brook, NY, 1996, pp. 43-46.
10. FBI, US Department of Justice, Washington, DC 20402. The Science of Fingerprints, Classification and Uses, 1984.
11. D.A. Freedman, On bootstrapping two stage least squares estimates in stationary linear models, Ann. Statistics 12 (1984) 827-842.
12. K. Fukunaga, Introduction to Statistical Pattern Recognition, Academic Press, 1990.
13. M. Golfarelli, D. Maio, D. Maltoni, On the error-reject trade-off in biometric verification systems, IEEE Trans. Pattern Anal. Mach. Intell. 19 (7) (1997) 786-796.
14. Y. Hamamoto, S. Uchimura, S. Tomita, A bootstrap technique for nearest-neighbor classifier design, IEEE Trans. Pattern Anal. Mach. Intell. 19 (1) (1997) 73-79.
15. A.K. Jain, R.M. Bolle, in: S. Pankanti (Ed.), Biometrics: Personal Identification in Networked Society, Kluwer Academic Publishers, Boston, MA, 1999.
16. A.K. Jain, R.C. Dubes, C.C. Chen, Bootstrap techniques for error estimation, IEEE Trans. Pattern Anal. Mach. Intell. 9 (5) (1987) 628-633.
17. R.Y. Liu, Bootstrap procedures under some non-iid models, Ann. Statistics 16 (1988) 1696-1708.
18. R.Y. Liu, K. Singh, Moving blocks Jackknife and Bootstrap capture weak dependence, in: R. LePage, L. Billard (Eds.), Exploring the Limits of the Bootstrap, Wiley, New York, 1992, pp. 225-248.
19. D. Maio, D. Maltoni, R. Cappelli, J.L. Wayman, A.K. Jain, FVC2000: fingerprint verification competition, IEEE Trans. Pattern Anal. Mach. Intell. 24 (3) (2002) 402-412.
20. J. Neter, W. Wasserman, Applied Linear Statistical Models, Richard D. Irwing Inc, Homewood, IL, 1974.
21. W.W. Peterson, T.G. Birdsall, The theory of signal detectability. Technical Report 13 (unclassified), Electronic Defense Group, University of Michigan, Ann Arbor, 1953.
22. W.W. Peterson, T.G. Birdsall, W.C. Fox, The theory of signal delectability, Trans. IRE PGIT-4 (1954) 171-212.
23. P.J. Phillips, A. Martin, C.L. Wilson, M. Przybocki, An introduction to evaluating biometric systems, IEEE Comput. 21 (2) (2000) 56-63.
24. P.J. Phillips, On performance statistics for biometrics systems, in: Proc. IEEE AutoID'99 (1999) 111-116.
25. P.J. Phillips, H. Moon, S.A. Rizvi, P.J. Rauss, The FERET evaluation methodology for face-recognition algorithms, FERET Trans. Pattern Anal. Mach. Intell. 22 (10) (2000) 1090-1104.
26. D.M. Politis, Computer-intensive methods in statistical analysis, IEEE Signal Process. 15 (1) (1998) 39-55.
27. R. Viveros, K. Balasubramanian, J.A. Mitas, Binomial and negative bionomial analogues under correlated bernoulli trials, J. Am. Statistician 48 (3) (1984) 243-247.
28. J.L. Wayman, A scientific approach to evaluating biometric systems using mathematical methodology, in: CardTech/SecureTech (1997) 477-492.
29. J.L. Wayman, Confidence interval and test size estimation for biometric data, in: Proc. IEEE AutoID'99 (1999) 177-184.
30. J.L. Wayman, Error rate equations for the general biometric system, IEEE Automat. Robot. Mag. 6 (1) (1999) 35-48.
31. S.M. Weiss, Small sample error rate estimation for k-NN classifiers, IEEE Trans. Pattern Anal. Mach. Intell. 13 (3) (1991) 285-289.
32. S. Winograd. Personal communications, December 2000.
33. A.M. Zoubir, B. Boashash, The bootstrap and its sapplication in signal processing, IEEE Signal Process. 15 (1) (1998) 56-76.