Bayes optimality in linear discriminant analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 30, Issue 4, 2008, Pages 647-657

  Hamsici, Onur C ^a   Martinez, Aleix M ^a  

^a Ohio State University   (United States)

Author keywords

Bayes optimal; Convex optimization; Data mining; Data visualization; Feature extraction; Linear discriminant analysis; Pattern recognition

Indexed keywords

APPROXIMATION THEORY; DATA MINING; DATA REDUCTION; DATA VISUALIZATION; DISCRIMINANT ANALYSIS; FEATURE EXTRACTION; GAUSSIAN DISTRIBUTION; IMAGE CLASSIFICATION; OPTIMIZATION;

CONVEX OPTIMIZATION; KERNEL MAPPING; LINEAR DISCRIMINANT ANALYSIS;

BAYESIAN NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; DISCRIMINANT ANALYSIS; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; COMPUTER SIMULATION; DISCRIMINANT ANALYSIS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; LINEAR MODELS; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 42449085399     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2007.70717     Document Type: Article

References (22)

1. B.B. Verbeck, M.V. Chafee, D.A. Crowe, and A.P. Georgopoulos, "Parallel Processing of Serial Movements in Prefrontal Cortex," Proc. Nat'l Academy of Sciences of the USA, vol. 99, no. 20, pp. 13172-13177, 2002.
2. G. Baudat and F. Anouar, "Generalized Discriminant Analysis Using a Kernel Approach," Neural Computation, vol. 12, no. 10, pp. 2385-2404, 2000.
3. S.V. Beiden, M.A. Maloof, and R.F. Wagner, "A General Model for Finite-Sample Effects in Training and Testing of Competing Classifiers," IEEE Trans. Pattern Analysis and Machine Intelligence vol. 25, no. 12, pp. 1561-1569, Dec. 2003.
4. R.A. Fisher, "The Statistical Utilization of Multiple Measurements," Annals of Eugenics, vol. 8, pp. 376-386, 1938.
5. K. Fukunaga and J.M. Mantock, "Nonparametric Discriminant Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, pp. 671-678, 1983.
6. S. Geisser, "Discrimination, Allocatory, and Separatory Linear Aspects," Classification and Clustering, J. Van Ryzin, ed., pp. 301-330, 1977.
7. P.E. Gill, W. Murray, and M.H. Wright, Numerical Linear Algebra and Optimization, vol. 1. Addison-Wesley, 1991.
8. B. Leibe and B. Schiele, "Analyzing Appearance and Contour Based Methods for Object Categorization," Proc. IEEE Conf. Computer Vission and Pattern Recognition, 2003.
9. M. Loog, R.P.W. Duin, and R. Haeb-Umbach, "Multiclass Linear Dimension Reduction by Weighted Pairwise Fisher Criteria," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 7, pp. 762-766, July 2001.
10. R. Lotlikar and R. Kothari, "Fractional-Step Dimensionality Reduction," IEEE Trans. Pattern Analysis and Machine Intelligence vol. 22, no. 6, pp. 623-627, June 2000.
11. J. Lu, K.N. Plataniotis, and A.N. Venetsanopoulos, "Face Recognition Using LDA-Based Algorithms," IEEE Trans. Neural Networks, vol. 14, no. 1, pp. 195-200, 2003.
12. A.M. Martinez and A.C. Kak, "PCA versus LDA," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 2, pp. 228-233, Feb. 2001.
13. A.M. Martinez and M. Zhu, "Where Are Linear Feature Extraction Methods Applicable," IEEE Trans. Pattern Analysis and Machine Intelligence vol. 27, no. 12, pp. 1934-1944, Dec. 2005.
14. S. Michiels, S. Koscielny, and C. Hill, "Prediction of Cancer Outcome with Microarrays: A Multiple Random Validation Strategy," Lancet, vol. 365, no. 9458, pp. 488-492, 2005.
15. S. Mika, G. Ratsch, J. Weston, B. Scholkopf, and K. Muller, "Fisher Discriminant Analysis with Kernels," Proc. IEEE Neural Networks for Signal Processing Workshop, 1999.
16. D.J. Newman, S. Hettich, C.L. Blake, and C.J. Merz, "UCI Repository of Machine Learning Databases," Dept. of Information and Computer Sciences, Univ. of California, Irvine,, http://www.ics.uci.edu/~mlearn/ MLRepository.html, 1998.
17. P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the Face Recognition Grand Challenge," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
18. C.R. Rao, Linear Statistical Inference and Its Applications, second ed. Wiley Interscience, 2002.
19. M. Sommer, A. Olbrich, and M. Arendasy, "Improvements in Personnel Selection with Neural Networks: A Pilot Study in the Field of Aviation Psychology," Int'l J. Aviation Psychology, vol. 14, no. 1, pp. 103-115, 2004.
20. M.J. Schervish, "Linear Discrimination for Three Known Normal Populations," J. Statistical Planning and Inference, vol. 10, pp. 167-175, 1984.
21. J. Yang, G.W. Xu, Q.F. Hong, H.M. Liebich, K. Lutz, R.M. Schmulling, and H.G. Wahl, "Discrimination of Type 2 Diabetic Patients from Healthy Controls by Using Metabonomics Method Based on Their Serum Fatty Acid Profiles," J. Chromatography B-Analytical Technologies in the Biomedical and Life Sciences, vol. 813, nos. 1-2, pp. 53-58, Dec. 25, 2004.
22. J.P. Ye, T. Li, T. Xiong, and R. Janardan, "Using Uncorrelated Discriminant Analysis for Tissue Classification with Gene Expression Data," IEEE/ACM Trans. Computational Biology and Bioinformatics, vol. 1. no. 4. pp. 181-190, Oct.-Dec. 2004.