Regularized orthogonal linear discriminant analysis

Pattern Recognition

Volumn 45, Issue 7, 2012, Pages 2719-2732

  Ching, Wai Ki ^a   Chu, Delin ^b   Liao, Li Zhi ^c   Wang, Xiaoyan ^b  

^a UNIVERSITY OF HONG KONG   (Hong Kong)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

Author keywords

Data dimensionality reduction; Orthogonal linear discriminant analysis; QR factorization; Regularized orthogonal linear discriminant analysis

Indexed keywords

CROSS VALIDATION; DATA DIMENSIONALITY REDUCTION; LINEAR DISCRIMINANT ANALYSIS; MATHEMATICAL RELATIONSHIP; MATHEMATICAL THEORY; QR FACTORIZATIONS; REAL WORLD DATA; REGULARIZATION PARAMETERS;

VIRTUAL REALITY;

PARAMETERIZATION;

EID: 84862798516     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.01.007     Document Type: Article

References (47)

1. A.A. Alizadeh Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling Nature 403 2000 503 511 (Pubitemid 30082188)
2. P. Baldi, and G.W. Hatfield DNA Microarrays and Gene Expression: From Experiments to Data Analysis and Modeling 2002 Cambridge
3. M.W. Berry, S.T. Dumais, and G.W. OBrie Using linear algebra for intelligent information retrieval SIAM Review 37 1995 573 595
4. S.A. Billings, and K.L. Lee Nonlinear Fisher discriminant analysis using a minimum squared error cost function and the orthogonal least squares algorithm Neural Network 15 2002 263 270 (Pubitemid 34213783)
5. C.M. Bishop Pattern Recognition and Machine Learning 2006 Springer
6. L. Chen, H.M. Liao, M. Ko, J. Lin, and G. Yu A new LDA-based face recognition system which can solve the small sample size problem Pattern Recognition 33 2000 1713 1726
7. D. Chu, S.T. Goh, and Y.S. Hung Characterization of all solutions for undersampled uncorrelated linear discriminant analysis problems SIAM Journal on Matrix Analysis and Applications 32 2011 820 844
8. D. Chu, and S.T. Goh A new and fast implementation for null space based linear discriminant analysis Pattern Recognition 43 2010 1373 1379
9. D. Chu, and S.T. Goh A new and fast orthogonal linear discriminant analysis on undersampled problems SIAM Journal on Scientific Computing 32 2010 2274 2297
10. D. Chu, L.De. Lathauwer, and B.De. Moor A QR-type reduction for computing the SVD of a general matrix product/quotient Numerical Mathematics 95 2003 101 121 (Pubitemid 36914030)
11. D.Q. Dai, and P.C. Yuen Regularized discriminant analysis and its application to face recognition Pattern Recognition 36 2003 845 847
12. M. Dettling Bag boosting for tumor classification with gene expression data Oxford Journals on Life Sciences and Bioinformatics 20 2004 3583 3593 (Pubitemid 40136794)
13. M. Dettling, and P. Bhlmann Supervised clustering of genes Genome Biology 3 2002 0069.10069.15
14. L. Duchene, and S. Leclerq An optimal transformation for discriminant and principal component analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 10 1988 978 983
15. S. Dudoit, J. Fridlyand, and T.P. Speed Comparison of discrimination methods for the classification of tumors using gene expression data Journal of the American Statistical Association 97 2002 77 87
16. R.Q. Duda, P.E. Hart, and D.G. Stork Pattern Classification second ed. 2001 John Wiley and Sons Inc.
17. W.B. Frakes, and R. Baeza-Yates Information Retrieval: Data Structures and Algorithms 1992 Prentice Hall PTR
18. J.H. Friedman Regularized discriminant analysis Journal of the American Statistical Association 84 1989 165 175
19. K. Fukunaga Introduction to Statistical Pattern Recognition second ed. 1990 Academic Press Inc.
20. T.R. Golub, D.K. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, J.P. Mesirov, H. Coller, M.L. Loh, J.R. Downing, M.A. Caligiuri, C.D. Bloomfield, and E.S. Lander Molecular classification of cancer: class discovery and class prediction by gene expression monitoring Science 286 1999 531 537
21. G.H. Golub, and C.F. Van Loan Matrix Computations third ed. 1996 The Johns Hopkins University Press Baltimore, MD
22. Y. Guo, T. Hastie, and R. Tibshirani Regularized linear discriminant analysis and its application in microarray Biostatistics 8 2007 86 100 (Pubitemid 44906104)
23. P. Hall, J.S. Marron, and A. Neeman Geometric representation of high dimensional, low sample size data Journal of Royal Statistical Society Series B 67 2005 427 444 (Pubitemid 40855293)
24. R.F. Harrison, and K. Pasupa Sparse multinomial kernel discriminant analysis (sMKDA) Pattern Recognition 42 2009 1795 1802
25. T. Hastie, A. Buja, and R. Tibshirani Penalized discriminant analysis Annals of Statistics 23 1995 73 102
26. P. Howland, M. Jeon, and H. Park Structure preserving dimension reduction for clustered text data based on the generalized singular value decomposition SIAM Journal on Matrix Analysis and Applications 25 2003 165 179 (Pubitemid 38260434)
27. P. Howland, and H. Park Generalizing discriminant analysis using the generalized singular value decomposition IEEE Transactions on Pattern Analysis and Machine Intelligence 26 2004 995 1006
28. R. Huang, Q. Liu, H. Lu, and S. Ma Solving the small sample size problem of LDA Proceedings of the International Conference on Pattern Recognition 2002 29 32 (Pubitemid 44844422)
29. A.K. Jain, and R.C. Dubes Algorithms for Clustering Data 1988 Prentice Hall
30. S. Ji, and J. Ye Generalized linear discriminant analysis: a unified framework and efficient model selection IEEE Transactions on Neural Networks 19 2008 1768 1782
31. Z. Jin, J.Y. Yang, Z.S. Hu, and Z. Lou Face recognition based on the uncorrelated discriminant transformation Pattern Recognition 34 2001 1405 1416 (Pubitemid 32424906)
32. Z. Jin, J.Y. Yang, Z.M. Tang, and Z.S. Hu A theorem on the uncorrelated optimal discriminant vectors Pattern Recognition 34 2001 2041 2047 (Pubitemid 32760633)
33. I.T. Jolliffe Principal Component Analysis second ed. 2002 Springer-Verlag New York
34. J. Khan, J. Wei, M. Ringner, L. Saal, M. Ladanyi, F. Westermann, F. Berthold, M. Schwab, C.R. Antonescu, C. Peterson, and P. Meltzer Classification and diagnostic prediction of cancers using expression profiling and artificial neural networks Nature Medicine 7 2001 673 679 (Pubitemid 32588022)
35. G. Kowalski Information Retrieval Systems: Theory and Implementation 1997 Kluwer Academic Publishers
36. H. Park, B. Drake, S. Lee, C. Park, Fast Linear Discriminant Analysis Using QR Decomposition and Regularization, Technical Report GT-CSE-07-21, 2007.
37. S. Pomeroy Prediction of central nervous system embryonal tumor outcome based on gene expression Nature 415 2002 436 442 (Pubitemid 34100955)
38. J.G. Sun Perturbation bounds for the Cholesky and QR factorization BIT 31 1991 341 352
39. D.L. Swets, and J. Weng Using discriminant eigenfeatures for image retrieval IEEE Transactions on Pattern Analysis and Machine Intelligence 18 1996 831 836 (Pubitemid 126772824)
40. 1-norm multiclass support vector machines: methodology and theory Journal of the American Statistical Association 102 2007 583 594
41. Whitehead Institute Center for Genomic Research: cancer genomics 〈 http://www-genome.wi.mit.edu/cancer 〉.
42. J. Ye Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems Journal of Machine Learning Research 6 2005 483 502
43. J. Ye, R. Janardan, C.H. Park, and H. Park An optimization criterion for generalized discriminant analysis on undersampled problems IEEE Transactions on Pattern Analysis and Machine Intelligence 26 2004 982 994
44. J. Ye, and Q. Li A two-stage linear discriminant analysis via QR-decomposition IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 929 941 (Pubitemid 40889843)
45. J. Ye, and T. Xiong Computational and theoretical analysis of null space and orthogonal linear discriminant analysis Journal of Machine Learning Research 7 2006 1183 1204 (Pubitemid 44015300)
46. J. Ye, T. Xiong, Q. Li, R. Janardan, J. Bi, Efficient model selection for regularized linear discriminant analysis, in: Proceeding CIKM '06. Proceedings of the 15th ACM International Conference on Information and Knowledge Management, 2006.
47. J. Ye, T. Wang, Regularized discriminant analysis for high dimensional, low sample size data, in: Proceeding KDD '06. Proceedings of the 12th ACM SIGKDD International Conference on Knowledge discovery and Data Mining, 2006.