Asymptotic generalization bound of fisher's linear discriminant analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 12, 2014, Pages 2325-2337

  Bian, Wei ^a   Tao, Dacheng ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

asymptotic generalization analysis; Fishers linear discriminant analysis; random matrix theory

Indexed keywords

EID: 84908681002     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2327983     Document Type: Article

References (32)

1. R. Fisher, "The use of multiple measurements in taxonomic problems", Ann. Eugenics, vol. 7, pp. 179-188, 1936.
2. C. Rao, "The utilization of multiple measurements in problems of biological classification", J. Roy. Statist. Soc. Ser. B: Methodol., vol. 10, pp. 159-203, 1948.
3. M. Loog, R. P. W. Duin, and R. Haeb-Umbach, "Multiclass linear dimension reduction by weighted pairwise Fisher criteria", IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 7, pp. 762-766, Jul. 2001.
4. D. Tao, X. Li, X. Wu, and S. Maybank, "Geometric mean for subspace selection", IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
5. W. Bian and D. Tao, "Max-min distance analysis by using sequential SDP relaxation for dimension reduction", IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 1037-1050, May 2011.
6. F. Dela Torre and T. Kanade, "Multimodal oriented discriminant analysis", in Proc. 22nd Int. Conf. Mach. Learn., 2005, pp. 177-184.
7. G. Potamianos and H. Graf, "Linear discriminant analysis for speechreading", in Proc. Workshop Multimedia Signal Process, 1998, pp. 221-226.
8. E. Alexandre-Cortizo, M. Rosa-Zurera, and F. Lopez-Ferreras, "Application of Fisher linear discriminant analysis to speech/music classification", in Proc. Int. Conf. Comput. Tool, 2005, pp. 1666-1669.
9. P. Belhumeur, J. Hespanha, and D. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection", IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
10. T. Kim and J. Kittler, "Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image", IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 318-327, Mar. 2005.
11. J. Ye and Q. Li, "A two-stage linear discriminant analysis via qrdecomposition", IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 929-941, Jun. 2005.
12. E. Altman, "Financial ratios, discriminant analysis and the prediction of corporate bankruptcy", J. Finance, vol. 23, no. 4, pp. 589-609, 1968.
13. K. Kumar and S. Bhattacharya, "Artificial neural network vs linear discriminant analysis in credit ratings forecast: A comparative study of prediction performances", Rev. Account. Finance, vol. 5, no. 3, pp. 216-227, Aug. 2006.
14. O. Hamsici and A. Martinez, "Bayes optimality in linear discriminant analysis", IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 4, pp. 647-657, Apr. 2008.
15. P. J. Bickel and E. Levina, "Some theory for Fisher's linear discriminant function, 'naive Bayes', and some alternatives when there are many more variables than observations", Bernoulli, vol. 10, no. 6, pp. 989-1010, 2004.
16. J. Fan, Y. Fan, and Y. Wu, "High-dimensional classification", in High-Dimensional Data Analysis, T. Cai and X. Shen, Eds., New Jersey, NJ, USA: World Scientific, 2011, pp. 3-37.
17. T. Anderson, An Introduction to Multivariate Statistical Analysis, 2nd ed. New York, NY, USA: Wiley, 1984.
18. E. Wigner, "Characteristic vectors of bordered matrices with infinite dimensions", Ann. Math., vol. 62, no. 3, pp. 548-564, 1955.
19. E. Wigner, "On the distribution of the roots of certain symmetric matrices", Ann. Math., vol. 67, no. 2, pp. 325-327, 1958.
20. V. Marcenko and L. Pastur, "Distribution of eigenvalues for some sets of random matrices", Math. USSR-Sbornik, vol. 1, p. 457, 1967.
21. A. Edelman and N. Rao, "Random matrix theory", Acta Numerica, vol. 14, no. 233-297, p. 139, 2005.
22. A. Tulino and S. Verdu, Random Matrix Theory and Wireless Communications. Hanover, MA, USA: Now Publishers Inc, vol. 1, 2004.
23. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd Edition, New York, NY, USA: Academic, Sep. 1990.
24. R. J. Durrant and A. Kaban, "A bound on the performance of LDA in randomly projected data spaces", in Proc. Int. Conf. Pattern Recognit., 2010, pp. 4044-4047.
25. D. C. Hoyle, "Accuracy of pseudo-inverse covariance learning-A random matrix theory analysis", wIEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 7, pp. 1470-1481, Jul. 2011.
26. G. J. Mclachlan, Discriminant Analysis and Statistical Pattern Recognition (Wiley Series in Probability and Statistics), New York, NY, USA: Wiley-Interscience, Aug. 2004.
27. R. J. Durrant and A. Kaban, "Compressed fisher linear discriminant analysis: classification of randomly projected data", in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2010, pp. 1119-1128.
28. R. J. Durrant and A. Kaban, "Error bounds for kernel Fisher linear discriminant in Gaussian Hilbert space", J. Mach. Learn. Res. - Proc. Track, vol. 22, pp. 337-345, 2012.
29. C. Blake and C. Merz, "UCI repository of machine learning databases", Dept. Inform. Comput. Sci., Univ. California, Irvine, CA, USA, Tech. Rep., 1998.
30. A. Edelman, "Eigenvalues and condition numbers of random matrices", Dept. Mathematics, Ph. D. dissertation, Massachusetts Inst. Technol., 1989.
31. T. Tao, Topics in Random Matrix Theory. Providence, RI, USA: Amer. Math. Soc, 2012.
32. P. Billingsley, Convergence of Probability Measures, (Wiley Series in Probability and Statistics), vol. 175, Hoboken, NJ, USA: Wiley, 1999.