An MM algorithm for multicategory vertex discriminant analysis

Journal of Computational and Graphical Statistics

Volumn 17, Issue 3, 2008, Pages 527-544

  Lange, Kenneth ^a   Wu, Tong Tong ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Iteratively reweighted least squares; Majorization; Regression; Regular simplex

Indexed keywords

EID: 53549084093     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/106186008X340940     Document Type: Article

References (28)

1. Breiman, L., Friedman, J., Olshen, R., and Stone, C. (1984), Classification and Regression Trees, New York: Chapman & Hall/CRC.
2. Coxeter, H. S. M. (1973), Regular Poly topes, New York: Dover.
3. Cristianini, N., and Shawe-Taylor, J. (2000), An Introduction to Support Vector Machines and other Kernel-Based Learning Methods, Cambridge: Cambridge University Press.
4. de Leeuw, J. (1994), Block Relaxation Algorithms in Statistics. Information Systems and Data Analysis, eds. H.-H Bock, W. Lenski, and M. M. Richter, Berlin: Springer.
5. de Leeuw, J., and Heiser, W. J. (1977), Convergence of Correction Matrix Algorithms for Multidimensional Scaling. Geometric Representations of Relational Data, eds. J.C. Roskam and E. I. Borg, Ann Arbor, MI: Mathesis Press.
6. (1980), Multidimensional Scaling with Restriction on the Configuration. Multivariate Analysis - V: Proceeding of the Fifth International Symposium on Multivariate Analysis, ed. P. Krishnaiah, Amsterdam: North-Holland Publishing Company.
7. Forsyth, R. S. (1990), "PC/BEAGLE User's Guide."
8. Golub, G. H., and Van Loan, C. F. (1996), Matrix Computations (3rd ed.), Baltimore, MD: Johns Hopkins University Press.
9. Groenen, P. J. (1993), The Majorization Approach to Multidimensional Scaling: Some Problems and Extensions, Leiden, the Netherlands: DSWO Press.
10. Groenen, P. J. F., Nalbantov, G., and Bioch, J. C. (2006), "Nonlinear Support Vector Machines Through Iterative Majorization and I-splines," available online at http://hdl.handle.net/1765/7889.
11. Guermeur, Y. (2002), "Combining Discriminant Models with New Multi-class SVMS," Pattern Analysis & Applications 5, 168-179.
12. Hand, D. J. (2006), "Classifier Technology and the Illusion of Progress," Statistical Science, 21, 1-14.
13. Hastie, T., Rosset, S., Tibshirani, R., and Zhu, J. (2004), "The Entire Regularization Path for the Support Vector Machine" Journal of Machine Learning Research, 5, 1391-1415.
14. Hastie, T., Tibshirani, R., and Buja, A. (1994), "Flexible Discriminant Analysis by Optimal Scoring," Journal of the American Statistical Association, 89, 1255-1270.
15. Hastie, T., Tibshirani, R., and Friedman, J. (2001), The Elements of Statistical Learning: Data Mining, Inference, and Prediction, New York: Springer-Verlag.
16. Heiser, W. J. (1995), Convergent Computing by Iterative Majorization: Theory and Applications in Multidimensional Data Analysis. Recent Advances in Descriptive Multivariate Analysis, ed. W. J. Krzanowski, Oxford: Clarendon Press.
17. Hunter, D. R., and Lange, K. (2004), "A Tutorial on MM Algorithms," The American Statistician, 58, 30-37.
18. Lange, K. (1995), "A Gradient Algorithm Locally Equivalent to the EM Algorithm," Journal of the Royal Statistical Society, Series B, 57, 425-437.
19. (2004), Optimization, New York: Springer-Verlag.
20. Lee, Y., Lin, Y., and Wahba, G. (2001 ), "Multicategory Support Vector Machines," Computing Science and Statistics, 33, 498-512.
21. (2004), "Multicategory Support Vector Machines: Theory and Application to the Classification of Microarray Data and Satellite Radiance Data," Journal of the American Statistical Association, 99, 67-81.
22. Liu, Y., Shen, X., and Doss, H. (2005), "Multicategory (ψ-learning and Support Vector Machine: Computational Tools," Journal of Computational and Graphical Statistics, 14, 219-236.
23. Murphy, P. M., and Aha, D. W. (1994), "UCI Repository of Machine Learning Databases," available online at http://www.ics.uci.edu/ ∼mlearn/MLRepository.html.
24. Scholkopf, B., and Smola, A. J. (2002), Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, Cambridge, MA: MIT Press.
25. Shen, X., Tseng, G. C., Zhang, X., and Wong, W. H. (2003), "On ψ-learning," Journal of the American Statistical Association, 98, 724-734.
26. Vapnik, V. (1995), The Nature of Statistical Learning Theory, New York: Springer-Verlag.
27. Wahba, G. (1999), Support Vector Machines, Reproducing Kernel Hilbert Spaces and the Randomized GACV, Advances in Kernel Methods-Support Vector Learning, eds. B. Schlkopf, C.J.C. Burges, and A. J. Smola, Cambridge, MA: MIT Press.
28. Zwitter, M., and Soklic, M. (1988), "Lymphography Domain," available online at http://www.ics.uci.edu/mlearn/MLRepository.html.