Optimizing 0/1 loss for perceptrons by random coordinate descent

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn , Issue , 2007, Pages 749-754

  Li, Ling ^a   Lin, Hsuan Tien ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BOOSTING;

COMPLEX DATASETS; COMPUTATIONALLY EFFICIENT; COORDINATE DESCENT; ENSEMBLE LEARNING; NONSEPARABLE; PERCEPTRON LEARNING; REAL-WORLD PROBLEM; TEST ERRORS;

COST FUNCTIONS;

EID: 41549092416     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2007.4371051     Document Type: Conference Paper

References (20)

1. F. Rosenblatt, "The perceptron: A probabilistic model for information storage and organization in the brain," Psychological Review, vol. 65, pp. 386-408, 1958.
2. _, Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms. Spartan, 1962.
3. V. N. Vapnik, The Nature of Statistical Learning Theory. Springer-Verlag, 1995.
4. S. I. Gallant, "Perceptron-based learning algorithms," IEEE Transactions on Neural Networks, vol. 1, pp. 179-191, 1990.
5. P. Marcotte and G. Savard, "Novel approaches to the discrimination problem," Mathematical Methods of Operations Research, vol. 36, pp. 517-545, 1992.
6. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," in Machine Learning: Proceedings of the Thirteenth International Conference (ICML '96), L. Saitta, Ed., 1996, pp. 148-156.
7. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, ser. Springer Series in Statistics. Springer-Verlag, 2001.
8. Y. Freund and R. E. Schapire, "Large margin classification using the perceptron algorithm," Machine Learning, vol. 37, pp. 277-296, 1999.
9. T. Zhang, "Solving large scale linear prediction problems using stochastic gradient descent algorithms," in ICML 2004: Proceedings of the Twenty-First International Conference on Machine Learning, R. Greiner and D. Schuurmans, Eds., 2004.
10. R. C. Holte, "Very simple classification rules perform well on most commonly used datasets," Machine Learning, vol. 11, pp. 63-91, 1993.
11. L. Li, "Perceptron learning with random coordinate descent," California Institute of Technology, Pasadena, CA, Computer Science Technical Report CaltechCSTR:2005.006, 2005.
12. F. J. Solis and R. J.-B. Wets, "Minimization by random search techniques," Mathematics of Operations Research, vol. 6, pp. 19-30, 1981.
13. S. Axler, P. Bourdon, and W. Ramey, Harmonic Function Theory, 2nd ed., ser. Graduate Texts in Mathematics. Springer-Verlag, 2001.
14. J. Dunagan and S. Vempala, "A simple polynomial-time rescaling algorithm for solving linear programs," in Proceedings of the 36th Annual ACM Symposium on Theory of Computing, L. Babai, Ed., 2004, pp. 315-320.
15. S. Hettich, C. L. Blake, and C. J. Merz, "UCI repository of machine learning databases," 1998, available at http://www.ics.uci.edu/~mlearn/ MLRepository.html.
16. L. Breiman, "Arcing classifiers," The Annals of Statistics, vol. 26, pp. 801-824, 1998.
17. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford University Press, 1995.
18. J. H. Friedman, "Regularized discriminant analysis," Journal of the American Statistical Association, vol. 84, pp. 165-175, 1999.
19. C.-C. Chang and C.-J. Lin, LIBSVM: A library for support vector machines, 2001, software available at http://www.csie.ntu.edu.tw/~cjlin/ libsvm.
20. C.-W. Hsu, C.-C. Chang, and C.-J. Lin, "A practical guide to support vector classification," National Taiwan University, Tech. Rep., 2003.