Shrinkage estimator generalizations of proximal support vector machines

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2002, Pages 173-182

  Agarwal, Deepak K ^a  

^a AT AND T LABS RESEARCH   (United States)

Author keywords

Bayesian models; Bias variance tradeoff; Classification; Correlation; Kernel; Regression

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; CORRELATION METHODS; DATA MINING; ESTIMATION; MATHEMATICAL MODELS; RANDOM PROCESSES; REGRESSION ANALYSIS;

BAYESIAN MODEL; GAUSSIAN PROCESS; PROXIMAL SUPPORT VECTOR MACHINES;

NEURAL NETWORKS;

EID: 0242540463     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/775047.775073     Document Type: Conference Paper

References (30)

1. US census bureau. Adult dataset. Publicly available from: www.sgi.com/Technology/mlc/db.
2. D. Agarwal. Bayesian spatial regression analysis with large datasets, ph.d dissertation, university of connecticut, www.research.att.com/~dagarwal. 2001.
3. J. Albert and S. Chib. Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association, 88:669-679, 1993.
4. H. Arthur and K. Robert. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12:55-67, 1970.
5. L. Brieman. Bagging predictors. Machine Learning, 26:123-140, 1996.
6. D. DeCoste. Visualizing mercer kernel feature spaces via kernelized locally-linear embeddings. In The 8th International Conference on Neural Information Processing, 2001.
7. A. Dempster, M. Schatzoff, and N. Wermuth. A simulation study of alternatives to ordinary least squares. Journal of the American Statistical Association, 72:77-106, 1977.
8. H. Drucker, C. J. Burges, L. Kaufman, A. Smola, and V. Vapnik. Support vector regression machines. In Michael C. Mozer, Michael I. Jordan, and Thoms Petsche editors, Advances in Neural Information Processing Systems -9-, pages 155-161. The MIT Press, Cambridge, MA, 1997.
9. K. Duan, S. Keerthi, and A. Poo. Evaluation of simple performance measures for tuning SVM hyperparameters. Technical Report, Department of Mechanical Engineering, National University of Singapore, 2001.
10. W. DuMouchel and D. Pregibon. Empirical bayes screening for multi-item associations. In Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 67-76. San Francisco, CA, USA, August 2001.
11. B. Efron and C. Morris. Data analysis using stein's estimator and its generalizations. Journal of the American Statistical Association, 70:311-319, 1975.
12. J. Friedman, T. Hastie, and R. Tibshirani. Additive logistic regression: A statistical view of boosting. The Annals of Statistics, 38(2):337-374, April 2000.
13. G. Fung and O. Mangasarian. Proximal support vector machine classifiers. In Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 77-86, San Francisco, CA, USA, August 2001.
14. J. Garcke and M. Griebel. Data mining with sparse grids using simplicial basis functions. In Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 87-96. San Francisco, CA, USA, August 2001.
15. A. Gelfand and A. Smith. Sampling based approaches to calculating marginal densities. Journal of the American Statistical Association, 85:398-409, 1990.
16. M. Genton. Classes of kernels for machine learning: A statistics perspective. Journal of Machine Learning Research, 2:299-312, 2000.
17. D. Gibbons. A simulation study of some ridge estimators. Journal of the American Statistical Association, 76:131-139, 1981.
18. J. Gilbert, C. Moler, and R. Schreiber. Sparse matrices in MATLAB: Design and implementation. SIAM Journal on Matrix Analysis and Applications, 13(1):333-356, 1992.
19. T. Hsaing. A bayesian view on ridge regression. The Statistician, 24:267-268, 1975.
20. S. le Cessie and J. van Houwelingen. Ridge estimators in logistic regression. Applied Statistics, 41:191-201, 1992.
21. A. Lee and M. Silvapulle. Ridge estimation in logistic regression. Communications in Statistics, Part B-Simulation and Computation, 17:1231-1257, 1988.
22. Y. Lee and O. Mangasarian. Ssvm: A smooth support vector machine. Computational Optimization and Applications, 20(1): to appear, 2001.
23. M. J. Mackinnon and M. L. Puterman. Collinearity in generalized linear models. Communications in Statistics, Part A - Theory and Methods, 18:3463-3472, 1989.
24. O. Mangasarian. Generalized support vector machines. In A. Smola, P. Bartlett, B. Schölkopf, and D. Schuurmans, editors, Advances in Large Margin Classifiers, pages 135-146. The MIT Press, Cambridge, MA, 2000.
25. B. Marx, P. Eilers, and E. Smith. Ridge likelihood estimation for generalized linear regression. In P. van der Heijden, W. Jensen, B. Francis, and G. Seeber, editors, Statistical Modeling, pages 227-238. North Holland Publishing Company (Elseviers), Amsterdam, 1992.
26. P. Murphy and D. Aha. UCI repository of machine learning databases. www.ics.uci.edu/~mleran/MLRepository.html.
27. B. Segerstedt. On ordinary ridge regression in generalized linear models. Communications in Statistics, Part A - Theory and Methods, 21:2227-2246, 1992.
28. G. Smith and F. Campbell. A critique of some ridge regression methods (with discussion). Journal of the American Statistical Association, 75:74-81, 1980.
29. D. Stewart and Z. Leyk. Meschach: Matrix computations in C. www.netlib.org/c/meschach.
30. R. Thisted. Comments on 'a critique of some ridge regression methods', Journal of the American Statistical Association, 75:81-86, 1980.