Penalized splines and reproducing kernel methods

American Statistician

Volumn 60, Issue 3, 2006, Pages 233-240

  Pearce, N D ^a   Wand, M P ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Bioinformatics; Classification; Data mining; Generalized additive models; Kernel machines; Machine learning; Mixed models; Reproducing kernel Hilbert spaces; Semi parametric regression; Statistical learning; Supervised learning; Support vector machines

Indexed keywords

EID: 33747477568     PISSN: 00031305     EISSN: None     Source Type: Journal    
DOI: 10.1198/000313006X124541     Document Type: Article

References (44)

1. Aronszajn, N. (1950), "Theory of Reproducing Kernels," Transactions of the American Mathematical Society, 68, 337-404.
2. Berry, S. M., Carroll, R. J., and Ruppert, D. (2002), "Bayesian Smoothing and Regression Splines for Measurement Error Problems," Journal of the American Statistical Association, 97, 160-169.
3. Boser, B. E., Guyon, I. M., and Vapnik, V. N. (1992), "A Training Algorithm for Optimal Margin Classifiers," in Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, ed. D. Haussler, New York: ACM Press, pp. 144-152.
4. Brumback, B. A., Ruppert, D., and Wand, M. P. (1999), Comment on Shively, Kohn, and Wood, Journal of the American Statistical Association, 94, 794-797.
5. Burges, C. (1998), "A Tutorial on Support Vector Machines for Pattern Recognition," Data Mining and Knowledge Discovery, 2, 121-167.
6. Chambers, J. M., and Hastie, T. J. (1992), Statistical Models in S, New York: Chapman & Hall.
7. Crainiceanu, C., Ruppert, D., and Wand, M. P. (2005), "Bayesian Analysis for Penalized Spline Regression using WinBUGS," Journal of Statistical Software, 14, 14.
8. Cristianini, N., and Shawe-Taylor, J. (2000), An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge: Cambridge University Press.
9. Dudoit, S., Fridlyand, J., and Speed, T. P. (2002), "Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data," Journal of the American Statistical Association, 97, 77-87.
10. Eilers, P. H. C., and Marx, B. D. (1996), "Flexible Smoothing with B-splines and Penalties" (with discussion), Statistical Science, 11, 89-121.
11. Evgeniou, T., Pontil, M., and Poggio, T. (2000), "Regularization Networks and Support Vector Machines," Advances in Computational Mathematics, 13, 1-50.
12. Fine, S., and Scheinberg, K. (2001), "Efficient SVM Training Using Low-Rank Kernel Representations," Journal of Machine Learning Research, 2, 243-264.
13. French, J. L., Kammann, E. E., and Wand, M. R (2001), Comment on Ke and Wang, Journal of the American Statistical Association, 96, 1285-1288.
14. Girosi, R., Jones, M., and Poggio, T. (1995), "Regularization Theory and Neural Networks Architectures," Neural Computation, 7, 219-269.
15. Green, P. J., and Silverman, B. W. (1994), Nonparametric Regression and Generalized Linear Models, London: Chapman and Hall.
16. Hansen, M. H., and Kooperberg, C. (2002), "Spline Adaptation in Extended Linear Models" (with discussion), Statistical Science, 17, 2-51.
17. Hastie, T. (1996), "Pseudosplines," Journal of the Royal Statistical Society, Series B, 58, 379-396.
18. _ (2005), gam 0. 94, R package, available online is cran.r-project.org.
19. Hastie, T., Tibshirani, R., and Friedman, J. (2001), The Elements of Statistical Learning, New York: Springer-Verlag.
20. Joachims, T. (1998), "Making Large-Scale SVM Learning Practical," in Advances in Kernel Methods-Support Vector Learning, eds. B. Scholkopf, C. Burges, and A. Smola, Cambridge, MA: MIT Press.
21. Kammann, E. E., and Wand, M. P. (2003), "Geoadditive Models," Applied Statistics, 52, 1-18.
22. Lee, Y., Kim, Y., Lee, S., and Koo, J.-Y. (2006), "Structured Multicategory Support Vector Machines with ANOVA Decomposition," Biometrika, to appear.
23. Lin, Y., Lee, Y., and Wahba, G. (2002), "Support Vector Machines for Classification in Nonstandard Situations," Machine Learning, 46, 191-202.
24. Lin, Y., Wahba, G., Zhang, H., and Lee, Y. (2002), "Statistical Properties and Adaptive Tuning of Support Vector Machines," Machine Learning, 48, 115-136.
25. Lin, Y., and Zhang, H. H. (2006), "Component Selection and Smoothing in Smoothing Spline Analysis of Variance Models," The Annals of Statistics, 34, 5.
26. Marx, B. D., and Eilers, P. H. C. (1998), "Direct Generalized Additive Modeling With Penalized Likelihood," Computational Statistics and Data Analysis, 28, 193-209.
27. Ngo, L., and Wand, M. P. (2004), "Smoothing With Mixed Model Software," Journal of Statistical Software, 9, 1.
28. Ormerod, J. T., and Wand, M. P. (2006), LowRankQP 1. 0, R package, available online at cran.r-project.org.
29. Parker, R. L., and Rice, J. A. (1985), Discussion of "Some Aspects of the Spline Smoothing Approach to Nonparametric Regression Curve Fitting" by B. W. Silverman, Journal of the Royal Statistical Society, Series B, 47, 40-42.
30. Platt, J. (1998), "Fast Training of Support Vector Machines Using Sequential Minimal Optimization," in Advances in Kernel Methods-Support Vector Learning, eds. B. Scholkopf, C. Burges, and A. Smola, Cambridge, MA: MIT Press.
31. Rudin, W. (1991), Functional Analysis (2nd ed.), New York: McGraw Hill.
32. Ruppert, D. (2002), "Selecting the Number of Knots for Penalized Splines," Journal of Computational and Graphical Statistics, 11, 735-757.
33. Ruppert, D., Wand, M. P., and Carroll, R. J. (2003), Semiparametric Regression, New York: Cambridge University Press.
34. Schoenberg, I. (1969), "Monosplines and Quadrature Formulae," in Theory and Application of Spline Functions, ed. T. Greville, Madison, WI: University of Wisconsin Press.
35. Schölkopf, B., and Smola, A. J. (2002), Learning with Kernels, Cambridge, MA: MIT Press.
36. Simmons, G.F. (1983), Introduction to Topology and Modern Analysis, Melbourne: Krieger.
37. Smola, A. J., and Scholkopf, B. (2000), "Sparse Greedy Matrix Approximation for Machine Learning," in Proceedings of the 17th International Conference on Machine Learning, San Francisco: Morgan Kaufmann.
38. Stone, C. J. (1994), "The Use of Polynomial Splines and their Tensor Products in Multivariate Function Estimation" (with discussion), The Annals of Statistics, 22, 118-184.
39. Verbyla, A. P., Cullis, B. R., Kenward, M. G., and Welham, S. J. (1999), "The Analysis of Designed Experiments and Longitudinal Data by Using Smoothing Splines" (with discussion), Applied Statistics, 48, 269-311.
40. Wahba, G. (1990), Spline Models for Observational Data, Philadelphia: SIAM.
41. _ (1999), "Support Vector Machines, Reproducing Kernel Hilbert Spaces, and Randomized GACV," in Advances in Kernel Methods: Support Vector Learning, eds. B. Scholkopf, C. Burges, and A. Smola, Cambridge, MA: MIT Press, pp. 69-88.
42. Wand, M. P., and Jones, M. C. (1995), Kernel Smoothing, London: Chapman and Hall.
43. Williams, C.K.I, and Seeger, M. (2001), "Using the Nyström Method to Speed up Kernel Machines," in Advances in Neural Information Processing Systems (vol. 13), eds. T. K. Leen and T. G. Diettrich, Cambridge, MA: MIT Press, pp. 682-688.
44. Wood, S. N. (2006), mgcv 1. 3., R package, available online at cran.r-project.org.