Additive approximations in high dimensional nonparametric regression via the SALSA

33rd International Conference on Machine Learning, ICML 2016

Volumn 1, Issue , 2016, Pages 122-131

  Kandasamy, Kirthevasan ^a   Yu, Yaoliang ^a  

^a Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; ECONOMIC AND SOCIAL EFFECTS; LEARNING SYSTEMS;

CURSE OF DIMENSIONALITY; HIGH-DIMENSIONAL; INDEPENDENT FUNCTIONS; KERNEL RIDGE REGRESSIONS; NON-ADDITIVE MODELS; NON-PARAMETRIC REGRESSION; REGRESSION FUNCTION; RESIDUAL SUM OF SQUARES;

REGRESSION ANALYSIS;

EID: 84997831578     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (42)

1. Aronszajn, N. Theory of Reproducing Kernels. Trans. Amer. Math. Soc., 1950.
2. Bach, Francis R. Consistency of the Group Lasso and Multiple Kernel Learning. JMLR, 2008.
3. Berlinet, Alain and Thomas-Agnan, Christine. Reproducing kernel Hilbert spaces in Probability and Statistics. Kluwer Academic, 2004.
4. Chang, Chih-Chung and Lin, Chih-Jen. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(3), 2011.
5. Dai, Bo, Xie, Bo, He, Niao, Liang, Yingyu, Raj, Anant, Balean, Maria-Florina F, and Song, Le. Scalable Kernel Methods via Doubly Stochastic Gradients. In NIPS, 2014.
6. Duvenaud, David K., Nickisch, Hannes, and Rasmussen, Carl Edward. Additive Gaussian Processes. In NIPS, 2011.
7. Efron, Bradley, Hastie, Trevor, Johnstone, Iain, and Tibshirani, Robert. Least Angle Regression. Annals of Statistics, 32(2):407-499, 2004.
8. Friedman, Jerome H. Multivariate Adaptive Regression Splines. Ann. Statist., 19(1):1-67, 1991.
9. Friedman, Jerome H. Greedy Function Approximation: A Gradient Boosting Machine. Annals of Statistics, 2000.
10. Gönen, Mehmet and Alpaydin, Ethem. Multiple Kernel Learning Algorithms. Journal of Machine Learning Research, 12:2211-2268, 2011.
11. Guillame-Bert, M, Dubrawski, A, Chen, L, Holder, A, Pinsky, MR, and Clermont, G. Utility of Empirical Models of Hemorrhage in Detecting and Quantifying Bleeding. In Intensive Care Medicine, 2014.
12. Györfi, László, Kohler, Micael, Krzyzak, Adam, and Walk, Harro. A Distribution Free Theory of Nonparametric Regression. Springer Series in Statistics, 2002.
13. Hara, Kentaro and Chellappa, Rama. Computationally efficient regression on a dependency graph for human pose estimation. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, 2013.
14. Hastie, T. J. and Tibshirani, R. J. Generalized Additive Models. London: Chapman & Hall, 1990.
15. Hastie, T. J., Tibshirani, R. J., and Friedman, J. The Elements of Statistical Learning. Springer., 2001.
16. Jakabsons, Gints. Open source regression software for Matlab/Octave, 2015.
17. Just, Marcel Adam, Cherkassky, Vladimir L., Aryal, S, Mitchell, Tom M., Just, Marcel Adam, Cherkassky, Vladimir L., Aryal, Esh, and Mitchell, Tom M. A neurosemantic theory of concrete noun representation based on the underlying brain codes. PLoS ONE, 2010.
18. Lafferty, John D. and Wasserman, Larry A. Rodeo: Sparse Nonparametric Regression in High Dimensions. In NIPS, 2005.
19. Le, Quoc, Sarlos, Tamas, and Smola, Alex. Fastfood - Approximating Kernel Expansions in Loglinear Time. In 30th International Conference on Machine Learning (ICML), 2013.
20. Lin, Yi and Zhang, Hao Helen. Component selection and smoothing in smoothing spline analysis of variance models. Annals of Statistics, 2006.
21. Lou, Yin, Caruana, Rich, Gehrke, Johannes, and Hooker, Giles. Accurate Intelligible Models with Pairwise Interactions. In KDD, 2013.
22. Macdonald, Ian Grant. Symmetric functions and Hall polynomials. Clarendon Press, 1995.
23. Paschou, P. PCA-correlated SNPs for Structure Identification. PLoS Genetics, 2007.
24. Plate, Tony A. Accuracy versus Interpretability in flexible modeling: implementing a tradeoff using Gaussian process models. Behaviourmetrika, Interpreting Neural Network Models", 1999.
25. Rahimi, Ali and Recht, Benjamin. Random Features for Large-Scale Kernel Machines. In NIPS, 2007.
26. Rahimi, Ali and Recht, Benjamin. Weighted Sums of Random Kitchen Sinks: Replacing minimization with randomization in learning. In NIPS, 2009.
27. Rasmussen, C. E. and Williams, C. K. I. Gaussian Processes for Machine Learning. Cambridge University Press, 2006.
28. Ravikumar, Pradeep, Lafferty, John, Liu, Han, and Wasserman, Larry. Sparse Additive Models. Journal of the Royal Statistical Society: Series 5, 71:1009-1030, 2009.
29. Schölkopf, Bernhard and Smola, Alexander J. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, 2001.
30. Shawe-Taylor, John and Cristianini, Nello. Kernel Methods for Pattern Analysis. Cambridge university press, 2004.
31. Steinwart, Ingo and Christmann, Andreas. Support Vector Machines. Springer, 2008.
32. Steinwart, Ingo, Hush, Don R., and Scovel, Clint. Optimal Rates for Regularized Least Squares Regression. In COLT, 2009.
33. Tegmark et al, M. Cosmological Constraints from the SDSS Luminous Red Galaxies. Physical Review, 74(12), 2006.
34. Tibshirani, Robert. Regression Shrinkage and Selection Via the Lasso. Journal of the Royal Statistical Society, Series B, 1994.
35. Tsybakov, Alexandre B. Introduction to Nonparametric Estimation. Springer, 2008.
36. Tu, Zhidong. Integrative Analysis of a cross-locci regulation Network identifies App as a Gene regulating Insulin Secretion from Pancreatic Islets. PLoS Genetics, 2012.
37. Wang, Yong and Witten, Ian H. Inducing Model Trees for Continuous Classes. In ECML, 1997.
38. Wehbe, L., Murphy, B., Talukdar, P., Fyshe, A., Ramdas, A., and Mitchell, T. Simultaneously uncovering the patterns of brain regions involved in different story reading. PLoS ONE, 2014.
39. Williamson, Robert C, Smola, Alex J., and Schölkopf, Bernhard. Generalization Performance of Regularization Networks and Support Vector Machines via Entropy Numbers of Compact Operators. IEEE Transactions on Information Theory, 47(6):2516-2532, 2001.
40. Xu, Zenglin, Jin, Rong, Yang, Haiqin, King, Irwin, and Lyu, Michael R. Simple and Efficient Multiple Kernel Learning by Group Lasso. In ICML, 2010.
41. Zhang, Tong. Learning Bounds for Kernel Regression Using Effective Data Dimensionality. Neural Computation, 17(9):2077-2098, 2005.
42. Zhang, Yuchen, Duchi, John C, and Wainwright, Martin J. Divide and Conquer Kernel Ridge Regression. In COLT, 2013.