Efficient learning of Generalized Linear and Single Index Models with isotonic regression

Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

Volumn , Issue , 2011, Pages

  Kakade, Sham M ^a   Kalai, Adam Tauman ^a   Kanade, Varun ^b   Shamir, Ohad ^a  

^a MICROSOFT RESEARCH   (United States)

^b HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HEURISTIC ALGORITHMS; LEARNING ALGORITHMS; REGRESSION ANALYSIS;

CONVEX ESTIMATION; DIMENSIONAL FUNCTIONS; EFFICIENT LEARNING; GENERALISATION; GENERALIZED LINEAR MODEL; ISOTONIC REGRESSION; ISOTRON; LINEAR PREDICTORS; LIPSCHITZ; SINGLE INDEX MODELS;

ITERATIVE METHODS;

EID: 85162537884     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. P. McCullagh and J. A. Nelder. Generalized Linear Models (2nd ed.). Chapman and Hall, 1989.
2. P. Hall W. Härdle and H. Ichimura. Optimal smoothing in single-index models. Annals of Statistics, 21(1):157-178, 1993.
3. J. Horowitz and W. Härdle. Direct semiparametric estimation of single-index models with discrete covariates, 1994.
4. A. Juditsky M. Hristache and V. Spokoiny. Direct estimation of the index coefficients in a single-index model. Technical Report 3433, INRIA, May 1998.
5. P. Naik and C. Tsai. Isotonic single-index model for high-dimensional database marketing. Computational Statistics and Data Analysis, 47:775-790, 2004.
6. P. Ravikumar, M. Wainwright, and B. Yu. Single index convex experts: Efficient estimation via adapted bregman losses. Snowbird Workshop, 2008.
7. A. T. Kalai and R. Sastry. The isotron algorithm: High-dimensional isotonic regression. In COLT '09, 2009.
8. A. T. Kalai, A. R. Klivans, Y. Mansour, and R. A. Servedio. Agnostically learning halfspaces. In Proceedings of the 46th Annual IEEE Symposium on Foundations of Computer Science, FOCS '05, pages 11-20, Washington, DC, USA, 2005. IEEE Computer Society.
9. S. Shalev-Shwartz, O. Shamir, and K. Sridharan. Learning kernel-based halfspaces with the zero-one loss. In COLT, 2010.
10. L. Yeganova and W. J. Wilbur. Isotonic regression under lipschitz constraint. Journal of Optimization Theory and Applications, 141(2):429-443, 2009.
11. S. M. Kakade, A. T. Kalai, V. Kanade, and O. Shamir. Efficient learning of generalized linear and single index models with isotonic regression. arxiv.org/abs/1104.2018.
12. UCI. University of california, irvine: http://archive.ics.uci.edu/ml/.
13. S. Cosslett. Distribution-free maximum-likelihood estimator of the binary choice model. Econometrica, 51(3), May 1983.