Polynomial regression under arbitrary product distributions

Machine Learning

Volumn 80, Issue 2-3, 2010, Pages 273-294

  Blais, Eric ^a   O'Donnell, Ryan ^a   Wimmer, Karl ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b DUQUESNE UNIVERSITY   (United States)

Author keywords

Agnostic learning; Linear threshold functions; Noise sensitivity; Polynomial regression

Indexed keywords

AGNOSTIC LEARNING; ARBITRARY NOISE; FOURIER; GAUSSIANS; LINEAR THRESHOLD FUNCTIONS; NOISE SENSITIVITY; OPEN PROBLEMS; ORTHOGONAL DECOMPOSITION; POLYNOMIAL REGRESSION; PRODUCT DISTRIBUTIONS; TECHNICAL INNOVATION; THRESHOLD FUNCTIONS;

ACOUSTIC NOISE; POLYNOMIALS; PROBABILITY DISTRIBUTIONS; REGRESSION ANALYSIS;

LEARNING ALGORITHMS;

EID: 77955613111     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-010-5179-6     Document Type: Article

References (23)

1. I. Benjamini G. Kalai O. Schramm 1999 Noise sensitivity of Boolean functions and applications to percolation Publications Mathématiques 90 1 5 43 0986.60002 1813223
2. C. Cortes V. Vapnik 1995 Support-vector networks Machine Learning 20 3 273 297 0831.68098
3. Feldman, J., O'Donnell, R., & Servedio, R. (2005). Learning mixtures of product distributions over discrete domains. In Proc. 46th IEEE symp. on foundations of comp. sci. (pp. 501-510).
4. Feldman, J., O'Donnell, R., & Servedio, R. (2006). Pac learning mixtures of Gaussians with no separation assumption. In Proc. 19th workshop on comp. learning theory (pp. 20-34).
5. 0 functions. In Proc. 4th workshop on comp. learning theory (pp. 317-325).
6. Guruswami, V., & Raghavendra, P. (2006). Hardness of learning halfspaces with noise. In Proc. 47th IEEE symp. on foundations of comp. sci. (pp. 543-552).
7. J. Håstad 2001 A slight sharpening of LMN Journal of Computing and System Sciences 63 3 498 508 1052.94506 10.1006/jcss.2001.1803 (Pubitemid 34266039)
8. W. Hoeffding 1948 A class of statistics with asymptotically normal distribution Annals of Mathematical Statistics 19 3 293 325 0032.04101 10.1214/aoms/1177730196 26294
9. Kalai, A. (2006). Machine learning theory course notes. http://www.cc.gatech.edu/~atk/teaching/mlt06/lectures/mlt-06-10.pdf.
10. Kalai, A., Klivans, A., Mansour, Y., & Servedio, R. (2005). Agnostically learning halfspaces. In Proc. 46th IEEE symp. on foundations of comp. sci. (pp. 11-20).
11. S. Karlin Y. Rinott 1982 Applications of Anova type decompositions for comparisons of conditional variance statistics including jackknife estimates Annals of Statistics 10 2 485 501 0491.62036 10.1214/aos/1176345790 653524
12. M. Kearns R. Schapire L. Sellie 1994 Toward efficient agnostic learning Machine Learning 17 2 115 141 0938.68797
13. A. Klivans R. O'Donnell R. Servedio 2004 Learning intersections and thresholds of halfspaces Journal of Computing and System Sciences 68 4 808 840 1074.68026 10.1016/j.jcss.2003.11.002 2059646
14. Lee, W. S., Bartlett, P., & Williamson, R. (1995). On efficient agnostic learning of linear combinations of basis functions. In Proc. 8th workshop on comp. learning theory (pp. 369-376).
15. N. Linial Y. Mansour N. Nisan 1993 Constant depth circuits, Fourier transform, and learnability Journal of the ACM 40 3 607 620 0781.94006 10.1145/174130.174138 1370363 (Pubitemid 23707885)
16. Minsky, M., & Papert, S. (1969). Perceptrons. Cambridge: MIT Press.
17. Mossel, E., O'Donnell, R., & Oleszkiewicz, K. (2005). Noise stability of functions with low influences: invariance and optimality. In Proc. 46th IEEE symp. on foundations of comp. sci. (pp. 21-30).
18. O'Donnell, R. (2003). Computational aspects of noise sensitivity. PhD thesis, MIT.
19. O'Donnell, R., & Servedio, R. (2003). New degree bounds for polynomial threshold functions. In Proc. 35th ACM symp. on the theory of computing (pp. 325-334).
20. Peres, Y. (2004). Noise stability of weighted majority. arXiv:math/0412377v1.
21. J. M. Steele 1986 An Efron-Stein inequality for nonsymmetric statistics Annals of Statistics 14 2 753 758 0604.62017 10.1214/aos/1176349952 840528
22. L. Valiant 1984 A theory of the learnable Communications of the of the ACM 27 11 1134 1142 0587.68077 10.1145/1968.1972 (Pubitemid 15425292)
23. R. von Mises 1947 On the asymptotic distribution of differentiable statistical functions Annals of Mathematical Statistics 18 3 309 348 0037.08401 10.1214/aoms/1177730385 22330