New lower bounds for statistical query learning

Journal of Computer and System Sciences

Volumn 70, Issue 4, 2005, Pages 485-509

  Yang, Ke ^a,b  

^a Carnegie Mellon University   (United States)

^b GOOGLE INC   (United States)

Author keywords

KL divergence; Lower bound statistical query; PAC learning; Singular value decomposition

Indexed keywords

ALGORITHMS; COMPUTATIONAL METHODS; FOURIER TRANSFORMS; PROBABILITY; PROBLEM SOLVING; QUERY LANGUAGES;

KL-DIVERGENCE; LOWER BOUND STATISTICAL QUERY; PROBABLY APPROXIMATELY CORRECT (PAC) LEARNING; SINGULAR VALUE DECOMPOSITION;

LEARNING SYSTEMS;

EID: 17444425308     PISSN: 00220000     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jcss.2004.10.003     Document Type: Conference Paper

References (14)

1. J.A. Aslam, S.E. Decatur, Specification and Simulation of Learning Algorithms for Efficiency and Noise-Tolerance, in: COLT 1995, ACM Press, New York, July 1995, pp. 437-446.
2. C. Bishop Neural Networks for Pattern Recognition 1995 Oxford University Press Oxford
3. A. Blum, M. Furst, J. Jackson, M. Kearns, Y. Mansour, S. Rudich, Weakly Learning DNF and Characterizing Statistical Query Learning Using Fourier Analysis, STOC 1994, 1994, pp. 253-262.
4. C. Chatfield, and A. Collins Introduction to Multivariate Analysis 1980 Chapman & Hall London
5. T. Cover, and J. Thomas Elements of Information Theory 1991 Wiley New York
6. S. Floyd, and M. Warmuth Sample compression, learnability, and the Vapnik-Chervonenkis dimension Mach. Learning 21 3 1995 269 304
7. R. Horn, and C. Johnson Matrix Analysis 1985 Cambridge University Press Cambridge
8. J. Jackson, On the efficiency of noise-tolerant PAC algorithms derived from statistical queries, in: Proceedings of the 13th Annual Workshop on Computational Learning Theory, 2000.
9. M. Kearns, Efficient noise-tolerant learning from statistical queries, in: Proceedings of the 25th Annual ACM Symposium on Theory of Computing, 1993, pp. 392-401.
10. S. Kullback Information Theory and Statistics 1959 Dover Publications New York
11. S. Kullback, and R.A. Leibler On information and sufficiency Ann. Math. Statist. 22 1951 79 86
12. G. Strang Linear Algebra and its Applications third ed. 1988 Harcourt Brace, Jovanovich, New York
13. L. Valiant A theory of the learnable Comm. Assoc. Comput. Mach. 27 11 1984 1134 1142
14. K. Yang, On learning correlated boolean concepts using statistical query, in: The Proceedings of the 12th International Conference on Algorithmic Learning Theory (ALT'01), Lecture Notes in Artificial Intelligence, vol. 2225, 2001, pp. 59-76.