On the problem of on-line learning with log-loss

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2017, Pages 2995-2999

  Fogel, Yaniv ^a   Feder, Meir ^a  

^a TEL AVIV UNIVERSITY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION THEORY; MIXTURES; STOCHASTIC SYSTEMS;

CURRENT DATA; DATA SAMPLE; LOGARITHMIC LOSS; LOSS FUNCTIONS; ONLINE LEARNING; PROBABILITY ASSIGNMENT; STOCHASTIC SETTINGS;

E-LEARNING;

EID: 85034111500     PISSN: 21578095     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2017.8007079     Document Type: Conference Paper

References (10)

1. V. N. Vapnik, "An overview of statistical learning theory", IEEE transactions on neural networks, vol. 10, no. 5, pp. 988-999, 1999.
2. O. Bousquet, S. Boucheron, and G. Lugosi, "Introduction to statistical learning theory", in Advanced lectures on machine learning. Springer, 2004, pp. 169-207.
3. S. Ben-David, D. Pál, and S. Shalev-Shwartz, "Agnostic online learning." in COLT. Citeseer, 2009.
4. N. Merhav and M. Feder, "Universal prediction", IEEE Transactions on Information Theory, vol. 44, no. 6, pp. 2124-2147, 1998.
5. G. Kramer, "Directed information for channels with feedback", Ph. D. dissertation, University of Manitoba, Canada, 1998.
6. E. Gofer, N. Cesa-Bianchi, C. Gentile, and Y. Mansour, "Regret minimization for branching experts." in COLT, vol. 13, 2013, pp. 618-638.
7. N. Cesa-Bianchi and G. Lugosi, Prediction, learning, and games. Cambridge university press, 2006.
8. S. Shalev-Shwartz, "Online learning and online convex optimization", Foundations and Trends in Machine Learning, vol. 4, no. 2, pp. 107-194, 2011.
9. T. Onoyama, M. Sibuya, and H. Tanaka, "Limit distribution of the minimum distance between independent and identically distributed ddimensional random variables", in Statistical Extremes and Applications. Springer, 1984, pp. 549-562.
10. A. Rakhlin, K. Sridharan, and A. Tewari, "Online learning: Stochastic, constrained, and smoothed adversaries", in Advances in Neural Information Processing Systems, 2011, pp. 1764-1772.