Lifelong learning with weighted majority votes

Advances in Neural Information Processing Systems

Volumn , Issue , 2016, Pages 3619-3627

  Pentina, Anastasia ^a   Urner, Ruth ^b  

^a INSTITUTE OF SCIENCE AND TECHNOLOGY AUSTRIA   (Austria)

^b MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; INTELLIGENT BUILDINGS; INTELLIGENT SYSTEMS;

ALGORITHMIC FRAMEWORK; BUILDING INTELLIGENT SYSTEMS; COMPLEXITY MEASURES; INFORMATION TRANSFERS; LIFE LONG LEARNING; LIMITED INFORMATION; POTENTIAL BENEFITS; SAMPLE COMPLEXITY;

LEARNING ALGORITHMS;

EID: 85019214594     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. J. Abernethy, P. Bartlett, and A. Rakhlin. Multitask learning with expert advice. In Workshop on Computational Learning Theory (COLT), 2007.
2. A. Argyriou, T. Evgeniou, and M. Pontil. Convex multi-task feature learning. Machine Learning (ML), 2008.
3. M.-F. Balcan, A. Blum, and S. Vempala. Efficient representations for lifelong learning and autoencoding. In Workshop on Computational Learning Theory (COLT), 2015.
4. J. Baxter. A model of inductive bias learning. Journal of Artificial Intelligence Research (JAIR), 12, 2000.
5. S. Ben-David, J. Blitzer, K. Crammer, A. Kulesza, F. Pereira, and J. W. Vaughan. A theory of learning from different domains. Machine Learning (ML), 2010.
6. S. Ben-David and R. Schuller. Exploiting task relatedness for multiple task learning. 2003.
7. S. Boucheron, O. Bousquet, and G. Lugosi. Theory of classification: a survey of some recent advances. ESAIM: Probability and Statistics, 9: 323-375, 11 2005.
8. K. Crammer and Y. Mansour. Learning multiple tasks using shared hypotheses. In Conference on Neural Information Processing Systems (NIPS), 2012.
9. E. Eaton and P. L. Ruvolo. ELLA: An efficient lifelong learning algorithm. In International Conference on Machine Learning (ICML), 2013.
10. A. Evgeniou and M. Pontil. Multi-task feature learning. In Conference on Neural Information Processing Systems (NIPS), 2007.
11. Y. Freund and R. E. Schapire. Experiments with a new boosting algorithm. In International Conference on Machine Learning (ICML), 1996.
12. P. Germain, A. Habrard, F. Laviolette, and E. Morvant. A New PAC-Bayesian Perspective on Domain Adaptation. In International Conference on Machine Learning (ICML), 2016.
13. D. Kifer, S. Ben-David, and J. Gehrke. Detecting change in data streams. In International Conference on Very Large Data Bases (VLDB), 2004.
14. J. Z. Kolter and M. A. Maloof. Dynamic weighted majority: An ensemble method for drifting concepts. Journal of Machine Learning Research (JMLR), 8: 2755-2790, Dec. 2007.
15. A. Kumar and H. Daumé III. Learning task grouping and overlap in multi-task learning. In International Conference on Machine Learning (ICML), 2012.
16. I. Kuzborskij and F. Orabona. Stability and hypothesis transfer learning. In International Conference on Machine Learning (ICML), 2013.
17. Y. Mansour, M. Mohri, and A. Rostamizadeh. Domain adaptation: Learning bounds and algorithms. In Workshop on Computational Learning Theory (COLT), 2009.
18. A. Maurer. Transfer bounds for linear feature learning. Machine Learning, 75(3): 327-350, 2009.
19. A. Maurer, M. Pontil, and B. Romera-Paredes. Sparse coding for multitask and transfer learning. In International Conference on Machine Learning (ICML), 2013.
20. S. J. Pan and Q. Yang. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10): 1345-1359, Oct. 2010.
21. A. Pentina and S. Ben-David. Multi-task and lifelong learning of kernels. In Algorithmic Learning Theory (ALT), 2015.
22. A. Pentina and C. H. Lampert. A PAC-Bayesian bound for lifelong learning. In International Conference on Machine Learning (ICML), 2014.
23. M. Pontil and A. Maurer. Excess risk bounds for multitask learning with trace norm regularization. In Workshop on Computational Learning Theory (COLT), 2013.
24. S. Shalev-Shwartz and S. Ben-David. Understanding Machine Learning: From Theory to Algorithms. Cambridge University Press, New York, NY, USA, 2014.
25. S. Thrun and T. M. Mitchell. Lifelong robot learning. Robotics and Autonomous Systems, 15(1-2): 25-46, 1995. The Biology and Technology of Intelligent Autonomous Agents.
26. S. Thrun and L. Pratt. Learning to learn. Kluwer Academic Publishers, 1998.
27. V. N. Vapnik and A. J. Chervonenkis. On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability & Its Applications, 16(2): 264-280, 1971.