A PAC-bayesian bound for lifelong learning

31st International Conference on Machine Learning, ICML 2014

Volumn 3, Issue , 2014, Pages 2656-2664

  Pentina, Anastasia ^a   Lampert, Christoph H ^a  

^a INSTITUTE OF SCIENCE AND TECHNOLOGY AUSTRIA   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS;

EFFECTIVE ALGORITHMS; GENERALIZATION BOUND; LIFE LONG LEARNING; LOW-DIMENSIONAL REPRESENTATION; MACHINE LEARNING COMMUNITIES; PAC-BAYESIAN BOUNDS; TRANSFER INFORMATION; TRANSFER LEARNING;

LEARNING ALGORITHMS;

EID: 84919934898     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Argyriou, Andreas, Evgeniou, Theodoras, and Pontil, Mas- similiano. Convex multi-task feature learning. Machine Learning, 73(3):243-272, 2008.
2. Aytar, Yusuf and Zisserman, Andrew. Tabula rasa: Model transfer for object category detection. In International Conference on Computer Vision (ICCV), 2011.
3. Baxter, Jonathan. A model of inductive bias learning. Journal of Artificial Intelligence Research, 12:149-198, 2000.
4. Bengio, Yoshua, Louradour, Jerome, Collobert, Ronan, and Weston, Jason. Curriculum learning. In International Conference on Machine Learing (ICML), 2009.
5. Bridle, John S. and Cox, Stephen J. Rec Norm: Simultaneous normalisation and classification applied to speech recognition. In Conference on Neural Information Processing Systems (NIPS), pp. 234-240, 1990.
6. Caruana, Rich. Multitask learning. Machine Learning, 28 (1):41-75, 1997.
7. Catoni, Olivier. PAC-Bayesian Supervised Classification (The Thermodynamics of Statistical Learning), volume 56 of Monograph Series of the Institute of Mathematical Statistics. IMS, 2007.
8. Downs, Thomas D. Orientation statistics. Biometrika, 59 (3):665-676, 1972.
9. Evgeniou, Theodoras and Pontil, Massimiliano. Regularized multi-task learning. In International Conference on Knowledge Discovery and Data Mining (SIGKDD), 2004.
10. Germain, Pascal, Lacasse, Alexandre, Laviolette, Fran§ois, and Marchand, Mario. PAC-Bayesian learning of linear classifiers. In International Conference on Machine Learing (ICML), 2009.
11. Hoeffding, Wassily. Probability inequalities for sums of bounded random variables. Journal of the American Statistical Association, 58(301): 13-30, March 1963.
12. Kumar, Abhishek and Daume III, Hal. Learning task grouping and overlap in multi-task learning. In International Conference on Machine Learing (ICML), 2012.
13. Lampert, Christoph H., Nickisch, Hannes, and Harmeling, Stefan. Attribute-based classification for zero-shot visual object categorization. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2013.
14. Langford, John. Tutorial on practical prediction theory for classification. Journal of Machine Learning Research (JMLR), 6:273-306, 2005.
15. Langford, John and Shawe-Taylor, John. PAC-Bayes and margins. In Conference on Neural Information Processing Systems (NIPS), 2002.
16. Laviolette, Francois and Marchand, Mario. PAC-Bayes risk bounds for stochastic averages and majority votes of sample-compressed classifiers. Journal of Machine Learning Research (JMLR), 8:1461-1487, 2007.
17. Maurer, Andreas. Transfer bounds for linear feature learning. Machine Learning, 75(3):327-350, 2009.
18. Maurer, Andreas, Pontil, Massimiliano, and Romera- Paredes, Bernardino. Sparse coding for multitask and transfer learning. In International Conference on Machine Learning (ICML), 2013.
19. McAllester, David. PAC-Bayesian model averaging. In Workshop on Computational Learning Theory (COLT), pp. 164-170. ACM, 1999.
20. McAllester, David. Simplified PAC-Bayesian margin bounds. In Learning Theory and Kernel Machines, pp. 203-215. Springer, 2003.
21. Parrado-Hernandez, Emilio, Ambroladze, Amiran, Shawe- Taylor, John, and Sun, Shiliang. PAC-Bayes bounds with data dependent priors. Journal of Machine Learning Research (JMLR), 13:3507-3531, 2012.
22. Ruvolo, Paul and Eaton, Eric. ELLA: An efficient lifelong learning algorithm. In International Conference on Machine Learing (ICML), 2013.
23. Seeger, Matthias W. Bayesian Gaussian Process Models: PAC-Bayesian Generalization Error Bounds and Sparse Approximations. PhD thesis, University of Edinburgh, 2003.
24. Thrun, Sebastian and Mitchell, Tom M. Lifelong robot learning. Robotics and autonomous systems, 15(1):25- 46, 1995.
25. Vapnik, Vladimir N. Statistical learning theory. Wiley, 1998.
26. Wen, Zaiwen and Yin, Wotao. A feasible method for optimization with orthogonality constraints. Mathematical Programming, 142(1-2):397-434, 2013.
27. Xue, Ya, Liao, Xuejun, Carin, Lawrence, and Krishnapu- ram, Balaji. Multi-task learning for classification with Dirichlet process priors. Journal of Machine Learning Research (JMLR), 8:35-63, 2007.
28. Yang, Jun, Yan, Rong, and Hauptmann, Alexander G. Cross-domain video concept detection using adaptive SVMs. In International Conference on Multimedia, pp. 188-197, 2007.