Transfer learning

Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques

Volumn , Issue , 2009, Pages 242-264

  Torrey, Lisa ^a   Shavlik, Jude ^a  

^a UNIVERSITY OF WISCONSIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84866381873     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-60566-766-9.ch011     Document Type: Chapter

References (63)

1. Asadi, M., & Huber, M. (2007). Effective control knowledge transfer through learning skill and representation hierarchies. In Proceedings of the International Joint Conference on Artificial Intelligence.
2. Baxter, J. (2000). A model of inductive bias learning. Journal of Artificial Intelligence Research, 12, 149-198.
3. Ben-David, S., & Schuller, R. (2003). Exploiting task relatedness for multiple task learning. In Proceedings of the Conference on Learning Theory.
4. Carroll, C., & Seppi, K. (2005). Task similarity measures for transfer in reinforcement learning task libraries. In Proceedings of the IEEE International Joint Conference on Neural Networks.
5. Caruana, R. (1997). Multitask learning. Machine Learning, 28, 41-75. doi:10.1023/A:1007379606734
6. Croonenborghs, T., Driessens, K., & Bruynooghe, M. (2007). Learning relational skills for inductive transfer in relational reinforcement learning. In Proceedings of the International Conference on Inductive Logic Programming.
7. Dai, W., Xue, G., Yang, Q., & Yu, Y. (2007a). Transferring Naive Bayes classifiers for text classification. In Proceedings of the AAAI Conference on Artificial Intelligence.
8. Dai, W., Yang, Q., Xue, G., & Yu, Y. (2007b). Boosting for transfer learning. In Proceedings of the International Conference on Machine Learning.
9. Davis, J., & Domingos, P. (2008). Deep transfer via second-order Markov logic. In Proceedings of the AAAI Workshop on Transfer Learning for Complex Tasks.
10. Dietterich, T. (2000). Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Artificial Intelligence Research, 13, 227-303.
11. Driessens, K., Ramon, J., & Croonenborghs, T. (2006). Transfer learning for reinforcement learning through goal and policy parametrization. In Proceedings of the ICML Workshop on Structural Knowledge Transfer for Machine Learning.
12. Eaton, E., & DesJardins, M. (2006). Knowledge transfer with a multiresolution ensemble of classifiers. In Proceedings of the ICML Workshop on Structural Knowledge Transfer for Machine Learning.
13. Eaton, E., DesJardins, M., & Lane, T. (2008). Modeling transfer relationships between learning tasks for improved inductive transfer. In Proceedings of the European Conference on Machine Learning.
14. Falkenhainer, B., Forbus, K., & Gentner, D. (1989). The structure-mapping engine: Algorithm and examples. Artificial Intelligence, 41, 1-63. doi:10.1016/0004-3702(89)90077-5
15. Fernandez, F., & Veloso, M. (2006). Probabilistic policy reuse in a reinforcement learning agent. In Proceedings of the Conference on Autonomous Agents and Multi-Agent Systems.
16. Freund, Y., & Schapire, R. (1997). A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1), 119-139. doi:10.1006/jcss.1997.1504
17. Hlynsson, H. (2007). Transfer learning using the minimum description length principle with a decision tree application. Unpublished master's thesis, University of Amsterdam.
18. Klenk, M., & Forbus, K. (2007). Measuring the level of transfer learning by an AP physics problemsolver. In Proceedings of the AAAI Conference on Artificial Intelligence.
19. Konidaris, G., & Barto, A. (2006). Autonomous shaping: Knowledge transfer in reinforcement learning. In Proceedings of the International Conference on Machine Learning.
20. Kuhlmann, G., & Stone, P. (2007). Graph-based domain mapping for transfer learning in general games. In Proceedings of the European Conference on Machine Learning.
21. Lazaric, A., Restelli, M., & Bonarini, A. (2008). Transfer of samples in batch reinforcement learning. In Proceedings of the International Conference on Machine Learning.
22. Liu, Y., & Stone, P. (2006). Value-function-based transfer for reinforcement learning using structure mapping. In Proceedings of the AAAI Conference on Artificial Intelligence.
23. Madden, M., & Howley, T. (2004). Transfer of experience between reinforcement learning environments with progressive difficulty. Artificial Intelligence Review, 21, 375-398. doi:10.1023/B:AIRE.0000036264.95672.64
24. MarR, Z., Rosenstein, M., Kaelbling, L., & Dietterich, T. (2005). Transfer learning with an ensemble of background tasks. In Proceedings of the NIPS Workshop on Transfer Learning.
25. Mehta, N., Ray, S., Tadepalli, P., & Dietterich, T. (2008). Automatic discovery and transfer of MAXQ hierarchies. In Proceedings of the International Conference on Machine Learning.
26. Mihalkova, L., Huynh, T., & Mooney, R. (2007). Mapping and revising markov logic networks for transfer learning. In Proceedings of the AAAI Conference on Artificial Intelligence.
27. Mihalkova, L., & Mooney, R. (2006). Transfer learning with Markov logic networks. In Proceedings of the ICML Workshop on Structural Knowledge Transfer for Machine Learning.
28. Mitchell, T. (1997). Machine learning. New York: McGraw-Hill.
29. Niculescu-Mizil, A., & Caruana, R. (2007). Inductive transfer for Bayesian network structure learning. In Proceedings of the Conference on AI and Statistics.
30. Pan, S., Kwok, J., & Yang, Q. (2008). Transfer learning via dimensionality reduction. In Proceedings of the AAAI Conference on Artificial Intelligence.
31. Perkins, T., & Precup, D. (1999). Using options for knowledge transfer in reinforcement learning (Tech. Rep. UM-CS-1999-034). University of Massachusetts, Amherst, USA.
32. Price, B., & Boutilier, C. (1999). Implicit imitation in multiagent reinforcement learning. In Proceedings of the International Conference on Machine Learning.
33. Raina, R., Ng, A., & Koller, D. (2006). Constructing informative priors using transfer learning. In Proceedings of the International Conference on Machine Learning.
34. Richardson, M., & Domingos, P. (2006). Markov logic networks. Machine Learning, 62(1-2), 107-136. doi:10.1007/s10994-006-5833-1
35. Rosenstein, M., Marx, Z., Kaelbling, L., & Dietterich, T. (2005). To transfer or not to transfer. In Proceedings of the NIPS Workshop on Inductive Transfer.
36. Ruckert, U., & Kramer, S. (2008). Kernel-based inductive transfer. In Proceedings of the European Conference on Machine Learning.
37. Sharma, M., Holmes, M., Santamaria, J., Irani, A., Isbell, C., & Ram, A. (2007). Transfer learning in real-time strategy games using hybrid CBR/RL. In Proceedings of the International Joint Conference on Artificial Intelligence.
38. Sherstov, A., & Stone, P. (2005). Action-space knowledge transfer in MDPs: Formalism, suboptimality bounds, and algorithms. In Proceedings of the Conference on Learning Theory.
39. Shi, X., Fan, W., & Ren, J. (2008). Actively transfer domain knowledge. In Proceedings of the European Conference on Machine Learning.
40. Singh, S. (1992). Transfer of learning by composing solutions of elemental sequential tasks. Machine Learning, 8(3-4), 323-339. doi:10.1007/BF00992700
41. Soni, V., & Singh, S. (2006). Using homomorphisms to transfer options across continuous reinforcement learning domains. In Proceedings of the AAAI Conference on Artificial Intelligence.
42. Stracuzzi, D. (2006). Memory organization and knowledge transfer. In Proceedings of the ICML Workshop on Structural Knowledge Transfer for Machine Learning.
43. Sutton, C., & McCallum, A. (2005). Composition of conditional random fields for transfer learning. In Proceedings of the Conference on Empirical methods in Natural Language Processing.
44. Sutton, R. (1988). Learning to predict by the methods of temporal differences. Machine Learning, 3, 9-44.
45. Sutton, R., & Barto, A. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
46. Talvitie, E., & Singh, S. (2007). An experts algorithm for transfer learning. In Proceedings of the International Joint Conference on Artificial Intelligence.
47. Tanaka, F., & Yamamura, M. (2003). Multitask reinforcement learning on the distribution of MDPs. Transactions of the Institute of Electrical Engineers of Japan, 123(5), 1004-1011.
48. Taylor, M., Jong, N., & Stone, P. (2008a). Transferring instances for model-based reinforcement learning. In Proceedings of the European Conference on Machine Learning.
49. Taylor, M., Kuhlmann, G., & Stone, P. (2007). Accelerating search with transferred heuristics. In Proceedings of the ICAPS Workshop on AI Planning and Learning.
50. Taylor, M., Kuhlmann, G., & Stone, P. (2008b). Autonomous transfer for reinforcement learning. In Proceedings of the Conference on Autonomous Agents and Multi-Agent Systems.
51. Taylor, M., & Stone, P. (2007a). Cross-domain transfer for reinforcement learning. In Proceedings of the International Conference on Machine Learning.
52. Taylor, M., & Stone, P. (2007b). Transfer via inter-task mappings in policy search reinforcement learning. In Proceedings of the Conference on Autonomous Agents and Multi-Agent Systems.
53. Taylor, M., Stone, P., & Liu, Y. (2005). Value functions for RL-based behavior transfer: A comparative study. In Proceedings of the AAAI Conference on Artificial Intelligence.
54. Taylor, M., Whiteson, S., & Stone, P. (2006). Transfer learning for policy search methods. In Proceedings of the ICML Workshop on Structural Knowledge Transfer for Machine Learning.
55. Thrun, S., & Mitchell, T. (1995). Learning one more thing. In Proceedings of the International Joint Conference on Artificial Intelligence.
56. Torrey, L., Shavlik, J., Natarajan, S., Kuppili, P., & Walker, T. (2008). Transfer in reinforcement learning via Markov logic networks. In Proceedings of the AAAI Workshop on Transfer Learning for Complex Tasks.
57. Torrey, L., Shavlik, J., Walker, T., & Maclin, R. (2006). Relational skill transfer via advice taking. In Proceedings of the ICML Workshop on Structural Knowledge Transfer for Machine Learning.
58. Torrey, L., Shavlik, J., Walker, T., & Maclin, R. (2007). Relational macros for transfer in reinforcement learning. In Proceedings of the International Conference on Inductive Logic Programming.
59. Torrey, L., Walker, T., Shavlik, J., & Maclin, R. (2005). Using advice to transfer knowledge acquired in one reinforcement learning task to another. In Proceedings of the European Conference on Machine Learning.
60. Walsh, T., Li, L., & Littman, M. (2006). Transferring state abstractions between MDPs. In Proceedings of the ICML Workshop on Structural Knowledge Transfer for Machine Learning.
61. Wang, C., & Mahadevan, S. (2008). Manifold alignment using Procrustes analysis. In Proceedings of the International Conference on Machine Learning.
62. Watkins, C. (1989). Learning from delayed rewards. Unpublished doctoral dissertation, University of Cambridge.
63. Wilson, A., Fern, A., Ray, S., & Tadepalli, P. (2007). Multi-task reinforcement learning: A hierarchical Bayesian approach. In Proceedings of the International Conference on Machine Learning.