A tour of machine learning: An AI perspective

AI Communications

Volumn 27, Issue 1, 2014, Pages 11-23

  Sebag, Michele ^a  

^a CNRS   (France)

Author keywords

Change of representation; Machine Learning; Machine reasoning; Reinforcement learning; Statistical learning; Unsupervised learning

Indexed keywords

CHANGE OF REPRESENTATION; HISTORICAL PERSPECTIVE; STATISTICAL LEARNING;

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; UNSUPERVISED LEARNING;

REINFORCEMENT LEARNING;

EID: 84889678199     PISSN: 09217126     EISSN: None     Source Type: Journal    
DOI: 10.3233/AIC-130580     Document Type: Review

References (103)

1. P. Abbeel and A.Y. Ng, Apprenticeship learning via inverse reinforcement learning, in: Proc. of Int. Conf. on Machine Learning, C.E. Brodley, ed., ACM International Conf. Proc. Series, Vol. 69, ACM, 2004.
2. D. Achlioptas, Database-friendly random projections, in: ACM Symposium on the Principles of Database Systems, 2001, pp. 274-281.
3. S.-I. Amari, Neural theory of association and concept formation, Biological Cybernetics 26 (1977), 175-185.
4. Y. Amit and D. Geman, Shape quantization and recognition with randomized trees, Neural Computation 9 (1997), 1545-1588.
5. P. Auer, N. Cesa-Bianchi and P. Fischer, Finite-time analysis of the multiarmed bandit problem, Machine Learning 47(2) (2002), 235-256.
6. S. Baker, Final Jeopardy: Man vs. Machine and the Quest to Know Everything, Houghton Mifflin Harcourt, 2011.
7. R. Bardenet, M. Brendel, B. Kégl and M. Sebag, Collaborative hyperparameter tuning, in: Proc. of Int. Conf. on Machine Learning, S. Dasgupta and D. McAllester, eds, 2013.
8. S. Ben-David, U. von Luxburg, J. Shawe-Taylor and N. Tishby (eds), Theoretical Foundations of Clustering, NIPS Workshop, 2005.
9. Y. Bengio, Learning deep architectures for AI, Foundations and Trends in Machine Learning 2(1) (2009), 1-127.
10. Y. Bengio, P. Lamblin, D. Popovici and H. Larochelle, Greedy layer-wise training of deep networks, in: Advances in Neural Information Processing Systems, B. Schölkopf, J.C. Platt and T. Hoffman, eds, MIT Press, 2006, pp. 153-160.
11. D.P. Bertsekas and J.N. Tsitsiklis, Neuro-dynamic Programming, Athena Scientific, 1996.
12. A. Beygelzimer, V. Dani, T.P. Hayes and J. Langford, Reductions between classification tasks, Electronic Colloquium on Computational Complexity (ECCC), (077), 2004.
13. C.M. Bishop, Pattern Recognition and Machine Learning, Springer, 2006.
14. C.M. Bishop, Embracing uncertainty: Applied machine learning comes of age, in: Machine Learning and Knowledge Discovery in Databases, Part I, D. Gunopulos, T. Hofmann, D. Malerba and M. Vazirgiannis, eds, Lecture Notes in Computer Science, Vol. 6911, Springer, 2011.
15. D.M. Blei, A.Y. Ng and M.I. Jordan, Latent Dirichlet allocation, Journal of Machine Learning Research 3 (2003), 993-1022.
16. M. Boden (ed.), The Philosophy of Artificial Intelligence, Oxford Univ. Press, 1990.
17. D. Bollier, The promise and peril of big data, Technical report, The Aspen Institute, 2010.
18. B. Boser, I. Guyon and V. Vapnik, A training algorithm for optimal margin classifiers, in: Proc. of Computational Learning Theory Conference (COLT), 1992, pp. 144-152.
19. L. Bottou, From machine learning to machine reasoning, CoRR (2011), available at: abs/1102.1808.
20. L. Bottou and O. Bousquet, The tradeoffs of large scale learning, in: Advances in Neural Information Processing Systems, C. Platt, D. Koller, Y. Singer and S.T. Roweis, eds, 2007.
21. L. Breiman, Random forests, Machine Learning 45(1) (2001), 5-32.
22. L. Breiman, J. Friedman, R. Olshen and C.J. Stone, Classification and Regression Trees, Wadsworth Statistics/Probability Series, Wadsworth Advanced Books and Software, Belmont, CA, 1984.
23. R. Byron and C. Nass, The Media Equation, Cambridge Univ. Press, 1996.
24. S. Calinon, F. Guenter and A. Billard, On learning, representing and generalizing a task in a humanoid robot, IEEE Transactions on Systems, Man and Cybernetics, Part B 37(2) (2007), 286-298. (Special issue on robot learning by observation, demonstration and imitation.)
25. E.J. Candès, J. Romberg and T. Tao, Stable signal recovery from incomplete and inaccurate measurements, Comm. Pure Appl. Math. 59 (2006), 1207-1223.
26. A. Carlson, J. Betteridge, B. Kisiel, B. Settles, E.R. Hruschka, Jr. and T.M. Mitchell, Toward an architecture for neverending language learning, in: National Conference on Artificial Intelligence (AAAI), M. Fox and D. Poole, eds, AAAI Press, 2010.
27. O. Chapelle and Y. Chang, Yahoo! learning to rank challenge overview, Journal of Machine Learning Research, Proceeding Track 14 (2011), 1-24.
28. W.J. Clancey, Situated action: A neuropsychological interpretation response to Vera and Simon, Cognitive Science 17 (1993), 87-116.
29. R. Collobert and J. Weston, A unified architecture for natural language processing: deep neural networks with multitask learning, in: Proc. of Int. Conf. on Machine Learning, W.W. Cohen, A. McCallum and S.T. Roweis, eds, ACM International Conference Proceeding Series, Vol. 307, ACM, 2008, pp. 160-167.
30. N. Cristianini, Are we there yet?, in: Eur. Conf. on Machine Learning and Knowledge Discovery in Databases, W.L.Buntine, M. Grobelnik, D. Mladenic and J. Shawe-Taylor, eds, Lecture Notes in Computer Science, Vol. 5781, Springer,2009.
31. L. De Raedt, P. Frasconi, K. Kersting and S. Muggleton (eds), Probabilistic Inductive Logic Programming - Theory and Applications, Lecture Notes in Computer Science, Vol. 4911, Springer, 2008.
32. V. de Silva and J. Tenenbaum, Global versus local methods in nonlinear dimensionality reduction, in: Advances in Neural Information Processing Systems, S. Becker, S. Thrun and K. Obermayer, eds, 2003, pp. 721-728.
33. T.G. Dietterich, Approximate statistical tests for comparing supervised classification learning algorithms, Neural Computation 10(7) (1998), 1895-1923.
34. C. Dimitrakakis and M.G. Lagoudakis, Rollout sampling approximate policy iteration, Machine Learning 72(3) (2008), 157-171.
35. B. Efron, The jackknife, the bootstrap, and other resampling plans, in: CBMS-NSF Regional Conf. Series in Applied Mathematics, Vol. 38, 1982.
36. Y. Freund and R.E. Shapire, Experiments with a new boosting algorithm, in: Proc. of Int. Conf. on Machine Learning, L. Saitta, ed., Morgan Kaufmann, 1996, pp. 148-156.
37. B.J. Frey and D. Dueck, Clustering by passing messages between data points, Science 315 (2007), 972-976.
38. J. Fürnkranz, D. Gamberger and N. Lavrac, Foundations of Rule Learning, Springer, 2012.
39. C. Furtlehner, M. Sebag and X. Zhang, Scaling analysis of affinity propagation, Phys. Rev. E 81(6) (2010).
40. S. Gelly and D. Silver, Combining online and offline knowledge in UCT, in: Proc. of Int. Conf. on Machine Learning, Z. Ghahramani, ed., ACM, 2007, pp. 273-280.
41. C. Goutte, N. Cancedda, M. Dymetman and G. Foster, Learning Machine Translation, MIT Press, 2009.
42. P.D. Grünwald, The Minimum Description Length Principle, MIT Press, 2007.
43. I. Guyon and A. Elisseeff, An introduction to variable and feature selection, Journal of Machine Learning Research 3 (2003), 1157-1182.
44. J. Hastad, Computational limitations of small depth circuits, PhD thesis, Massachusetts Institute of Technology, 1987.
45. G.E. Hinton, S. Osindero and Y.-W. Teh, A fast learning algorithm for deep belief nets, Neural Computation 18 (2006), 1527-1554.
46. H.H. Hoos, Programming by optimization, Commun. ACM 55(2) (2012), 70-80.
47. F.-H. Hsu, Behind Deep Blue: Building the Computer that Defeated the World Chess Champion, Princeton Univ. Press,2002.
48. R.D. King, J. Rowland, S. Oliver, M. Young, W. Aubrey, E. Byrne, M. Liakata and M. Markham, Make way for robot scientists, Science 325(5943) (2009), 945.
49. A. Kleiner, A. Talwalkar, P. Sarkar and M.I. Jordan, The big data bootstrap, in: Proc. of Int. Conf. on Machine Learning, J. Langford and J. Pineau, eds, 2012.
50. L. Kocsis and C. Szepesvári, Bandit based Monte-Carlo planning, in: Eur. Conf. on Machine Learning, J. Fürnkranz, T. Scheffer and M. Spiliopoulou, eds, Springer, 2006, pp. 282-293.
51. Y. Kodratoff and R.S. Michalski, Machine Learning: An Artificial Intelligence Approach, Vol. 3, Morgan Kaufmann, 1990.
52. G. Konidaris, S. Kuindersma, A. Barto and R. Grupen, Constructing skill trees for reinforcement learning agents from demonstration trajectories, in: Advances in Neural Information Processing Systems, J.D. Lafferty, C.K.I. Williams, J. Shawe-Taylor, R.S. Zemel and A. Culotta, eds, 2010, pp. 1162-1170.
53. T. Lai and H. Robbins, Asymptotically efficient adaptive allocation rules, Advances in Applied Mathematics 6 (1985), 4-22.
54. Y. Le Cun, Modèles connexionnistes de l'apprentissage, PhD thesis, Université Pierre et Marie Curie, Paris VI, 1987.
55. D.B. Lenat, The nature of heuristics, Artificial Intelligence 19(2) (1982), 189-249.
56. H. Lipson, J.C. Bongard, V. Zykov and E. Malone, Evolutionary robotics for legged machines: From simulation to physical reality, in: IAS, 2006, pp. 11-18.
57. M.L. Littman, R.S. Sutton and S.P. Singh, Predictive representations of state, in: Advances in Neural Information Processing Systems, T.G. Dietterich, S. Becker and Z. Ghahramani, eds, MIT Press, 2001, pp. 1555-1561.
58. J. Mairal, F. Bach, J. Ponce and G. Sapiro, Online learning for matrix factorization and sparse coding, Journal of Machine Learning Research 11 (2010), 19-60.
59. H. Mannila and H. Toivonen, Levelwise search and borders of theories in knowledge discovery, Data Mining and Knowledge Discovery 1(3) (1997), 241-258.
60. W. McCulloch and W. Pitts, A logical calculus of the ideas immanent in nervous activity, Bulletin of Mathematical Biophysics 7 (1943), 115-133.
61. M. Meila, Comparing clustering - an axiomatic view, in: Proc. of Int. Conf. on Machine Learning, L. De Raedt and S. Wrobel, eds, 2005, pp. 577-584.
62. R.S. Michalski, A theory and methodology of inductive learning, in: Machine Learning: An Artificial Intelligence Approach, R.S. Michalski, J.G. Carbonell and T.M. Mitchell, eds, Vol. 1, Morgan Kaufmann, 1983, pp. 83-134.
63. R.S. Michalski, J.G. Carbonell and T.M. Mitchell, Machine Learning: An Artificial Intelligence Approach, Vol. 1, Morgan Kaufmann, 1983.
64. R.S. Michalski, J.G. Carbonell and T.M. Mitchell, Machine Learning: An Artificial Intelligence Approach, Vol. 2, Morgan Kaufmann, 1986.
65. T.M. Mitchell, Generalization as search, Artificial Intelligence 18 (1982), 203-226.
66. S. Muggleton and L. De Raedt, Inductive logic programming: Theory and methods, Journal of Logic Programming 19 (1994), 629-679.
67. A. Newell, J.C. Shaw and H.A. Simon, Report on a general problem-solving program, in: Proc. of the Int. Conf. on Information Processing, 1959, pp. 256-264.
68. A.Y. Ng and S. Russell, Algorithms for inverse reinforcement learning, in: Proc. of Int. Conf. on Machine Learning, P. Langley, ed., Morgan Kaufmann, 2000, pp. 663-670.
69. J.K. O'Regan, How to build consciousness into a robot: The sensorimotor approach, in: 50 Years of Artificial Intelligence, M. Lungarella, F. Iida, J.C. Bongard and R. Pfeifer, eds, Lecture Notes in Computer Science, Vol. 4850, Springer, 2006, pp. 332-346.
70. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann, 1991.
71. J. Pearl, Causality: Models, Reasoning and Inference, Cambridge Univ. Press, 2000.
72. J. Peters and S. Schaal, Reinforcement Learning of Motor Skills with Policy Gradients, Neural Networks 21(4) (2008), 682-697.
73. R. Pfeiffer and J. Bongard, How the Body Shapes the Way We Think: A New View of Intelligence, MIT Press, 2007.
74. J.R. Quinlan, Induction of decision trees, Machine Learning 1 (1986), 81-106.
75. C.E. Rasmussen and C.K.I.Williams, Gaussian Processes for Machine Learning, MIT Press, 2006.
76. J. Rissanen, Modeling by shortest data description, Automatica 14 (1978), 465-471.
77. F. Rosenblatt, The perceptron: A probabilistic model for information storage and organization in the brain, Psychological Review 65(6) (1958), 386-408.
78. S. Roweis and L. Saul, Nonlinear dimensionality reduction by locally linear embedding, Science 290(5500) (2000), 2323-2326.
79. D.E. Rumelhart and J.L. McClelland, Parallel Distributed Processing, MIT Press, 1986.
80. S. Russell and A. Norwig, Artificial Intelligence, A Modern Approach, Prentice Hall, 1995.
81. F. Russo, Frequency-driven probabilities in quantitative causal analysis, Philosophical Writings 32 (2006), 32-49.
82. L. Saitta, A. Giordana and A. Cornuéjols, Phase Transitions in Machine Learning, Cambridge Univ. Press, 2011.
83. A.L. Samuel, Programming computers to play games, Advances in Computers 1 (1960), 165-192.
84. R.E. Schapire, The strength of weak learnability, Machine Learning 5 (1990), 197.
85. B. Schölkopf, C. Burges and A. Smola, Advances in Kernel Methods: Support Vector Machines, MIT Press, Cambridge, MA, 1998.
86. J. Surowiecki, The Wisdom of Crowds, Random House, 2004.
87. R.S. Sutton and A.G. Barto, Reinforcement Learning, MIT Press, 1998.
88. C. Szepesvári, Algorithms for Reinforcement Learning, Morgan & Claypool Publishers, 2010.
89. G. Tesauro, Programming backgammon using self-teaching neural nets, Artificial Intelligence 134(1,2) (2002), 181-199.
90. S. Thrun, W. Burgard and D. Fox, Probabilistic Robotics, MIT Press, 2005.
91. N. Tishby, F.C. Pereira and W. Bialek, The information bottleneck method, in: Proc. of the 37th Annual Allerton Conference on Communication, Control and Computing, 1999, pp. 368-377.
92. I. Tsochantaridis, T. Joachims, T. Hofmann and Y. Altun, Large margin methods for structured and interdependent output variables, Journal of Machine Learning Research 6 (2005), 1453-1484.
93. A.M. Turing, Computing machinery and intelligence, Mind 49(236) (1950), 433-460.
94. L.G. Valiant, A theory of the learnable, Communication of the ACM 27 (1984), 1134-1142.
95. V.N. Vapnik, The Nature of Statistical Learning, Springer,1995.
96. R. Vert and J.-P. Vert, Consistency and convergence rates of one-class SVMs and related algorithms, Journal of Machine Learning Research 7 (2006), 817-854.
97. P. Viappiani and C. Boutilier, Optimal Bayesian recommendation sets and myopically optimal choice query sets, in: Advances in Neural Information Processing Systems, J.D. Lafferty, C.K.I. Williams, J. Shawe-Taylor, R.S. Zemel and A. Culotta, eds, 2010, pp. 2352-2360.
98. R. Vilalta, C.G. Giraud-Carrier and P. Brazdil, Metalearning - concepts and techniques, in: Data Mining and Knowledge Discovery Handbook, O. Maimon and L. Rokach, eds, Springer, 2010, pp. 717-731.
99. K. Weinberger, J. Blitzer and S. Lawrence, Distance metric learning for large margin nearest neighbor classification, in: Advances in Neural Information Processing Systems, MIT Press, 2005, pp. 1473-1480.
100. J. Weizenbaum, Eliza - a computer program for the study of natural language communication between man and machine, Communications of the ACM 9(1) (1966), 36-45.
101. B. Widrow, Generalization and information storage in networks of Adaline neurons, in: Self-Organizing Systems, M.C. Yovits, G.T. Jacobi and G.D. Goldstein, eds, Spartan Books, 1962.
102. P.H. Winston, Learning structural descriptions from examples, in: The Psychology of Computer Vision, P.H. Winston, ed., McGraw Hill, New York, 1975, pp. 157-209.
103. L. Xu, F. Hutter, H.H. Hoos and K. Leyton-Brown, SATzilla: Portfolio-based algorithm selection for SAT, J. Artif. Intell. Res. 32 (2008), 565-606.