Sequence Learning: From Recognition and Prediction to Sequential Decision Making

IEEE Intelligent Systems

Volumn 16, Issue 4, 2001, Pages 67-70

  Giles, C Lee ^b  

^a UNIVERSITY OF MISSOURI   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HIDDEN MARKOV MODELS; INDUCTIVE LOGIC PROGRAMMING; SEQUENCE LEARNING; SEQUENTIAL DECISION MAKING;

BACKPROPAGATION; DECISION MAKING; EVOLUTIONARY ALGORITHMS; LEARNING ALGORITHMS; LOGIC PROGRAMMING; MARKOV PROCESSES; MATHEMATICAL MODELS; PROBABILITY DISTRIBUTIONS; RECURRENT NEURAL NETWORKS;

LEARNING SYSTEMS;

EID: 0035387537     PISSN: 15411672     EISSN: None     Source Type: Journal    
DOI: 10.1109/MIS.2001.1463065     Document Type: Article

References (28)

1. J. Anderson, Learning and Memory, John Wiley & Sons, New York, 1995.
2. R. Sun, E. Merrill, and T. Peterson, “From Implicit Skills to Explicit Knowledge: A Bottom-Up Model of Skill Learning,” Cognitive Science, vol. 25, no. 2, 2001, pp. 203–244.
3. R. Bellman, Dynamic Programming, Princeton Univ. Press, Princeton, N.J., 1957.
4. D. Bertsekas and J. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific, Belmont, Mass., 1996.
5. L. Kaelbling, M. Littman, and A. Moore, “Reinforcement Learning: A Survey,” J. Artificial Intelligence Research, vol. 4, 1996, pp. 237–285.
6. R. Sutton and A. Barto, Reinforcement Learning, MIT Press, Cambridge, Mass., 1997.
7. A. McCallum, “Learning to Use Selective Attention and Short-Term Memory in Sequential Tasks,” Proc. Conf. Simulation of Adaptive Behavior, MIT Press, Cambridge, Mass., 1996, pp. 315–324.
8. R. Sun and C. Sessions, “Self Segmentation of Sequences,” IEEE Trans. System, Man, and Cybernetics, vol. 30, no. 3, 2000, pp.403-418.
9. C. Nevill-Manning and I. Witten, “Identifying Hierarchical Structure in Sequences: A Linear-Time Algorithm,” J. Artificial Intelligence Research, vol. 7, 1997, pp. 67–82.
10. R. Sun and T. Peterson, “Multi-agent Reinforcement Learning: Weighting and Partitioning,” Neural Networks, vol. 12, nos. 4–5, 1999, pp. 127–153.
11. C. Tham, “Reinforcement Learning of Multiple Tasks Using a Hierarchical CMAC Architecture,” Robotics and Autonomous Systems, vol. 15, 1995, pp. 247–274.
12. C.L. Giles and M. Gori, eds., Adaptive Processing of Sequences and Data Structures, Springer-Verlag, Heidelberg, Germany, 1998.
13. C. L. Giles, B.G. Horne, and T. Lin, “Learning a Class of Large Finite State Machines with a Recurrent Neural Network,” Neural Networks, vol. 8 no. 9, 1995, pp. 1359–1365.
14. I. Guyon et al., “Storage and Retrieval of Complex Sequences in Neural Networks,” Physical Rev. A, vol. 38, 1988, pp. 6365–6372.
15. D. Kleinfeld and H. Sompolinsky, “Associative Neural Network Models for the Generation of Temporal Patterns,” Biophysics J., vol. 54, 1988, pp. 1039–1051.
16. C. Watkins, Learning with Delayed Rewards, PhD thesis, Cambridge Univ., Cambridge, UK, 1989.
17. L. Lin, “Self-Improving Reactive Agents Based on Reinforcement Learning, Planning, and Teaching,” Machine Learning, vol. 8, 1992, pp. 293–321.
18. T. Tesauro, “Practical Issues in Temporal Difference Learning,” Machine Learning, vol. 8, 1992, pp. 257–277.
19. P. Agre and D. Chapman, “What Are Plans For?” Designing Autonomous Agents, P. Maes, ed., Elsevier, New York, 1990.
20. N. Lavrac and S. Dzeroski, Inductive Logic Programming, Ellis Horwood, New York, 1994.
21. L.E. Baum, “An Inequality and Associated Maximization Technique in Statistical Estimation for Probabilistic Functions of a Markov Process” Inequalities, vol. 3, 1972, pp. 1–8.
22. J. Grefenstette, “The Evolution of Strategies for Multiagent Environments,” Adaptive Behavior, vol. 1, no. 1, 1992, pp. 65–90.
23. L. Meeden, “An Incremental Approach to Developing Intelligent Neural Network Controllers for Robots,” IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 26, no. 3, 1996, pp. 473–485.
24. R. Sun and T. Peterson, “Autonomous Learning of Sequential Tasks: Experiments and Analyses,” IEEE Trans. Neural Networks, vol. 9, no. 6, Nov. 1998, pp. 1217–1234.
25. R. Dearden and C. Boutilier, “Abstraction and Approximate Decision Theoretic Planning,” Artificial Intelligence, vol. 89, 1997, pp. 219–283.
26. R. Sun and C. Sessions, “Learning Plans without A Priori Knowledge,” Proc. 1998 IEEE World Congress Computational Intelligence and Int’l Joint Conf. Neural Networks (WCCI-IJCNN ’98), vol. 1, IEEE Press, Piscataway, N.J., 1998, pp. 1–6.
27. L. Wang and D. Alkon, eds., Artificial Neural Networks: Oscillations, Chaos, and Sequence Processing, IEEE CS Press, Los Alamitos, Calif., 1993.
28. R. Sun and L. Giles, Sequence Learning: Paradigms, Algorithms, and Applications, Springer-Verlag, Heidelberg, Germany, 2001.