Skill acquisition through program-level imitation in a real-time domain

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 2, 2007, Pages 272-285

  Wood, Mark A ^a   Bryson, Joanna J ^a  

^a UNIVERSITY OF BATH   (United Kingdom)

Author keywords

Computer games; Program level imitation; Representation; Social learning

Indexed keywords

GAME THEORY; REAL TIME SYSTEMS; TIME DOMAIN ANALYSIS; VIRTUAL REALITY;

COMPUTER GAMES; PROGRAM-LEVEL IMITATION; SOCIAL LEARNING;

LEARNING SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; COMPUTER SYSTEM; HUMAN; IMITATION; METHODOLOGY; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; ROBOTICS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; COMPUTER SYSTEMS; HUMANS; IMITATIVE BEHAVIOR; PSYCHOMOTOR PERFORMANCE; ROBOTICS;

EID: 34047106206     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2006.886948     Document Type: Article

References (57)

1. S. Hurley and N. Chater, Eds., Perspectives on Imitation: From Neuroscience to Social Science. Cambridge, MA: MIT Press, 2005.
2. R. W. Byrne and A. E. Russon, "Learning by imitation: A hierarchical approach," Brain Behav. Sci., vol. 21, no. 5, pp. 667-721, 1998.
3. J. Demiris, S. Rougeaux, G. M. Hayes, L. Berthouze, and Y. Kuniyoshi, "Deferred imitation of human head movements by an active stereo vision head," in Proc. 6th IEEE Int. Workshop Robot Human Commun., Sendai, Japan, Sep. 1997, pp. 88-93.
4. M. J. Matarić, "Sensory-motor primitives as a basis for imitation: Linking perception to action and biology to robotics," in Imitation in Animals and Artifacts, ser. Complex Adaptive Systems, K. Dautenhahn and C. L. Nehaniv, Eds. Cambridge, MA: MIT Press, 2002, ch. 15, pp. 391-422.
5. D. K. Roy, "Learning from sights and sounds: A computational model," Ph.D. dissertation, MIT Media Lab., Cambridge, MA, Sep. 1999.
6. M. A. Wood, J. C. S. Leong, and J. J. Bryson, "ACT-R is almost a model of primate task learning: Experiments in modelling transitive inference," in Proc. 26th Annu. Conf. Cogn. Sci. Soc., K. Forbus, D. Gentner, and T. Regier, Eds., Chicago, IL, Aug. 2004, pp. 1470-1475.
7. J. J. Bryson and J. C. S. Leong, "Primate errors in transitive 'inference': A two-tier learning model," Anim. Cogn., 2006, to be published.
8. R. A. Rensink, "The dynamic representation of scenes," Vis. Cogn., vol. 7, no. 1-3, pp. 17-42, Jan. 2000.
9. R. Dawkins, "Hierarchical organisation: A candidate principle for ethology," in Growing Points in Ethology, P. P. G. Bateson and R. A. Hinde, Eds. Cambridge, U.K.: Cambridge Univ. Press, 1976, pp. 7-54.
10. T. M. Caro and M. D. Hauser, "Is there teaching in nonhuman animals," Q. Rev. Biol., vol. 67, no. 2, pp. 151-174, Jun. 1992.
11. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, ser. Adaptive Computation and Machine Learning. Cambridge, MA: MIT Press, 1998.
12. D. Gordon, "APT agents: Agents that are adaptive, predictable, and timely," in Proc. 1st Goddard Workshop FAABS, 2000, pp. 278-293.
13. M. Barley and H. W. Guesgen, Eds., Spring Symposium on Safe Learning Agents. Menlo Park, CA: AAAI, Mar. 2002.
14. C. L. Nehaniv and K. Dautenhahn, "The correspondence problem," in Imitation in Animals and Artifacts, ser. Complex Adaptive Systems, K. Dautenhahn and C. L. Nehaniv, Eds. Cambridge, MA: MIT Press, 2002, ch. 2, pp. 41-61.
15. S. Hurley, "Active perception and perceiving action: The shared circuits model," in Perceptual Experience, T. Gendler and J. Hawthorne, Eds. London, U.K.: Oxford Univ. Press, 2005, ch. 6.
16. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc. Ser B, vol. 39, no. 1, pp. 1-38, 1977.
17. T. Mitchell, Machine Learning. New York: McGraw-Hill, 1997.
18. R. M. Neal, Bayesian Learning for Neural Networks. New York: Springer-Verlag, Aug. 1996.
19. D. K. Roy and A. P. Pentland, "Learning words from sights and sounds: A computational model," Cogn. Sci., vol. 26, no. 1, pp. 113-146, Jan. 2002.
20. E. D. Thiessen and J. R. Saffran, "When cues collide: Statistical and stress cues in infant word segmentation," Dev. Psychol., vol. 39, no. 4, pp. 706-716, 2003.
21. R. W. Byrne, "Imitation as behavior parsing," Philos. Trans. R. Soc. London B, vol. 358, no. 1431, pp. 529-536, Mar. 2003.
22. G. L. Drescher, Made-up Minds: A Constructivist Approach to Artificial Intelligence. Cambridge, MA: MIT Press, 1991.
23. A. Alissandrakis, C. L. Nehaniv, K. Dautenhahn, and J. Saunders, "Achieving corresponding effects on multiple robotic platforms: Imitating in context using different effect metrics," in Proc. 3rd Int. Symp. Imitation Anim. and Artifacts, Hatfield, U.K., Apr. 2005, pp. 10-19.
24. V. V. Hafner, "Cognitive maps in rats and robots," J. Adapt. Behav., Special Issue on "Towards Artificial Rodents," vol. 13, no. 2, pp. 87-96, 2005.
25. S. Schaal, "Is imitation learning the route to humanoid robots?" Trends Cogn. Sci., vol. 3, no. 6, pp. 233-242, 1999.
26. T. Tyrrell, "Computational mechanisms for action selection," Ph.D. dissertation, Univ. Edinburgh, Centre for Cogn. Sci., Edinburgh, U.K., 1993.
27. L. S. Zettlemoyer, H. Pasula, and L. P. Kaelbling, "Learning planning rules in noisy stochastic worlds," in Proc. AAAI, M. M. Veloso and S. Kambhampati, Eds., Pittsburgh, PA, Jul. 2005, pp. 911-918.
28. J. E. Laird, "Using a computer game to develop advanced AI," Computer, vol. 34, no. 7, pp. 70-75, Jul. 2001.
29. R. Le Hy, A. Arrigoni, P. Bessière, and O. Lebeltel, "Teaching Bayesian behaviours to video game characters," Robot. Auton. Syst., vol. 47, no. 2/3, pp. 177-185, 2004.
30. C. Thurau, C. Bauckhage, and G. Sagerer, "Imitation learning at all levels of game-AI," in Proc. Int. Conf. Comput. Games, Artif. Intell., Des. and Educ., 2004, pp. 402-408.
31. B. Gorman and M. Humphrys, "Towards integrated imitation of strategic planning and motion modelling in interactive computer games," in Proc. 3rd ACM Annu. Int. Conf. GDTW, Liverpool, U.K., Nov. 2005, pp. 92-99.
32. J. J. Bryson, W. Lowe, and L. A. Stein, "Hypothesis testing for complex agents," in Proc. NIST Workshop Performance Metrics Intell. Syst., A. M. Meystel and E. R. Messina, Eds., Washington, DC, Aug. 2001, pp. 233-240. NIST Special Publication 970.
33. Digital Extremes, Unreal Tournament, 1999, Epic Games, Inc.
34. S. Schaal, A. Ijspeert, and A. Billard, "Computational approaches to motor learning by mutation," Philos. Trans. R. Soc. London, B, vol. 358, no. 1431, pp. 537-547, 2003.
35. E. Bizzi, S. Giszter, E. Loeb, F. A. Mussa-Ivaldi, and P. Saltiel, "Modular organization of motor behavior in the frog's spinal cord," Trends Neurosci., vol. 18, no. 10, pp. 442-446, 1995.
36. M. S. A. Graziano, C. S. R. Taylor, T. Moore, and D. F. Cooke, "The cortical control of movement revisited," Neuron, vol. 36, no. 3, pp. 349-362, Oct. 2002.
37. D. Custance, A. Whiten, and T. Fredman, "Social learning of an artificial fruit task in capuchin monkeys (cebus apella)," J. Comput. Psychol., vol. 113, no. 1, pp. 13-23, Mar. 1999.
38. Digital Extremes, UnrealEd 2.0, 2000, Epic Games, Inc.
39. A. von Stein and J. Sarnthein, "Different frequencies for different scales of cortical integration: From local gamma to long range alpha-theta synchronization," Int. J. Psychophysiol., vol. 38, no. 3, pp. 301-313, 2000.
40. S. Schaal and C. G. Atkeson, "Robot juggling: An implementation of memory-based learning," Control Syst. Mag., vol. 14, no. 1, pp. 57-71, 1994.
41. J. J. Bryson and B. McGonigle, "Agent architecture as object oriented design," in Proc. 4th Int. Workshop ATAL, M. P. Singh, A. S. Rao, and M. J. Wooldridge, Eds., Providence, RI, 1998, pp. 15-30.
42. K. R. Thórisson, "A mind model for multimodal communicative creatures and humanoids," Int. J. Appl. Artif. Intell., vol. 13, no. 4/5, pp. 519-538, 1999.
43. J. J. Bryson, "Modular representations of cognitive phenomena in AI, psychology and neuroscience," in Visions of Mind: Architectures for Cognition and Affect, D. N. Davis, Ed. Hershey, PA: Idea Group, 2005, pp. 66-89.
44. J. L. McClelland, B. L. McNaughton, and R. C. O'Reilly, "Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory," Psychol. Rev., vol. 102, no. 3, pp. 419-457, 1995.
45. N. R. Carlson, Physiology of Behavior. Boston, MA: Allyn & Bacon, 2000.
46. K. Louie and M. A. Wilson, "Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep," Neuron, vol. 29, no. 1, pp. 145-156, Jan. 2001.
47. T. J. Teyler and P. Discenna, "The hippocampal memory indexing theory," Behav. Neurosci., vol. 100, no. 2, pp. 147-154, Apr. 1986.
48. W. Lowe, "Semantic representation and priming in a self-organizing lexicon," in Proc. 4th NCPW - Connectionist Representations, J. A. Bullinaria, D. W. Glasspool, and G. Houghton, Eds., London, U.K., 1997, pp. 227-239.
49. T. Kobayashi, H. Nishijo, M. Fukuda, J. Bures, and T. Ono, "Task-dependent representations in rat hippocampal place neurons," J. Neurophysiol., vol. 78, no. 2, pp. 597-613, 1997.
50. J. E. Laird and P. S. Rosenbloom, "The evolution of the Soar cognitive architecture," in Mind Matters, D. M. Steier and T. M. Mitchell, Eds. Mahwah, NJ: Erlbaum, 1996.
51. J. R. Anderson and M. Matessa, "The rational analysis of categorization and the ACT-R architecture," in Rational Models of Cognition, M. Oaksford and N. Chater, Eds. London, U.K.: Oxford Univ. Press, 1998.
52. G. Rizzolatti, L. Fogassi, and V. Gallese, "Cortical mechanisms subserving object grasping and action recognition: A new view on the cortical motor functions," in The New Cognitive Neurosciences, 2nd ed. M. S. Gazzaniga, Ed., Cambridge, MA: MIT Press, 2000, ch. 38, pp. 538-552.
53. J. J. Bryson and M. A. Wood, "Learning discretely: Behaviour and organisation in social learning," in Proc. 3rd Int. Symp. Imitation Anim. and Artifacts, Y. Demiris, Ed., Hatfield, U.K., Apr. 2005, pp. 30-37.
54. L. P. Kaelbling, M. L. Littman, and A. R. Cassandra, "Planning and acting in partially observable stochastic domains," Artif. Intell., vol. 101, no. 1/2, pp. 99-134, 1998.
55. S. Benson, "Learning action models for reactive autonomous agents," Ph.D. dissertation, Stanford Univ., Dept. Comput. Sci., Stanford, CA, Dec. 1996.
56. A. Whiten, "Imitation of the sequential structure of actions by chimpanzees (pan troglodytes)," J. Comput. Psychol., vol. 112, no. 3, pp. 270-281, 1998.
57. W. T. Fitch, "The evolution of speech: A comparative review," Trends Cogn. Sci., vol. 4, no. 7, pp. 258-267, 2000.