A robotic approach to understanding the role and the mechanism of vicarious trial-and-error in a T-maze task

PLoS ONE

Volumn 9, Issue 7, 2014, Pages

  Matsuda, Eiko ^a,b,c   Hubert, Julien ^a   Ikegami, Takashi ^a  

^a UNIVERSITY OF TOKYO   (Japan)

^b UNIVERSITY OF SUSSEX   (United Kingdom)

^c JAPAN SOCIETY FOR THE PROMOTION OF SCIENCE   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; ARTIFICIAL NEURAL NETWORK; CALCULATION; DECISION MAKING; LEARNING; MATHEMATICAL ANALYSIS; NONHUMAN; RAT; ROBOTICS; T-MAZE TEST; TACTILE STIMULATION; TASK PERFORMANCE; VICARIOUS TRIAL AND ERROR; ANIMAL; COMPUTER SIMULATION; HUMAN; MAZE TEST; PSYCHOLOGICAL MODEL;

ANIMALS; COMPUTER SIMULATION; DECISION MAKING; HUMANS; MAZE LEARNING; MODELS, PSYCHOLOGICAL; NEURAL NETWORKS (COMPUTER); ROBOTICS;

EID: 84904658611     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0102708     Document Type: Article

References (35)

1. Tolman EC (1939) Prediction of vicarious trial and error by means of the schematic sowbug. Psychol Rev 46: 318-336.
2. Hu D, Amsel A (1995) A simple test of the vicarious trial-and-error hypothesis of hippocampal function. Proceedings of the National Academy of Sciences of the United States of America 92: 5506-9.
3. Johnson A, Redish AD (2007) Neural ensembles in ca3 transiently encode paths forward of the animal at a decision point. The Journal of neuroscience: the official journal of the Society for Neuroscience 27: 12176-89.
4. van der Meer MA, Johnson A, Schmitzer-Torbert NC, Redish AD (2010) Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task. Neuron 67: 25-32.
5. Schmidt B, Papale A, Redish AD, Markus EJ (2013) Conflict between place and response navigation strategies: Effects on vicarious trial and error (vte) behaviors. Learning & Memory 20: 130-138.
6. Voss JL, Warren DE, Gonsalves BD, Federmeier KD, Tranel D, et al. (2011) Spontaneous revisitation during visual exploration as a link among strategic behavior, learning, and the hippocampus. Proceedings of National Academy of Sciences 108: E402-E409.
7. Tarsitano M (2006) Route selection by a jumping spider (portia labiata) during the locomotory phase of a detour. Animal Behaviour 72: 1437-1442.
8. Rossler OE (1994) Fraiberg-lenneberg speech. Chaos, Solitons & Fractals 4: 125-131.
9. Ikegami T (2007) Simulating active perception and mental imagery with embodied chaotic itinerancy. Journal of Consciousness Studies 14: 111-125.
10. Johnson A, Varberg Z, Benhardus J, Maahs A, Schrater P (2012) The hippocampus and exploration: dynamically evolving behavior and neural representations. Frontiers in human neuroscience 6: 216.
11. Harvey I, Husbands P, Cliff D, Thompson A, Jakobi N (1997) Evolutionary robotics: the sussex approach. Robotics and Autonomous Systems 20: 205-224. (Pubitemid 127399445)
12. Nolfi S, Floreano D (2000) Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines. MIT press.
13. Brooks RA (1991) Intelligence without representation. Artificial Intelligence: Building Embodied, Situated Agents 47: 139-159.
14. Pfeifer R, Scheier C (1999) Understanding intelligence. MIT Press.
15. Pfeifer R, Bongard JC (2006) How the body shapes the way we think. MIT press.
16. Bovet S, Pfeifer R (2005) Emergence of delayed reward learning from sensorimotor coordination. In: IEEE/RSJ International Conference on Intelligent Robots and Systems(IROS). Edmonton, pp. 841-846.
17. Iizuka H, di Paolo E (2008) Extended homeostatic adaptation: Improving the link between internal and behavioural stability. In: Proceedings of the 10th International Conference on Simulation of Adaptive Behavior. Berlin, Germany: Springer-Verlag, pp. 1-11.
18. Mondada F, Bonani M, Raemy X, Pugh J, Cianci C, et al. (2009) The e-puck, a robot designed for education in engineering. In: Proceedings of the 9th Conference on Autonomous Robot Systems and Competitions. pp. 59-65.
19. Bovet S (2006) Emergence of insect navigation strategies from homogeneous sensorimotor coupling. In: Proceedings of the 9th International Conference on Intelligent Autonomous Systems. pp. 525-533.
20. Holland JH (1975) Adaptation in Natural and Artificial Systems. Ann Arbor: The University of Michigan Press.
21. Bovet SI (2007) Robots with Self-Developing Brains. Ph.D. thesis, Universität Zürich.
22. Rosenstein MT, Collins JJ, Luca CJD (1993) A practical method for calculating largest lyapunov exponents from small data sets. Physica D 65: 117-134.
23. Muenzinger KF, Gentry E (1931) Tone discrimination in white rats. J Comp Psychol 12: 195-206.
24. Muenzinger KF (1938) Vicarious trial and error at a point of choice: A general survey of its relation to learning efficiency. Journal of Genetic Psychology 53: 75-86.
25. Khamassi M, Humphries MD (2012) Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies. Frontiers in Behavioral Neuroscience 6.
26. van der Meer M, Kurth-Nelson Z, Redish AD (2012) Information processing in decision-making systems. Neuroscientist 18: 342-359.
27. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 8: 1704-1711. (Pubitemid 41683198)
28. Keramati M, Dezfouli A, Piray P (2011) Speed/accuracy trade-off between the habitual and the goal-directed processes. PLoS Computational Biology 7: e1002055.
29. Caluwaerts K, Staffa M, N'Guyen S, Grand C, Dollé L, et al. (2012) A biologically inspired metacontrol navigation system for the psikharpax rat robot. Bioinspiration & Biomimetics 7: 025009: 1-52.
30. Rumelhart DE, McClelland JL (1986) Parallel distributed processing: explorations in the microstructure of cognition. MIT Press.
31. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441: 876-879.
32. Cohen JD, McClure SM, Yu AJ (2007) Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philosophical Transactions 362: 933-942. (Pubitemid 47056820)
33. Barnes TD, Kubota Y, Hu D, Jin DZ, Graybiel AM (2005) Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437: 1158-1161. (Pubitemid 41509353)
34. Humphries MD, Khamassi M, Gurney K (2012) Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia. Frontiers in Neuroscience 6: 1-14.
35. Tsuda I (2001) Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. Behavioral and Brain Sciences 24: 793-847.