An insect-based method for learning landmark reliability using expectation reinforcement in dynamic environments

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2010, Pages 3805-3812

  Mathews, Zenon ^a   Verschure, Paul F M J ^a,b   Bermúdez I Badia, Sergi ^a  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

AUTONOMOUS ROBOT; COGNITIVE PSYCHOLOGY; DISTRIBUTED ADAPTIVE CONTROL; DYNAMIC ENVIRONMENTS; LANDMARK NAVIGATION; MEMORY CAPACITY; MEMORY CONSOLIDATION; NEURAL MECHANISMS; NEUROETHOLOGY; NEURONAL MODEL; REINFORCEMENT METHOD;

DYNAMICS; NAVIGATION; REINFORCEMENT; ROBOTS;

ROBOTICS;

EID: 77955798418     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROBOT.2010.5509935     Document Type: Conference Paper

References (36)

1. R. Benenson, S. Petti, T. Fraichard, and M. Parent, "Towards urban driverless vehicles," International Journal of Vehicle Autonomous Systems, vol. 6, no. 1/2, pp. 4-23, 2006.
2. H. Andreasson, A. Treptow, and T. Duckett, "Localization for mobile robots using panoramic vision, local features and particle filter," Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on, pp. 3348-3353, April 2005.
3. E. Royer, J. Bom, M. Dhome, B. Thuilot, M. Lhuillier, and F. Marmoiton, "Outdoor autonomous navigation using monocular vision," Intelligent Robots and Systems, 2005. (IROS 2005). 2005 IEEE/RSJ International Conference on, pp. 1253-1258, Aug. 2005.
4. A. J. Davison and N. Kita, "Sequential localisation and map-building for real-time computer vision and robotics," Robotics and Autonomous Systems, vol. 36, no. 4, pp. 171-183, 2001.
5. D. Stephens, J. Brown, and R. Ydenberg, Foraging:Behavior and Ecology. Chicago: University of Chicago Press, 2007.
6. R. Wehner, "Desert ant navigation: how miniature brains solve complex tasks," Journal of comparative physiology.A, Neuroethology, sensory, neural, and behavioral physiology, vol. 189, no. 8, pp. 579-588, Aug 2003.
7. T. S. Collett and M. Collett, "Memory use in insect visual navigation," Nature reviews.Neuroscience, vol. 3, no. 7, pp. 542-552, Jul 2002.
8. L. Paletta, E. Rome, and H. Buxton, "Attenion architectures for machnine vision and mobile robots," Neurobiology of Attention, p. 642..648, 2005.
9. M. Witkowski and D. Randell, "A model of modes of attention and inattention for artificial perception," Bioinspiration and biomimetics, vol. 2, no. 3, pp. S94-S115, Sep 2007.
10. E. C. Tolman, "Cognitive maps in rats and men." Psychological review, vol. 55, no. 4, pp. 189-208, July 1948.
11. J. O'Keefe and J. Dostrovsky, "The hippocampus as a spatial map. preliminary evidence from unit activity in the freely-moving rat," Brain research, vol. 34, no. 1, pp. 171-175, Nov 1971.
12. J. O'Keefe and L. Nadel, The Hippocampus as a Cognitive Map. Oxford University Press, USA, 1978-12-07 1978.
13. J. O'Keefe, The hippocampal cognitive map and navigational strategies. Oxford University Press, USA, 1991.
14. R. U. Muller, M. Stead, and J. Pach, "The hippocampus as a cognitive graph," The Journal of general physiology, vol. 107, no. 6, pp. 663-694, Jun 1996.
15. M. O. Franz and H. A. Mallot, "Biomimetic robot navigation," Robotics and autonomous Systems, vol. 30, pp. 133-153, 2000.
16. A. Arleo and W. Gerstner, "Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity," Biological Cybernetics, vol. 83, no. 3, pp. 287-299, 2000, article.
17. A. Guanella and P. F. M. J. Verschure, "Prediction of the position of an animal based on populations of grid and place cells: a comparative simulation study," Journal of Integrative Neuroscience, vol. 6, no. 3, pp. 433-446, 2007.
18. R. Wyss, P. Knig, and P. F. M. J. Verschure, "Invariant representations of visual patterns in a temporal population code," Proceedings of the National Academy of Sciences of the United States of America, vol. 100, no. 1, pp. 324-329, 01/2003 2003.
19. C. Giovannangeli, P. Gaussier, and G. Desilles, "Robust mapless outdoor vision-based navigation," Intelligent Robots and Systems, 2006 IEEE/RSJ International Conference on, pp. 3293-3300, Oct. 2006.
20. C. Giovannangeli and P. Gaussier, "Autonomous vision-based navigation: Goal-oriented action planning by transient states prediction, cognitive map building, and sensory-motor learning," Intelligent Robots and Systems, 2008. IROS 2008. IEEE/RSJ International Conference on, pp. 676-683, Sept. 2008.
21. K. von Frisch, "Decoding the language of the bee," Science (New York, N.Y.), vol. 185, no. 4152, pp. 663-668, Aug 23 1974.
22. T. S. Collett, "Insect navigation: visual panoramas and the sky compass," Current biology : CB, vol. 18, no. 22, pp. R1058-61, Nov 25 2008.
23. A. Si, M. V. Srinivasan, and S. Zhang, "Honeybee navigation: properties of the visually driven 'odometer'," The Journal of Experimental Biology, vol. 206, no. Pt 8, pp. 1265-1273, 2003.
24. R. Wehner, M. Boyer, F. Loertscher, S. Sommer, and U. Menzi, "Ant navigation: one-way routes rather than maps," Current biology : CB, vol. 16, no. 1, pp. 75-79, Jan 10 2006.
25. S. Akesson and R. Wehner, "Visual navigation in desert ants cataglyphis fortis: are snapshots coupled to a celestial system of reference?" The Journal of experimental biology, vol. 205, no. Pt 14, pp. 1971-1978, Jul 2002.
26. Z. Mathews, M. Lechón, J. M. Blanco Calvo, A. Dhir, A. Duff, S. Bermúdez i Badia, and P. F.M.J. Verschure, "Insect-like mapless navigation based on head direction cells and contextual learning using chemo-visual sensors," Intelligent Robots and Systems (IROS 2009), 2009 IEEE/RSJ International Conference on, 2009.
27. J. L. Kubie and A. A. Fenton, "Heading-vector navigation based on head-direction cells and path integration," Hippocampus, Dec 12 2008.
28. K. Nader and O. Hardt, "A single standard for memory: the case for reconsolidation," Nature Reviews Neuroscience, vol. 10, no. 3, pp. 224-234, mar 2009.
29. M. Gil, R. Menzel, and R. J. De Marco, "Does an insect's unconditioned response to sucrose reveal expectations of reward?" PLoS ONE, vol. 3, no. 7, p. e2810, 07 2008.
30. G. M. Viswanathan, S. V. Buldyrev, S. Havlin, M. G. E. da Luz, E. P. Raposo, and H. E. Stanley, "Optimizing the success of random searches," Nature, vol. 401, no. 6756, pp. 911-914, oct 1999.
31. A. M. Reynolds, A. D. Smith, D. R. Reynolds, N. L. Carreck, and J. L. Osborne, "Honeybees perform optimal scale-free searching flights when attempting to locate a food source," Journal of Experimental Biology, vol. 210, no. 21, pp. 3763-3770, nov 2007.
32. P. F. Verschure, T. Voegtlin, and R. J. Douglas, "Environmentally mediated synergy between perception and behaviour in mobile robots," Nature, vol. 425, no. 6958, pp. 620-624, Oct 9 2003.
33. P. F. M. J. Verschure and P. Althaus, "A real-world rational agent: unifying old and new ai," Cognitive Science A Multidisciplinary Journal, vol. 27, no. 4, pp. 561-590, 2003.
34. U. Bernardet, M. Blanchard, and P. F. M. J. Verschure, "Iqr: a distributed system for real-time real-world neuronal simulation," Neurocomputing, vol. 44-46, pp. 1043-1048, 2002.
35. P. F. M. J. Verschure and P. Althaus, "A real-world rational agent: Unifying old and new ai," Cognitive Science, vol. 27, pp. 561-590, 2003.
36. M. Gil, R. J. D. Marco, and R. Menzel, "Learning reward expectations in honeybees," Learning & Memory (Cold Spring Harbor, N.Y.), vol. 14, no. 7, pp. 491-496, July 2007.