Evolvable hardware: A robot navigation system testbed

New Generation Computing

Volumn 16, Issue 2, 1998, Pages 97-122

  Keymeulen, Didier ^a,b,c,d   Iwata, Masaya ^a,b,e,f   Konaka, Kenji ^a   Kuniyoshi, Yasuo ^a   Higuchi, Tetsuya ^a  

^a ELECTROTECHNICAL LABORATORY   (Japan)

^b NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

^c UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

^d VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

^e OSAKA UNIVERSITY   (Japan)

^f ONERA   (France)

Author keywords

Autonomous Robots; Genetic Algorithms; Reinforcement Learning; Software Reconfigurable Device

Indexed keywords

BOOLEAN FUNCTIONS; COLLISION AVOIDANCE; DESIGN; NAVIGATION;

EVOLVABLE HARDWARE;

MOBILE ROBOTS;

EID: 11744281406     PISSN: 02883635     EISSN: None     Source Type: Journal    
DOI: 10.1007/BF03037313     Document Type: Article

References (51)

1. Altera Corporation, FLEX Embedded Programmable Logic Family Data Sheet, ver. 2, 1997. See http://www.altera.com.
2. Beer, R. D. and Gallagher, J. C., "Evolving Dynamic Neural Networks for Adaptive Behavior," Adaptive Behavior, 1, 1, pp. 91-122, July 1992.
3. Booker, L. B., "Classifier Systems That Learn Internal World Models," Machine Learning, 3, 2-3, pp. 161-192, 1988.
4. Brooks, R., "Artificial Life and Real Robots," in Proceedings of the First European Conference on Artificial Life (F. J. Varela and P. Bourgine, eds.), Cambridge, MA, 1992, MIT Press/Bradford Books, pp. 3-10, 1992.
5. Brooks, R., "A Robust Layered Control System for a Mobile Robot," in Proceedings of IEEE International Conference Robotics and Automation, pp. 14-23, 1986.
6. Bruner, J. S., "Going beyond the Information Given," in Contemporary Approaches to Cognition, Boston: Harvard University Press, 1957.
7. Cliff, D., Harvey, I., and Husbands, P., "Explorations in Evolutionary Robotics," Adaptive Behavior, 2, 1, pp.73-110, July 1993.
8. Connell, J. H. and Mahadevan, S., Robot Learning, Kluwer International Series in Engineering and Computer Science, Kluwer Academic Publisher, 1993.
9. de Micheli, C. and Gupta, R. K., "Hardware/Software Co-Design," Proceedings of the IEEE, 85, 3, pp. 349-365, March 1997.
10. Dorigo, M. and Colombetti, M., "Robot Shaping: Developing Autonomous Agents through Learning," Artificial Intelligence, 71, pp. 321-370, 1994.
11. Dorigo, M. and Schnepf, U., "Genetics-Based Machine Learning and Behavior-Based Robotics: A New Synthesis," IEEE Transactions on Systems, Man, and Cybernetics, 23, 1, pp. 141-154, 1993.
12. Floreano, D. and Mondada, F., "Automatic Creation of an Autonomous Agent: Genetic Evolution of a Neural-Network Driven Robot," in From Animals to Animats 3: Proceedings of the 3rd International Conference on Simulation of Adaptive Behavior (J.-A. Meyer, D. Cliff, P. Husbands, and S. Wilson, eds.), MIT Press, 1994.
13. Goldberg, D. E., Genetic Algorithms in Search, Optimization and Machine Learning, Addison Wesley, 1989.
14. Grefenstette, J. J., "Incremental Learning of Control Strategies with Genetic Algorithms," in Proceedings of the Sixth International Workshop on Machine Learning, Morgan Kaufmann, pp. 340-344, 1989.
15. Grefenstette, J. J., Ramsey, C. L., and Schultz, A., "Learning Sequential Decision Rules Using Simulation Models and Competition," Machine Learning, 5, 4, pp. 355-382, 1990.
16. Grefenstette, J. J. and Schultz, A., "An Evolutionary Approach to Learning in Robots," in Proceedings of the Machine Learning Workshop on Robot Learning, Eleventh International Conference on Machine Learning, New Brunswick, NJ, 1994.
17. Harvey, I., Husbands, P., and Cliff, D., "Seeing the Light: Artificial Evolution, Real Vision," in From Animals to Animats 3: Proceedings of the 3rd International Conference on Simulation of Adaptive Behavior (J.-A. Meyer, D. Cliff, P. Husbands, and S. Wilson, eds.), MIT Press, 1994.
18. Higuchi, T., Niwa, T., Tanaka, T., Iba, H., de Garis, H., and Furuya, T., "Evolvable Hardware with Genetic Learning: A First Step towards Building a Darwin Machine," in Proceedings of the 2nd International Conference on the Simulation of Adaptive Behavior (J.-A. Meyer, H. L. Roitblat, and S. W. Wilson, eds.), MIT Press, pp. 417-424, 1992.
19. Higuchi, T., Iwata, M., Kobayashi, A., and Yokoi, H., "Towards a Prosthetic Hand Controlled by Evolvable Hardware, in Proceedings of the World Congress on Medical Physics and Biomedical Engineering (D. Geiger and P. Aletti, eds.), p. 88, 48 rue de la Procession, 75015 Paris, France, 1997. Societe des Electriciens et Electroniciens.
20. Hoshino, T. and Tsuchida, M., "Manifestation of Neutral Genes in Evolving Robot Navigation," in Artificial Life V, Sciences of Complexity, Addison-Wesley, 1996.
21. Husbands, P., Harvey, I., Cliff, D., and Miller, G., "The Use of Genetic Algorithms for the Development of Sensorimotor Control Systems," in Proceedings of the Third European Conference on Artificial Life (F. Moran, A. Moreno, J. J. Merelo, and P. Chacon, eds.), Granada, Spain, 1995, Springer-Verlag, pp. 110-121, 1995.
22. Kaelbling, L. P., Learning in Embedded Systems, Bradford Book, MIT Press, Cambridge, 1993.
23. Kaelbling, L. P., "Associative Reinforcement Learning: A Generate and Test Algorithm," Machine Learning, 15, 3, pp. 299-320, 1994.
24. Kaelbling, L. P., "Associative Reinforcement Learning: Functions in k-dnf," Machine Learning, 15, 3, pp. 279-298, 1994.
25. Kaplan, S., "Perception of an Uncertain Environment," in Humanscape: Environments for People, Ann Arbor, MI: Ulrich's Books, 1982.
26. Koza, J., "Evolution of Subsumption Using Genetic Programming," in Proceedings of the First European Conference on Artificial Life (F. J. Varela and P. Bourgine, eds.), Cambridge, MA, 1992, MIT Press/Bradford Books, pp. 3-10, 1992.
27. Koza, J., Genetic Programming: On the Programming of Computers by Means of Natural Selection, MIT Press, 1992.
28. Lund, H. H. and Hallam, J., "Evolving Sufficient Robot Controllers," in Proceedings of the International Conference on Evolutionary Computation, Piscataway, NJ, 1997. IEEE, pp. 495-499, 1997.
29. Mahadevan, S., "Enhancing Transfer in Reinforcement Learning by Building Stochastic Models of Robot Actions," in Proceedings of the Ninth International Conference on Machine Learning, pp. 290-299, 1992.
30. Mataric, M. and Cliff, D., "Challenges in Evolving Controllers for Physical Robots," Robotics and Autonomous Systems, 19, 1, pp. 67-83, November 1996.
31. Miglino, O., Lund, H. H., and Nolfi, S., "Evolving Mobile Robile Robots in Simulated and Real Environments," Artificial Life, 2, 4, pp. 417-434, summer 1995.
32. Murakawa, M., Yoshizawa, S., Kajitani, I., and Higuchi, T., "Evolvable Hardware for Generalized Neural Networks," in Proc. of Fifteenth International Joint Conference on Artificial Intelligence (M. E. Pollack, ed.), Morgan Kaufmann Publishers, pp. 1146-1151, 1997.
33. Narendra, K. S. and Annaswamy, A. M., Stable Adaptive Sysyems, Prentice Hall, Englewood Cliffs, New Jersey, 1989.
34. Natarajan, B. K., Machine Learning: A Theoretical Approach, Morgan Kaufmann Publisher, 1991.
35. Parisi, D., Nolfi, S., and Cecconi, F., "Learning, Behavior and Evolution," in Proceedings of the First European Conference on Artificial Life, Cambridge, Ma, 1992, MIT Press/Bradford Books, pp. 207-216, 1992.
36. Pomerleau, D. A., "Neural Network Based Autonomous Navigation," in Vision and Navigation: The CMU Navlab, Kluwer Academic Publishers, Boston, MA, 1990.
37. Reynolds, C. W., "An Evolved, Vision-Based Model of Obstacle Avoidance Behavior," in Artificial Life III, Sciences of Complexity, Proc., XVII, Addison-Wesley, pp. 327-346, 1994.
38. Salami, M., Iwata, M., and Higuchi, T., "Lossless Image Compression by Evolvable Hardware," in Proceedings of the Fourth European Conference on Artificial Life, pp. 407-416, 1997.
39. Steels, L. and Brooks, R., eds., The Artificial Life Route to Artificial Intelligence: Building Embodied, Situated Agents, Lawrence Erlbaum Assoc., 1995.
40. Sutton, R. S., "Learning to Predict by the Method of Temporal Differences," Machine Learning, 3, 1, pp. 9-44, 1988.
41. Sutton, R. S., "Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming," in Proceedings of the Seventh International Conference on Machine Learning, pp. 216-224, 1990.
42. Sutton, R. S., "Special Issue on Reinforcement Learning," Machine Learning, 8, 3/4, 1992.
43. Thompson, A., "Evolving Electronic Robot Controllers That Exploit Hardware Resources," in Advances in Artificial Life: Proceedings 3rd European Conference on Artificial Life (F. Moran, A. Moreno, J. J. Merelo, and P. Chacon, eds.), Granada, Spain, 1995, Springer-Verlag, pp. 640-656, 1995.
44. Thrun, S., Explanation-Based Neural Network Learning: A Lifelong Learning Approach, Kluwer Academic Publishers, Boston, MA, 1996.
45. Uchibe, E., Asada, M., and Hosoda, K., "Behavior Coordination for a Mobile Robot Using Modular Reinforcement Learning," in Proceedings of IEEE|RSJ International Conference on Intelligent Robotics and Systems (IROS 96), IEEE Press, pp. 1329-1336, 1996.
46. Valiant, L. G., "A Theory of the Learnable," Communications of the ACM, 27, 11, pp. 1134-1142, 1984.
47. Villasenor, J. and Mangione-Smith, W. H., "Configurable Computing," Scientific American, pp. 66-71, 1997.
48. Watkins, C. J. C. H. and Dayan, P., "Q-Learning," Machine Learning, 8, 3, pp. 279-292, 1992.
49. Whitehead, S. D. and Ballard, D. H., "A Role for Anticipation in Reactive Systems That Learn," in Proceedings of the Sixth International Conference on Machine Learning, pp. 354-357, 1989.
50. Wilson, S., "Classifier Systems and the Animat Problem," Machine Learning, 2, pp. 199-228, 1987.
51. Xilinx Semiconductor Corporation, XC6200 Field Programmable Gate Arrays: Aduance Product Information v1.10, 1997. See http://www.xilinx.com.