A distributed and morphology-independent strategy for adaptive locomotion in self-reconfigurable modular robots

Robotics and Autonomous Systems

Volumn 61, Issue 9, 2013, Pages 1021-1035

  Christensen, David Johan ^a   Schultz, Ulrik Pagh ^b   Stoy, Kasper ^b  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

^b UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

Author keywords

Distributed control; Fault tolerance; Locomotion; Online learning; Self reconfigurable modular robots

Indexed keywords

ADAPTIVE LOCOMOTION; DISTRIBUTED CONTROL; DISTRIBUTED LEARNING; DISTRIBUTED REINFORCEMENT LEARNING; ONLINE LEARNING; RECONFIGURABILITY; RESOURCE REQUIREMENTS; SELF-RECONFIGURABLE MODULAR ROBOTS;

BIPED LOCOMOTION; FAULT TOLERANCE; LEARNING SYSTEMS; MORPHOLOGY;

MODULAR ROBOTS;

EID: 84880332035     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2013.05.009     Document Type: Article

References (83)

1. D.J. Christensen, M. Bordignon, U.P. Schultz, D. Shaikh, K. Stoy, Morphology independent learning in modular robots, in: Proceedings of International Symposium on Distributed Autonomous Robotic Systems 8, DARS 2008, April 2008, pp. 379-391.
2. D.J. Christensen, U.P. Schultz, K. Stoy, A distributed strategy for gait adaptation in modular robots, in: Proceedings of the IEEE International Conference on Robotics and Automation, ICRA2010, Anchorage, Alaska, May 2010, pp. 2765-2770.
3. T. Fukuda, S. Nakagawa, Dynamically reconfigurable robotic system, in: Proceedings of the IEEE International Conference on Robotics & Automation, ICRA'88, 1988, pp. 1581-1586.
4. T. Fukuda, S. Nakagawa, Y. Kawauchi, M. Buss, Self organizing robots based on cell structures - CEBOT, in: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS'88, 1988, pp. 145-150.
5. M. Yim, B. Shirmohammadi, D. Benelli, Amphibious modular robot astrobiologist, in: Proceedings of SPIE Unmanned Systems Technology IX, Vol. 656, April 2007.
6. K. Stoy, D. Brandt, and D.J. Christensen Self-Reconfigurable Robots: An Introduction Intelligent Robotics and Autonomous Agents Series 2010 The MIT Press
7. K. Gilpin, and D. Rus Modular robot systems IEEE Robotics & Automation Magazine 17 3 2010 38 55
8. S. Murata, and H. Kurokawa Self-Organizing Robots 2012 Springer
9. A. Castano, W.-M. Shen, and P. Will CONRO: towards deployable robots with inter-robot metamorphic capabilities Autonomous Robots 8 3 2000 309 324
10. M. Yim, New locomotion gaits, in: Proceedings, International Conference on Robotics & Automation, ICRA'94, San Diego, California, USA, 1994, pp. 2508-2514.
11. M. Yim, D. Duff, K. Roufas, Modular reconfigurable robots, an approach to urban search and rescue, in: Proceedings of 1st International Workshop on Human-friendly Welfare Robotics Systems, Taejon, Korea, 2000.
12. G. Chirikjian, Kinematics of a metamorphic robotic system, in: Proc. of IEEE Intl. Conf. on Robotics and Automation, 1994, pp. 449-455.
13. S. Murata, H. Kurokawa, S. Kokaji, Self-assembling machine, in: Proceedings of IEEE International Conference on Robotics and Automation, ICRA'94, 1994, pp. 441-448.
14. D. Rus, M. Vona, A physical implementation of the self-reconfiguring crystalline robot, in: Proceedings of the IEEE International Conference on Robotics and Automation, ICRA'00, Vol. 2, 2000, pp. 1726-1733.
15. K. Kotay, D. Rus, M. Vona, C. McGray, The self-reconfiguring robotic molecule, in: Proc., IEEE Int. Conf. on Robotics & Automation, ICRA'98, Leuven, Belgium, 1998, pp. 424-431.
16. H. Kurokawa, S. Murata, E. Yoshida, K. Tomita, S. Kokaji, A 3-d self-reconfigurable structure and experiments, in: Proceedings of the IEEE/RJS International Conference on Intelligent Robots and Systems, IROS'98, Vol. 2. Victoria, BC, Canada, 1998, pp. 860-665.
17. S. Murata, E. Yoshida, K. Tomita, H. Kurokawa, A. Kamimura, S. Kokaji, Hardware design of modular robotic system, in: Proceedings, IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS'00, Takamatsu, Japan, 2000, pp. 2210-2217.
18. H. Kurokawa, K. Tomita, A. Kamimura, S. Kokaji, T. Hasuo, and S. Murata Distributed self-reconfiguration of M-TRAN III modular robotic system International Journal of Robotics Research 27 3-4 2008 373 386
19. W.-M. Shen, M. Krivokon, H. Chiu, J. Everist, M. Rubenstein, and J. Venkatesh Multimode locomotion via superbot reconfigurable robots Autonomous Robots 20 2 2006 165 177
20. M. Yim, W.-M. Shen, B. Salemi, D. Rus, M. Moll, H. Lipson, and E. Klavins Modular self-reconfigurable robot systems: challenges and opportunities for the future IEEE Robotics & Automation Magazine 14 1 2007 43 52
21. A. Sproewitz, S. Pouya, S. Bonardi, J. van den Kieboom, R. Mockel, A. Billard, P. Dillenbourg, and A. Ijspeert Roombots: reconfigurable robots for adaptive furniture IEEE Computational Intelligence Magazine 5 3 2010 20 32 Special issue on Evolutionary and Developmental Approaches to Robotics
22. E.H. Stergaard, K. Kassow, R. Beck, and H.H. Lund Design of the ATRON lattice-based self-reconfigurable robot Autonomous Robots 21 2006 165 183
23. S. Kernbach, E. Meister, O. Scholz, R. Humza, J. Liedke, L. Ricotti, J. Jemai, J. Havlik, and W. Liu Evolutionary robotics: the next-generation-platform for on-line and on-board artificial evolution IEEE Congress on Evolutionary Computation, 2009 CEC'09 2009 IEEE 1079 1086
24. H. Wei, Y. Chen, J. Tan, and T. Wang Sambot: a self-assembly modular robot system IEEE/ASME Transactions on Mechatronics 16 4 2011 745 757
25. J. Zhao, X. Cui, Y. Zhu, and S. Tang A new self-reconfigurable modular robotic system UBot: multi-mode locomotion and self-reconfiguration 2011 IEEE International Conference on Robotics and Automation ICRA 2011 IEEE 1020 1025
26. Y. Meng, Y. Zhang, A. Sampath, Y. Jin, and B. Sendhoff Cross-ball: a new morphogenetic self-reconfigurable modular robot 2011 IEEE International Conference on Robotics and Automation ICRA 2011 IEEE 267 272
27. J. Davey, N. Kwok, M. Yim, Emulating self-reconfigurable robots - design of the SMORES system, in: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, October 2012, pp. 4464-4469.
28. M. Yim, A reconfigurable modular robot with many modes of locomotion, Proceedings of the JSME International Conference on Advanced Mechatronics, Tokyo, Japan, 1993, 283-288
29. H. Kurokawa, A. Kamimura, E. Yoshida, K. Tomita, S. Kokaji, S. Murata, M-TRAN II: metamorphosis from a four-legged walker to a caterpillar, in: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, 2003, pp. 2454-2459.
30. M. Yim, Locomotion with a unit-modular reconfigurable robot. Ph.D. Thesis, Department of Mechanical Engineering, Stanford University, 1994.
31. W.-M. Shen, B. Salemi, P. Will, Hormones for self-reconfigurable robots, Proc., Int. Conf. on Intelligent Autonomous Systems, IAS-6, Venice, Italy, 2000, 918-925.
32. W.-M. Shen, B. Salemi, and P. Will Hormone-inspired adaptive communication and distributed control for CONRO self-reconfigurable robots IEEE Transactions on Robotics and Automation 18 2002 700 712
33. K. Stoy, W.-M. Shen, and P. Will Using role based control to produce locomotion in chain-type self-reconfigurable robots IEEE Transactions on Mechatronics 7 4 2002 410 417
34. K. Støy, W.-M. Shen, P. Will, Implementing configuration dependent gaits in a self-reconfigurable robot, in: Proc., IEEE Int. Conf. on Robotics and Automation, ICRA'03, Taipei, Taiwan, 2003.
35. M. Yim, D. Duff, Y. Zhang, Closed chain motion with large mechanical advantage, in: Proceedings, IEEE/RSJ International Conference on Intelligent Robots and Systems, Maui, Hawaii, USA, 2001, pp. 318-323.
36. M. Yim, S. Homans, K. Roufas, Climbing with snake-like robots, in: Proceedings of IFAC Workshop on Mobile Robot Technology, Jejudo, Korea, 2001.
37. Y. Zhang, M. Yim, C. Eldershaw, D. Duff, K. Roufas, Phase automata: a programming model of locomotion gaits for scalable chain-type modular robots, in: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS'03, Las Vegas, Nevada, USA, 2003, pp. 2442-2447.
38. A.J. Ijspeert Central pattern generators for locomotion control in animals and robots: a review Neural Networks 21 4 2008 642 653
39. A. Kamimura, H. Kurokawa, E. Yoshida, K. Tomita, S. Murata, S. Kokaji, Automatic locomotion pattern generation for modular robots, in: IEEE International Conference on Robotics and Automation, ICRA, 2003, pp. 714-720.
40. A. Kamimura, H. Kurokawa, E. Yoshida, S. Murata, K. Tomita, and S. Kokaji Automatic locomotion design and experiments for a modular robotic system IEEE/ASME Transactions on Mechatronics 10 3 2005 314 325
41. D. Marbach, A.J. Ijspeert, Online optimization of modular robot locomotion, in: Proceedings of the IEEE Int. Conference on Mechatronics and Automation, ICMA 2005, 2005, pp. 248-253.
42. D.J. Christensen, J. Campbell, and K. Stoy Anatomy-based organization of morphology and control in self-reconfigurable modular robots Neural Computing and Applications (NCA) 19 6 2010 787 805
43. R. Moreno, and J. Gomez Central pattern generators and hormone inspired messages: a hybrid control strategy to implement motor primitives on chain type modular reconfigurable robots ICRA 2011 IEEE 1014 1019
44. Z. Butler, D. Rus, Distributed locomotion algorithms for self-reconfigurable robots operating on rough terrain, in: Proceedings of IEEE International Symposium on Computational Intelligence in Robotics and Automation, CIRA'03, 2003 pp. 880-885.
45. R. Fitch, and Z. Butler Million module march: scalable locomotion for large self-reconfiguring robots International Journal of Robotics Research 27 2008 331 343
46. P. Varshavskaya, L. Kaelbling, and D. Rus Automated design of adaptive controllers for modular robots using reinforcement learning International Journal of Robotics Research 27 3-4 2008 505 526 Special issue on Self-Reconfigurable Modular Robots
47. E.H. Stergaard, and H.H. Lund Distributed cluster walk for the ATRON self-reconfigurable robot Proceedings of the 8th Conference on Intelligent Autonomous Systems IAS-8 2004 Holland Amsterdam 291 298
48. E. Yoshida, S. Murata, A. Kamimura, K. Tomita, H. Kurokawa, and S. Kokaji A self-reconfigurable modular robot: reconfiguration planning and experiments The International Journal of Robotics Research 21 10 2002 903 916
49. E. Yoshida, S. Murata, A. Kamimura, K. Tomita, H. Kurokawa, S. Kokaji, A motion planning method for a self-reconfigurable modular robot, in: Proceedings, IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS'01, Maui, Hawaii, USA, 2001, pp. 590-597.
50. A. Ishiguro, M. Shimizu, T. Kawakatsu, Don't try to control everything!: an emergent morphology control of a modular robot, in: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, 2004, pp. 981-985.
51. K. Sims Evolving 3D morphology and behavior by competition R. Brooks, P. Maes, Proc., Artificial Life IV 1994 MIT Press 28 39
52. H. Lipson, and J.B. Pollack Automatic design and manufacture of robotic lifeforms Nature 406 2000 974 978
53. D. Marbach, and A.J. Ijspeert Co-evolution of configuration and control for homogenous modular robots Proc., 8th Int. Conf. on Intelligent Autonomous Systems 2004 Holland Amsterdam 712 719
54. E. Yoshida, S. Murata, A. Kamimura, K. Tomita, H. Kurokawa, S. Kokaji, Evolutionary synthesis of dynamic motion and reconfiguration process for a modular robot M-TRAN, in: Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation, CIRA, Kobe, Japan, 2003, pp. 1004-1010.
55. M.D. Handier, and G.S. Hornby Evolving quadruped gaits with a heterogeneous modular robotic system Proceedings of the IEEE Congress on Evolutionary Computation 2007 IEEE 3631 3638
56. S. Pouya, J. van den Kieboom, A. Spröwitz, A.J. Ijspeert, Automatic gait generation in modular robots: "to oscillate or to rotate; that is the question", in: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. Taipei, Taiwan, 2010, pp. 514-520.
57. E. Haasdijk, A. Rusu, and A. Eiben Hyperneat for locomotion control in modular robots Evolvable Systems: From Biology to Hardware 2010 169 180
58. H. Hamann, J. Stradner, T. Schmickl, and K. Crailsheim A hormone-based controller for evolutionary multi-modular robotics: from single modules to gait learning 2010 IEEE Congress on Evolutionary Computation CEC 2010 IEEE 1 8
59. P. Zahadat, T. Schmickl, and K. Crailsheim Evolving reactive controller for a modular robot: benefits of the property of state-switching in fractal gene regulatory networks From Animals to Animats 12 2012 209 218
60. A. Brunete, M. Hernando, and E. Gambao Offline ga-based optimization for heterogeneous modular multiconfigurable chained microrobots IEEE/ASME Transactions on Mechatronics 18 2 2013 578 585
61. A. Faíña, F. Bellas, D. Souto, and R. Duro Towards an evolutionary design of modular robots for industry Foundations on Natural and Artificial Computation 2011 50 59
62. J.C. Bongard, and R. Pfeifer Evolving complete agents using artificial ontogeny Morpho-functional Machines: The New Species 2003 Springer 237 258
63. M. Mataric, and D. Cliff Challenges in evolving controllers for physical robots Robotics and Autonomous Systems 19 1 1996 67 83
64. G. Hornby, S. Takamura, J. Yokono, O. Hanagata, T. Yamamoto, M. Fujita, Evolving robust gaits with aibo, in: Proceedings of the IEEE International Conference on Robotics and Automation, 2000, pp. 3040-3045.
65. S.H. Mahdavi, and P.J. Bentley An evolutionary approach to damage recovery of robot motion with muscles Seventh European Conference on Artificial Life ECAL03 2003 Springer 248 255
66. V. Zykov, J. Bongard, H. Lipson, Evolving dynamic gaits on a physical robot, in: Proceedings of Genetic and Evolutionary Computation Conference, Late Breaking Paper, GECCO'04, 2004.
67. A. Sproewitz, R. Moeckel, J. Maye, and A.J. Ijspeert Learning to move in modular robots using central pattern generators and online optimization International Journal of Robotics Research 27 3-4 2008 423 443
68. P. Maes, R.A. Brooks, Learning to coordinate behaviors, in: National Conference on Artificial Intelligence, 1990, pp. 796-802.
69. M.J. Mataric Reinforcement learning in the multi-robot domain Autonomous Robots 4 1 1997 73 83
70. J. Bongard, V. Zykov, and H. Lipson Resilient machines through continuous self-modeling Science 314 5802 2006 1118 1121
71. D.J. Christensen, A. Sproewitz, A.J. Ijspeert, Distributed online learning of central pattern generators in modular robots, in: Proceedings of the 11th International Conference on Simulation of Adaptive Behavior, SAB2010, Paris, France, August 2010, pp. 402-412.
72. D.J. Christensen, J.C. Larsen, K. Stoy, Adaptive strategy for online gait learning evaluated on the polymorphic robotic locokit, in: Proceedings of the IEEE Conference on Evolving and Adaptive Intelligent Systems, EAIS, 2012.
73. R. Sutton, and A. Barto Reinforcement Learning - An Introduction 1998 The MIT Press
74. D. Brandt, D.J. Christensen, A new meta-module for controlling large sheets of ATRON modules, in: Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, California, November 2007, pp. 2375-2380.
75. D.J. Christensen, Evolution of shape-changing and self-repairing control for the ATRON self-reconfigurable robot, in: Proceedings of the IEEE International Conference on Robotics and Automation, ICRA'06, Orlando, Florida, 2006, pp. 2539-2545.
76. D.J. Christensen, U.P. Schultz, D. Brandt, K. Stoy, A unified simulator for self-reconfigurable robots, in: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, 2008, pp. 870-876.
77. R. Smith, Open dynamics engine, 2005. www.ode.org.
78. J. Morimoto, and K. Doya Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning Robotics and Autonomous Systems 36 1 2001 37 51
79. D.J. Christensen, Experiments on fault-tolerant self-reconfiguration and emergent self-repair, in: Proceedings of Symposium on Artificial Life part of the IEEE Symposium Series on Computational Intelligence. Honolulu, Hawaii, April 2007, pp. 355-361.
80. U.P. Schultz, M. Bordignon, and K. Stoy Robust and reversible execution of self-reconfiguration sequences Robotica 29 1 2011 35 57
81. D.H. Wolpert, and W.G. Macready No free lunch theorems for optimization IEEE Transactions on Evolutionary Computation 1 1 1997 67 82
82. R.A. Brooks, Artificial life and real robots, in: Toward a Practice of Autonomous Systems: Proceedings of the First European Conference on Artificial Life, Cambridge, MA, USA, 1992, pp. 3-10.
83. P. Varshavskaya, L.P. Kaelbling, D. Rus, Learning distributed control for modular robots, in: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, 2004, IROS, Vol. 3, 2004, pp. 2648-2653.