Machine learning with AIBO robots in the four-legged league of RoboCup

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 37, Issue 3, 2007, Pages 297-310

  Chalup, Stephan K ^a   Murch, Craig L ^a,b   Quinlan, Michael J ^a  

^a UNIVERSITY OF NEWCASTLE   (Australia)

^b Computer Science Corporation ^*  (Australia)

Author keywords

Learning systems; Legged locomotion; Machine learning; RoboCup; Robot soccer; Robot vision systems; Sony AIBO

Indexed keywords

COMPUTER SOFTWARE; COMPUTER VISION; DECISION TREES; EVOLUTIONARY ALGORITHMS; ROBOTICS; SUPPORT VECTOR MACHINES;

EVOLUTIONARY HILL CLIMBING; LEGGED LOCOMOTION;

ROBOT LEARNING;

EID: 34247201952     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2006.886964     Document Type: Article

References (126)

1. Sony Corp. (2005, Oct. 21). [Online]. Available: http://www.sony.net/ Products/aibo/
2. Federation of International Robosoccer Association (FIRA). (2005, Jun. 1). [Online]. Available: http://www.fira.net/
3. RoboCup. (2005, Jun. 1). [Online]. Available: http://www.robocup.org/
4. RoboCup Special Interest Group (SIG) on Multiagent Learning. (2005, Oct. 21). RoboCup special interest group (SIG) on multiagent learning. [Online]. Available: http://sserver.sourceforge.net/SIG-learn/
5. H. L. Akin, M. K. Baloǧlu, H. K. Baǧci, S. Bayhan, C. Meriçli, D. Poslu, O. Sever, O. T. Yildiz, S. Argirov, B. Marinov, P. Pavlova, N. Shakev, J. Tombakov, and A. Topalov, "Cerberus 2003 team report," Boǧaziçi Univ., Istanbul, Turkey, and Tech. Univ. Sofia, Sofia, Bulgaria, Tech. Rep., 2003.
6. H. Akin, A. Topalov, and O. Kaynak, "Cerberus 2001 team description," in Lecture Notes in Computer Science, vol. 2377, A. Birk, S. Coradeschi, and S. Tadokoro, Eds. New York: Springer-Verlag, 2002, pp. 689-692.
7. S. Anderson, K. Croaker, J. Dockter, V. Estivill-Castro, J. Fenwick, N. Lovell, and S. Seymon, "MiPAL team Griffith - Summary of our technology and implementation," Griffith Univ., Brisbane, Australia, Tech. Rep., 2003.
8. M. Asada and H. Kitano, Eds., "RoboCup-1998: Robot Soccer World Cup II," in Lecture Notes in Computer Science, vol. 1604, New York: Springer-Verlag, 1999.
9. T. Bäck, D. B. Fogel, and Z. Michalewicz, Eds., Handbook of Evolutionary Computation. Bristol, U.K: Inst. of Physics and New York: Oxford Univ. Press, 1997.
10. A. G. Barto, R. S. Sutton, and C. W. Anderson, "Neuron-like adaptive elements that can solve difficult learning control problems," IEEE Trans. Syst., Man, Cybern., vol. SMC-13, no. 5, pp. 834-846, Sep. 1983.
11. D. Bertsekas and J. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996.
12. A. Birk, S. Coradeschi, and S. Tadokoro, Eds., "RoboCup-2001: Robot Soccer World Cup V," in Lecture Notes in Computer Science, vol. 2377. New York: Springer-Verlag, 2002.
13. B. E. Boser, I. M. Guyon, and V. N. Vapnik, "A training algorithm for optimal margin classifiers," in Proc. 5th Annu. ACM Workshop Comput. Learn. Theory, D. Haussler, Ed. Pittsburgh, PA, Jul. 1992, pp. 144-152.
14. M. Bowling, B. Browning, A. Chang, and M. Veloso, "Plays as team plans for coordination and adaptation," presented at the IJCAI Workshop Issues Design. Phys. Agents Dyn. Real-Time Environ.: World Modeling, Plan., Learn., Commun., Acapulco, Mexico, 2003.
15. M. Bowling and M. Veloso, "Simultaneous adversarial multi-robot learning," in Proc. 18th Int. Joint Conf. Artif. Intell., Acapulco, Mexico, 2003, pp. 699-704.
16. J. Bruce, T. Balch, and M. Veloso, "Fast and inexpensive color image segmentation for interactive robots," in Proc. 2000 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS-2000), vol. 3, Oct., pp. 2061-2066.
17. G. Buskey, J. Roberts, and G. Wyeth, "A helicopter named Dolly - Behavioural cloning for autonomous helicopter control," presented at the Australas. Conf. Robot. Autom., W. Friedrich and P. Lim, Eds., Aukland, Norway, 2002, 2002.
18. S. K. Chalup and C. L. Murch, "Machine learning in the four-legged league," presented at the 3rd IFAC Symp. Mechatron. Syst., Sydney, Australia, Sep. 6-8, 2004.
19. S. Chan, M. Sio, T. Volgelgesang, T. F. Yik, B. Hengst, S. B. Pham, and C. Sammut, "The UNSW RoboCup 2001 Sony Legged Robot League Team," in Lecture Notes in Computer Science, vol. 2377, A. Birk, S. Coradeschi, and S. Tadokoro, Eds. New York: Springer-Verlag: Springer-Verlag, 2002, pp. 39-45.
20. J. Chen, E. Chung, R. Edwards, N. Wong, B. Hengst, C. Sammut, and W. Uther, "Rise of the AIBOS III - AIBO revolutions," Univ. New South Wales, Sydney, Australia, Tech. Rep., 2003.
21. S. Chernova and M. Veloso, "An evolutionary approach to gait learning for four-legged robots," in Proc. 2004 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS-2004), pp. 2562-2567.
22. J. Connell and S. Mahadevan, Eds., Robot Learning. Norwell, MA: Kluwer, 1993.
23. C. Cortes and V. Vapnik, "Support vector networks,: Mach. Learn., vol. 20, pp. 273-297, 1995.
24. Z. Crisman, E. Curre, C. Kwok, L. Meyers, N. Ratliff, L. Tsybert, and D. Fox, "Team description: UW Huskies-02," in Lecture Notes in Computer Science, vol. 2752, G. A. Kaminka, P. U. Lima, and R. Rojas, Eds. New York: Springer-Verlag, 2002.
25. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines. Cambridge, U.K.: Cambridge Univ. Press, 2000.
26. I. Dahm and J. Ziegler, "Adaptive methods to improve self-localization in robot soccer," in Lecture Notes in Computer Science, vol. 2752, G. A. Kaminka, P. U. Lima, and R. Rojas, Eds. New York: Springer-Verlag: Springer-Verlag, 2002, pp. 393-408.
27. J. Dalgliesh and M. Lawther, "Playing soccer with quadruped robots," Comput. Eng. thesis, Sch. Comput. Sci. Eng., Univ. New South Wales, Sydney, Australia, 1999.
28. J. Demiris and A. Birk, Eds., Interdisciplinary Approaches to Robot Learning. Singapore: World Scientific, 2000.
29. M. Dorigo, Ιntroduction to the special issue on learning autonomous robots," IEEE Trans. Syt., Man, Cybern., vol. 26, no. 3, pp. 361-364, Jun. 1996.
30. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. Hoboken, NJ: Wiley, 1973.
31. P. Fidelman and P. Stone, "Learning ball acquisition on a physical robot," presented at the Int. Symp. Robot. Autom. (ISRA), Queretaro, Mexico, Aug. 2004.
32. J. Franklin, T. Mitchell, and S. Thrun, "Robot learning," Mach. Learn. J., vol. 23, no. 2/3, 1996.
33. M. Fujita, "AIBO: Toward the era of digital creatures," Int. J. Robot. Res., vol. 20, pp. 781-794, 2001.
34. M. Fujita "On activating human communications with pet-type robot AIBO," Proc. IEEE, vol. 92, no. 11, pp. 1804-1813, Nov. 2004.
35. M. Fujita and K. Kageyama, "An open architecture for robot entertainment," in Proc. 1st Int. Conf. Autonom. Agents, 1997, pp. 435-442.
36. M. Fujita and H. Kitano, "Development of an autonomous quadruped robot for robot entertainment," Autonom. Robots, vol. 5, no. 1, pp. 7-18, 1998.
37. T. Fukase, Y. Kobayashi, R. Ueda, T. Kawabe, and T. Arai, "Real-time decision making under uncertainty of self-localisation results," in Lecture Notes in Computer Science, vol. 2752, G. A. Kaminka, P. U. Lima, and R. Rojas, Eds. New York: Springer-Verlag: Springer-Verlag, vol. 2752, 2002, pp. 375-383.
38. D. Golubovic and H. Hu, "A hybrid evolutionary algorithm for gait generation of Sony legged robots," in Proc. 28th Annu. Conf. IEEE Ind. Electron. Soc., Sevilla, Spain, Nov. 5-8, 2002, pp. 2593-2598.
39. D. Gu and H. Hu, "Evolving fuzzy logic controllers for sony legged robots," in Lecture Notes in Computer Science, vol. 2377, A. Birk, S. Coradeschi, and S. Tadokoro, Eds. New York: Springer-Verlag: Springer-Verlag, 2002, pp. 356-361.
40. D. Gu and H. Hu, "Reinforcement learning of fuzzy logic controller for quadruped walking robots," presented at the 15th IFAC World Congr., Barcelona, Spain, Jul. 21-26, 2002.
41. D. Gu, H. Hu, J. Reynolds, and E. Tsang, "GA-based learning in behaviour based robotics," in Proc. IEEE Int. Symp. Comput. Intell. Robot. Autom., vol. 3, Kobe, Japan, Jul. 16-20, 2003, pp. 1521-1526.
42. J.-S. Gutmann and D. Fox, "An experimental comparison of localization methods continued," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2002, pp. 454-459.
43. V. V. Hafner and F. Kaplan, "Learning to interpret pointing gestures: Experiments with four-legged autonomous robots," in Proc. NeuroBotics Workshop, G. Palm and S. Wermter, Eds., 2004, pp. 225-234.
44. M. Hardt and O. von Stryk, "The role of motion dynamics in the design, control and stability of bipedal and quadrupedal robots," in Lecture Notes in Computer Science, vol. 2752, G. A. Kaminka, P. U. Lima, and R. Rojas, Eds. New York: Springer-Verlag: Springer-Verlag, 2002, pp. 206-223.
45. B. Hengst, D. Ibbotson, S. B. Pham, J. Dalgliesh, M. Lawther, P. Preston, and C. Sammut, "The UNSW robocup 2000 Sony legged league team," in Lecture Notes in Computer Science, vol. 2019, P. Stone, T. Balch, and G. Kraetzschmar, Eds. New York: Springer-Verlag: Springer-Verlag, 2001, pp. 64-75.
46. B. Hengst, S. Pham, D. Ibbotson, and C. Sammut, "Omnidirectional locomotion for quadruped robots," in Lecture Notes in Computer Science, vol. 2377, A. Birk, S. Coradeschi, and S. Tadokoro, Eds. New York: Springer-Verlag: Springer-Verlag, 2002, pp. 368-373.
47. G. S. Homby, M. Fujita, S. Takamura, T. Yamamoto, and O. Hanagata, "Autonomous evolution of gaits with the Sony quadruped robot," in Proc. 1999 Genetic Evol. Comput. Conf. (GECCO), vol. 2, W. Banzhaf, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela, and R. E. Smith, Eds. San Mateo, CA: Morgan Kaufmann, 1999, pp. 1297-1304.
48. G. S. Homby, S. Takamura, J. Yokono, O. Hanagata, T. Yamamoto, and M. Fujita, "Evolving robust gaits with AIBO," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA-2000), pp. 3040-3045.
49. H. Hu, D. Gu, D. Golubovic, B. Li, and Z. Lio, "Essex Rovers 2001 team description," in Lecture Notes in Computer Science, vol. 2377, A. Birk, S. Coradeschi, and S. Tadokoro, Eds. New York: Springer-Verlag: Springer-Verlag, 2002, pp. 697-700.
50. H. Hu and D. Gu, "A multi-agent system for cooperative quadruped walking robots," presented at the IASTED Int. Conf. Robot. Appl., Honolulu, HI, Aug. 14-16, 2000.
51. H. Hu and D. Gu, "Reactive behaviours and agent architecture for Sony legged robots to play football," Int. J. Indus. Robot, vol. 28, no. 1, pp. 45-53, Jan. 2001.
52. J. Inoue, H. Aoyama, A. Ishino, and A. Shinohara. (2004). Jolly pochie 2004 in the four legged robot league. Dept. Inf., Kyushu Univ. 33, Fukuoka, Japan, Tech. Rep. [Online]. Available: http://www.i.kyushu-u.ac.jp/JollyPochie/
53. A. Isaac and C. Sammut, "Goal-directed learning to fly," in Proc. 20th Int. Conf. Mach. Learn., T. Fawcett and N. Mishra, Eds., Washington, DC, 2003, pp. 258-265.
54. G. A. Kaminka, P. U. Lima, and R. Rojas, Ed., "RoboCup-2002: Robot Soccer World Cup VI," in Lecture Notes in Computer Science, vol. 2752. New York: Springer-Verlag, 2003.
55. F. Kaplan and P.-Y. Oudeyer, "Motivational principles for visual know-how development," in Proc. 3rd Epigenetic Robot. Workshop: Modeling Cogn. Dev. Robot. Syst. vol. 101, C. Prince, L. Berthouze, H. Kozima, D. Bullock, G. Stojanov, and C. Balkenius, Eds., ser. Lund University Cognitive Studies Series, pp. 72-80, 2003.
56. F. Kaplan, P.-Y. Oudeyer, E. Kubinyi, and A. Miklosa, "Robotic clicker training," Robot. Autonom. Syst., vol. 38, no. 3/4, pp. 197-206, 2002.
57. M. S. Kim and W. Uther, "Automatic gait optimisation for quadruped robots," in Australasian Conf. Robot. Autom. (ACRA'2003), pp. 1-9.
58. H. Kitano, Ed., "RoboCup-1997: Robot Soccer World Cup I," in Lecture Notes in Computer Science, vol. 1395. New York: Springer-Verlag, 1998.
59. H. Kitano, M. Fujita, S. Zrehen, and K. Kageyama, "Sony legged robot for RoboCup challenge," in Proc. 1998 IEEE Int. Conf. Robot. Autom., vol. 3, May 16-20, pp. 2605-2612.
60. H. Kitano, M. Asada, Y. Kuniyoshi, I. Noda, E. Osawa, and H. Matsubara, "RoboCup: A challenge problem for AI and robotics," in Lecture Notes in Computer Science, vol. 1395, H. Kitano, Ed. New York: Springer-Verlag, 1997.
61. H. Kitano M. Asada, Y. Kuniyoshi, I. Noda, E. Osawa, and H. Matsubara, "RoboCup: A challenge problem for AI," AI Mag., vol. 18, no. 1, pp. 73-85, 1997.
62. A. Kleiner, M. Dietl, and B. Nebel, "Towards a life-long learning soccer agent," in Lecture Notes in Computer Science, vol. 2752, G. A. Kaminka, P. U. Lima, and R. Rojas, Eds. New York: Springer-Verlag, 2002.
63. Y. Kobayashi and H. Yuasa, "Team ARAIBO," in Lecture Notes in Computer Science, vol. 1856, M. Veloso, E. Pagello, and H. Kitano, Eds. New York: Springer-Verlag, 2000, pp. 758-761.
64. N. Kohl and P. Stone, "Machine learning for fast quadrupedal locomotion," in Proc. 19th Nat. Conf. Artif. Intell., 2004, pp. 611-616.
65. N. Kohl "Policy gradient reinforcement learning for fast quadrupedal locomotion," in IEEE Int. Conf. Robot. Autom., 2004, pp. 2619-2624.
66. C. Kwok and D. Fox, "Map-Based Multi Model Tracking of a Moving Object," in Lecture Notes in Computer Science, vol. 3276, D. Nardi, M. Riedmiller, C. Sammut, and J. Santos-Victor, Eds. New York: Springer-Verlag, 2004.
67. C. Kwok and D. Fox, "Reinforcement learning for sensing strategies," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Systems (IROS-04), 2004, pp. 3158-3163.
68. M. Lawther and J. Dalgliesh, "UNSW United," in Lecture Notes in Computer Science, vol. 1856, M. Veloso, E. Pagello, and H. Kitano, Eds. New York: Springer-Verlag, 2000, pp. 788-791.
69. D. D. Lee and H. S. Seung, "Biologically inspired computation and learning in sensorimotor systems," in Proc. SPIE. Applications and Science of Neural Networks, Fuzzy Systems, and Evolutionary Computation IV, vol. 4479, B. Bosacchi, D. B. Fogel, and J. C. Bezdek, Eds. 2001, pp. 4-11.
70. B. Li, H. Hu, and L. Spacek, "An adaptive color segmentation algorithm for Sony legged robots," in Proc. 21st IASTED Int. Conf. Appl. Inform., Insbruck, Austria, Feb. 1-13, 2003, pp. 126-131.
71. S. Mahadevan, "Machine learning for robots: A comparison of different paradigms," in Proc. Workshop Towards Real Autonomy, IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS-96), 1996.
72. G. Marceau, "The McGill's red dogs legged league system," in Lecture Notes in Computer Science, vol. 2019, P. Stone, T. Balch, and G. Kraetzschmar, Eds. New York: Springer-Verlag, 2001, pp. 627-630.
73. M. Mataric and D. Cliff, "Challenges in evolving controllers for physical robots," Robot. Auton. Syst., vol. 19, no. 1, pp. 67-83, 1996.
74. R. H. Middleton, M. Freeston, and L. McNeill, "An application of the extended Kalman fifter to robot soccer localisation and world modelling," presented at the IFAC Symp. Mechatron. Syst., Sydney, Australia, 2004.
75. M. Mitchell, An Introduction to Genetic Algorithms. Cambridge, MA: MIT Press, 1996.
76. T. Mitchell, Machine Learning. New York: McGraw Hill, 1997.
77. M. Mitsunaga and M. Asada, "Observation strategy for decision making based on information criterion," in Lecture Notes in Computer Science, vol. 2019, P. Stone, T. Balch, and G. Kraetzschmar, Eds. New York: Springer-Verlag, 2001, pp. 189-198.
78. M. Mitsunaga "Visual attention control by sensor space segmentation for a small quadruped robot based on information criterion," in Lecture Notes in Computer Science, vol. 2377, A. Birk, S. Coradeschi, and S. Tadokoro, Eds. New York: Springer-Verlag, 2002, pp. 154-163.
79. N. Mitsunaga, Y. Nagai, T. Ishida, T. Izumi, and M. Asada, "Baby Tigers 2001: Osaka Legged Robot Team," in Lecture Notes in Computer Science, vol. 2377, A. Birk, S. Coradeschi, and S. Tadokoro, Eds. New York: Springer-Verlag, 2002, pp. 685-688.
80. N. Mitsunaga and M. Asada, "Baby Tigers 1999: Osaka Legged Robot Team," in Lecture Notes in Computer Science, vol. 1856, M. Veloso, E. Pagello, and H. Kitano, Eds. New York: Springer-Verlag, 2000, pp. 762-765.
81. C. L. Murch, " Dimensionality reduction on AIBO robots," Honours thesis, School Elect. Eng. Comput. Sci., Univ. Newcastle, Newcastle, Australia, Nov. 2004.
82. D. Nardi, M. Riedmiller, C. Sammut, and J. Santos-Victor, Eds., "RoboCup-2004: Robot Soccer World Cup VIII" in Lecture Notes in Computer Science, vol. 3276. New York: Springer-Verlag, 2005.
83. A. Y. Ng, H. J. Kim, M. I. Jordan, and S. Sastry, " Autonomous helicopter flight via reinforcement learning," in Advances in Neural Information Processing Systems 16, S. Thrun, L. Saul, and B. Schölkopf, Eds. Cambridge, MA: MIT Press, 2003.
84. NIPS Conference. Advances in neural information processing systems. Cambridge, MA: MIT Press, Jun. 1998. [Online]. Available: http://nips.cc
85. X. Olivares, J. Ruiz-del-Solar, and J. C. Zagal, "Online learning of an object manipulation behaviour for legged robots," in Proc. 1st IEEE Latin Amer. Robot. Symp. (LARS), Mexico City, Mexico, Oct. 28-29, 2004, pp. 42-47.
86. P.-Y. Oudeyer and F. Kaplan, "Intelligent adaptive curiosity: A source of self-development," presented at the 4th Epigenetic Robot. Workshop, Genoa, Italy, 2004.
87. P.-Y. Oudeyer, F. Kaplan, V. Hafner, and A. Whyte, "The playground experiment: Task-independent development of a curious robot," in Proc. AAAI Spring Symp. Workshop Dev. Robot., 2005, pp. 42-47.
88. S. Pham, B. Hengst, D. Ibbotson, and C. Sammut, "Stochastic gradient descent localisation in quadruped robots," in Lecture Notes in Computer Science, vol. 2377, A. Birk, S. Coradeschi, and S. Tadokoro, Eds. New York: Springer-Verlag, 2002, pp. 447-452.
89. T. Poggio and S. Smale, "The mathematics of learning: Dealing with data," Notices Amer. Math. Soc., vol. 50, no. 5, pp. 537-544, 2003.
90. D. Polani, B. Browning, A. Bonarini, and K. Yoshida, Eds., "RoboCup 2003: Robot Soccer World Cup VII," in Lecture Notes in Computer Science, vol. 3020. New York: Springer-Verlag, 2004.
91. W. Press, S. Teukolsky, W. T. Vetterling, and B. Flannery, Numerical Recipes in C: The Art of Scientific Computing, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 1995.
92. F. K. H. Quek, "An algorithm for the rapid computation of boundaries of run-length encoded regions," Pattern Recognit. J., vol. 33, no. 10, pp. 1637-1649, Oct. 2000.
93. J. R. Quinlan, "Discovering rules from large collections of examples: A case study" in Expert Systems in the Microelectronic Age, D. Michie, Ed. Edinburgh, Scotland: University Press, 1979.
94. J. R. Quinlan, C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann, 1993.
95. M. J. Quinlan, C. Murch, R. H. Middleton, and S. K. Chalup, "Traction monitoring for collision detection with legged robots," in Lecture Notes in Artificial Intelligence, vol. 3020, D. Polani, B. Browning, A. Bonarini, and K. Yoshida, Eds., New York: Springer-Verlag, 2004.
96. M. J. Quinlan, S. K. Chalup, and R. H. Middleton, "Techniques for improving vision and locomotion on the Sony AIBO robot," presented at the Australas. Conf. Robot. Autom. (ACRA'2003), Brisbane, Australia.
97. M. J. Quinlan, S. K. Chalup, and R. H. Middleton, "Application of SVMs for colour classification and collision detection with AIBO robots," in Advances in Neural Information Processing Systems 16 (NIPS'2003), S. Thrun, L. Saul, and B. Schölkopf, Eds. Cambridge, MA: MIT Press, 2004.
98. M. Riedmiller and A. Merke, "Using machine learning techniques in complex multi-agent domains," in Perspectives on Adaptivity and Learning, Lecture Notes in Computer Science, I. Stamatescu, W. Menzel, M. Richter, and U. Ratsch, Eds. New York: Springer-Verlag, 2002.
99. T. Röfer, "Evolutionary gait-optimization using a fitness function based on proprioception," in Lecture Notes in Computer Science, vol. 3276, D. Nardi, M. Riedmiller, C. Sammut, and J. Santos-Victor, Eds. New York: Springer-Verlag, 2004.
100. C. Sammut, "Robot soccer: Science or just fun and games?," in Proc. Adv. Artif. Intell. 16th Australian Conf. AI (AI 2003), Lecture Notes in Artificial Intelligence, vol. 2903, T. D. Gedeon and L. C. C. Fung, Eds., pp. 12-23.
101. B. Schölkopf and A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA: MIT Press, 2002.
102. B. Schölkopf, J. C. Platt, J. Shawe-Taylor, A. J. Smola, and R. C. Williamson, "Estimating the support of a high-dimensional distribution," Neural Comput., vol. 13, pp. 1443-1471, 2001.
103. D. Schulz and D. Fox, "Bayesian color estimation for adaptive vision-based robot localization," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS-04), 2004, pp. 1884-1889.
104. M. Sridharan and P. Stone,, "Towards illumination invariance in the legged league," in Robo Cup-2004: Robot Soccer World Cup VIII, Lecture Notes in Computer Science, vol. 3276, D. Nardi, M. Riedmiller, and C. Sammut, Eds. Berlin, Germany: Springer-Verlag, 2005, pp. 196-208.
105. P. Stone, T. Balch, and G. Kraetzschmar, Eds., "RoboCup-2000: Robot Soccer World Cup IV," in Lecture Notes in Computer Science, vol. 2019. New York: Springer, 2001.
106. P. Stone, K. Dresner, S. Erdoǧan, P. Fidelman, N. Jong, N. Kohl, G. Kuhlmann, E. Lin, M. Sridharan, D. Stronger, and G. Hariharan, "UT Austin Villa 2003: A new RoboCup four-legged team," Univ. of Texas at Austin, Tech. Rep. 2003
107. P. Stone, "Multiagent competitions and research: Lessons from RoboCup and TAC," in Lecture Notes in Computer Science, vol. 2752, G. A. Kaminka, P. U. Lima, and R. Rojas, Eds., New York: SpringerVerlag, 2002, pp. 224-237.
108. P. Stone, K. Dresner, P. Fidelman, N. K. Jong, N. Kohl, G. Kuhlmann, M. Sridharan, and D. Stronger, "The UT Austin Villa 2004 RoboCup four-legged team: Coming of age," Dept. Comput. Sci., AI Lab., Univ. Texas at Austin, Tech. Rep. UT-AI-TR-04-313, Oct. 2004.
109. P. Stone, R. S. Sutton, and G. Kuhlmann, "Reinforcement learning for RoboCup-soccer keepaway," Adapt. Behav., vol. 13, no. 3, pp. 165-188, 2005.
110. P. Stone and M. Veloso, "Multiagent systems: A survey from a machine learning perspective," Auton. Robots, vol. 8, no. 3, pp. 345-383, 2000.
111. P. Stone and M. Veloso, "A survey of multiagent systems and multirobot systems," in Robot Teams: From Diversity to Polymorphism, T. Balch and L. E. Parker, Eds. Natick, MA: AK Peters, 2002, pp. 37-92.
112. D. Stronger and P. Stone, "Simultaneous calibration of action and sensor models on a mobile robot," presented at the 2004 Int. Symp. Robot. Autom. (ISRA), Queretaro, Mexico, Aug. 2004.
113. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
114. D. Vail and M. Veloso, "Learning from accelerometer data on a legged robot," presented at the 5th IFAC/EURON Symp. Intell. Auton. Veh. (IAV2004), Lisbon, Portugal, Jul. 2004.
115. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
116. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
117. M. Veloso, E. Pagello, and H. Kitano, Eds., "RoboCup-1999: Robot SoccerWorld Cup III," in Lecture Notes in Computer Science, vol. 1856. New York: Springer-Verlag, 2000.
118. M. Veloso, W. Uther, M. Fujita, M. Asada, and H. Kitano, "Playing soccer with legged robots," in Proc. Int. Conf. Intell. Robots Syst. (IROS-98), 1998, pp. 437-442.
119. M. Veloso and W. Uther, "The CMTrio-98 Sony legged robot team," in Lecture Notes in Computer Science, vol. 1604, M. Asada and H. Kitano, Eds., New York: Springer-Verlag, 1999, pp. 491-497.
120. Z. Wang, J. Wong, T. Tam, B. Leung, M. S. Kim, J. Brooks, A. Chang, and N. Von Huben, "rUNSWift UNSW RoboCup2002 Sony Legged League Team," Univ. New South Wales, Kensington, NSW, Australia, Tech. Rep., 2002.
121. T. Weigel, J.-S. Gutman, M. Dietl, A. Kleiner, and B. Nebel, "CS Freiburg: Coordinating robots for successful soccer playing," IEEE Trans. Robot. Autom., vol. 18, no. 5, pp. 685-699, Oct. 2002.
122. D. Wilking and T. Röfer, "Realtime object recognition using decision tree learning," in Lecture Notes in Computer Science, vol. 3276, D. Nardi, M. Riedmiller, C. Sammut, and J. Santos-Victor, Eds. New York: Springer-Verlag, 2004.
123. J.C. Zagal and J. Ruiz-del Solar, "Learning to kick the ball using back to reality," in Lecture Notes in Computer Science, D. Nardi, M. Riedmiller, C. Sammut, and J. Santos-Victor, Eds., vol. 3276, New York: Springer-Verlag: Springer-Verlag, 2005.
124. J.C. Zagal and J. Ruiz-del Solar, "UCHILSIM: A dynamically and visually realistic simulator for the RoboCup four legged league," in Lecture Notes in Computer Science, vol. 3276, D. Nardi, M. Riedmiller, C. Sammut, and J. Santos-Victor, Eds., New York: Springer-Verlag, 2005, pp. 34-45.
125. J. C. Zagal, J. Ruiz-del Solar, P. Guerrero, and R. Palma, "Evolving visual object recognition for legged robots," in Lecture Notes in Computer Science, vol. 3020, D. Polani, B. Browning, A. Bonarini, and K. Yoshida, Eds., New York: Springer-Verlag, 2004.
126. J. C. Zagal, J. Ruiz-del Solar, and P. Vallejos, "Back to reality: Crossing the reality gap in evolutionary robotics," presented at the IAV 2004, 5th IFAC Symp. Intell. Auton. Veh., Lisbon, Portugal, 2004.