From simulation to real robots with predictable results: Methods and examples

Performance Evaluation and Benchmarking of Intelligent Systems

Volumn , Issue , 2009, Pages 113-137

  Balakirsky, S ^a   Carpin, S ^b   Dimitoglou, G ^c   Balaguer, B ^b  

^a NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c HOOD COLLEGE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; INTELLIGENT SYSTEMS; ROBOTICS; ROBOTS;

ALGORITHM DEVELOPMENT; DEVELOPMENT COMMUNITY; MOBILITY MODEL; ROBOTICS COMPETITIONS; SENSOR MODEL; SIMULATION ENGINE; SIMULATION SYSTEMS; SYSTEMATIC METHODOLOGY;

EDUCATIONAL ROBOTS;

EID: 84892296648     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1007/978-1-4419-0492-8_6     Document Type: Conference Paper

References (42)

1. Adobbati, R.,Marshall, A. N., Scholer, A., Tejada, S., Kaminka, G. A., Schaffer, S., Sollitto, C. "GameBots: A 3D virtual world test bed for multiagent research," Proceedings of the Second International Workshop on Infrastructure for Agents, MAS, and Scalable MAS, Montreal, Canada, 2001.
2. Balakirsky, S., Scrapper, C., Carpin, S., Lewis, M., "USARSim: providing a framework for multi-robot performance evaluation," Proceedings of PerMIS, Gaithersburg, MD, 2006.
3. Balakirsky, S., Scrapper, C., Carpin, S., Lewis, M., "USARSim: A RoboCup Virtual Urban Search and Rescue Competition," Proceedings of the 2007 SPIE Unmanned Systems Technology IX, Defense and Security Symposium, 2007.
4. Balakirsky, S., Proctor, F., Scrapper, C., and Kramer, T., "An Integrated Control and Simulation Environment for Mobile Robot Software Development," Proceedings of the ASME Computers and Information in Engineering Conference, New York, NY, 2008.
5. Balakirsky, S., Madhavan, R., and Scrapper, C., "NIST/IEEE Virtual Manufacturing Automation Competition: From Earliest Beginnings to Future Directions," Proceedings of PerMIS, Gaithersburg, MD, 2008.
6. Barraquand, J., Kavraki, L., Latombe, J., Motwani, R., Li, T., and Raghavan, P. 1997. "A random sampling scheme for path planning," International Journal on Robotics Research 16(6), Dec. 1997, 759-774.
7. Balaguer, B., Carpin, S., Balakirsky, S., "Towards Quantitative Comparisons of Robot Algorithms: Experiences with SLAM in Simulation and Real World Systems," Workshop on Performance Evaluation and Benchmarking for Intelligent Robots and Systems at IEEE/RSJ IROS, 2007.
8. Balaguer, B., Carpin, S. "Where Am I? A Simulated GPS Sensor for Outdoor Robotic Applications," Proceedings of the First International Conference on Simulation, Modeling and Programming for Autonomous Robots, Springer-Verlag, Berlin, 2008, 222-233.
9. Brooks, R., Mataríc, M., "Real Robots, Real Learning Problems," Robot Learning, Kluwer Academic Press, Hingham, MA, 1993, 193-213.
10. Canny, J. F., The Complexity of Robot Motion Planning, MIT Press, 1988.
11. Canny, J., "On the "Piano Movers" series by Schwartz, Sharir, and Ariel-Sheffi". In the Robotics Review 1, O. Khatib, J. J. Craig, and T. Lozano-Pérez, Eds. MIT Press, Cambridge, MA, 1989, pp. 33-40.
12. Carpin, S., Lewis, M.,Wang, J., Balakirsky, S., Scrapper, C., "USARSim: a robot simulator for research and education," Proceedings of the IEEE 2007 International Conference on Robotics and Automation, IEEE, Roma, 2007, pp. 1400-1405.
13. Carpin, S., Stoyanov, T., Nevatia, Y., Lewis, M., Wang, J., "Quantitative Assessments of USARSim Accuracy," Proceedings of PerMIS 2006.
14. Carpin, S., Wang, J., Lewis, M., Birk, A., Jacoff, A., "High fidelity tools for rescue robotics: results and perspectives," Robocup 2005: Robot Soccer World Cup IX, LNAI, Vol. 4020, Springer, Berlin, 2006, pp. 301-311.
15. Faraz al, A., Payandeh, S., "Kinematic modelling and trajectory planning for a telelaparoscopic manipulating system," Robotica, 18(4), 2000, 347-360, Cambridge University Press, Cambridge, MA.
16. Gerkey, B., Vaughan, R., Howard, A. "The player/stage project: Tools for multi-robot and distributed sensor systems," Proceedings of the International Conference on Advanced Robotics (ICAR), North-Holland Publishing Co., Amsterdam, 2003, pp. 317-323.
17. Kavraki, L. E.; Svestka, P.; Latombe, J.-C.; Overmars, M. H., "Probabilistic roadmaps for path planning in high-dimensional configuration spaces," IEEE Transactions on Robotics and Automation 12(4), 1996, 566-580.
18. Koenig, N., Howard, A. "Design and use paradigms for Gazebo, an open-source multi-robot simulator," IEEE/RSJ International Conference on Intelligent Robots and Systems, Sage Publications, Inc., Thousand Oaks, CA, 2004, pp. 2149-2154.
19. Kyriacou, T., Nehmzow, U., Iglesias, R., Billings, S. A. "Accurate robot simulation through system identification", Robotics and Autonomous Systems, 56(12), 2008, 1082-1093.
20. Laue, T., Spiess, K., Röfer, T. (2006). "SimRobot-A General Physical Robot Simulator and Its Application in RoboCup," RoboCup 2005: Robot Soccer World Cup, IX(4020), 2006, 173-183.
21. LaValle, S. M., Kuffner, J. J., "Rapidly-exploring random trees: Progress and prospects," Proceedings Workshop on the Algorithmic Foundations of Robotics, 2000.
22. Latombe, J.-C. "Motion planning: A journey of robots, molecules, digital actors, and other artifacts," International Journal on Robotic Research, 18(11), 1999, 1119-1128.
23. Leger, C., "Darwin2k, An Evolutionary Approach to Automated Design for Robotics," Kluwer Academic Publishers, Hingham, MA, 2000, 0-7923-7929-2.
24. Lewis, M., Jacobson, J. "Game Engines in Research," Communications of the Association for Computing Machinery (CACM), NY:ACM 45(1), 2002.
25. Lozano-Perez, T. "Spatial Planning: A Configuration Space Approach," IEEE Transactions on Computers, C-32(2), February 1983, pp. 108-120. Also, IEEE Tutorial on Robotics, IEEE Computer Society, 1986, pp. 26-38. Also, AI Memo 605, December 1980.
26. Messina, E., "Performance Standards for Urban Search & Rescue Robots: Enabling Deployment of New Tools for Responders," Defense Standardization Program Office Journal, July/December 2007, pp. 43-48.
27. Michel, O., "Webots: a Powerful Realistic Mobile Robots Simulator," Proceeding of the Second International Workshop on RoboCup. LNAI. Springer-Verlag, Berlin, 1998.
28. Nilsson, N., "A mobile automaton: An application of artificial intelligence techniques," Proceedings of International Joint Conference on Artificial Intelligence, Washington, DC, (IJCAI-69), 1969.
29. Pepper, C., Balakirsky, S., and Scrapper, C., "Robot Simulation Physics Validation," Proceedings of the Performance Metrics for Intelligent Systems (PerMIS) Workshop, 2007.
30. RoboCup Rescue Virtual League. http://www. robocuprescue. org/wiki/index. php?title= Virtualrobots, accessed 01/15/09.
31. Sheng, X., "Motion planning for computer animation and virtual reality applications," Computer Animation, IEEE Computer Society, Washington, DC, 1995, p. 56.
32. Song, G., Amato, N. M., "Using motion planning to study protein folding pathways," Proceedings of the Fifth Annual international Conference on Computational Biology, ACM, New York, NY, 2001, pp. 287-296.
33. Schlenoff, C., Steves, M., Weiss, B., Shneier, M., Virts, A., "Applying SCORE to field-based performance evaluations of soldier worn sensor technologies," Journal of Field Robotics, 24(8-9), 2006, 671-698.
34. Schwartz, J. T., Sharir, M., "On the piano movers problem: I. The case of a rigid polygonal body moving amidst polygonal barriers", Communications on Pure and AppliedMathematics, 36, 1983, 345-398.
35. Schwartz, J. T., Sharir, M., "On the Piano movers Problem II: General techniques for computing topological properties of algebraic manifolds," Advances in Applied Mathematics, 4, 1983, 298-351.
36. Southwest Research Institute, Applied Physics Division, Micrologger Introduction.
37. Sycara, K., Pannu, A. S., "The RETSINA multiagent system (video session): towards integrating planning, execution and information gathering," Proceedings of the Second International Conference on Autonomous Agents, ACM, New York, NY, 1998.
38. Taylor, B., Balakirsky, S., Messina, E., Quinn, R., "Design and Validation of a Whegs Robot in USARSim," Proceedings of the Performance Metrics for Intelligent Systems (PerMIS) Workshop, 2007.
39. Shawna, T., Song, G., Amato, N. M., "Protein Folding by Motion Planning," Physical Biology, 2, 2005, S148-S155.
40. UNR, Unreal engine, http://www. epicgames. com, accessed June 1, 2008.
41. USARSim Homepage, http://www. sourceforge. net/projects/usarsim, accessed 01/15/ 2009.
42. VMAC Home page. http://vmac. hood. edu, accessed 01/15/2009.