Development of a colon endoscope robot that adjusts its locomotion through the use of reinforcement learning

International Journal of Computer Assisted Radiology and Surgery

Volumn 5, Issue 4, 2010, Pages 317-325

  Trovato, G ^a   Shikanai, M ^a   Ukawa, G ^a   Kinoshita, J ^a   Murai, N ^a   Lee, J W ^a   Ishii, H ^a   Takanishi, A ^a   Tanoue, K ^b   Ieiri, S ^b   Konishi, K ^b   Hashizume, M ^b  

^a WASEDA UNIVERSITY   (Japan)

^b KYUSHU UNIVERSITY HOSPITAL   (Japan)

Author keywords

Autonomous colonoscope; Colon endoscope; Forward reverse screw; Medical robot; Reinforcement learning

Indexed keywords

ANIMAL TISSUE; ARTICLE; COLONOSCOPE; COLONOSCOPY; COMPUTER PROGRAM; CONTROLLED STUDY; EQUIPMENT DESIGN; FIBER OPTICS; LEARNING ALGORITHM; MATHEMATICAL ANALYSIS; NONHUMAN; PRIORITY JOURNAL; REINFORCEMENT; ROBOTICS; SAFETY; SURGICAL TECHNOLOGY; SWINE; ALGORITHM; ANATOMY AND HISTOLOGY; ANIMAL; COLON; DEVICES; FEASIBILITY STUDY; PLIABILITY; PROCEDURES; TORQUE;

ALGORITHMS; ANIMALS; COLON; COLONOSCOPES; COLONOSCOPY; EQUIPMENT DESIGN; FEASIBILITY STUDIES; FIBER OPTIC TECHNOLOGY; PLIABILITY; ROBOTICS; SOFTWARE; SWINE; TORQUE;

EID: 77955984530     PISSN: 18616410     EISSN: 18616429     Source Type: Journal    
DOI: 10.1007/s11548-010-0481-0     Document Type: Article

References (24)

1. Boyle P, Levin B (2008) World Cancer Report 2008. Int Agency Res Cancer Treat 88(1):123-132 (in Japanese)
2. Johnston PG (2006) The colorectal cancer coalition: reflections on the future. Oncologist 11:970-972
3. Colquhoun P, Weiss EG, Efron J, Nogueras JJ, Vernava AM, Wexner SD (2006) Colorectal cancer screening: do we practice what we preach? Surg Innov 13:81-85
4. Church JM (1995) Endoscopy of the colon, rectum and anus. Igaku- Shoin Medical Publishers, New York
5. Wickham J (1996) Editorial. Min Invas Ther & Allied Tech
6. Cuschieri A,Melzer A (1997) The impact of technologies on minimally invasive therapy. Surg Endosc 11:91-92
7. Kassim I, Phee L, Ng WS, Gong F, Dario P, Mosse CA (2006) Locomotion techniques for robotic colonoscopy, Inst. of Nat. Neuroscience, Singapore; Engineering in Medicine and Biology Magazine
8. Iddan G, Meron G, Glukhovsky A, Swain P (2000) Wireless capsule endoscopy. Nature 405:417
9. Valdastri P,Webster RJ, Quaglia C, QuiriniM,Menciassi A, Dario P (2009) A new mechanism for mesoscale legged locomotion in compliant tubular environments. IEEE Trans Robot 25:1047-1057
10. Accoto D, Stefanini C, Phee L, Arena A, Pernorio G, Menciassi A, Carrozza MC, Dario P (2001) Measurements of the frictional properties of the gastrointestinal tract. In: Proceedings of the 2nd World Tribology Congress. Vienna, p 728
11. Tanaka S et al (2006) The present condition of a capsule endoscope and a double balloon endoscope, a view.Med Treat 88(1):123-132 (in Japanese)
12. Hassan C, Zullo A,Winn S, Morini S (2008) Cost-effectiveness of capsule endoscopy in screening for colorectal cancer. Endoscopy 40:414-421
13. Grundfest WS, Burdick IV JW, Slatkin AB (1994) Robotic endoscopy. US Patent 5,337,732,1994
14. Slatkin AB, Burdick G, GrundfestWS (1995) The development of a robotic endoscope Intelligent Robots and Systems. IEEE/RSJ Int Conf Intell Robots Syst 2:2162
15. Menciassi A, Park JH, Lee S, Gorini S, Dario P, Park JO (2002) Robotic solutions and mechanisms for a semi-autonomous endoscope. In: Proceedings of the IEEE RSJ International Conference on intelligent robots and systems, Lausanne, Switzerland, pp. 1379-1384
16. Phee L, Accoto D, Menciassi A, Stefanini C, Carrozza MC, Dario P (2002) Analysis and development of locomotion devices for the gastrointestinal tract. IEEE Trans Biomed Eng 49:613-616
17. Kalmár Z, Szepesvári C, Lorincz A (1998) Modular reinforcement learning: an application a real robot task. Lecture notes in computer science, ISSN 0302-9743
18. Abbeel P, Ng AY (2005) Exploration and apprenticeship learning in reinforcement learning. In: ICML '05 proceedings of the 22nd international conference on Machine learning, pp 1-8
19. Abbeel P, Quigley M, Ng AY (2006) Using inaccurate models in reinforcement learning. In: ICML'06 proceedings of the 23rd international conference on Machine learning
20. Ito et al (2007) Development of colon endoscope robots with new drive mechanisms-self-propelled endoscope robots of rotatory inertia and reverse screw types. In: Proceedings of the 25th Annual conference of the robotics society of Japan 2J17 (in Japanese)
21. Moore A (1990) Efficient memory-based learning for robot control. PhD. Thesis, Technical Report No.229, Computer Laboratory, University of Cambridge
22. Sutton RS, Barto G (1998) Reinforcement learning: an introduction. MIT Press, Cambridge
23. Asada M, Noda S, Tawaratsumida S, Hosoda K (1996) Purposive behavior acquisition for a real robot by vision-based reinforcement learning. Mach Learn 23:279-303
24. Uchibe E, AsadaM, Hosoda K (1996) Behavior coordination for a mobile robot using modular reinforcement learning. In: Proceedings of IEEE/RSJ Int Conf on Intelligent Robot and Sytems. pp 1329-1336