FAce MOUSe: A Novel Human-Machine Interface for Controlling the Position of a Laparoscope

IEEE Transactions on Robotics and Automation

Volumn 19, Issue 5, 2003, Pages 825-841

  Nishikawa, Atsushi ^a   Hosoi, Toshinori ^b   Koara, Kengo ^c   Negoro, Daiji ^d   Hikita, Ayae ^e   Asano, Shuichi ^f   Kakutani, Haruhiko ^c   Miyazaki, Fumio ^a   Sekimoto, Mitsugu ^g   Yasui, Masayoshi ^g   Miyake, Yasuhiro ^h   Takiguchi, Shuji ^g   Monden, Morito ^g  

^a OSAKA UNIVERSITY   (Japan)

^b NEC CORPORATION   (Japan)

^c MITSUBISHI ELECTRIC CORPORATION   (Japan)

^d TOSHIBA CORPORATION   (Japan)

^e FURUKAWA ELECTRIC CO LTD   (Japan)

^f DENSO CORPORATION   (Japan)

^g OSAKA UNIVERSITY GRADUATE SCHOOL OF MEDICINE   (Japan)

^h UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

Author keywords

Face gesture; Human machine interface; Laparoscopic surgery; Robotic camera assistant; Solo surgery

Indexed keywords

CAMERAS; HUMAN COMPUTER INTERACTION; INTERFACES (COMPUTER); SURGERY;

LAPAROSCOPE;

ROBOTICS;

EID: 10744225617     PISSN: 1042296X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRA.2003.817093     Document Type: Article

References (21)

1. J. M. Sackier and Y. Wang, "Robotically assisted laparoscopic surgery from concept to development," Surgical Endoscopy, vol. 8, no. 1, pp. 63-66, Jan. 1994.
2. R. Hurteau, S. DeSantis, E. Begin, and M. Gagner, "Laparoscopic surgery assisted by a robotic cameraman: Concept and experimental results, " in Proc. IEEE Int. Conf. Robotics and Automation, San Diego, CA, May 1994, pp. 2286-2289.
3. R. H. Taylor, J. Funda, B. Eldridge, S. Gomory, K. Gruben, D. LaRose, M. Talamini, L. Kavoussi, and J. Anderson, "A telerobotic assistant for laparoscopic surgery," IEEE Eng. Med. Biol. Mag., vol. 14, pp. 279-288, May-June 1995.
4. M. E. Allaf, S. V. Jackman, P. G. Schulam, J. A. Cadeddu, B. R. Lee, R. G. Moore, and L. R. Kavoussi, "Laparoscopic visual field, voice vs. foot pedal interfaces for control of the AESOP robot," Surgical Endoscopy, vol. 12, no. 12, pp. 1415-1418, Dec. 1998.
5. G. F. Buess, A. Arezzo, M. O. Schurr, F. Ulmer, H. Fisher, L. Gumb, T. Testa, and C. Nobman, "A new remote-controlled endoscope positioning system for endoscopie solo surgery the FIPS endoarm," Surgical Endoscopy, vol. 14, no. 4, pp. 395-399, Apr. 2000.
6. T. Kimura, Y. Umehara, and S. Matsumoto, "Laparoscopic cholecystectomy performed by a single surgeon using a visual field tracking camera," Surgical Endoscopy, vol. 14, pp. 825-829, Sept. 2000.
7. V. F. Murioz, C. Vara-Thorbeck, J. G. DeGabriel, J. F. Lozano, E. Sanchez-Badajoz, A. Garcia-Cerezo, R. Toscano, and A. Jimenez-Garrido, "A medical robotic assistant for minimally invasive surgery," in Proc. IEEE Int. Conf. Robotics and Automation, San Francisco, CA, Apr. 2000, pp. 2901-2906.
8. C. Vara-Thorbeck, V. F. Murioz, R. Toscano, J. Gomez, J. Fernandez, M. Felices, and A. Garcia-Cerezo, "A new robotic endoscope manipulator a preliminary trial to evaluate the performance of a voice-operated industrial robot and a human assistant in several simulated and real endoscopic operations," Surgical Endoscopy, vol. 15, pp. 924-927, Sept. 2001.
9. E. Kobayashi, K. Masamune, I. Sakuma, T. Dohi, and D. Hashimoto, "A new safe laparoscopic manipulator system with a five-bar linkage mechanism and an optical zoom," Comput.-Aided Surgery, vol. 4, no. 4, pp. 182-192, 1999.
10. E. Kobayashi, K. Masamune, I. Sakuma, T. Dohi, K. Shinohara, and D. Hashimoto, "Safe and simple man-machine interface for a laparoscope manipulator system comparison of command input methods," J. Jpn. Soc. Comput.-Aided Surgery, vol. 3, no. 2, pp. 71-78, 2001.
11. P. A. Finlay and M. H. Ornstein, "Controlling the movement of a surgical laparoscope. Endosista, with four degrees of freedom, operates in concert with surgeon's intuitive head motions," IEEE Eng. Med. Biol. Mag., vol. 14, no. 3, pp. 289-291, May-June 1995.
12. N. J. Dowler and S. R. J. Holland, "The evolutionary design of an endoscopic telemanipulator," IEEE Robot. Automat. Mag., vol. 3, pp. 38-45, Dec. 1996.
13. P. A. Finlay, "A robotic camera holder for laparoscopy," in Proc. 10th Int. Conf. Advanced Robotics, Workshop 2 on Medical Robotics, Budapest, Hungary, Aug. 2001, pp. 129-132.
14. A. Casals, J. Amat, and E. Laporte, "Automatic guidance of an assistant robot in laparoscopic surgery," in Proc. IEEE Int. Conf. Robotics and Automation, Minneapolis, MN, Apr. 1996, pp. 895-900.
15. M. O. Schurr, A. Arezzo, B. Neisisu, H. Riminsland, H. U. Hilzinger, J. Dorn, K. Roth, and G. F. Buess, "Trocar and instrument positioning system TISKA an assist device for endoscopie solo surgery," Surgical Endoscopy, vol. 13, pp. 528-531, May 1999.
16. M. S. Wilson, A. Middlebrook, C. Sutton, R. Stone, and R. F. McCloy, "MIST VR: A virtual reality trainer for laparoscopic surgery assesses performance," Ann. Roy. Coll. Surgeons of England, vol. 79, pp. 403-404, 1997.
17. A. Nishikawa, T. Hosoi, K. Koara, A. Hikita, D. Negoro, S. Asano, F. Miyazaki, M. Sekimoto, Y. Miyake, M. Yasui, and M. Monden, "A laparoscope positioning system with the surgeon's face image-based human-machine interface," in Proc. CARS2001 -Computer Assisted Radiology and Surgery, 15th Int. Congr. Exhibit., Berlin, Germany, June 27-30, 2001, pp. 165-170.
18. A. Nishikawa, T. Hosoi, K. Koara, D. Negoro, A. Hikita, S. Asano, F. Miyazaki, M. Sekimoto, Y. Miyake, M. Yasui, and M. Monden, "Real-time visual tracking of the surgeon's face for laparoscopic surgery," in Proc. Medical Image Computing and Computer-Assisted Intervention, MICCAI 2001, vol. 2208, Lecture Notes in Computer Science, Utrecht, The Netherlands, Oct. 2001, pp. 9-16.
19. A. Nishikawa, S. Asano, F. Miyazaki, M. Sekimoto, M. Yasui, and M. Monden, "A laparoscope positioning system based on the real-time visual tracking of surgeon's face and surgical instruments," in Proc. CARS2002 -Computer Assisted Radiology and Surgery, 16th Int. Congr. Exhibit., Paris, France, June 26-29, 2002, pp. 1090-1090.
20. A. Nishikawa, D. Negoro, H. Kakutani, F. Miyazaki, M. Sekimoto, M. Yasui, S. Takiguchi, and M. Monden, "Using an endoscopie solo surgery simulator for quantitative evaluation of human-machine interface in robotic camera positioning systems," in Proc. Medical Image Computing and Computer-Assisted Intervention, MICCAI 2002, vol. 2488, Lecture Notes in Computer Science, Tokyo, Japan, Sept. 2002, pp. 1-8.
21. -, "Design of an endoscopic solo surgery simulator for quantitative evaluation of human-machine interface in robotic camera positioning systems," Adv. Robot., vol. 17, pp. 503-521, Sept. 2003.