I want that: Human-in-the-loop control of a wheelchair-mounted robotic arm

Applied Bionics and Biomechanics

Volumn 8, Issue 1, 2011, Pages 127-147

  Tsui, Katherine M ^a,b,c   Behal, Aman ^c   Kontak, David ^d   Yanco, Holly A ^a  

^a UNIVERSITY OF MASSACHUSETTS LOWELL   (United States)

^b Universal Robotics Inc   (United States)

^c UNIVERSITY OF CENTRAL FLORIDA   (United States)

^d Crotched Mountain Rehabilitation Center   (United States)

Author keywords

Human robot interaction; visual servoing

Indexed keywords

HUMAN ROBOT INTERACTION; ROBOTIC ARMS; VISUAL SERVOING; WHEELCHAIRS;

COGNITIVE FUNCTIONS; COGNITIVE LOADS; COMPLETE SYSTEM; HUMAN-IN-THE-LOOP CONTROL; TASK DECOMPOSITION; VISION-BASED SYSTEM; WHEELCHAIR-MOUNTED ROBOTIC ARMS;

ROBOTICS;

EID: 79959352993     PISSN: 11762322     EISSN: 17542103     Source Type: Journal    
DOI: 10.3233/ABB-2011-0004     Document Type: Article

References (38)

1. K. Tsui, H. Yanco, D. Kontak and L. Beliveau, Development and evaluation of a flexible interface for a wheelchair mounted robotic arm, in: Human-Robot Interaction Conf, 2008.
2. D.-J. Kim, R. Lovelett and A. Behal, Eye-in-hand stereo visual servoing of an assistive robot arm in unstructured environments, IEEE Intl Conf on Robotics and Automation, 2009.
3. International Center for Disability Information, ICDI - The total number of disabilities reported by people age 5 years old and olders, 2003, Available at: http://www.icdi.wvu. edu/disability/U.S%20Tables/US7.htm. Accessed Oct. 2009.
4. H. Kayne, T. Kang and M. LaPlante, Disability statistics report: Mobility device use in the United States (Report 14), 2000, Available at: http://dsc.ucsf.edu/publication.php? pub id=2. Accessed Oct. 2009.
5. Design in Motion, The problem with manual wheelchair use, 2007, Available at: http://www.dinm.net/freeflex.html. Accessed Oct. 2009.
6. Exact Dynamics, iARM, 2010, Available at: http://www. exactdynamics.nl/site/?page=iarm. Accessed Jan. 2010.
7. G. R̈omer,H. Stuyt and A. Peters, Cost-savings and economic benefits due to the assistive robotic manipulator (ARM), in Proc of the Intl Conf on Rehabilitation Robotics, 2005, pp. 201-204. (Pubitemid 44017792)
8. G.R̈omer,H. Stuyt and K. vanWoerden, Process for obtaining a "Manus" (ARM) within the Netherlands, Lecture Notes in Control and Information Sciences, vol. 306, 2004, pp. 221- 230. Part II: Rehabilitation Robots for Assistance of Human Movements, Chapter 14.
9. R. Woodworth, The accuracy of voluntary movement, Psychology Review Monograph Supplement, 1899.
10. C. Stanger, C. Anglin,W.S. Harwin and D. Romilly, Devices for assisting manipulation: A summary of user task priorities, IEEE Trans. on Rehab Engineering, 4(2), (1994), 256-265.
11. B. Driessen, T. Kate, F. Liefhebber, A. Versluis and J. Woerden, Collaborative control of the manus manipulator, Universal Access in the Information Society, vol. 4, no. 2, 2005, pp. 165-173. (Pubitemid 43118504)
12. B. Driessen, F. Liefhebber, T. Kate and K. VanWoerden, Collaborative control of the manus manipulator, IEEE Intl Conf on Rehab Robotics, 2005.
13. K.M. Tsui, K. Abu-Zahra, R. Casipe, J. M'Sadoques and J.L. Drury, Developing heuristics for assistive robotics, 2010. Late breaking paper at ACMSIGCH/SIGART Human-Robot Interaction Conf.
14. C. Dune, C. Leroux and E. Marchand, Intuitive human interactive with an arm robot for severely handicapped people - A one click approach, IEEE Intl Conf on Rehab Robotics, 2007.
15. C. Dune, E. Marchand, C. Collewet and C. Leroux, Active rough shape estimation of unknown objects, IEEE/RSJ Intl Conf on Intelligent Robots and Systems, (2008), 3622-3627.
16. C. Dune, E. Marchand, C. Collewet and C. Leroux, Visionbased grasping of unknown objects to improve disabled persons autonomy, in: Robotics: Science and Systems Manipulation Workshop: Intelligence in Human Environments, 2008.
17. Y. Choi, C. Anderson, J. Glass and C. Kemp, Laser pointers and a touch screen: Intuitive interfaces for autonomous mobile manipulation for the motor impaired, Intl ACM SIGACCESS Conf on Computers and Accessibility, 2008, ACM, pp. 225- 232.
18. H. Nguyen, C. Anderson, A. Trevor, A. Jain, Z. Xu and C. Kemp, El-E: An assistive robot that fetches objects from flat surfaces, in Human-Robot Interaction Conf Workshop on Robotic Helpers, 2008.
19. H. Nguyen and C. Kemp, Bio-inspired assistive robotics: Service dogs as a model for human-robot interaction and mobile manipulation, IEEE/RAS-EMBS Int Conf on Biomedical Robotics and Biomechatronics, (2008), 542-549.
20. J.-Y. Bouguet, Camera calibration toolbox for matlab, 2008, Available at: http://www.vision.caltech.edu/bouguetj/ calib doc/. Accessed Mar. 2009.
21. K. Konolige, SVS Development System, 2003. Available at: http://www.ai.sri.com/∼konolige/svs/svs.htm/. Accessed Mar. 2009.
22. Open Source Assistive Technology Software, Dwell Click - oats, 2010, Available at: http://www.oatsoft.org/ Software/dwell-click. Accessed July. 2010.
23. Intel, Welcome - OpenCV Wiki, 2009, Available at: http://opencv. willowgarage.com. Accessed Mar. 2009.
24. S. Inspecta and B. Ricard, cvBlobsLib - OpenCVWiki, 2009. http://opencv.willowgarage.com/wiki/cvBlobsLib. Accessed Mar. 2009.
25. D. Lowe, Distinctive image features from scale-invariant keypoints, J of Computer Vision 60(2) (2004), 91-110.
26. D.-J. Kim, Z.Wang and A. Behal, Motion Segmenatation and Control Design for an Intelligent Assistive Robotic Manipulator, IEEE/ASME Transactions on Mechatronics, 2011, In submission.
27. D. Nister and H. Stewenius, Scalable recognition with a vocabulary tree, IEEE Conf on Computer Vision and Pattern Recognition, 2 (2006), 2161-2168. (Pubitemid 44931581)
28. M. Fischler and R. Bolles, Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography, Communication of the ACM, vol. 24, (1981), 381-395. (Pubitemid 12444102)
29. K. Fukunaga, Introduction to Statistical Pattern Recognition. Academic Press, 1990.
30. M. Ozuysal, P. Fua andV. Lepetit, Fast keypoint recognition in ten lines of code, IEEE Conf on Computer Vision and Pattern Recognition (2007).
31. J. Chen, D.M. Dawson, W.E. Dixon and A. Behal, Adaptive homography-based visual servo tracking for a fixed camera configuration with a camera-in-hand extension, IEEE Trans on Control Systems Technology, 13(5) (2005), 814-825. (Pubitemid 41410785)
32. O. Faugeras, Three-dimensional Computer Vision: A Geometric Viewpoint, MIT Press, Cambridge, MA, 2001.
33. Y. Fang, A. Behal, W. Dixon, and D. Dawson, Adaptive 2.5 D visual servoing of kinematically redundant robot manipulators, IEEE Conf on Decision and Control, 3 (2002), 2860-2865.
34. C. Hagen, D. Malkmus and P. Durham, Levels of cognitive functioning, Rehabilitation of the Head Injured Adult: Comprehensive Physical Management, 1979 pp. 87-88, Downey, CA. Professional Staff Association of Rancho Los Amigos Hospital, Inc.
35. R.J. Cooper, Assistive Technology - CrossScanner Single Switch Method to Operate ALL Software, 2009, Available at: http://www.rjcooper.com/cross-scanner/ index.html. Accessed Oct. 2009.
36. D.M. McNair, M. Lorr and L.F. Droppleman, Profile of mood states, Educational and Industrial Testing Service, 1992.
37. J. Jutai, Psychosocial impact of assistive devices scale (PIADS), 2009. http://www.piads.ca/9/index1.2.html. Accessed Oct. 2009.
38. AT&T Labs, Inc. - Research, AT&T Labs Natural Voice® Text-to-Speech Demo, 2010. http://www2.research. att.com/∼ttsweb/tts/demo. php. Accessed Jan. 2010.