Pick-and-place application development using voice and visual commands

Industrial Robot

Volumn 39, Issue 6, 2012, Pages 592-600

  Van Delden, Sebastian ^a   Umrysh, Michael ^b   Rosario, Carlos ^a   Hess, Gregory ^a  

^a UNIVERSITY OF SOUTH CAROLINA UPSTATE   (United States)

^b Livingston and Haven Manufacturing   (United States)

Author keywords

Articulated robotics; Control technology; Hand gesture recognition; Human robot interaction; Robotics; Speech recognition; Visual programming; Voice commands

Indexed keywords

APPLICATION DEVELOPMENT; AUGMENTED TRANSITION NETWORKS; CONTROL TECHNOLOGIES; DECIBEL LEVELS; DEPTH RECOVERY; DEPTH VARIATION; DESIGN/METHODOLOGY/APPROACH; FACTORY FLOORS; HAND-GESTURE RECOGNITION; IMAGE PROCESSING TECHNIQUE; INDUSTRIAL ROBOTIC SYSTEMS; MANUFACTURING ENVIRONMENTS; NATURAL LANGUAGES; PICK-AND-PLACE; POINTING ALGORITHM; PRIOR KNOWLEDGE; ROBOT CONTROLLER; ROBOT CONTROLS; ROBOT MOVEMENTS; ROBOTIC EQUIPMENTS; SHINY SURFACES; TARGET LANGUAGE; USER FRIENDLY; VISION COMPONENTS; VISUAL COMMAND; VISUAL PROGRAMMING; VOICE COMMAND; VOICE SYSTEMS; VOICE TECHNOLOGIES; VOICE-RECOGNITION SYSTEMS;

ALGORITHMS; COMPUTER PROGRAMMING; FLOORS; GESTURE RECOGNITION; IMAGE PROCESSING; ROBOTICS; ROBOTS;

SPEECH RECOGNITION;

EID: 84867209403     PISSN: 0143991X     EISSN: None     Source Type: Journal    
DOI: 10.1108/01439911211268796     Document Type: Article

References (22)

1. Bartholomew, J., Miller, G. Voice control for noisy industrial environments Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society 3 1988 1509-10
2. Bradski, G., Kaehler, A. Learning OpenCV: Compute Vision with the OpenCV Library O'Reilly Media Sebastopol, CA 2008
3. Chang, C., Chen, J., Tai, W., Han, C. New approach for static gesture recognition Journal of Information Science Engineering 22 2006 1047-57
4. Craig, J. Introduction to Robotics: Mechanics and Control Prentice-Hall Upper Saddle River, NJ 2004 3rd ed.
5. Droeschel, D., Stuckler, J., Behnke, S. Learning to interpret pointing gesture with a time-of-flight camera Proceedings of the 6th ACM/IEEE Conference on Human-Robot Interaction, Lausanne, Switzerland 2011
6. Erol, A., Bebis, G., Nicolescu, M., Boyle, R., Twombly, X. Vision-based hand pose estimation: a review Computer Vision and Image Understanding 108 1/2 2007 52-73
7. Grammar Grammar Format Tags for the Microsoft Speech API 2011 MSDN Library
8. Guan, H., Chang, J., Chen, L., Feris, R. Multi-view appearance-based 3D hand pose estimation Proceedings of the Conference on Computer Vision and Pattern Recognition 2006 154-60
9. Hägele, M., Schaaf, W., Helms, E. Robot assistants at manual workplaces: effective co-operation and safety aspects Proceedings of the 33rd International Symposium on Robotics, Stockholm, Sweden 2002
10. Holada, M., Pelc, M. Lazinica, A. The robot voice-control system with interactive learning New Developments in Robotics Automation and Control InTech Rijeka 2008
11. Hollmann, R., Hägele, M. The use of voice control for industrial robots in noisy manufacturing environments Proceedings of the 39th International Symposium on Robotics, Seoul, Korea 2008 14-18
12. Kawarazaki, N., Yoshidome, T., Nishihara, K. An assistive robot system using gesture and voice instructions Proceedings of the 2nd Cambridge Workshop on Universal Access and Assistive Technology (Incorporating the 5th Cambridge Workshop on Rehabilitation Robotics) 2004
13. Kehl, R., van Gool, K. Real-time pointing gesture recognition for an immersive environment Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition, Seoul, Korea 2004
14. OSHA Factsheet: Laboratory Safety Noise. Occupational Safety and Health Administration (OSHA) 2011 available at: www.osha.gov/Publications/laboratory/ OSHAfactsheet-laboratory-safety-noise.pdf (accessed 29 October 2011).
15. Park, C., Roh, M., Lee, S. Real-time 3D pointing gesture recognition in mobile space Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, The Netherlands 2008 1-6
16. Pires, J. Robot-by-voice: experiments on commanding an industrial robot using the human voice Industrial Robot: An International Journal 32 6 2005
17. Quek, F., McNeill, D., Bryll, R., Duncan, S., Ma, X., Kirbas, C., McCullough, K., Ansari, A. Multimodal human discourse: gesture and speech ACM Transactions on Computer-Human Interaction 9 3 2002 171-93
18. Storring, M., Granum, E., Moeslund, T. A natural interface to a virtual environment through computer vision-estimated pointing gestures In the Workshop on Gesture and Sign Language Based Human-Computer Interaction, London 2001 59-63
19. van Delden, S., Overcash, B. Towards voice-guided robotic manipulator jogging Proceedings of the 12th World Multiconference on Systemics, Cybernetics and Informatics, Orlando, FL 3 2008 138-44
20. van Delden, S., Umrysh, M. Visual detection of objects in a robotic work area using hand gestures Proceedings of the 9th IEEE International Symposium on Robotics and Sensor Environments, Montreal, Canada 2011 237-43
21. Woods, W. Transition network grammars for natural language analysis Communications of the ACM 13 1970 591-602
22. Yoichi, S., Kobayashi, Y., Koike, H. Fast tracking of hands and fingertips in infrared images for augmented desk interface Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, IEEE Computer Society, Washington, DC 2000 462-7