Multimodal human-robot interaction in an assistive technology context

Proceedings of the 2007 Australasian Conference on Robotics and Automation, ACRA 2007

Volumn , Issue , 2007, Pages

  Harte, Elizabeth ^a   Jarvis, Professor Raymond ^b  

^a MONASH UNIVERSITY   (Australia)

^b ARC Centre for Perceptive and Intelligent Machines in Complex Environments   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ASSISTIVE TECHNOLOGY; CONTEXTUAL INFORMATION; DOMESTIC ENVIRONMENTS; MITSUBISHI HEAVY INDUSTRIES; MULTI-MODAL; PROBABILITY OF CORRECTNESS; ROBOTIC SYSTEMS;

GESTURE RECOGNITION; HUMAN ROBOT INTERACTION; OBJECT RECOGNITION; PROBABILITY; ROBOTICS;

SPEECH RECOGNITION;

EID: 84855580103     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Australian Bureau of Statistics. Population Projections: Australia 1999-2101. Canberra: ABS, Catalogue No. 3222.0, 2000.
2. Karl B. J. Axnick & Ray Jarvis. Face and Pose Recognition for Robotic Surveillance. Australasian Conference on Robotics and Automation (ACRA), December 2005.
3. Barton, G. and Delmas, P, A Semi-Automated Colour Predicate for Robust Skin Detection, CITR at Tamaki Campus, Computer Science Department, University of Auckland, 2002.
4. R. A. Bolt, "Put that there: Voice and gesture at the graphics interface," Comput. Graph., vol. 14, no. 3, pp. 262-270, 1980.
5. C.C. Chakaradeep. A Simple Speech Application Using SAPI 5.1 SDK. [Cited 2007 January]. Available from: http://www.codeproject.com/audio/SAPI.asp.
6. P. Cohen, M. Johnston, D. McGee, S. Oviatt, J. Pittman, I. Smith, L. Chen, and J. Clow. QuickSet: Multimodal interaction for distributed applications, Proceedings of the Fifth Annual International Multimodal Conference, ACM Press: New York. November, 1997
7. C. Codella, R. Jalili, L. Koved, J. Lewis, D. Ling, J. Lipscomb, D. Rabenhorst, C. Wang, A. Norton, P. Sweeney, and C. Turk, Interactive simulation in a multi-person virtual world, in Proc. ACM Conf. Human. Factors in Computing Systems (CHI'92), pp. 329-334. 1992. (Pubitemid 23609823)
8. Jacob Eisenstein and C. Mario Christoudias. A Salience-Based Approach to Gesture-Speech Alignment. In Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, pp.2532. East Stroudsburg, Pennsylvania, May 2-7 2004.
9. M. Fukumoto, Y. Suenaga, and K. Mase, "Finger-pointer: pointing interface by image processing," Comput. Graph., vol. 18, no. 5, pp. 633-642, 1994.
10. Gupta O. K. and Jarvis, R. A. Multi-sensory Fusion and Understanding of HumanRobot Interaction in Assistive Robotic Technology Environments: Navigation and Hand-Eye Coordination, Transfer Report, ECSE, IRRC, Monash University, Australia. 2007.
11. Holzapfel, H., Nickel, K., and Stiefelhagen, R. Implementation and evaluation of a constraint-based multimodal fusion system for speech and 3D pointing gestures. In Proceedings of the 6th international Conference on Multimodal interfaces (State College, PA, USA, October 13 - 15, 2004). 2004.
12. Intel, Open Source Computer Vision Library, v1.0. http://www.intel.com/ technology/computing/opencv/ 2006.
13. Johnston, M. and Bangalore, S. Finite-state multimodal parsing and understanding. In Proceedings of the 18th Conference on Computational Linguistics - Volume 1 (Saarbrücken, Germany, July 31 - August 04, 2000). International Conference On Computational Linguistics. Association for Computational Linguistics, Morristown, NJ, 369-375. 2000.
14. Michael J Jones and James M Rehg. Statistical Color Models with Application to Skin Detection. International Journal of Computer Vision, 46(1):81-96, 2002. (Pubitemid 34138494)
15. Ketteberov, S., Sharma, R. Toward Natural Speeach/Gesture Control of a Large Display. Lecture Notes in Computer Science, vol 2254, Proceedings of the 8th IFIP International Conference on engineernig for Human-Computer Interaction, pp221-234, 2001.
16. Diego Macrini, Indexing and Matching for View-Based 3-D Object Recognition Using Shock Graphs, in Graduate Department of Computer Science. 2003, University of Toronto.
17. Oviatt, S., "Advances in robust multimodal interface design," Computer Graphics and Applications, IEEE, vol.23, no.5, pp. 62-68, Sept.-Oct. 2003
18. SL Phung, D Chai and A Bouzerdoum, A Universal and Robust Human Skin Colour Model Using Neural Networks. Proc INNS-IEEE Int'l Joint Conf Neural Networks. vol 4, pp 2844-2849, July 2001. (Pubitemid 32794762)
19. Poddar, I., Sethi, Y., Ozyildiz, E., Sharma, R. Toward Natural Gesture/Speech HCI: A Case Study of Weather narration. Proceedings of the Workshop on Perceptual User Interfaces, PUI98, San Francisco, CA, pp1-6, November 1998.
20. Punarjay Chakravarty, David Rawlinson and Ray Jarvis. Person Tracking, Pursuit & Interception by Mobile Robot, Australasian Conference on Robotics and Automation (ACRA), Auckland, New Zealand, December 2006.
21. Russ, G., Sallans, B. and Hareter, H. Semantic based information fusion in a multimodal interface. HCI'05, International Conference on humancomputer interaction, Las Vegas, Nevada, USA, 20-23 June 2005, pp 94-100.
22. M. T. Vo and C. Wood, "Building an application framework for speech and pen input integration in multimodal learning interfaces," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, Atlanta, GA, pp. 3545-3548. 1996.
23. J. Wang, "Integration of eye-gaze, voice and manual response in multimodal user interface," in Proc. IEEE Int. Conf. Systems, Man and Cybernetics, pp. 3938-3942. 1995.
24. Lizhong Wu, Sharon L. Oviatt, and Philip R. Cohen. Multimodal integration-A statistical view. IEEE Trans. Multimedia, vol. 1, pp. 334-341, Dec. 1999.
25. Lizhong Wu, Sharon L. Oviatt, and Philip R. Cohen. From Members to Teams to Committee - A Robust Approach to Gestural and Multimodal Recognition. IEEE Transactions on Neural Networks, vol. 13, no. 4, July 2002.
26. Ingrid Zukerman, Michael Niemann and Sarah George. Probabilistic, Multi-staged Interpretation of Spoken Utterances" cimca, p. 194, International Conference on Computational Inteligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA'06), 2006.