Multimodal speech-gesture interface for handfree painting on a virtual paper using partial recurrent neural networks as gesture recognizer

Proceedings of the International Joint Conference on Neural Networks

Volumn 3, Issue , 2002, Pages 2293-2298

  Corradini, Andrea ^a   Cohen, Philip R ^a  

^a Center for Human Computer Communication   (United States)

Author keywords

Augmented and virtual reality; Communication agent; Multimodal system; Painting tool; Partial recurrent artificial neural network; Pointing gesture; Speech recognition; User centered interface

Indexed keywords

GESTURE RECOGNITION; INTERACTIVE COMPUTER GRAPHICS; MULTIMEDIA SYSTEMS; SPEECH RECOGNITION; THREE DIMENSIONAL COMPUTER GRAPHICS; USER INTERFACES; VIRTUAL REALITY;

MULTIMODAL SYSTEM; PAINTING TOOL; POINTING GESTURE; VIRTUAL PAPER;

RECURRENT NEURAL NETWORKS;

EID: 0036086033     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. VRPN: A device-independent, network-transparent VR peripheral system
2. Dynamic gesture recognition using neural networks; a fundament for advanced interaction construction
3. Put-that-there: Voice and gesture at the graphics interface
4. Uncalibrated stereo vision with pointing for a man-machine interface
5. Quickset: Multimodal interactions for distributed applications
6. Camera-based gesture recognition for robot control
7. Finger tracking as an input device for augmented reality
8. Finding structure in time
9. Realtime detection of pointing actions for a glove-free interface
10. Gesture with speech for graphics manipulation
11. Detection and estimation of pointing gestures in dense disparity maps
12. Serial order: A parallel distributed processing approach advances in connectionist theory
13. The biological fundations of gestures: Motor and semiotic aspects
14. The adaptive agent architecture: Achieving fault-tolerance using persistent broker teams
15. Review of neural networks for speech recognition
16. Multimodal interfaces for dynamic interactive maps
17. Multimodal interfaces that process what comes naturally
18. Designing the user interface for multimodal speech and gesture applications: State-of-the-art systems and research directions
19. Integration and synchronization of input modes during multimodal HCI
20. The role of the hand in the evolution of language
21. FingerMouse: A freehand computer pointing interface
22. Speech/gesture interface to visual-computing environment
23. Concentrating information in time analog neural networks with applications to speech recognitions
24. Multimodal human-computer interface combination of gesture and speech recognition
25. Phoneme recognition using time-delay neural networks
26. Multimodal integration - a statistical view