A study of manual gesture-based selection for the PEMMI multimodal transport management interface

Proceedings of the Seventh International Conference on Multimodal Interfaces, ICMI'05

Volumn , Issue , 2005, Pages 274-281

  Chen, Fang ^a   Choi, Eric ^a   Epps, Julien ^a   Lichman, Serge ^a   Ruiz, Natalie ^a,b   Shi, Yu ^a   Taib, Ronnie ^a,b   Wu, Mike ^a  

^a National IGT Australia   (Australia)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Manual gesture; Multimodal fusion; Multimodal interaction; Multimodal output generation; Speech

Indexed keywords

CONTROL SYSTEMS; FEEDBACK; GESTURE RECOGNITION; LARGE SCALE SYSTEMS; SPEECH; SPEECH RECOGNITION;

MANUAL GESTURE; MULTIMODAL FUSION; MULTIMODAL INTERACTION; MULTIMODAL OUTPUT GENERATION; PERCEPTUALLY EFFECTIVE MULTIMODAL INTERFACE (PEMMI);

USER INTERFACES;

EID: 32344442005     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1088463.1088510     Document Type: Conference Paper

References (21)

1. Baudel, T. and Beaudouin-Lafon M. Charade: Remote Control of Objects Using Free-Hand Gestures. Communications of the ACM, 36, 7, (1993), 28-35.
2. Bolt, R. A. "Put-that-there": Voice and gesture at the graphic interface. Proc. of Computer Graphics (SIGGRAPH'80), 14, 3 (1980), 262-270.
3. Card, S. K., J. D. Mackinlay, et al., (Eds.) Information Visualization. Readings in Information Visualization. San Francisco, California, Morgan Kaufmann, (1999).
4. th Int. Multimedia Conf. (Multimedia '97), ACM Press: Seattle, WA, (1997), 31-40.
5. Corradini, A., Wesson, R. M., and Cohen, P. R. A Map-based System Using Speech and 3D Gestures for Pervasive Computing. In Proc. IEEE Int. Conf. on Multimodal Interfaces, Pittsburgh, PA, (2002), 191-196.
6. Elting C. Michelitsch G. A Multimodal Presentation Planner for a Home Entertainment Environment. In Proc. PUI 2001, Orlando FL, USA. ACM Press: New York, NY, (2001), 1-5.
7. Epps, J., Oviatt, S., and Chen, F. Integration of Speech and Gesture Inputs during Multimodal Interaction. In Proc. Aust. Int. Conf. on Computer-Human Interact. (OZCHI), (2004).
8. Gomez, G., Moralez, E. Automatic feature construction and a simple rule induction algorithm for skin detection. In Proc. IMCL Workshop on Machine Learning in Computer Vision, (2002), 31-38.
9. Graham, E. and MacKenzie, C.L. Pointing on a Computer Display. In Proc. Conf. companion on Human Factors in Computing Systems (1995), 314-315.
10. ISO Report number ISO/TC 159/SC4/WG3 N147: Ergonomic requirements for office work with visual display terminals (VDTs) - part 9 - Requirements for non-keyboard input devices (ISO 9241-9), International Organisation for Standardisation, 1998.
11. Jojic, N., Brumitt, B., Meyers, B., and Harris, S. Detecting and estimating pointing gestures in dense disparity maps. In Proc. IEEE Int. Conf. on Face and Gesture Recog. (2000), 468-475.
12. Kelly, M.J. Preliminary Human Factors Guidelines for Traffic Management Centers. Technical Report FHWA-JPO-99-042, U.S. Department of Transportation, (1999).
13. Miller, G. A. The Magic Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. Psychological Review 63, (1957), 81-97.
14. Mousavi, S., Low, R., and Sweller, J. Reducing cognitive load by mixing auditory and visual presentation modes. Journal of Educational Psychology, 87 (1995). 319-334.
15. Nesbitt, K. V. Multi-sensory Display of Abstract Data, PhD thesis, School of Information Technology, University of Sydney, (2003).
16. Nickel, K., and Stiefelhagen, R. User tests and multimodal gesture: Pointing gesture recognition based on 3-D tracking of face, hands and head orientation. In Proc. Int. Conf. on Multimodal Interfaces (2003), 140-146.
17. Oviatt, S. L. Ten myths of multimodal interaction, Communications of the ACM, 42, 11, (1999), 74-81.
18. Oviatt, S., Coulston, R., and Lunsford, R. When Do We Interact Multimodally? Cognitive Load and Multimodal Communication Patterns. In Proc. 6th Int. Conf. on Multimodal Interfaces (2004).
19. Plaisant, C., Tamoff, P., Keswani, S. and Rose, A. Understanding Transportation Management Systems Performance with a Simulation-Based Learning Environment. In Proc. Conference on Intelligent Transportation Systems ' 99 (CD ROM), (1999).
20. Schapira, E. and Sharma, R. Experimental Evaluation of Vision and Speech Based Multimodal Interfaces. In Proc. PUI 2001, ACM Press (2001), 1-9.
21. Wilson, A., and Oliver, N. GWindows: Robust stereo vision for gesture-based control of windows. In Proc. Int. Conf. on Multimodal Interfaces (2003), 140-146.