A spoken dialogue system for navigation in non-immersive virtual environments

Computer Graphics Forum

Volumn 21, Issue 4, 2002, Pages 713-722

  McNeill, M D J ^a   Sayers, H ^a   Wilson, S ^a   Mc Kevitt, P ^a  

^a UNIVERSITY OF ULSTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER GRAPHICS; HUMAN COMPUTER INTERACTION; NAVIGATION; SPEECH RECOGNITION; VIRTUAL REALITY;

MULTI-MODAL INTERACTION;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 0036915247     PISSN: 01677055     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-8659.00629     Document Type: Conference Paper

References (57)

1. J. Susanne and G.W. Furnas. Navigation in electronic worlds. In CHI'97 Workshop, SIGCHI Bulletin, 29(4), pages 44-49. 1997.
2. K. Kulwinder. Designing virtual environments for usability, PhD Thesis, Centre for Human-Computer Interface Design, City University, London, 1998.
3. S. Rushton and J. Wann. Problems in perception and action in virtual worlds. Virtual Reality International'93, 10:43-55, 1993.
4. K. Stanney. Towards human-centered systems. IEEE Computer Graphics and Applications, 21-28, July/August, 1997.
5. M. Mohageg, R. Myers, C. Martin, J. Kent, D. Mott and P. Isaacs. A user interface for accessing 3D content on the world wide web. In Proceedings of CHI'96, ACM Press, pages 466-472. 1996.
6. L.D. Miller. Metrics for Usability Standards in Computing (MUSIC): A usability evaluation of the Rolls-Royce virtual reality for aero engine maintenance system, Masters Thesis, University College, 1994.
7. T. Johnsgard. Fitt's law with a virtual reality glove and a mouse: Effects of gain. In Proceedings of Graphics Interface '94, pages 8-15. 1994.
8. D.S. Tan, G.G. Robertson and M. Czerwinski. Exploring 3D navigation: combining speed-coupled flying with orbiting. In Proceedings ACM CHI 2001, pages 418-425. 2001.
9. H.M. Sayers, S. Wilson, W. Myles and M.D.J. McNeill. Usable interfaces for virtual environment applications on non-immersive systems. In Proceedings Eurographics UK Conference. 2000.
10. N.G. Vinson. Design guidelines for landmarks to support navigation in virtual environments. In Proceedings of ACM CHI'99, pages 142-149. 1999.
11. A. van Ballegooij and A. Eliens. Navigation by query in virtual worlds. In ACM Web3D Conference 2001, Paderbon, Germany, pp. 77-83. 2001.
12. V. Tanriverdi and R.J.K. Jacob. Interacting with eye movements in virtual environments. In Proceedings ACM CHI 2000, pages 265-272. 2000.
13. P. Mc Kevitt (ed.). Integration of Natural Language and Vision Processing (Volumes I-IV). Kluwer Academic Publishers, 1995/96.
14. D. Golightly, K.S. Hone and F.E. Ritter. Speech interaction can support problem solving. In M. Angela Sasse and Chris Johnson (eds), Human-Computer Interaction, INTERACT'99, IOS Press, pages 149-155. 1999.
15. M. Billinghurst, J. Savage, P. Oppenheimer and C. Edmond. The expert surgical assistant: an intelligent virtual environment with multimodal input. In S. Weghorst, H.B. Sieberg and K.S. Morgan (eds), Proceedings of Medicine Meets Virtual Reality IV, pages 590-607. 1995.
16. D. Weiner and S.K. Ganapathy. A synthetic visual environment with hand gesturing and voice input. In Conference on Human Factors in Computing Systems (CHI'89), pages 235-240. 1989.
17. R.A. Bolt. Put-That-There: voice and gesture at the graphics interface. In ACM SIGGRAPH Proceedings 1980, pages 262-270. 1980.
18. P. Mc Kevitt. Visions for language. In Proceedings of the Workshop on Integration of Natural Language and Vision processing, Twelfth American National Conference on Artificial Intelligence AAAI-94, pages 44-57. 1994.
19. P. Mc Kevitt. SuperinformationhighwayS "Sprog og multimedier" (speech and multimedia). In Tom Bröndsted and Inger Lytje (eds), Aalborg University Press, pages 166-183. 1997.
20. D. Partridge. A new guide to Artificial Intelligence. Ablex Publishing Corporation, 1991.
21. E. Rich and K. Knight. Artificial Intelligence. McGraw-Hill, 1991.
22. D. Dennett. Consciousness explained. Penguin, 1991.
23. S.M. Kosslyn and J.R. Pomerantz. Imagery, propositions and the form of internal representations. Cognitive Psychology, (9):52-76, 1977.
24. Z. Pylyshyn. What the mind's eye tells the mind's brain: a critique of mental imagery. Psychological Bulletin, (80): 1-24, 1973.
25. W. Wahlster. One word says more than a thousand pictures: On the automatic verbalization of the results of image sequence analysis. Bereich Nr. 25. Universität des Saarlandes, 1988.
26. D. Waltz. Understanding line drawings of scenes with shadows. The psychology of computer vision, P.H. Winston (ed), McGraw-Hill, pages 19-91. 1975.
27. G. Herzog and G. Retz-Schmidt. Das system SOCCER: simultan Interpretation und naturalichsprachliche. Beschreibung zeitveranderlicher Szenen Sport und Informatik. J. Perl (ed), Hofmann, 1990.
28. B. Neumann and H.J. Novak. NAOS: ein system zur naturalichsprachlichen. Beschreibung zeitveranderlicher Szenen Informatik, Forschung und Entwicklung, 1(1):83-92, 1986.
29. G. Retz-Schmidt. Recognizing intentions, ineractions, and causes of plan failures. User Modelling and User-Adapted Interaction, (1): 173-202, 1991.
30. G. Retz-Schmidt and M. Tetzlaff. Methods for the intentional description of image sequences. Bereich Nr. 80. Universität des Saarlandes, Germany, 1991.
31. G. Herzog, C.K. Sung, E. André W. Enkelmann, H.H. Nagel, T. Rist and W. Wahlster. Incremental natural language description of dynamic imagery. In C. Freksa and W. Brauer (eds), Wissenbasierte Systeme. 3, Springer-Verlag, pp. 153-162. 1989.
32. E. André, G. Herzog and T. Rist. On the simultaneous interpretation of real-world image sequences and their natural language description: the system SOCCER. In Proceedings of the 8th European Conference on Artificial Intelligence, pages 449-454. 1988.
33. W. Maas, P. Wiziniski and G. Herzog. VITRA GUIDE: Multimodal route descriptions for computer assisted vehicle navigation. Bereich Nr. 93. Universität des Saarlandes, 1993.
34. M. Maybury (ed.). Intelligent multimedia interfaces. AAAI Press, Menlo Park, CA, 1993.
35. M. Maybury and W. Wahlster (eds.). Readings in intelligent user interfaces. Morgan Kaufmann Publishers, 1998.
36. G. Carenini, F. Pianesi, M. Ponzi and O. Stock. Natural language generation and hypertext access. In IRST Technical Report 9201-06. Instituto Per La Scientifica E Tecnologica, Loc. Pant e Di Povo, I-138100 Trento, Italy, 1992.
37. O. Stock. Natural language and exploration of an information space: the ALFresco Interactive system. In Proceedings of the 12th International Joint Conference on Artificial Intelligence (IJCAI-91), pages 972-978. 1991.
38. E. André and T. Rist. The design of illustrated documents as a planning task intelligent multimedia interfaces. In M. Maybury (ed), AAAI Press, Menlo Park, CA, pages 75-93. 1993.
39. W. Wahlster, E. André W. Finkler, M.J. Profitlich and T. Rist. Plan-based integration of natural language and graphics generation. Artificial Intelligence, Special issue on natural language generation, (63):387-427, 1993.
40. M. Maybury. Planning multimedia explanations using communicative acts. In Proceedings of the Ninth American National Conference on Artificial Intelligence (AAAI-91), pages 14-19. 1991.
41. T. Broendsted, P. Dalsgaard, L.B. Larsen, M. Manthey, P. Mc Kevitt, T.B. Moeslund and K.G. Olesen. A platform for developing intelligent multimedia applications. In Technical Report R-98-1004. Center for Person Kommunikation (CPK), Institute for Electronic Systems (IES), Aalborg University, Denmark, 1998.
42. T. Broendsted, L.B. Larsen, M. Manthey, P. Mc Kevitt, T.B. Moeslund and K.G. Olesen. The IntelliMedia WorkBench: a generic environment for multimodal systems. In Robert H. Mannell and Jordi Robert-Ribes (eds), Proceedings of the Fifth International Conference on Spoken Language Processing (ICSLP-98), (2), pages 273-276. 1998.
43. T. Broendsted, L.B. Larsen, M. Manthey, P. Mc Kevitt, T.B. Moeslund and K.G. Olesen. CHAMELEON: a general platform for performing intellimedia. In P. Mc Kevitt, S. O'Nuallain and C. Mulvihill (eds), Language, Vision and Music, AiCR, John Benjamins Publishing, Amsterdam, pages 79-96. 2002.
44. T. Broendsted, P. Dalsgaard, L.B. Larsen, M. Manthey, P. Mc Kevitt, T.B. Moeslund and K.G. Olesen. The IntelliMedia WorkBench - an environment for building multimodal systems. In Advances in Cooperative Multimodal Communication: Second International Conference, CMC'98, pages 217-233. 1998.
45. T. Broendsted, P. Dalsgaard, L.B. Larsen, M. Manthey, P. Mc Kevitt, T.B. Moeslund and K.G. Olesen. Developing intelligent multimedia applications. Multi-modality in Language and Speech Systems (MiLaSS), B. Granstrom, I. Karlsson and D. House (eds), Kluwer Academic Publishers, pages 149-171. 2002.
46. P. Mc Kevitt and P. Dalsgaard. A frame semantics for an IntelliMedia TourGuide. In Proceedings of the Eighth Ireland Conference on Artificial Intelligence (AI-97), volume 1, University of Ulster, Northern Ireland, pages 104-111. 1997.
47. G. Rickheit and I. Wachsmuth. Collaborative Research Centre "Situated Artificial Communicators" at the University of Bielefeld. Integration of Natural Language and Vision Processing, volume IV, Recent Advances, P. Mc Kevitt (ed), Kluwer Academic Publishers, pages 11-16. 1996.
48. K.R. Thörisson. Communicative humanoids: a computational model of psychosocial dialogue skills, Ph.D. thesis, Massachusetts Institute of Technology, 1996.
49. K.R. Thörisson. Layered action control in communicative humanoids. In Proceedings of Computer Graphics Europe '97. 1997.
50. Naoyuki Okada. Integrating vision, motion and language through mind. Integration of Natural Language and Vision Processing, volume IV, Recent Advances, P. Mc Kevitt (ed), Kluwer Academic Publishers, pages 55-80. 1996.
51. N. Okada. Integrating vision, motion and language through mind. In Proceedings of the Eighth Ireland Conference on Artificial Intelligence (AI-97), volume 1, University of Uster, Northern Ireland, pages 7-16. 1997.
52. A. Waibel, M.T. Vo, P. Duchnowski and S. Manke. Multimodal interfaces. In P. Mc Kevitt (ed), Integration of Natural Language and Vision Processing, volume IV, Recent Advances, Kluwer Academic Publishers, pp. 145-165. 1996.
53. M. Denis and M. Carfantan (eds.). Images et langages: multimodalit/e et modelisation cognitive. Acres du Colloque Interdisciplinaire du Comit/e Nationa de la Recherche Scientifique. Salle des Conférences, Siége du CNRS, Paris, 1993.
54. A. Pentland (ed.). Looking at people: recognition and interpretation of human action, in IJCAI-93 Workshop (W28) at The 13th International Conference on Artificial Intelligence (IJCAI-93). Chambéry, France, 1993.
55. D. Bowman, D. Koller and L. Hodges. Travel in immersive virtual environments: an evaluation of viewpoint motion control techniques. In Proceedings of the 1997 Virtual Reality Annual International Symposium (VRAIS), pages 45-52. 1997.
56. R.P. Darken and J.L. Silbert. A Toolset for Navigation in Virtual Environments. In Proceedings of UIST '93, pages 157-165. 1993.
57. D.D. Salvucci and J.R. Anderson. Intelligent Gazeadded interfaces. In Proceedings ACM CHI2000, pages 273-280. 2000.