Natural conversational interfaces to geospatial databases

Transactions in GIS

Volumn 9, Issue 2, 2005, Pages 199-221

  Cai, Guoray ^a   Wang, Hongmei ^a   MacEachren, Alan M ^a   Fuhrmann, Sven ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FORMAL LANGUAGES; HUMAN COMPUTER INTERACTION; PROBLEM SOLVING; SEMANTICS;

COLLABORATIVE ACTIVITIES; COMPUTATIONAL MODELLING; CONCEPTUAL FRAMEWORKS; CONVERSATIONAL INTERFACE; GEOGRAPHICAL INFORMATION; GEOSPATIAL DATABASE; MENTAL STATE; PLAN-BASED; SPOKEN LANGUAGES; TASK DOMAIN;

GEOGRAPHIC INFORMATION SYSTEMS;

COMPUTER SYSTEM; CONCEPTUAL FRAMEWORK; DATABASE; GIS; SOFTWARE;

EID: 24944576132     PISSN: 13611682     EISSN: 14679671     Source Type: Journal    
DOI: 10.1111/j.1467-9671.2005.00213.x     Document Type: Article

References (68)

1. Albrecht J 1997 Universal analytical GIS operations: A task-oriented systematization of data-structure-independent GIS functionality. In Craglia M and Onsrud H (eds) Geographic Information Research: Transatlantic Perspectives. London, Taylor and Francis: 577-91
2. Allen J, Byron D, Dzikovska M, Ferguson G, Galescu L, and Stent A 2001 Towards conversational human-computer interaction. AI Magazine 22 (4): 27-37
3. Armstrong M P 2001 The four way intersection of geospatial information and information technology. In Proceedings of the NRC/CSTB Workshop on Intersections between Geospatial Information and Information Technology, Washington, D.C.
4. Armstrong M P and Densham P J 1995 A conceptual framework for improving human-computer interaction in locational decison-making. In Nyerges T L, Mark D M, Laurini R, and Egenhofer M J (eds) Cognitive Aspects of Human-Computer Interaction for Geographic Information Systems. Dordrecht, Kluwer Academic Publishers: 343-54
5. Bolt R A 1980 Put-that-there: Voice and gesture at the graphics interface. ACM Computer Graphics 14: 262-70
6. Bratman M E 1992 Shared cooperative activity. Philosophical Review 101: 327-41
7. Brennan S E 1998 The grounding problem in conversation with and through computers. In Fussell S R and Kreuz R J (eds) Social and Cognitive Psychological Approaches to Interpersonal Communication. Hillsdale, NJ, Lawrence Erlbaum: 201-25
8. Brewer I and McNeese M D 2003 Using cognitive systems engineering to develop collaborative geospatial military technologies. In Proceedings of the International Conference on Military Geology and Geography, West Point, New York
9. Cai G, Wang H, and MacEachren A M 2003 Communicating vague spatial concepts in human-GIS interactions: A collaborative dialogue approach. In Kuhn W, Worboys M F, and Timpf S (eds) Spatial Information Theory: Foundations of Geographic Information Science. Berlin, Springer Lecture Notes in Computer Science No 2825: 287-300
10. Carroll J M 2000 Five reasons for scenario-based design. Interacting with Computers 13: 43-60
11. Clark H H and Brennan S E 1991 Grounding in communication. In Resnick L B, Levine R M, and Teasley S D (eds) Perspectives on Socially Shared Cognition. Washington, DC, APA: 127-49
12. Cohen P R, Johnston M, McGee D, Oviatt S, Pittman J, Smith I, Chen L, and Clow J 1997 QuickSet: Multimodal interaction for distributed applications. In Proceedings of the Fifth ACM International Conference on Multimedia, Seattle, Washington: 31-40
13. Copas C V and Edmonds E 2000 Intelligent interfaces through interactive planners. Interacting with Computers 12: 545-64
14. Egenhofer M J 1996 Multi-modal spatial querying. In Kraak J M and Molenaar M (eds) Advances in GIS Research II: Proceedings of The Seventh International Symposium on Spatial Data Handling. London, Taylor and Francis: 785-99
15. ESRI 2002 ArcXML Programmer's Reference Guide -ArcIMS 4.0. Redlands, CA, Environmental Systems Research Institute
16. Fischer G 2001 User modeling in human-computer interaction. User Modeling and User-Adapted Interaction 11: 1-18
17. Flanagan J L and Huang T S 2003 Scanning the special issue on human-computer multimodal interfaces. Proceedings of the IEEE 91: 1267-70
18. Florence J, Hornsby K, and Egenhofer M J 1996 The GIS wallboard: Interactions with spatial information on large-scale displays. In Kraak J M and Molenaar M (eds) Advances in GIS Research II: Proceedings of the Seventh International Symposium on Spatial Data Handling. London, Taylor and Francis: 449-63
19. Frank A U and Mark D M 1991 Language issues for GIS. In Maguire D J, Goodchild M F, and Rhind D W (eds) Geographical Information Systems: Principles and Applications. London, Longman: 147-63
20. Glass J, Flammia G, Goodine D, Phillips M, Polifroni J, Sakai S, Seneff S, and Zue V 1995 Multilingual spoken-language understanding in the MIT Voyager system. Speech Communications 17: 1-18
21. Gorin A L, Riccardi G, and Wright J H 1997 How may I help you? Speech Communications 23: 113-27
22. Grosz B J and Kraus S 1996 Collaborative plans for complex group action. Artificial Intelligence 86: 269-357
23. Grosz B J and Sidner C L 1986 Attention, intentions, and the structure of discourse. Computational Linguistics 12: 175-204
24. Grosz B J and Sidner C L 1990 Plans for discourse. In Cohen P R, Morgan J L, and Pollack M E (eds) Intentions in Communication. Cambridge, MA, MIT Press: 417-44
25. Hagen E 1999 An approach to mixed initiative spoken information retrieval dialogue. User Modeling and User-Adapted Interaction 9: 167-213
26. Hobbs J R 1979 Coherence and coreference. Cognitive Science 3: 67-89
27. Jennings N R, Sycara K, and Wooldridge M 1998 A roadmap of agent research and development. Autonomous Agents and Multi-Agent Systems 1: 7-38
28. Jones R M, Copas C V, and Edmonds E A 1997 GIS support for distributed group-work in regional planning. International Journal of Geographical Information Science 11: 53-71
29. Juang B H and Furui S 2000 Automatic recognition and understanding of spoken language: A first step toward natural human-machine communication. Proceedings of the IEEE 88: 1142-65
30. Kettebekov S and Sharma R 2000 Understanding gestures in a multimodal human computer interaction. International Journal of Artificial Intelligence Tools 9: 205-24
31. 2 Map: Crisis management using a multimodal interface. In Proceedings of the ARL Federate Laboratory 4th Annual Symposium, College Park, Maryland
32. Lochbaum K E 1994 Using Collaborative Plans to Model the Intentional Structure of Discourse. Unpublished Ph.D. Dissertation, Harvard University
33. Lochbaum K E 1998 A collaborative planning model of intentional structure. Computational Linguistics 24: 525-72
34. Lochbaum K E, Grosz B J, and Sidner C L 2000 Discourse structure and intention recognition. In Dale R, Moisl H, and Somers H (eds) Handbook of Natural Language Processing. New York, Marcel Dekker: 123-46
35. Lokuge I and Ishizaki S 1995 Geospace: An interactive visualization system for exploring complex information spaces. In Proceedings of the International Conference in Human Factors in Computer Systems (CHI'95), New York: 409-14
36. MacEachren A M and Brewer I 2004 Developing a conceptual framework for visually-enabled geocollaboration. International Journal of Geographical Information Science 18: 1-34
37. MacEachren A M, Cai G, Sharma R, Brewer I and Rauschert I 2005 Enabling collaborative geoinformation access and decision-making through a natural, multimodal interface. International Journal of Geographical Information Science 19: 1-26
38. MacEachren A M and Kraak M-J 2001 Research challenges in geovisualization. Cartography and Geographic Information Science 28: 3-12
39. Mann W C and Thompson S A 1987 Rhetorical Structure Theory: A Theory of Text Organization. Los Angeles, CA, Information Science Institute (ISI) Report No. RR-87-90
40. Mark D and Frank A 1992 User Interfaces for Geographic Information Systems. Santa Barbara, CA, National Center for Geographic Information and Analysis Technical Report No. 92-3
41. McTear M F 2002 Spoken dialogue technology: Enabling the conversational user interface. ACM Computing Surveys 34: 90-169
42. Mondschein L G 1994 The role of spatial information systems in environmental emergency management. Journal of the American Society for Information Science 45: 678-85
43. Muntz R R, Barclay T, Dozier J, Faloutsos C, MacEachren A M, Martin J L, Pancake C M, and Satyanarayanan M 2003 IT Roadmap to a Geospatial Future: Report of the Committee on Intersections Between Geospatial Information and Information Technology. Washington, DC, National Academy of Sciences Press
44. Neal J G, Thielman C Y, Dobes Z, Haller S M, and Shapiro S C 1998 Natural language with integrated deictic and graphic gestures. In Maybury M T and Wahlster W (eds) Readings in Intelligent User Interfaces. San Francisco, CA, Morgan Kaufman: 38-51
45. Neal J G, Thielman C Y, Funke D J, and Byoun J S 1989 Multimodal output composition for human-computer dialogues. In Proceedings of the IEEE AI Systems in Government Conference, Washington, DC: 250-7
46. Nielsen J 1993 Usability Engineering. Boston, AP Professional
47. Nyerges T, Barndt M, and Brooks K 1997 Public participation geographic information systems. In Proceedings of Auto-Carto 13, Seattle, Washington: 224-33
48. O'Shaughnessy D 2003 Interacting with computers by voice: Automatic speech recognition and synthesis. Proceedings of the IEEE 91: 1272-305
49. Oviatt S 1996 Multimodal interfaces for dynamic interactive maps. In Proceedings of the International Conference on Human Factors in Computing Systems (CHI'96): 95-102
50. Oviatt S and Cohen P 2000 Multimodal interfaces that process what comes naturally. Communications of the ACM 43 (3): 45-53
51. Oviatt S, Cohen P, Wu L, Vergo J, Duncan L, Suhm B, Bers J, Holzman T, Winograd T, Landay J, Larson J, and Ferro D 2000 Designing the user interface for multimodal speech and pen-based gesture applications: State-of-the-art systems and future research directions. Human-Computer Interaction 15: 263-322
52. Pollack M E 1990 Plans as complex mental attitude. In Cohen P R and Morgan J L (eds) Intentions in Communication. Cambridge, MA, MIT Press: 77-103
53. Rauschert I, Agrawal P, Fuhrmann S, Brewer I, Sharma R, Cai G, and MacEachren A 2002 Designing a user-centered, multimodal GIS interface to support emergency management. In Proceedings of the Tenth ACM International Symposium on Advances in Geographic Information Systems, McLean, Virginia: 119-24
54. Rubin J 1994 Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. New York, John Wiley and Sons
55. Shapiro S C, Chalupski C H, and Chou H C 1991 Linking Arc/INFO with SNACTor. Santa Barbara, CA, National Center for Geographic Information and Analysis Technical Report No. 91-11
56. Sharma R, Pavlovic V I, and Huang T S 1998 Toward multimodal human-computer interface. Proceedings of the IEEE 86: 853-69
57. Sharma R, Poddar I, Ozyildiz E, Kettebekov S, Kim H, and Huang T S 1999 Toward interpretation of natural speech/gesture: Spatial planning on a virtual map. In Proceedings of ARL Advanced Displays Annual Symposium, Adelphi, Maryland: 35-9
58. Sharma R, Yeasin M, Krahnstoever N, Rauschert, Cai G, Brewer I, MacEachren A, and Sengupta K 2003 Speech-gesture driven multimodal interfaces for crisis management. Proceedings of the IEEE 91: 1327-54
59. Terveen L G 1995 Overview of human-computer collaboration. Knowledge-Based Systems 8: 67-81
60. Timpf S 2003 Geographic activity models. In Duckham M, Goodchild M, and Worboys M F (eds) Foundations of Geographic Information Science. London, Taylor and Francis: 241-54
61. Torres R J 2002 Practitioner's Handbook for User Interface Design and Development. Upper Saddle River, NJ, Prentice Hall
62. Traynor C and Williams M G 1995 Why are geographic information systems hard to use? In Proceedings of the International Conference on Human Factors in Computing Systems (CHI'95), Denver, Colorado: 288-9
63. W3C 2000 Simple Object Access Protocol (SOAP) 1.1, World Wide Web Consortium
64. Wang F 2003 Handling grammatical errors, ambiguity and impreciseness in GIS natural language queries. Transactions in GIS 7: 103 -21
65. Wilson A and Bobick A 1999 Parametric hidden Markov models for gesture recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 21: 884-900
66. Zerger A and Smith D I 2003 Impediments to using GIS for real-time disaster decision support. Computers, Environment and Urban Systems 27: 123-41
67. Zue V, Glass J, Goddeau D, Goodine D, Leung H, McCandless M, Phillips M, Polfroni J, Seneff S, and Whitney D 1990 Recent progress on the MIT voyager spoken language system. In Proceedings of the ICSLP: 1317-20
68. Zue V W and Glass J R 2000 Conversational interfaces: Advances and challenges. Proceedings of the IEEE 88: 1166-80