Enabling collaborative geoinformation access and decision-making through a natural, multimodal interface

International Journal of Geographical Information Science

Volumn 19, Issue 3, 2005, Pages 293-317

  Maceachren, A M ^a   Cai, G ^a   Sharma, R ^a   Rauschert, I ^a   Brewer, I ^a   Bolelli, L ^a   Shaparenko, B ^a   Fuhrmann, S ^a   Wang, H ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Decision making; Emergency response; Geocollaboration; Geoinformation; GIS; Multimodal interface

Indexed keywords

DECISION MAKING; GIS; SOFTWARE;

EID: 14844354568     PISSN: 13658816     EISSN: None     Source Type: Journal    
DOI: 10.1080/13658810412331280158     Document Type: Article

References (79)

1. Al-Kodmany, K., 2000, Extending geographic information systems to meet neighborhood planning needs: the case of three Chicago communities. URISA Journal, 12, pp. 19-37.
2. Allen, J., Byron, D., Dzikovska, M., Ferguson, G., Galescu, L. and Stent, A., 2001, Towards conversational human-computer interaction. AI Magazine, 22, pp. 27-37.
3. Armstrong, M.P. and Densham, P.J., 1995, A conceptual framework for improving human-computer interaction in locational decison-making. In Cognitive Aspects of Human-Computer Interaction for Geographic Information Systems, M.J. Egenhofer (Ed.), pp. 343-354 (Dordrecht: Kluwer Academic).
4. Balkanski, C. and Hurault-Plantet, M., 2000, Cooperative requests and replies in a collaborative dialogue model. International Journal of Human-Computer Studies, 53, pp. 915-968.
5. Blaser, A. and Egenhofer, M., 2000, A visual tool for querying geographic databases. In AVI2000-Advanced Visual Databases, Salerno Salerno, Italy, May 2000, pp. 211-216.
6. Burrough, P.A. and Frank, A.U. (Eds.), 1996, Geographic Objects With Indeterminate Boundaries (London: Taylor & Francis).
7. Cai, G., Wang, H. and MacEachren, A., 2003, Communicating vague spatial concepts in human-GIS interactions: a collaborative dialogue approach. In COSIT 2003: Conference on Spatial Information Theory, Lecture Notes in Computer Science (LNCS) 2825, Ittingen, Switzerland, 24-28 September, pp. 287-300.
8. Chang, S.-K., 2000, The sentient map. Journal of Visual Languages and Computing, 11, pp. 455-474.
9. Codella, C., Jalili R., Koved, L., Lewis, J.B., Ling, D.T., Lipscomb, J.S., Rabenhorst, D.A., Wang, C.P., Norton, A., Sweeney, P. and Turk, G., 1992, Interactive simulation in a multi-person virtual world. In ACM Conference on Human Factors in Computing Systems-CHI'92, pp. 329-334.
10. Corradini, A.C. and Cohen, P.R., 2002, Multimodal speech-gesture interface for handfree painting on a virtual paper using partial recurrent neural networks as gesture recognizer. In Proceedings of the International Joint Conference on Artificial Neural Networks (IJCNN'02), Honolulu, HI, 12-17 May 2002, pp. 2293-2298.
11. Densham, P.J., Armstrong, M.P. and Kemp, K.K., 1995, NCGIA Initiative 17 on Collaborative Spatial Decision-Making (Santa Barbara, CA: NCGIA).
12. Egenhofer, M.J., 1996, Multi-modal spatial querying. In International Symposium on Spatial Data Handling, Delft, The Netherlands, pp. 785-799.
13. Egenhofer, M.J., 1997, Query processing in spatial-query-by-sketch. Journal of Visual Languages and Computing, 8, pp. 403-424.
14. Egenhofer, M.J., and Franzosa, R.D., 1995, On the equivalence of topological relations. International Journal of Geographical Information Systems, 9, pp. 133-152.
15. Egenhofer, M.J., and Golledge, R.G., 1998, Spatial and Temporal Reasoning in Geographic Information Systems (New York: Oxford University Press).
16. Fabrikant, S.I. and Buttenfield, B.P., 2001, Formalizing semantic spaces for information access. Annals of the Association of American Geographers, 91, pp. 263-280.
17. Fisher, P., 2000, Sorites paradox and vague geographies. Fuzzy Sets and Systems, 113, pp. 7-18.
18. Florence, J., Hornsby, K. and Egenhofer, M.J., 1996, The GIS Wallboad: interactions with spatial information on large-scale display. In International Conference on Spatial Data Handling, pp. 8A.1-8A.15.
19. Frank, A.U. and Mark, D.M., 1991, Language issues for GIS. In Geographical Information Systems: Principles and Applications, D.W. Rhind (Ed.), Vol. 1, pp. 147-163 (London: Longman).
20. Fukumoto, M., Suenaga, Y. and Mase, K., 1994, Finger-pointer: Pointing interface by image processing. Computers and Graphics, 18, pp. 633-642.
21. Gargano, M., Nardelli, E. and Talamo, M., 1992, A model for complex data: Completeness and soundness properties. In Geographic Database Management Systems, G. Gambosi, M. Scholl and H.-W. Six (Eds.), pp. 56-78 (Berlin: Springer).
22. Glass, J., FLammia, G., Goodine, D., Phillips, M., Polifroni, J., Sakai, S., Seneff, S. and Ze, V., 1995, Multilingual spoken-language understanding in the MIT Voyager system. Speech Communications '95 17, pp. 1-18.
23. Goodchild, M.F., 1999, Future directions in geographic information science. Geographic Information Science, 5, pp. 1-8.
24. Grosz, B.J. and Kraus, S., 1996, Collaborative plans for complex group action. Artificial Intelligence, 86, pp. 269-357.
25. Grosz, B.J. and Sidner, C.L., 1986, Attention, intentions, and the structure of discourse. Computational Linguistics, 12, pp. 175-204.
26. Grosz, B.J. and Sidne, C.L., 1990, Plans for discourse. In Intentions in Communication, M.E. Pollack (Ed.), pp. 417-444 (Cambridge, MA: MIT Press).
27. Hollnagel, E. and Woods, D.D., 1983, Cognitive systems engineering: New wine in new bottles. International Journal of Man-Machine Studies, 18, pp. 583-600.
28. Hopkins, L.D., Ramanathan, R. and George, R.V.., 2001, Interface for a Planning Workbench, Department of Urban and Regional Planning, University of Illinois at Urbana-Champaign. Available at http:// www.rehearsal.uiuc.edu/DesignWorkSpace/ [2001, Nov. 4, 2001].
29. Jankowski, P. and Nyerges, T., 2001, Geographic Information Systems for Group Decision Making: Towards a Participatory, Geographic Information Science (New York: Taylor & Francis).
30. Jankowski, P., Nyerges, T.L., Smith, A., Moore, T.J. and Horvath, E., 1997, Spatial group choice: a SDSS tool for collaborative spatial decision-making. International Journal of Geographical Information Science, 11, pp. 577-602.
31. Jokinen, K., Sadek, D. and Traum, D., 2000, Introduction to Special Issue on Collaboration, Cooperation and Conflict in Dialogue Systems. International Journal of Human Computer Studies, 53, pp. 867-870.
32. Kettebekov, S., Krahnstöver, N., Leas, M., Polat, E., Raju, H., Schapira, E. and Sharma, R., 2000, i2Map: Crisis Management using a Multimodal Interface. In ARL Federate Laboratory 4th Annual Symposium March, 2000, College Park, MD.
33. Kettebekov, S. and Sharma, R., 2000, Understanding gestures in a multimodal human computer interaction. International Journal of Artificial Intelligence Tools, 9, pp. 205-224.
34. Koons, D.B. and Sparell, C.J., 1994, Iconic: speech and depictive gestures at the human-machine interface. In Proceedings of the CHI '94 Conference, pp. 453-454.
35. Krahnstoever, N., Kettebekov, S., Yeasin, M. and Sharma, R., 2002, A real-time framework for natural multimodal interaction with large screen displays. In Fourth International Conference on Multimodal Interfaces (ICMI), Pittsburgh, PA, 14-16 October, pp. 349-354.
36. Larson, R.R., 1996, Geographic information retrieval and spatial browsing. In M. Gluck (Ed.), GIS and Libraries: Patrons, Maps and Spatial Information (pp. 81-124). Urbana-Champaign: University of Illinois.
37. Lochbaum, K.E., 1998, A collaborative planning model of intentional structure. Computational Linguistics, 24, pp. 525-572.
38. Lokuge, I. and Ishizaki, S., 1995, Geospace: An interactive visualization system for exploring complex information spaces. In CHI '89 Conference Proceedings, 1995, New York, pp. 409-414.
39. MacEachren, A.M., 2000, Cartography and GIS: facilitating collaboration. Progress in Human Geography, 24, pp. 445-456.
40. MacEachren, A.M., 2001, Cartography and GIS: extending collaborative tools to support virtual teams. Progress in Human Geography, 25 pp. 431-444.
41. Mark, D.M., Freksa, C., Hirtle, S.C., Lloyd, R. and Tversky, B., 1999, Cognitive models of geographical space. International Journal of Geographical Information Science, 13, pp. 747-774.
42. Mark, D.M. and Gould, M.D., 1991, Interacting with geographic information: A commentary. Photogrammetric Engineering & Remote Sensing, 57, pp. 1427-1430.
43. Mark, D.M., Svorou, S. and Zubin, D., 1987, Spatial terms and spatial concepts: Geographic, cognitive, and linguistic perspectives. In International Geographic Information Systems (IGIS) Symposium: The Research Adgenda, Proceedings, Vol. I: Overview of Research Needs and the Research Adgenda, 15-18 November 1989, Arlington, VA, pp. II-101-112.
44. McNeese, M.D., Zaff, B.S., Citera, M., Brown, C.E. and Whitaker, R., 1995, AKADAM: Eliciting user knowledge to support participatory ergonomics. The International Journal of Industrial Ergonomics, 15, pp. 345-363.
45. Muntz, R.R., Barclay, T., Dozier, J., Faloutsos, C., MacEachren, A.M., Martin, J.L., Pancake, C.M. and Satyanarayanan, M., 2003, IT Roadmap to a Geospatial Future, Report of the Committee on Intersections Between Geospatial Information and Information Technology (Washington, DC: National Academies Press).
46. Neal, J.G. and Shapiro, S.C., 1991, Intelligent multi-media interface technology. In Architectures for Intelligent Interfaces: Elements and Prototypes, A.W. Tyler (Ed.). (Reading, MA: Addison-Wesley), pp. 11-44.
47. Neal, J.G., Thielman, C.Y., Dobes, Z., Haller, S.M. and Shapiro, S.C., 1998, Natural language with integrated deictic and graphic gestures. In Reading in Intelligent User Interfaces, M.T. Maybury and W. Wahlster (Eds.), pp. 38-51 (San Francisco, CA: Morgan Kauffman).
48. Nobre, E. and Câmara, A., 1995, Spatial simulation by sketch. In Proceedings, 1st Conference on Spatial Multimedia and Virtual Reality Lisbon, Portugal, 18-20 October.
49. Nyerges, T.L. and Jankowski, P., 1997, Enhanced adaptive structuration theory: A theory of GIS-supported collaborative decision making. Geographical Systems, 4, pp. 225-259.
50. Nyerges, T.L., Mark, D.M., Laurini, R. and Egenhofer, M. (Eds.), 1995, Cognitive Aspects of Human-Computer Interaction for Geographic Information Systems (Dordrecht: Kluwer).
51. Oviatt, S., 1996, Multimodal interfaces for dynamic interactive maps. In Proceedings of the Conference on Human Factors in Computing Systems (CHI'96), pp. 95-102.
52. Oviatt, S.L., 1997, Multimodal interactive maps: Designing for human performance. Human-Computer Interaction, 12, pp. 93-129.
53. Pavlovic, V.I., Sharma, R. and Huang, T.S., 1997, Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, pp. 677-695.
54. Potter, S.S., Roth, E.M., Woods, D.D. and Elm, W.C., 2000, Bootstrapping multiple converging cognitive task analysis techniques for system design. In Cognitive Task Analysis, J.M. Schraagen and V.L. Shalin (Eds.), pp. 317-340 (Mahwah, NJ: Erlbaum).
55. Rasmussen, J., Pejtersen, A.M. and Goodstein, L.P., 1994, Cognitive Engineering: Concepts and Applications (New York: Wiley).
56. Rauschert, I., Agrawal, P., Fuhrmann, S., Brewer, I., Sharma, R., Cai, G. and MacEachren, A., 2002, Designing a user-centered, multimodal GIS interface to support emergency management. In ACM International Symposium on Advances in Geographical Information Systems, McLean, VA, 8-9 November 2002, pp. 119-124.
57. Rime, B. and Schiaratura, L., 1991, Gesture and speech. In Fundamentals of Nonverhal Behavior, R. Feldman and B. Rime (Eds.), pp. 239-281 (New York: Press Syndicate of the University of Cambridge).
58. Ruthkowski, C., 1982, An introduction to the human applications standard computer interface, part 1: Theory and principles. Byte, 7, pp. 291-310.
59. Shackel, B., 1997, Human-computer interaction whence and whither? Journal of American Society of Information Science, 48, pp. 970-986.
60. Shackel, B., 2000, People and computers-some recent highlights. Applied Ergonomics, 31, pp. 595-608.
61. Shapiro, S.C., Chalupski, C.H. and Chou, H.C., 1991, Linking Arc/INFO with SNACTor, Technical Paper 91-11 (Santa Barbara, CA: National Center for Geographic Information and Analysis).
62. Sharma, R., Cai, J., Poddar, I. and Chakravarthy, S., 2000, Exlpoiting speech/gesture co-occurrence for improving continuous gesture recognition in weather narration. In Proceedings of the IEEE Conference on Face and Gesture Recognition, March 2000, Grenoble, France, pp. 422-427.
63. Sharma, R., Pavlovic, V.I. and Huang, T.S., 1998, Toward multimodal human-computer interface. Proceedings of the IEEE, 86 (5), pp. 853-869.
64. Sharma, R., Poddar, I., Ozyildiz, E., Kettebekov, S., Kim, H. and Huang, T.S., 1999, Toward interpretation of natural speech/gesture: spatial planning on a virtual map. In Proceedings of ARL Advanced Displays Annual Symposium, Adelphi, MD, pp. 35-39.
65. Shiffer, M.J., 1998, The evolution of public participation GIS. Cartography and Geographic Information Systems, 25, pp. 89-94.
66. Shneiderman, B., 1998, Designing the User Interface-Strategies for Effective Human-Computer Interaction, (3rd ed.) (Reading, MA: Addison-Wesley Longman).
67. Slocum, T.A., Blok, C., Jiang, B., Koussoulakou, A., Montello, D.R., Fuhrmann, S. and Hedley, N.R., 2001, Cognitive and usability issues in geovisualization. Cartography and Geographic Information Science, 28, pp. 61-75.
68. Smith, T.R., Ramakrishnan, R. and Voisard, A., 1992, Object-based data model and deductive language for spatio-temporal database applications. In Geographic Database Management Systems, H.-W. Six (Ed.), pp. 79-102 (Berlin: Springer).
69. Starner, T., Weaver, J. and Pentland, A., 1998, Real-time American sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20 pp. 1371-1375.
70. Stieiti, N.A., Hdopf, V., Ishii, H., Kaplan, S. and Moran, T.P., 1998, Cooperative Buildings-Integrating Information, Organization and Architecture. In CSCW '98, Seattle, WA, 1998, pp. 411-413.
71. Terveen, L.G., 1995, Overview of human-computer collaboration. Knowledge-Based Systems, 8, pp. 67-81.
72. Vicente, K.J., 1999, Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work (Mahwah, NJ: Erlbaum).
73. Vo, M.T. and Waibel, A., 1994, A multimodal human computer interface: Combination of gesture and speech recognition. In Proceedings of the CHI'94 Summary Conference on Human Factors in Computing Systems, pp. 69-70.
74. Wahlster, W., 2002, SmartKom: fusion and fission of speech, gestures, and facial expressions. In Proceedings of the 1st International Workshop on Man-Machine Symbiotic Systems, Kyoto, Japan, pp. 213-225.
75. Wang, F., 1994, Towards a natural language user interface: An approach of fuzzy query. International Journal of Geographical Information Systems, 8, pp. 143-162.
76. Wise, J., Thomas, J., Pennok, K., Lantrip, D., Pottier, M., Schur, A. and Crow, V., 1995, Visualizing the non-visual: spatial analysis and interaction with information from text documents. In Proceedings IEEE 1995 Symposium on Information Visualization, Atlanta, GA, pp. 51-58.
77. Woodruff, A.G. and Plaunt, C., 1994, GIPSY: Geo-referenced information processing system. Journal of the American Society for Information Science, 45, pp. 645-655.
78. Zue, V., Glass, J., Goddeau, D., Goodine, D., Leung, H., McCandless, M., Phillips, M., Polfroni, J., Seneff, S. and Whitney, D., 1990, Recent progress on the MIT voyager spoken language system. In Proceedings of the ICSLP, pp. 1317-1320.
79. Zue, V.W. and Glass, J.R., 2000, Conversational interfaces: Advances and challenges. Proceedings of the IEEE, 88, pp. 1166-1180.