Ontology-based user modeling in an augmented audio reality system for museums

User Modelling and User-Adapted Interaction

Volumn 15, Issue 3-4, 2005, Pages 339-380

  Hatala, Marek ^a,b   Wakkary, Ron ^a  

^a SIMON FRASER UNIVERSITY   (Canada)

^b Laboratory for Ontological Research   (Canada)

Author keywords

Audio augmented reality; Context aware; Museum guide; Ontologies; Semantic technologies; Tangible user interface; Testing; Ubiquitous computing; User evaluations; User modeling

Indexed keywords

SEMANTIC TECHNOLOGIES; USER EVALUATIONS; USER MODELING;

COMPUTATION THEORY; HUMAN COMPUTER INTERACTION; KNOWLEDGE BASED SYSTEMS; MATHEMATICAL MODELS; PROBLEM SOLVING;

ADAPTIVE SYSTEMS;

EID: 28244459504     PISSN: 09241868     EISSN: 15731391     Source Type: Journal    
DOI: 10.1007/s11257-005-2304-5     Document Type: Article

References (83)

1. Alfaro, I., Zancanaro, M., Cappalletti, A., Nardon, M. and Guerzoni, A.: 2003, Navigating by Knowledge. In: Proceedings of the Eighth International Conference on Intelligent User Interfaces, Miami, Florida, USA, pp. 221-223.
2. Aoki, P. M., Grinter, R. E., Hurst, A., Szymanski, M. H., Thornton, J. D. and Woodruff, A.: 2002, Sotto Voce: Exploring the Interplay of Conversation and Mobile Audio Spaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Minneapolis, Minnesota, USA, pp. 431-438.
3. Aoki, P. M. and Woodruff, A.: 2000, Improving Electronic Guidebook Interfaces using a Task-Oriented Design Approach. In: Proceedings of the Conference on Designing Interactive Systems, New York City, New York, USA, pp. 319-325.
4. Bartle, R. A.: 1990, Who Plays MUAs?. Comms Plus! October/November 1990, 18-19.
5. Baus, J., Krüger, A. and Wahlster W.: 2002, A Resource-Adaptive Mobile Navigation System. In: Seventh International Conference on Intelligent User Interfaces, San Francisco, California, USA, pp. 15-22.
6. Bell, G. and Kaye, J. J.: 2002, Designing technology for domestic spaces: a kitchen manifesto. Gastronomica - the Journal of Food and Culture 2(2), 42-62.
7. Bell, G.: 2002, Making Sense of Museums: The Museum as Cultural Ecology. Intel Labs 1-17.
8. Benelli, G., Blanchi, A., Marti, P., Not, E. and Sennari, D.: 1999, HIPS: Hyper-Interaction within the Physical Space. IEEE Multimedia Systems'99, Florence, Italy, pp. 1075-1078.
9. Berners-Lee, T., Hendler, I and Lassila, O.: 2001, The Semantic Web. Scientific American 284(5), 34-44.
10. Bjork, S., Holopainen, J., Ljungstrand, P. and Akesson, K. P.: 2002, Designing Ubiquitous Computing Games: A Report from a Workshop Exploring Ubiquitous Computing Entertainment. Personal and Ubiquitous Computing 6, 443-458.
11. Bobrow, D. G.: 1991, Dimensions of interactions. AI Magazine 12(3), 64-80.
12. Bodker, S.: 1990, Through the Interface: A Human Activity Approach to User Interface Design. Malwah, New Jersey: Lawrence Erlbaum Associates, Inc.
13. Brewster, S., Lumsden, J., Bell, M., Hall, M. and Tasker, S.: 2003, Multimodal Eyes-Free Interaction Techniques for Wearable Devices. In: Proceedings of the conference on Human factors in computing systems, Ft. Lauderdale, Florida, USA, pp. 473-480.
14. Burke, R.: 2002, Hybrid Recommender Systems: Survey and Experiments. User Modeling and User-Adapted Interaction 12(4), 331-370.
15. Burnett, M. and Rainsford, C.: 2001, A Hybrid Evaluation Approach for Ubiquitous Computing Environments. Ubicomp01 Workshop: Evaluation Methodologies for Ubiquitous Computing, http://zing.ncsl.nist.gov/ubicomp01/papers/ Ubiquitous_Computing_Evaluation.pdf. Last viewed Aug. 15, 2005.
16. Carroll, J. M.: 2002, Human-Computer Interaction in the New Millenium. New York: ACM Press.
17. Carroll, J. M.: 2000, Making use: Scenario-Based Design of Human-Computer Interactions. Cambridge, Massachusetts: MIT Press.
18. Carse, J. P.: 1987, Finite and Infinite Games. New York: Ballantine Books.
19. Chandrasekaran, B., Josephson, J. R. and Benjamins V. R,: 1991, What are ontologies, and why do we need them? IEEE Intelligent Systems 14(1), 20-26.
20. Crampton-Smith, G.: 1995, The Hand that Rocks the Cradle. ID Magazine, 60-65.
21. Crofts, N. Doerr, M. and Gill, T.: 2003, The CIDOC Conceptual Reference Model: A standard for communicating cultural contents, Cultivate Interactive, 9, 7 February 2003, http://www.cultivate-int.org/issue9/chios/. Last viewed Aug. 15, 2005.
22. Csikszentmihalyi, M.: 1990, Flow: The Psychology of Optimal Experience. Harper & Row, New York.
23. Dean, D.: 1994, Museum Exhibition: Theory and Practice. Routledge, London.
24. Dourish, P.: 2001, Where the Action is: The Foundations of Embodied Interaction. MIT Press, Cambridge, Massachusetts.
25. Dourish, P.: 2004, What We Talk About When We Talk About Context. Personal Ubiquitous Computing 8(1), 19-30.
26. Eckel, G.: 2001, Immersive Audio-Augmented Environments. In: Proceedings of the Eighth Biennial Symposium on Arts and Technology at Connecticut College, New London, CT, USA. http://viswiz.gmd.de/~eckel/publications/eckel01a.pdf. Last viewed Aug. 15, 2005.
27. Ehn, P.: 1989, Work-Oriented Design of Computer Artifacts. Arbetslivscentrum, Stockholm
28. Fink, J. and Kobsa, A.: 2002, User Modeling for Personalized City Tours. Artifical Intellegence Review 18(1), 33-74.
29. Fischer, G.: 2001, User Modeling in Human\- Computer Interaction'. User Modeling and User-Adapted Interaction 11(1-2), 65-86.
30. Fishkin, K. P.: 2004, A Taxonomy for and Analysis of Tangible Interfaces. Personal Ubiquitous Computing 8(5), 347-358.
31. Fitzmaurice, G. W., Ishii, H. and Buxton, W. A. S.: 1995, Bricks: Laying the Foundations for Graspable User Interfaces. Proceedings of the SIGCHI conference on Human factors in computing systems, Denver, Colorado, USA, pp. 442-449.
32. Fleck, M., Frid, M., Kindberg, T., O'Brien-Strain, E., Rajani, R. and Spasojevic, M.: 2002, From Informing to Remembering: Ubiquitous Systems in Interactive Museums. IEEE Pervasive Computing 1(2), 13-21.
33. Gay, G. and Hembrooke, H.: 2004, Activity-Centered Design: An Ecological Approach to Designing Smart Tools and Usable Systems. MIT Press, Cambridge, Massachusetts.
34. Goecks, J. and Shavlik, J.: 2000, Learning Users' Interests by Unobtrusively Observing their Normal Behavior. In: Proceedings of the fifth international conference on Intelligent user interfaces. New Orleans, Louisiana, USA, pp. 129-132.
35. Goßmann, J. and Specht, M.: 2002, Location Models for Augmented Environments. Personal and Ubiquitous Computing 6(5-6), 334-340.
36. Hatala, M., Wakkary, R. and Kalantari, L.: 2005, Rules and Ontologies in Support of Real-Time Ubiquitous Application. Web Semantics: Science, Services and Agents on the World Wide Web 3(1), 5-22.
37. Hatala, M., Kalantari, L., Wakkary, R. and Newby, K.: 2004, Ontology and Rule Based Retrieval of Sound Objects in Augmented Audio Reality System for Museum Visitors. In: Proceedings of the 2004 ACM symposium on Applied computing, Nicosia, Cyprus, pp. 1045-1050.
38. Hinckley, K., Pausch, R., Goble, J. C. and Kassell, N. F.: 1994, Passive Real-World Interface Props for Neurosurgical Visualization. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Boston, Massachusetts, USA, pp. 452-458.
39. Holmquist, L. E., Redström, J. and Ljungstrand, P.: 1999, Token-Based Access to Digital Information. First International Symposium on Handheld and Ubiquitous Computing, Karlsruhe, Germany, pp. 234-245.
40. Huizinga, J.: 1964, Homo Ludens: A Study of the Play-element in Culture. Beacon Press, Boston.
41. Hummels, C. and Helm, A.v.d.: 2004, ISH and the Search for Resonant Tangible Interaction. Personal Ubiquitous Computing 8(5), 385-388.
42. Ishii, H., Wisneski, C., Orbanes, J., Chun, B. and Paradiso, J.: 1999, Pingpongplus: Design of an Athletic-Tangible Interface for Computer-Supported Cooperative Play. Conference on Human Factors in Computing Systems, Pittsburgh, Pennsylvania, USA, pp. 394-401.
43. Ishii, H. and Ullmer, B.: 1997, Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. Conference on Human Factors in Computing Systems, Atlanta, Georgia, USA, 234-241.
44. Konstan, J. A., Rield, J., Borchers, A. and Herlocker, J.L.: 1998, Recommender Systems: A GroupLens Perspective. Recommender Systems: Papers from the 1998 Workshop, Menlo Park, California, USA, pp. 60-64.
45. Kopena, J. and Regli, WC.: 2003, DAMLJessKB: A Tool for Reasoning with the Semantic Web. IEEE Intelligent Systems 18(3), 74-77.
46. Leinhardt, G. and Crowley, K.: 1998, Museum Learning as Conversational Elaboration: A Proposal to Capture, Code and Analyze Museum Talk. Vol. Museum Learning Collaborative Technical Report MLC-01. Pittsburgh, PA: University of Pittsburgh, Learning Research and Development Center.
47. Lieberman, H.: 1995, Letizia: An Agent that Assists Web Browsing. International Joint Conference on Artificial Intelligence (IJCAI-95), Montreal, Quebec, Canada, pp. 475-480.
48. Miller, C. and Funk, H. B.: 2001, Verification through User Value: Or 'How to Avoid Drinking Your Own Bathwater in Ubicomp Evaluations. Ubicomp'01 Workshop: Evaluation Methodologies for Ubiquitous Computing, http://zing.ncsl.nist.gov/ubicomp01/papers/Ubicomp-eval3.doc. Last viewed Aug. 15, 2005.
49. Mladenic, D.: 1996, Personal WebWatcher: Implementation and Design. Vol. Technical Report IJS-DP-7472. Department for Intelligent Systems, J.Stefan Institute.
50. Mulholland, P., Collins, T. and Zdrahal, Z.: 2004, Story Fountain: Intelligent Support for Story Research and Exploration. In: Proceedings of the Ninth international conference on Intelligent user interface, Funchal, Madeira, Portugal, pp. 62-69.
51. Mynatt, E. D., Back, M. and Want, R.: 1998, Designing Audio Aura. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Los Angeles, California, USA, pp. 566-573.
52. Nardi, B. A.: 1995,Context and Consciousness: Activity Theory and Human-Computer Interaction. MIT Press, Cambridge, Massachusetts.
53. Nardi, B. A. and O'Day, V. L.: 1999, Information Ecologies: Using Technology with Heart. MIT Press, Cambridge, Massachusetts.
54. Norman, M. and Thomas, P.: 1990, The Very Idea: Informing HCI Design from Conversation Analysis. In: P. Luff, N. Gilbert and D. Frohlich (eds): Computers and Conversation. London: Academic Press, pp. 51-65.
55. Not, E. and Zancanaro, M.: 2000, The MacroNode Approach: Mediating between Adaptive and Dynamic Hypermedia. In: Proceedings of the International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, Trento, Italy, pp. 167-178.
56. Noy, N. F. and Hafner, C. D.: 1997, The State of the Art in Ontology Design: A Survey and Comparative Review. AI Magazine 18(3), 53-74.
57. Oppermann, R. and Specht, M.: 2000, A Context-Sensitive Nomadic Exhibition Guide.In: Proceedings of the 2nd international symposium on Handheld and Ubiquitous Computing, Bristol, UK, pp. 127-142.
58. Pentland, A.: 1996, Smart Rooms. Scientific American 274(4), 68-76.
59. Petrelli, D., Not, E., Zancanaro, M., Strapparava, C. and Stock, O.: 2001, Modeling and Adapting to Context. Personal Ubiquitous Computing 5(1), 20-24.
60. Pirhonen, A., Brewster, S. and Holguin, C.: 2002, Gestural and Audio Metaphors as a Means of Control for Mobile Devices. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Minneapolis, Minnesota, USA, pp. 291-298.
61. Post, S. and Sage, A. P.: 1990, An Overview of Automated Reasoning. IEEE Transactions on Systems, Man and Cybernetics 20(1), 202-224.
62. Proctor, N. and Tellis, C.: 2003, The State of the Art in Museum Handhelds in 2003'. Museum and the Web, Pittsburgh, Pennsylvania, U.S.A., http://www.archimuse.com/mw2003/papers/proctor/proctor.html. Last viewed Aug. 15, 2005.
63. Resnick, P. and Varian, H. R.: 1997, Recommender Systems. Communications of the ACM 40(3), 56-58.
64. Semper, R. and Spasojevic, M.: 2002, The Electronic Guidebook: Using Portable Devices and a Wireless Web-Based Network to Extend the Museum Experience. Museum and Web, Charlotte, North Carolina, USA, http://www. archimuse.com/mw2002/papers/semper/semper.html. Last viewed Aug. 15, 2005.
65. Seo, Y. and Zhang, B.: 2000, A Reinforcement Learning Agent for Personalized Information Filtering. In: Proceedings of the fifth international conference on intelligent user interfaces, New Orleans, Louisiana, USA, pp. 248-251.
66. Serrell, B.: 1996, The Question of Visitor Styles. In: S. Bitgood (ed.): Visitor Studies: Theory, Research, and Practice. Jacksonville, Alabama: Visitor Studies Association, pp. 48-53.
67. Shaer, O., Leland, N., Calvillo-Gamez, E. H. and Jacob, R. J. K.: 2004, The TAC paradigm: Specifying tangible user interfaces. Personal and Ubiquitous Computing 8(5), 359-369.
68. Sparacino, F.: 2002, The Museum Wearable: Real-Time Sensor-Driven Understanding of Visitors' Interests for Personalized Visually-Augmented Museum Experiences'. Museums and the Web, Boston, Massachusetts, U.S.A.,http://www. archimuse.com/mw2002/papers/sparacino/sparacino.html. Last viewed Aug. 15, 2005.
69. Spasojevic, M. and Kindberg, T.: 2001, Evaluating the CoolTown User Experience. Ubicomp'01 Workshop: Evaluation Methodologies for Ubiquitous Computing, http://zing.ncsl.nist.gov/ubicomp01/papers/Exploratorium- UbicompPosition.pdf. Last viewed Aug. 15, 2005.
70. Suchman, L. A.: 1987, Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press, New York, NY.
71. Terrenghi, L. and Zimmermann, A.: 2004, Tailored Audio Augmented Environments for Museums. In: IUI '04: Proceedings of the ninth international conference on Intelligent user interface, Funchal, Madeira, Portugal, pp.334-336.
72. Tolmie, P.: 2002, Unremarkable Computing. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Minneapolis, Minnesota, USA, pp. 399-406.
73. Towle, B. and Quinn, C.: 2000, Knowledge Based Recommender Systems using Explicit User Models. Knowledge-Based Electronic Markets, Papers from the AAAI Workshop (AAAI Technical Report WS-00-04), Menlo Park, California, USA, pp. 74-77.
74. Ullmer, B.: 2002, Tangible Interfaces for Manipulating Aggregates of Digital Information. PhD Thesis, Massachusetts Institute of Technology.
75. Ullmer, B. and Ishii, H.: 2001, Emerging Frameworks for Tangible User Interfaces'. In: J.M. Carroll (ed.): Human-Computer Interaction in the New Millenium. New York: Addison-Wesley, pp. 579-601.
76. Ullmer, B., Ishii H. and Jacob, R.J.K.: 2005, Token+constraint Systems for Tangible Interaction with Digital Information. ACM Transactions Computer-Human Interaction 12(1), 81-118.
77. vom Lehn, D., Heath, C. and Hindmarsh, J.: 2001, Exhibiting Interaction: Conduct and Collaboration in Museums and Galleries. Symbolic Interaction 24, 189-216.
78. Vygotsky, L. S.: 1925/1982, Consciousness as a Problem in the Psychology of Behaviour. Moscow: Pedagogika.
79. Wahlster, W and Kobsa, A.: 1989, User Models in Dialog Systems. In: A. Kobsa and W. Wahlster (eds): User Models in Dialog Systems. New York, NY: Springer-Verlag, Inc.
80. Wakkary, R. and Evernden, D.: 2005, Museum as Ecology: A Case Study of an Ambient Intelligent Museum Guide. In: D. Bearman and J. Trant (eds): Museums and the Web 2005 Selected Papers, Vancouver, Canada, pp. 151-162.
81. Wakkary, R., Newby, K., Hatala, M., Evernden, D. and Droumeva, M.: 2004, Interactive Audio Content: The use of Audio for a Dynamic Museum Experience through Augmented Audio Reality and Adaptive Information Retrieval. In: D. Bearman and J. Trant (eds): Museums and the Web 2004 Selected Papers, Arlington, Virginia, pp. 55-60.
82. Wakkary, R.: 2005, Framing Complexity, Design and Experience: A Reflective Analysis. Digital Creativity 16(1), (in press).
83. Weiser, M.: 1993, Some Computer Science Issues in Ubiquitous Computing. Communications of ACM 36 (7), 75-84.