Evaluating the usability of natural language query languages and interfaces to Semantic Web knowledge bases

Journal of Web Semantics

Volumn 8, Issue 4, 2010, Pages 377-393

  Kaufmann, Esther ^a   Bernstein, Abraham ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Natural language interfaces; Query languages; Usability study

Indexed keywords

AMOUNT OF INFORMATION; END-USERS; KNOWLEDGE BASIS; NATURAL LANGUAGE INTERFACES; NATURAL LANGUAGE QUERIES; ONE STEP; ONTOLOGY-BASED; RETRIEVAL PERFORMANCE; USABILITY STUDIES;

ONTOLOGY; SEMANTIC WEB; USABILITY ENGINEERING;

QUERY LANGUAGES;

EID: 78649323291     PISSN: 15708268     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.websem.2010.06.001     Document Type: Conference Paper

References (74)

1. T. Andreasen An approach to knowledge-based query evaluation Fuzzy Sets and Systems 140 1 2003 75 91
2. I. Androutsopoulos, S. Kallonis, and V. Karkaletsis Exploiting OWL ontologies in the multilingual generation of object descriptions 10th European Workshop on Natural Language Generation (ENLG 2005) Aberdeen, UK 2005
3. I. Androutsopoulos, G.D. Ritchie, and P. Thanisch Natural language interfaces to databases - an introduction Natural Language Engineering 1 1 1995 29 81
4. S. Auer, and J. Lehmann What have Innsbruck and Leipzig common? Extracting semantics from Wiki content 4th European Semantic Web Conference (ESWC 2007) Innsbruck, A 2007
5. A. Badia Question answering database querying: bridging the gap with generalized quantification Journal of Applied Logic 5 1 2007 3 19
6. A. Bangor, P.T. Kortum, J.T. Miller, An empirical evaluation of the System Usability Scale, International Journal of Human-Computer Interaction 24 (6) (2008) 574-594. URL: http://dx.doi.org/10.1080/10447310802205776.
7. S. Bechhofer, R. Stevens, G. Ng, A. Jacoby, and C. Goble Guiding the user: an ontology driven interface 1999 User Interfaces to Data Intensive Systems (UIDIS 1999) Edinburgh, Scotland 1999
8. J.E. Bell, and L.A. Rowe An exploratory study of ad hoc query languages to databases 8th International Conference on Data Engineering Tempe, AZ 1992
9. A. Bernstein, and E. Kaufmann GINO - a guided input natural language ontology 5th International Semantic Web Conference (ISWC 2006) 2006
10. A. Bernstein, E. Kaufmann, C. Bürki, and M. Klein Object similarity in ontologies: a foundation for business intelligence systems and high-performance retrieval Twenty-Fifth International Conference on Information Systems (ICIS 2004) 2004
11. A. Bernstein, E. Kaufmann, and N.E. Fuchs Talking to the Semantic Web - a controlled English query interface for ontologies AIS SIGSEMIS Semantic Web & Information Systems Bulletin 2 1 2005 42 47
12. A. Bernstein, E. Kaufmann, N.E. Fuchs, and J. von Bonin Talking to the Semantic Web: a controlled English query interface for ontologies Fourteenth Annual Workshop on Information Technologies and Systems (WITS 2004) Washington, DC 2004
13. A. Bernstein, E. Kaufmann, A. Göhring, and C. Kiefer Querying ontologies: a controlled English interface for end-users 4th International Semantic Web Conference (ISWC 2005) 2005
14. A. Bernstein, E. Kaufmann, and C. Kaiser Querying the Semantic Web with ginseng: a guided input natural language search engine 15th Workshop on Information Technologies and Systems (WITS 2005) Las Vegas, NV 2005
15. J. Bortz, and N. Doering Forschungsmethoden und Evaluation fuer Human- und Sozialwissenschaftler 2002 Springer Berlin
16. J. Brooke SUS - a "quick and dirty" usability scale P. Jordan, B. Thomas, B. Weerdmeester, A. McClelland, Usability Evaluation in Industry 1996 Taylor and Francis London
17. S.K. Cha Kaleidoscope: a cooperative menu-guided query interface (SQL version) IEEE Transactions on Knowledge and Data Engineering 3 1 1991 42 47
18. S. Chakrabarti Breaking through the syntax barrier: searching with entities and relations 15th European Conference on Machine Learning (ECML 2004) Pisa, Italy 2004
19. P. Cimiano ORAKEL: a natural language interface to an F-Logic knowledge base 9th International Conference on Applications of Natural Language to Information Systems (NLDB 2004) Salford, UK 2004
20. P. Cimiano, P. Haase, J. Heizmann, M. Mantel, ORAKEL: A Portable Natural Language Interface to Knowledge Bases, Technical Report 1439, Institute AIFB, University of Karlsruhe, 2007.
21. R. Croson The method of experimental economics International Negotiation 10 1 2005 131 148
22. S.M. Dekleva Is natural language querying practical? ACM SIGMIS Database 25 2 1994 24 36
23. S.E. Désert WESTLAW is natural v. Boolean searching: a performance study Law Library Journal 85 4 1993 713 742
24. G. Distelhorst, V. Srivastava, C. Rosse, and J.F. Brinkley A prototype natural language interface to a large complex knowledge base, the foundational model of anatomy American Medical Informatics Association Annual Fall Symposium Philadelphia, PA 2003
25. M. Dittenbach, D. Merkl, and H. Berger A Natural language query interface for tourism information 10th International Conference on Information Technologies in Tourism (ENTER 2003) Helsinki, Finland 2003
26. A. Duke, T. Glover, and J. Davies Squirrel: an advanced semantic search and browse facility 4th European Semantic Web Conference Innsbruck, A 2007
27. J.J. Faraway Linear Models with R 2005 Chapman and Hall Boca Raton, FL
28. J.J. Faraway Extending the Linear Model with R: Generalized Linear Mixed Effects and Nonparametric Regression Models 2006 Chapman & Hall Boca Raton, FL
29. S. Feldman Testing natural languagecomparing dialog target, and DR-LINK Online 20 6 1996 71 79
30. A Frank, H.-U. Krieger, F. Xu, H. Uszkoreit, B. Crysmann, and U. Schäfer Question answering from structured knowledge sources Journal of Applied Logic 5 1 2007 20 48
31. A. Funk, V. Tablan, K. Bontcheva, H. Cunningham, B. Davis, S. Handschuh, Clone: controlled language for ontology editing, in: ISWC/ASWC, 2007.
32. A. Giddens The Constitution of Society: Outline of the Theory of Structuration 1984 University of California Press Berkeley, CA
33. J. Golbeck, and P. Mutton Semantic Web interaction on Internet relay chat Proceedings of Interaction Design on the Semantic Web 2004
34. B.J. Grosz, D.E. Appelt, P.A. Martin, and F.C. Pereira TEAM: an experiment in the design of transportable natural language interfaces Artificial Intelligence 32 2 1987 173 243
35. N. Guarino, C. Masolo, and G. Vetere OntoSeek: content-based access to the Web IEEE Intelligent Systems 14 3 1999 70 80
36. C. Hallett, R. Power, and D. Scott Intuitive querying of e-health data repositories UK E-Science All-hands Meeting Nottingham, UK 2005
37. C. Hallett, D. Scott, and R. Power Composing questions through conceptual authoring Computational Linguistics 33 1 2007 105 133
38. G. Hart, M. Johnson, C. Dolbear, Rabbit: developing a control natural language for authoring ontologies, in: M. Hauswirth, M. Koubarakis, S. Bechhofer (Eds.), Proceedings of the 5th European Semantic Web Conference, LNCS, Springer Verlag, Berlin, Heidelberg, 2008. URL: http://data.semanticweb.org/conference/ eswc/2008/papers/10.
39. M. Jarke, J.A. Turner, E.A. Stohr, Y. Vassiliou, N.H. White, and K. Michielsen A field evaluation of natural language for data retrieval IEEE Transactions on Software Engineering 1 1985 97 113
40. T. Joachims, L. Granka, B. Pan, H. Hembrooke, F. Radlinski, and G. Gay Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search ACM Transactions on Informations Systems 25 2 2007 1 27
41. B. Katz, J. Lin, and D. Quan Natural language annotations for the Semantic Web International Conference on Ontologies Databases Applications of Semantics (ODBASE 2002) Irvine, CA 2002
42. E. Kaufmann, Talking to the Semantic Web - Query Interfaces to Ontologies for Casual End-users, PhD thesis, University of Zurich, Faculty of Economics, Zurich, Switzerland, 2007.
43. E. Kaufmann, and A. Bernstein How useful are natural language interfaces to the Semantic Web for casual end-users? 6th International Semantic Web Conference (ISWC 2007) Busan, Korea 2007
44. E. Kaufmann, A. Bernstein, and L. Fischer NLP-Reduce: a "naïve" but domain-independent natural language interface for querying ontologies 4th European Semantic Web Conference (ESWC 2007) Innsbruck, A 2007
45. E. Kaufmann, A. Bernstein, and R. Zumstein Querix: a natural language interface to query ontologies based on clarification dialogs 5th International Semantic Web Conference (ISWC 2006) Athens, GA 2006
46. T. Kuhn An evaluation framework for controlled natural languages N.E. Fuchs, Proceedings of the Workshop on Controlled Natural Language (CNL 2009). Lecture Notes in Computer Science 2010 Springer
47. H. Lee, A.F. Smeaton, and N.E. O'Connor User evaluation of Físchlár-news: an automatic broadcast news delivery system ACM Transactions on Information Systems 24 2 2006 145 189
48. S. Linckels, and C. Meinel A simple solution for an intelligent librarian system IADIS International Conference of Applied Computing (AC2005) Lisbon, Portugal 2005
49. V. Lopez, E. Motta, and V. Uren PowerAqua: fishing the Semantic Web 3rd European Semantic Web Conference Budva, Montenegro 2006
50. A. Malhotra, Design Criteria for a Knowledge-based English Language System for Management: An Experimental Analysis, PhD thesis, MIT Sloan School of Management, 1975.
51. M.J. Minock, A Phrasal Approach to Natural Language Interfaces over Databases, Tech. Rep. UMINF-05.09, University of Umea, Sweden, 2005.
52. MKBEEM, Multilingual Knowledge Based European Electronic Market Place, 2005.
53. R.J. Mooney Learning semantic parsers: an important but under-studied problem AAAI 2004 Spring Symposium on Language Learning: An Interdisciplinary Perspective Stanford, CA 2004
54. J. Nielsen Usability Engineering 1993 Academic Press San Diego/New York
55. W.C. Odgen, and P. Bernick Using natural language interfaces M. Helander, T.K. Landauer, P.V. Prabhu, Handbook of Human Computer Interaction 1997 Elsevier North-Holland
56. W.J. Orlikowski The duality of technology: rethinking the concept of technology in organizations Organization Science 3 3 1992 398 427
57. A.-M. Popescu, O. Etzioni, and H. Kautz Towards a theory of natural language interfaces to databases 8th International Conference on Intelligent User Interfaces Miami, FL 2003
58. J. Preece, Y. Rogers, and H. Sharp Interaction Design: Beyond Human-Computer Interaction 2002 John Wiley and Sons New York
59. B. Rasch, M. Friese, W. Hofmann, and E. Naumann Quantitative Methoden - Band 1 und 2 2004 Springer Berlin, Heidelberg
60. M. Rauterberg Benutzungs-orientierte Benchmark-Tests: eine Methode zur Benutzerbeteiligung bei Standardsoftware-Entwicklungen Software Ergonomie'91 (German Chapter of ACM Berichte Nr. 32) Stuttgart 1991
61. M. Reichert, S. Linckels, C. Meinel, and T. Engel Student's perception of a semantic search engine IADIS Cognition and Exploratory Learning in Digital Age (CELDA 2005) Porto, Portugal 2005
62. L. Sachs Angewandte Statistik: Anwendung statistischer Methoden 2004 Springer Berlin
63. R. Schwitter, and M. Tilbrook Dynamic semantics at work International Workshop on Logic and Engineering of Natural Language Semantics Kanazawa, Japan 2004
64. R. Schwitter, and M. Tilbrook Let's talk in description logic via controlled natural language Logic and Engineering of Natural Language Semantics (LENLS2006) Tokyo, Japan 2006
65. A. Spink, W. Dietmar, B.J. Jansen, and T. Saracevic Searching the Web: the public and their queries Journal of the American Society for Information Science and Technology 52 3 2001 226 234
66. A. Spoerri InfoCrystal: a visual tool for information retrieval management Second International Conference on Information and Knowledge Management 1993 ACM Press Washington, DC
67. V. Tablan, D. Damljanovic, and K. Bontcheva A natural language query interface to structured information Proceedings of the 5th European Semantic Web Conference 2008
68. V. Tablan, T. Polajnar, H. Cunningham, K. Bontcheva, User-friendly Ontology Authoring Using a Controlled Language, Research Memorandum CS-05-10, Department of Computer Science, University of Sheffield, 2005.
69. L.R. Tang, and R.J. Mooney Using multiple clause constructors in inductive logic programming for semantic parsing 12th European Conference on Machine Learning (ECML-2001) Freiburg, Germany 2001
70. H.R. Tennant, K.M. Ross, and C.W. Thompson Usable natural language interfaces through menu-based natural language understanding SIGCHI Conference on Human Factors in Computing Systems Boston, MA 1983
71. C.W. Thompson, P. Pazandak, and H.R. Tennant Talk to your Semantic Web IEEE Internet Computing 9 6 2005 75 78
72. H. Turtle Natural language vs Boolean query evaluation: a comparison of retrieval performance 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'94) Dublin, Ireland 1994
73. C. Wang, M. Xiong, Q. Zhou, and Y. Yu PANTO - a portable natural language interface to ontologies 4th European Semantic Web Conference (ESWC 2007) Innsbruck, A 2007
74. T.D. Wang, and B. Parsia CropCircles: topology sensitive visualization of OWL class hierarchies 5th International Semantic Web Conference (ISWC 2006) Athens, GA 2006