Evaluating advanced search interfaces using established information-seeking models

Journal of the American Society for Information Science and Technology

Volumn 60, Issue 7, 2009, Pages 1407-1422

  Wilson, Max L ^a   Schraefel, M C ^a   White, Ryen W ^b  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FACETED BROWSING; INDEPENDENT VARIABLES; INFORMATION SEEKING; INTERACTIVE INFORMATION RETRIEVAL; POTENTIAL VALUES; SEARCH INTERFACES; USER STUDY;

INFORMATION SERVICES;

EID: 66749185221     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.21080     Document Type: Article

References (51)

1. Bates,M.J.(1979a).Ideatactics. JournaloftheAmericanSocietyforInformationScience,30(5),280-289. (Pubitemid10437946)
2. Bates,M.J.(1979b).Informationsearchtactics. JournaloftheAmericanSocietyforInformationScience,30(4),205-214. (Pubitemid10444791)
3. Bates, M.J. (1990). Where should the person stop and the information search interface start? Information Processing and Management, 26(5), 575-591.
4. Bates, M.J. (2002). The cascade of interactions in the digital library interface. Information Processing and Management, 38(3), 381-400. (Pubitemid 34040560)
5. Beaulieu,M.(1997).Experimentsoninterfaces-supportqueryexpansion. JournalofDocumentation,53(1),8-19.(Pubitemid127013054)
6. Belkin, N.J. (2000). Helping people find what they don't know. Communications of the ACM, 43(8), 58-61.
7. Belkin, N.J., Cool, C., Stein, A., & Thiel, U. (1995). Cases, scripts, and information-seeking strategies: On the design of interactive information retrieval, systems. Expert Systems with Applications, 9(3), 379-395.
8. Belkin, N.J., Marchetti, P.G., & Cool, C. (1993). Braque: Design of an interface to support user interaction in information retrieval. Information Processing and Management, 29(3), 325-344.
9. Belkin, N.J., Oddy, R.N., & Brooks, H.M. (1982). Ask for information retrieval: Part I. Journal of Documentation, 38(2), 61-71.
10. Belkin, N.J., Oddy, R.N. & Brooks, H.M. (1982). Ask for information retrieval: Part II. Journal of Documentation, 38(3), 145-164.
11. Borlund, P. (2003). The IIR evaluation model: a framework for evaluation of interactive information retrieval systems. Information Research, 8(3), Paper 152.
12. Bruza, P., McArthur, R., & Dennis, S. (2000). Interactive Internet search: Keyword, directory and query reformulation mechanisms compared. In E. Yannakoudakis, N.J. Belkin, M.-K. Leong, & P. Ingwersen (Chairs), Proceedings of the 23rd Annual International Conference on Research and Development in Information Retrieval (ACM SIGIR'00) (pp. 280-287). New York: ACM Press.
13. Card, S.K., Moran, T.P., & Newell, A. (1980). The keystroke-level model for user performance time with interactive systems. Communications of the ACM, 23(7), 396-410. (Pubitemid 11433615)
14. Chandler,P.,&Sweller,J.(1996).Cognitiveloadwhilelearning- useacomputerprogram..Appliedcognitivepsychology,10(2),151-170. (Pubitemid126482120)
15. Chi,E.H.,Pirolli,P.,Chen,K.,&Pitkow,J.(2001).Usinginformationscent- modeluserinformationneedsandactionsandtheWeb.InM.Beaudouin-Lafon&R.J.K. Jacob(Eds.), ProceedingsoftheACMSIGCHIConferenceonHumanfactorsinComputingSystems(CHF'01) (490-497).NewYork:ACMPress.(Pubitemid32393393)
16. Cleverdon, C.W., Mills, J., & Keen, M. (1966). Factors determining the performance of indexing systems. Aslib Cranfield Research Project, Cranfield, England.
17. Cool, C., & Belkin, N.J. (2002). A classification of interactions with information. In H. Bruce, R. Fidel, P. Ingwersen, & P. Vakkari (Eds.), Proceedings of the 4th International Conference on Conceptions of Library and Information Science (CoLIS4) (pp. 1-15). Santa Barbara, CA: Libraries Unlimited.
18. Dumais, S.T., & Belkin, N.J. (2005). The TREC interactive tracks: Putting the user into search. In E. Voorhees & D. Harman (Eds.), TREC: Experiment and Evaluation in Information Retrieval (pp. 123-153). Cambridge, MA: MIT Press.
19. Fu,W.,&Pirolli,P.(2007).SNIF-ACT: acognitivemodelofusernavigationontheWorldWideWeb.Human-ComputerInteraction,22(4) ,355-412.(Pubitemid350201649)
20. Godbold, N. (2006). Beyond information seeking: Towards a general model of information behaviour. Information Research, 11(4), Paper 269.
21. Gong, R., & Kieras, D. (1994). A validation of the GOMS model methodology in the development of a specialized, commercial software application. In B. Adelson, S. Dumais, & J.S. Olson (Eds.), Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI'94) (pp. 351-357). New York: ACM Press.
22. Harman, D.K. (1997). The TREC conferences. In K. Jones & P. Willett (Eds.), Multimedia information and systems series (pp. 247-256). San Francisco, CA: Morgan Kaufmann.
23. Hearst, M.A. (2000). Next generation Web search: Setting our sites. IEEE Data Engineering Bulletin: Special Issue on Next Generation Web Search, 23(3), 38-48.
24. Hildebreand, M., Ossenbruggen, J.v., & Hardman, L. (2006). /facet: A browser for heterogeneous semantic Web repositories. In I. Cruz, S. Decker, D. Allemang, C Preist, D. Schwabe, P. Mika, M. Uschold, & L. Aroyo (Eds.), Lecture Notes in Computer Science: Vol.4273. Proceedings of the 5th International Conference on the Semantic Web (ISWC '06) (pp. 272-285). Heidelberg, Germany: Springer.
25. Huvila, I., & Widén-Wulff, G. (2006). Perspectives to the classification of information interactions: The Cool and Belkin faceted classification scheme under scrutiny. In I. Ruthven, (Chair), Proceedings of the 1st International Conference on Information Interaction in Context (IIiX'06) (pp. 144-152). New York: ACM Press. (Pubitemid 47142389)
26. Lagergren, E., & Over, P. (1998). Comparing interactive information retrieval systems across sites: The TREC-6 interactive track matrix experiment. In W.B. Croft, A. Moffat, C.J. van Rijsbergen, R. Wilkinson, & J. Zobel (Chairs), Proceedings of the 21st Annual International Conference on Research and Development in Information Retrieval (ACM SIGIR'98) (pp. 164-172). New York: ACM Press.
27. Liu, B., & Oard, D.W. (2006). One-sided measures for evaluating ranked retrieval effectiveness with spontaneous conversational speech. In E.N. Efthimiadis, S. Dumais, D. Hawking, & K. Järvelin (Chairs), Proceedings of the 29th Annual International Conference on Research and Development in Information Retrieval (ACM SIGIR'06) (pp. 673-674). New York: ACM Press. (Pubitemid 44626699)
28. Marchionini,G.(2006).Exploratorysearch:From,findingtounderstanding. CommunicationsoftheACM,49(4),41-46.(Pubitemid43909062)
29. Paas,F.,Renkl,A.,&Sweller,J.(2003). Cognitiveloadtheoryandinstructionaldesign:recentdevelopments. EducationalPsychologist,38(1),1-4.(Pubitemid36399998)
30. Pharo, N. (1999). Web information search strategies: A model for classifying Web interaction. In Proceedings of the 3rd International Conference on the Conceptions of the Library and Information Science (CoLIS3), 207-218.
31. Robertson, S.E., & Hancock-Beaulieu, M.M. (1992). On the evaluation of IR systems. Information Processing and Management, 28(4), 457-466.
32. Rocchio, J. (1971). Relevance feedback in information retrieval. In G. Salton (Ed.), The SMART retrieval system-Experiments in automatic document processing : Englewood Cliffs, N.J.: Prentice Hall.
33. Salton, G., & Buckley, C. (1990). Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science, 41(4), 288-297.
34. Saracevic, T. (1997). The stratified model of information retrieval interaction: extension and applications. In Proceedings of the 60th Annual Meeting of the American Society for Information Science (ASIS'97) (pp. 313-327). Medford, NJ: Information Today.
35. schraefel, m.c., Karam, M., & Zhao, S. (2003, September). Listen to the music: Audio preview cues for the exploration of online music. Paper presented at Interact 2003, Zurich, Switzerland. Retrieved March 27, 2009, from http://www.dgp.toronto.edu/∼sszhao/paper/ schraefel-interact03Listen.pdf
36. schraefel, m.c., Wilson, M.L., Russell, A., & Smith, D.A. (2006). mSpace: Improving information access to multimedia domains with multimodal exploratory search. Communications of the ACM, 49(4), 47-49.
37. schraefel, m.c., Zhu, Y., Modjeska, D., Wigdor, D., & Zhao, S. (2002). Hunter gatherer: Interaction support for the creation and management of within-Web-page collections. In Proceedings of the 11th International Conference on World Wide Web (WWW'02), 172-181.
38. Shneiderman,B.(1983).Directmanipulation:Astepbeyondprogramminglanguages. Computer,16(8),57-69.(Pubitemid13590936)
39. Spink, A., Greisdorf, H., & Bateman, J. (1998). From highly relevant to not relevant: Examining different regions of relevance. Information Processing and Management, 34(5), 599-621. (Pubitemid 128410409)
40. Taylor, R.S. (1968). Question-negotiation and information-seeking in libraries. College and Research Libraries, 29, 178-194.
41. White, R.W., & Drucker, S.M. (2007). Investigating behavioral variability in Web search. In C. Williamson, M.E. Zurko, P.F. Patel-Schneider, & P. Shenoy (Chairs), Proceedings of the 16th International Conference on World Wide Web (WWW'07) (pp. 21-30). Retrieved March 27, 2009, from http://www2007.org/papers/paper535.pdf (Pubitemid 47582235)
42. White, R.W., Kules, B., Drucker, S.M., & schraefel, m.c. (2006). Introduction. Communications of the ACM, 49(4), 36-39.
43. White, R.W. & Roth, R.A. (2009). Exploratory search: Beyond the queryresponse paradigm. In G. Marchionini (Ed.), Synthesis lectures on information concepts, retrieval, and services. San Rafael, CA: Morgan & Clay pool.
44. White, R.W., Ruthven, I., Jose, J.M., & Rijsbergen, C.J.V. (2005). Evaluating implicit feedback models using searcher simulations. ACM Transactions on Information Systems, 23(3), 325-361. (Pubitemid 43906379)
45. Wilson, M.L., & schraefel, m.c. (2006). mSpace: What do numbers and totals mean in a flexible semantic browser. In Proceedings of the 3rd International Semantic Web User Interaction Workshop (SWUI'06)
46. Wilson, M.L., & schraefel, m.c. (2008a). A longitudinal study of exploratory and keyword search. In R. Larsen, A. Paepcke, J. Borbinha, & M. Naaman (Chairs), ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL'08) (pp. 52-56). New York: ACM Press.
47. Wilson, M.L., & schraefel, m.c. (2008b). Improving Exploratory search interfaces: adding value or information, overload? In D. Tunkelang, R. White, & B. Kules (Chairs), Second International Workshop on Human-Computer Interaction and Information Retrieval (HCIR'08) (pp. 81-84). Retrieved March 27, 2009, from http://research.microsoft. com/en-us/um/people/ryenw/hcir2008/doc/ HCIR08-Proceedings.pdf
48. Yee, K.-P., Swearingen, K., Li, K., & Hearst, M. (2003). Faceted metadata for image search and browsing. In G. Cockton & P. Korhonen (Eds.), Proceedings of the SIGCHI Conference on. Human Factors in Computing Systems (CHI'03) (pp. 401-408). New York: ACM Press.
49. Yuan, X., & Belkin, N.J. (2007). Supporting multiple information-seeking strategies in a single system framework. In W. Kraaij, A.P. de Vries, C.L.A. Clarke, N. Fuhr, & N. Rando (Chairs), Proceedings of the 30th Annual International Conference on Research and Development in Information Retrieval (ACM SIGIR'07) (pp. 247-254). New York: ACM Press. (Pubitemid 350164968)
50. Zamir, O., Etzioni, O., Madani, O., & Karp, R.M. (1997). Fast and intuitive clustering of Web documents. In Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining (RRD'97), 287-2901.
51. Zhang, J., & Marchionini, G. (2005). Evaluation and evolution of a browse and search interface: Relation browser. In L. Delcambre & G. Giuliano (Chairs), Proceedings of the 2005 National Conference on Digital Government Research (DG.O'05) (pp. 179-188). New York: ACM Press.