An evaluation of adaptive filtering in the context of realistic task-based information exploration

Information Processing and Management

Volumn 44, Issue 2, 2008, Pages 511-533

  He, Daqing ^a   Brusilovsky, Peter ^a   Ahn, Jaewook ^a   Grady, Jonathan ^a   Farzan, Rosta ^a   Peng, Yefei ^a   Yang, Yiming ^b   Rogati, Monica ^b  

^a UNIVERSITY OF PITTSBURGH   (United States)

^b School of Computer Science ^*  (United States)

Author keywords

Adaptive filtering; CAFE; Evaluation framework; Exploratory search; Intelligence analysts; Task based information exploration; User study

Indexed keywords

INFORMATION RETRIEVAL; INTELLIGENT AGENTS; PROFESSIONAL ASPECTS; SEARCH ENGINES;

INFORMATION ACCESS TOOLS; INFORMATION EXPLORATION;

ADAPTIVE FILTERING;

EID: 39649086281     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2007.07.009     Document Type: Article

References (35)

1. Acosta-Diaz R., Guillen H.M., GarciaRuiz M.A., Gallardo A.R., Pulido J.R.G., and Reyes P.D. An open source platform for indexing and retrieval of multimedia information from a digital library of graduate thesis. Proceedings of world conference on E-learning in corporate, government, healthcare, & higher education E-learning 2006 Honolulu (2006), AACE, Hawaii 1822-1829
2. Allan J. Topic detection and tracking: event-based information organization (2002), Kluwer Academic Publishers
3. Allan, J. (2003). HARD track overview in TREC 2003 high accuracy retrieval from documents. In The twelfth text retrieval conference.
4. Borlund P. The IIR evaluation model: a framework for evaluation of interactive information retrieval systems. Information Research 8 3 (2003)
5. Borlund P., and Ingwersen P. The development of a method for the evaluation of interactive information retrieval systems. Journal of Documentation 53 3 (1997) 225-250
6. Cleverdon C.W., Mills J., and Keen M. Factors determining the performance of indexing systems (1966), ASLIB Cranfield Project, Cranfield
7. Díaz A., and Gervás P. Personalisation in news delivery systems: item summarization and multi-tier item selection using relevance feedback. Web Intelligence and Agent Systems 3 3 (2005) 135-154
8. Dumais S.T., and Belkin N.J. The TREC interactive tracks: putting the user into search. In: Voorhees E.M., and Harman D.K. (Eds). TREC: Experiment and evaluation in information retrieval (2005), MIT Press 123-152
9. Fiscus, J., & Wheatley, B. (2004). Overview of the TDT2004 evaluation and results. In Proceedings of TDT-04.
10. Fuhr, N., Govert, N., Kazai, G., & Lalmas, M. (2002). INEX: INitiative for the evaluation of XML retrieval. In Proceedings of the SIGIR 2002 workshop on XML and information retrieval.
11. Gotz D., Zhou M.X., and Aggarwal V. Interactive visual synthesis of analytic knowledge. In: Wong P.C., and Keim D. (Eds). IEEE symposium on visual analytics science and technology, VAST 2006 (2006), IEEE, Baltimore, MD 51-58
12. Hanani U., Shapira B., and Shoval P. Information filtering: overview of issues, research and systems. User Modeling and User Adapted Interaction 11 3 (2001) 203-259
13. He, D., & Demner-Fushman, D. (2003). HARD experiment at maryland: from need negotiation to automated HARD process. In Proceedings of text REtrival conference (TREC) 2003.
14. Ingwersen P.J., and Kalervo. The Turn: integration of information seeking and retrieval in context (2005), Springer
15. Kando, N. (2005). In Proceedings of the fifth NTCIR workshop meeting on evaluation of information access technologies: information retrieval, question answering and cross-lingual information access Tokyo, Japan.
16. Larsen, B., Malik, S., & Tombros, A. (2005). The interactive track at INEX 2005. In The workshop of INEX 2005.
17. Larsen, B., Ingwersen, P., & Kekalainen, J. (2006). The polyrepresentation continuum in IR. In 1st international conference on IR in context.
18. Marchionini G. Exploratory search: from finding to understanding. Communications of the ACM 49 4 (2006) 41-46
19. Marchionini G., and Shneiderman B. Finding facts vs. browsing knowledge in hypertext systems. IEEE Computer 21 1 (1988) 70-79
20. McColgin, D., Gregory, M., Hetzler, E., & Turner, A. (2006). In: White, R.W., Muresan, G., Marchionini, G. (Eds.). From question answering to visual exploration in workshop on evaluating exploratory search systems at SIGIR 2006. (pp. 47-50).
21. Peters C., Gey F., Gonzalo J., Mueller H., Jones G., and Kluck M. Accessing multilingual information repositories: 6th workshop of the cross-language evaluation forum (2006), Springer
22. Pirolli, P., & Card, S.K. 2005. The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of 2005 International Conference on Intelligence Analysis, McLean, VA, 2-4 May 2005.
23. Pirolli P., and Fu W.-T. SNIF-ACT: A model of information foraging on the World Wide Web. In: Brusilovsky P., Corbett A., and Rosis F.d. (Eds). 9th international user modeling conference (2003), Springer-Verlag, Berlin 45-54
24. Robertson, S., & Soboroff, I. (2002). The TREC 2002 filtering track report. In Proceedings of TREC 2002.
25. Robertson S.E., and Hancock-Beaulieu M.M. On the evaluation of IR systems. Information Processing and Management 28 4 (1992) 457-466
26. Saracevic, T. (1995). Evaluation of evaluation in information retrieval. In: Proceedings of SIGIR '95 (pp. 138-146).
27. Voorhees, E. M., Harman, D., K., 2005. TREC: Experiment and evaluation in information retrieval: MIT Press.
28. Waern A. User involvement in automatic filtering - an experimental study. User Modeling and User Adapted Interaction 14 (2004) 201-237
29. White, R. W., Muresan, G., & Marchionini, G. (2006). Evaluating exploratory search systems. In: Evaluating exploratory search systems, a workshop of ACM SIGIR06.
30. White R.W., Jose J.M., and Ruthven I. An implicit feedback approach for interactive information retrieval. Information Processing and Management 42 1 (2004) 166-190
31. White R.W., Kules B., Drucker S.M., and Schraefel M.C. Supporting exploratory search. Communications of the ACM 49 4 (2006) 37-39
32. Wong P.C., Chin Jr. G., Foote H., Mackey P., and Thomas J. Have Green - a visual analytics framework for large semantic graphs. In: Wong P.C., and Keim D. (Eds). IEEE symposium on visual analytics science and technology, VAST 2006 (2006), IEEE, Baltimore, MD 67-74
33. Yang, Y., Lad, A., Lao, N., Harpale, A., Kisiel, B., & Rogati, et al. (2007). Utility-based information distillation over temporally sequenced documents. In Proceedings of ACM SIGIR'2007.
34. Yang Y., Yoo S., Zhang J., and Kisiel B. Robustness of adaptive filtering methods in a cross-benchmark evaluation. 28th Annual international ACM SIGIR conference Salvador (2005), ACM Press, Brazil 98-105
35. Zhang,Y. (2004). Using bayesian priors to combine classifiers for adaptive filtering. In 27th Annual international ACM SIGIR conference, Sheffield, United Kingdom (pp. 345-352).