Implicit Feedback: Using Behavior to Infer Relevance

Information Retrieval Series

Volumn 19, Issue , 2005, Pages 169-186

  Kelly, Diane ^a  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

Collaborative Filter; Implicit Measure; Query Expansion; Reading Time; Relevance Feedback

Indexed keywords

COLLABORATIVE FILTER; FEEDBACK CURRENTS; FEEDBACK RESEARCHES; IMPLICIT FEEDBACK; IMPLICIT MEASURES; KEY ISSUES; QUERY EXPANSION; READING TIME; RELEVANCE FEEDBACK; RESEARCH EFFORTS;

COLLABORATIVE FILTERING;

EID: 84925297554     PISSN: 18717500     EISSN: 27306836     Source Type: Book Series    
DOI: 10.1007/1-4020-4014-8_9     Document Type: Chapter

References (57)

1. Anick, P. (2003). Using Terminological Feedback for Web Search Refinement: A Log Based Study. In Proceedings of the 26th Annual ACM SIGIR International Conference on Research and Development in Information Retrieval (SIGIR ‘03) (pp. 88–95), Canada.
2. Beaulieu, M. (1997). Experiments on Interfaces to Support Query Expansion. Journal of Documentation, 53(1), 8–19.
3. Belkin, N. J., Cool, C., Kelly, D., Lin, S. J., Park, S. Y., Perez-Carballo, J., and Sikora, C. (2001). Iterative Exploration, Design and Evaluation of Support for Query Reformulation in Interactive Information Retrieval. Information Processing and Management, 37(3), 404–434.
4. Billsus, D. and Pazzani, M. J. (1999). A Personal News Agent That Talks, Learns and Explains. In Proceedings of the 3rd International Conference on Autonomous Agents (AGENTS ‘99), (pp. 268–275), USA.
5. Bollacker, K. D., Lawrence, S., and Giles, C. L. (2000). Discovering Relevant Scientific Literature on the Web. IEEE Intelligent Systems, 15(2), 42–47.
6. Borlund, P. (2003). The Concept of Relevance in IR. Journal of the American Society for Information Science, 54(10), 913–925.
7. Budzik, J. and Hammond, K. (1999). Watson: Anticipating and Contextualizing Information Needs. In Proceedings of the 62nd Meeting of the American Society for Information Science (ASIS ’99), (pp. 727–740), USA.
8. Budzik, J., Hammond, K., and Birnbaum, L. (2001). Information Access in Context. Knowledge Based Systems, 14(1–2), 37–53.
9. Chen, M. LaPaugh, A. S. and Singh, J. P. (2002). Predicting Category Access for a User in Structured Information Space. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’02), (pp. 65–72), Finland.
10. Claypool, M. Le, P. Waseda, M. and Brown, D. (2001). Implicit Interest Indicators. In Proceedings of the 6th International Conference on Intelligent User Interfaces (IUI ’01), (pp. 33–40), USA.
11. Cooper, M. D. and Chen, H.-M. (2001). Predicting the Relevance of a Library Catalog Search. Journal of the American Society for Information Science, 52(10), 813– 827.
12. Dumais, S., Cutrell, E., Sarin, R., and Horvitz, E. (2004). Implicit Queries (IQ) for Contextualized Search. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’04), Sheffield, UK, 594.
13. Fendlay, J. M., Walker, R., and Kengridge, R. W. (1995) (Eds.). Eye Movement Research: Mechanisms, Processes and Applications. New York: Elsevier Science Publishing.
14. Fischer, G. and Stevens, C. (1991). Information Access in Complex, Poorly Structured Information Spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘91), (pp. 63–70), USA.
15. Goldberg, D., Nichols, D., Oki, B. M., and Terry, D. (1992). Using Collaborative Filtering to Weave an Information Tapestry. Communications of the ACM, 35(12), 61–70.
16. Golovchinsky, G., Price, M. N., and Schilit, B. N. (1999). From Reading to Retrieval: Freeform Ink Annotations as Queries. In Proceedings of the 24th Annual ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’99), (pp. 19–25), USA.
17. Huang, C.-K., Chien, L.-F., and Oyang, Y.-J. (2003). Relevant Term Suggestion in Interactive Web Search Based on Contextual Information in Query Session Logs. Journal of the American Society for Information Science and Technology, 54(7), 638–649.
18. Ikehara, C. S., Chin, D. N., and Crosby, M. E. (2003). A Model for Integrating an Adaptive Information Filter Utilizing Biosensor Data to Assess Cognitive Load. In Proceedings of the Ninth International Conference on User Modeling (UM ’03), (pp. 208–212), USA.
19. Joachims, T. (2002). Optimizing Search Engines Using Clickthrough Data. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD ’02), (pp. 133–142), Canada.
20. Joachims, T. Freitag, D., and Mitchell, T. (1997). WebWatcher: A Tour Guide for the World Wide Web. In Proceedings of the International Joint Conference on Artificial Intelligence (ICML 97), (pp. 770–777), USA.
21. Kamba, T., Sakagami, H., and Koseki, Y. (1997). ANATAGONOMY: A Personalized Newspaper on the World Wide Web. International Journal of Human-Computer Studies, 46, 789–803.
22. Kellar, M., Watters, C., Duffy, J., and Shepherd, M. (2004). Effect of Task on Time Spent Reading as an Implicit Measure of Interest. In Proceedings of the 67th American Society for Information Science and Technology (ASIS and T) Annual Meeting, 41, pp. 168–175.
23. Kelly, D. and Belkin, N. J. (2001). Reading Time, Scrolling and Interaction: Exploring Implicit Sources of User Preferences for Relevance Feedback During Interactive Information Retrieval. In Proceedings of the 24th Annual ACM SIGIR International Conference on Research and Development in Information Retrieval (SIGIR ‘01), (pp. 408–409), USA.
24. Kelly, D. and Belkin, N. J. (2002). A User Modeling System for Personalized Interaction and Tailored Retrieval in Interactive IR. In Proceedings of the Annual Conference of the American Society for Information Science and Technology (ASIST ‘02), (pp. 316–325), USA.
25. Kelly, D. and Belkin, N. J. (2004). Display Time as Implicit Feedback: Understanding Task Effects. In Proceedings of the 27th Annual ACM International Conference on Research and Development in Information Retrieval (SIGIR ’04), (pp. 377–384), Sheffield, UK.
26. Kelly, D. and Cool, C. (2002). The Effects of Topic Familiarity on Information Search Behavior. In Proceedings of the Second ACM/IEEE Joint Conference on Digital Libraries (JCDL ’02), (pp. 74–75), USA.
27. Kelly, D. and Teevan, J. (2003). Implicit Feedback for Inferring User Preference: A Bibliography. SIGIR Forum 37(2), 18–28.
28. Kim. J. Oard, D. W. and Romanik, K. (2000). Using Implicit Feedback for User Modeling in Internet and Intranet Searching. University of Maryland CLIS Technical Report 00-01.
29. Kleinberg, J. M. (1999). Authoritative Sources in a Hyperlinked Environment. Journal of the ACM, 46(5), 604–632.
30. Koenemann, J. and Belkin, N. J. (1996). A Case for Interaction: A Study of Interactive Information Retrieval Behavior and Effectiveness. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI ’96), (pp. 205– 212), Canada.
31. Kuhlthau, C. C. (1993). Seeking Meaning: A Process Approach to Library and Information Services. Norwood, NJ: Ablex.
32. Lieberman, H. (1995). Letizia: An Agent That assists Web Browsing. In Proceedings of the International Joint Conference on Artificial Intelligence (pp. 924–929), USA.
33. Liu, F., Yu, C., and Meng, W. (2002). Personalized Web Search By Mapping User Queries to Categories. In Proceedings of the Eleventh International Conference on Information and Knowledge Management (CIKM ‘02), (pp. 558–565), USA.
34. Miller, B. N., Riedl, J. T., and Konstan, J. A. (2003). GroupLens for Usenet: Experiences in Applying Collaborative Filtering to a Social Information System. In: C. Lueg and D. Fisher (Eds.), From Usenet to CoWebs: Interacting With Social Information Spaces (pp. 206–231) London: Springer Press.
35. Mladenic, D. (1999). Machine Learning Used By Personal WebWatcher. Proceedings of the ACAI-99 Workshop on Machine Learning and Intelligent Agents. Crete.
36. Morita, M. and Shinoda, Y. (1994). Information Filtering Based on User Behavior Analysis and Best Match Text Retrieval. In Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’94), (pp. 272–281), Ireland.
37. Nichols, D. M. (1997). Implicit Ratings and Filtering. In Proceedings of the 5th DELOS Workshop on Filtering and Collaborative Filtering (pp. 31–36), Hungary.
38. Oard, D. W. and Kim, J. (2001). Modeling Information Content Using Observable Behavior. In Proceedings of the 64th Annual Meeting of the American Society for Information Science and Technology (ASIST ’01), (pp. 38–45), USA.
39. Page, L. Brin, S. Motwani, R. and Winograd, T. (1998). The PageRank Citation Ranking: Bringing Order to the Web. Stanford University Technical Report.
40. Picard, R. W. and Klein, J. (2002). Computers That Recognize and Respond to User Emotion: Theoretical and Practical Implications. Interacting with Computers, 14(2), 141–169.
41. Price, M. N., Golovchinsky, G., and Schilit, B. N. (1998). Linking By Inking: Trailblazing in a Paper-Like Hypertext. In Proceedings of the 9th ACM Conference on Hypertext and Hypermedia ’98 (Hypertext ’98), (pp. 30–39), USA.
42. Quiroga, L. M. and Mostafa, J. (2002). An Experiment in Building Profiles in Information Filtering: The Role of Context of User Relevance Feedback. Information Processing and Management, 38, 671–694.
43. Rhodes, B. J. and Starner, T. (1996). Remembrance Agent: A Continuously Running Automated Information Retrieval System. In Proceedings of the 1st International Conference on the Practical Application of Intelligent Agents and Multi-Agent Technology (PAAM ’96), (pp. 487–495).
44. Rhodes, B. J. (2000). Margin Notes: Building a Contextually Aware Associative Memory. In Proceedings of the 5th International Conference on Intelligent User Interfaces (IUI ’00), (pp. 219–224), USA.
45. Rucker, J. and Polanco, J. (1997). Citeseer: Personalized Navigation for the Web. Communications of the ACM, 40(3), 73–75.
46. Salton, G. (Ed.) (1971). The SMART Retrieval System: Experiments in Automatic Document Processing. NJ: Prentice-Hall.
47. Seo, Y. W. and Zhang, B. T. (2000). A Reinforcement Learning Agent for Personalized Information Filtering. In Proceedings of the 5th International Conference on Intelligent User Interfaces (IUI ’00), (pp. 248– 251), USA.
48. Shen, X. and Zhai, C.-X. (2003). Exploiting Query History for Document Ranking in Interactive Information Retrieval. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’03), (pp. 377–378), Canada.
49. Shipman, F. M., Price, M. N., Marshall, C. C., Golovchinsky, G., and Schilit, B. N. (2003). Identifying Useful Passages in Documents Based on Annotation Patterns. In Proceedings of the 2003 European Conference on Digital Libraries (ECDL ’03), (pp. 101–112).
50. Spink, A. (1996). Multiple Search Session Model of End-User Behavior: An Exploratory Study. Journal of the American Society for Information Science, 47(8), 603–609.
51. Spink, A. and Losee, R. M. (1996). Feedback in Information Retrieval. Annual Review of Information Science and Technology, 31, 33–78.
52. Terveen, L. Hill, W. Amento, B. McDonald, D. and Crete, J. (1997). PHOAKS: A System for Sharing Recommendations. Communications of the ACM, 40(3), 59–62.
53. Vakkari, P. (2000). Cognition and Changes of Search Terms and Tactics During Task Performance: A Longitudinal Case Study. In Proceedings of the RIAO 2000 Conference, 894–907.
54. Vakkari, P. (2003). Task-Based Information Searching. Annual Review of Information Science and Technology, 37, 413–464.
55. White, R. W. Ruthven, I. and Jose, J. M. (2002a). Finding Relevant Documents Using Top Ranking Sentences: An Evaluation of Two Alternative Schemes. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’02), (pp. 57–64), Finland.
56. White, R. W. Jose, J. M. and Ruthven, I. (2003). An Approach for Implicitly Detecting Information Needs. In Proceedings of the 12th Annual ACM Conference on Information and Knowledge Management (CIKM’03), (pp. 504–507), New Orleans, LA.
57. White, R. W. and Jose, J. M. (2004). An Implicit System for Predicting Interests. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’04), (p. 595), Sheffield, UK.