How evaluator domain expertise affects search result relevance judgments

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2008, Pages 591-598

  Kinney, Kenneth A ^a   Huffman, Scott B ^a   Zhai, Juting ^a  

^a GOOGLE INC   (United States)

Author keywords

Domain expertise; Information retrieval; Search evaluation

Indexed keywords

DOMAIN EXPERTISE; DOMAIN EXPERTS; EVALUATION APPROACH; KEY WORD MATCHING; RELEVANCE JUDGMENT; REPRESENTATIVE SAMPLE; SEARCH EVALUATION; SEARCH RESULTS; SURFACE FEATURE;

INFORMATION RETRIEVAL; INFORMATION SERVICES; WEB SERVICES;

KNOWLEDGE MANAGEMENT;

EID: 67650075369     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1458082.1458160     Document Type: Conference Paper

References (11)

1. A. Aula and K. Nordhausen. Modeling successful performance in web searching. J. Am. Soc. Inf. Sci. Technol., 57(12):1678-1693, 2006.
2. R. E. Downing, J. L. Moore, and S. W. Brown. The effects and interaction of spatial visualization and domain expertise on information seeking. Computers in Human Behavior, 21(2):195-209, 2004.
3. G. B. Duggan and S. J. Payne. Knowledge in the head and on the web: using topic expertise to aid search. In CHI '08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, pages 39-48, New York, NY, USA, 2008. ACM.
4. D. Harman. Overview of the first trec conference. In SIGIR '93: Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, pages 36-47, New York, NY, USA, 1993. ACM.
5. W. Hersh, C. Buckley, T. J. Leone, and D. Hickam. Ohsumed: an interactive retrieval evaluation and new large test collection for research. In SIGIR '94: Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, pages 192-201, New York, NY, USA, 1994. Springer-Verlag New York, Inc.
6. C. Holscher and G. Strube. Web search behavior of internet experts and newbies. Computer Networks, 33(1):337-346, 2000.
7. K. Jarvelin and J. Kekalainen. Cumulated gain-based evaluation of ir techniques. ACM Trans. Inf. Syst., 20(4):422-446, 2002.
8. C. Jenkins, C. L. Corritore, and S.Wiedenbeck. Patterns of information seeking on the web: A qualitative study of domain expertise and web expertise. IT and Society, 1(3):64-89, 2003.
9. P. Vakkari, M. Pennanen, and S. Serola. Changes of search terms and tactics while writing a research proposal: A longitudinal case study. Inf. Process. Manage., 39(3):445-463, 2003.
10. B. M. Wildemuth. The effects of domain knowledge on search tactic formulation. Journal of the American Society for Information Science and Technology, 55(3):246-258, 2003.
11. X. Zhang, H. G. B. Anghelescu, and X. Yuan. Domain knowledge, search behavior, and search effectiveness of engineering and science students: an exploratory study. Information Research, 10(2), 2005.