Improving search engines using human computation games

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2009, Pages 275-284

  Ma, Hao ^a   Chandrasekar, Raman ^b   Quirk, Chris ^b   Gupta, Abhishek ^c  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b MICROSOFT RESEARCH   (United States)

^c GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Findability; Human computation games; Query alterations; Relevance; Web search

Indexed keywords

ALTERNATIVE APPROACH; CLICKTHROUGH DATA; GAME PLAYERS; HUMAN COMPUTATION; OTHER APPLICATIONS; QUERY REFINEMENT; RELEVANCE JUDGMENT; WEB PAGE; WEB SEARCH ENGINES; WEB SEARCHES;

INFORMATION RETRIEVAL; KNOWLEDGE MANAGEMENT; METADATA; SEARCH ENGINES;

WORLD WIDE WEB;

EID: 74549203384     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1645953.1645990     Document Type: Conference Paper

References (28)

1. P. N. Bennett, D.M. Chickering, A.Mityagin. Learning Consensus Opinion: Mining Data from a Labeling Game. In WWW '09, pages 121-131, New York, NY, USA, 2009. ACM.
2. P. Brown, V. Della Pietra, S. Della Pietra, and R. Mercer. The mathematics of statistical machine translation: parameter estimation. Computational Linguistics 19(2): 263-312, 1993.
3. A. Dempster, N. Laird, and D. Rubin. Likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39(1):1-38, 1977.
4. D. Edery and E. Mollick. Changing the Game: How Video Games Are Transforming the Future of Business. Pearson Education Inc., 2009.
5. N. Ford, T. D. Wilson, A. Foster, D. Ellis, and A. Spink. Information seeking and mediated searching. Part 4. Cognitive styles in information seeking. Journal of the American Society for Information Science and Technology (JASIST), 53(9):728-735, 2002.
6. P. Koehn, F. J. Och, and D. Marcu. Statistical phrase-based translation. In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, Edmonton, Alberta, Canada, 2003.
7. E. Law, A. Mityagin, and M. Chickering. Building human-computation games for search. In Submission.
8. E. Law, A. Mityagin, and M. Chickering. Intentions: A game for classifying query intent. In CHI EA '09, pages 3805-3810, New York, NY, USA, 1980. ACM.
9. E. Law, L. von Ahn, R. B. Dannenberg, and M. Crawford. Tagatune: A game for music and sound annotation. In Proceedings of the Eighth International Conference on Music Information Retrieval, pages 361-364, Vienna, Austria, 2007. Austrian Computer Society.
10. T. W. Malone. What makes things fun to learn? Heuristics for designing instructional computer games. In SIGSMALL '80: Proceedings of the 3rd ACM SIGSMALL symposium and the first SIGPC symposium on Small systems, pages 162-169, New York, NY, USA, 1980. ACM.
11. T. W. Malone. Heuristics for designing enjoyable player interfaces: Lessons from computer games. In Proceedings of the 1982 conference on Human factors in computing systems, pages 63-68, New York, NY, USA, 1982. ACM.
12. M. McDonald, R. Musson and R. Smith. The Practical Guide to Defect Prevention, Microsoft Press, 2007.
13. NIST 2008 Machine Translation Evaluation. http://www.nist.gov/speech/ tests/mt/2008/doc/mt08-official-results-v0.html
14. T. Paek, Y.-C. Ju, and Chris Meek. People watcher: A game for eliciting human-transcribed data for automated directory assistance. In INTERSPEECH '07, pages 1322-1325, 2007.
15. C. Quirk, C. Brockett, and W. B. Dolan. Monolingual Machine Translation for Paraphrase Generation. In EMNLP '04. Barcelona, Spain, 2004.
16. S. Vogel, H. Ney, and C. Tillmann. HMM-based word alignment in statistical translation. In COLING '96. Copenhagen, Denmark, 1996.
17. L. von Ahn. Games with a purpose. IEEE Computer, 39(6):92-94, 2006.
18. L. von Ahn and L. Dabbish. Labeling images with a computer game. In CHI '04, pages 319-326, New York, NY, USA, 2004. ACM.
19. L. von Ahn and L. Dabbish. Designing games with a purpose. Communications of the ACM, 51(8):58-67, 2008.
20. L. von Ahn, S. Ginosar, M. Kedia, and M. Blum. Improving image search with phetch. In ICASSP '07, pages 15-20, April 2007.
21. L. von Ahn, S. Ginosar, M. Kedia, R. Liu, and M. Blum. Improving accessibility of the web with a computer game. In CHI '06, pages 79-82, New York, NY, USA, 2006. ACM.
22. L. von Ahn, M. Kedia, and M. Blum. Verbosity: a game for collecting common-sense facts. In CHI '06, pages 75-78, New York, NY, USA, 2006. ACM.
23. L. von Ahn, R. Liu, and M. Blum. Peekaboom: a game for locating objects in images. In CHI '06, pages 55-64, New York, NY, USA, 2006. ACM.
24. I. Weber, S. Robertson and M. Vojnovic. Rethinking the ESP Game. Technical Report, Microsoft Research, MSRTR-2008-132, Sept. 2008.
25. E. Agichtein, E. Brill, and S. Dumais. Improving web search ranking by incorporating user behavior information. In SIGIR '06, pages 19-26, New York, NY, USA, 2006. ACM.
26. G. Buscher, A. Dengel, and L. van Elst. Query expansion using gaze-based feedback on the subdocument level. In SIGIR '08, pages 387-394, New York, NY, USA, 2008. ACM.
27. L. Azzopardi, V. Vinay. An Evaluation Measure for Higher Order Information Access Tasks. In CIKM '08, New York, NY, USA, 2008, ACM.
28. L. Azzopardi, V. Vinay. Accessibility in Information Retrieval. In ECIR '08, pages 482-489, Glasgow, Scotland, 2008.