Comparing crowd-based, game-based, and machine-based approaches in initial query and query refinement tasks

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7814 LNCS, Issue , 2013, Pages 495-506

  Harris, Christopher G ^a   Srinivasan, Padmini ^a,b  

^a UNIVERSITY OF IOWA   (United States)

^b University of Iowa   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONSTRUCT QUERIES; FEED-BACK BASED; HUMAN COMPUTATION; MACHINE-BASED ALGORITHM; QUERY INTERFACES; QUERY REFINEMENT; RECALL AND PRECISION; WEB-BASED INTERFACE;

EMPLOYMENT; INFORMATION RETRIEVAL; MULTIMEDIA SYSTEMS;

QUERY PROCESSING;

EID: 84875448191     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-36973-5_42     Document Type: Conference Paper

References (27)

1. Ageev, M., Guo, Q., Lagun, D., Agichtein, E.: Find it if you can: a game for modeling different types of web search success using interaction data. In: Proceedings of SIGIR 2011, pp. 345-354. ACM, New York (2011)
2. Allan, J., Papka, R., Lavrenko, V.: On-line new event detection and tracking. In: Proceedings of SIGIR 1998, pp. 37-45. ACM, New York (1998)
3. Alonso, O., Lease, M.: Crowdsourcing for information retrieval: principles, methods, and applications. In: Proceedings of SIGIR 2011, pp. 1299-1300. ACM, New York (2011)
4. Alonso, O., Mizzaro, S.: Using crowdsourcing for TREC relevance assessment. Information Processing & Management 48(6), 1053-1066 (2012)
5. Anick, P.: Using terminological feedback for web search refinement: a log-based study. In: Proceedings of SIGIR 2003, pp. 88-95. ACM, New York (2003)
6. Belkin, N.J., Cool, C., Kelly, D., Lin, S.-J., Park, S.Y., Perez-Carballo, J., Sikora, C.: Iterative exploration, design and evaluation of support for query reformulation in interactive information retrieval. Inf. Process. Manage. 37(3), 403-434 (2001)
7. Bozzon, A., Brambilla, M., Ceri, S.: Answering search queries with CrowdSearcher. In: Proceedings of WWW 2012, Lyon, France, pp. 1009-1018. ACM, New York (2012)
8. Buckley, C., Voorhees, E.M.: Retrieval evaluation with incomplete information. In: Proceedings of SIGIR 2004, pp. 25-32. ACM, New York (2004)
9. Carvalho, V.R., Lease, M., Yilmaz, E.: Crowdsourcing for search evaluation. SIGIR Forum 44(2), 17-22 (2011)
10. Dasdan, A., Drome, C., Kolay, S., Alpern, M., Han, A., Chi, T., Hoover, J., Davtchev, I., Verma, S.: Thumbs-Up: a game for playing to rank search results. In: Proceedings of the ACM SIGKDD Workshop on Human Computation, Paris, France, pp. 36-37. ACM, New York (2009)
11. Dillon, A., Song, M.: An empirical comparison of the usability for novice and expert searchers of a textual and a graphic interface to an art-resource database. Journal of Digital Information 1(1) (2006)
12. Efthimiadis, E.N.: Interactive query expansion: a user-based evaluation in a relevance feedback environment. J. Am. Soc. Inf. Sci. 51(11), 989-1003 (2000)
13. Harris, C.G.: An Evaluation of Search Strategies for User-Generated Video Content. In: Proceedings of the WWW Workshop on Crowdsourcing Web Search, Lyon, France, pp. 48-53 (2012)
14. Harris, C.G., Srinivasan, P.: Applying Human Computation Mechanisms to Information Retrieval. In: Proceedings of 75th Annual Mtg of ASIS&T, Baltimore, MD (2012)
15. Joachims, T.: A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categorization. DTIC Document, 143-151 (1996)
16. Jones, K.S.: A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation 28(1), 11-21 (1972)
17. Law, E., van Ahn, L., Mitchell, T.: Search war: a game for improving web search. In: Proceedings of the ACM SIGKDD Workshop on Human Computation, Paris, France, p. 31. ACM, New York (2009)
18. Lease, M., Yilmaz, E.: Crowdsourcing for information retrieval. SIGIR Forum 45(2), 66-75 (2012)
19. McKibbon, K.A., Haynes, R.B., Walker Dilks, C.J., Ramsden, M.F., Ryan, N.C., Baker, L., Flemming, T., Fitzgerald, D.: How good are clinical MEDLINE searches? A comparative study of clinical end-user and librarian searches. Computers and Biomedical Research 23(6), 583-593 (1990)
20. Milne, D., Nichols, D.M., Witten, I.H.: A competitive environment for exploratory query expansion. In: Proceedings of the 8th ACM/IEEE-CS Joint Conference on Digital libraries (JCDL 2008), pp. 197-200. ACM, New York (2008)
21. Robertson, S.E., Walker, S., Jones, S., Hancock-Beaulieu, M.M., Gatford, M.: Okapi at TREC-3. NIST Special Publication SP-1995), 109-121 (1995)
22. Rocchio, J.J.: Relevance feedback in information retrieval. In: Salton, G. (ed.) The SMART Retrieval System - Experiments in Automatic Document Processing, pp. 313-323. Prentice Hall, Englewood Cliffs (1971)
23. Ruthven, I.: Re-examining the potential effectiveness of interactive query expansion. In: Proceedings of SIGIR 2003, pp. 213-220. ACM, New York (2003)
24. Spink, A., Jansen, B.J., Wolfram, D., Saracevic, T.: From e-sex to e-commerce: Web search changes. Computer 35(3), 107-109 (2002)
25. Strohman, T., Metzler, D., Turtle, H., Croft, W.B.: Indri: A language model-based search engine for complex queries. In: Proceedings of the International Conference on Intelligence Analysis, McLean, VA, Poster, May 2-6 (2005)
26. Turtle, H.: Natural language vs. Boolean query evaluation: a comparison of retrieval performance. In: Proceedings of SIGIR 1995, pp. 212-220. Springer, New York (1995)
27. Yan, T., Kumar, V., Ganesan, D.: CrowdSearch: exploiting crowds for accurate real-time image search on mobile phones. In: Proceedings of MobiSys 2010, pp. 77-90. ACM, New York (2010)