Games with a purpose or mechanised labour? A comparative study

ACM International Conference Proceeding Series

Volumn , Issue , 2013, Pages

  Sabou, Marta ^a   Bontcheva, Kalina ^b   Scharl, Arno ^a   Föls, Michael ^c  

^a MODUL UNIVERSITY VIENNA   (Austria)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

^c VIENNA UNIVERSITY OF ECONOMICS AND BUSINESS   (Austria)

Author keywords

Comparison; Games with a Purpose; Human Computation; Mechanised Labour

Indexed keywords

COMPARATIVE STUDIES; COMPARISON; CROSS GENRES; GAMES WITH A PURPOSE; HUMAN COMPUTATION; MECHANISED LABOUR; NATURAL LANGUAGE PROCESSING; RESEARCH ACTIVITIES;

KNOWLEDGE MANAGEMENT; NATURAL LANGUAGE PROCESSING SYSTEMS;

RESEARCH;

EID: 84888143290     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2494188.2494210     Document Type: Conference Paper

References (20)

1. J. Chamberlain, K. Fort, U. Kruschwitz, M. Lafourcade, and M. Poesio. Using Games to Create Language Resources: Successes and Limitations of the Approach. In I. Gurevych and K. Jungi, editors, The People's Web Meets NLP. Collaboratively Constructed Language Resources. Springer, 2013. To Appear.
2. K. Eckert, M. Niepert, C. Niemann, C. Buckner, C. Allen, and H. Stuckenschmidt. Crowdsourcing the Assembly of Concept Hierarchies. In Proc. of the 10th Annual Joint Conference on Digital Libraries, JCDL '10, pages 139-148. ACM, 2010.
3. K. Fort, G. Adda, and K. Cohen. Amazon Mechanical Turk: Gold Mine or Coal Mine? Computational Linguistics, 37(2):413-420, 2011.
4. A. Kawrykow, G. Roumanis, A. Kam, D. Kwak, C. Leung, C. Wu, E. Zarour, and P. players. Phylo: A Citizen Science Approach for Improving Multiple Sequence Alignment. PLoS ONE, 7(3):e31362, 2012.
5. A. Kittur, E. H. Chi, and B. Suh. Crowdsourcing User Studies with Mechanical Turk. In Proc. of the 26th Conference on Human Factors in Computing Systems, pages 453-456, 2008.
6. F. Laws, C. Scheible, and H. Schütze. Active Learning with Amazon Mechanical Turk. In Proc. of the Conf. on Empirical Methods in NLP, pages 1546-1556, 2011.
7. W. Mason and D. J. Watts. Financial Incentives and the "Performance of Crowds". In Proc. of the ACM SIGKDD Workshop on Human Computation, HCOMP '09, pages 77-85. ACM, 2009.
8. G. Parent and M. Eskenazi. Speaking to the Crowd: Looking at Past Achievements in Using Crowdsourcing for Speech and Predicting Future Challenges. In Proc. of INTERSPEECH, pages 3037-3040, 2011.
9. M. Poesio, U. Kruschwitz, J. Chamberlain, L. Robaldo, and L. Ducceschi. Phrase Detectives: Utilizing Collective Intelligence for Internet-Scale Language Resource Creation. Transactions on Interactive Intelligent Systems, 2012. To Appear.
10. A. J. Quinn and B. B. Bederson. Human Computation: A Survey and Taxonomy of a Growing Field. In Proc. of Human Factors in Computing Systems, pages 1403-1412, 2011.
11. M. Sabou, K. Bontcheva, and A. Scharl. Crowdsourcing Research Opportunities: Lessons from Natural Language Processing. In Proc. of the 12th International Conference on Knowledge Management and Knowledge Technologies (iKNOW), Special Track on Research 2.0, 2012.
12. A. Scharl, M. Sabou, and M. Föls. Climate Quiz: a Web Application for Eliciting and Validating Knowledge from Social Networks. In Proc. of the 18th Brazilian symposium on Multimedia and the web, WebMedia '12, pages 189-192. ACM, 2012.
13. K. Siorpaes and M. Hepp. Games with a Purpose for the Semantic Web. Intelligent Systems, IEEE, 23(3):50-60, 2008.
14. R. Snow, B. O'Connor, D. Jurafsky, and A. Y. Ng. Cheap and Fast - but is it Good?: Evaluating Non-Expert Annotations for Natural Language Tasks. In Proc. of EMNLP, pages 254-263, 2008.
15. S. Thaler, E. Simperl, and S. Wölger. An Experiment in Comparing Human-Computation Techniques. IEEE Internet Computing, 16(5):52-58, 2012.
16. L. von Ahn. Human Computation. PhD thesis, Carnegie Mellon University, December 2005.
17. L. von Ahn. Games With a Purpose. Computer, 39(6):92-94, 2006.
18. A. Wang, C. Hoang, and M. Y. Kan. Perspectives on Crowdsourcing Annotations for Natural Language Processing. Language Resources and Evaluation, 47(1), 2013.
19. G. Wohlgenannt, A. Weichselbraun, A. Scharl, and M. Sabou. Dynamic Integration of Multiple Evidence Sources for Ontology Learning. Journal of Information and Data Management, 3(3):243-254, 2012.
20. L. Wolf, M. Knuth, J. Osterhoff, and H. Sack. RISQ! Renowned Individuals Semantic Quiz - a Jeopardy like Quiz Game for Ranking Facts. In Proc. of the 7th International Conference on Semantic Systems, I-Semantics '11, pages 71-78. ACM, 2011.