Clustering dictionary definitions using Amazon Mechanical Turk

Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, Mturk 2010 at the 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2010 - Proceedings

Volumn , Issue , 2010, Pages 21-29

  Parent, Gabriel ^a   Eskenazi, Maxine ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMAZON'S MECHANICAL TURKS; CLUSTERINGS; DICTIONARY DEFINITIONS; GLOBAL VIEW; MECHANICAL TURKS; TRAINING SETS; VOCABULARY TUTORS; WORD SENSE DISAMBIGUATION; WORKERS';

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80052404485     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Alonso, O., Rose, D. E., & Stewart, B. (2008). Crowdsourcing for relevance evaluation. ACM SIGIR Forum, 42 (2), pp. 9-15.
2. Callison-Burch, C. (2009). Fast, Cheap, and Creative: Evaluating Translation Quality Using Amazon‟s Mechanical Turk. Proceedings of EMNLP 2009.
3. Coxhead, A. (2000). A new academic word list. TESOL quarterly, 34 (2), 213-238.
4. Chklovski, T. & Mihalcea, R. (2003). Exploiting agreement and disagreement of human annotators for word sense disambiguation. Proceedings of RANLP 2003.
5. Fung, B. C., Wang, K., & Ester, M. (2003). Hierarchical document clustering using frequent itemsets. Proc. of the SIAM International Conference on Data Mining.
6. Gruenstein, A., McGraw, I., & Sutherland, A. (2009). "A self-transcribing speech corpus: collecting continuous speech with an online educational game". SLaTE Workshop.
7. Hathaway, R. J., & Bezdek, J. C. (2001). Fuzzy c-means clustering of incomplete data. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 31 (5), 735-744.
8. Heilman, M. Collins-Thompson, K., Callan, J. & Eskenazi M. (2006). Classroom success of an Intelligent Tutoring System for lexical practice and reading comprehension. Proceedings of the Ninth International Conference on Spoken Language.
9. Horton, J. (2009, 12 11). Turker Talk. Retrieved 01 2010, from Deneme: http://groups.csail.mit.edu/uid/deneme/?p=436
10. Hu, T., & Sung, S. Y. (2006). Finding centroid clusterings with entropy-based criteria. Knowledge and Information Systems, 10 (4), 505-514.
11. Huang, Y., & Mitchell, T. M. (2006). Text clustering with extended user feedback. Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval (p. 420). ACM.
12. Jagadeesan, A., Lynn, A., Corney, J., Yan, X., Wenzel, J., Sherlock, A., et al. (2009). Geometric reasoning via internet CrowdSourcing. 2009 SIAM/ACM Joint Conference on Geometric and Physical Modeling (pp. 313-318). ACM.
13. Kulkarni, A., Callan, J., & Eskenazi, M. (2007). Dictionary Definitions: The Likes and the Unlikes. Proceedings of the SLaTE Workshop on Speech and Language Technology in Education. Farmington, PA, USA.
14. Ledlie, J., Odero, B., Minkow, E., Kiss, I., & Polifroni, J. (2009). Crowd Translator: On Building Localized Speech Recognizers through Micropayments. Nokia Research Center.
15. Little, G. (2009, 08 22). Website Clustering. Retrieved 01 2010, from Deneme: http://groups.csail.mit.edu/uid/deneme/?p=244
16. Little, G., Chilton, L. B., Goldman, M., & Miller, R. C. (2009). TurKit: tools for iterative tasks on mechanical Turk. Proceedings of the ACM SIGKDD Workshop on Human Computation (pp. 29-30). ACM.
17. Niu, Z.-Y., Dong-Hong, J., & Chew-Lim, T. (2007). I2r: Three systems for word sense discrimination, chinese word sense disambiguation, and english word sense disambiguation. Proceedings of the Fourth International Workshop on Semantic Evaluations (SemEval-2007) (pp. 177-182). Prague, Czech Republic: Association for Computational Linguistics.
18. Rosenberg, A., & Hirschberg, J. (2007). V-measure: A conditional entropy-based external cluster evaluation measure. Proceedings of the 2007 Joint Conference EMNLP-CoNLL, (pp. 410-420).
19. SigLex, A. (2008). Retrieved 01 2010, from SemEval-2, Evaluation Exercises on Semantic Evaluation: http://semeval2.fbk.eu/semeval2.php
20. Snow, R., O'Connor, B., Jurafsky, D., & Ng, A. Y. (2008). Cheap and fast-but is it good? Evaluating non-expert annotations for natural language tasks. Proceedings of the Conference on Empirical Methods in Natural Language Processing (pp. 254-263). Association for Computational Linguistics.
21. Snow, R., Prakash, S., Jurafsky, D., & Ng, A. Y. (2007). Learning to Merge Word Senses. Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL) (pp. 1005-1014). Prague, Czech Republic: Association for Computational Linguistics.
22. Strehl, A., & Ghosh, J. (2003). Cluster ensembles-a knowledge reuse framework for combining multiple partitions. The Journal of Machine Learning Research, 3, 583-617.
23. Topchy, A., Jain, A. K., & Punch, W. (2005). Clustering ensembles: Models of consensus and weak partitions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27 (12), 1866-1881.
24. Zhao, Y., & Karypis, G. (2001). Criterion functions for document clustering: Experiments and analysis. Report TR 01-40, Department of Computer Science, University of Minnesota.