Using crowdsourcing and active learning to track sentiment in online media

Frontiers in Artificial Intelligence and Applications

Volumn 215, Issue , 2010, Pages 145-150

  Brew, Anthony ^a   Greene, Derek ^a   Cunningham, Pádraig ^a  

^a UNIVERSITY COLLEGE DUBLIN   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; E-LEARNING; LEARNING SYSTEMS;

ACTIVE LEARNING; ANNOTATION WORK; DESIGN CHALLENGES; MACHINE LEARNING SYSTEMS; NEWS CONTENT; ONLINE MEDIUM; WEB 2.0 TECHNOLOGIES;

CROWDSOURCING;

EID: 77956050042     PISSN: 09226389     EISSN: 18798314     Source Type: Book Series    
DOI: 10.3233/978-1-60750-606-5-145     Document Type: Conference Paper

References (18)

1. G. Attardi and M. Simi, 'Blog mining through opinionated words', in Proc. 15th Text REtrieval Conference (TREC 2006), (2006).
2. Sugato Basu, Mikhail Bilenko, and Raymond J. Mooney, 'A probabilistic framework for semi-supervised clustering', in Proc. 10th ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD'04), pp. 59-68, (2004).
3. J. Blitzer, M. Dredze, and F. Pereira, 'Biographies, bollywood, boomboxes and blenders: Domain adaptation for sentiment classification', in Proc. 45th Annual Meeting of the Association of Computational Linguistics, pp. 440-447, (2007).
4. Anthony Brew, Derek Greene, and P?adraig Cunningham, 'Is it Over Yet? Learning to Recognize Good News in Financial Media', Technical Report UCD-CSI-2010-2011, University College Dublin, (January 2010).
5. P. Cunningham, M. Cord, and S.J. Delany, 'Supervised Learning', in Machine Learning Techniques for Multimedia: Case Studies on Organization and Retrieval, eds., M. Cord and P. Cunningham, 21-49, Springer, (2008).
6. AP Dawid and AM Skene, 'Maximum likelihood estimation of observer error-rates using the EM algorithm', Journal of the Royal Statistical Society. Series C (Applied Statistics), 28(1), 20-28, (1979).
7. Pinar Donmez, Jaime G. Carbonell, and Jeff Schneider, 'Efficiently learning the accuracy of labeling sources for selective sampling', in Proc. 15th ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD '09), pp. 259-268, (2009).
8. P.Y. Hsueh, P. Melville, and V. Sindhwani, 'Data Quality from Crowdsourcing: A Study of Annotation Selection Criteria', in Proc. NAACL HLT 2009 Workshop on Active Learning for Natural Language Processing, pp. 27-35, (2009).
9. Aniket Kittur, Ed H. Chi, and Bongwon Suh, 'Crowdsourcing user studies with mechanical turk', in Proc. 26th Annual ACM Conference on Human Factors in Computing Systems (CHI'08), pp. 453-456, (2008).
10. S. Matsumoto, H. Takamura, and M. Okumura, 'Sentiment classification using word sub-sequences and dependency sub-trees', in Proc. 9th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD'05), pp. 301-310. Springer, (2005).
11. B. Pang, L. Lee, and S. Vaithyanathan, 'Thumbs up?: Sentiment classification using machine learning techniques', in Proceedings of the ACL- 02 conference on Empirical methods in natural language processing, volume 10, pp. 79-86, (2002).
12. F. Provost, T. Fawcett, and R. Kohavi, 'The case against accuracy estimation for comparing induction algorithms', in Proc. 15th International Conference on Machine Learning (ICML'98), pp. 445-453, (1998).
13. V.C. Raykar, S. Yu, L.H. Zhao, A. Jerebko, C. Florin, G.H. Valadez, L. Bogoni, and L. Moy, 'Supervised Learning from Multiple Experts: Whom to trust when everyone lies a bit', in Proc. 26th Annual International Conference on Machine Learning (ICML'09), pp. 889-896, (2009).
14. V.S. Sheng, F. Provost, and P.G. Ipeirotis, 'Get another label? improving data quality and data mining using multiple, noisy labelers', in Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 614-622, (2008).
15. P. Smyth, U. Fayyad, M. Burl, P. Perona, and P. Baldi, 'Inferring ground truth from subjective labelling of Venus images', Advances in Neural Information Processing Systems (NIPS'95), (1995).
16. Rion Snow, Brendan O'Connor, Daniel Jurafsky, and Andrew Y. Ng, 'Cheap and fast-but is it good?: evaluating non-expert annotations for natural language tasks', in Proc. Conference on Empirical Methods in Natural Language Processing (EMNLP'08), pp. 254-263. Association for Computational Linguistics, (2008).
17. T.Wilson, J.Wiebe, and P. Hoffmann, 'Recognizing contextual polarity in phrase-level sentiment analysis', in Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, pp. 347-354. Association for Computational Linguistics, (2005).
18. Alex Wright, 'Mining the web for feelings, not facts', The New York Times, (24 August 2009).