A machine-learning approach to negation and speculation detection for sentiment analysis

Journal of the Association for Information Science and Technology

Volumn 67, Issue 9, 2016, Pages 2118-2136

  Cruz, Noa P ^a   Taboada, Maite ^b   Mitkov, Ruslan ^c  

^a UNIVERSITY OF HUELVA   (Spain)

^b SIMON FRASER UNIVERSITY   (Canada)

^c UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

Author keywords

machine learning; natural language processing

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA MINING; LEARNING ALGORITHMS; NATURAL LANGUAGE PROCESSING SYSTEMS;

MACHINE LEARNING APPROACHES; NATURAL LANGUAGE PROCESSING; OPINION MINING; SECOND PHASE; SENTIMENT ANALYSIS; SIMON FRASER UNIVERSITY;

LEARNING SYSTEMS;

HUMAN; MACHINE LEARNING; MINING; NATURAL LANGUAGE PROCESSING; PREDICTION; RECOGNITION; UNIVERSITY;

EID: 84983372812     PISSN: 23301635     EISSN: 23301643     Source Type: Journal    
DOI: 10.1002/asi.23533     Document Type: Article

References (63)

1. Agarwal, S., & Yu, H. (2010). Detecting hedge cues and their scope in biomedical text with conditional random fields. Journal of Biomedical Informatics, 43(6), 953–961.
2. Akbani, R., Kwek, S., & Japkowicz, N. (2004). Applying Support Vector Machines to Imbalanced Data Sets (pp. 39–50). Machine Learning: ECML 2004. Pisa, Italy: Springer.
3. Apostolova, E., Tomuro, N., & Demner-Fushman, D. (2011). Automatic extraction of lexico-syntactic patterns for detection of negation and speculation scopes. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: Short Papers (Volume 2, pp. 283–287).
4. Ballesteros Martínez, M. (2010). Mejora de la precisión para el análisis de dependencias usando maltparser para el castellano. Spain: Complutense University of Madrid.
5. Barua, S., Islam, M., Yao, X., & Murase, K. (2014). MWMOTE–majority weighted minority oversampling technique for imbalanced data set learning. IEEE Transactions on Knowledge and Data Engineering, 26(2), 405–425.
6. Benamara, F., Chardon, B., Mathieu, Y.Y., Popescu, V., & Asher, N. (2012). How do negation and modality impact opinions? Proceedings of the Workshop on Extra-Propositional Aspects of Meaning in Computational Linguistics (pp. 10–18).
7. Cao, P., Zaiane, O., & Zhao, D. (2014). A measure optimized cost-sensitive learning framework for imbalanced data classification. Biologically-Inspired Techniques for Knowledge Discovery and Data Mining, Advances in Data Mining and Database Management Book Series.
8. Chang, C., & Lin, C. (2011). LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST), 2(3), 27.
9. Chapman, W.W., Bridewell, W., Hanbury, P., Cooper, G.F., & Buchanan, B.G. (2001). A simple algorithm for identifying negated findings and diseases in discharge summaries. Journal of Biomedical Informatics, 34, 301–310.
10. Choi, Y., & Cardie, C. (2008). Learning with compositional semantics as structural inference for subsentential sentiment analysis. Proceedings of the Conference on Empirical Methods in Natural Language Processing (pp. 793–801).
11. Councill, I.G., McDonald, R., & Velikovich, L. (2010). What's great and what's not: Learning to classify the scope of negation for improved sentiment analysis. Proceedings of the Workshop on Negation and Speculation in Natural Language Processing (pp. 51–59).
12. Cruz Díaz, N.P., Maña López, M.J., Vázquez, J.M., & Álvarez, V.P. (2012). A machine-learning approach to negation and speculation detection in clinical texts. Journal of the American Society for Information Science and Technology, 63(7), 1398–1410.
13. Dadvar, M., Hauff, C., & de Jong, F. (2011). Scope of negation detection in sentiment analysis. Proceedings of the Dutch-Belgian Information Retrieval Workshop (pp. 16–20).
14. Elkin, P.L., Brown, S.H., Bauer, B.A., Husser, C.S., Carruth, W., Bergstrom, L.R., & Wahner-Roedler, D.L. (2005). A controlled trial of automated classification of negation from clinical notes. BMC Medical Informatics and Decision Making, 5(1), 13.
15. Farkas, R., Vincze, V., Móra, G., Csirik, J., & Szarvas, G. (2010). The CoNLL-2010 shared task: Learning to detect hedges and their scope in natural language text. Proceedings of the Fourteenth Conference on Computational Natural Language Learning—Shared Task (pp. 1–12).
16. Gaifman, H. (1965). Dependency systems and phrase-structure systems. Information and Control, 8(3), 304–337.
17. Gelbukh, A., Torres, S., & Calvo, H. (2005). Transforming a constituency treebank into a dependency treebank. Procesamiento del Lenguaje Natural, 35(4), 145–152.
18. Gildea, D., & Jurafsky, D. (2002). Automatic labeling of semantic roles. Computational Linguistics, 28(3), 245–288.
19. He, H., & Garcia, E.A. (2009). Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering, 21(9), 1263–1284.
20. He, H., & Ma, Y. (2013). Imbalanced Learning: Foundations, Algorithms, and Applications. Hoboken, NJ: John Wiley & Sons.
21. Hogenboom, A., van Iterson, P., Heerschop, B., Frasincar, F., & Kaymak, U. (2011). Determining negation scope and strength in sentiment analysis. 2011 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 960, 2589–2594.
22. Horn, L.R. (1989). A natural history of negation. Chicago: University of Chicago Press.
23. Hsu, C., Chang, C., & Lin, C. (2003). A practical guide to support vector classification. Taiwan: Department of Computer Science and Information Engineering, National Taiwan University.
24. Huang, Y., & Lowe, H.J. (2007). A novel hybrid approach to automated negation detection in clinical radiology reports. Journal of the American Medical Informatics Association, 14(3), 304–311.
25. Jia, L., Yu, C., & Meng, W. (2009). The effect of negation on sentiment analysis and retrieval effectiveness. Proceedings of the 18th ACM Conference on Information and Knowledge Management (pp. 1827–1830).
26. Konstantinova, N., de Sousa, S., Cruz, N., Maña, M.J., Taboada, M., & Mitkov, R. (2012). A review corpus annotated for negation, speculation and their scope. Proceedings of the Eight International Conference on Language Resources and Evaluation (pp. 3190–3195).
27. Kumar, M., & Sheshadri, H. (2012). On the classification of imbalanced data sets. International Journal of Computer Applications, 44, 6280-8449.
28. Lapponi, E., Read, J., & Ovrelid, L. (2012). Representing and resolving negation for sentiment analysis. 2012 IEEE 12th International Conference on Data Mining Workshops (ICDMW) (pp. 687–692).
29. Liu, J., & Seneff, S. (2009). Review sentiment scoring via a parse-and-paraphrase paradigm. Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing (pp. 161–169).
30. Macdonald, C., & Ounis, I. (2006). The TREC Blogs06 collection: Creating and analysing a blog test collection. Department of Computer Science, University of Glasgow Tech Report TR-2006-224, 1, 3.1–4.1.
31. Martınez-Cámara, E., Martın-Valdivia, M., Molina-González, M., & Urena-López, L. (2013). Bilingual experiments on an opinion comparable corpus. WASSA 2013, 87.
32. Mitchell, K.J. (2004). Implementation and evaluation of a negation tagger in a pipeline-based system for information extraction from pathology reports. Proceedings of the Medinfo Conference (pp. 663–667).
33. Moilanen, K., & Pulman, S. (2007). Sentiment composition. Proceedings of the Recent Advances in Natural Language Processing International Conference (pp. 378–382).
34. Montoyo, A., Martínez-Barco, P., & Balahur, A. (2012). Subjectivity and sentiment analysis: An overview of the current state of the area and envisaged developments. Decision Support Systems, 53(4), 675–679.
35. Morante, R., & Blanco, E. (2012). * SEM 2012 shared task: Resolving the scope and focus of negation. Proceedings of the First Joint Conference on Lexical and Computational Semantics-Volume 1: Proceedings of the Main Conference and the Shared Task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation (pp. 265–274).
36. Morante, R., & Daelemans, W. (2009a). Learning the scope of hedge cues in biomedical texts. Proceedings of the Workshop on Current Trends in Biomedical Natural Language Processing (pp. 28–36).
37. Morante, R., & Daelemans, W. (2009b). A metalearning approach to processing the scope of negation. Proceedings of the Thirteenth Conference on Computational Natural Language Learning (pp. 21–29).
38. Mutalik, P.G., Deshpande, A., & Nadkarni, P.M. (2001). Use of general-purpose negation detection to augment concept indexing of medical documents a quantitative study using the umls. Journal of the American Medical Informatics Association, 8(6), 598–609.
39. Nivre, J., Hall, J., & Nilsson, J. (2006). Maltparser: A data-driven parser-generator for dependency parsing. Proceedings of the Recent Advances in Natural Language Processing International Conference (pp. 2216–2219).
40. Özgür, A., & Radev, D.R. (2009). Detecting speculations and their scopes in scientific text. Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: 3, pp. 1398–1407.
41. Øvrelid, L., Velldal, E., & Oepen, S. (2010). Syntactic scope resolution in uncertainty analysis. Proceedings of the 23rd International Conference on Computational Linguistics (pp. 1379–1387).
42. Pang, B., & Lee, L. (2004). A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics (pp. 271–278).
43. Polanyi, L. (1986). The linguistic discourse model: Towards a formal theory of discourse structure. TR-6409. Cambridge: BBN Laboratories.
44. Polanyi, L., & van der Berg, M. (2011). Discourse structure and sentiment. 2011 IEEE 11th International Conference on Data Mining Workshops (ICDMW) (pp. 97–102).
45. Polanyi, L., & Zaenen, A. (2006). Contextual valence shifters. In J.G. Shanahan, Y. Qu, & J. Wiebe (Eds.), Computing attitude and affect in text: theory and applications (pp. 1–10). Dordrecht, Netherlands: Springer.
46. Rijsbergen, C.J.V. (1979). Information retrieval (2nd ed.). Newton, MA: Butterworth-Heinemann.
47. Rushdi Saleh, M., Martín-Valdivia, M.T., Montejo-Ráez, A., & Ureña-López, L. (2011). Experiments with SVM to classify opinions in different domains. Expert Systems with Applications, 38(12), 14799–14804.
48. Saurí, R. (2008). A factuality profiler for eventualities in text. (Ph.D. dissertation). Brandeis University, Waltham, MA.
49. Saurí, R., & Pustejovsky, J. (2009). FactBank: A corpus annotated with event factuality. Language Resources and Evaluation, 43(3), 227–268.
50. Sebastiani, F. (2002). Machine learning in automated text categorization. ACM Computing Surveys (CSUR), 34(1), 1–47.
51. Szarvas, G., Vincze, V., Farkas, R., & Csirik, J. (2008). The BioScope corpus: Annotation for negation, uncertainty and their scope in biomedical texts. Proceedings of the Workshop on Current Trends in Biomedical Natural Language Processing (pp. 38–45).
52. Taboada, M. (2008). SFU review corpus. Simon Fraser University. Retrieved from http://www.sfu.ca/~mtaboada/research/SFU_Review_Corpus.html
53. Taboada, M., Voll, K., & Brooke, J. (2008). Extracting Sentiment as a Function of Discourse Structure and Topicality. Vancouver, Canada: Simon Fraser University.
54. Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011). Lexicon-based methods for sentiment analysis. Computational Linguistics, 37(2), 267–307.
55. Velldal, E., Øvrelid, L., Read, J., & Oepen, S. (2012). Speculation and negation: Rules, rankers, and the role of syntax. Computational Linguistics, 38(2), 369–410.
56. Wiebe, J., Wilson, T., & Cardie, C. (2005). Annotating expressions of opinions and emotions in language. Language Resources and Evaluation, 39(2–3), 165–210.
57. Wiegand, M., Balahur, A., Roth, B., Klakow, D., & Montoyo, A. (2010). A survey on the role of negation in sentiment analysis. Proceedings of the Workshop on Negation and Speculation in Natural Language Processing (pp. 60–68).
58. Wilson, T., Wiebe, J., & Hoffmann, P. (2005). Recognizing contextual polarity in phrase-level sentiment analysis. Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing (pp. 347–354).
59. Witten, I.H., & Frank, E. (2005). Data mining: Practical machine learning tools and techniques. San Francisco, CA: Morgan Kaufmann.
60. Yessenalina, A., & Cardie, C. (2011). Compositional matrix-space models for sentiment analysis. Proceedings of the Conference on Empirical Methods in Natural Language Processing (pp. 172–182).
61. Zhu, Q., Li, J., Wang, H., & Zhou, G. (2010). A unified framework for scope learning via simplified shallow semantic parsing. Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing (pp. 714–724).
62. Zirn, C., Niepert, M., Stuckenschmidt, H., & Strube, M. (2011). Fine-grained sentiment analysis with structural features. Proceedings of the 5th International Joint Conference on Natural Language Processing (pp. 336–344).
63. Zou, B., Zhou, G., & Zhu, Q. (2013). Tree kernel-based negation and speculation scope detection with structured syntactic parse features. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing (pp. 968–976) Seattle, WA.