Sentiment analysis methods for understanding large-scale texts: a case for using continuum-scored words and word shift graphs

EPJ Data Science

Volumn 6, Issue 1, 2017, Pages

  Reagan, Andrew J ^a   Danforth, Christopher M ^a   Tivnan, Brian ^b   Williams, Jake Ryland ^c   Dodds, Peter Sheridan ^a  

^a UNIVERSITY OF VERMONT   (United States)

^b MITRE CORPORATION   (United States)

^c DREXEL UNIVERSITY   (United States)

Author keywords

data visualization; language; natural language processing; sentiment; sentiment analysis; sentiment dictionaries; text visualization

Indexed keywords

BEHAVIORAL RESEARCH; DATA MINING; DATA VISUALIZATION; SCALES (WEIGHING INSTRUMENTS); VISUALIZATION;

LANGUAGE; SENTIMENT; SENTIMENT ANALYSIS; SENTIMENT DICTIONARIES; TEXT VISUALIZATION;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 85032565890     PISSN: None     EISSN: 21931127     Source Type: Journal    
DOI: 10.1140/epjds/s13688-017-0121-9     Document Type: Article

References (44)

1. Bollen J, Mao H, Zeng X (2011) Twitter mood predicts the stock market. J Comput Sci 2(1):1-8
2. Si J, Mukherjee A, Liu B, Li Q, Li H, Deng X (2013) Exploiting topic based Twitter sentiment for stock prediction. In: ACL, vol 2, pp 24-29
3. Chung S, Liu S (2011) Predicting stock market fluctuations from Twitter. Berkeley, California
4. Ruiz EJ, Hristidis V, Castillo C, Gionis A, Jaimes A (2012) Correlating financial time series with micro-blogging activity. In: Proceedings of the fifth ACM international conference on web search and data mining. ACM, New York, pp 513-522
5. Dodds PS, Clark EM, Desu S, Frank MR, Reagan AJ, Williams JR, Mitchell L, Harris KD Kloumann IM, Bagrow JP, Megerdoomian K, McMahon MT, Tivnan BF, Danforth CM (2015) Human language reveals a universal positivity bias. Proc Natl Acad Sci USA 112(8):2389-2394
6. Alajajian SE, Williams JR, Reagan AJ, Alajajian SC, Frank MR, Mitchell L, Lahne J, Danforth CM, Dodds PS (2017) The Lexicocalorimeter: gauging public health through caloric input and output on social media. PLoS ONE 12(2):e0168893. doi:10.1371/journal.pone.0168893
7. Bradley MM Lang PJ (1999) Affective norms for english words (ANEW): stimuli, instruction manual and affective ratings. Technical report c-1, University of Florida, Gainesville, FL
8. Pennebaker JW, Francis ME, Booth RJ (2001) Linguistic inquiry and word count: LIWC 2001. Erlbaum, Mahway
9. Wilson T, Wiebe J, Hoffmann P (2005) Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of human language technologies conference/conference on empirical methods in natural language processing (HLT/EMNLP 2005)
10. Liu B (2010) Sentiment analysis and subjectivity. In: Handbook of natural language processing 2nd edn. pp 627-666
11. Warriner AB, Kuperman V, Brysbaert M (2013) Norms of valence, arousal, and dominance for 13,915 English lemmas. Behav Res Methods 45(4):1191-1207. doi:10.3758/s13428-012-0314-x
12. Socher R, Perelygin A, Wu JY, Chuang J, Manning CD, Ng AY, Potts C (2013) Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the conference on empirical methods in natural language processing (EMNLP), pp 1631-1642. Citeseer
13. Dodds PS, Danforth CM (2009) Measuring the happiness of large-scale written expression: songs, blogs, and presidents. J Happiness Stud 11(4):441-456. doi:10.1007/s10902-009-9150-9
14. Dodds PS, Harris KD, Kloumann IM, Bliss CA, Danforth CM (2011) Temporal patterns of happiness and information in a global social network: hedonometrics and Twitter. PLoS ONE 6(12):26752. doi:10.1371/journal.pone.0026752
15. Ribeiro FN, Araújo M, Gonçalves P, Gonçalves MA, Benevenuto F (2016) SentiBench — a benchmark comparison of state-of-the-practice sentiment analysis methods. EPJ Data Sci 5(1):23. doi:10.1140/epjds/s13688-016-0085-1
16. Liu B (2012) Sentiment analysis and opinion mining. Synthesis lectures on human language technologies. Morgan & Claypool, San Rafael, pp 1-167
17. Watson D, Clark LA (1999) The PANAS-X: manual for the positive and negative affect schedule-expanded form. PhD thesis, University of Iowa
18. De Smedt T, Daelemans W (2012) Pattern for Python. J Mach Learn Res 13(1):2063-2067
19. Baccianella S, Esuli A, Sebastiani F (2010) SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: LREC’10, pp 2200-2204
20. Nielsen F (2011) A new ANEW: evaluation of a word list for sentiment analysis in microblogs. In: Rowe M, Stankovic M, Dadzie A-S, Hardey M (eds) Proceedings of the ESWC2011 workshop on ‘making sense of microposts’: big things come in small packages CEUR workshop proceedings, vol 718, pp 93-98
21. Stone PJ, Dunphy DC, Smith MS (1966) The general inquirer: a computer approach to content analysis. MIT Press, Cambridge
22. Whissell C, Fournier M, Pelland R, Weir D, Makarec K (1986) A dictionary of affect in language: iv. Reliability, validity, and applications. Percept Mot Skills 62(3):875-888
23. Mohammad SM Turney PD (2013) Crowdsourcing a word-emotion association lexicon. Comput Intell 29(3):436-465
24. Kiritchenko S, Zhu X, Mohammad SM (2014) Sentiment analysis of short informal texts. J Artif Intell Res 50:723-762
25. Zhu X, Kiritchenko S, Mohammad SM (2014) NRC-Canada-2014: recent improvements in the sentiment analysis of tweets. In: Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014), pp 443-447. Citeseer
26. Mohammad SM, Kiritchenko S, Zhu X (2013) NRC-Canada: building the state-of-the-art in sentiment analysis of tweets. In: Proceedings of the seventh international workshop on semantic evaluation exercises (SemEval-2013), Atlanta, Georgia, USA
27. Taboada M, Brooke J, Tofiloski M, Voll K, Stede M (2011) Lexicon-based methods for sentiment analysis. Comput Linguist 37(2):267-307
28. Cambria E, Olsher D, Rajagopal D (2014) Senticnet 3: a common and common-sense knowledge base for cognition-driven sentiment analysis. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence. AAAI Press, Menlo Park, pp 1515-1521
29. Gonçalves P, Araújo M, Benevenuto F, Cha M (2013) Comparing and combining sentiment analysis methods. In: Proceedings of the first ACM conference on online social networks. ACM, New York, pp 27-38.
30. Thelwall M, Buckley K, Paltoglou G, Cai D, Kappas A (2010) Sentiment strength detection in short informal text. J Am Soc Inf Sci Technol 61(12):2544-2558
31. Hutto CJ, Gilbert E (2014) Vader: a parsimonious rule-based model for sentiment analysis of social media text. In: Eighth international AAAI conference on weblogs and social media. AAAI Press, Menlo Park
32. Levallois C (2013) Umigon: sentiment analysis for tweets based on terms lists and heuristics. In: Second joint conference on lexical and computational semantics (*SEM), vol 2, pp 414-417
33. Pappas N, Katsimpras G, Stamatatos E (2013) Distinguishing the popularity between topics: a system for up-to-date opinion retrieval and mining in the web. In: International conference on intelligent text processing and computational linguistics. Springer, Berlin, pp 197-209
34. Poria S, Gelbukh A, Hussain A, Howard N, Das D, Bandyopadhyay S (2013) Enhanced senticnet with affective labels for concept-based opinion mining. IEEE Intell Syst 28(2):31-38
35. Sandhaus E (2008) The New York Times Annotated Corpus. Linguistic Data Consortium, Philadelphia
36. Pang B, Lee L (2004) A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts. In: Proceedings of the ACL
37. Lin Y, Michel J-B, Aiden EL, Orwant J, Brockman W, Petrov S (2012) Syntactic annotations for the Google books ngram corpus. In: Proceedings of the ACL 2012 system demonstrations, pp 169-174. Association for Computational Linguistics
38. Mitchell L, Frank MR, Harris KD, Dodds PS, Danforth CM (2013) The geography of happiness: connecting Twitter sentiment and expression, demographics, and objective characteristics of place. PLoS ONE 8(5):64417. doi:10.1371/journal.pone.0064417
39. Dodds PS, Clark EM, Desu S, Frank MR, Reagan AJ, Williams JR, Mitchell L, Harris KD, Kloumann IM, Bagrow JP, Megerdoomian K, McMahon MT, Tivnan BF, Danforth CM (2015) Reply to Garcia et al.: common mistakes in measuring frequency-dependent word characteristics. Proc Natl Acad Sci USA 112(23):2984-2985. http://www.pnas.org/content/112/23/E2984.full.pdf. doi:10.1073/pnas.1505647112
40. Rayner JMV (1985) Linear relations in biomechanics: the statistics of scaling functions. J Zool 206:415-439
41. Michel J-B, Shen YK, Aiden AP, Veres A, Gray MK, Pickett JP, Hoiberg D, Clancy D, Norvig P, Orwant J, Pinker S, Nowak MA, Aiden EL (2011) Quantitative analysis of culture using millions of digitized books. Science 331(6014):176-182
42. Pechenick EA, Danforth CM, Dodds PS (2015) Characterizing the Google books corpus: strong limits to inferences of socio-cultural and linguistic evolution. arXiv preprint arXiv:1501.00960
43. Hand DJ, Yu K (2001) Idiot’s Bayes — not so stupid after all? Int Stat Rev 69(3):385-398
44. Bird S (2006) Nltk: the natural language toolkit. In: Proceedings of the COLING/ACL on interactive presentation sessions, pp 69-72. Association for Computational Linguistics