Sarcastic sentiment detection in tweets streamed in real time: a big data approach

Digital Communications and Networks

Volumn 2, Issue 3, 2016, Pages 108-121

  Bharti, S K ^a   Vachha, B ^a   Pradhan, R K ^a   Babu, K S ^a   Jena, S K ^a  

^a NATIONAL INSTITUTE OF TECHNOLOGY   (India)

Author keywords

Big data; Flume; Hadoop; Hive; MapReduce; Sarcasm; Sentiment; Tweets

Indexed keywords

EID: 85015224919     PISSN: 24685925     EISSN: 23528648     Source Type: Journal    
DOI: 10.1016/j.dcan.2016.06.002     Document Type: Article

References (49)

1. D. Chaffey, Global Social Media Research Summary 2016. URL 〈 http://www.smartinsights.com/social-media-marketing/social-media-strategy/new-global-social-media-research/〉.
2. Tan, W., Blake, M.B., Saleh, I., Dustdar, S., Social-network-sourced big data analytics. Internet Comput. 17:5 (2013), 62–69.
3. Z.N. Gastelum, K.M. Whattam, State-of-the-Art of Social Media Analytics Research, Pacific Northwest National Laboratory, 2013, pp. 1-9.
4. Zikopoulos, P., Eaton, C., Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data. 2011, McGraw-Hill Osborne Media.
5. E. Riloff, A. Qadir, P. Surve, L. De Silva, N. Gilbert, R. Huang, Sarcasm as contrast between a positive sentiment and negative situation, in: Proceedings of the Conference on Empirical Methods in Natural Language Processing, 2013, pp. 704–714.
6. Hadoop. URL 〈 http://hadoop.apache.org/〉.
7. S. Fitzgerald, I. Foster, C. Kesselman, G. Von Laszewski, W. Smith, S. Tuecke, A directory service for configuring high-performance distributed computations, in: Proceedings on High Performance Distributed Computing, IEEE, 1997, pp. 365–375.
8. Dean, J., Ghemawat, S., Mapreduce: simplified data processing on large clusters. Commun. ACM 51:1 (2008), 107–113.
9. Hoffman, S., Apache Flume: Distributed Log Collection for Hadoop. 2013, Packt Publishing Ltd.
10. Flume. URL 〈 http://flume.apache.org/〉.
11. K. Shvachko, H. Kuang, S. Radia, R. Chansler, The Hadoop distributed file system, in: Proceedings of 26th Symposium on Mass Storage Systems and Technologies (MSST), IEEE, 2010, pp. 1–10.
12. A. Thusoo, J.S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff, R. Murthy, Hive: a warehousing solution over a map-reduce framework, Proc. VLDB Endow. 2(2) (2009) 1626–1629.
13. S.M. Thede, M.P. Harper, A second-order hidden Markov model for part-of-speech tagging, in: Proceedings of the 37th Annual Meeting on Computational Linguistics, ACL, 1999, pp. 175–182.
14. D. Klein, C.D. Manning, Accurate unlexicalized parsing, in: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, ACL, 2003, pp. 423–430.
15. Park, K., Hwang, K., A bio-text mining system based on natural language processing. J. KISS: Comput. Pract. 17:4 (2011), 205–213.
16. Q. Mei, C. Zhai, Discovering evolutionary theme patterns from text: an exploration of temporal text mining, in: Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, ACM, 2005, pp. 198–207.
17. Liu, B., Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5:1 (2012), 1–167.
18. R. González-Ibánez, S. Muresan, N. Wacholder, Identifying sarcasm in twitter: a closer look, in: Proceedings of the 49th Annual Meeting on Human Language Technologies, ACL, 2011, pp. 581–586.
19. S.K. Bharti, K.S. Babu, S.K. Jena, Parsing-based sarcasm sentiment recognition in twitter data, in: Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), ACM, 2015, pp. 1373–1380.
20. E. Lunando, A. Purwarianti, Indonesian social media sentiment analysis with sarcasm detection, in: International Conference on Advanced Computer Science and Information Systems (ICACSIS), IEEE, 2013, pp. 195–198.
21. P. Tungthamthiti, S. Kiyoaki, M. Mohd, Recognition of sarcasm in tweets based on concept level sentiment analysis and supervised learning approaches, in: 28th Pacific Asia Conference on Language, Information and Computation, 2014, pp. 404–413.
22. Ha, I., Back, B., Ahn, B., Mapreduce functions to analyze sentiment information from social big data. Int. J. Distrib. Sens. Netw. 2015:1 (2015), 1–11.
23. Twitter streaming api. URL 〈 http://apiwiki.twitter.com/〉, 2010.
24. J. Kalucki, Twitter streaming api. URL 〈 http://apiwiki.twitter.com/Streaming-API-Documentation/〉, 2010.
25. A. Bifet, E. Frank, Sentiment knowledge discovery in twitter streaming data, in: 13th International Conference on Discovery Science, Springer, 2010, pp. 1–15.
26. Z. Tufekci, Big questions for social media big data: representativeness, validity and other methodological pitfalls, arXiv preprint arXiv:1403.7400.
27. A.P. Shirahatti, N. Patil, D. Kubasad, A. Mujawar, Sentiment Analysis on Twitter Data Using Hadoop.
28. Taylor, R.C., An overview of the Hadoop/mapreduce/hbase framework and its current applications in bioinformatics. BMC Bioinform. 11:Suppl 12 (2010), 1–6.
29. M. Kornacker, J. Erickson, Cloudera Impala: Real Time Queries in Apache Hadoop, for Real. URL 〈 http://blog〉. cloudera. com/blog/2012/10/cloudera-impala-real-time-queries-in-apache-hadoop-for-real.
30. D. Davidov, O. Tsur, A. Rappoport, Semi-supervised recognition of sarcastic sentences in twitter and amazon, in: Proceedings of the Fourteenth Conference on Computational Natural Language Learning, ACL, 2010, pp. 107–116.
31. E. Filatova, Irony and sarcasm: Corpus generation and analysis using crowdsourcing, in: Proceedings of Language Resources and Evaluation Conference, 2012, pp. 392–398.
32. Kreuz, R.J., Roberts, R.M., Two cues for verbal irony: hyperbole and the ironic tone of voice. Metaphor Symb. 10:1 (1995), 21–31.
33. R.J. Kreuz, G.M. Caucci, Lexical influences on the perception of sarcasm, in: Proceedings of the Workshop on Computational Approaches to Figurative Language, ACL, 2007, pp. 1–4.
34. O. Tsur, D. Davidov, A. Rappoport, Icwsm—a great catchy name: Semi-supervised recognition of sarcastic sentences in online product reviews, in: Proceedings of International Conference on Weblogs and Social Media, 2010, pp. 162–169.
35. J.W. Pennebaker, M.E. Francis, R.J. Booth, Linguistic Inquiry and Word Count: Liwc 2001, vol. 71, no. 1, Lawrence Erlbaum Associates, Mahway, 2001, pp. 1–11.
36. C. Strapparava, A. Valitutti, et al., Wordnet affect: an affective extension of wordnet, in: Proceedings of Language Resources and Evaluation Conference, vol. 4, 2004, pp. 1083–1086.
37. F. Barbieri, H. Saggion, F. Ronzano, Modelling sarcasm in twitter a novel approach, in: Proceedings of the 5th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, 2014, pp. 50–58.
38. P. Carvalho, L. Sarmento, M.J. Silva, E. De Oliveira, Clues for detecting irony in user-generated contents: oh...!! it's so easy;-), in: Proceedings of the 1st International CIKM Workshop on Topic-Sentiment Analysis for Mass Opinion, ACM, 2009, pp. 53–56.
39. D. Tayal, S. Yadav, K. Gupta, B. Rajput, K. Kumari, Polarity detection of sarcastic political tweets, in: Proceedings of International Conference on Computing for Sustainable Global Development (INDIACom), IEEE, 2014, pp. 625–628.
40. A. Rajadesingan, R. Zafarani, H. Liu, Sarcasm detection on twitter: a behavioral modeling approach, in: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, ACM, 2015, pp. 97–106.
41. Utsumi, A., Verbal irony as implicit display of ironic environment: distinguishing ironic utterances from nonirony. J. Pragmat. 32:12 (2000), 1777–1806.
42. C. Liebrecht, F. Kunneman, A. van den Bosch, The perfect solution for detecting sarcasm in tweets# not, in: Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, ACL, New Brunswick, NJ, 2013, pp. 29–37.
43. Marcus, M.P., Marcinkiewicz, M.A., Santorini, B., Building a large annotated corpus of English: the Penn treebank. Comput. Linguist. 19:2 (1993), 313–330.
44. A. Esuli, F. Sebastiani, Sentiwordnet: A publicly available lexical resource for opinion mining, in: Proceedings of Language Resources and Evaluation Conference, 2006, pp. 417–422.
45. N. Ide, K. Suderman, The american national corpus first release, in: Proceedings of Language Resources and Evaluation Conference, Citeseer, 2004.
46. N. Ide, C. Macleod, The american national corpus: a standardized resource of American English, in: Proceedings of Corpus Linguistics, 2001.
47. Charniak, E., Statistical techniques for natural language parsing. AI Mag. 18:4 (1997), 33–43.
48. J. Perkins, Python Text Processing with NLTK 2.0 Cookbook, Packt Publishing Ltd, 2010.
49. D. Rusu, L. Dali, B. Fortuna, M. Grobelnik, D. Mladenic, Triplet extraction from sentences, in: Proceedings of the 10th International Multiconference on Information Society—IS, 2007, pp. 8–12.