Emerging directions in predictive text mining

Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery

Volumn 5, Issue 4, 2015, Pages 155-164

  Indurkhya, Nitin ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP LEARNING; PREDICTIVE ANALYTICS; SENTIMENT ANALYSIS;

COMPLEX APPLICATIONS; GROWTH POTENTIAL; META INFORMATION; MULTILINGUAL TEXTS; NATURAL LANGUAGE PROCESSING; PREDICTIVE MODELS; SCALABLE ALGORITHMS; UNSTRUCTURED DATA;

TEXT MINING;

EID: 84931956838     PISSN: 19424787     EISSN: 19424795     Source Type: Journal    
DOI: 10.1002/widm.1154     Document Type: Review

References (86)

1. Reyes A, Rosso P, Veale T. Learning representations by back-propagating errors. Nature 1986, 323:533-536.
2. Kecman V. Learning and Soft Computing: Support Vector Machines, Neural Networks, and Fuzzy Logic Models. Cambridge, MA: MIT Press; 2001.
3. Hinton GE, Salakhutdinov RR. Reducing the dimensionality of data with neural networks. Science 2006, 3130:504-507.
4. Hinton GE. Learning multiple layers of representation. Trends Cogn Sci 2007, 110:428-434.
5. Brants T, Popat AC, Xu P, Och FJ, Dean J, Google Inc. Large language models in machine translation. In: Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CNLL). Stroudsburg, PA: Association for Computational Linguistics; 2007, 858-867.
6. Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. Available at: http://arxiv.org/abs/1301.3781, 2013. [Accessed 20 May 2015].
7. Mikolov T, Kopecky J, Burget L, Glembek O, Cernocky J. Neural network based language models for highly inflective languages. In: Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '09. Washington, DC: IEEE Computer Society; 2009, 4725-4728.
8. Salakhutdinov R, Hinton G. Semantic hashing. Int J Approx Reason 2009, 50:969-978.
9. Kalchbrenner N, Blunsom P. Recurrent continuous translation models. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing (EMNLP). Stroudsburg, PA: Association for Computational Linguistics; 2013, 1700-1709.
10. Larochelle H, Bengio Y. Classification using discriminative restricted Boltzmann machines. In: Proceedings of the 25th International Conference on Machine Learning. New York: ACM; 2008, 536-543.
11. Glorot X, Bordes A, Bengio Y. Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11). New York: ACM; 2011, 513-520.
12. Socher R, Pennington J, Huang EH, Ng AY, Manning CD. Semi-supervised recursive autoencoders for predicting sentiment distributions. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA: Association for Computational Linguistics; 2011, 151-161.
13. Pascanu R, Gulcehre C, Cho K, Bengio Y. How to construct deep recurrent neural networks. http://arxiv.org/abs/1312.6026, 2013. [Accessed 20 May 2015].
14. Sussillo D. Neural circuits as computational dynamical systems. Curr Opin Neurobiol 2014, 25:156-163.
15. Shen Y, Wang J. Robustness analysis of global exponential stability of recurrent neural networks in the presence of time delays and random disturbances. IEEE Trans Neural Netw Learn Syst 2012, 23:87-96.
16. Blei DM, Ng AY, Jordan MI. Latent Dirichlet allocation. J Mach Learn Res 2003, 3:993-1022.
17. Blei DM. Probabilistic topic models. Commun ACM 2012, 550:77-84.
18. McCallum AK. AvaiMallet: a machine learning for language toolkit. Available at: http://mallet.cs.umass.edu, 2002. [Accessed 20 May 2015].
19. Wang X, McCallum A, Wei X. Topical n-grams: phrase and topic discovery, with an application to information retrieval. In: Seventh IEEE International Conference on Data Mining. ICDM 2007. Washington DC: IEEE Computer Society; 2007, 697-702.
20. Derntl M, Günnemann N, Tillmann A, Klamma R, Jarke M. Building and exploring dynamic topic models on the web. In: Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management. New York: ACM; 2014, 2012-2014.
21. Teh YW, Jordan MI, Beal MJ, Blei DM. Hierarchical Dirichlet processes. J Am Stat Assoc 2006, 101:1566-1581.
22. Blei DM, Griffiths TL, Jordan MI. The nested Chinese restaurant process and Bayesian nonparametric inference of topic hierarchies. J ACM 2010, 57:7.
23. Gardner MJ, Lutes J, Lund J, Hansen J, Walker D, Ringger E, Seppi K. The topic browser: an interactive tool for browsing topic models. In: NIPS Workshop on Challenges of Data Visualization, Whistler, BC, Canada, 2010.
24. Chuang J, Manning CD, Heer J. Termite: visualization techniques for assessing textual topic models. In: Proceedings of the International Working Conference on Advanced Visual Interfaces. New York: ACM; 2012, 74-77.
25. Reich J, Tingley D, Leder-Luis J, Roberts ME, Stewart BM. Computer assisted reading and discovery for student generated text in massive open online courses. J Learn Anal. Forthcoming.
26. Guo Z, Zhang Z, Zhu S, Chi Y, Gong Y. A two-level topic model towards knowledge discovery from citation networks. IEEE Trans Knowl Data Eng 2014, 260:780-794.
27. Wilson TA. Topic chains for determining risk of unauthorized information transfer. PhD Thesis, Arizona State University, Tempe, AZ, 2014.
28. Wallach HM, Murray I, Salakhutdinov R, Mimno D. Evaluation methods for topic models. In: Proceedings of the 26th Annual International Conference on Machine Learning. New York: ACM; 2009, 1105-1112.
29. Chang J, Gerrish S, Wang C, Boyd-Graber JL, Blei DM. Reading tea leaves: how humans interpret topic models. In: Advances in Neural Information Processing Systems, vol. 22. Cambridge, MA: MIT Press; 2009, 288-296.
30. Schenker A, Last M, Bunke H, Kandel A. Classification of web documents using a graph model. In: Proceedings of the Seventh International Conference on Document Analysis and Recognition. Washington DC: IEEE Computer Society; 2003, 240-244.
31. Zuo J, Wang M, Ye H. Text classification model based on Markov network distance. J Comput Inform Syst 2011, 70:3368-3375.
32. Aggarwal C, Zhao P. Towards graphical models for text processing. Knowl Inf Syst 2013, 360:1-21.
33. Reyes A, Rosso P, Veale T. Graph classification by means of Lipschitz embedding. IEEE Trans Syst Man Cybern B Cybern 2009, 39:1472-1483.
34. Jiang C, Coenen F, Sanderson R, Zito M. Text classification using graph mining-based feature extraction. Knowl-Based Syst 2010, 230:302-308.
35. Saravanan M, Ravindran B, Raman S. Improving legal document summarization using graphical models. Front Artif Int Appl 2006, 152:51.
36. Sorokina D, Gehrke J, Warner S, Ginsparg P. Plagiarism detection in arxiv. In: Sixth International Conference on Data Mining, ICDM'06. Washington DC: IEEE Computer Society; 2006, 1070-1075.
37. Zaki MJ, Aggarwal CC. Xrules: an effective structural classifier for xml data. In: Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM; 2003, 316-325.
38. Wilson TA. Substructure similarity search in graph databases. In: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data. New York: ACM; 2005, 766-777.
39. Wan X. Co-training for cross-lingual sentiment classification. Vist: a dynamic index method for querying xml data by tree structures. In: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data. New York: ACM; 2003, 110-121.
40. Sowa JF. Conceptual Structures: Information Processing in Mind and Machine. Boston, MA: Addison-Wesley Longman; 1984.
41. Kamaruddin SS, Hamdan AR, Bakar AA, Nor FM. Dissimilarity algorithm on conceptual graphs to mine text outliers. In: 2nd Conference on Data Mining and Optimization, DMO '09. Washington DC: IEEE Computer Society; 2009, 46-52.
42. Montes-y-Gómez M, Gelbukh A, López-López A. Text mining at detail level using conceptual graphs. In: Conceptual Structures: Integration and Interfaces. Berlin: Springer; 2002, 122-136.
43. Jiang T, Tan A-H, Wang K. Mining generalized associations of semantic relations from textual web content. IEEE Trans Knowl Data Eng 2007, 190:164-179.
44. Yang S-Y, Soo V-W. Extract conceptual graphs from plain texts in patent claims. Eng Appl Artif Intell 2012, 250:874-887.
45. Barzilay R, Elhadad M. Using lexical chains for text summarization. In: Advances in Automatic Text Summarization. Cambridge, MA: MIT Press; 1999, 111-121.
46. Steinberger J, Poesio M, Kabadjov MA, Jeek K. Two uses of anaphora resolution in summarization. Inf Process Manag 2007, 430:1663-1680.
47. Goldstein J, Mittal V, Carbonell J, Kantrowitz M. Multi-document summarization by sentence extraction. In: Proceedings of the 2000 NAACL-ANLP Workshop on Automatic Summarization, vol. 4. Stroudsburg, PA: Association for Computational Linguistics; 2000, 40-48.
48. Belz A. Automatic generation of weather forecast texts using comprehensive probabilistic generation-space models. Nat Lang Eng 2008, 140:431-455.
49. Yu J, Reiter E, Hunter J, Mellish C. Choosing the content of textual summaries of large time-series data sets. Nat Lang Eng 2007, 130:25-49.
50. Di Eugenio B, Green N. Emerging applications of natural language generation in information visualization, education and healthcare. In: Indurkhya N, Damerau FJ, eds. Handbook of Natural Language Processing. 2nd ed. Boca Raton, FL: CRC Press; 2010. ISBN: 78-1420085921.
51. Lehmam A. Essential summarizer: innovative automatic text summarization software in twenty languages. In: Adaptivity, Personalization and Fusion of Heterogeneous Information, RIAO '10. Paris, France: Le Centre de Hautes Etudes Internationales D'informatique Documentaire; 2010, 216-217.
52. Lin C-Y. Rouge: a package for automatic evaluation of summaries. In: Proceedings of the ACL-04 Workshop Text Summarization Branches Out. Stroudsburg, PA: Association for Computational Linguistics; 2004, 74-81.
53. Zhou L, Lin C-Y, Munteanu DS, Hovy E. ParaEval: using paraphrases to evaluate summaries automatically. In: Proceedings of the Main Conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics. Stroudsburg, PA: Association for Computational Linguistics; 2006, 447-454.
54. Conroy JM, Dang HT, Nenkova A, Owczarzak K, eds. Proceedings of Workshop on Evaluation Metrics and System Comparison for Automatic Summarization. Stroudsburg, PA: Association for Computational Linguistics; June 2012.
55. Pang B, Lee L. Opinion mining and sentiment analysis. Found Trends Inform Retr 2008, 20:1-135.
56. Liu B. Sentiment analysis and subjectivity. In: Indurkhya N, Damerau FJ, eds. Handbook of Natural Language Processing. 2nd ed. Boca Raton, FL: CRC Press; 2010. ISBN: 978-1420085921.
57. Mostafa MM. More than words: social networks text mining for consumer brand sentiments. Expert Syst Appl 2013, 40:4241-4251.
58. Wilson TA. Fine-grained subjectivity and sentiment analysis: recognizing the intensity, polarity, and attitudes of private states. Doctoral Dissertation, ProQuest, University of Pittsburgh, Pittsburgh, PA, 2008.
59. Recupero D, Presutti V, Consoli S, Gangemi A, Nuzzolese A. Sentilo: frame-based sentiment analysis. Cogn Comput 2014, 7:211-225.
60. Saini A, Bhatia N, Suri B, Jain S. Emoxract: domain independent emotion mining model for unstructured data. In: 2014 Seventh International Conference on Contemporary Computing (IC3). Washington DC: IEEE Computer Society; 2014, 94-98.
61. Ganapathibhotla M, Liu B. Mining opinions in comparative sentences. In: Proceedings of the 22nd International Conference on Computational Linguistics, vol. 1. Stroudsburg, PA: Association for Computational Linguistics; 2008, 241-248.
62. Fan T-K, Chang C-H. Sentiment-oriented contextual advertising. Knowl Inf Syst 2010, 230:321-344.
63. Wilson T, Wiebe J, Hoffmann P. Recognizing contextual polarity: an exploration of features for phrase-level sentiment analysis. Comput Ling 2009, 350:399-433.
64. Volkova S, Wilson T, Yarowsky D. Exploring demographic language variations to improve multilingual sentiment analysis in social media. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing (EMNLP). Stroudsburg, PA: Association for Computational Linguistics; 2013, 1815-1827.
65. Reyes A, Rosso P, Veale T. A multidimensional approach for detecting irony in twitter. Lang Resour Eval 2013, 47:239-268.
66. Blanchard O. Social Media ROI: Managing and Measuring Social Media Efforts in Your Organization. Boston, MA: Pearson Education; 2011.
67. Zhang T, Oles F. The value of unlabeled data for classification problems. In: Langley P, ed. Proceedings of the Seventeenth International Conference on Machine Learning. San Francisco, CA: Morgan Kaufmann; 2000, 1191-1198.
68. Blum A, Mitchell T. Combining labeled and unlabeled data with co-training. In: Proceedings of the Eleventh Annual Conference on Computational Learning Theory. New York: ACM; 1998, 92-100.
69. Goldman S, Zhou Y. Enhancing supervised learning with unlabeled data. In: Proceedings of Seventh International Conference on Machine Learning. San Francisco, CA: Morgan Kaufmann; 2000, 327-334.
70. Zhou Z-H, Li M. Tri-training: exploiting unlabeled data using three classifiers. IEEE Trans Knowl Data Eng 2005, 170:1529-1541.
71. Balcan M-F, Blum A, Yang K. Co-training and expansion: towards bridging theory and practice. In: Advances in Neural Information Processing Systems, vol. 17. Cambridge, MA: MIT Press; 2004, 89-96.
72. Kiritchenko S, Matwin S. Email classification with co-training. In: Proceedings of the 2011 Conference of the Center for Advanced Studies on Collaborative Research. Riverton, NJ: IBM Corp.; 2011, 301-312.
73. Wan X. Co-training for cross-lingual sentiment classification. In: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, vol. 1. Stroudsburg, PA: Association for Computational Linguistics; 2009, 235-243.
74. Nigam K, Ghani R. Analyzing the effectiveness and applicability of co-training. In: Proceedings of the Ninth International Conference on Information and Knowledge Management. New York: ACM; 2000, 86-93.
75. Madani O, Pennock DM, Flake GW. Co-validation: using model disagreement on unlabeled data to validate classification algorithms. In: Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press; 2004, 873-880.
76. Platanios A, Blum A, Mitchell TM. Estimating accuracy from unlabeled data. In Proceedings of 30th Conference on Uncertainty in Artificial Intelligence, Quebec, Canada, 2014.
77. Zhu X, Goldberg AB. Introduction to semi-supervised learning. Synt Lect Artif Int Mach Learn 2009, 30:1-130.
78. Carlson A, Betteridge J, Wang RC, Hruschka ER Jr, Mitchell TM. Coupled semi-supervised learning for information extraction. In: Proceedings of the Third ACM International Conference on Web Search and Data Mining. New York: ACM; 2010, 101-110.
79. Ando RK, Zhang T. A framework for learning predictive structures from multiple tasks and unlabeled data. J Mach Learn Res 2005, 6:1817-1853.
80. Ko Y, Seo J. Automatic text categorization by unsupervised learning. In: Proceedings of the 18th Conference on Computational linguistics, vol. 1. Stroudsburg, PA: Association for Computational Linguistics; 2000, 453-459.
81. Barzilay R, Lee L. Learning to paraphrase: an unsupervised approach using multiple-sequence alignment. In: Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, vol. 1. Stroudsburg, PA: Association for Computational Linguistics; 2003, 16-23.
82. Leskovec J, Milic-Frayling N, Grobelnik M. Impact of linguistic analysis on the semantic graph coverage and learning of document extracts. In: Proceedings of the 20th National Conference on Artificial Intelligence, vol. 3. Menlo Park, CA: AAAI Press; 2005, 1069-1074.
83. Zhu L, Gao S, Pan SJ, Li H, Deng D, Shahabi C. Graph-based informative-sentence selection for opinion summarization. In: Advances in Social Networks Analysis and Mining (ASONAM). Washington DC: IEEE Computer Society; 2013, 408-412.
84. Hu X, Tang J, Gao H, Liu H. Unsupervised sentiment analysis with emotional signals. In: Proceedings of the 22nd International Conference on World Wide Web. Geneva, Switzerland: International World Wide Web Conferences Steering Committee; 2013, 607-618.
85. Zhu L, Galstyan A, Cheng J, Lerman K. Tripartite graph clustering for dynamic sentiment analysis on social media. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data. New York: ACM; 2014, 1531-1542.
86. Tan C, Lee L, Tang J, Jiang L, Zhou M, Li P. User-level sentiment analysis incorporating social networks. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM; 2011, 1397-1405.