Approaching Sentiment Analysis by using semi-supervised learning of multi-dimensional classifiers

Neurocomputing

Volumn 92, Issue , 2012, Pages 98-115

  Ortigosa Hernández, Jonathan ^a   Rodríguez, Juan Diego ^a   Alzate, Leandro ^b   Lucania, Manuel ^b   Inza, Iñaki ^a   Lozano, Jose A ^a  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

^b NONE

Author keywords

EM algorithm; Multi dimensional class Bayesian network classifiers; Multi dimensional classification; Semi supervised learning; Sentiment Analysis

Indexed keywords

BAYESIAN NETWORK CLASSIFIERS; CLASSIFICATION FRAMEWORK; CLASSIFICATION TASKS; COMPUTATIONAL STUDIES; EM ALGORITHMS; LEARNING TECHNIQUES; MULTI-DIMENSIONAL APPROACH; MULTI-LABEL; NEGATIVE SENTIMENTS; POLARITY CLASSIFICATION; REAL-WORLD PROBLEM; RECOGNITION RATES; SEMI-SUPERVISED; SEMI-SUPERVISED LEARNING; SENTIMENT ANALYSIS; SINGLE VARIABLE; STATISTICAL RELATIONS; SUBOPTIMAL SOLUTION;

ALGORITHMS; BAYESIAN NETWORKS; DATA MINING; SUPERVISED LEARNING;

TEXT PROCESSING;

ARTICLE; BAYES THEOREM; BAYESIAN NETWORK CLASSIFIER; CLASSIFICATION; CLASSIFIER; DATA MINING; LEARNING ALGORITHM; MACHINE LEARNING; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; SEMI SUPERVISED LEARNING; SENTIMENT ANALYSIS;

EID: 84861480960     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2012.01.030     Document Type: Article

References (58)

1. Abbasi A., Chen H., Thoms S., Fu T. Affect analysis of web forums and blogs using correlation ensembles. IEEE Trans. Knowledge Data Eng. 2008, 20(9):1168-1180.
2. Argamon S., Whitelaw C., Chase P., Raj Hota S., Garg N., Levitan S. Stylistic text classification using functional lexical features. J. Am. Soc. Inf. Sci. Technol. 2007, 58(6):802-822.
3. J. Atserias, B. Casas, E. Comelles, M. Gonzalez, L. Padro, M. Padro, Freeling 1.3: Syntactic and semantic services in an open-source NLP library, in: Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC'06), 2006, pp. 48-55.
4. Baklr G., Taskar B., Hofmann T., Scholkopf B., Smola A., Vishwanathan S.V.N. Predicting Structured Data 2007, MIT Press.
5. Bielza C., Li G., Larrañaga P. Multi-dimensional classification with Bayesian networks. Int. J. Approx. Reason. 2011, 52(6):705-727.
6. Bishop C.M. Pattern Recognition and Machine Learning (Information Science and Statistics) 2006, Springer.
7. R. Blanco, Learning Bayesian Networks from Data with Factorisation and Classification Purposes. Applications in Biomedicine. PhD Thesis, University of the Basque Country, 2005.
8. X. Carreras, I. Chao, L. Padro, M. Padro, An open-source suite of language analyzers, in: Proceedings of the Fourth International Conference on Language Resources and Evaluation, vol. 10, 2006, pp. 239-242.
9. Caruana R. Multitask learning. Machine Learning 1997, 28:41-75.
10. Chapelle O., Scholkopf B., Zien A. Semi-Supervised Learning 2006, The MIT Press.
11. Chow C.I., Member S., Liu C.N. Approximating discrete probability distributions with dependence trees. IEEE Trans. Inf. Theory 1968, 14:462-467.
12. I. Cohen, Semisupervised Learning of Classifiers with Application to Human-Computer Interaction, PhD thesis, University of Illinois at Urbana-Champaign, 2003.
13. I. Cohen, F.G. Cozman, A. Bronstein, The effect of unlabeled data on generative classifiers, with application to model selection, in: Proceedings of the SPIE 93 Conference on Geometric Methods in Computer Vision, 2002.
14. Cohen I., Cozman F.G., Sebe N., Cirelo M.C., Huang T.S. Semisupervised learning of classifiers: theory, algorithms and their application to human-computer interaction. IEEE Trans. Pattern Anal. Mach. Intell. 2004, 26(12):1553-1567.
15. Cooper G., Herskovits E. A Bayesian method for the induction of probabilistic networks from data. Mach. Learn. 1992, 9:309-347.
16. H. Daumé, D. Marcu, Learning as search optimization: approximate large margin methods for structured prediction, in: Proceedings of the 22nd International Conference on Machine Learning, 2005, pp. 169-176.
17. de Waal P.R., van der Gaag L.C. Inference and learning multi-dimensional Bayesian network classifiers. Lect. Notes Artif. Intell. 2007, 4724:501-511.
18. Dempster A.P., Laird N.M., Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Series B (Methodological) 1977, 39(1):1-38.
19. S. Dumais, Hierarchical classification of web content, in: Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2000, pp. 256-263.
20. Boiy E., Moens M.F. A machine learning approach to sentiment analysis in multilingual web text. Inf. Retrieval 2009, 12(5):526-558.
21. A. Esuli, F. Sebastiani, Sentiwordnet: a publicly available lexical resource for opinion mining, in: Proceedings of the Fifth Conference on Language Resources and Evaluation (LREC06), 2006, pp. 417-422.
22. Forman G. An extensive empirical study of feature selection metrics for text classification. J. Mach. Learn. 2003, 3:1289-1305.
23. N. Friedman, The Bayesian structural EM algorithm, in: Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann Publishers, 1998, pp. 129-138.
24. Friedman N., Geiger D., Goldszmidt M. Bayesian network classifiers. Mach. Learn. 1997, 29(2-3):131-163.
25. J.H. George, R. Kohavi, K. Pfleger, Irrelevant features and the subset selection problem, in: Machine Learning, Proceedings of the Eleventh International Conference, 1994, pp. 121-129.
26. Hartley H. Maximum likelihood estimation from incomplete data. Biometrics 1958, 14:174-194.
27. V. Hatzivassiloglou, J.M. Wiebe, Effects of adjective orientation and gradability on sentence subjectivity, in: Proceedings of the 18th Conference on Computational linguistics, 2000, pp. 299-305.
28. R. Kohavi, Wrappers for Performance Enhancement and Oblivious Decision Graphs. PhD Thesis, Stanford University, 1995.
29. Kruskal J.B. On the shortest spanning subtree of a graph and the traveling salesman problem. Proc. Am. Math. Soc. 1956, 7(1):48-50.
30. Kullback S. Information Theory and Statistics 1959, Wiley.
31. P. Langley, W. Iba, K. Thompson, An analysis of Bayesian classifiers, in: Proceedings of the 10th National Conference on Artificial Intelligence, 1992, pp. 223-228.
32. Larrañaga P., Lozano J.A., Peña J.M., Inza I. Special issue on probabilistic graphical models for classification. Mach. Learn. 2005, 59(3).
33. Liu B. Sentiment analysis and subjectivity. Handbook of Natural Language Processing 2010, Chapman & Hall. second ed. N. Indurkhya, F.J. Damerau (Eds.).
34. McLachlan G.J., Krishnan T. The EM Algorithm and Extensions 1997, Wiley-Interscience.
35. V. Ng, S. Dasgupta, S.M.N. Arifin, Examining the role of linguistic knowledge sources in the automatic identification and classification of reviews, in: Proceedings of the COLING/ACL Conference, 2006, pp. 611-618.
36. Nigam K., McCallum A., Thrun S., Mitchell T. Text classification from labeled and unlabeled documents using EM. Mach. Learn. 2000, 39(2):103-134.
37. Pang B., Lee L. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval 2008, 2(1-2):1-135.
38. B. Pang, L. Lee, S. Vaithyanathan, Thumbs up? Sentiment classification using machine learning techniques, in: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'02), 2002, pp. 79-86.
39. Pearl J. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference 1988, Morgan Kaufmann Publishers Inc.
40. M. Qazi, G. Fung, S. Krishnan, R. Rosales, H. Steck, R.B. Rao, D. Poldermans, D. Chandrasekaran, Automated heart wall motion abnormality detection from ultrasound images using Bayesian networks, in: IJCAI'07: Proceedings of the 20th International Joint Conference on Artificial Intelligence, Morgan Kaufmann Publishers Inc., 2007, pp. 519-525.
41. E. Riloff, J. Wiebe, Learning extraction patterns for subjective expressions, in: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'03), 2003, pp. 105-112.
42. E. Riloff, J. Wiebe, T. Wilson, Learning subjective nouns using extraction pattern bootstrapping, in: Proceedings of the Seventh Conference on Natural Language Learning, 2003, pp. 25-32.
43. J.D. Rodríguez, J.A. Lozano, Multi-objective learning of multi-dimensional Bayesian classifiers, in: Eighth Conference on Hybrid Intelligent Systems (HIS'08), September 2008, pp. 501-506.
44. J.D. Rodríguez, J.A. Lozano, Learning Bayesian Network Classifiers for Multi-dimensional Supervised Classification Problems by Means of a Multi-objective Approach. Technical Report EHU-KZAA-TR-3-2010, Department of Computer Science and Artificial Intelligence, University of the Basque Country, San Sebastián, Spain, 2010.
45. Rodriguez J.D., Perez A., Lozano J.A. Sensitivity analysis of k-fold cross-validation in prediction error estimation. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32(3):569-574.
46. Rose C., Wang Y.C., Cui Y., Arguello J., Stegmann K., Weinberger A., Fischer F. Analyzing collaborative learning processes automatically: exploiting the advances of computational linguistics in computer-supported collaborative learning. Int. J. Computer-Supported Collab. Learn. 2007, 3(3).
47. M. Sahami, Learning limited dependence Bayesian classifiers, in: AAAI Press (Ed.), Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96), 1996, pp. 335-338.
48. B. Snyder, R. Barzilay, Multiple aspect ranking using the good grief algorithm, in: Proceedings of the Joint Human Language Technology/North American Chapter of the ACL Conference (HLT-NAACL), 2007, pp. 300-307.
49. Stone M. Cross-validatory choice and assessment of statistical predictions. J. R. Stat. Soc. B 1974, 36(1):111-147.
50. D.M.J. Tax, R.P.W Duin, Using two-class classifiers for multiclass classification, in: Proceedings of 16th International Conference on Pattern Recognition, 2002, pp. 124-127.
51. Tsoumakas G., Katakis I. Multi label classification: an overview. Int. J. Data Warehousing Mining 2007, 3(3):1-13.
52. O. Tsur, D. Davidiv, A. Rappoport, ICWSM a great catchy name: semi-supervised recognition of sarcastic sentences in product reviews, in: Proceedings of the International AAAI Conference on Weblogs and Social Media-ICWSM10, 2010.
53. L.C. van der Gaag, P.R. de Waal, Multi-dimensional Bayesian network classifiers, in: Proceedings of the Third European Workshop in Probabilistic Graphical Models, 2006, pp. 107-114.
54. Wiebe J., Wilson T., Bruce R., Bell N., Martin M. Learning subjective language. Comput. Ling. 2004, 30(3):277-308.
55. I.H. Witten, E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, in: Morgan Kaufmann Series in Data Management Systems, second ed., Morgan Kaufmann, 2005.
56. H. Yu, V. Hatzivassiloglou, Towards answering opinion questions: separating facts from opinions and identifying the polarity of opinion sentences, in: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2003.
57. X. Zhu, Semi-supervised Learning Literature Survey. Technical Report 1530, Department of Computer Sciences, University of Wisconsin, Madison, 2005.
58. X. Zhu, A.B. Goldberg, Introduction to Semi-Supervised Learning, Synthesis Lectures on Artificial Intelligence and Machine Learning, Morgan & Claypool Publishers, 2009.