Using scatterplots to understand and improve probabilistic models for text categorization and retrieval

International Journal of Approximate Reasoning

Volumn 50, Issue 7, 2009, Pages 945-956

  Di Nunzio, Giorgio Maria ^a,b  

^a UNIVERSITY OF PADOVA   (Italy)

^b NONE

Author keywords

Information Retrieval; Naive Bayes Models; Text Categorization

Indexed keywords

AUTOMATED TEXT CATEGORIZATION; BERNOULLI; BINARY INDEPENDENCE MODEL; CARTESIAN PLANE; CONSTANT COMPONENTS; MULTINOMIAL; NAIVE BAYES; NAIVE BAYES MODELS; PROBABILISTIC MODELS; RELEVANCE FEEDBACK; SCATTER PLOTS; TEXT CATEGORIZATION; TEXT CLASSIFICATION; TEXT RETRIEVAL; TEXTUAL DOCUMENTS; TRAINING DATA; VISUALIZATION TOOLS;

DATA VISUALIZATION; FEEDBACK; INFORMATION RETRIEVAL; INFORMATION RETRIEVAL SYSTEMS; INFORMATION SERVICES; NATURAL LANGUAGE PROCESSING SYSTEMS; TWO DIMENSIONAL; VISUALIZATION;

TEXT PROCESSING;

EID: 67649117886     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2009.01.002     Document Type: Article

References (31)

1. A. Krowne, M. Halbert, An initial evaluation of automated organization for digital library browsing, in: M. Marlino, T. Sumner, F. Shipman III (Eds.), ACM/IEEE Joint Conference on Digital Libraries (JCDL 2005), ACM Press, New York, NY, USA, Denver, CO, USA, 2005, pp. 246-255.
2. Ferreira de Oliveria M., and Levkowitz H. From visual data exploration to visual data mining: a survey. IEEE Transactions on Visualization and Computer Graphics 9 3 (2003) 378-394
3. Keim D. Information visualization and visual data mining. IEEE Transactions on Visualization and Computer Graphics 8 1 (2002) 1-8
4. Keim D., and Kriegel H.-P. Visualization techniques for mining large databases: a comparison. IEEE Transactions on Knowledge and Data Engineering 8 6 (1996) 923-938
5. B. Becker, R. Kohavi, D. Sommerfield, Visualizing the simple Bayesian classifier, in: U. Fayyad, G. Grinstein, A. Wierse (Eds.), Information Visualization in Data Mining and Knowledge Discovery, Morgan Kaufmann Publishers, San Francisco, 2001, pp. 237-249 (Chapter 18). URL citeseer.ist.psu.edu/becker97visualizing.html.
6. B. Poulin, R. Eisner, D. Szafron, P. Lu, R. Greiner, D.S. Wishart, A. Fyshe, B. Pearcy, C. Macdonell, J. Anvik, Visual explanation of evidence with additive classifiers, in: AAAI, AAAI Press, 2006, pp. 1822-1829.
7. Hearst M.A. User interfaces and visualization. In: Baeza-Yates R., and Ribeiro-Neto B. (Eds). Modern Information Retrieval (1999), Addison-Wesley, New York 257-323
8. M. Mozina, J. Demsar, M.W. Kattan, B. Zupan, Nomograms for visualization of naive bayesian classifier, in: J.-F. Boulicaut, F. Esposito, F. Giannotti, D. Pedreschi (Eds.), Knowledge Discovery in Databases: PKDD 2004, 8th European Conference on Principles and Practice of Knowledge Discovery in Databases, Pisa, Italy, September 20-24, 2004, Proceedings, Lecture Notes in Computer Science (LNCS), vol. 3202, Springer, 2004, pp. 337-348.
9. Kohonen T., Kaski S., Lagus K., Salojärvi J., Honkela J., Patero V., and Saarela A. Self-organization of a massive document collection. IEEE Transaction on Neural Networks 11 3 (2000) 574-585
10. J.A. Walter, J. Ontrup, D. Wessling, H. Ritter, Interactive visualization and navigation in large data collections using the hyperbolic space, in: Proceedings of the Third IEEE International Conference on Data Mining (ICDM 2003), 19-22 December 2003, Melbourne, FL, USA, IEEE Computer Society, 2003, pp. 355-362.
11. G.M. Di Nunzio, Visualization and classification of documents: a new probabilistic model to automated text classification, Bulletin of the IEEE Technical Committee on Digital Libraries (IEEE-TCDL) 2 (2).
12. G.M. Di Nunzio, The two-dimensional probabilistic model for automated text categorization, Ph.D. thesis, Department of Information Engineering, University of Padua, Padova, Italy, December 2005.
13. Sebastiani F. Machine learning in Automated Text Categorization. ACM Computing Surveys 34 1 (2002) 1-47
14. Middleton S.E., Shadbolt N.R., and Roure D.C.D. Ontological user profiling in recommender systems. ACM Transaction on Information Systems 22 1 (2004) 54-88
15. S. Eyheramendy, D.D. Lewis, D. Madigan, On the Naive Bayes model for Text Categorization, in: Christopher M. Bishop, Brendan J. Frey (Eds.), Proceedings of the Nineth International Workshop on Artificial Intelligence and Statistics, 2003.
16. D. Lewis, Naive (Bayes) at 40: the independence assumption in information retrieval, in: Nedellec and Rouveirol [31], pp. 4-15.
17. A. McCallum, K. Nigam, A comparison of event models for Naive Bayes Text Classification, in: AAAI-98 Workshop on Learning for Text Categorization, AAAI Press, 1998, pp. 41-48.
18. Zang T., and Oles F.J. Text Categorization based on regularized linear classification methods. Information Retrieval 4 1 (2001) 5-31
19. T. Joachims, Text Categorization with support vector machines: learning with many relevant features, in: Nedellec and Rouveirol [31], pp. 137-142.
20. W.S. Cooper, Inconsistencies and misnomers in probabilistic IR, in: A. Bookstein, Y. Chiaramella, G. Salton, V.V. Raghavan (Eds.), Proceedings of the 14th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Chicago, IL, USA, October 13-16, 1991 (Special Issue of the SIGIR Forum), ACM, 1991, pp. 57-61.
21. Rifkin R., and Klautau A. In defense of one-vs-all classification. Journal of Machine Learning Research 5 (2004) 101-141
22. G.M. Di Nunzio, A. Micarelli, Pushing "Underfitting" to the limit: learning in bidimensional Text Categorization, in: R.L. de Mántaras, L. Saitta (Eds.), Proceedings of the 16th European Conference on Artificial Intelligence (ECAI 2004), Including Prestigious Applicants of Intelligent Systems (PAIS 2004), IOS Press, 2004, pp. 465-469.
23. Mladenič D., Brank J., Grobelnik M., and Milic-Frayling N. Feature selection using linear classifier weights: interaction with classification models. In: Callan J., Fuhr N., and Nejdl W. (Eds). Peer-to-Peer Information Retrieval (2004), ACM Press, New York, NY, USA 234-241
24. Damerau F., Zhang T., Weiss S., and Indurkhya N. Text Categorization for a comprehensive time-dependent benchmark. Information Processing and Management 40 2 (2004) 209-221
25. K. Nigam, A. McCallum, S. Thrun, T. Mitchell, Learning to classify text from labeled and unlabeled documents, in: AAAI'98/IAAI'98: Proceedings of the Fifteenth National/Tenth Conference on Artificial Intelligence/Innovative Applications of Artificial Intelligence, American Association for Artificial Intelligence, Menlo Park, CA, USA, 1998, pp. 792-799.
26. Van Rijsbergen C. Information Retrieval (1979), Butterworth-Heinemann, Newton, MA, USA
27. S. Eyheramendy, D. Madigan, A novel feature selection score for Text Categorization, in: Proceedings of International Workshop on Feature Selection for Data Mining: Interfacing Machine Learning and Statistics (in Conjunction with 2005 SIAM International Conference on Data Mining), 2005, pp. 1-8.
28. Fuhr N. Models in Information Retrieval. In: Agosti M., Crestani F., and Pasi G. (Eds). Lectures on Information Retrieval, Lecture Notes in Computer Science (LNCS) vol. 1980 (2000), Springer, Heidelberg, Germany 21-50
29. Robertson S.E., and Sparck Jones K. Relevance weighting of search terms. Journal of the American Society for Information Science 27 (1976) 129-146
30. Di Nunzio G.M., Ferro N., Mandl T., and Peters C. Clef 2007: ad hoc track overview. In: Peters C., Jijkoun V., Mandl T., Müller H., Oard D.W., Peñas A., Petras V., and Santos D. (Eds). CLEF, Lecture Notes in Computer Science vol. 5152 (2007), Springer 13-32
31. In: Nedellec C., and Rouveirol C. (Eds). Machine Learning: ECML-98, 10th European Conference on Machine Learning, Lecture Notes in Computer Science (LNCS) vol. 1398 (1998), Springer, Heidelberg, Germany