Effect of term distributions on centroid-based text categorization

Information Sciences

Volumn 158, Issue 1-4, 2004, Pages 89-115

  Lertnattee, Verayuth ^a   Theeramunkong, Thanaruk ^a  

^a THAMMASAT UNIVERSITY   (Thailand)

Author keywords

Centroid based classifier; Term distribution; Text categorization

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL METHODS; PROBABILITY DISTRIBUTIONS; REGRESSION ANALYSIS; TEXT PROCESSING;

INVERSE DOCUMENT FREQUENCY (IDF); TEXT CATEGORIZATION;

INFORMATION MANAGEMENT;

EID: 0242692521     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2003.07.007     Document Type: Article

References (35)

1. Nigam K., McCallum A.K., Thrun S., Mitchell T.M. Text classification from labeled and unlabeled documents using EM. Machine Learning. 39(2/3):2000;103-134 http://www.cs.cmu.edu/knigam/papers/emcat-mlj99.ps.
2. Yang Y. An evaluation of statistical approaches to text categorization. Information Retrieval. 1(1/2):1999;69-90 http://www.cs.cmu.edu/yiming/papers.yy/irj99.ps.
3. Apté C.d., Damerau F.J., Weiss S.M. Automated learning of decision rules for text categorization. ACM Transactions on Information Systems. 12(3):1994;233-251 http://www.acm.org/pubs/articles/journals/tois/1994-12-3/p233-apte/p233-apte. pdf.
4. Yang Y., Chute C.G. An example-based mapping method for text categorization and retrieval. ACM Transactions on Information Systems. 12(3):1994;252-277 http://www.acm.org/pubs/articles/journals/tois/1994-12-3/p252-yang/p252-yang. pdf.
5. Yang Y., Liu X. A re-examination of text categorization methods. Hearst M.A., Gey F., Tong R. Proceedings of SIGIR-99, 22nd ACM International Conference on Research and Development in Information Retrieval. 1999;42-49 ACM Press, New York, US, Berkeley, US, http://www.cs.cmu.edu/yiming/papers.yy/sigir99.ps.
6. Larkey L.S. Automatic essay grading using text categorization techniques. Croft W.B., Moffat A., van Rijsbergen C.J., Wilkinson R., Zobel J. Proceedings of SIGIR-98, 21st ACM International Conference on Research and Development in Information Retrieval. 1998;90-95 ACM Press, New York, US, Melbourne, Australia, http://cobar.cs.umass.edu/pubfiles/ir-121.ps.
7. D.B. Skalak, Prototype and feature selection by sampling and random mutation hill climbing algorithms, in: International Conference on Machine Learning, 1994, pp. 293-301. Available from 〈citeseer.nj.nec.com/skalak94prototype.html〉.
8. Han E.-H., Karypis G., Kumar V. Text categorization using weight-adjusted. k -nearest neighbor classification Cheung D., Li Q., Williams G. Proceedings of PAKDD-01, 5th Pacific-Asia Conferenece on Knowledge Discovery and Data Mining. 2001;53-65 Springer Verlag, Heidelberg, Germany, Hong Kong, China. published in the "Lecture Notes in Computer Science" series, number 2035 http://link.springer.de/link/service/series/0558/papers/2035/20350053.pdf.
9. Hull D.A. Improving text retrieval for the routing problem using latent semantic indexing. Croft W.B., van Rijsbergen C.J. Proceedings of SIGIR-94, 17th ACM International Conference on Research and Development in Information Retrieval. 1994;282-289 Springer Verlag, Heidelberg, Germany, Dublin, Ireland, http://www.acm.org/pubs/articles/proceedings/ir/188490/p282-hull/p282-hull.pdf.
10. D.J. Ittner, D.D. Lewis, D.D. Ahn, Text categorization of low quality images, in: Proceedings of SDAIR-95, 4th Annual Symposium on Document Analysis and Information Retrieval, Las Vegas, US, 1995, pp. 301-315. Available from 〈http://www.research.att.com/lewis/papers/ittner95.ps〉.
11. Joachims T. A probabilistic analysis of the Rocchio algorithm with TFIDF for text categorization. Fisher D.H. Proceedings of ICML-97, 14th International Conference on Machine Learning. 1997;143-151 Morgan Kaufmann Publishers, San Francisco, US, Nashville, US, citeseer.nj.nec.com/joachims96probabilistic.html.
12. Chuang W.T., Tiyyagura A., Yang J., Giuffrida G. A fast algorithm for hierarchical text classification. Kambayashi Y., Mohania M., Tjoa A. Proceedings of DaWaK-00, 2nd International Conference on Data Warehousing and Knowledge Discovery. 2000;409-418 Springer Verlag, Heidelberg, Germany, London, UK. published in the "Lecture Notes in Computer Science" series, number 1874 http://www.cs.iastate.edu/yang/Papers/dawak00.ps.
13. Deng Z.-H., Tang S.-W., Yang D.-Q., Zang M., Wu X.-B., Yang M. A linear text classification algorithm based on category relevance factors. Proceedings of ICADL-02, 5th International Conference on Asian Digital Libraries. 2002;88-98 ACM Press, New York, US, Singapore.
14. Joachims T. Text categorization with support vector machines: learning with many relevant features. Nédellec C., Rouveirol C. Proceedings of ECML-98, 10th European Conference on Machine Learning, no. 1398. 1998;137-142 Springer Verlag, Heidelberg, Germany, Chemnitz, Germany, citeseer.nj.nec.com/joachims98text.html.
15. Ng H.T., Goh W.B., Low K.L. Feature selection, perceptron learning, and a usability case study for text categorization. Belkin N.J., Narasimhalu A.D., Willett P. Proceedings of SIGIR-97, 20th ACM International Conference on Research and Development in Information Retrieval. 1997;67-73 ACM Press, New York, US, Philadelphia, US, http://www.acm.org/pubs/articles/proceedings/ir/258525/p67-ng/p67-ng.pdf.
16. E.-H. Han, G. Karypis, Centroid-based document classification: analysis and experimental results, in: Principles of Data Mining and Knowledge Discovery, 2000, pp. 424-431. Available from〈citeseer.nj.nec.com/han00centroidbased.html〉.
17. V. Lertnattee, T. Theeramunkong, Improving centroid-based text classification using term-distribution-based weighting and feature selection, in: Proceedings of INTECH-01, 2nd International Conference on Intelligent Technologies, Bangkok, Thailand, 2001, pp. 349-355.
18. T. Theeramunkong, V. Lertnattee, Improving centroid-based text classification using term-distribution-based weighting system and clustering, in: Proceedings of ISCIT-01, 2nd International Symphosium on Communication and Information Technology, Cheingmai, Thailand, 2001, pp. 1167-1182.
19. Schapire R.E., Singer Y., Singhal A. Boosting and Rocchio applied to text filtering. Croft W.B., Moffat A., van Rijsbergen C.J., Wilkinson R., Zobel J. Proceedings of SIGIR-98, 21st ACM International Conference on Research and Development in Information Retrieval. 1998;215-223 ACM Press, New York, US, Melbourne, Australia, http://www.research.att.com/schapire/cgi-bin/uncompress-papers/SchapireSiSi98. ps.
20. Cohen W.W. Learning to classify English text with ILP methods. De Raedt L. Advances in Inductive Logic Programming. 1995;124-143 IOS Press, Amsterdam, The Netherlands, http://www.research.whizbang.com/wcohen/postscript/ilp.ps.
21. H. Sorensen, M. McElligott, Psun: a profileing system for usenet news, in: Proceedings of CIKM-95, Intelligent Information Agents Workshop, Baltimore, 1995.
22. Salton G., Buckley C. Term-weighting approaches in automatic text retrieval. Information Processing and Management. 24(5):1988;513-523.
23. A. Singhal, G. Salton, C. Buckley, Length normalization in degraded text collections, Tech. Rep. TR95-1507, 1995. Available from 〈citeseer.nj.nec.com/singhal95length.html〉.
24. A. Singhal, C. Buckley, M. Mitra, Pivoted document length normalization, in: Research and Development in Information Retrieval, 1996, pp. 21-29. Available from 〈citeseer.nj.nec.com/singhal96pivoted.html〉.
25. Nigam K., McCallum A.K., Thrun S., Mitchell T.M. Learning to classify text from labeled and unlabeled documents. Proceedings of AAAI-98, 15th Conference of the American Association for Artificial Intelligence. 1998;792-799 AAAI Press, Menlo Park, US, Madison, US. an extended version appears as [1] http://www.cs.cmu.edu/knigam/papers/emcat-aaai98.ps.
26. Siolas G., d'Alche Buc F. Support vector machines based on a semantic kernel for text categorization. Amari S.-I., Giles C.L., Gori M., Piuri V. Proceedings of IJCNN-00, 11th International Joint Conference on Neural Networks. vol. 5:2000;205-209 IEEE Computer Society Press, Los Alamitos, US, Como, Italy, http://dlib.computer.org/conferen/ijcnn/0619/pdf/06193581.pdf.
27. Lee K.H., Kay J., Kang B.H., Rosebrock U. A comparative study on statistical machine learning algorithms and thresholding strategies for automatic text categorization. Ishizuka M., Sattar A. Proceedings of PRICAI-02, 7th Pacific Rim International Conference on Artificial Intelligence. 2002;444-453 Springer Verlag, Heidelberg, Germany, Tokyo, Japan. published in the "Lecture Notes in Computer Science" series, number 2417 http://link.springer.de/link/service/series/0558/papers/2417/24170444.pdf.
28. McCallum A.K., Rosenfeld R., Mitchell T.M., Ng A.Y. Improving text classification by shrinkage in a hierarchy of classes. Shavlik J.W. Proceedings of ICML-98, 15th International Conference on Machine Learning. 1998;359-367 Morgan Kaufmann Publishers, San Francisco, US, Madison, US, http://www.cs.cmu.edu/mccallum/papers/hier-icml98.ps.gz.
29. Craven M., DiPasquo D., Freitag D., McCallum A.K., Mitchell T.M., Nigam K., Slattery S. Learning to extract symbolic knowledge from the World Wide Web. Proceedings of AAAI-98, 15th Conference of the American Association for Artificial Intelligence. 1998;509-516 AAAI Press, Menlo Park, US, Madison, US, http://www.cs.cmu.edu/afs/cs.cmu.edu/project/theo-11/www/wwkb/overview-aaai98. ps.gz.
30. Sebastiani F. Machine learning in automated text categorization. ACM Computing Surveys. 34(1):2002;1-47 http://faure.iei.pi.cnr.it/fabrizio/Publications/ACMCS02.pdf.
31. Salton G. Automatic Text Processing: The Transformation, Analysis, and Retreival of Information by Computer. 1989;Addison-Wesley, Reading, Pensylvania.
32. Rocchio J.J. Relevance feedback in information retrieval. Salton G. The SMART REtrieval System: Experiments in Automatic Document Processing. 1971;313-323 Prentice-Hall, Englewood Cliffs, New Jersey.
33. Robertson S.E., Sparck-Jones K. Relevance weighting of search terms. Journal of American Society for Information Science. 3(27):1976;129-146.
34. Fuhr N. Models for retrieval with probabilistic indexing. Information Processing and Management. 1(25):1989;55-72.
35. F. Debole, F. Sebastiani, Supervised term weighting for automated text categorization, in: Proceedings of SAC-03, 18th ACM Symposium on Applied Computing, ACM Press, New York, US, Melbourne, US, forthcoming. Available from 〈http://faure.iei.pi.cnr.it/fabrizio/Publications/SAC03b.pdf〉.