Context-sensitive learning methods for text categorization

ACM Transactions on Information Systems

Volumn 17, Issue 2, 1999, Pages 141-173

  Cohen, William W ^a   Singer, Yoram ^a  

^a AT AND T LABS RESEARCH   (United States)

Author keywords

Algorithms; Experimentation; H.3.3 Information Storage and Retrieval : Information Search and Retrieval; I.2.6 Artificial Intelligence : Learning concept learning; parameter learning; I.5.4 Pattern Recognition : Applications text processing

Indexed keywords

EID: 0001345686     PISSN: 10468188     EISSN: None     Source Type: Journal    
DOI: 10.1145/306686.306688     Document Type: Article

References (47)

1. ALMUALLIM, H. AND DIETTERICH, T. 1991. Learning with many irrelevant features. In Proceedings of the 9th National Conference on Artificial Intelligence (AAAI-91, July 14-19), T. Dean and K. McKeown, Eds. MIT Press, Cambridge, MA.
2. APTÉ, C., DAMERAU, F., AND WEISS, S. M. 1994a. Towards language independent automated learning of text categorization models. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94, Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY, 23-30.
3. APTÉ, C., DAMERAU, F., AND WEISS, S. M. 1994b. Automated learning of decision rules for text categorization. ACM Trans. Inf. Syst. 12, 3 (July 1994), 233-251.
4. ARMSTRONG, R., FRIETAG, D., JOACHIMS, T., AND MITCHELL, T. M. 1995. WebWatcher: A learning apprentice for the World Wide Web. In Proceedings of the 1995 AAAI Spring Symposium on Information Gathering from Heterogenous Distributed Environments (Stanford, CA, Mar.). AAAI Press, Menlo Park, CA.
5. BLUM, A. 1990. Learning boolean functions in an infinite attribute space. In Proceedings of the 22nd Annual ACM Symposium on Theory of Computing (STOC '90, Seattle, WA, May 12-14), H. Ortiz, Ed. ACM Press, New York, NY, 64-72.
6. BLUM, A. 1995. Empirical support for WINNOW and weighted majority algorithms: Results on a calendar scheduling domain. In Proceedings of the 12th International Conference on Machine Learning (Lake Tahoe, CA).
7. BRUNK, C. AND PAZZANI, M. 1991. Noise-tolerant relational concept learning algorithms. In Proceedings of the 8th International Workshop on Machine Learning (Ithaca, NY). Morgan Kaufmann, San Mateo, California.
8. BUCKLEY, C. AND SALTON, G. 1995. Optimization of relevance feedback weights. In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '95, Seattle, WA, July 9-13), E. A. Fox, P. Ingwersen, and R. Fidel, Eds. ACM Press, New York, NY, 351-357.
9. BUCKLEY, C., SALTON, G., AND ALLAN, J. 1994. The effect of adding relevance information in a relevance feedback environment. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94, Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY, 292-300.
10. CESA-BIANCHI, N., FREUND, Y., HELMBOLD, D. P., HAUSSLER, D., SCHAPIRE, R. E., AND WARMUTH, M. K. 1993. How to use expert advice. In Proceedings of the 25th Annual ACM Symposium on Theory of Computing (STOC '93, San Diego, CA, May 16-18), R. Kosaraju, D. Johnson, and A. Aggarwal, Eds. ACM Press, New York, NY, 382-391.
11. CHURCH, K. W. AND GALE, W. A. 1995. Poisson mixtures. Nat. Lang. Eng. 1, 2, 163-190.
12. COHEN, W. W. 1993. Efficient pruning methods for separate-and-conquer rule learning systems. In Proceedings of the 13th International Joint Conference on Artificial Intelligence (Chambery, France).
13. COHEN, W. W. 1995a. Fast effective rule induction. In Proceedings of the 12th International Conference on Machine Learning (Lake Tahoe, CA).
14. COHEN, W. W. 1995b. Text categorization and relational learning. In Proceedings of the 12th International Conference on Machine Learning (Lake Tahoe, CA).
15. COHEN, W. W. 1996a. Learning rules that classify e-mail. In Proceedings of the 1996 AAAI Spring Symposium on Machine Learning and Information Access (Palo Alto, CA). AAAI Press, Menlo Park, CA.
16. COHEN, W. W. 1996b. Learning with set-valued features. In Proceedings of the 13th National Conference on Artificial Intelligence (Portland, OR).
17. COHEN, W. W. AND SINGER, Y. 1996. Learning to query the Web. In Proceedings of AAAI-96 Workshop on Internet-Based Information Systems. AAAI Press, Menlo Park, CA.
18. FREUND, Y. AND SCHAPIRE, R. E. 1995. A decision-theoretic generalization of on-line learning and an application to boosting. In Proceedings of the 2nd European Conference on Computational Learning Theory. Springer-Verlag, Berlin, Germany, 23-37.
19. FREUND, Y., SCHAPIRE, R., SINGER, Y., AND WARMUTH, M. 1997. Using and combining predictors that specialize. In Proceedings of the 29th Annual ACM Symposium on Theory of Computing. ACM Press, New York, NY, 334-343.
20. FÜRNKRANZ, J. AND WIDMER, G. 1994. Incremental reduced error pruning. In Proceedings of the 11th Annual Conference on Machine Learning (New Brunswick, NJ). Morgan Kaufmann Publishers Inc., San Francisco, CA.
21. HULL, D. AND GREFENSTETTE, 1996. Stemming algorithms: A case study for detailed evaluation. J. Am. Soc. Inf. Sci. 47, 1, 70-84.
22. HULL, S., PEDERSEN, J., AND SCHUTZE, H. 1995. Method combination for document filtering. In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '95, Seattle, WA, July 9-13), E. A. Fox, P. Ingwersen, and R. Fidel, Eds. ACM Press, New York, NY.
23. ITTNER, D. J., LEWIS, D. D., AND AHN, D. D. 1995. Text categorization of low quality images. In Symposium on Document Analysis and Information Retrieval (Las Vegas, NV). 301-315.
24. JOHN, G., KOHAVI, R., AND PFEGER, K. 1994. Irrelevant features and the subset selection problem. In Proceedings of the 11th Annual Conference on Machine Learning (New Brunswick, NJ). Morgan Kaufmann Publishers Inc., San Francisco, CA.
25. KIVINEN, J. AND WARMUTH, M. K. 1994. Exponentiated gradient versus gradient descent for linear predictors. Tech. Rep. UCSC-CRL-94-16. Computer Research Laboratory, University of California, Santa Cruz, CA.
26. LEWIS, D. D. 1992a. An evaluation of phrasal and clustered representations on a text categorization task. In Proceedings of the 15th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '92, Copenhagen, Denmark, June 21-24), N. Belkin, P. Ingwersen, A. M. Pejtersen, and E. Fox, Eds. ACM Press, New York, NY, 37-50.
27. LEWIS, D. D. 1992b. Representation and learning in information retrieval. Ph.D. Dissertation. Department of Computer Science, University of Massachusetts, Amherst, MA.
28. LEWIS, D. AND CATLETT, J. 1994. Heterogeneous uncertainty sampling for supervised learning. In Proceedings of the 11th Annual Conference on Machine Learning (New Brunswick, NJ). Morgan Kaufmann Publishers Inc., San Francisco, CA.
29. LEWIS, D. AND GALE, W. 1994. Training text classifiers by uncertainty sampling. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94, Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY.
30. LEWIS, D. AND RINGUETTE, M. 1994. A comparison of two learning algorithms for text categorization. In Symposium on Document Analysis and Information Retrieval (Las Vegas, NV).
31. LEWIS, D., SCHAPIRE, R., CALLAN, J. P., AND PAPKA, R. 1996. Training algorithms for linear classifiers. In Proceedings of the 19th Annual ACM International SIGIR Conference on Research and Development in Information Retrieval (Zurich, Switzerland). ACM Press, New York, NY.
32. LITTLESTONE, N. 1988. Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm. Mach. Learn. 2, 4, 285-318.
33. LITTLESTONE, N. AND WARMUTH, M. K. 1994. The weighted majority algorithm. Inf. Comput. 108, 2 (Feb. 1, 1994), 212-261.
34. NG, H., GOG, W., AND LOW, K. 1997. Feature selection, perceptron learning, and a usability case study for text categorization. In Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 67-73.
35. PAGALLO, G. AND HAUSSLER, D. 1990. Boolean feature discovery in empirical learning. Mach. Learn. 5, 1 (Mar. 1990), 71-99.
36. PAZZANI, M., NGUYEN, L., AND MANTIK, S. 1995. Learning from hotlists and coldhsts: Towards a WWW information filtering and seeking agent. In Proceedings of the AI Tools Conference (Washington, DC).
37. LANGLEY, P. 1990. Learning logical definitions from relations. Mach. Learn. 5, 3 (Aug. 1990), 233-266.
38. QUINLAN, J. R. 1995. MDL and categorical theories (continued). In Proceedings of the 12th International Conference on Machine Learning (Lake Tahoe, CA).
39. ROCCHIO, J. 1971. Relevance feedback information retrieval. In The Smart Retrieval System-Experiments in Automatic Document Processing, G. Salton, Ed. Prentice-Hall, Englewood Cliffs, NJ, 313-323.
40. SALTON, G. 1991. Developments in automatic text retrieval. Science 253, 974-980.
41. SCHAPIRE, R., SINGER, Y., AND SINGHAL, A. 1998. Boosting and Rocchio applied to text filtering. In Proceedings of the 21st Annual ACM International Conference on Research and Development in Information Retrieval. ACM Press, New York, NY.
42. SCHUTZE, H., HULL, D., AND PEDERSEN, J. 1996. A comparison of classifiers and document representations for the routing problem. In Proceedings of the 19th Annual ACM International SIGIR Conference on Research and Development in Information Retrieval (Zurich, Switzerland). ACM Press, New York, NY.
43. VAN RIJSBERGEN, C. J. 1979. Information Retrieval. 2nd ed. Butterworths, London, UK.
44. VOVK, V. G. 1990. Aggregating strategies. In Proceedings of the 3rd Annual Workshop on Computational Learning Theory (COLT '90, Rochester, NY, Aug. 6-8), M. Fulk and J. Case, Eds. Morgan Kaufmann Publishers Inc., San Francisco, CA, 371-386.
45. WIENER, E., PEDERSON, J. O., AND WIEGEND, A. S. 1995. A neural network approach to topic spotting. In Symposium on Document Analysis and Information Retrieval (Las Vegas, NV). 317-332.
46. YANG, Y. 1994 Expert network: Effective and efficient learning from human decisions in text categorization and retrieval. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94 Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY, 13-22.
47. YANG, Y. AND CHUTE, C. G. 1994. An example-based mapping method for text categorization and retrieval. ACM Trans. Inf. Syst. 12, 3 (July 1994), 252-277.