Scalable feature selection, classification and signature generation for organizing large text databases into hierarchical topic taxonomies

VLDB Journal

Volumn 7, Issue 3, 1998, Pages 163-178

  Chakrabarti, Soumen ^a   Dom, Byron ^a   Agrawal, Rakesh ^a   Raghavan, Prabhakar ^a  

^a IBM ALMADEN RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0000776545     PISSN: 10668888     EISSN: None     Source Type: Journal    
DOI: 10.1007/s007780050061     Document Type: Article

References (48)

1. Alon N, Matias Y, Szegedy M (1996) The space complexity of approximating the frequency moments. In: Symposium on the Theory of Computing (STOC), May 1996, Philadelphia, Pa., pp 20-29
2. Anick P, Vaithyanathan S (1997) Exploiting clustering and phrases for context-based information retrieval. In: SIGIR, 1997
3. Apte C, Damerau F, Weiss SM (1994) Automated learning of decision rules for text categorization. IBM Research Report RC18879
4. Balabanovic M, Shoham Y (1997) Content-based, collaborative recommendation. Commun ACM 40(3):66-72
5. Berger JO (1985) Statistical Decision Theory and Bayesian Analysis. Springer, Berlin Heidelberg New York
6. Breiman L, Friedman JH, Olshen RA, Stone CJ (1984) Classification and Regression Trees. Brooks/Cole, Pacific Grove, Calif
7. Chakrabarti S, Dom B, Agrawal R, Raghavan P (1997) Using taxonomy, discriminants, and signatures for navigating in text databases. In: VLDB Conf, August 1997, Athens, Greece
8. Chakrabarti S, Dom B, Indyk P (1998) Enhanced hypertext categorization using hyperlinks. In: SIGMOD ACM, 1998
9. Chekuri C, Goldwasser M, Raghavan P, Upfal E (1996) Web search using automatic classification. In: Sixth World Wide Web Conference. 1996, San Jose, Calif
10. Cohen WW, Singer Y (1996) Context-sensitive learning methods for text categorization. In: SIGIR ACM, 1996
11. Cover TM, Thomas JA (1991) Elements of Information Theory. Wiley, Chichester
12. Cutting DR, Karger DR, Pedersen JO (1993) Constant interaction-time scatter/gather browsing of very large document collections. In: SIGIR, 1993
13. Deerwester S, Dumais ST, Landauer TK, Furnas GW, Harshman RA (1990) Indexing by latent semantic analysis. J Soc Inf Sci 41(6):391-407
14. Duda R, Hart P (1973) Pattern Classification and Scene Analysis. Wiley, New York
15. Falaoutsos C, Oard DW (1995) A survey of information retrieval and filtering methods. Technical Report CS-TR-3514. University of Maryland, College Park, MD 20742
16. Frakes WB, Baeza-Yates R (1992) Information retrieval: Data structures and algorithms. Prentice-Hall, Englewood Cliffs, NJ
17. Friedman JH (1997) On bias, variance, 0/1 loss, and the curse-of-dimensionality. Data Min Knowl Discovery 1(1):55-77
18. Fukunaga K (1990) An Introduction to Statistical Pattern Recognition, 2nd ed. Academic Press, New York
19. Goldberg D, Nichols D, Oki B, Terry D (1992) Using collaborative filtering to weave an information tapestry. Commun ACM 35(12):61-70
20. Harman D Ranking algorithms. In: Frakes WB, Baeza-Yates R (eds) Information retrieval: Data structures and algorithms, Chapter 14. Prentice-Hall, Englewood Cliffs, NJ.
21. Hush DR, Home BG (1993) Progress in supervised neural networks. IEEE Signal Process Mag: 8-39
22. Jain AK, Mao J, Mohiuddin K (1996) Artificial neural networks: A tutorial. Computer 29(3):31-44
23. Jones KS A statistical interpretation of term specificity and its applications in retrieval. J Documentation 28(1):11-20
24. Koller D, Sahami M (1997) Hierarchically classifying documents using very few words. In: International Conference on Machine Learning, Vol. 14, 1997. Morgan-Kaufmann, San Mateo, Calif
25. Langley P (1996) Elements of Machine Learning. Morgan Kaufmann, San Mateo, Calif
26. Laplace P-S (1995) Nine Philosophical Essays on Probabilities (Translated by A.I. Dale from the 5th French edition of 1825). Springer, New York
27. Lewis D (1991) Evaluating text categorization. In: Proceedings of the Speech and Natural Language Workshop, 1991, Morgan-Kaufmann, San Mateo, Calif., pp 312-318
28. Lippmann RP (1989) Pattern classification using neural networks. IEEE Commun Mag :47-64
29. Miller BN, Reidl JT, Konstan JA (1997) Experiences with GroupLens: Making Usenet useful again. In: USENIX Annual Technical Conference, 1997, pp 219-233
30. Mladenic D (1998) Feature subset selection in text-learning. In: 10th European Conference on Machine Learning, 1998
31. Mirsky S (1997) Untangling the web. IBM Res Mag 4:8-10
32. Natarajan BK (199) Machine Learning: A Theoretical Approach. Morgan-Kaufmann, San Mateo, Calif
33. Papadimitriou C, Raghavan P, Tamaki H, Vempala S (1996) Latent sematic indexing: A probabilistic analysis.
34. Quinlan JR (1993) C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo, Calif
35. Raghavan P (1997) Information retrieval algorithms: A survey. In: Symposium on Discrete Algorithms, 1997
36. Ristad ES (1995) A natural law of succession. Research report CS-TR-495-95, Princeton University, Princeton, Calif
37. Robertson SE, Walker S (1994) Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval. In: SIGIR, 1994, pp 232-241
38. Salton G, Buckley C (1988) Term-weighting approaches in automatic text retrieval. Inf Process Manage 24(5):513-523
39. Salton G, McGill MJ (1983) Introduction to Modern Information Retrieval, McGraw-Hill, New York
40. Schutze H, Hull DA, Pederson JO (1995) A comparison of classifiers and document representations for the routing problem. In: SIGIR, 1995, pp 229-237
41. Shardanand U, Maes P (1995) Social information filtering: Algorithms for automating word of mouth. In: Computer Human Interaction (CHI), 1995. ACM Press, New York
42. van Rijsbergen CJ (1979) Information Retrieval. Butterworths, Oxford (Also available on-line at http://www.dcs.gla.ac.uk/Keith/Preface.html)
43. Voorhees EM (1993) Using WordNet to disambiguate word senses for text retrieval. In: SIGIR, 1993, pp 171-180
44. Wald A (1950) Statistical Decision Functions. Wiley, New York
45. Weiss SM, Kulikowski CA (1990) Computer Systems That Learn. Morgan-Kaufmann, San Mateo, Calif
46. Yang Y, Pedersen J (1997) A comparative study on feature selection in text categorization. In: International Conference on Machine Learning, 1997, pp 412-420
47. Young TY, Calvert TW (1974) Classification, Estimation and Pattern Recognition. Elsevier Science Publishers, Amsterdam
48. Zipf GK (1949) Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology. Addison-Wesley, Reading, Mass