Corpus-Based Statistical Screening for Content-Bearing Terms

Journal of the American Society for Information Science and Technology

Volumn 52, Issue 3, 2001, Pages 247-259

  Kim, Won ^a   Wilbur, W John ^a  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; STATISTICAL METHODS;

CONTENT BASED RETRIEVAL; CONTENT-BEARING PHRASES;

AUTOMATIC INDEXING;

EID: 0034832550     PISSN: 15322882     EISSN: None     Source Type: Journal    
DOI: 10.1002/1097-4571(2000)9999:9999<::AID-ASI1588>3.0.CO;2-7     Document Type: Article

References (33)

1. Bookstein, A., Klein, S.T., & Raita, T. (1995), Detecting content bearing words by serial clustering. Paper presented at the Proceedings of the 18th annual international ACM SIGIR conference on research and development in information retrieval, Seattle, WA.
2. Bookstein, A., Klein, S.T., & Raita, T. (1998). Clumping properties of content-hearing words. Journal of the American Society for Information Science, 49(2), 102-114.
3. Bookstein, A., & Swanson, D.R. (1974). Probabilistic models for automatic indexing. Journal of the American Society for Information Science, 25(5), 312-318.
4. Bookstein, A., & Swanson, D.R. (1975). A decision theoretic foundation for indexing. Journal of the American Society for Information Science, 26, 45-50.
5. Carroll, J.M., & Roeloffs, R. (1969). Computer selection of keywords using word frequency analysis. American Documentation, 20(3), 227- 233.
6. Curtice, R.M., & Jones, P.E. (1967). Distributional constraints and the automatic selection of an indexing vocabulary. Paper presented at the American Documentation Institute Annual Meeting, Cambridge, MA.
7. Damereau, J. (1965). An experiemnt in automatic indexing. American Documentation, 16(4), 283-289.
8. Dillon, M., & Federhart, P. (1982). The use of discriminant analysis to select content-bearing words. Journal of the American Society for Information Science, 33(4), 245-253.
9. Harman, D. (1994). Data preparation. In R. Merchant (Ed.), The proceedings of the TIPSTER text program - Phase I. San Mateo, CA: Morgan Kaufmann Publishing Co.
10. Harter, S.P. (1975a). A probabilistic approach to automatic keyword indexing: Part II. An algroithm for probabilistic indexing. Journal of the American Society for Information Science, 26, 280-289.
11. Harter, S.P. (1975b). A probabilistic approach to automatic keyword indexing: Part I. On the distribution of specialty words in a technical literature. Journal of the American Society for Information Science, 26, 197-206.
12. Langley, P. (1996). Elements of machine learning. San Francisco: Morgan Kaufmann Publishers, Inc.
13. Langley, P., Iba, W., & Thompson, K. (1992). An analysis of Bayesian classifiers. Paper presented at the tenth national conference on artificial intelligence, San Jose.
14. Langley, P., & Sage, S. (1994). Induction of selective Bayesian classifiers. Paper presented at the tenth conference on uncertainty in artificial intelligence, Seattle, WA.
15. Larson, H.J. (1982). Introduction to probability theory and statistical inference (3rd ed). New York: John Wiley & Sons.
16. Ponte, J.M., & Croft, W.B. (1998). A language modeling approach to information retrieval. Paper presented at the SIGIR98, Melbourne, Australia.
17. Resnick, A. (1961). Relative effectiveness of document titles and abstracts for determining relevance of documents. Science, 134, 1004-1006.
18. Robertson, S.E., & Spark Jones, K. (1976). Relevance weighting of search terms. Journal of the American Society for Information Science, May- June, 129-146.
19. Salton, G. (1969). A comparison between manual and automatic indexing methods. American Documentation. January, 61-71.
20. Salton, G. (1975). A theory of indexing (vol. 18). Philadelphia, PA: Society for Industrial and Applied Mathematics.
21. Salton, G. (1989). Automatic text processing. Reading MA: Addison- Wesley Publishing Company.
22. Salton, G. (1991). Developments in automatic text retrieval. Science, 253, 974-980.
23. Salton, G. (1992). The state of retrieval system evaluation. Information Processing & Management, 28(4), 441-449.
24. Salton, G., Wong, A., & Yu, C.T. (1976). Automatic indexing using term discrimination and term precision measurements. Information Processing & Management, 12, 43-51.
25. Salton, G., & Yang, C.S. (1973). On the specification of term values in automatic indexing. Journal of Documentation, 29(4), 351-372.
26. Salton, G., Yang, C.S., & Yu, C.T. (1975). A theory of term importance in automatic text analysis. Journal of the American Society for Information Science, 26(1), 33-44.
27. Staff, N.L.M. (2000). Medical subject headings - Tree structures. Bethesda, MD: National Library of Medicine.
28. Stone, D.C., & Ruhinoff, M. (1968). Statistical generation of a technical vocabulary. American Documentation, 19, 411-412.
29. van Rijshergen, C.J. (1979). Information retrieval (2nd ed). London: Butterworths.
30. Wilbur, W.J., & Sirotkin, K. (1992). The automatic identification of stop words. Journal of Information Science, 18, 45-55.
31. Wilbur, W.J., & Yang, Y. (1996). An analysis of statistical term strength and its use in the indexing and retrieval of molecular biology texts. Computers in Biology and Medicine, 26(3), 209-222.
32. Witten, I. H., Moffat, A., & Bell, T.C. (1999). Managing Gigabytes. (Second ed.). San Francisco: Morgan-Kaufmann Publishers, Inc.
33. Yang, Y. (1999). An evaluation of statistical approaches to text categorization. Information Retrieval, 1(1), 69-90.