Nature of indexing: How humans and machines analyze messages and texts for retrieval. Part II: Machine indexing, and the allocation of human versus machine effort

Information Processing and Management

Volumn 37, Issue 2, 2001, Pages 255-277

  Anderson, James D ^a   Pérez Carballo, José ^a  

^a RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA REDUCTION; DATA STRUCTURES; HUMAN COMPUTER INTERACTION; INFORMATION RETRIEVAL; USER INTERFACES;

HUMAN INTELLECTUAL INDEXING;

AUTOMATIC INDEXING;

EID: 0343832451     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0306-4573(00)00046-7     Document Type: Article

References (56)

1. Bates, M. J. (1976). Rigorous systematic bibliography. RQ, 16(1), 7-26.
2. Bates M.J. Indexing and access for digital libraries and the internet: Human, database, and domain factors. Journal of the American Society for Information Science. 49(13):1998;1185-1205.
3. Belkin N.J., Croft W.B. Information filtering and information retrieval: Two sides of the same coin? Communications of the ACM. 35(12):1992;29-38.
4. Blair, D. C., & Kimbrough, S. O. (2000). Exemplary documents: A foundation for information retrieval design. Information Processing and Management, in press.
5. Brooks T.A. Orthography as a fundamental impediment to online information retrieval. Journal of the American Society for Information Science. 49(8):1998;731-741.
6. Callan, J. P., Croft, W. B., & Broglio, J. (1995). TREC and TIPSTER experiments with inquiry. Information Processing and Management, 31(3), 327-332, 343. Reprinted in: K. Sparck Jones, P. Willet (Eds.), Readings in information retrieval (pp. 436-439). San Francisco: Morgan Kaufman, c1997.
7. Callan, J. P., Croft, W. B., & Broglio, J. (1995). TREC and TIPSTER experiments with inquiry. Information Processing and Management, 31(3), 327-332, 343. Reprinted in: K. Sparck Jones, P. Willet (Eds.), Readings in information retrieval (pp. 436-439). San Francisco: Morgan Kaufman, c1997.
8. Cavnar, W. B. (1994). Using an n-gram-based document representation with a vector processing retrieval model. In D. Harman (Ed.), TREC-3: Proceedings of the third Text REtrieval Conference (pp. 269 ff); 2-3 November 1994; Gaithersburg, MD. Co-sponsored by the National Institute of Standards and Technology (NIST) and the Advanced Research Projects Agency (ARPA). Gaithersburg, MD: US Department of Commerce, Technology Administration, National Institute of Standards and Technology; Washington, DC: For sale by the Supt. of Docs., US G.P.O., (NIST Special Publication; 500-226). http://www.trec.nist.gov/.
9. Croft, B. (1989). Automatic indexing. In B. H. Weinberg (Ed.), Indexing: The state of our knowledge and the state of our ignorance: Proceedings of the 20th annual meeting of the American Society of Indexers (pp. 86-100); 13 May 1988, New York. Medford: Learned Information.
10. Deerwester S.C., Dumais S.T., Furnas G.W., Landauer T.K., Harshman R. Indexing by latent semantic analysis. Journal of the American Society for Information Science. 41(6):1990;391-407.
11. Francis, W. N., Kučera, H., & Mackie, A. W. (1982). Frequency analysis of English usage: Lexicon and grammar. Boston: Houghton Mifflin.
12. Frohmann B. Rules of indexing: A critique of mentalism in information retrieval theory. Journal of Documentation. 46(2):1990;81-101.
13. Gordan M.D., Dumais S.T. Using latent semantic indexing for literature based discovery. Journal of the American Society for Information Science. 49(8):1998;674-685.
14. Gutwin, C., Paynter, G., Witten, I. H., Nevill-Manning, C. G., & Frank, E. (1998). Improving browsing in digital libraries with keyphrase indexes. Technical report 98-1, Computer Science Department, University of Saskatchewan, http://www.cs/usask.ca/faculty/gutwin/1998/keyphind-techreport/html/keyphind-9. html.
15. Harman D. How effective is suffixing? Journal of the American Society for Information Science. 42(1):1991;7-15.
16. Harman, D. (1994). Automatic indexing. In R. Fidel, T. B. Hahn, E. M. Rasmussen, P. J. Smith (Eds.), Challenges in indexing electronic text and images (pp. 247-264). Medford, NJ: Learned Information for the American Society for Information Science.
17. Hearst, M. (1999). The use of categories and clusters for organizing retrieval results. In T. Strzalkowski (Ed.), Natural language information retrieval (pp. 333-374). Dordrecht: Kluwer Academic Publishers.
18. Hodge, G. M., & Milstead, J. L. (1998). Computer support to indexing. Philadelphia, PA: National Federation of Abstracting and Information Services.
19. Huffman, S. (1995). Acquaintance: Language-independent document categorization by n-grams. In D. Harman (Ed.), TREC-4: Proceedings of the fourth Text REtrieval Conference (pp. 269 ff); 1-3 November 1995; Gaitherburg, MD. Co-sponsored by the National Institute of Standards and Technology (NIST) and the Defense Advanced Research Projects Agency (DARPA). Gaithersburg, MD: US Department of Commerce, Technology Administration, National Institute of Standards and Technology; Washington, DC: For sale by the Supt. of Docs., US G.P.O. (NIST Special Publication; 500-236) http://www.trec.nist.gov/.
20. Hull D.A. Stemming algorithms: A case study for detailed evaluation. Journal of the American Society for Information Science. 47(1):1996;70-84.
21. Humphrey, S. M. (1994). Knowledge-based systems for indexing. In R. Fidel, T. B. Hahn, E. M. Rasmussen, P. J. Smith (Eds.), Challenges in indexing electronic text and images (pp. 161-175). Medford, NJ: Learned Information for the American Society for Information Science.
22. Institute for Scientific Information (1961-1999). Science citation index. Philadelphia: ISI.
23. Institute for Scientific Information (1969-1999). Social sciences citation index. Philadelphia: ISI.
24. Institute for Scientific Information (1976-1999). Arts and humanities citation index. Philadelphia: ISI.
25. Kessler M.M. Bibliographic coupling between scientific papers. American Documentation. 14(1):1963;10-25.
26. Kowalski, G. (1997). Information retrieval systems: Theory and implementation. Boston: Kluwer Academic Publishers.
27. Korfhage, R. R. (1997). Information storage and retrieval. New York: Wiley Computer Publishing.
28. Krovetz, R. (1993). Viewing morphology as an inference process. In R. Korfhage, E. Rasmussen, P. Willett (Eds.), Proceedings of the 16th annual international ACM-SIGIR conference on research and development in information retrieval (pp. 191-202); 27 June-1 July 1993; Pittsburgh, PA. New York, Association for Computing Machinery. (Also available as UMass technical report TR-93-35).
29. Krovetz, R. (1999). Personal correspondence to J. Pérez-Carballo.
30. Lancaster, F. W. (1991, 1998). Indexing and abstracting in theory and practice. Champaign, IL: University of Illinois, Graduate School of Library and Information Science; 1991. A 2nd ed. was published in 1998.
31. Mayfield, J., & McNamee, P. (1998). Indexing using both n-grams and words. In E. M. Voorhees, D. Harman (Eds.) TREC-7: Proceedings of the seventh Text REtrieval Conference; (pp. 419-424); 9-11 November 1998; Gaithersburg, MD. Co-sponsored by the National Institute of Standards and Technology (NIST) and the Defense Advanced Research Projects Agency (DARPA). Gaithersburg, MD: US Department of Commerce, Technology Administration, National Institute of Standards and Technology; Washington, DC: For sale by the Supt. of Docs., US G.P.O. (NIST Special Publication; 500-242). http://www.trec.nist.gov/.
32. Milstead J.L. Methodologies for subject analysis in bibliographic databases. Information Processing and Management. 28(3):1992;407-431.
33. Paice C.D. Method for evaluation of stemming algorithms based on error counting. Journal of the American Society for Information Science. 47(8):1996;632-649.
34. Pérez-Carballo, J., & Strzalkowski, T. (2000). Natural language information retrieval: Progress report. Information Processing and Management, 36(1), 155-178.
35. Salton, G. (1975). A theory of indexing. Philadelphia: Society for Industrial and Applied Mathematics.
36. Salton G., McGill M.J. Introduction to modern information retrieval. 1983a;Prentice-Hall, Englewood Cliffs, NJ.
37. Salton, G., & McGill, M. J. (1983b) The SMART and SIRE experimental retrival systems. Reprinted in: K. Sparck Jones, P. Willett (Eds.), Readings in information retrieval (pp. 118-155). San Francisco: Morgan Kaufman; c1987.
38. Salton, G., & Buckley, C. (1988). Term weighting approaches in automatic text retrieval. Information Processing and Management, 24(5), 513-523. Reprinted in: K. Sparck Jones, P. Willett (Eds.), Readings in information retrieval (pp. 323-328). San Francisco: Morgan Kaufman.
39. Salton, G., & Buckley, C. (1988). Term weighting approaches in automatic text retrieval. Information Processing and Management, 24(5), 513-523. Reprinted in: K. Sparck Jones, P. Willett (Eds.), Readings in information retrieval (pp. 323-328). San Francisco: Morgan Kaufman.
40. Salton, G. (1989). Automatic text processing: The transformation, analysis, and retrieval of information by computer. Reading, MA: Addison-Wesley.
41. Salton G., Buckley C. Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science. 41(4):1990;288-297.
42. Small H.G. Co-citation in the scientific literature: A new measure of the relationship between two documents. Journal of the American Society for Information Science. 24(4):1973;265-269.
43. Sparck Jones, K., & Willett, P. (Eds.) (1997). Readings in information retrieval. San Francisco: Morgan Kaufman.
44. Sparck Jones, K. (1999). What is the role of NLP in text retrieval? (pp. 1-24) In T. Strzalkowski (Ed.), Natural language information retrieval. Dordrecht: Kluwer Academic Publishers.
45. Sparck Jones, K., Walker, S., & Robertson, S.E. (2000). A probabilistic model of information retrieval: Development and comparative experiments. Information Processing and Management, 36(6), 779-840.
46. Spink A. Term relevance feedback and mediated database searching: Implications for information retrieval practice and systems design. Information Processing and Management. 31(2):1995;161-171.
47. Stiles H.E. The association factor in information retrieval. Journal of the Association of Computing Machinery. 8(2):1961;271-279.
48. Strzalkowski, T., Lin, F., & Pérez-Carballo, J. (1997). Natural language information retrieval: Trec-6 report. In E. M. Voorhees, D. Harman (Eds.), Information technology: The sixth Text REtrieval Conference (TREC-6) (pp. 209-228); 19-21 November 1997; Gaithersburg, MD Co-sponsored by the National Institute of Standards and Technology (NIST) and the Defense Advanced Research Projects Agency (DARPA). Gaithersburg, MD: US Department of Commerce, Technology Administration, National Institute of Standards and Technology; Washington, DC: For sale by the Supt. of Docs., US G.P.O. (NIST special publication; no. 500-240). http://www.trec.nist.gov/.
49. Strzalkowski, T., Lin, F., Wang, J., & Pérez-Carballo, J. (1999). Evaluating natural language processing techniques in information retreival. In T. Strzalkowski (Ed.), Natural language information retrieval (pp. 113-145). Dordrecht: Kluwer Acadmeic Publishers.
50. Strzalkowski, T., Pérez-Carballo, J., & Marinescu, M. (1996). Natural language information retrieval in digital libraries. In E. A. Fox, G. Marchionini (Eds.), Proceedings of the first ACM international conference on digital libraries (pp. 117-125); 20-23 March 1996; Bethesda, MD. New York: Association for Computing Machinery.
51. TREC (1992-1999). Text Retrieval Conferences. In E. M. Voorhees, D. Harman (Eds.), Proceedings of the Text Retrieval Conferences 1-8; 1992-1999; Gaithersburg, MD. Co-sponsored by the National Institute of Standards and Technology (NIST) and the Defense Advanced Research Projects Agency (DARPA). Gaithersburg MD: US Department of Commerce, Technology Administration, National Institute of Standards and Technology; Washington, DC: For sale by the Supt. of Docs., US G.P.O. http://www.trec.nist.gov/.
52. Wellisch H.H. Indexing after the millennium 3: The indexer as helmsman. The Indexer. 21(2):1998;89.
53. Wiener, N. (1950). The human use of human beings: Cybernetics and society (2nd ed. rev). London: Eyre and Spottiswoode; 2nd ed., Garden City, NY: Doubleday; 1954.
54. Willett P. Recent trends in heirarchic document clustering: A critical review. Information Processing and Management. 24(5):1998;577-597.
55. Wilson, P. (1978). Some fundamental concepts of information retrieval. Drexel Library Quarterly, 14(2), 10-24.
56. Witten I.H., Nevill-Manning C.G., McNab R., Cunningham S.J. A public library based on full text retrieval. Communications of the ACM. 41(4):1998;71-75.