Rethinking online monitoring methods for information retrieval systems: From search product to search process

Journal of the American Society for Information Science

Volumn 47, Issue 7, 1996, Pages 568-583

  Borgman, Christine L ^a   Hirsh, Sandra G ^a,b   Miller, John ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF ARIZONA   (United States)

^c UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ACQUISITION; DATABASE SYSTEMS; INTERACTIVE COMPUTER SYSTEMS; MONITORING; ONLINE SEARCHING; ONLINE SYSTEMS; QUERY LANGUAGES; SYSTEMS ANALYSIS; USER INTERFACES;

DATA COLLECTION TECHNIQUE; ONLINE MONITORING METHODS; TRANSACTION LOG ANALYSIS;

INFORMATION RETRIEVAL SYSTEMS;

EID: 0030188853     PISSN: 00028231     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1097-4571(199607)47:7<568::AID-ASI8>3.0.CO;2-S     Document Type: Article

References (77)

1. Barry, C. L. (1994). User-defined relevance criteria: An exploratory study. Journal of the American Society for Information Science, 45, 124-134.
2. Bates, M. J. (1989). The design of browsing and berrypicking techniques for the online search interface. Online Review, 13(5), 407-424.
3. Belkin, N. J. (1980). Anomalous states of knowledge as the basis for information retrieval. Canadian Journal of Information Science, 5, 133-143.
4. Borgman, C. L. (1982). Online monitoring of users of the Ohio State University online catalog: Methodological issues and results. Proceedings of the 45th American Society for Information Science Annual Meeting, October 17-21, 1982. Columbus, OH (pp. 35-36). White Plains, NY: Knowledge Industry Publications.
5. Borgman, C. L. (1983). End user behavior on an online information retrieval system: A computer monitoring study. Proceedings of the 6th International ACM Special Interest Group on Information Retrieval Conference, June 6-8, 1983, Bethesda, MD. SIGIR Forum, 14(4), 161-176.
6. Borgman, C. L. (1984). The user's mental model of an information retrieval system: Effects on performance. Unpublished doctoral dissertation, Stanford University, Stanford, CA.
7. Borgman, C. L. (1986a). The user's mental model of an information retrieval system: An experiment on a prototype online catalog. International Journal of Man-Machine Studies, 24, 47-64.
8. Borgman, C. L. (1986b). Why are online catalogs hard to use? Lessons learned from information retrieval studies. Journal of the American Society for Information Science, 37, 387-400.
9. Borgman, C. L. (1989). All users of information systems are not created equal: An exploration into individual differences. Information Processing and Management, 25(3), 237-252.
10. Borgman, C. L., Bower, J., Auth, M. J., & Krieger, D. (1989a). From hands-on science to hands-on information retrieval. Proceedings of the American Society for Information Science Annual Meeting, 26, 96-103.
11. Borgman, C. L., Chignell, M. C., & Valdez, F. (1989b). Designing an information retrieval interface based on children's categorization of knowledge: A pilot study. Proceedings of the American Society for Information Science Annual Meeting, 26, 81-95.
12. Borgman, C. L., Gallagher, A. L., Hirsh, A. G., & Walter, V. A. (1995). Children's searching behavior on browsing and keyword online catalogs: The Science Library Catalog project. Journal of the American Society for Information Science, 46, 663-684.
13. Borgman, C. L., Gallagher, A. L., Krieger, D., & Bower, J. (1990a). Children's use of an interactive catalog of science materials. Proceedings of the American Society for Information Science Annual Meeting, 27, 55-68.
14. Borgman, C. L., Gallagher, A. L., Walter, V. A., & Rosenberg, J. B. (1991). The Science Library Catalog project: Comparison of children's searching behavior in a direct manipulation and a keyword search system. Proceedings of the 54th Annual Meeting of the American Society for Information Science Annual Meeting, 28, 162-169.
15. Borgman, C. L., Krieger, D., Gallagher, A. L., & Bower, J. (1990b). Children's use of an interactive science library: Exploratory research. School Library Media Quarterly, 18(2), 108-112.
16. Brodie, K. W., et al. (1992). Scientific visualization. Berlin: Springer-Verlag.
17. Chapman, J. L. (1981). A state transition analysis of online information-seeking behavior. Journal of the American Society for Information Science, 32, 325-333.
18. Cooper, M. D. (1983). Response time variations in an online search system. Journal of the American Society for Information Science, 34, 374-380.
19. Dickson, J. (1984). An analysis of user errors in searching an online catalog. Cataloging & Classification Quarterly, 4(3), 19-38.
20. Egan, D. E. (1988). Individual differences in human-computer interaction. In M. Helander, (Ed.), Handbook of human-computer interaction (pp. 543-579). New York: Elsevier.
21. Eick, S. G., Nelson, M. C., & Schmidt, J. D. (1993). Graphical analysis of computer log files. Communications of the ACM, 37(12), 50-56.
22. Eisenberg, M. B. (1988). Measuring relevance judgements. Information Processing & Management, 24(4), 373-389.
23. Fenichel, C. H. (1981). Online searching: Measures that discriminate among users with different types of experiences. Journal of the American Society for Information Science, 32, 23-32.
24. Froehlich, T. J. (1994). Relevance reconsidered - towards an agenda for the 21st century: Introduction to special topic issue on relevance research. Journal of the American Society for Information Science, 45, 149-159.
25. Hancock-Beaulieu, M. M. (1993). A comparative transaction log analysis of browsing and search formulation in online catalogues. Program: Automated Library and Information Systems, 27(3), 269-280.
26. Hanson, S. J., Kraut, R. E., & Farber, J. M. (1984). Interface design and multivariate analysis of UNIX command use. ACM Transactions on Office Information Systems, 2, 42-57.
27. Harris, M. A. (1986). Sequence analysis of moves in online searching. The Canadian Journal of Information Science, 11(2), 35-56.
28. Hildreth, C. R. (1987). Beyond Boolean: Designing the next generation of online catalogs. Library Trends, 35(4), 647-667.
29. Hiller, J. (1988). Domains and mappings in relational databases. Proceedings. ASWEC 88. Canberra, Australia: The Institution of Radio and Electronics Engineers.
30. Hiller, J. (1990a). Querying of directories. Paper presented to the Open Distributed Processing Workshop, January 18-19, 1990, The University of Sydney, Sydney, Australia.
31. Miller, J. (1990b). The testing of high level languages. Proceedings, ASWEC 90, May 1990. Sydney, Australia: The Institution of Radio and Electronics Engineers.
32. Miller, J. (1991). The recording of online data and analysis of online sessions (Tech. Rep.). Sydney, Australia: School of Computer Science and Engineering, University of New South Wales.
33. Hirsh, S. G. (1996). The effect of domain knowledge on elementary school children's information retrieval behavior on an automated library catalog. Unpublished doctoral dissertation, Department of Library and Information Science, University of California, Los Angeles.
34. Hirsh, S. G., & Borgman, C. L. (1995). Comparing children's use of browsing and keyword searching on the Science Library Catalog. In T. Kinney (Ed.), Proceedings of the Annual Meeting of the American Society for Information Science, 32, October 9-12, 1995, Chicago (pp. 19-26). Medford, NJ: Information Today.
35. Hsieh-Yee, I. (1993). Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers. Journal of the American Society for Information Science, 44, 161-174.
36. Ingwersen, P. (1984). Psychological aspects of information retrieval. Social Science Information Studies, 4, 83-95.
37. Janes, J. W. (1994). Other people's judgements: A comparison of users' and others' judgements of document relevance, topicality, and utility. Journal of the American Society for Information Science, 45, 160-171.
38. Kalin, S. W. (1987). The invisible users of online catalogs: A public services perspective. Library Trends, 35(4), 587-595.
39. Kalin, S. W. (1991). The searching behavior of remote users: A study of one online public access catalog (OPAC). Proceedings of the 54th Annual Meeting of the American Society for Information Science, 28, Washington, DC (pp. 178-195). Medford, NJ: Learned Information.
40. Kanji, G. K. (1993). 100 statistical tests. London: Sage.
41. Kantor, P. B. (1994). Information retrieval techniques. In M. E. Williams (Ed.), Annual review of information science and technology, 29 (pp. 53-90). Medford. NJ: Learned Information (published on behalf of the American Society for Information Science).
42. Lancaster, F. W., & Warner, A. J. (1993). Information retrieval today. Arlington, VA: Information Resources Press.
43. Larson, R. R. (1991). The decline of subject searching: Long-term trends and patterns of index use in an online catalog. Journal of the American Society for Information Science, 42, 197-215.
44. Liebscher, P., & Marchionini, G. (1988). Browse and analytical search strategies in a full-text CD-ROM encyclopedia. School Library Media Quarterly, 16(4), 223-233.
45. Lin, X., Liebscher, P., & Marchionini, G. (1991). Graphical representations of electronic search patterns. Journal of the American Society for Information Science, 42, 469-478.
46. Marchionini, G. (1989). Information-seeking strategies of novices using a full-text electronic encyclopedia. Journal of the American Society for Information Science, 40, 54-66.
47. Marchionini, G. (1992). Interfaces for end-user information seeking. Journal of the American Society for Information Science, 43, 156-163.
48. Marchionini, G. (1995). Information seeking in electronic environments. Boston: Cambridge University Press.
49. Millsap, L., & Ferl, T. E. (1993). Search patterns of remote users: An analysis of OPAC transaction logs. Information Technology & Libraries, 12(3), 321-343.
50. Nielsen, B. (1986). What they say they do and what they do: Assessing online catalog use instruction through transaction monitoring. Information Technology and Libraries, 5(1), 28-34.
51. Nielsen, I. H., Lomheim, I., Pasanen-Tuomainen, I. (1993). Monitoring online catalogues (OPACs) in the Nordic Technological University libraries. NORDINFO Publikation 23. Helsinki: NORDINFO.
52. O'Brien, A. (1994). Online catalogs: Enhancements and developments. In M. E. Williams (Ed.), Annual review of information science and technology, 29 (pp. 219-242). Medford, NJ: Learned Information (published on behalf of the American Society for Information Science).
53. Park, T. K. (1994). Toward a theory of user-based relevance: A call for a new paradigm of inquiry. Journal of the American Society for Information Science, 45, 135-141.
54. Penniman, W. D. (1975). Rhythms of dialogue in human-computer conversation. Unpublished doctoral dissertation, Ohio State University, Columbus.
55. Penniman, W. D. (1981). Modeling and evaluation of on-line user behavior. Final report to the National Library of Medicine, NLM/EMP (1 R01 LM 03444-01). Dublin, OH: OCLC.
56. Penniman, W. D., & Dominick, W. D. (1980). Monitoring and evaluation of on-line information system usage. Information Processing & Management, 16(1), 17-35.
57. Peters, T. A. (1993). The history and development of transaction log analysis. Library Hi Tech, 11 (2), 41-66.
58. Qui, L. (1993). Markov models of search state patterns in a hypertext information retrieval system. Journal of the American Society for Information Science, 44, 413-427.
59. Rice, R. E., & Borgman, C. L. (1983). The use of computer-monitored data in information science and communication research. Journal of the American Society for Information Science, 34, 247-256.
60. Riecken, G. (Ed.) (1994). Special issue on intelligent agents. Communications of the Association for Computing Machinery, 37(7), 18-147.
61. Robertson, S. E., & Hancock-Beaulieu, M. M. (1992). On the evaluation of IR systems. Information Processing & Management, 28(4), 457-466.
62. Rosenberg, J. B., & Borgman, C. L. (1991). A report on the loading of MARC format bibliographic records into HyperCard. Information Technology and Libraries, 10(4), 292-297.
63. Rosenberg, J. B., & Borgman, C. L. (1992). Extending the Dewey decimal classification via keyword clustering: The Science Library Catalog project. Proceedings of the 54th American Society for Information Science Annual Meeting, 29, October 26-29, 1992, Pittsburgh (pp. 171-184). Medford, NJ: Learned Information.
64. Saracevic, T. (1975). Relevance: A review of and a framework for thinking on the notion in information science. Journal of the American Society for Information Science, 26, 321-343.
65. Saracevic, T., & Kantor, P. (1988). A study of information seeking and retrieving. III. Searchers, searches, and overlap. Journal of the American Society for Information Science, 39, 197-216.
66. Schamber, L. (1994). Relevance and information behavior. In M. E. Williams (Ed.), Annual Review of Information Science and Technology, 29 (pp. 3-48). Medford, NJ: Learned Information.
67. Shute, S. J., & Smith, P. J. (1993). Knowledge-based search tactics. Information Processing & Management, 29(1), 29-45.
68. Sparck Jones, K. (1981). Information retrieval experiment. London: Butterworths.
69. Sullivan, M. V., Borgman, C. L., & Wippern, D. (1990). End-users, mediated searches, and front-end assistance programs on Dialog: A comparison of learning, performance, and satisfaction. Journal of the American Society for Information Science, 41, 27-42.
70. Taylor, A. G. (1984). Authority files in online catalogs: An investigation of their value. Cataloging & Classification Quarterly, 4(3), 1-17.
71. Tolle, J. E. (1983a). Transaction log analysis: Online catalogs. Research and development in information retrieval. Sixth Annual International ACM SIGIR Conference, 17(4), 147-160.
72. Tolle, J. E. (1983b). Understanding patrons' use of online catalogs: Transaction log analysis of the search method. In R. F. Vondran, A. Caputo, C. Wasserman, R. A. V. Diener (Eds.), Productivity in the Information Age: Proceedings of ASIS 46th Annual Meeting, 20, (pp. 167-171). White Plains, NY: Knowledge Industry.
73. Tolle, J. E. (1984a). Monitoring and evaluation of information systems via transaction log analysis. Research and development in information retrieval. Proceedings of the Third Joint BCS and ACM Symposium, 247-258.
74. Tolle, J. E. (1984b). Monitoring use of online information systems: NLM CATLlNE database. In B. Flood, J. Witiak, T. H. Hogan (comp.), 1984: Challenges to an Information Society. Proceedings of the 47th ASIS Annual Meeting, 21, (pp. 126-129). White Plains, NY: Knowledge Industry.
75. Tolle, J. E., & Hah, S. (1985). Online search patterns: NLM CATLINE database. Journal of the American Society for Information Science, 36, 82-93.
76. Walter, V. A., & Borgman, C. L. (1991). The Science Library Catalog: A prototype information retrieval system for children. Journal of Youth Services in Libraries, 4(2), 159-166.
77. Walter, V. A., Borgman, C. L., Hirsh, S. G. (in press). The Science Library Catalog: A springboard for information literacy. School Library Media Quarterly.