The dilemma of measurement in information retrieval research

Journal of the American Society for Information Science

Volumn 47, Issue 1, 1996, Pages 23-36

  Ellis, David ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EXPERT SYSTEMS; INDEXING (OF INFORMATION); INFORMATION RETRIEVAL SYSTEMS; MEASUREMENTS; PERFORMANCE; PROBABILITY;

COGNITION; INFORMATION RETRIEVAL RESEARCH;

INFORMATION RETRIEVAL;

EID: 0029771472     PISSN: 00028231     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1097-4571(199601)47:1<23::AID-ASI3>3.0.CO;2-4     Document Type: Article

References (102)

1. Allen, B. L. (1990). Knowledge organization in an information retrieval task. Information Processing and Management, 26, 535-542.
2. Allen, B. L. (1991a). Cognitive research in information science: Implications for design. In M. E. Williams (Ed.), Annual Review of Information Science and Technology, Volume 26 (pp. 3-37). Medford, NJ: Learned Information.
3. Allen, B. L. (1991b). Topic knowledge and on-line catalog search formulation. Library Quarterly, 61, 188-213.
4. Bates, M. J. (1989). The design of browsing and berrypicking techniques for the on-line search interface. On-line Review, 13, 407-424.
5. Bates, M. J. (1990). Where should the person stop and the information search interface start. Information Processing and Management, 26, 575-591.
6. Belkin, N. J. (1978). Progress in documentation: Information concepts for information science. Journal of Documentation, 34, 55-85.
7. Belkin, N. J. (1980a). Anomalous states of knowledge as the basis for information retrieval. Canadian Journal of Information Science, 5, 133-143.
8. Belkin, N. J. (1980b). The problem of matching in information retrieval. In O. Harbo (Ed.), Theory and Application of Information Research (pp. 187-197). London: Mansell.
9. Belkin, N. J. (1984). Cognitive models and information retrieval. Social Science Information Studies, 4, 111-129.
10. Belkin, N. J. (1990). The cognitive viewpoint in information science. Journal of Information Science, 16, 11-15.
11. Belkin, N. J., Brooks, H., & Oddy, R. N. (1979). Representing and classifying anomalous states of knowledge. In K. Gray & M. Mac-Cafferty (Eds.), Informatics 5. The analysis of meaning (pp. 227-238). London: Aslib.
12. Belkin, N. J., Marchetti, P. G., & Cool, C. (1993). Braque: Design of an interface to support user interaction in information retrieval. Information Processing and Management, 29, 325-344.
13. Belkin, N. J., Oddy, R. N., & Brooks, H. M. (1982a). ASK for information retrieval I: Background and theory. Journal of Documentation, 38, 61-71.
14. Belkin, N. J., Oddy, R. N., & Brooks, H. M. (1982b). ASK for information retrieval II: Results of a design study. Journal of Documentation, 38, 145-164.
15. Blair, D. C. (1990). Language and representation in information retrieval. Oxford: Elsevier.
16. Borgman, C. (1986). The user's mental model of an information retrieval system: An experiment on a prototype online catalog. International Journal of Man-Machine Studies, 24, 47-64.
17. Brookes, B. C. (1975a). The fundamental equation of information science. In Problems of information science, FID 530 (pp. 115-130). Moscow: VINITI.
18. Brookes, B. C. (1975b). The fundamental problem of information science. In V. Horsnell (Ed.), Informatics 2 (pp. 42-49). London: Aslib.
19. Brookes, B. C. (1977). The developing cognitive viewpoint in information science. In M. De Mey (Ed.), International workshop on the cognitive viewpoint, (pp. 195-203). Ghent: University of Ghent.
20. Brookes, B. C. (1980a). The foundations of information science. Part I: Philosophical aspects. Journal of Information Science, 2, 125-133.
21. Brookes, B. C. (1980b). The foundations of information science. Part II: Quantitative aspects: Classes of things and the challenge of human individuality. Journal of Information Science, 2, 209-221.
22. Brookes, B. C. (1980c). The foundations of information science. Part III: Quantitative aspects: Objective maps and subjective landscapes. Journal of Information Science, 2, 269-275.
23. Brookes, B. C. (1981a). The foundations of information science. Part IV: Information science: The changing paradigm. Journal of Information Science, 3, 3-12.
24. Brookes, B. C. (1981b). Information technology and the science of information. In R. N. Oddy, S. E. Robertson, C. J. Van Rijsbergen, & P. W. Williams (Eds.), Information Retrieval Research (pp. 1-8). London: Butterworths.
25. Chen, H., & Dhar, V. (1991). Cognitive process as a basis for intelligent retrieval system design. Information Processing and Management, 27, 405-432.
26. Cleverdon, C. W. (1962). Report on the testing and analysis of an investigation into the comparative efficiency of indexing systems. Cranfield: College of Aeronautics.
27. Cleverdon, C. W. (1967). The Cranfield tests of index language devices. Aslib Proceedings, 19, 173-194.
28. Cleverdon, C. W. (1970). Review of the origins and development of research. Aslib Proceedings, 22, 538-549.
29. Cleverdon, C. W., & Keen, E. M. (1966). Factors determining the performance of indexing systems. (Volume 2: Test results). Cranfield: College of Aeronautics.
30. Cleverdon, C. W., Mills, J., & Keen, E. M. (1966). Factors determining the performance of indexing systems. (Volume 1: Design). Cranfield: College of Aeronautics.
31. Croft, W. B. (1987). Approaches to intelligent retrieval. Information Processing and Management, 23, 249-254.
32. Croft, W. B., & Thompson, R. H. (1987). I3R: A new approach to the design of document retrieval systems. Journal of the American Society for Information Science, 38, 389-404.
33. Cuadra, C. A., & Katter, R. V. (1967). Opening the black box of relevance. Journal of Documentation, 23, 291-303.
34. Cuadra, C. A., Katter, R. V., Holmes, E. H.,& Wallace, E. M. (1967). Experimental studies of relevance judgements (Final Rep., Vol. 1. Rep. No. TM3520/001/00). Santa Monica. CA: Systems Development Corporation.
35. Daniels, P. (1986). Cognitive models in information retrieval: An evaluative review. Journal of Documentation, 42, 272-304.
36. De Mey, M. (1980). The relevance of the cognitive paradigm for information science. In O. Harbo (Ed.), Theory and application of information research (pp. 48-61). London: Mansell.
37. De Mey, M. (1982). The cognitive paradigm. Dordrecht, Holland: Reidel Publishing.
38. Doyle, L. B. (1963). Is relevance an adequate criterion in retrieval system evaluation. In Proceedings of the American Documentation Inslilute 26th Annual Meeling (pp. 199-200). Washington, DC: American Documentation Institute.
39. Ellis, D. (1984a). Effectiveness of information retrieval systems: the need for new explanatory frameworks. Social Science Information Studies, 4, 261-272.
40. Ellis, D. (1984b). Theory and explanation in information retrieval research. Journal of Information Science, 8, 25-38.
41. Ellis, D. (1989a). A behavioural approach to information retrieval system design. Journal of Documentation, 45, 171-212.
42. Ellis, D. (1989b). A behavioural model for information retrieval system design. Journal of Information Science, 15, 237-247.
43. Ellis, D. (1990). New horizons in information retrieval. London: Library Association.
44. Ellis, D. (1992). The physical and cognitive paradigms in information retrieval research. Journal of Documentation, 48, 45-64.
45. Ellis, D. (1993). Modelling the information seeking patterns of academic researchers: A grounded theory approach. Library Quarterly, 63, 469-486.
46. Ellis, D. (1994). Paradigms in information retrieval research. In A. Kent (Ed.), Encyclopedia of Library and Information Science, 54 (pp. 275-290). Also in: A. Kent & J. Williams (Eds.), Encyclopedia of Microcomputers, 13, 57-72. New York: Marcel Dekker.
47. Ellis, D. (1994). Paradigms in information retrieval research. In A. Kent (Ed.), Encyclopedia of Library and Information Science, 54 (pp. 275-290). Also in: A. Kent & J. Williams (Eds.), Encyclopedia of Microcomputers, 13, 57-72. New York: Marcel Dekker.
48. Ellis, D., Cox, D., & Hall, K. (1993). A comparison of the information seeking patterns of researchers in the physical and social sciences. Journal of Documentation, 49, 356-359.
49. Fidel, R. (1984). Online searching styles: A case-study-based model of searching behaviour. Journal of the American Society for Information Science, 35, 211-221.
50. Fidel, R. (1985). Moves in online searching. Online Review, 9, 61-74.
51. Fidel, R. (1993). Qualitative methods in information retrieval research. Library and Information Science Research, 15, 219-247.
52. Frohmann, B. (1994). Discourse analysis as a research method in library and information science. Library and Information Science Research, 16, 119-138.
53. Gull, C. D. (1956). Seven years of work on the organization of materials in the special library. American Documentation, 7, 320-329.
54. Hancock, M. (1987). Subject searching behaviour at the library catalogue and at the shelves: Implications for online interactive catalogues. Journal of Documentation, 43, 303-321.
55. Hancock-Beaulieu, M. (1990). Evaluating the impact of an online library catalogue on the subject searching behaviour at the catalogue and at the shelves. Journal of Documentation, 46, 318-338.
56. Harter, S. P. (1992). Psychological relevance and information science. Journal of the American Society for Information Science, 43, 602-615.
57. Heine, M. D. (1981). Simulation and simulation experiments. In K. Sparck Jones (Ed.), Information Retrieval Experiment (pp. 179-198). London: Butterworths.
58. Hjorland, B. (1988). Information retrieval in psychology: Implications of a case study. Behavioural and Social Sciences Librarian, 6, 39-64.
59. Hollnagel, E. (1987). Cognitive models, cognitive tasks and information retrieval. In I. Wormell (Ed.), Knowledge Engineering. London: Taylor Graham.
60. Ingwersen, P. (1982). Search procedures in the library - analysed from the cognitive point of view. Journal of Documentation, 38, 165-191.
61. Ingwersen, P. (1984). Psychological aspects of information retrieval. Social Science Information Studies, 4, 83-95.
62. Ingwersen, P. (1992). Information Retrieval Interaction. London: Taylor Graham.
63. Kuhlthau, C. C. (1988). Developing a model of the library search process: Cognitive and affective aspects. RQ, 28, 232-242.
64. Kuhlthau, C. C. (1991). Inside the search process: Information seeking from the users perspective. Journal of the American Society for Information Science, 42, 361-371.
65. Kuhlthau, C. C. (1993). A principle of uncertainty for information-seeking. Journal of Documentation, 49, 339-355.
66. Lesk, M. E., & Salton, G. (1968). Relevance assessments and retrieval system evaluation. Information Storage and Retrieval, 4, 343-359.
67. Maron, M. E., & Kuhns, J. L. (1960). On relevance probabilistic indexing and information retrieval. Journal of the Association for Computing Machinery, 7, 216-244.
68. Neill, S. D. (1992). Dilemmas in the study of information: Exploring the boundaries of information science. New York: Greenwood Press.
69. Oddy, R. N. (1977a). Information retrieval through man-machine dialogue. Journal of Documentation, 33, 1-14.
70. Oddy, R. N. (1977b). Retrieving references by dialogue rather than by query formulation. Journal of Informatics, 1, 37-53.
71. Oddy, R. N. (1981). Laboratory tests: Automatic systems. In K. Sparck Jones (Ed.), Information Retrieval Experiment (pp. 156-178). London: Butterworths.
72. Park, T. K. (1993). The nature of relevance in information retrieval: An empirical study. Library Quarterly, 63, 318-351.
73. Park, T. K. (1994). Toward a theory user-based relevance: A call for a new paradigm of inquiry. Journal of the American Society for Information Science, 45, 135-141.
74. Pejtersen, A. M. (1984). Design of a computer-aided user-system dialogue based on an analysis of users' search behaviour. Social Science Information Studies, 4, 167-183.
75. Putnam, H. (1978). Meaning and the moral sciences. London: Routledge & Kegan Paul.
76. Robertson, S. E. (1977a). The probability ranking principle in information retrieval. Journal of Documentation, 33, 294-304.
77. Robertson, S. E. (1977b). Theories and models in information retrieval. Journal of Documentation, 33, 126-148.
78. Robertson, S. E. (1979). Between aboutness and meaning. In M. Mac-Cafferty and K. Gray (Eds.), The analysis of meaning (Informatics 5) (pp. 202-205). London: Aslib.
79. Robertson, S. E. (1981). The methodology of information retrieval experiment. In K. Sparck Jones (Ed.), Information Retrieval Experiment (pp. 9-31). London: Butterworths.
80. Robertson, S. E. (1994). Computer retrieval. In B. C. Vickery (Ed.), Fifty years of information progress (pp. 119-146). London: Aslib.
81. Robertson, S. E., & Hancock-Beaulieu, M. M. (1992). On the evaluation of IR systems. Information Processing and Management, 28, 457-466.
82. Robertson, S. E., & Sparck Jones, K. (1976). Relevance weighting of search terms. Journal of the American Society for Information Science, 27, 129-146.
83. Saracevic, T. (1987). Changing agenda for information retrieval: Editorial. Information Processing and Management, 23, i-ii.
84. Schamber, L. (1994). Relevance and information behavior. In M. E. Williams (Ed.), Annual Review of Information Science and Technology, Volume 29, (pp. 3-48). Medford, NJ: Learned Information.
85. Schamber, L., Eisenberg, M. B., & Nilan, M. S. (1990). A re-examination of relevance: Toward a dynamic situational definition. Information Processing and Management, 26, 755-776.
86. Sharp, J. R. (1982). [Review of the book Information retrieval experiment]. Journal of Documentation, 38, 238-240.
87. Sparck Jones, K. (1979a). Experiments in relevance weighting of search terms. Information Processing and Management, 15, 133-144.
88. Sparck Jones, K. (1979b). Search term relevance weighting given little relevance information. Journal of Documentation, 35, 30-48.
89. Sparck Jones, K. (1981a). The Cranfield tests. In K. Sparck Jones (Ed.), Information Retrieval Experiment (pp. 256-284). London: Butterworths.
90. Sparck Jones, K. (1981b). Retrieval system tests. 1958-1978. In K. Sparck Jones (Ed.), Information Retrieval Experiment (pp. 213-255). London: Butterworths.
91. Sparck Jones, K., & Van Rijsbergen, C. J. (1975). Report on the need for and provision of an 'ideal' test collection. British Library Research and Development Report 5266. University of Cambridge: Computer Laboratory.
92. Sutton, S. A. (1994). The role of attorney mental models of law in case relevance determination: An exploratory analysis. Journal of the American Society for Information Science, 45, 186-200.
93. Swanson, D. R. (1986). Subjective versus objective relevance in bibliographic retrieval systems. Library Quarterly, 56, 389-398.
94. Thorne, R. G. (1955). The efficiency of subject catalogues and the cost of information searches. Journal of Documentation, 11, 130-148.
95. Van Rijsbergen, C. J. (1979). Information retrieval. 2nd ed. London: Butterworths.
96. Van Rijsbergen, C. J. (1981). Retrieval effectiveness. In K. Sparck Jones (Ed.), Information Retrieval Experiment (pp. 3-43). London: Butterworths.
97. Waterworth, J. A., & Chignell, M. H.(1989). A model for information exploration. Hypermedia, 3, 35-58.
98. Westbrook, L. (1993). User-needs: A synthesis and analysis of current theories for the practitioner. RQ, 32, 541-549.
99. Wilkins, L. T. (1964). Social deviance. London: Tavistock Publications.
100. Wilson, T. D. (1981). On user studies and information needs. Journal of Documentation, 37, 3-15.
101. Wilson, T. D. (1994). Information needs and uses: Fifty years of progress? In B. C. Vickery (Ed.), Fifty years of information progress (pp. 15-51). London: Aslib.
102. Wittgenstein, L. (1967). Zettel. Oxford: Blackwell.