Reflections on Mira: interactive evaluation in information retrieval

Journal of the American Society for Information Science and Technology

Volumn 51, Issue 14, 2000, Pages 1269-1274

  Dunlop, Mark ^a  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN COMPUTER INTERACTION; INFORMATION TECHNOLOGY; INTERACTIVE COMPUTER SYSTEMS; MULTIMEDIA SYSTEMS; SEARCH ENGINES; SOCIETIES AND INSTITUTIONS;

INTERACTIVE EVALUATION; MULTIMEDIA INFORMATION;

INFORMATION RETRIEVAL SYSTEMS;

EID: 0034505724     PISSN: 15322822     EISSN: None     Source Type: Journal    
DOI: 10.1002/1097-4571(2000)9999:9999<::AID-ASI1042>3.0.CO;2-7     Document Type: Article

References (19)

1. Amati, G., & Crestani, F. (in press). Probabilistic learning by uncertainty sampling with non-binary relevance. In F. Crestani & G. Pasi (Eds.), Soft computing in information retrieval: Techniques and applications. Heidelberg: Physica Verlag.
2. Borlund, P. (2000). Experimental components for the evaluation of interactive information retrieval systems. Journal of Documentation, 56(1), 71-90.
3. Buckley, C., Mitra, M., Walz, J., & Cardie, C. (1998). Using clustering and superconcepts within SMART: TREC-6. In E. Voorhees, & D. Harman (Eds.), Proceedings of the sixth text retrieval conference (TREC-6) (pp. 107-124), NIST Special Publication 500-240.
4. Campbell, I. (2000). Interactive evaluation of the ostensive model using a new test collection of images with multiple relevance assessments. Information Retrieval, 2(1), 89-116.
5. Denos, N., & Berti, L. (1998). Document quality criteria for collaborative IR, slides from presentation at Mira Dublin, www.des.gla.ac.uk/mira/workshops/dublin/.
6. Draper, S.W., & Dunlop, M.D. (1997). New IR - new evaluation: The impact of interactive multimedia on information retrieval and its evaluation. The New Review of Hypermedia and Multimedia, 3, 107-122.
7. Draper, S.W., Dunlop, M.D., Ruthven, I., & Van Rijsbergen, C.J. (Eds.). (1999). Proceedings of Mira 99: Evaluating interactive information retrieval (Glasgow), published in Electronic Workshops in Computing.
8. Dunlop, M.D. (1997). Time relevance and interaction modelling for information retrieval. Proceedings of SIGIR-97, Philadelphia, USA, pp. 206-213. New York: ACM Press.
9. Dunlop, M.D. (Ed.). (1996). Proceedings of the second Mira workshop (Monselice, Italy). University of Glasgow Computing Science Research Report TR-1997-2, www.dcs.gla.ac.uk/mira/workshops/padua_procs/
10. Fidel, R., & Crandall, M. (1997). Users' perception of the performance of a filtering system. Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval, Philadelphia, USA, pp. 198-205.
11. Golovchinsky, G. (1997). What the query told the link: The integration of hypertext and information retrieval, Proceedings of Hypertext '97 (Southampton, UK). New York: ACM Press, pp. 67-74.
12. Green, T.R.G., & Petre, M. (1996). Usability analysis of visual programming environments: A "cognitive dimensions" framework. Journal of Visual Languages and Computing, 7, 131-174.
13. Harman, D. (1992). Evaluation issues in information retrieval. Information Processing and Management, 28(4), 439-440.
14. Harper, D.J. (1997). Information retrieval evaluation: Lifebelt, security blanket or straitjacket? abstract in Smeaton, A.F., Report on Schloss-Dagsluhl meeting on "evaluation of multimedia information retrieval", www.dcs.gla.ac.uk/mira/workshops/dagstuhl/.
15. Harper, D.J., & Hendry, D. (1996). Evaluation light, Section 4.2 of Dunlop, M.D. (Ed.). Proceedings of the second Mira workshop (Monselice, Italy). University of Glasgow Computing Science Research Report TR-1997-2, www.dcs.gla.ac.uk/mira/workshops/padua_procs.
16. Jose, J.M., Furner, J., & Harper, D.J. (1998). Spatial querying for image retrieval: A user-oriented evaluation, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, Melbourne Australia, pp 232-240. ACM Press.
17. Lagergren, E., & Over, P. (1998). Comparing interactive information retrieval systems across sites: The TREC-6 interactive track matrix experiment. Proceedings of SIGIR 98, Melbourne Australia, pp. 164-172. New York: ACM Press.
18. Macaulay, C., Benyon, D., & Crerar, C. (2000). Ethnography, theory and design: "Uncovering" new artefacts. International Journal of Human-Computer Studies.
19. Martfnez, J.M. (1999). Overview of the MPEG-7 Standard ISO/IEC JTC1/SC29/WG11 N3158 report, http://www.cselt.it/mpeg/standards/mpeg-7/mpeg-7.htm.