Towards an infrastructure for digital library performance evaluation

Evaluation of Digital Libraries: An Insight Into Useful Applications and Methods

Volumn , Issue , 2009, Pages 93-120

  Agosti, Maristella ^a   Ferro, Nicola ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

BIOMEDICAL ENGINEERING;

DIGITAL LIBRARIES;

EID: 84903510976     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-1-84334-484-1.50006-5     Document Type: Chapter

References (28)

1. Abiteboul S., Agrawal R., Bernstein P.A., Carey M.J., Ceri S., Croft W.B., DeWitt D.J., Franklin M.J., Garcia-Molina H., Gawlick D., Gray J., Haas L.M., Halevy A.Y., Hellerstein J.M., Ioannidis Y.E., Kersten M.L., Pazzani M.J., Lesk M., Maier D., Naughton J.F., Schek H.-J., Sellis T.K., Silberschatz A., Stonebraker M., Snodgrass R.T., Ullman J.D., Weikum G., Widom J., Zdonik S.B. The Lowell Database research self-assessment. Communications of the ACM 2005, 48(5):111-118.
2. Ackoff R.L. From data to wisdom. Journal of Applied Systems Analysis 1989, 16:3-9.
3. Agosti M. Log data in digital libraries. Post-proceedings of the 4th Italian Research Conference on Digital Library Systems 2008, 115-122. Pisa, ISTI-CNR at Gruppo ALI, Padua, 24-25 January.
4. Agosti M., Di Nunzio G.M., Ferro N. A proposal to extend and enrich the scientific data curation of evaluation campaigns. in Proceedings of the 1st International Workshop on Evaluating Information Access 2007, 62-73. National Institute of Informatics, Tokyo, Tokyo, 15 May.
5. Agosti M., Di Nunzio G.M., Ferro N. Scientific data of an evaluation campaign: Do we properly deal with them?. In Evaluation of Multilingual and Multi-modal Information Retrieval: 7th Workshop of the Cross-Language Evaluation Forum 2007, 11-20. Springer-Verlag, Berlin, Germany, 4730 Budapest, September, LNCS.
6. Agosti M., Ferro N., Fox E.A., Gonçalves M.A. Modelling DL quality - a comparison between approaches: The DELOS Reference Model and the 5S model. paper presented at the Second DELOS Conference on Digital Libraries 2007, 5-7. Tirrenia, Pisa, December, available at:. http://www.delos.info/index.php?option=com_content&task=view&id=602&Itemid=334.
7. Anderson W.L. Some challenges and issues in managing, and preserving access to long-lived collections of digital scientific and technical data. Data Science Journal 2004, 3:191-202.
8. Brase J. Using digital library techniques: Registration of scientific primary data. Proceedings of the 8th European Conference on Digital Libraries 2004, 3232:488-494. Springer-Verlag, Berlin, Bath, September, LNCS.
9. Cleverdon C.W. The Cranfield tests on index languages device. Readings in Information Retrieval 1997, 47-60. Morgan Kaufmann, San Francisco, CA. K. Spärck Jones, P. Willet (Eds.).
10. Croft W.B. Combining approaches to information retrieval. Advances in Information Retrieval: Recent Research from the Center for Intelligent Information Retrieval 2000, 1-36. Kluwer, Norwell, MA. W.B. Croft (Ed.).
11. Di Nunzio G.M., Ferro N., Jones G.J., Peters C. CLEF 2005: Ad hoc track overview. Evaluation of Multilingual and Multi-modal Information Retrieval: 6th Workshop of the Cross- Language Evaluation Forum 2006, 11-36. Springer-Verlag, Berlin, 4022 Alicante, 17-22 September, LNCS.
12. Dussin M., Ferro N. Design of the user interface of a scientific digital library system for large-scale evaluation campaigns 2007, 5-7. available at:, Tirrenia, Pisa, December, (accessed 15 April 2009). http://www.delos.info/index.php?option=com_content&task=view&id=602&Itemid=334.
13. Dussin M., Ferro N. The design of the user interface of a scientific DLS in the context of the data, information, knowledge and wisdom hierarchy 2008, 105-113. Padua, 24-25 January, ISTICNR at Gruppo ALI: Pisa.
14. Dussin M., Ferro N. Design of a digital library system for large-scale evaluation campaigns 2008, 400-401. Springer-Verlag, Berlin, 5173, Aarhus, 14-19 September, LNCS.
15. Führ N., Hansen P., Micsik A., Sølvberg I. Digital libraries: A generic classification scheme 2001, 187-199. Springer-Verlag, Berlin, 2163, Darmstadt, 4-9 September, LNCS.
16. Führ N., Tsakonas G., Aalberg T., Agosti M., Hansen P., Kapidakis S., Klas C.-P., Kovács L., Landoni M., Micsik A., Papatheodorou C., Peters C., Sølvberg I. Evaluation of digital libraries. International Journal on Digital Libraries 2007, 8(1):21-38.
17. Collins Dictionary of the English Language 1979, William Collins Sons and Co, Glasgow. P. Hanks (Ed.).
18. Harman D., Buckley C. SIGIR 2004 Workshop: RIA and "Where can IR go from here?". ACM SIGIR Forum 2004, 38(2):45-49.
19. Hull D.A. Using statistical testing in the evaluation of retrieval experiments 1993, 329-338. ACM Press, New York, Pittsburgh, PA, 27 June to 1 July.
20. Ioannidis Y.E., Maier D., Abiteboul S., Buneman P., Davidson S.B., Fox E.A., Halevy A.Y., Knoblock C.A., Rabitti F., Schek H.-J., Weikum G. Digital library information-technology infrastructures. International Journal on Digital Libraries 2005, 5(4):266-274.
21. Krasner G.E., Pope S.T. A cookbook for using the modelview- controller user interface paradigm in Smalltalk-80. Journal of Object-Oriented Programming 1988, 1(3):26-49.
22. Lord P., MacDonald A. e-Science Curation Report: Data curation for e-Science in the UK - an audit to establish requirements for future curation and provision available at:, (accessed 25 November 2008). http://www.jisc.ac.uk/uploaded_documents/e-ScienceReportFinal.pdf.
23. Long-lived digital data collections: Enabling research and education in the 21st century National Science Board, available at:, (accessed 25 November 2008). http://www.nsf.gov/pubs/2005/nsb0540/.
24. Paskin N. Digital object identifiers for scientific data. Data Science Journal 2005, 4:12-20.
25. Paskin N. The DOI Handbook - Edition 4.4.1 2006, available at:, (accessed 25 November 2008). http://www.dx.doi.org/10.1000/186.
26. Tsichritzis D.C., Lochovsky F.H. Data Models 1982, Prentice Hall, Englewood Cliffs, NJ.
27. Zeleny M. Management support systems: Towards integrated knowledge management. Human Systems Management 1987, 7(1):59-70.
28. Zobel J. How reliable are the results of large-scale information retrieval experiments 1998, 307-314. ACM Press, New York, Melbourne, 24-28 August.