Metadata harvesting for content-based distributed information retrieval

Journal of the American Society for Information Science and Technology

Volumn 59, Issue 1, 2008, Pages 12-24

  Simeoni, Fabio ^a   Yakici, Murat ^a   Neely, Steve ^b   Crestani, Fabio ^c  

^a UNIVERSITY OF STRATHCLYDE   (United Kingdom)

^b UNIVERSITY COLLEGE DUBLIN   (Ireland)

^c UNIVERSITY OF LUGANO   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

DATA STRUCTURES; DISTRIBUTED DATABASE SYSTEMS; METADATA; NETWORK PROTOCOLS; RESOURCE ALLOCATION;

CENTRALIZED RETRIEVAL; DISTRIBUTED RETRIEVAL; FULL-CONTENT INDICES; LARGE-SCALE RESOURCE POOLING; OPEN ARCHIVE INITIATIVE'S (OAI) PROTOCOLS;

INFORMATION RETRIEVAL;

EID: 38549170965     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.20694     Document Type: Article

References (43)

1. Anan, H., Liu, X., Maly, K., Nelson, M., Zubair, M., French, J.C., Fox, E., & Shivakumar, P. (2002). Preservation and transition of NCSTRAL using an OAI-based architecture. In Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries (pp. 181-182). New York: ACM Press.
2. Bailey, C.W. (2005). Open access bibliography: Liberating scholarly literature with e-prints and open access journals. Association of Research Libraries (ARL): Washington, USA
3. Bowman, C.M., Danzig, P.B., Hardy, D.R., Manber, U., & Schwartz, M.F. (1995). The Harvest information discovery and access system. Computer Networks and ISDN Systems, 28(1-2), 119-125.
4. Callan, J. (2000a). Advances in Information Retrieval, chapter Distributed Information Retrieval (pp. 127-150). London, Kluwer.
5. Callan, J. (2000b). Distributed IR testbed definition: trec123-100bysourcecallan99. v2a. Technical Rep. Carnegie Mellon University, Language Technologies Institute.
6. Callan, J., Crestani, F., Nottelmann, H., Pala, P., & Shou, X.M. (2003). Resource selection and data fusion in multimedia distributed digital libraries. In Proceedings of the 26th annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 363-364). New York: ACM Press.
7. Callan, J., Fuhr, N., & Nejdi, W. (Eds.). (2004a, July). Proceedings of the SIGIR Workshop on Peer-to-Peer Information Retrieval, 27th annual International ACM SIGIR Conference, Sheffield, United Kingdom.
8. Callan, J.P., & Connell, M.E. (2001). Query-based sampling of text database. Information Systems, 19(2), 97-130.
9. Callan, J.P., Crestani, F., & Sanderson, M. (Eds.). (2004b, August). Distributed Multimedia Information Retrieval, SIGIR 2003 Workshop on Distributed Information Retrieval, Toronto, Canada, Revised Selected and Invited Paper. Vol. 2924 of Lecture Notes in Computer Science. SpringerVerlag: Germany.
10. Carmel, D., Cohen, D., Fagin, R., Farchi, E., Herscovici, M., Maarek, Y.S., & Soffer, A. (2001). Static index pruning for information retrieval systems. In Proceedings of the 24th annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 43-50), New York: ACM Press.
11. Chou, C.-C., Kuo, P.-X., Ho, J.-M., & Lee, D. (2003). Union catalog using extended oai-pmh. Public Draft, http://www.iis.sinica.edu.tw/~ccchou/ publications/oai.pdf.
12. Craswell, N.E. (2000). Methods for Distributed Information Retrieval. Unpublished doctoral dissertation, Australian National University.
13. Crow, R. (2002). The case for institutional repositories: A SPARC position paper. SPARC, The Scholarly Publishing and Academic Resources Coalition: Washington, USA. Available at http://www.arl.org/sparc/~doc/ ir_final_release_102.pdf
14. DCMI. (2004). The Dublin Core Metadata Initiative, Dublin core metadata element set. Version 1.1: Reference description. Public Draft. Available at http://dublincore.org/documents/2004/12/20/dces/.
15. de Sompel, H.V., Nelson, M.L., Lagoze, C., & Warner, S. (2004). Resource harvesting within the oai-pmh framework. D-Lib Magazine, 10(12).
16. de Sompel, H.V., Young, J.A., & Hickey, T.B. (2003). Using the oai-pmh . . . differently. D-Lib Magazine, 9(7/8).
17. Dijk, E. (2004). Sharing grey literature by using OA-x. Public Draft. Grey Journal, 1(2), 83-90. Available at http://www.greynet.org/images/GL6. Page_16.pdf
18. French, J.C, Powell, A.L., Callan, J., Viles, C.L., Emmitt, T., Prey, K.J., & Mou, Y. (1999). Comparing the performance of database selection algorithms. In Proceedings of the 22nd annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 238-245). New York: ACM Press.
19. Gatenby, J. (2002). Aiming at quality and combined: Blending physical and virtual union catalogues. Online Information Review, 26(5), 326-334.
20. Gravano, L., Chang, C.-C.K., Garcia-Molina, H., & Paepcke, A. (1997). STARTS: Stanford proposal for internet meta-searching. In Proceedings of the 1997 ACM SIGMOD International Conference on Management of Data (pp. 207-218). New York: ACM Press.
21. Joint Information Systems Committee. (2001). Information environment: Development strategy 2001-2005. Public Draft. Available at http://www.jisc.ac. uk/media/documents/themes/infoenvironment/ie_s trategy.pdf.
22. Lagoze, C., Arms, W., Gan, S., Hillmann, D., Ingram, C., Krafft, D., Marisa, R., Phipps, J., Saylor, J., Terrizzi, C., Hoehn, W., Millman, D., Allan, J., Guzman-Lara, S., & Kalt, T. (2002a). Core services in the architecture of the national science digital library (nsdl). In Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries (pp. 201-209). New York: ACM Press.
23. Lagoze, C., & de Sompel, H.V. (2001). The open archives initiative: Building a low-barrier interoperability framework. In Proceedings of the 1st ACM/IEEE-CS Joint Conference on Digital Libraries (pp. 54-62). New York: ACM Press.
24. Lagoze, C., de Sompel, H.V., Nelson, M., & Warner, S. (2002b). The open archives initiative protocol for metadata harvesting (2.0). Public Draft. Available at http://www.openarchives.Org/OAI/2.0/openarchivesprotocol.htm.
25. Larson, R.R. (2003, August). Distributed IR for digital libraries. In Research and Advanced Technology for Digital Libraries, Proceedings of the 7th European Conference, Trondheim, Norway (pp. 487-498).
26. Liu, X., Maly, K., Zubair, M., & Nelson, M.L. (2002). Dp9: an oai gateway service for web crawlers. In Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries (pp. 283-284). New York: ACM Press.
27. Lu, J., & Callan, J. (2002). Pruning long documents for distributed information retrieval. In Proceedings of the 11th International Conference on Information and Knowledge Management (pp. 332-339). New York: ACM Press.
28. Lu, J., & Callan, J. (2003). Content-based retrieval in hybrid peer-to-peer networks. In Proceedings of the 12th International Conference on Information and Knowledge Management (pp. 199-206). New York: ACM Press.
29. Lu, J., & Callan, J. (2006). Full-text federated search of text-based digital libraries in peer-to-peer networks. Information Retrieval, In ECIR, 9(4), (pp. 477-498), Kluwer Academic Publishers: Hingham, MA, USA.
30. Lynch, C.A. (1997). Building the infrastructure of resource sharing: Union catalogs, distributed search, and cross-database linkage. Library Trends, 45(3).
31. Nelson, M.L., de Sompel, H.V., Liu, X., Harrison, T.L., & McFarland, N. (2005). mod_oai: An apache module for metadata harvesting. Public Draft. Available at http://arxiv.org/abs/cs.DL/0503069.
32. Nottelmann, H., & Fuhr, N. (2003). The mind architecture for heterogeneous multimedia federated digital libraries. Recent research in multimedia distributed information retrieval. Proceedings of the ACM SIGIR 2003. Workshop on Distributed Information Retrieval (Lecture Notes in Computer Science, 2924) (pp. 112-125). Springer: Germany.
33. Paepcke, A., Brandriff, R., Janee, G., & Larson, R. (2003). Search middleware and the simple digital library interoperability protocol. D-Lib Magazine, 6(3).
34. Sanderson, R. (2003). Srw: Search/retrieve webservice. Public Draft. Available at http://www.loc.gov/standards/sru/srul-larchive/srw.html.
35. Simeoni, F. (2005). Servicing the federation: the case for metadata harvesting. Lecture Notes in Computer Science (LNCS), 3232/2004. pp. 389-399.
36. Simon, B., Massart, D., Assche, F.V., Ternier, S., & Duval, E. (2003). Simple query interface specifications. Public Draft.
37. Simons, G., & Bird, S. (2003). The open language archives community: An infrastructure for distributed archiving of language resources. Literary and Linguistic Computing 18, 2003, pp. 117-128. Oxford University Press: UK
38. Suleman, H., & Fox, E.A. (2002). Designing protocols in support of digital library componentization. In Proceedings of the 6th European Conference on Research and Advanced Technology for Digital Libraries (pp. 568-582). London: Springer-Verlag.
39. van der Kuil, A., & Feijen, M. (2004). The dawning of the Dutch Network of Digital Academic Repositories (DARE): A shared experience. Ariadne Magazine, 41.
40. Warner, S., Bekaert, J., Lagoze, C., Liu, X., Payette, S., & Van de Sompel, H. (2006). Pathways: Augmenting interoperability across scholarly repositories. International Journal on Digital Libraries. Currently available in online form at http://www.citebase.org/abstract?id=oai:ar_Xiv.org.cs/0610031
41. Witten, I.H., Moffat, A., & Bell, T.C. (1999). Managing gigabytes: Compressing and indexing documents and images (2nd ed.). San Francisco: Kaufmann.
42. Yang, B., & Garcia-Molina, H. (2001). Comparing hybrid peer-to-peer systems. In Proceedings of the 27th International Conference on Very Large Data Bases (pp. 561-570). San Francisco: Kaufmann.
43. Z39.50 Maintenance Agency. (2003). Information retrieval (z39.50): Application service definition and protocol specification. Retrived from http:// www.loc.gov/z3950/agency/profiles/profiles.html.