The D-NET software toolkit: A framework for the realization, maintenance,and operation of aggregative infrastructures

Program

Volumn 48, Issue 4, 2014, Pages 322-354

  Manghi, Paolo ^a   Artini, Michele ^a   Atzori, Claudio ^a   Bardi, Alessia ^a   Mannocci, Andrea ^a   Bruzzo, Sandro La ^a   Candela, Leonardo ^a   Castelli, Donatella ^a   Pagano, Pasquale ^a  

^a ISTI CNR   (Italy)

Author keywords

Aggregation; D NET; Data; Infrastructures; Metadata; Service oriented

Indexed keywords

EID: 84921884540     PISSN: 00330337     EISSN: None     Source Type: Journal    
DOI: 10.1108/PROG-08-2013-0045     Document Type: Article

References (76)

1. Aloia, N., Concordia, C. and Meghini, C. (2011), “Europeana v1.0”, in Maristella, A., Floriana, E., Carlo, M. and Nicola, O. (Eds), Digital Libraries and Archives-7th Italian Research Conference, IRCDL 2011, Pisa, January 20-21, revised papers, Vol. 249, Communications in Computer and Information Science, Springer Verlag, Berlin and Heidelberg, pp. 127-129, available at: http://dx.doi.org/10.1007/978-3-642-27302-5 16
2. Artini, M., Bardi, A., Biagini, F., Debole, F., La Bruzzo, S., Manghi, P., Mikulicic, M., Savino, P. and Zoppi, F. (2012), “Data interoperability and curation: the European film gateway experience”, in Maristella A., Floriana E., Stefano F. and Nicola F., (Eds), Digital Libraries and Archives 8th Italian Research Conference, IRCDL, revised selected papers, Vol. 354, February 9-10, Communications in Computer and Information Science, Springer, Bari, pp. 33-44.
3. Artini, M., Biagini, F., Manghi, P. and Mikulicic, M. (2008), “OAI-Publishers in repository infrastructures”, Post-Proceedings of the Forth Italian Research Conference on Digital Library Systems (IRCDL), DELOS, An Association for Digital Libraries, Padua, January, pp. 93-98.
4. Bardi, A., Manghi, P. and Zoppi, F. (2012), “Aggregative data infrastructures for the cultural heritage”, in Dodero, J.M., Palomo-Duarte, M. and Karampiperis, P. (Eds), 6th Research Conference, MTSR 2012, Cádiz, Proceedings, Vol. 343, November 28-30, Communications in Computer and Information Science, Springer Verlag, Berlin and Heidelberg, pp. 239-251.
5. Bizer, C., Heath, T. and Berners-Lee, T. (2009), “Linked data-the story so far”, International Journal on Semantic Web & Information Systems, Vol. 5 No. 3, pp. 1-22.
6. Boulton, G., Campbell, P., Collins, B., Elias, P., Wendy Hall, D., Laurie, G., O’Neill, O., Rawlins, M., Thornton, D.J., Vallance, P. and Walport, M. (2012), “Science as an open enterprise”, final report, The Royal Society, June.
7. Callaghan, S., Donegan, S., Pepler, S., Thorley, M., Cunningham, N., Kirsch, P., Ault, L., Bell, P., Bowie, R., Leadbetter, A., Lowry, R., Moncoiffé, G., Harrison, K., Smith-Haddon, B., Weatherby, A. and Wright, D. (2012), “Making data a first class scientific output: data citation and publication by Nerc’s environmental data centres”, International Journal of Digital Curation, Vol. 7 No. 1, pp. 107-113.
8. Candela, L., Castelli, D., Manghi, P. and Pagano, P. (2007), “Enabling services in knowledge infrastructures: the DRIVER experience”, Post-Proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL), DELOS, A Network of Excellence on Digital Libraries, Padua, January, pp. 71-77.
9. Candela, L., Castelli, D., Manghi, P. and Pagano, P. (2013a), “Recent developments in the design, construction, and evaluation of digital libraries: case studies”, in Cool, C. and Ng, K.B. (Eds), IGI Global, January, pp. 1-275, doi:10.4018/978-1-4666-2991-2.ch001.
10. Candela, L., Castelli, D., Manghi, P. and Pagano, P. (2013b), “Infrastructure-based research digital libraries”, in Cool, C. and Ng, K.B. (Eds), Recent Developments in the Design, Construction, and Evaluation of Digital Libraries: Case Studies, IGI Global, Hershey, PA, Chapter 1, pp. 1-17.
11. Castelli, D., Manghi, P. and Thanos, C. (2013), “A vision towards scientific communication infrastructures”, International Journal on Digital Libraries, Vol. 13 Nos 3/4, pp. 155-169, available at: http://dx.doi.org/10.1007/s00799-013-0106-7 (accessed July 14, 2013).
12. Chodorow, K. and Dirolf, M. (2010), MongoDB: The Definitive Guide, O’Reilly Media, Sebastopol, CA. Clarin, “Common language resources and technology infrastructure”, available at: www.clarin.eu (accessed June 25, 2014).
13. Consultative Committee for Space Data Systems (2002), “Reference model for an open archival information system”, Technical Report No. CCSDS 650.0-B-1, National Aeronautics and Space Administration, Blue Book, January.
14. Dekkers, M. and Weibel, S. (2003), “State of the Dublin core metadata initiative”, D-Lib Magazine, Vol. 9 No. 4, April, available at: www.dlib.org/dlib/april03/weibel/ 04weibel.html
15. de Walle, R.V. and Koenen, R. (2006), The MPEG-21 Book, Wiley, New York, NY.
16. Diepenbroek, D., Grobe, H., Reinke, M., Schindler, U., Schlitzer, R., Sieger, R. and Wefer, G. (2002), “PANGAEA-an information system for environmental sciences”, Computers & Geosciences Journal, Vol. 28 No. 10, pp. 1201-1210.
17. Driver. ‘Digital repository infrastructure vision for European research”, available at: www. driver-community.eu (accessed June 25, 2014).
18. Duval, E., Verbert, K. and Klerkx, J. (2011), “Towards an open learning infrastructure for open educational resources: abundance as a platform for innovation”, in Cloude, G., Rozenberg, G. and Salomaa, A. (Eds), Rainbow of Computer Science, Lecture Notes in Computer Science, Springer, Berlin and Heidelberg, pp. 144-156.
19. European Committee for Standardization (2010), “En 15907 film identification-enhancing interoperability of metadata-element sets and structures”, European Standard ICS, 35.240.30; 97.195, European Committee for Standardization, available at: http:// filmstandards.org/media/EN_15907_English.pdf
20. Feijen, M., Horstmann, W., Manghi, P., Robinson, M. and Russell, R. (2007), “DRIVER: building the network for accessing digital repositories across Europe”, Ariadne, Vol. 53 No. 53, ISSN 1361-3200.
21. Furrie, B. (2003), “Understanding MARC bibliographic: machine-readable cataloging”, Cataloging Distribution Service, Library of Congress, in collaboration with the Follett Software Company, available at: www.loc.gov/marc/umb/Fundaci_on
22. Española para la Ciencia y la Tecnologıá, “RECOLECTA or recolector de ciencia abierta: national repository aggregator of Spain”, available at: http://recolecta.fecyt.es (accessed June 25, 2014).
23. Graham, S., Hull, D. and Murray, B. (2006), “Web services base Notification 1.3 (WS-Basenotification)”, Oasis standard, OASIS, October.
24. Gudgin, M., Hadley, M. and Rogers, T. (2006), “Web services addressing 1.0-core”, W3C Recommendation, May.
25. Gudgin, M., Hadley, M., Mendelsohn, N., Moreau, J.-J., Nielsen, H.F., Karmarkar, A. and Lafon, Y. (2007), “Soap version 1.2 part 1: messaging framework”, 2nd ed., technical report, W3C, April.
26. Hapgood, M., Belehaki, A. and Manola, N. (2012), “Forecasting the future of near-earth space”, International Innovation Journal, September, pp. 67-69.
27. Haslhofer, B. and Klas, W. (2010), “A survey of techniques for achieving metadata interoperability”, ACM Computing Surveys, Vol. 42 No. 2, pp. 1-37.
28. Heritage of the People’s Europe (2010), “Jane Hunter and Anna Gerber. Harvesting community annotations on 3D models of museum artefacts to enhance knowledge, discovery and re-use”, Journal of Cultural Heritage, Vol. 11 No. 1, pp. 81-90, available at: www.peoplesheritage.eu
29. Iatropoulou, K., Lebesis, A., Manghi, P., Manola, N. and Mikulicic, M. (2010), “On constructing repository infrastructures-the D-NET software toolkit”, Proceedings of the Fifth International Conference on Open Repositories, Madrid, July.
30. ICM, “Ceon Poland repository aggregator”, available at: http://agregator.ceon.pl/ (accessed June 15, 2014).
31. ICOM International Committee for Documentation (2010), “Lightweight information describing objects”, November, available at: http://network.icom.museum/cidoc/working-groups/ data-harvesting-and-interchange/lido-technical/specification/ (accessed June 15, 2014).
32. Jackson, A.S., Han, M.-J., Groetsch, K., Mustafo, M. and Timothy, W.C. (2008), “Dublin core metadata harvested through OAI-PMH”, Journal of Library Metadata, Vol. 8 No. 1, pp. 5-21.
33. Johansson, A. and Ottosson, M.O. (2012), “A national current research information system for Sweden”, in Keith, G.J. and Jane, D. (Eds), E-Infrastructures for Research and Innovation: Linking Information Systems to Improve Scientific Knowledge Production, Action M, Agentura, pp. 67-71.
34. Khetrapal, A. and Ganesh, V. (2006), “Hbase and hypertable for large scale distributed storage systems a performance evaluation for open source bigtable implementations”, Evaluation, Dept. of Computer Science, 8pp, available at: http://cloud.pubs.dbs.uni-leipzig.de/ sites/cloud.pubs.dbs.uni-leipzig.de/files/Khetrapal2008HBaseandHypertableforlargescale distributedstorage.pdf
35. Knoth, P. and Zdrahal, Z. (2012), “Core: three access levels to underpin open access”, D-Lib Magazine, Vol. 18 Nos 11/12, available at: http://oro.open.ac.uk/35755/
36. Kollia, I., Tzouvaras, V., Drosopoulos, N. and Stamou, G. (2012), “A systemic approach for effective semantic access to cultural content”, Semantic Web, Vol. 3 No. 1, pp. 65-83, available at: http://dx.doi.org/10 3233/SW-2012-0051
37. La Bruzzo, S., Manghi, P. and Bardi, A. (2013), “OAIzer: configurable OAI exports over relational databases”, in Emmanouel, G. and Jane, G. (Eds), Metadata and Semantics Research, Communications in Computer and Information Science, Springer, Berlin and Heidelberg, pp. 35-47.
38. Lagoze, C. and Van de Sompel, H. (2007), “Interoperability for the discovery, use, and re-use of units of scholarly communication”, CTWatch Quarterly, Vol. 3 No. 3, pp. 32-41.
39. Lagoze, C., Payette, S., Shin, E. and Wilper, C. (2005), “Fedora: an architecture for complex objects and their relationships”, Journal of Digital Libraries, Special Issue on Complex Objects, Vol. 6 No. 2, pp. 124-138.
40. Lakshman, A. and Malik, P. (2010), “Cassandra: a decentralized structured storage system”, SIGOPS Oper. Syst. Rev., Vol. 44 No. 2, pp. 35-40.
41. Library of Congress (2002), “Encoded archival description”, available at: www.loc.gov/ead/ (accessed June 25, 2014).
42. Library of Congress (2005), “MARC standards web page”, available at: www.loc.gov/marc/ (accessed June 25, 2014).
43. Library of Congress, “CQL: contextual query language (SRU version 1.2 specifications)”, available at: www.loc.gov/standards/sru/specs/cql.html (accessed June 25, 2014).
44. Linked Data Community, “Linked data-connect distributed data across the web”, available at: http://linkeddata.org/home (accessed June 25, 2014).
45. Loebbecke, C. and Thaller, M. (2011), “Digitization as an IT response to the preservation of Europe’s cultural heritage”, in Carugati, A. and Rossignoli, C. (Eds), Emerging Themes in Information Systems and Organization Studies, Physica-Verlag, Heidelberg, pp. 359-372.
46. Lomow, G. and Newcomer, E. (2005), “Understanding SOA with web services”, Independent Technology Guides, ISBN-13: 978-0321180865, ISBN-10: 0321180860, Addison Wesley Professional, Boston.
47. Lynch, C.A. (2003), “Institutional repositories: essential infrastructure for scholarship in the digital age”, portal: Libraries and the Academy, Vol. 3 No. 2, pp. 327-336.
48. MacKenzie, M.C., Laskey, K., McCabe, F., Brown, P. and Metz, R. (2006), “Reference model for service oriented architecture 1.0”, technical report, Public Review Draft 1.0 OASIS, February.
49. Manghi, P., Bolikowski, L., Manola, N., Shirrwagen, J. and Smith, T. (2012a), “Openaireplus: the European scholarly communication data infrastructure”, D-Lib Magazine, Vol. 18, September-October, pp. 9-10, available at: http://puma.isti.cnr.it/dfdownloadnew. php?ident=/cnr.isti/2010-A2-032&langver=en&scelta=NewMetadata
50. Manghi, P., Candela, L. and Pagano, P. (2010a), “Interoperability patterns in digital library systems federations”, Proceedings of the Second DL.org Workshop on Making Digital Libraries Interoperable: Challenges and Approaches, in Conjunction With ECDL 2010, ISTICNR, Glasgow, September.
51. Manghi, P., Houssos, N., Mikulicic, M. and Joerg, B. (2012b), “The data model of the openaire scientific communication e-infrastructure”, in Dodero, J.M., Duarte, M.P. and Karampiperis, P. (Eds), Metadata and Semantics Research, Communications in Computer and Information Science (ISBN 978-3-64235232-4), Springer, Berlin and Heidelberg, pp. 168-180, available at: http://dx.doi.org/10.1007/978-3-642-35233-1_18
52. Manghi, P., Mikulicic, M. and Atzori, C. (2012c), “De-duplication of aggregation authority files”, Int. J. of Metadata, Semantics and Ontologies, Vol. 7 No. 2, pp. 114-130.
53. Manghi, P., Mikulicic, M., Candela, L., Artini, M. and Bardi, A. (2010b), “General-purpose digital library content laboratory systems”, Proceedings of the 14th European Conference on Digital Libraries, Glasgow, September.
54. Manghi, P., Mikulicic, M., Candela, L., Castelli, D. and Pagano, P. (2010c), “Realizing and maintaining aggregative digital library systems: D-NET software toolkit and Oaister system”, D-Lib Magazine (ISSN 1082-9873), Vol. 16 Nos 3/4, March/April, doi:10.1045/ march2010-manghi, available at: http://puma.isti.cnr.it/dfdownloadnew.php?ident=/ cnr.isti/2010-A2-032&langver=en&scelta=NewMetadata
55. Mazurek, C., Mielnicki, M., Nowak, A., Stroinski, M., Werla, M. and Weglarz, J. (2013), “Architecture for aggregation, processing and provisioning of data from heterogeneous scientific information services”, in Bembenik, R., Skonieczny, L., Rybinski, H., Kryszkiewicz, M. and Niezgodka, M. (Eds), Intelligent Tools for Building a Scientific Information Platform, of Studies in Computational Intelligence (ISBN 978-3-642-35646-9), Vol. 467, Springer, Berlin and Heidelberg, pp. 529-552.
56. Millington, P. and Nixon, W.J. (2007), “EPrints 3 pre-launch briefing”, Ariadne, 50.
57. Ministerio de Ciencia, Tecnologıá e Innovaci_on Productiva, “La Referencia national repository aggregator of Argentina”, available at: http://lareferencia.redclara.net (accessed June 25, 2014).
58. Monash, C. (2009), “Cloudera presents the mapreduce bull case”, blog, April 15, dbMs2.com.
59. MongoDB (2012), “Mongodb”, available at: www.mongodb.org
60. Moreau, L., Clifford, B., Freire, J., Futrelle, J., Gil, Y., Groth, P., Kwasnikowska, N., Miles, S., Missier, P., Myers, J., Plale, B., Simmhan, Y., Stephan, E. and Van den Bussche, J. (2011), “The open provenance model core specification (v1.1)”, Future Generation Computer Systems, Vol. 27 No. 6, pp. 743-756, available at: http://dx.doi.org/10.1016/ j.future.2010.07.005
61. Papatheodorou, C. (2012), “On cultural heritage metadata”, International Journal of Metadata, Semantics and Ontologies, Vol. 7 No. 3, pp. 157-161.
62. Pitti, D.V. (1999), “Encoded archival description: an introduction and overview”, D-Lib. Magazine, Vol. 5 No. 11, November, ISSN 1082-9873.
63. Kuć, R. (2013), “Apache solr 4 cookbook”.
64. Rajasekar, A., Moore, R., Hou, C.-Y., Christopher, A.L., Richard, M., de Torcy, A., Michael, W., Schroeder, W., Chen, S.-Y., Gilbert, L., Tooby, P. and Zhu, B. (2010), iRODS Primer: Integrated Rule-Oriented Data System, Morgan & Claypool, San Rafael, CA.
65. Reis, D., Freire, N., Manguinhas, H. and Pedrosa, G. (2009), “REPOX: a framework for metadata interchange”, in Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C. and Tsakonas, G. (Eds), Proceedings of the 13th European Conference on Research and Advanced Technology for Digital Libraries, ECDL’09, (ISBN 3-642-04345-3, 978-3-642-04345), Springer-Verlag, Berlin and Heidelberg, pp. 479-480, available at: http://dl.acm.org/ citation.cfm?id=1812799.1812878 (accessed January 1, 2009).
66. Rosiek, T., Sylwestrzak, W., Nowinski, A. and Niezgódka, M. (2013), “Infrastructural approach to modern digital library and repositorymanagement systems”, in Bembenik, R., Skonieczny, L., Rybinski, H., Kryszkiewicz, M. and Niezgodka, M. (Eds), Intelligent Tools for Building a Scientific Information Platform of Studies in Computational Intelligence (ISBN 978-3-642-35646-9), Vol. 467, pp. 111-128, Springer Verlag, Berlin and Heidelberg, available at: http:// dblp.uni-trier.de/db/series/sci/sci467.html#RosiekSNN13
67. Savino, P., Debole, F. and Eckes, G. (2009), “Searching and browsing film archives. the european film gateway approach”, 4th International Congress on Science and Technology on the Safeguard of Cultural Heritage in the Mediterranean Basin, Cairo, December.
68. Simeoni, F., Candela, L., Lievens, D., Pagano, P. and Simi, M. (2009), “Functional adaptivity for digital library services in e-infrastructures: the gcube approach”, in Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C. and Tsakonas, G. (Eds), Research and Advanced Technology for Digital Libraries, 13th European Conference, Proceedings, Lecture Notes in Computer Science (ISBN 0302-9743), Springer Verlag, Corfu, ECDL 2009-Research and Advanced Technology for Digital Libraries, 13th European Conference (September 27-October 2), Vol. 5714, pp. 51-62, doi:dx.doi.org/10.1007/978-3-642-04346-8\7.
69. Suber, P. (2004-2012), “Open access overview”, available at: www.earlham.edu/Bpeters/fos/ overview.htm#journals (accessed June 25, 2014).
70. Tansley, R., Bass, M. and Smith, M. (2003), “DSpace as an open archival information system: current status and future directions”, in Traugott, K. and Ingeborg, S. (Eds), Research and Advanced Technology for Digital Libraries 7th European Conference, ECDL 2003 (ISBN 3-540-40726-X), Proceedings, Lecture Notes in Computer Science, Springer-Verlag, Trondheim, August 17-22, pp. 446-460.
71. The Apache Software Foundation (2013), “Apache HBASE”, available at: http://hbaseapache.org/ (accessed June 25, 2014).
72. The PostgreSQL Global Development Group (2010), PostgreSQL 9.0 Reference Manual, Network Theory Ltd, Bristol.
73. Tim Banks (2006), Web Services Resource Framework Specification v1.2, technical report, OASIS, Tim Banks, Burlington, MA.
74. White, H.C., Carrier, S., Thompson, A., Greenberg, J. and Scherle, R. (2008), “The dryad data repository: a Singapore framework metadata architecture in a DSpace environment”, Proceedings of the 2008 International Conference on Dublin Core and Metadata Applications, DCMI ’08, Dublin Core Metadata Initiative, pp. 157-162, available at: http:// dl.acm.org/citation.cfm?id=1503418 1503435
75. Witten, I.H., Bainbridge, D. and Boddie, S.J. (2001), “Greenstone-open-source digital library software”, D-Lib Magazine, Vol. 7 No. 10.
76. Matthew, C., Ken Laskey, M., McCabe, F., Brown, P. and Metz, R. (2006), “Reference model for service oriented architecture 1.0”, technical report, OASIS, Public Review Draft 1.0, February.