Processing billions of RDF triples on a single machine using streaming and sorting

Proceedings of the ACM Symposium on Applied Computing

Volumn 13-17-April-2015, Issue , 2015, Pages 368-375

  Corcoglioniti, Francesco ^a   Rospocher, Marco ^a   Mostarda, Michele ^a   Amadori, Marco ^a  

^a FONDAZIONE BRUNO KESSLER   (Italy)

Author keywords

Linked data; RDF processing; RDFPRO; Sorting; Streaming

Indexed keywords

ACOUSTIC STREAMING; DATA HANDLING; METADATA; SORTING;

APPLICATION SCENARIO; EMPIRICAL EVALUATIONS; LINKED DATUM; OPEN SOURCE TOOLS; PARALLEL COMPOSITION; RDFPRO; RESEARCH QUESTIONS; SORTING TECHNIQUES;

PIPELINE PROCESSING SYSTEMS;

EID: 84955507876     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2695664.2695720     Document Type: Conference Paper

References (27)

1. Infovore. https://github.com/paulhoule/infovore.
2. Jena riot. https://jena.apache.org/documentation/io/.
3. make-void. https://github.com/cygri/make-void.
4. rapper. http://librdf.org/raptor/rapper.html.
5. rdfConvert. https://bitbucket.org/dotnetrdf/dotnetrdf/wiki/UserGuide/Tools/rdfConvert.
6. RDFPRO. http://fracor.bitbucket.org/rdfpro/.
7. rdfpipe. http://rdfextras.readthedocs.org/en/latest/tools/rdfpipe.html.
8. Sesame RDFConverter. http://sourceforge.net/projects/rdfconvert.
9. G. Aggarwal, M. Datar, S. Rajagopalan, and M. Ruhl. On the streaming model augmented with a sorting primitive. In IEEE Symposium on Foundations of Computer Science (FOCS), pages 540-549, 2004.
10. K. Alexander, R. Cyganiak, M. Hausenblas, and J. Zhao. Describing linked datasets. In Workshop on Linked Data on the Web (LDOW), 2009.
11. S. Auer, J. Demter, M. Martin, and J. Lehmann. LODStats - an extensible framework for high-performance dataset analytics. In EKAW, pages 353-362, 2012.
12. B. Bishop, A. Kiryakov, D. Ognyanoff, I. Peikov, Z. Tashev, and R. Velkov. OWLIM: A family of scalable semantic repositories. Semant. Web, 2(1):33-42, 2011.
13. C. Bizer and A. Schultz. The R2R framework: Publishing and discovering mappings on the Web. In Int. Workshop on Consuming Linked Data (COLD), 2010.
14. C. Böhm, J. Lorey, and F. Naumann. Creating voiD descriptions for Web-scale data. Web Semant., 9(3):339-345, Sept. 2011.
15. S. Ceri, G. Gottlob, and L. Tanca. What you always wanted to know about datalog (and never dared to ask). IEEE Knowl. Data Eng., 1(1):146-166, 1989.
16. J. D. Fernández, M. A. Martínez-Prieto, C. Gutiérrez, A. Polleres, and M. Arias. Binary RDF representation for publication and exchange (HDT). Web Semant., 19:22-41, 2013.
17. T. Heath and C. Bizer. Linked Data: Evolving the Web into a Global Data Space. Morgan & Claypool, 2011.
18. B. Heitmann, R. Cyganiak, C. Hayes, and S. Decker. Architecture of Linked Data applications. In Linked Data Management: Principles and Techniques. CRC Press, 2013.
19. A. Langegger and W. Woss. RDFStats - an extensible RDF statistics generator and library. In Int. Workshop on Database and Expert Systems Application, DEXA'09, pages 79-83, 2009.
20. D. Le-Phuoc, A. Polleres, M. Hauswirth, G. Tummarello, and C. Morbidoni. Rapid prototyping of semantic mash-ups through Semantic Web Pipes. In WWW, pages 581-590, 2009.
21. A. Margara, J. Urbani, F. van Harmelen, and H. Bal. Streaming the Web: Reasoning over dynamic data. Web Semant., 25(0):24-44, 2014.
22. E. Marx, S. Shekarpour, S. Auer, and A.-C. Ngomo. Large-scale RDF dataset slicing. In IEEE Int. Conf. on Semantic Computing (ICSC), pages 228-235, 2013.
23. T. O'Connell. A survey of graph algorithms under extended streaming models of computation. In Fundamental Problems in Computing, pages 455-476. Springer Netherlands, 2009.
24. A. Schultz, A. Matteini, R. Isele, P. N. Mendes, C. Bizer, and C. Becker. LDIF - a framework for large-scale Linked Data integration. In WWW Developers Track, 2012.
25. J. Urbani, S. Kotoulas, J. Maassen, F. Van Harmelen, and H. Bal. WebPIE: Aweb-scale parallel inference engine usingMapReduce. J. Web Semant, 10:59-75, 2012.
26. J. Volz, C. Bizer, M. Gaedke, and G. Kobilarov. Silk - A link discovery framework for the Web of Data. In Workshop on Linked Data on the Web (LDOW), 2009.
27. M. Welsh, D. Culler, and E. Brewer. SEDA: An architecture for well-conditioned, scalable internet services. In ACM Symposium on Operating Systems Principles (SOSP), pages 230-243, 2001.