Scalable RDF data compression with MapReduce

Concurrency and Computation: Practice and Experience

Volumn 25, Issue 1, 2013, Pages 24-39

  Urbani, Jacopo ^a   Maassen, Jason ^a   Drost, Niels ^a   Seinstra, Frank ^a   Bal, Henri ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

compression; dictionary encoding; distributed algorithms; MapReduce; RDF; Semantic Web

Indexed keywords

COMPACTION; ENCODING (SYMBOLS); PARALLEL ALGORITHMS; SEMANTIC WEB; SIGNAL ENCODING; WIRELESS SENSOR NETWORKS;

COMPRESSION TECHNIQUES; DISTRIBUTED DATA; ENCODING TECHNIQUES; HADOOP FRAMEWORKS; LARGE AMOUNTS; LARGE AMOUNTS OF DATA; MAP-REDUCE; RESOURCE DESCRIPTION FRAMEWORK;

DATA COMPRESSION;

EID: 84871211108     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.2840     Document Type: Conference Paper

References (30)

1. Berners-Lee T, Hendler J, Lassila O,. The semantic web. Scientific American May 2001; 284 (5): 34-43.
2. W3C recommendation: Rdf primer. http://www.w3.org/TR/rdf-primer/.
3. Linked Life Data. http://www.linkedlifedata.com.
4. Uk goverment data website. http://data.gov.uk.
5. Official statistics of linked data website. http://esw.w3.org/TaskForces/ CommunityProjects/LinkingOpenData/DataSets/Statistics.
6. Dean J, Ghemawat S,. Mapreduce: simplified data processing on large clusters.In Proceedings of the USENIX Symposium on Operating Systems Design & Implementation (OSDI), 2004; 137-147.
7. Urbani J, Kotoulas S, Oren E, van Harmelen F,. Scalable distributed reasoning using mapreduce. In Proceedings of the ISWC'09, 2009.
8. Urbani J, Kotoulas S, Maassen J, van Harmelen F, Bal H,. OWL Reasoning with WebPIE: Calculating the Closure of 100 Billion Triples. In ESWC (1), 2010; 213-227 http://dx.doi.org/10.1007/978-3-642-13486-9-15. Currently under submission.
9. Urbani J, Maaseen J, Bal H,. Massive semantic web data compression with MapReduce. Proceedings of the 1st Mapreduce Workshop at HPDC '10, 2010.
10. DAS-3 website. http://www.cs.vu.nl/das3.
11. DBPedia website. http://dbpedia.org.
12. Swoogle website. http://swoogle.umbc.edu.
13. Guo Y, Pan Z, Heflin J,. LUBM: A benchmark for OWL knowledge base systems. Journal of Web Semantics 2005; 3: 158-182. (Pubitemid 41336740)
14. LDSR website. http://www.ontotext.com/ldsr/.
15. Billion triple challenge website. http://challenge.semanticweb.org.
16. Uniprot website. http://www.uniprot.org.
17. Abadi D, Marcus A, Madden S, Hollenbach K,. Scalable semantic web data management using vertical partitioning, In Proceedings of the 33rd International Conference on Very Large Data Bases, ACM 2007. VLDB Endowment: University of Vienna, Austria, September 23-27, 2007; 411-422. ISBN 978-1-59593-649-3.
18. Weiss C, Karras P, Bernstein A,. Hexastore: sextuple indexing for semantic web data management. Proceedings of the VLDB Endowment Archive 2008; 1 (1): 1008-1019.
19. Broekstra J, Kampman A, VanHarmelen F,. Spinning the Semantic Web: Bringing the World Wide Web to Its Full Potential [outcome of a Dagstuhl seminar], In Spinning the Semantic Web, Fensel D, Hendler JA, Lieberman H, Wahlster W, (eds), MIT Press, 2003; 197 0-262-06232-1. DBLP, http://dblp.uni-trier.de.
20. Kiryakov A, Ognyanov D, Manov D,. OWLIM-a pragmatic semantic repository for OWL. In Proceedings of the Conference on Web Information Systems Engineering (WISE) Workshops, 2005; 182-192. (Pubitemid 43836908)
21. Fernández JD., Gutierrez C, Martínez-Prieto MA,. 2010. RDF compression: basic approaches. In WWW '10: Proceedings of the 19th International Conference on World wide web. ACM, New York, NY, USA; 1091-1092.
22. Lee K, Son JH, Kim G-W, Kim M-H,. Web document compaction by compressing URI references in RDF and OWL data, In ICUIMC, 2008; 163-168.
23. Michel BS, Nikoloudakis K, Reiher P, Zhang L,. URL forwarding and compression in adaptive web caching. INFOCOM 2000. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings. IEEE, 2000; 670-678. (Pubitemid 30584516)
24. Ye Y, Cosman P,. Dictionary design for text image compression with JBIG 2. IEEE Transactions on Image Processing 2001; 10 (6): 818-828. (Pubitemid 32498456)
25. Nagumo H, Lu M, Watson K,. Parallel algorithms for the static dictionary compression. Data Compression Conference, 1995. DCC '95. Proceedings, 1995; 162-171.
26. Zobel J, Heinz S, Williams HE,. In-memory hash tables for accumulating text vocabularies. Information Processing Letters 2001; 80 (6): 271-277. Elsevier Science. (Pubitemid 33018683)
27. Heinz S, Zobel J, Williams HE,. Burst tries: a fast, efficient data structure for string keys. ACM Transactions on Information Systems 2002; 20: 192-223. (Pubitemid 44642302)
28. Yang H, Dasdan A, Hsiao R, Parker D,. Map-reduce-merge: simplified relational data processing on large clusters. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM 2007: Beijing, China, June 12-14, 2007; ISBN 978-1-59593-686-8.
29. Olston C, Reed B, Srivastava U, Kumar R, Tomkins A,. Pig Latin: a not-so-foreign language for data processing, In Proceedings of the ACM SIGMOD International Conference on Management of Data, SIGMOD 2008. ACM 2008: Vancouver, BC, Canada, June 10-12, 2008; 1099-1110. ISBN 978-1-60558-102-6.
30. Thusoo A, Sarma JS, Jain N, Shao Z, Chakka P, Anthony S, Liu H, Wyckoff P, Murthy R,. Hive: a warehousing solution over a map-reduce framework. Proceedings of the VLDB Endowment 2009; 2 (2): 1626-1629. VLDB Endowment.