Scalable distributed indexing and query processing over Linked Data

Journal of Web Semantics

Volumn 10, Issue , 2012, Pages 3-32

  Karnstedt, Marcel ^a   Sattler, Kai Uwe ^b   Hauswirth, Manfred ^a  

^a NATIONAL UNIVERSITY OF IRELAND   (Ireland)

^b ILMENAU UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Decentralized data management; Distributed indexing; Distributed storage; Linked Data; Query processing; Structured queries

Indexed keywords

COMPLEX QUERIES; CORE PART; COST MODELS; COST-EFFICIENT; DATA INTEGRATION SYSTEM; DATA SETS; DATABASE TECHNOLOGY; DEGREE OF DISTRIBUTIONS; DISTRIBUTED APPROACHES; DISTRIBUTED QUERY PROCESSING; DISTRIBUTED STORAGE; DISTRIBUTED SYSTEMS; EXPERIMENTAL EVALUATION; LAYERED ARCHITECTURE; LINKED DATUM; PHYSICAL LAYERS; PROCESSING APPROACH; PROOF OF CONCEPT; QUERY ALGEBRAS; QUERY EXECUTION; RDF DATA; RDF STORES; SCALABILITY ISSUE; SCALABLE QUERY PROCESSING; STRUCTURED INFORMATION; STRUCTURED QUERIES; WEB APPLICATION;

DISTRIBUTED DATABASE SYSTEMS; EFFICIENCY; INDEXING (OF INFORMATION); INFORMATION MANAGEMENT; NETWORK LAYERS; OPTIMIZATION;

QUERY PROCESSING;

EID: 84857060642     PISSN: 15708268     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.websem.2011.11.010     Document Type: Article

References (78)

1. C. Bizer, A. Jentzsch, R. Cyganiak, State of the LOD cloud, 2011. Available from: < http://www4.wiwiss.fu-berlin.de/lodcloud/state/ >.
2. J. Gray, A. Szalay, A. Thakar, P.Z. Zunszt, T. Malik, J. Raddick, C. Stoughton, J. van den Berg, The SDSS SkyServer public access to the Sloan Digital Sky Server Data, Technical Report MSR-TR-2001-104, Microsoft Research, 2001.
3. K. Aberer, A. Datta, M. Hauswirth, R. Schmidt, Indexing data-oriented overlay networks, in: VLDB'05, 2005, pp. 685-696. (Pubitemid 43991044)
4. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, W. Vogels, Dynamo: Amazon's highly available key-value store, in: Proceedings of the 21st ACM Symposium on Operating Systems Principles (SOSP) 2007, 2007, pp. 205-220. (Pubitemid 351429377)
5. Basho, Basho: Riak, an Open Source Scalable Data Store, 2011. Available from: < www.basho.com/Riak >.
6. J. Madhavan, S.R. Jeffery, S. Cohen, X.L. Dong, D. Ko, C. Yu, A. Halevy, Web-scale data integration: you can only afford to pay as you go, in: CIDR'07, 2007, pp. 342-350.
7. A. Singhal Modern information retrieval: a brief overview Bulletin of the IEEE Computer Society Technical Committee on Data Engineering 24 4 2001 35 42
8. M. Karnstedt, Query Processing in a DHT-based Universal Storage, Ph.D. Thesis at Ilmenau University of Technology, AVM-Verlag, 2009.
9. M. Karnstedt, K. Sattler, M. Haß, M. Hauswirth, B. Sapkota, R. Schmidt, Estimating the number of answers with guarantees for structured queries in P2P databases (poster), in: CIKM'08, 2008, pp. 1407-1408.
10. M. Karnstedt, K. Sattler, M. Haß, M. Hauswirth, B. Sapkota, R. Schmidt, Approximating query completeness by predicting the number of answers in DHT-based web applications, in: International Workshop on Web Information and Data Management (WIDM'08), 2008, pp. 71-78.
11. K. Aberer, and M. Hauswirth Practical Handbook of Internet Computing 2004 CRC Press Ch. Peer-to-Peer Systems
12. K. Aberer, L.O. Alima, A. Ghodsi, S. Girdzijauskas, S. Haridi, M. Hauswirth, The essence of P2P: a reference architecture for overlay networks, in: Fifth IEEE International Conference on Peer-to-Peer Computing, Use of Computers at the Edge of Networks (P2P, Grid, Clusters), 2005.
13. A. Datta, M. Hauswirth, R. Schmidt, R. John, K. Aberer, Range queries in trie-structured overlays, in: P2P'05, 2005, pp. 57-66. (Pubitemid 44883090)
14. J. Aspnes, J. Kirsch, A. Krishnamurthy, Load balancing and locality in range-queriable data structures, in: PODC'04, 2004, pp. 115-124.
15. A. Bharambe, M. Agrawal, and S. Seshan Mercury: supporting scalable multi-attribute range queries SIGCOMM Computer Communication Review 34 4 2004 353 366 (Pubitemid 40954893)
16. O.D. Sahin, A. Gupta, D. Agrawal, A.E. Abbadi, A peer-to-peer framework for caching range queries, in: ICDE'04, 2004, p. 165.
17. A. Gupta, D. Agrawal, A.E. Abbadi, Approximate range selection queries in peer-to-peer systems, in: CIDR'03, 2003, pp. 141-151.
18. C.Y. Liau, W.S. Ng, Y. Shu, K.-L. Tan, S. Bressan, Efficient range queries and fast lookup services for scalable p2p networks, in: International Workshop on Databases, Information Systems and Peer-to-Peer Computing (DBISP2P'04), 2004, pp. 93-106.
19. K. Aberer, P. Cudré-Mauroux, A. Datta, Z. Despotovic, M. Hauswirth, M. Punceva, and R. Schmidt P-Grid: a self-organizing structured P2P system SIGMOD Record 32 3 2003 29 33 (Pubitemid 40290284)
20. H.V. Jagadish, B.C. Ooi, Q.H. Vu, Baton: a balanced tree structure for peer-to-peer networks, in: K. Böhm, C.S. Jensen, L.M. Haas, M.L. Kersten, P.-. Larson, B.C. Ooi (Eds.), VLDB, ACM, 2005, pp. 661-672. (Pubitemid 43991042)
21. H.V. Jagadish, B.C. Ooi, Q.H. Vu, R. Zhang, A. Zhou, Vbi-tree: a peer-to-peer framework for supporting multi-dimensional indexing schemes, in: L. Liu, A. Reuter, K.-Y. Whang, J. Zhang (Eds.), ICDE, IEEE Computer Society, 2006, p. 34. (Pubitemid 44539826)
22. S. Blanas, and V. Samoladas Contention-based performance evaluation of multidimensional range search in peer-to-peer networks Future Generation Computer Systems 25 1 2009 100 108
23. RDF at W3C homepage. < http://www.w3.org/RDF > (last visited 2009/02/21).
24. V. Levenshtein Binary codes of correcting deletions, insertions, and reversals Soviet Physics Doklady 10 8 1966 707 710
25. G. Navarro, R.A. Baeza-Yates, A practical q-gram index for text retrieval allowing errors, CLEI Electronic Journal 1 (2) (1998).
26. L. Gravano, P.G. Ipeirotis, H.V. Jagadish, N. Koudas, S. Muthukrishnan, D. Srivastava, Approximate string joins in a database (almost) for free, in: VLDB '01, 2001, pp. 491-500.
27. E. Schallehn, I. Geist, K. Sattler, Supporting similarity operations based on approximate string matching on the web, in: CoopIS'04, 2004, pp. 227-244. (Pubitemid 39750437)
28. G. Navarro A guided tour to approximate string matching ACM Computing Surveys 33 1 2001 31 88 (Pubitemid 33768480)
29. K. Aberer, P. Cudré-Mauroux, A. Datta, Z. Despotovic, M. Hauswirth, M. Punceva, R. Schmidt, and J. Wu Advanced peer-to-peer networking: the P-grid system and its applications PIKJ 26 2003 86 89 Special issue on P2P systems. Available from: < http://citeseer.ist.psu.edu/aberer03advanced.html
30. M. Karnstedt, K. Sattler, M. Richtarsky, J. Müller, M. Hauswirth, R. Schmidt, R. John, UniStore: querying a DHT-based universal storage, in: ICDE'07 Demonstrations Program, 2007, pp. 1503-1504. (Pubitemid 47422199)
31. E. Prud'hommeaux, A. Seaborne, SPARQL Query Language for RDF, w3C Candidate Recommendation, 2006. Available from: < http://www.w3.org/TR/rdf- sparql-query/ >.
32. J. Pérez, M. Arenas, and C. Gutierrez Semantics and complexity of SPARQL ACM Transactions on Database Systems 34 2009 16:1 16:45 10.1145/1567274.1567278 Available from: http://doi.acm.org/10.1145/1567274. 1567278
33. B. Glimm, M. Krötzsch, SPARQL beyond subgraph matching, in: ISWC'10, 2010, pp. 241-256. Available from: < http://portal.acm.org/citation.cfm?id= 1940281.1940298 >.
34. V. Papadimos, and D. Maier Mutant query plans Information and Software Technology 44 4 2002 197 206 (Pubitemid 34292009)
35. S. Börzsönyi, D. Kossmann, K. Stocker, The skyline operator, in: ICDE'01, 2001, pp. 421-432.
36. M. Karnstedt, J. Müller, K. Sattler, Cost-aware skyline queries in structured overlays, in: ICDE Workshop on Ranking in Databases (DBRank'07), 2007, pp. 285-288.
37. J. Müller, Berechnung von Skylines in strukturierten Overlaynetzwerken, Diploma Thesis at TU Ilmenau (available in German only), 2007.
38. S. Wang, Q.H. Vu, B.C. Ooi, A.K.H. Tung, and L. Xu Skyframe: a framework for skyline query processing in peer-to-peer systems The VLDB Journal 18 1 2009 345 362
39. C.T. Yu, and W. Meng Principles of Database Query Processing for Advanced Applications 1998 Morgan Kaufman Publishers Inc.
40. S. Schwalm, Anfragesystem für vertikal organisierte Universalrelationen in P2P-Systemen, Diploma Thesis at TU Ilmenau (available in German only), 2006.
41. B. Chun, D. Culler, T. Roscoe, A. Bavier, L. Peterson, M. Wawrzoniak, and M. Bowman PlanetLab: an overlay Testbed for broad-coverage services SIGCOMM Computer Communication Review 33 3 2003 3 12
42. R. Huebsch, B. Chun, J.M. Hellerstein, Pier on PlanetLab: initial experience and open problems, Technical Report, University of California, Berkeley, 2003.
43. D. Schwerdel, D. Günther, R. Henjes, B. Reuther, P. Müller, German-lab experimental facility, in: Future Internet, FIS'10, 2010, pp. 1-10. Available from: < http://portal.acm.org/citation.cfm?id=1929268.1929269 >.
44. M. Arias, J.D. Fernández, M.A. Martínez-Prieto, P. de la Fuente, An Empirical Study of Real-World SPARQL Queries, CoRR abs/1103.5043.
45. S.D. Gribble, A.Y. Halevy, Z.G. Ives, M. Rodrig, D. Suciu, What can database do for peer-to-peer? in: WebDB'01, 2001, pp. 31-36.
46. P.A. Bernstein, F. Giunchiglia, A. Kementsietsidis, J. Mylopoulos, L. Serafini, I. Zaihrayeu, Data management for peer-to-peer computing: a vision, in: Fifth International Workshop on the Web and Databases (WebDB'02), 2002, pp. 89-94.
47. R. Huebsch, J.M. Hellerstein, N. Lanham, B. Thau Loo, S. Shenker, I. Stoica, Querying the internet with PIER, in: VLDB '03, 2003, pp. 321-332.
48. B.C. Ooi, K.-L. Tan, A. Zhou, C.H. Goh, Y. Li, C.Y. Liau, B. Ling, W.S. Ng, Y. Shu, X. Wang, M. Zhang, PeerDB: peering into personal databases, in: SIGMOD'03, 2003, pp. 659-659.
49. W.S. Ng, B.C. Ooi, K.-L. Tan, PeerDB: a P2P-based system for distributed data sharing, in: ICDE'03, 2003, pp. 633-644.
50. W.S. Ng, B.C. Ooi, K.-L. Tan, BestPeer: a self-configurable peer-to-peer system, in: ICDE'02, 2002, p. 272. (Pubitemid 34278724)
51. Gnutella homepage. < http://rfc-gnutella.sourceforge.net > (last visited 2008/11/6).
52. Z. Kaoudi, K. Kyzirakos, M. Koubarakis, SPARQL query optimization on top of DHTs, in: ISWC'10, 2010, pp. 418-435. Available from: < http://portal.acm.org/citation.cfm?id=1940281.1940309 >.
53. Z. Kaoudi, M. Koubarakis, K. Kyzirakos, I. Miliaraki, M. Magiridou, and A. Papadakis-Pesaresi Atlas: storing, updating and querying rdf(s) data on top of dhts Web Semantics: Science, Services and Agents on the World Wide Web 8 4 2010 271 277 10.1016/j.websem.2010.07.001 Semantic Web Challenge 2009; User Interaction in Semantic Web research. Available from: < http://www. sciencedirect.com/science/article/B758F-50GWN98-1/2/ 10673894ac612f523ad9bf73c1b172fb >
54. E. Liarou, S. Idreos, and M. Koubarakis Evaluating conjunctive triple pattern queries over large structured overlay networks ISWC 4273 2006 399 413 Available from: < http://www.springerlink.com/index/y51k8656812x6716.pdf > (Pubitemid 44892045)
55. M. Cai, M.R. Frank, B. Yan, and R.M. MacGregor A subscribable peer-to-peer rdf repository for distributed metadata management Journal of Web Semantics 2 2 2004 109 130
56. M. Cai, M. Frank, J. Chen, P. Szekely, MAAN: a multi-attribute addressable network for grid information services, in: International Workshop on Grid Computing (GRID'03), 2003, p. 184.
57. L. Miller, A. Seaborne, A. Reggiori, Three implementations of SquishQL, a simple RDF query language, in: ISWC'02, 2002, pp. 423-435.
58. B. Quilitz, U. Leser, Querying distributed RDF data sources with SPARQL, in: ESWC'08, 2008, pp. 524-538.
59. F. Heine, Scalable p2p based RDF querying, in: International Conference on Scalable Information Systems (InfoScale'06), 2006, pp. 17-22.
60. D. Battré, F. Heine, and O. Kao Topk rdf query evaluation in structured p2p networks W. Nagel, W. Walter, W. Lehner, Euro-Par 2006 Parallel Processing, Lecture Notes in Computer Science vol. 4128 2006 Springer Berlin/Heidelberg 995 1004 10.1007/11823285-105 Available from: < http://dx.doi.org/10.1007/11823285-105 > (Pubitemid 44568473)
61. B. Lohrmann, D. Battré, O. Kao, Towards parallel processing of RDF queries in DHTs, in: Data Management in Grid and Peer-to-Peer Systems, Globe'09, 2009, pp. 36-47, doi:10.1007/978-3-642-03715-3-4. Available from: http://dx.doi.org/10.1007/978-3-642-03715-3-4.
62. D. Battré, Query planning in DHT based RDF stores, in: Signal Image Technology and Internet Based Systems, SITIS'08, 2008, pp. 187-194, doi:10.1109/SITIS.2008.15. Available from: < http://dx.doi.org/10.1109/SITIS. 2008.15 >.
63. H. Stuckenschmidt, R. Vdovjak, G.-J. Houben, J. Broekstra, Index structures and algorithms for querying distributed RDF repositories, in: WWW'04, 2004, pp. 631-639. (Pubitemid 40752797)
64. W. Nejdl, B. Wolf, C. Qu, S. Decker, M. Sintek, A. Naeve, M. Nilsson, M. Palmer, T. Risch, Edutella: a P2P Networking Infrastructure based on RDF, in: WWW'02, 2002.
65. O. Görlitz, and S. Staab Federated data management and query optimization for linked open data A. Vakali, L. Jain, Web Data Management Trails 2011 Springer Preprint available from: < http://www.uni-koblenz.de/staab/ Research/Publications/2010/LOD-Federation.pdf >
66. M. Brantner, D. Florescu, D. Graf, D. Kossmann, T. Kraska, Building a database on S3, in: SIGMOD'08, 2008, pp. 251-264.
67. J.W. Ross, and G. Westerman Preparing for utility computing: the role of IT architecture and relationship management IBM Systems Journal 43 1 2004 5 19
68. M. Stonebraker, U. Cetintemel, One size fits all: an idea whose time has come and gone, in: ICDE'05, 2005, pp. 2-11. (Pubitemid 41731109)
69. G. Koloniari, and E. Pitoura Peer-to-peer management of XML data: issues and research challenges SIGMOD Record 34 2 2005 6 17 (Pubitemid 41260005)
70. P. Cudré-Mauroux, S. Agarwal, and K. Aberer GridVine: an infrastructure for peer information management IEEE Internet Computing 11 5 2007 864 875 10.1109/MIC.2007.108 (Pubitemid 47534611)
71. K. Aberer, P. Cudre-Mauroux, and M. Hauswirth Start making sense: the chatty web approach for global semantic agreements Journal of Web Semantics 1 1 2003 89 114 (Pubitemid 44914728)
72. K. Aberer, P. Cudré-Mauroux, M. Hauswirth, T.V. Pelt, GridVine: building internet-scale semantic overlay networks, in: ISWC'04, 2004, pp. 107-121. (Pubitemid 39743878)
73. G. Kokkinidis, E. Sidirourgos, and V. Christophides Query processing in RDF/S-based P2P database systems S. Staab, H. Stuckenschmidt, Semantic Web and Peer-to-Peer 2006 Springer Berlin/Heidelberg 59 81 (Chapter 4)
74. A. Magkanaraki, V. Tannen, V. Christophides, Viewing the semantic web through RVL lenses, in: ISWC'03, 2003, pp. 98-112.
75. T. Neumann, and G. Weikum RDF-3X: a RISC-style engine for RDF VLDB Endowment 1 1 2008 647 659
76. T. Neumann, G. Weikum, Scalable join processing on very large RDF graphs, in: SIGMOD'09, 2009, pp. 627-640, doi:10.1145/1559845.1559911. Available from: http://doi.acm.org/10.1145/1559845.1559911.
77. A. Harth, S. Decker, Optimized index structures for querying rdf from the web, in: Third Latin American Web Congress, 2005, pp. 71-80.
78. A. Harth, K. Hose, M. Karnstedt, A. Polleres, K.-U. Sattler, J. Umbrich, Data summaries for on-demand queries over linked data, in: WWW'10, 2010.