XGDBench: A benchmarking platform for graph stores in exascale clouds

CloudCom 2012 - Proceedings: 2012 4th IEEE International Conference on Cloud Computing Technology and Science

Volumn , Issue , 2012, Pages 363-370

  Dayarathna, Miyuru ^a   Suzumura, Toyotaro ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Benchmark testing; Database systems; Network theory (graphs); Performance analysis; System performance

Indexed keywords

BENCHMARK TESTING; BENCHMARKING PLATFORMS; CLOUD ENVIRONMENTS; CLOUD SERVICES; COMMUNITY STRUCTURES; COMPUTING SYSTEM; EXASCALE; GRAPH DATA; GRAPH DATABASE; GRAPH STORES; GROWING DEMAND; HPC CLOUDS; PERFORMANCE ANALYSIS; PERFORMANCE EVALUATION; PUBLIC CLOUDS; SYNTHETIC GRAPHS; SYSTEM PERFORMANCE;

CLOUD COMPUTING; CLUSTER ANALYSIS; COMPUTER SYSTEMS; DATABASE SYSTEMS;

BENCHMARKING;

EID: 84874251660     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CloudCom.2012.6427516     Document Type: Conference Paper

References (36)

1. Apache. Fuseki: serving rdf data over http. URL: http://jena.apache.org/ documentation/serving data/, 2012.
2. D. A. Bader, J. Feo, J. Gilbert, J. Kepner, D. Koester, E. Loh, K. Madduri, B. Mann, T. Meuse, and E. Robinson. Hpc scalable graph analysis benchmark. Feb 2009.
3. C. Bizer and A. Schultz. The berlin sparql benchmark. International Journal On Semantic Web and Information Systems, 2009.
4. D. Chakrabarti, C. Faloutsos, and M. McGlohon. Graph mining: Laws and generators. In C. C. Aggarwal, H. Wang, and A. K. Elmagarmid, editors, Managing and Mining Graph Data, volume 40 of The Kluwer International Series on Advances in Database Systems, pages 69-123. Springer US, 2010.
5. P. Charles and et al. X10: an object-oriented approach to non-uniform cluster computing. OOPSLA '05, pages 519-538, 2005.
6. CloudGraph. Cloudgraph .net graph database. URL: http://www.cloudgraph. com/, 2012.
7. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with ycsb. In Proceedings of the 1st ACM symposium on Cloud computing, SoCC '10, pages 143-154, New York, NY, USA, 2010. ACM.
8. P. Cudré-Mauroux and S. Elnikety. Graph data management systems for new application domains. PVLDB, 4(12):1510-1511, 2011.
9. D. Dominguez-Sal, N. Martinez-Bazan, V. Muntes-Mulero, P. Baleta, and J. L. Larriba-Pay. A discussion on the design of graph database benchmarks. In Proceedings of the Second TPC technology conference on Performance evaluation, measurement and characterization of complex systems, TPCTC'10, pages 25-40, Berlin, Heidelberg, 2011. Springer-Verlag.
10. D. Dominguez-Sal, P. Urbón-Bayes, A. Giménez- Vañó, S. Gómez-Villamor, N. Martínez-Bazán, and J. L. Larriba-Pey. Survey of graph database performance on the hpc scalable graph analysis benchmark. In Proceedings of the 2010 international conference on Web-age information management, WAIM'10, pages 37-48, Berlin, Heidelberg, 2010. Springer-Verlag.
11. J. Dongarra and et al. The international exascale software project roadmap. International Journal of High Performance Computing Applications, 25(1):3-60, 2011.
12. J. Dudley, Y. Pouliot, R. Chen, A. Morgan, and A. Butte. Translational bioinformatics in the cloud: an affordable alternative. Genome Medicine, 2(8):51, 2010.
13. Dydra. Dydra: Networks made friendly. URL: http://dydra.com/, 2012.
14. S. Ekins, R. Gupta, E. Gifford, B. Bunin, and C. Waller. Chemical space: Missing pieces in cheminformatics. Pharmaceutical Research, 27:2035-2039, 2010. 10.1007/s11095-010-0229-0.
15. T. Endo, A. Nukada, S. Matsuoka, and N. Maruyama. Linpack evaluation on a supercomputer with heterogeneous accelerators. In IPDPS, pages 1-8, 2010.
16. M. Faloutsos, P. Faloutsos, and C. Faloutsos. On power-law relationships of the internet topology. SIGCOMM Comput. Commun. Rev., 29(4):251-262, Aug. 1999.
17. Y. Guo, Z. Pan, and J. Heflin. Lubm: A benchmark for owl knowledge base systems. Web Semantics: Science, Services and Agents on the World Wide Web, 3(23):158-182, 2005.
18. K. Huppler. Performance evaluation and benchmarking. chapter The Art of Building a Good Benchmark, pages 18-30. Springer-Verlag, Berlin, Heidelberg, 2009.
19. IBM. X10: Performance and productivity at scale. URL: http://x10-lang. org/, Jan. 2012.
20. F. Inc. Allegrograph rdfstore web 3.0's database. URL: http://www.franz.com/agraph/allegrograph/, Sept. 2012.
21. J. Leskovec, D. Huttenlocher, and J. Kleinberg. Signed networks in social media. In Proceedings of the 28th international conference on Human factors in computing systems, CHI '10, pages 1361-1370, New York, NY, USA, 2010. ACM.
22. L. Ma, Y. Yang, Z. Qiu, G. Xie, Y. Pan, and S. Liu. Towards a complete owl ontology benchmark. In Y. Sure and J. Domingue, editors, The Semantic Web: Research and Applications, volume 4011 of Lecture Notes in Computer Science, pages 125-139. Springer Berlin /Heidelberg, 2006.
23. L. H. Marek Ciglan, Alex Averbuch. Benchmarking traversal operations over graph databases. In Proceedings of the 3rd International Workshop on Graph Data Management: Techniques and Applications, GDM '12, 2012.
24. M. Morsey, J. Lehmann, S. Auer, and A.-C. N. Ngomo. Dbpedia sparql benchmark-performance assessment with real queries on real data. In International Semantic Web Conference (1)'11, pages 454-469, 2011.
25. R. Murphy, J. Berry, W. McLendon, B. Hendrickson, D. Gregor, and A. Lumsdaine. Dfs: A simple to write yet difficult to execute benchmark. In Workload Characterization, 2006 IEEE International Symposium on, pages 175-177, oct. 2006.
26. K. Myunghwan and J. Leskovec. Multiplicative attribute graph model of real-world networks. Internet Mathematics, 8(1-2):113-160, 2012.
27. R. Nambiar, N. Wakou, F. Carman, and M. Majdalany. Transaction processing performance council (tpc): State of the council 2010. In R. Nambiar and M. Poess, editors, Performance Evaluation, Measurement and Characterization of Complex Systems, volume 6417 of Lecture Notes in Computer Science, pages 1-9. Springer Berlin /Heidelberg, 2011.
28. Neo4j.org. Neo4j:the world's leading graph database. URL: http://neo4j. org/, Sept. 2012.
29. NuvolaBase. Nuvolabase: cloudize your data-commercial support, training and services about orientdb. URL: http://www.nuvolabase.com/site/, 2012.
30. K. Rohloff, M. Dean, I. Emmons, D. Ryder, and J. Sumner. An evaluation of triple-store technologies for large data stores. In On the Move to Meaningful Internet Systems 2007: OTM 2007 Workshops, volume 4806 of Lecture Notes in Computer Science, pages 1105-1114. Springer Berlin /Heidelberg, 2007.
31. M. Sarwat, S. Elnikety, Y. He, and G. Kliot. Horton: Online query execution engine for large distributed graphs. In ICDE, pages 1289-1292, 2012.
32. M. Schmidt, T. Hornung, G. Lausen, and C. Pinkel. Sp2bench: A sparql performance benchmark. CoRR, abs/0806.4627, 2008.
33. P. Shannon, A. Markiel, O. Ozier, N. S. Baliga, J. T. Wang, D. Ramage, N. Amin, B. Schwikowski, and T. Ideker. Cytoscape: A Software Environment for Integrated Models of Biomolecular Interaction Networks. Genome Research, 13(11):2498-2504, Nov. 2003.
34. O. Technologies. The nosql graph-document dbms. URL: http://www.orientdb. org/index.htm, Sept. 2012.
35. D. Thakker, T. Osman, S. Gohil, and P. Lakin. A pragmatic approach to semantic repositories benchmarking. In L. Aroyo, G. Antoniou, E. Hyvnen, A. ten Teije, H. Stuckenschmidt, L. Cabral, and T. Tudorache, editors, The Semantic Web: Research and Applications, volume 6088 of Lecture Notes in Computer Science, pages 379-393. Springer Berlin /Heidelberg, 2010.
36. C. Vicknair, M. Macias, Z. Zhao, X. Nan, Y. Chen, and D. Wilkins. A comparison of a graph database and a relational database: a data provenance perspective. In Proceedings of the 48th Annual Southeast Regional Conference, ACM SE '10, pages 42:1-42:6, New York, NY, USA, 2010. ACM.