Issues in big data testing and benchmarking

DBTest 2013 - Proceedings of the 6th International Workshop on Testing Database Systems, Co-located with ACM SIGMOD 2013

Volumn , Issue , 2013, Pages

  Alexandrov, Alexander ^a   Brücke, Christoph ^a   Markl, Volker ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

benchmarking; big data; data generation; data profiling; workloads

Indexed keywords

BIG DATUM; DATA CHARACTERIZATION; DATA GENERATION; DATA MANAGEMENT SYSTEM; DATA PROFILING; RELATIONAL DATA MODELS; RESEARCH CHALLENGES; WORKLOADS;

INFORMATION MANAGEMENT; RELATIONAL DATABASE SYSTEMS;

BENCHMARKING;

EID: 84889592081     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2479440.2482677     Document Type: Conference Paper

References (38)

1. A. Alexandrov, D. Battré, S. Ewen, M. Heimel, F. Hueske, O. Kao, V. Markl, E. Nijkamp, D. Warneke: Massively Parallel Data Analysis with PACTs on Nephele. PVLDB Vol. 3, No. 2, pp. 1625-1628 (2010)
2. S. Alsubaiee, A. Behm, R. Grover, R. Vernica, V. Borkar, M. J. Carey, C. Li: ASTERIX: Scalable Warehouse-Style Web Data Integration. In Proceedings of the Ninth International Workshop on Information Integration on the Web, Article 2, ACM, (2012)
3. A. Arasu, R. Kaushik, J. Li: Data Generation using Declarative Constraints. Proceeding of the SIGMOD Conference, pp. 685-696 (2011)
4. A. Alexandrov, B. Schiefer, J. Poelman, S. Ewen, T. Bodner, V. Markl: Myriad - Parallel Data Generation on Shared-Nothing Architectures, In Proc. ASBD, pp. 30-33 (2011)
5. A. Alexandrov, K. Tzoumas, V. Markl: Myriad: Scalable and Expressive Data Generation, In Proc. VLDB(5) pp. 1890-1893 (2012)
6. P. Brown, P. Haas: BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data. VLDB 2003: 668-679
7. K. S. Beyer, V. Ercegovac, R. Gemulla, A. Balmin, M. Eltabakh, C.-C. Kanne, E. J. Shekita: Jaql: A scripting language for large scale semistructured data analysis. In Proc. of VLDB Conference. (2011)
8. J. Dean, S. Ghemawat: MapReduce: simplified data processing on large clusters, In OSDI, pp. 137-150 (2004)
9. F. Färber, N. May, W. Lehner, P. Große, I. Müller, H. Rauhe, J. Dees: The SAP HANA Database - An Architecture Overview. IEEE Data Eng. Bull. 35(1): 28-33 (2012)
10. M. Frank, M. Poess, T. Rabl: Efficient update data generation for DBMS benchmarks. ICPE 2012: 169-180
11. R. Greenwald, R. Stackowiak, M. Alam, M. Bhuller. Achieving extreme performance with Oracle Exadata. McGraw-Hill Osborne Media (2011)
12. http://hadoop.apache.org/, last accessed 05-10-2013
13. P. J. Haas, I. Ilyas, G. Lohman, V. Markl: Discovering and Exploiting Statistical Properties for Query Optimization in Relational Databases: A Survey. Statistical Analysis and Data Mining 1(4): 223-250 (2009)
14. K. Huppler: The Art of Building a Good Benchmark. TPCTC 2009: 18-30 (2009)
15. I. Ilyas, V. Markl, P. Haas, P. Brown, A. Aboulnaga: CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies. SIGMOD Conference 2004: 647-658
16. https://github.com/cloudera/impala, last accessed 05-10-2013
17. Y. Low, D. Bickson, J. Gonzalez, C. Guestrin, A. Kyrola, J. M. Hellerstein: DistributedGraphLab: A framework for machine learning and data mining in the cloud. Proceedings of the VLDB Endowment, 5(8), pp. 716-727 (2012)
18. Mahout: http://mahout.apache.org/, last accessed 04-21-2013
19. https://github.com/TU-Berlin-DIMA/myriadtoolkit/wiki, last accessed 05-10-2013
20. http://www.hpi.unipotsdam.de/naumann/publications/publications-by-type/ year/2013/2276/Nau13.html, SIGMOD Record (2013)
21. https://github.com/TU-Berlin-DIMA/myriadtoolkit/wiki/Using-Oligos-Guide, last accessed 05-10-2013
22. C. Olston, B. Reed, U. Srivastava, R. Kumar, A. Tomkins: Pig Latin: A Not-So-Foreign Language for Data Processing. Proceedings of the SIGMOD Conference (SIGMOD), pp. 1099-1110, (2008)
23. http://www.paralleldatageneration.org/drupal6/, last accessed 05-10-2013
24. T. Rabl, M. Frank, H. Sergieh, H. Kosch: A Data Generator for Cloud-Scale Benchmarking. TPCTC 2010: 41-56
25. Y. Sismanis, P. Brown, P. Haas, B. Reinwald: GORDIAN: Efficient and Scalable Discovery of Composite Keys. VLDB 2006: 691-702
26. U. Srivastava, P. Haas, V. Markl, M. Kutsch, T.Tran: ISOMER: Consistent Histogram Construction Using Query Feedback. ICDE (2006)
27. http://spark-project.org/, last accessed 05-10-2013
28. http://www.stratosphere.eu/, last accessed 05-10-2013
29. E. Torlak: Scalable test data generation from multidimensional models. Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering (2012)
30. http://www.tpc.org, last accessed 05-10-2013
31. A. Thusoo, J. S.Sarma, N. Jain, Z. Shao, P.Chakka, S. Anthony, H. Liu, P. Wyckoff, R. Murthy: Hive - A Warehousing Solution Over a Map-Reduce Framework. PVLDB 2(2), pp. 1626-1629 (2009)
32. http://www.xml-benchmark.org/, last accessed 05-10-2013
33. A. Pavlo, E. Paulson, A. Rasin, D. Abadi, D. DeWitt, S. Madden, M. Stonebraker: A comparison of approaches to large-scale data analysis. SIGMOD Conference 2009: 165-178
34. J. Dittrich, J. Quiané-Ruiz, A. Jindal, Y. Kargin, V. Setty, J. Schad: Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing). PVLDB 3(1): 518-529 (2010)
35. D. Jiang, B. C. Ooi, L. Shi, S. Wu: The Performance of MapReduce: An In-depth Study. PVLDB 3(1):472-483 (2010)
36. J. Leskovec, D. Chakrabarti, J. Kleinberg, C. Faloutsos: Realistic, Mathematically Tractable Graph Generation and Evolution, Using Kronecker Multiplication. PKDD 2005: 133-145
37. U. Kang, C.E. Tsourakakis, C. Faloutsos: PEGASUS: A Peta-Scale Graph Mining System. ICDM 2009: 229-238
38. U. Kang, C.E. Tsourakakis, A.P. Appel, C. Faloutsos, J. Leskovec: HADI: Mining Radii of Large Graphs. TKDD 5(2): 8 (2011)