Skew-aware automatic database partitioning in shared-nothing, parallel OLTP systems

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2012, Pages 61-72

  Pavlo, Andrew ^a   Curino, Carlo ^b   Zdonik, Stanley ^a  

^a BROWN UNIVERSITY   (United States)

^b YAHOO RESEARCH   (United States)

Author keywords

h store; kb; oltp; parallel; shared nothing

Indexed keywords

H-STORE; KB; OLTP; PARALLEL; SHARED NOTHING;

COMPUTER SUPPORTED COOPERATIVE WORK; DATABASE SYSTEMS; DESIGN; INDUSTRY;

COST BENEFIT ANALYSIS;

EID: 84862637962     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2213836.2213844     Document Type: Conference Paper

References (50)

1. H-Store: Next Generation OLTP DBMS Research. http://hstore.cs.brown.edu.
2. Wikipedia MySQL Server Roles. https://wikitech.wikimedia.org/view/Server- roles.
3. S. Agrawal, S. Chaudhuri, A. Das, and V. Narasayya. Automating layout of relational databases. In ICDE, pages 607-618, 2003.
4. S. Agrawal, S. Chaudhuri, and V. R. Narasayya. Automated selection of materialized views and indexes in SQL databases. In VLDB, 2000.
5. S. Agrawal, V. Narasayya, and B. Yang. Integrating vertical and horizontal partitioning into automated physical database design. In SIGMOD, 2004.
6. V. Angkanawaraphan and A. Pavlo. AuctionMark: A benchmark for high-performance oltp systems.
7. M. Aslett. How will the database incumbents respond to NoSQL and NewSQL? The 451 Group, April 2011.
8. N. Bassiliades and I. P. Vlahavas. A non-uniform data fragmentation strategy for parallel main-memory database systems. In VLDB, pages 370-381, 1995.
9. R. Cattell. Scalable SQL and NoSQL data stores. SIGMOD Rec., 39:12-27.
10. S. Ceri, S. Navathe, and G. Wiederhold. Distribution design of logical database schemas. IEEE Trans. Softw. Eng., 9(4):487-504, 1983.
11. S. Chaudhuri, A. K. Gupta, and V. Narasayya. Compressing SQL workloads. In SIGMOD, pages 488-499, 2002.
12. S. Chaudhuri and V. Narasayya. Autoadmin "what-if" index analysis utility. SIGMOD Rec., 27(2):367-378, 1998.
13. S. Chaudhuri and V. R. Narasayya. An efficient cost-driven index selection tool for microsoft SQL server. In VLDB, pages 146-155, 1997.
14. Y. C. Cheng, L. Gruenwald, G. Ingels, and M. T. Thakkar. Evaluating partitioning techniques for main memory database: Horizontal and single vertical. In ICCI, pages 570-574, 1993.
15. J. Coleman and R. Grosman. Unlimited Scale-up of DB2 Using Server-assisted Client Redirect. http://ibm.co/fLR2cH, October 2005.
16. G. Copeland, W. Alexander, E. Boughter, and T. Keller. Data placement in bubba. SIGMOD, 17(3):99-108, 1988.
17. C. Curino, Y. Zhang, E. Jones, and S. Madden. Schism: a workload-drive approach to database replication and partitioning. In VLDB, 2010.
18. E. Danna and L. Perron. Structured vs. unstructured large neighborhood search: A case study on job-shop scheduling problems with earliness and tardiness costs. In Principles and Practice of Constraint Programming, volume 2833, pages 817-821, 2003.
19. S. Duan, V. Thummala, and S. Babu. Tuning database configuration parameters with iTuned. VLDB, 2:1246-1257, August 2009.
20. S. Finkelstein, M. Schkolnick, and P. Tiberio. Physical database design for relational databases. ACM Trans. Database Syst., 13(1):91-128, 1988.
21. F. Focacci, F. Laburthe, and A. Lodi. Handbook of Metaheuristics, chapter Local Search and Constraint Programming. Springer, 2003.
22. N. Folkman. So, that was a bummer. http://blog.foursquare.com/2010/10/05/ so-that-was-a-bummer/, October 2010.
23. S. Ghandeharizadeh, D. J. DeWitt, and W. Qureshi. A performance analysis of alternative multi-attribute declustering strategies. SIGMOD, 21(2):29-38, 1992.
24. S. Harizopoulos, D. J. Abadi, S. Madden, and M. Stonebraker. OLTP through the looking glass, and what we found there. In SIGMOD, pages 981-992, 2008.
25. E. P. Jones, D. J. Abadi, and S. Madden. Low overhead concurrency control for partitioned main memory databases. In SIGMOD, pages 603-614, 2010.
26. R. Kallman, H. Kimura, J. Natkins, A. Pavlo, A. Rasin, S. Zdonik, E. P. C. Jones, S. Madden, M. Stonebraker, Y. Zhang, J. Hugg, and D. J. Abadi. H-Store: A High-Performance, Distributed Main Memory Transaction Processing System. Proc. VLDB Endow., 1(2):1496-1499, 2008.
27. J. Krueger, C. Kim, M. Grund, N. Satish, D. Schwalb, J. Chhugani, H. Plattner, P. Dubey, and A. Zeier. Fast updates on Read-Optimized databases using Multi-Core CPUs. VLDB, 5:61-72, September 2011.
28. M. Livny, S. Khoshafian, and H. Boral. Multi-disk management algorithms. SIGMETRICS Perform. Eval. Rev., 15(1):69-77, 1987.
29. S. Manegold, P. Boncz, and M. L. Kersten. Generic database cost models for hierarchical memory systems. In VLDB, pages 191-202, 2002.
30. M. Mehta and D. J. DeWitt. Data placement in shared-nothing parallel database systems. The VLDB Journal, 6(1):53-72, 1997.
31. R. Mukkamala, S. C. Bruell, and R. K. Shultz. Design of partially replicated distributed database systems: an integrated methodology. SIGMETRICS Perform. Eval. Rev., 16(1):187-196, 1988.
32. R. Nehme and N. Bruno. Automated partitioning design in parallel database systems. In SIGMOD, SIGMOD, pages 1137-1148, 2011.
33. C. Nikolaou, A. Labrinidis, V. Bohn, D. Ferguson, M. Artavanis, C. Kloukinas, and M. Marazakis. The impact of workload clustering on transaction routing. Technical report, FORTH-ICS TR-238, 1998.
34. C. N. Nikolaou, M. Marazakis, and G. Georgiannakis. Transaction routing for distributed OLTP systems: survey and recent results. Inf. Sci., 97:45-82, 1997.
35. S. Padmanabhan. Data placement in shared-nothing parallel database systems. PhD thesis, University of Michigan, 1992.
36. S. Papadomanolakis and A. Ailamaki. Autopart: Automating schema design for large scientific databases using data partitioning. In SSDBM, 2004.
37. A. Pavlo, E. P. Jones, and S. Zdonik. On predictive modeling for optimizing transaction execution in parallel OLTP systems. VLDB, 5:85-96, October 2011.
38. E. Rahm. A framework for workload allocation in distributed transaction processing systems. J. Syst. Softw., 18:171-190, May 1992.
39. J. Rao, C. Zhang, N. Megiddo, and G. Lohman. Automating physical database design in a parallel database. In SIGMOD, pages 558-569, 2002.
40. P. Scheuermann, G. Weikum, and P. Zabback. Data partitioning and load balancing in parallel disk systems. The VLDB Journal, 7(1):48-66, 1998.
41. J. Sobel. Scaling Out (Facebook). http://on.fb.me/p7i7eK, April 2006.
42. M. Stonebraker and R. Cattell. 10 rules for scalable performance in 'simple operation' datastores. Commun. ACM, 54:72-80, June 2011.
43. M. Stonebraker, S. Madden, D. J. Abadi, S. Harizopoulos, N. Hachem, and P. Helland. The end of an architectural era: (it's time for a complete rewrite). In VLDB, pages 1150-1160, 2007.
44. M. Stonebraker and A. Pavlo. The SEATS Airline Ticketing Systems Benchmark. http://hstore.cs.brown.edu/projects/seats.
45. The Transaction Processing Council. TPC-C Benchmark (Revision 5.9.0). http://www.tpc.org/tpcc/, June 2007.
46. The Transaction Processing Council. TPC-E Benchmark (Revision 1.23.0). http://www.tpc.org/tpce/, June 2010.
47. C. B. Walton, A. G. Dale, and R. M. Jenevein. A taxonomy and performance model of data skew effects in parallel joins. In VLDB, pages 537-548, 1991.
48. A. Wolski. TATP Benchmark Description (Version 1.0). http:// tatpbenchmark.sourceforge.net, March 2009.
49. D. C. Zilio. Physical Database Design Decision Algorithms and Concurrent Reorganization for Parallel Database Systems. PhD thesis, University of Toronto, 1998.
50. D. C. Zilio, J. Rao, S. Lightstone, G. Lohman, A. Storm, C. Garcia-Arellano, and S. Fadden. DB2 design advisor: integrated automatic physical database design. In VLDB, pages 1087-1097, 2004.