From A to E: Analyzing TPC's OLTP benchmarks: The obsolete, the ubiquitous, the unexplored

ACM International Conference Proceeding Series

Volumn , Issue , 2013, Pages 17-28

  Tözün, Pinar ^a   Pandis, Ippokratis ^b   Kaynak, Cansu ^a   Jevdjic, Djordje ^a   Ailamaki, Anastasia ^a  

^a EPFL   (Switzerland)

^b IBM ALMADEN RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE ENGINE; DATABASE VENDORS; DISTRIBUTED TRANSACTION; INSTRUCTIONS PER CYCLES; LOCK CONTENTIONS; OPEN-SOURCE; OPTIMISTIC CONCURRENCY CONTROLS; WORKLOAD CHARACTERIZATION;

CONCURRENCY CONTROL;

DATABASE SYSTEMS;

EID: 84876802489     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2452376.2452380     Document Type: Conference Paper

References (39)

1. A. Ailamaki, D. J. DeWitt, and M. D. Hill. Data page layouts for relational databases on deep memory hierarchies. VLDB J., 11(3):198-215, 2002. (Pubitemid 36156203)
2. A. Ailamaki, D. J. DeWitt, M. D. Hill, and D. A. Wood. DBMSs on a modern processor: Where does time go? In VLDB, pages 266-277, 1999.
3. Anon. et al. A measure of transaction processing power. Datamation, 31(7), 1985.
4. I. Atta, P. Tözün, A. Ailamaki, and A. Moshovos. SLICC: Self-Assembly of Instruction Cache Collectives for OLTP Workloads. In MICRO, pages 188-198, 2012.
5. L. A. Barroso, K. Gharachorloo, and E. Bugnion. Memory system characterization of commercial workloads. In ISCA, pages 3-14, 1998.
6. P. A. Bernstein and N. Goodman. Multiversion concurrency control-theory and algorithms. ACM TODS, 8(4):465-483, 1983.
7. B. M. Cantrill et al. Dtrace. Available at http://dtrace.org.
8. M. J. Carey, D. J. DeWitt, M. J. Franklin, N. E. Hall, M. L. McAuliffe, J. F. Naughton, D. T. Schuh, M. H. Solomon, C. K. Tan, O. G. Tsatalos, S. J. White, and M. J. Zwilling. Shoring up persistent applications. In SIGMOD, pages 383-394, 1994.
9. K. Chakraborty, P. M. Wells, and G. S. Sohi. Computation spreading: employing hardware migration to specialize cmp cores on-the-fly. In ASPLOS, pages 283-292, 2006.
10. S. Chen, A. Ailamaki, M. Athanassoulis, P. B. Gibbons, R. Johnson, I. Pandis, and R. Stoica. TPC-E vs. TPC-C: Characterizing the new TPC-E benchmark via an I/O comparison study. SIGMOD Record, 39:5-10, 2010.
11. C. B. Colohan, A. Ailamaki, J. G. Steffan, and T. C. Mowry. Optimistic intra-transaction parallelism on chip multiprocessors. In VLDB, pages 73-84, 2005.
12. S. Eyerman, L. Eeckhout, T. Karkhanis, and J. E. Smith. A performance counter architecture for computing accurate cpi components. In ASPLOS, pages 175-184, 2006.
13. M. Ferdman, A. Adileh, O. Kocberber, S. Volos, M. Alisafaee, D. Jevdjic, C. Kaynak, A. D. Popescu, A. Ailamaki, and B. Falsafi. Clearing the Clouds: A Study of Emerging Scale-out Workloads on Modern Hardware. In ASPLOS, pages 37-48, 2012.
14. G. Graefe, H. Kimura, and H. Kuno. Foster B-trees. ACM TODS, 37(3):17:1-17:29, 2012.
15. N. Hardavellas, I. Pandis, R. Johnson, N. Mancheril, A. Ailamaki, and B. Falsafi. Database servers on chip multiprocessors: Limitations and opportunities. In CIDR, pages 79-87, 2007.
16. IBM. IBM breaks double digit performance barrier with 10 million transactions per minute, 2010. Available at http://www- 03.ibm.com/press/us/en/ pressrelease/32328.wss.
17. Intel. Intel VTune Amplifier XE performance profiler. Available at http://software.intel.com/enus/ articles/intel-vtune-amplifier-xe/.
18. R. Johnson, I. Pandis, and A. Ailamaki. Improving OLTP scalability using speculative lock inheritance. PVLDB, 2(1):479-489, 2009.
19. R. Johnson, I. Pandis, N. Hardavellas, A. Ailamaki, and B. Falsafi. Shore-MT: a scalable storage manager for the multicore era. In EDBT, pages 24-35, 2009.
20. R. Johnson, I. Pandis, R. Stoica, M. Athanassoulis, and A. Ailamaki. Aether: a scalable approach to logging. PVLDB, 3:681-692, 2010.
21. S. Kavalanekar, B. Worthington, Q. Zhang, and V. Sharda. Characterization of storage workload traces from production windows servers. In IISWC, pages 119-128, 2008.
22. K. Keeton, D. A. Patterson, Y. Q. He, R. C. Raphael, and W. E. Baker. Performance characterization of a quad Pentium Pro SMP using OLTP workloads. In ISCA, pages 15-26, 1998.
23. W. Lang, J. M. Patel, and S. Shankar. Wimpy node clusters: what about non-wimpy workloads? In DaMoN, pages 47-55, 2010.
24. P.-A. Larson, S. Blanas, C. Diaconu, C. Freedman, J. M. Patel, and M. Zwilling. High-performance concurrency control mechanisms for main-memory databases. PVLDB, 5(4), 2011.
25. C. Mohan. ARIES/KVL: a key-value locking method for concurrency control of multiaction transactions operating on B-tree indexes. In VLDB, pages 392-405, 1990.
26. C. Mohan and F. Levine. ARIES/IM: an efficient and high concurrency index management method using write-ahead logging. In SIGMOD, pages 371-380, 1992.
27. Oracle. cputrack. Available at http://docs.oracle.com/cd/E19683-01/816- 0210/6m6nb7m6s/index.html.
28. Oracle. SPARC supercluster with 27 SPARC T3-4 servers demonstrates world record performance on TPC-C benchmark, 2010. Available at http://www.oracle.com/ us/solutions/performancescalability/ t3-4-tpc-c-12210-bmark-190934.html.
29. I. Pandis, R. Johnson, N. Hardavellas, and A. Ailamaki. Data-oriented transaction execution. PVLDB, 3(1):928-939, 2010.
30. I. Pandis, P. Tözün, R. Johnson, and A. Ailamaki. PLP: page latch-free shared-everything OLTP. PVLDB, 4(10):610-621, 2011.
31. D. Porobic, I. Pandis, M. Branco, P. Tözün, and A. Ailamaki. OLTP on hardware islands. PVLDB, 5(11):1447-1458, 2012.
32. P. Ranganathan, K. Gharachorloo, S. V. Adve, and L. A. Barroso. Performance of database workloads on shared-memory systems with out-of-order processors. In ASPLOS-VIII, pages 307-318, 1998.
33. R. Stets, K. Gharachorloo, and L. Barroso. A detailed comparison of two transaction processing workloads. In WWC, pages 37-48, 2002.
34. M. Stonebraker, S. Madden, D. J. Abadi, S. Harizopoulos, N. Hachem, and P. Helland. The end of an architectural era: (it's time for a complete rewrite). In VLDB, pages 1150-1160, 2007.
35. TPC. TPC benchmark B standard specification, revision 2.0, 1994. Available at http://www.tpc.org/tpcb.
36. TPC. TPC benchmark D standard specification, revision 2.1, 1998. Available at http://www.tpc.org/tpcd.
37. TPC. TPC benchmark C standard specification, revision 5.11, 2010. Available at http://www.tpc.org/tpcc.
38. TPC. TPC benchmark E standard specification, revision 1.12.0, 2010. Available at http://www.tpc.org/tpce.
39. TPC. TPC benchmark H standard specification, revision 2.14.3, 2011. Available at http://www.tpc.org/tpch.