'Anti-Caching'-based elastic memory management for Big Data

Proceedings - International Conference on Data Engineering

Volumn 2015-May, Issue , 2015, Pages 1268-1279

  Zhang, Hao ^a   Chen, Gang ^b,c   Ooi, Beng Chin ^a   Wong, Weng Fai ^a   Wu, Shensen ^b,c   Xia, Yubin ^d  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b ZHEJIANG UNIVERSITY   (China)

^c Jiangsu Simcere Diagnostics Co   (China)

^d SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BIG DATA; DATABASE SYSTEMS; DISKS (MACHINE COMPONENTS); DISKS (STRUCTURAL COMPONENTS);

CACHING MECHANISM; CODE MODIFICATIONS; ELASTIC MEMORY; FINE-GRAINED COMPONENTS; MAIN MEMORY; MEMORY DATABASE; PREDICTION ACCURACY; STATE-OF-THE-ART APPROACH;

INFORMATION MANAGEMENT;

EID: 84940849500     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2015.7113375     Document Type: Conference Paper

References (51)

1. J. Ousterhout, P. Agrawal, D. Erickson, C. Kozyrakis, J. Leverich, D. Mazieres et al., "The case for ramclouds: Scalable high-performance storage entirely in dram," Operating Systems Review, vol. 43, no. 4, pp. 92-105, 2010.
2. J. C. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, J. J. Furman et al., "Spanner: Google's globally-distributed database," in OSDI '12, 2012, pp. 251-264.
3. S. Alsubaiee, Y. Altowim, H. Altwaijry, A. Behm, V. R. Borkar, Y. Bu et al., "Asterixdb: A scalable, open source BDMS," in PVLDB '14, 2014, pp. 841-852.
4. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," in OSDI '04, 2004, pp. 137-150.
5. D. Jiang, G. Chen, B. C. Ooi, K.-L. Tan, and S. Wu, "epic: an extensible and scalable system for processing big data," in PVLDB '14, 2014, pp. 541-552.
6. G. Malewicz, M. H. Austern, A. J. Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski, "Pregel: A system for large-scale graph processing," in SIGMOD '10, 2010, pp. 135-146.
7. Y. Low, D. Bickson, J. Gonzalez, C. Guestrin, A. Kyrola, and J. M. Hellerstein, "Distributed graphlab: A framework for machine learning and data mining in the cloud," in PVLDB '12, 2012, pp. 716-727.
8. BackType and Twitter, "Storm: Distributed and faulttolerant realtime computation," 2011. [Online]. Available: https://storm. incubator. apache. org/
9. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari, "S4: Distributed stream computing platform," in ICDMW '10, 2010, pp. 170-177.
10. H. Zhang et al., "Memepic: Towards a database system architecture without system calls," National University of Singapore, Tech. Rep., 2014.
11. D. J. DeWitt, R. H. Katz, F. Olken, L. D. Shapiro, M. Stonebraker, and D. A. Wood, "Implementation techniques for main memory database systems," in SIGMOD '84, 1984, pp. 1-8.
12. T. J. Lehman and M. J. Carey, "A recovery algorithm for a highperformance memory-resident database system," in SIGMOD '87, 1987, pp. 104-117.
13. M. H. Eich, "Mars: The design of a main memory database machine," in The Kluwer International booktitle in Engineering and Computer Science. Springer US, 1988, vol. 43, pp. 325-338.
14. H. Garcia-Molina and K. Salem, "Main memory database systems: An overview," IEEE Transactions on Knowledge and Data Engineering, vol. 4, no. 6, pp. 509-516, 1992.
15. R. Kallman, H. Kimura, J. Natkins, A. Pavlo, A. Rasin, S. Zdonik et al., "H-store: A high-performance, distributed main memory transaction processing system," in PVLDB '08, 2008, pp. 1496-1499.
16. A. Kemper and T. Neumann, "Hyper: A hybrid oltp&olap main memory database system based on virtual memory snapshots," in ICDE '11, 2011, pp. 195-206.
17. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley et al., "Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing," in NSDI '12, 2012, pp. 15-28.
18. S. M. Rumble, A. Kejriwal, and J. Ousterhout, "Log-structured memory for dram-based storage," in FAST '14, 2014, pp. 1-16.
19. V. Sikka, F. Färber, W. Lehner, S. K. Cha, T. Peh, and C. Bornhövd, "Efficient transaction processing in sap hana database: The end of a column store myth," in SIGMOD '12, 2012, pp. 731-742.
20. T. Lahiri, M.-A. Neimat, and S. Folkman, "Oracle timesten: An inmemory database for enterprise applications," IEEE Data Engineering Bulletin, vol. 36, no. 2, pp. 6-13, 2013.
21. J. Lindstr öm, V. Raatikka, J. Ruuth, P. Soini, and K. Vakkila, "Ibm soliddb: In-memory database optimized for extreme speed and availability," IEEE Data Engineering Bulletin, vol. 36, no. 2, pp. 14-20, 2013.
22. C. Diaconu, C. Freedman, E. Ismert, P.-A. Larson, P. Mittal, R. Stonecipher et al., "Hekaton: Sql server's memory-optimized oltp engine," in SIGMOD '13, 2013, pp. 1243-1254.
23. D. Sidlauskas and C. S. Jensen, "Spatial joins in main memory: Implementation matters" in PVLDB '15, 2014, pp. 97-100.
24. S. Harizopoulos, D. J. Abadi, S. Madden, and M. Stonebraker, "Oltp through the looking glass, and what we found there," in SIGMOD '08, 2008, pp. 981-992.
25. H. Zhang, B. M. Tudor, G. Chen, and B. C. Ooi, "Efficient in-memory data management: An analysis," in PVLDB '14, 2014, pp. 833-836.
26. J. DeBrabant, A. Pavlo, S. Tu, M. Stonebraker, and S. Zdonik, "Anticaching: A new approach to database management system architecture," in PVLDB '13, 2013, pp. 1942-1953.
27. A. Silberschatz, P. B. Galvin, G. Gagne, and A. Silberschatz, Operating system concepts. Addison-Wesley Reading, 1998, vol. 4.
28. B. Jacob, S. W. Ng, and D. T. Wang, Memory systems: cache, DRAM, disk. Morgan Kaufmann, 2010.
29. T. Mühlbauer, W. Rödiger, R. Seilbeck, A. Reiser, A. Kemper, and T. Neumann, "Instant loading for main memory databases," in PVLDB '13, 2013, pp. 1702-1713.
30. A. Eldawy, J. J. Levandoski, and P. Larson, "Trekking through siberia: Managing cold data in a memory-optimized database," in PVLDB '14, 2014, pp. 931-942.
31. J. J. Levandoski, P. Larson, and R. Stoica, "Identifying hot and cold data in main-memory databases," in ICDE '13, 2013, pp. 26-37.
32. K. Alexiou, D. Kossmann, and P.-A. Larson, "Adaptive range filters for cold data: Avoiding trips to siberia," in PVLDB '13, 2013, pp. 1714-1725.
33. B. Fitzpatrick and A. Vorobey, "Memcached: a distributed memory object caching system," 2003. [Online]. Available: http://memcached. org/
34. S. Sanfilippo and P. Noordhuis, "Redis," 2009. [Online]. Available: http://redis. io
35. W. Effelsberg and T. Haerder, "Principles of database buffer management," ACM Transactions on Database Systems, vol. 9, no. 4, pp. 560-595, 1984.
36. A. S. Tanenbaum, Modern Operating Systems. Prentice Hall Englewood Cliffs, 1992, vol. 2.
37. R. Stoica and A. Ailamaki, "Enabling efficient os paging for mainmemory oltp databases," in DaMoN '13, 2013, p. 7.
38. F. Funke, A. Kemper, and T. Neumann, "Compacting transactional data in hybrid oltp&olap databases," in PVLDB '12, 2012, pp. 1424-1435.
39. R. Bose and J. Frew, "Lineage retrieval for scientific data processing: A survey," ACM Computing Surveys, vol. 37, no. 1, pp. 1-28, 2005.
40. M. Rajashekhar and Y. Yue, "Twemcache: Twitter memcached," 2012. [Online]. Available: https://github. com/twitter/twemcache
41. R. Nishtala, H. Fugal, S. Grimm, M. Kwiatkowski, H. Lee, H. C. Li et al., "Scaling memcache at facebook," in NSDI '13, 2013, pp. 385-398.
42. M. Gorman, Understanding the Linux virtual memory manager. Prentice Hall, 2004.
43. MongoDB Inc., "Mongodb," 2009. [Online]. Available: http://www. mongodb. org/
44. P. A. Boncz, M. Zukowski, and N. Nes, "Monetdb/x100: Hyperpipelining query execution," in CIDR '05, 2005, pp. 225-237.
45. H. Chu, "Mdb: A memory-mapped database and backend for openldap," The 3rd LDAP International Conference, 2011.
46. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears, "Benchmarking cloud serving systems with ycsb," in SoCC '10, 2010, pp. 143-154.
47. D. P. Bovet and M. Cesati, Understanding the Linux kernel. O'Reilly Media, Inc., 2005.
48. F. Bonomi, M. Mitzenmacher, R. Panigrahy, S. Singh, and G. Varghese, "An improved construction for counting bloom filters," in ESA' 06, 2006, pp. 684-695.
49. G. Graefe, H. Volos, H. Kimura, H. Kuno, J. Tucek, M. Lillibridge, and A. Veitch, "In-memory performance for big data," in PVLDB '15, 2014.
50. A. Belay, A. Bittau, A. Mashtizadeh, D. Terei, D. Mazieres, and C. Kozyrakis, "Dune: Safe user-level access to privileged cpu features," in OSDI '12, 2012, pp. 335-348.
51. Y. Collet, "Lz4: Extremely fast compression algorithm," 2013. [Online]. Available: https://code. google. com/p/lz4/