Exploiting application-level similarity to improve SSD cache performance in Hadoop

Journal of Supercomputing

Volumn 70, Issue 3, 2014, Pages 1331-1344

  Chen, Zhijian ^a   Luo, Wenhai ^b   Wu, Dan ^c   Huang, Xiang ^a   He, Jian ^b   Zheng, Yuanhuan ^b   Wu, Di ^b  

^a Guangdong Electric Power Design Institute   (China)

^b SUN YAT SEN UNIVERSITY   (China)

^c ELECTRIC POWER RESEARCH INSTITUTE   (China)

Author keywords

Cache management algorithm; Data similarity; Hybrid Hadoop storage system

Indexed keywords

CRYPTOGRAPHY; DIGITAL STORAGE; INFORMATION MANAGEMENT;

APPLICATION LEVEL; CACHE MANAGEMENT; CACHE PERFORMANCE; DATA SIMILARITY; DEPLOYMENT COSTS; SMALL SCALE; SOLID STATE DRIVES; STORAGE SYSTEMS;

CLUSTERING ALGORITHMS;

EID: 84919879773     PISSN: 09208542     EISSN: 15730484     Source Type: Journal    
DOI: 10.1007/s11227-014-1230-x     Document Type: Article

References (17)

1. Borthakur D (2007) The Hadoop distributed file system: architecture and design. Hadoop Project Website, The Apache Software Foundation
2. Kim Y, Gupta A, Urgaonkar B, Berman P, Sivasubramaniam A (2011) HybridStore: a cost-efficient, high-performance storage system combining SSDs and HDDs. In Proceedings of MASCOTS
3. Narayanan D, Thereska E, Donnelly A, Elnikety S, Rowstron A (2009) Migrating server storage to SSDs: analysis of tradeoffs. In: EuroSys
4. Hua Y, Liu X, Feng D (2013) Data similarity-aware computation infrastructure for the cloud. IEEE Trans Computers
5. Hu Y, Jiang H, Feng D, Tian L, Luo H, Ren C (2013) Exploring and exploiting the multilevel parallelism inside SSDs for improved performance and endurance. IEEE Trans Computers
6. Dayan N, Svendsen M, Bjorling M, Bonnet P, Bouganim L (2013) EagleTree: exploring the design space of SSD-based algorithms. In: VLDB
7. Chen F, Koufaty D, Zhang X (2011) Hystor: making the best use of solid state drives in high performance storage systems. In: ICS
8. Ozmen O, Salem K, Schindler J, Daniel S (2010) Workload-aware storage layout for database systems. In: Proceedings of ACM SIGMOD Int’l Conference on management of data
9. Liu X, Salem K (2013) Hybrid storage management for database systems. In: VLDB
10. Lee S, Moon B, Park C, Kim J, Kim S (2008) A case for flash memory SSD in enterprise database applications. In: Proceedings ACM SIGMOD International Conference on management of data
11. Miller E, Brandt S, Long D (2001) HeRMES: high-performance reliable MRAM-enabled storage. In: Proceedings of IEEE Workshop on hot topics in operating systems
12. Hua Y, Liu X, Feng D (2012) MERCURY: a scalable and similarity-aware scheme in multi-level cache hierarchy. In: MASCOTS
13. Biswas S, Franklin D, Savage A, Dixon R, Sherwood T, Chong F (2009) Multi-execution: MultiCore caching for data similar executions. In: ISCA
14. Lee R, Ding X, Chen F, Lu Q, Zhang X (2009) MCC-DB: minimizing cache conflicts in multi-core processors for databases. In: VLDB
15. Pritchett T, Thottethodi M (2010) SieveStore: a highly-selective. Ensemble-level disk cache for cost-performance. In: ISCA
16. Kim S, Jung D, Kim J, Maeng S (2009) HeteroDrive: reshaping the storage access pattern of OLTP workload using SSD. In: Proceedings of IWSSPS
17. Oh Y, Choi J, Lee D, Noh S (2012) Caching less for better performance: balancing cache size and update cost of flash memory cache in hybrid storage systems. In: FAST