MHT: A light-weight scalable zero-hop MPI enabled distributed key-value store

Proceedings - 2015 IEEE International Conference on Big Data, IEEE Big Data 2015

Volumn , Issue , 2015, Pages 2901-2903

  Zhou, Xiaobing ^a   Li, Tonglin ^b   Wang, Ke ^d   Zhao, Dongfang ^b   Sadooghi, Iman ^b   Raicu, Ioan ^b,c  

^a Hortonworks ^*  (United States)

^b ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

^c ARGONNE NATIONAL LABORATORY   (United States)

^d INTEL CORPORATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SUPERCOMPUTERS;

APPLICATION DESIGN; DISTRIBUTED KEY-VALUE STORES; KEY-VALUE STORES; LIGHT WEIGHT; LOS ALAMOS NATIONAL LABORATORY; MPI COMMUNICATIONS;

BIG DATA;

EID: 84963778931     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigData.2015.7364116     Document Type: Conference Paper

References (27)

1. Yi Wang, Gagan Agrawal, Gulcin Ozer, and Kun Huang. Removing sequential bottlenecks in analysis of next-generation sequencing data. In IPDPSW, 2014 IEEE International. IEEE, 2014.
2. Tianyun Su, Zhihan Lv, Shan Gao, Xiaolong Li, and Haibin Lv. 3d seabed: 3d modeling and visualization platform for the seabed. In Multimedia and Expo Workshops (ICMEW), 2014 IEEE International Conference.
3. Fan Shi, Xiang Zhang, Qian Li, and Changyu Shen. Notice of retraction particle tracking in microinjection molding simulated by mis. In Computer Engineering and Technology (ICCET), 2010 2nd International Conference on. IEEE, 2010.
4. Fan Shi, Xiang Zhang, Qian Li, and Changyu Shen. Mould wall friction effects on micro injection moulding based on simulation of mis. IOP Conference Series: Materials Science and Engineering, 2010.
5. SHI Fan, Zhang Xiang, LI Qian, and Shen Changyu. Numerical simulation of micro injection moulding based on mesh free method. Sciencepaper Online, 2010.
6. Su Zhang, Xinwen Zhang, and Xinming Ou. After we knew it: empirical study and modeling of cost-effectiveness of exploiting prevalent known vulnerabilities across iaas cloud. In Proceedings of the 9th ACM symposium on Information, computer and communications security, pages 317-328. ACM, 2014.
7. Fan Shi, Aaron M Coffey, Kevin W Waddell, Eduard Y Chekmenev, and Boyd M Goodson. Nanoscale catalysts for nmr signal enhancement by reversible exchange. The Journal of Physical Chemistry C, 119(13):7525-7533, 2015.
8. Tonglin Li, Ioan Raicu, and Lavanya Ramakrishnan. Scalable state management for scientific applications in the cloud. BigData Congress '14.
9. Tonglin Li, Kate Keahey, Rajesh Sankaran, Pete Beckman, and Ioan Raicu. A cloud-based interactive data infrastructure for sensor networks. IEEE/ACM Supercomputing/SC'14.
10. Tonglin Li, Kate Keahey, Ke Wang, Dongfang Zhao, and Ioan Raicu. A dynamically scalable cloud data infrastructure for sensor networks. ACM ScienceCloud 15.
11. Tonglin Li, Ke Wang, Dongfang Zhao, Kan Qiao, Iman Sadooghi, Xiaobing Zhou, and Ioan Raicu. A flexible qos fortified distributed key-value storage system for the cloud. In IEEE BigData Conference2015. IEEE, 2015.
12. I. Sadooghi, J. Hernandez Martin, T. Li, K. Brandstatter, Y. Zhao, K. Maheshwari, T. Pais Pitta de Lacerda Ruivo, S. Timm, G. Garzoglio, and I. Raicu. Understanding the performance and potential of cloud computing for scientific applications. 2015.
13. Parallel reconfigurable observational environment. http://www.nmc-probe.org/. Accessed: 2014-11-30.
14. Berk Atikoglu, Yuehai Xu, Eitan Frachtenberg, Song Jiang, and Mike Paleczny. Workload analysis of a large-scale key-value store. SIGMETRICS '12, 2012.
15. Hyeontaek Lim, Dongsu Han, David G. Andersen, and Michael Kaminsky. Mica: a holistic approach to fast in-memory key-value storage. NSDI'14.
16. J.M. Wozniak, B. Jacobs, R. Latham, S.W. Son S. Lang, and R. Ross. C-mpi: A DHT implementation for grid and HPC environments. 2010.
17. Tonglin Li, Xiaobing Zhou, Kevin Brandstatter, Dongfang Zhao, Ke Wang, Anupam Rajendran, Zhao Zhang, and Ioan Raicu. ZHT: A light-weight reliable persistent dynamic scalable zero-hop distributed hash table. IPDPS '13.
18. Tonglin Li, Raman Verma, Xi Duan, Hui Jin, and Ioan Raicu. Exploring distributed hash tables in highend computing. SIGMETRICS Performance Evaluation Review, 2011.
19. Tonglin Li, Xiaobing Zhou, Ke Wang, Dongfang Zhao, Iman Sadooghi, Zhao Zhang, and Ioan Raicu. A convergence of key-value storage systems from clouds to supercomputers. Concurr. Comput. : Pract. Exper.(CCPE), 2015.
20. Tonglin Li and Ioan Raicu. Distributed nosql storage for extreme-scale system services. In IEEE/ACM Supercomputing PhD Showcase. IEEE/ACM, 2015.
21. Tonglin Li. A convergence of NoSQL storage systems from clouds to supercomputers. Illinois Institute of Technology, PhD Proposal, 2014.
22. Dongfang Zhao, Zhao Zhang, Xiaobing Zhou, Tonglin Li, Ke Wang, Dries Kimpe, Philip Carns, Robert Ross, and Ioan Raicu. Fusionfs: Towards supporting data-intensive scientific applications on extreme-scale high-performance computing systems. In Big Data, 2014 IEEE International Conference on.
23. Ke Wang, Xiaobing Zhou, Tonglin Li, Michael Lang, and Ioan Raicu. Optimizing load balancing and data-locality with data-aware scheduling. IEEE BigData'14.
24. Ke Wang, Ning Liu, Iman Sadooghi, Xi Yang, Xiaobing Zhou, Tonglin Li, Michael Lang, Xian-He Sun, and Ioan Raicu. Overcoming Hadoop scaling limitations through distributed task execution. IEEE Cluster'15, 2015.
25. Ke Wang, Kan Qiao, Iman Sadooghi, Xiaobing Zhou, Tonglin Li, Michael Lang, and Ioan Raicu. Load-balanced and locality-aware scheduling for data-intensive workloads at extreme scales. Concurrency and Computation: Practice and Experience, 2015.
26. Iman Sadooghi, Ke Wang, Shiva Srivastava, Dharmit Patel, Dongfang Zhao, Tonglin Li, and Ioan Raicu. Fabriq: Leveraging distributed hash tables towards distributed publish-subscribe message queues. IEEE/ACM International Symposium on Big Data Computing (BDC), 2015.
27. Tonglin Li, Chaoqi Ma, Jiabao Li, Xiaobing Zhou, Ke Wang, Dongfang Zhao, Iman Sadooghi, and Ioan Raicu. GRAPH/Z: A key-value store based scalable graph processing system. Cluster'15.