SSS: An implementation of key-value store based MapReduce framework

Proceedings - 2nd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2010

Volumn , Issue , 2010, Pages 754-761

  Ogawa, Hirotaka ^a   Nakada, Hidemoto ^a   Takano, Ryousei ^a   Kudoh, Tomohiro ^a  

^a NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

Cloud technologies; Key value store; MapReduce

Indexed keywords

COMMUNITY IS; DATA-INTENSIVE APPLICATION; ENERGY EFFICIENT; FLEXIBLE WORKFLOWS; KEY-VALUE STORE; MAPREDUCE; PARALLEL APPLICATION; PERFORMANCE PROBLEMS; PROGRAMMING MODELS; PROGRAMMING TOOLS; READ/WRITE PERFORMANCE; RUNTIME PERFORMANCE; SOLID STATE DRIVES;

COMPUTER SYSTEMS; TECHNOLOGY;

CLOUD COMPUTING;

EID: 79952397765     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CloudCom.2010.89     Document Type: Conference Paper

References (24)

1. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," Communications of the ACM, vol. 51, no. 1, pp. 107-113, 2008.
2. Apache Hadoop Project, "Hadoop," http://hadoop.apache.org/.
3. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: distributed data-parallel programs from sequential building blocks," in EuroSys '07: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007. New York, NY, USA: ACM, 2007, pp. 59-72.
4. Y. Gu and R. L. Grossman, "Sector and Sphere: The Design and Implementation of a High Performance Data Cloud," Philosophical Transactions: A Special Issue associated with the UK e-Science All Hands Meeting, vol. 367, pp. 2429-2445, 2009.
5. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The Google File System," in SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles. New York, NY, USA: ACM, 2003, pp. 29-43.
6. D. Borthakur, "HDFS Architecture," http://hadoop.apache.org/ hdfs/docs/current/hdfs design.html.
7. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox, "Twister: A Runtime for Iterative MapReduce," in Proceedings of The First International Workshop on MapReduce and its Applications (MAPREDUCE'10), 2010.
8. M. Zaharia, M. Chowdhury, M. Franklin, S. Shenker, and I. Stoica, "Spark: Cluster Computing with Working Sets," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2010-53, May 2010. [Online]. Available: http://www.eecs.berkeley.edu/Pubs/TechRpts/2010/EECS-2010- 53.html
9. Fusion-io, "Fusion-io :: Products," http://www.fusionio.com/ Products.aspx.
10. FAL Labs, "Tokyo Tyrant: network interface of Tokyo Cabinet," http://fallabs.com/tokyotyrant/.
11. D. Karger, E. Lehman, T. Leighton, R. Panigrahy, M. Levine, and D. Lewin, "Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web," in Proceedings of the twenty-ninth annual ACM symposium on Theory of computing, ser. STOC '97. New York, NY, USA: ACM, 1997, pp. 654-663. [Online]. Available: http://doi.acm.org/ 10.1145/258533.258660
12. FAL Labs, "Tokyo Cabinet: a modern implementation of DBM," http://fallabs.com/tokyocabinet/index.html.
13. S. Chu, "MemcacheDB," http://memcachedb.org/.
14. Oracle Corporation, "Oracle Berkeley DB," http://www.oracle. com/technetwork/database/berkeleydb/overview/index.html.
15. J. Garzik, "Hail Cloud Computing Wiki," http://hail.wiki. kernel.org/index.php/Main Page.
16. "Java Binding of Tokyo Tyrant," http://code.google.com/p/ jtokyotyrant.
17. couchdb-fuse: A FUSE interface to CouchDB, http://code.google.com/p/ couchdb-fuse/.
18. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels, "Dynamo: Amazon's Highly Available Key-Value Store," in SOSP '07: Proceedings of Twenty-first ACM SIGOPS Symposium on Operating Systems Principles. New York, NY, USA: ACM, 2007, pp. 205-220.
19. A. Lakshman and P. Malik, "Cassandra: A Decentralized Structured Storage System," SIGOPS Operating Systems Review, vol. 44, no. 2, pp. 35-40, 2010.
20. S. Sehrish, G. Mackey, J. Wang, and J. Bent, "MRAP: A Novel MapReduce-based Framework to Support HPC Analytics Applications with Access Patterns," in Proceedings of High Performance Distributed Computing (HPDC 2010), 2010.
21. Y. Yu, M. Isard, D. Fetterly, M. Budiu, U. Erlingsson, P. K. Gunda, and J. Currey, "DryadLINQ: A System for General-Purpose Distributed Data-Parallel Computing Using a High-Level Language," in OSDI'08: Proceedings of the 8th USENIX conference on Operating Systems Design and Implementation. Berkeley, CA, USA: USENIX Association, 2008, pp. 1-14.
22. M. Isard and Y. Yu, "Distributed Data-Parallel Computing Using a High-Level Programming Language," in SIGMOD '09: Proceedings of the 35th SIGMOD International Conference on Management of Data. New York, NY, USA: ACM, 2009, pp. 987-994.
23. R. Pike, S. Dorward, R. Griesemer, and S. Quinlan, "Interpreting the data: Parallel analysis with Sawzall," Scientific Programming, vol. 13, no. 4, pp. 277-298, 2005.
24. The R Project for Statistical Computing, http://www.r-project.org/.