CubicRing: Enabling one-hop failure detection and recovery for distributed in-memory storage systems

Proceedings of the 12th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2015

Volumn , Issue , 2015, Pages 529-542

  Zhang, Yiming ^a   Guo, Chuanxiong ^b   Li, Dongsheng ^a   Chu, Rui ^a   Wu, Haitao ^b   Xiong, Yongqiang ^c  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^b MICROSOFT   (United States)

^c MSR   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGGREGATES; DATA STORAGE EQUIPMENT; DIGITAL STORAGE; RECOVERY; SYSTEMS ANALYSIS; TRAFFIC CONGESTION;

DISTRIBUTED STRUCTURES; FAILURE DETECTION AND RECOVERIES; FALSE DETECTIONS; FAST FAILURE RECOVERY; MEMORY STORAGE; RING STRUCTURES; SWITCH FAILURE; TRANSIENT NETWORK;

COMPUTER SYSTEM RECOVERY;

EID: 84967318044     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (56)

1. http://books.google.com/books?id=5wDQNwAACAAJ.
2. http://kylinx.com/papers/cmem1.4.pdf.
3. https://ramcloud.stanford.edu/wiki/pages/viewpage.action?pageId=8355860sosp-2011-reviews-and-comments-on-ramcloud.
4. http://wiki.open.qq.com/wiki/CMEM.
5. http://www.aristanetworks.com/en/products/7100series.
6. http://www.broadcom.com/press/release.php?id=s634491.
7. http://www.datacenterknowledge.com/archives/2008/05/30/failure-rates-in-google-data-centers/.
8. http://www.isi.edu/nsnam/ns/.
9. http://www.memcached.org/.
10. AL-FARES, M., RADHAKRISHNAN, S., RAGHAVAN, B., HUANG, N., AND VAHDAT, A. Hedera: Dynamic flow scheduling for data center networks. In NSDI (2010), pp. 281-296.
11. ANAND, A., MUTHUKRISHNAN, C., KAPPES, S., AKELLA, A., AND NATH, S. Cheap and large cams for high performance data-intensive networked systems. In NSDI (2010), USENIX Association, pp. 433-448.
12. ANDERSEN, D. G., FRANKLIN, J., KAMINSKY, M., PHANISHAYEE, A., TAN, L., AND VASUDEVAN, V. Fawn: a fast array of wimpy nodes. In SOSP (2009), J. N. Matthews and T. E. Anderson, Eds., ACM, pp. 1-14.
13. ANTIREZ. An update on the memcached/redis benchmark. http://antirez.com/post/update-on-memcached-redis-benchmark.html.
14. BERTIER, M., MARIN, O., AND SENS, P. Implementation and performance evaluation of an adaptable failure detector. In 2002 International Conference on Dependable Systems and Networks (DSN 2002), 23-26 June 2002, Bethesda, MD, USA, Proceedings (2002), pp. 354-363.
15. BHUYAN, L. N., AND AGRAWAL, D. P. Generalized hypercube and hyperbus structures for a computer network. IEEE Trans. Computers 33, 4 (1984), 323-333.
16. BUDHIRAJA, N., MARZULLO, K., SCHNEIDER, F. B., AND TOUEG, S. The primary-backup approach, 1993.
17. CANDEA, G., KAWAMOTO, S., FUJIKI, Y., FRIEDMAN, G., AND FOX, A. Microreboot - A technique for cheap recovery. In 6th Symposium on Operating System Design and Implementation (OSDI 2004), San Francisco, California, USA, December 6-8, 2004 (2004), pp. 31-44.
18. CHANDRA, T. D., AND TOUEG, S. Unreliable failure detectors for reliable distributed systems. J. ACM 43, 2 (1996), 225-267.
19. CHANG, F., DEAN, J., GHEMAWAT, S., HSIEH, W. C., WALLACH, D. A., BURROWS, M., CHANDRA, T., FIKES, A., AND GRUBER, R. Bigtable: A distributed storage system for structured data. In OSDI (2006), pp. 205-218.
20. CHEN, W., TOUEG, S., AND AGUILERA, M. K. On the quality of service of failure detectors. IEEE Trans. Computers 51, 5 (2002), 561-580.
21. CULLY, B., LEFEBVRE, G., MEYER, D. T., FEELEY, M., HUTCHINSON, N. C., AND WARFIELD, A. Remus: High availability via asynchronous virtual machine replication. (best paper). In 5th USENIX Symposium on Networked Systems Design & Implementation, NSDI 2008, April 16-18, 2008, San Francisco, CA, USA, Proceedings (2008), p. 161.
22. DANIELS, D., DOO, L. B., DOWNING, A., ELSBERND, C., HALLMARK, G., JAIN, S., JENKINS, B., LIM, P., SMITH, G., SOUDER, B., AND STAMOS, J. Oracle's symmetric replication technology and implications for application design. In SIGMOD (1994), ACM Press, p. 467.
23. DEBNATH, B. K., SENGUPTA, S., AND LI, J. Flashstore: High throughput persistent key-value store. PVLDB 3, 2 (2010), 1414-1425.
24. DEBNATH, B. K., SENGUPTA, S., AND LI, J. Skimpystash: Ram space skimpy key-value store on flash-based storage. In SIGMOD Conference (2011), T. K. Sellis, R. J. Miller, A. Kementsietsidis, and Y. Velegrakis, Eds., ACM, pp. 25-36.
25. DECANDIA, G., HASTORUN, D., JAMPANI, M., KAKULAPATI, G., LAKSHMAN, A., PILCHIN, A., SIVASUBRAMANIAN, S., VOSSHALL, P., AND VOGELS, W. Dynamo: amazon's highly available key-value store. In SOSP (2007), pp. 205-220.
26. DORMANDO. Redis vs memcached (slightly better bench). http://dormando.livejournal.com/525147.html.
27. DRAGOJEVIĆ, A., NARAYANAN, D., CASTRO, M., AND HODSON, O. Farm: Fast remote memory. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14) (Seattle, WA, 2014), USENIX Association, pp. 401-414.
28. FAN, B., ANDERSEN, D. G., AND KAMINSKY, M. Memc3: Compact and concurrent memcache with dumber caching and smarter hashing. In Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2013, Lombard, IL, USA, April 2-5, 2013 (2013), pp. 371-384.
29. FERNER, C. S., AND LEE, K. Y. Hyperbanyan networks: A new class of networks for distributed memory multiprocessors. IEEE Transactions on Computers 41, 3 (1992), 254-261.
30. GARCIA-MOLINA, H., AND SALEM, K. Main memory database systems: An overview. IEEE Trans. Knowl. Data Eng. 4, 6 (1992), 509-516.
31. GILL, P., JAIN, N., AND NAGAPPAN, N. Understanding network failures in data centers: measurement, analysis, and implications. In SIGCOMM (2011), pp. 350-361.
32. GLENDENNING, L., BESCHASTNIKH, I., KRISHNAMURTHY, A., AND ANDERSON, T. E. Scalable consistency in scatter. In SOSP (2011), pp. 15-28.
33. GRAY, J., AND PUTZOLU, G. R. The 5 minute rule for trading memory for disk accesses and the 10 byte rule for trading memory for cpu time. In Proceedings of the Association for Computing Machinery Special Interest Group on Management of Data 1987 Annual Conference, San Francisco, California, May 27-29, 1987 (1987), U. Dayal and I. L. Traiger, Eds., ACM Press, pp. 395-398.
34. GREENBERG, A. G., HAMILTON, J. R., JAIN, N., KANDULA, S., KIM, C., LAHIRI, P., MALTZ, D. A., PATEL, P., AND SENGUPTA, S. Vl2: a scalable and flexible data center network. Commun. ACM 54, 3 (2011), 95-104.
35. GUO, C., LU, G., LI, D., WU, H., ZHANG, X., SHI, Y., TIAN, C., ZHANG, Y., AND LU, S. Bcube: a high performance, server-centric network architecture for modular data centers. In SIGCOMM (2009), pp. 63-74.
36. GUPTA, T., LENERS, J. B., AGUILERA, M. K., AND WALFISH, M. Improving availability in distributed systems with failure informers. In Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2013, Lombard, IL, USA, April 2-5, 2013 (2013), pp. 427-441.
37. HAYASHIBARA, N., DÉFAGO, X., YARED, R., AND KATAYAMA, T. The φ accrual failure detector. In 23rd International Symposium on Reliable Distributed Systems (SRDS 2004), 18-20 October 2004, Florianpolis, Brazil (2004), pp. 66-78.
38. HERLIHY, M., AND WING, J. M. Linearizability: A correctness condition for concurrent objects. ACM Trans. Program. Lang. Syst. 12, 3 (1990), 463-492.
39. HUNT, P., KONAR, M., JUNQUEIRA, F. P., AND REED, B. Zookeeper: Wait-free coordination for internet-scale systems. In USENIX ATC (2010), pp. 1-14.
40. KALLMAN, R., KIMURA, H., NATKINS, J., PAVLO, A., RASIN, A., ZDONIK, S. B., JONES, E. P. C., MADDEN, S., STONEBRAKER, M., ZHANG, Y., HUGG, J., AND ABADI, D. J. Hstore: a high-performance, distributed main memory transaction processing system. PVLDB 1, 2 (2008), 1496-1499.
41. LENERS, J. B., WU, H., HUNG, W., AGUILERA, M. K., AND WALFISH, M. Detecting failures in distributed systems with the falcon spy network. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles 2011, SOSP 2011, Cascais, Portugal, October 23-26, 2011 (2011), pp. 279-294.
42. LIM, H., FAN, B., ANDERSEN, D. G., AND KAMINSKY, M. Silt: a memory-efficient, high-performance key-value store. In SOSP (2011), pp. 1-13.
43. MAHAJAN, P., SETTY, S. T. V., LEE, S., CLEMENT, A., ALVISI, L., DAHLIN, M., AND WALFISH, M. Depot: Cloud storage with minimal trust. In 9th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2010, October 4-6, 2010, Vancouver, BC, Canada, Proceedings (2010), pp. 307-322.
44. NIGHTINGALE, E. B., ELSON, J., FAN, J., HOFMANN, O., HOWELL, J., , AND SUZUE, Y. Flat datacenter storage. In OSDI (2012).
45. ONGARO, D., RUMBLE, S. M., STUTSMAN, R., OUSTERHOUT, J. K., AND ROSENBLUM, M. Fast crash recovery in ramcloud. In SOSP (2011), pp. 29-41.
46. OUSTERHOUT, J. K., AGRAWAL, P., ERICKSON, D., KOZYRAKIS, C., LEVERICH, J., MAZIÈRES, D., MITRA, S., NARAYANAN, A., PARULKAR, G. M., ROSENBLUM, M., RUMBLE, S. M., STRATMANN, E., AND STUTSMAN, R. The case for ramclouds: scalable high-performance storage entirely in dram. Operating Systems Review 43, 4 (2009), 92-105.
47. PAGH, R., AND RODLER, F. F. Cuckoo hashing. J. Algorithms 51, 2 (2004), 122-144.
48. ROSENBLUM, M., AND OUSTERHOUT, J. K. The design and implementation of a log-structured file system. In SOSP (1991), pp. 1-15.
49. RUMBLE, S. M., ONGARO, D., STUTSMAN, R., ROSENBLUM, M., AND OUSTERHOUT, J. K. It's time for low latency. In HotOS (2011).
50. SO, K. C. W., AND SIRER, E. G. Latency and bandwidthminimizing failure detectors. In Proceedings of the 2007 EuroSys Conference, Lisbon, Portugal, March 21-23, 2007 (2007), pp. 89-99.
51. STEVENS, C. E. At attachment 8 - ata/atapi command set. Technical Report 1699, Technical Committee T13 (2008).
52. WANG, Y., KAPRITSOS, M., REN, Z., MAHAJAN, P., KIRUBANANDAM, J., ALVISI, L., AND DAHLIN, M. Robustness in the salus scalable block store. In Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2013, Lombard, IL, USA, April 2-5, 2013 (2013), pp. 357-370.
53. WU, H., LU, G., LI, D., GUO, C., AND ZHANG, Y. Mdcube: a high performance network structure for modular data center interconnection. In CoNEXT (2009), J. Liebeherr, G. Ventre, E. W. Biersack, and S. Keshav, Eds., ACM, pp. 25-36.
54. ZAHARIA, M., DAS, T., LI, H., HUNTER, T., SHENKER, S., AND STOICA, I. Discretized streams: Fault-tolerant streaming computation at scale. In SOSP (2013).
55. ZHANG, Y., AND LIU, L. Distributed line graphs: A universal technique for designing dhts based on arbitrary regular graphs. IEEE Trans. Knowl. Data Eng. 24, 9 (2012), 1556-1569.
56. ZHANG, Y., POWER, R., ZHOU, S., SOVRAN, Y., AGUILERA, M. K., AND LI, J. Transaction chains: achieving serializability with low latency in geo-distributed storage systems. In SOSP (2013), pp. 276-291.