Smoke and mirrors: Reflecting files at a geographically remote location without loss of performance

Proceedings of the 7th USENIX Conference on File and Storage Technologies, FAST 2009

Volumn , Issue , 2009, Pages 211-224

  Weatherspoon, Hakim ^a   Ganesh, Lakshmi ^a   Marian, Tudor ^a   Balakrishnan, Mahesh ^b   Birman, Ken ^a  

^a Computer Science Department ^*  (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FILE ORGANIZATION; MIRRORS;

DATACENTER; DISASTER RECOVERY; FILE SHARING; FILE SYSTEMS; LOSS OF PERFORMANCE; REMOTE LOCATION; ROUND-TRIP TIME;

SMOKE;

EID: 85006521569     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (44)

1. Cornell national lambda rail (nlr) rings testbed. http://www.cs.cornell.edu/~hweather/nlr.
2. Firewalling, nat, and packet mangling for linux. http://www.netfilter.org. Last accessed Jan. 2009.
3. National lambda rail. http://www.nlr.net.
4. AGUILERA, M. K., KEETON, K., A, M., MUNISWAMYREDDY, K., AND UYSAL, M. Improving recoverability in multi-tier storage systems. In Proc. of DSN (2007).
5. ANDERSON, T., DAHLIN, M., NEEFE, J., PATTERSON, D., ROSELLI, D., AND WANG, R. Serverless Network File Systems. In Proc. of ACM SOSP (Dec. 1995).
6. AZAGURY, A., FACTOR, M., AND MICKA, W. Advanced functions for storage subsystems: Supporting continuous availability. An IBM SYSTEM Journal, 2003.
7. BAIRAVASUNDARAM, L., GOODSON, G., PASUPATHY, S., AND SCHINDLER, J. An analysis of latent sector errors in disk drives. In Proc. of ACM SIGMETRICS (June 2007).
8. BAKER, M., SHAH, M., ROSENTHAL, D. S. H., ROUSSOPOULOS, M., MANIATIS, P., GIULI, T., AND BUNGALE, P. A fresh look at the reliability of long-term digital storage. SIGOPS Oper. Syst. Rev. 40, 4 (2006), 221–234.
9. BALAKRISHNAN, M., BIRMAN, K., PHANISHAYEE, A., AND PLEISCH, S. Ricochet: Lateral error correction for time-critical multicast. In NSDI (Apr. 2007).
10. BALAKRISHNAN, M., MARIAN, T., BIRMAN, K., WEATHERSPOON, H., AND VOLLSET, E. Maelstrom: Transparent error correction for lambda networks. In NSDI (2008).
11. BYERS, J. W., LUBY, M., MITZENMACHER, M., AND REGE, A. A digital fountain approach to reliable distribution of bulk data. SIGCOMM Comput. Commun. Rev. 28, 4 (1998), 56–67.
12. CORP, E. Symmetrix remote data facility. http://www.emc.com/products/family/srdf-family.htm. Last accessed Jan. 2009.
13. COUGIAS, D., HEIBERGER, E., AND KOOP, K. The backup book: disaster recovery from desktop to data center. Schaser-Vartan Books, Lecanto, FL, 2003.
14. GHEMAWAT, S., GOBIOFF, H., AND LEUNG, S. The google file system. In Proc. of ACM SOSP (Oct. 2003), pp. 29–43.
15. GUNAWI, H. S., PRABHAKARAN, V., KRISHNAN, S., ARPACI-DUSSEAU, A. C., AND ARPACI-DUSSEAU, R. H. Improving file system reliability with i/o shepherding. In Proc. of ACM SOSP (Oct. 2007).
16. HARTMAN, J. H., AND OUSTERHOUT, J. K. The zebra striped network file system. ACM TOCS (1995).
17. HITZ, D., LAU, J., AND MALCOLM, M. File system design for an NFS file server appliance. In Proceedings of the USENIX Technical Conference (1994).
18. HUITEMA, H. The case for packet level FEC. In Proc. of the IFIP Workshop on Protocols for High-Speed Networks (Oct. 1996).
19. JI, M., VEITCH, A., AND WILKES, J. Seneca: Remote mirroring done write. In Proc. of USENIX FAST (June 2003).
20. KEETON, K., BEYER, D., BRAU, E., MERCHANT, A., SANTOS, C., AND ZHANG, A. On the road to recovery: Restoring data after disasters. In Proc. of ACM EuroSys (Apr. 2006).
21. KEETON, K., AND MERCHANT, A. A framework for evaluating storage system dependability. In Proc. of DSN (Washington, DC, USA, 2004), IEEE Computer Society, p. 877.
22. KEETON, K., SANTOS, C., BEYER, D., CHASE, J., AND WILKES, J. Designing for disasters. In Proc. of USENIX FAST (Berkeley, CA, USA, 2004), USENIX Association, pp. 59–62.
23. LEE, E. K., AND THEKKATH, C. A. Petal: Distributed virtual disks. In Proc. of ACM ASPLOS (1996), pp. 84–92.
24. LEUNG, S. A., MACCORMICK, J., PERL, S. E., AND ZHANG, L. Myriad: Cost-effective disaster tolerance. In Proc. of USENIX FAST (Jan. 2002).
25. LISKOV, B., GHEMAWAT, S., GRUBER, R., JOHNSON, P., SHRIRA, L., AND WILLIAMS, M. Replication in the harp file system. In Proc. of ACM SIGOPS (1991).
26. MANIATIS, P., ROUSSOPOULOS, M., GIULI, T. J., ROSENTHAL, D. S. H., AND BAKER, M. The LOCKSS peer-to-peer digital preservation system. ACM TOCS (2005).
27. MATTHEWS, J., ROSELLI, D., COSTELLO, A., WANG, R., AND ANDERSON, T. Improving the performance of log-structured file systems with adaptive methods. In Proc. of ACM SOSP (1997).
28. NONNENMACHER, J., BIERSACK, E. W., AND TOWSLEY, D. Parity-based loss recovery for reliable multicast transmission. IEEE/ACM Transactions on Networking 6, 4 (1998), 349–361.
29. ORACLE. Berkeley db java edition architecture. An Oracle White Paper, Sept. 2006. http://www.oracle.com/database/ berkeleydb/je/index.html.
30. PARSONS, D. S., PERETTI, B., AND GROCHOW, J. M. Closing the gap: A research and development agenda to improve the resiliency of the banking and finance sector. In U.S. Department of the Treasury Study (Mar. 2005).
31. PATTERSON, H., MANLEY, S., FEDERWISCH, M., HITZ, D., KLEIMAN, S., AND OWARA, S. Snapmirror: File system based asynchronous mirroring for disaster recovery. In Proc. of USENIX FAST (Jan. 2002).
32. PLANK, J. S., BASSI, A., BECK, M., MOORE, T., SWANY, D. M., AND WOLSKI, R. Managing data storage in the network. IEEE Internet Computing 5, 5 (September/October 2001), 50–58.
33. RIZZO, L. Effective erasure codes for reliable computer communication protocols. ACM Computer Communication Review (1997).
34. RIZZO, L., AND VICISANO, L. RMDP: An fec-based reliable multicast protocol for wireless environments. In ACM SIGCOMM Mobile Computer and Communication Review (New York, NY, USA, 1998), vol. 2, ACM Press, pp. 22–31.
35. ROSENBLUM, M., AND OUSTERHOUT, J. K. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems 10, 1 (1992), 26–52.
36. SCHROEDER, B., AND GIBSON, G. A. Disk failures in the real world: what does an mttf of 1,000,000 hours mean to you? In Proc. of USENIX FAST (2007).
37. THEKKATH, C., MANN, T., AND LEE, E. Frangipani: A scalable distributed file system. In Proc. of ACM SOSP (1997).
38. VITERBI, A. Error bounds for convolutional codes and an asymptotically optimal decoding algorithm. IT 13 (1967), 260–269.
39. WEATHERSPOON, H., EATON, P., CHUN, B., AND KUBIATOWICZ, J. Antiquity: Exploiting a secure log for wide-area distributed storage. In Proc. of ACM EuroSys (2007).
40. WHITE, B., LEPREAU, J., STOLLER, L., RICCI, R., GURUPRASAD, S., NEWBOLD, M., HIBLER, M., BARB, C., AND JOGLEKAR, A. An integrated experimental environment for distributed systems and networks. In Proc. of USENIX OSDI (2002).
41. WITTY, R. J., AND SCOTT, D. Disaster recovery plans and systems are essential. Gartner Research Gartner FirstTake: FT-14-5021 (September 12 2001).
42. YAN, R., SHU, J., AND CHAN WEN, D. An implementation of semi-synchronous remote mirroring system for sans. In ACM Workshop of Grid and Cooperative Computing (GCC) (2004).
43. YEUNG, R. W., AND ZHANG, Z. Distributed source coding for satellite communications. IEEE Transactions on Information Theory 45, 4 (May 1999), 1111–1120.
44. YOU, L. L., POLLACK, K. T., AND LONG, D. D. E. Deep store: an archival storage system architecture. In Proc. 21st International Conference on Data Engineering (ICDE) (Apr. 2005).