CernVM-FS - Delivering scientific software to globally distributed computing resources

NDM'11 - Proceedings of the 2011 International Workshop on Network-Aware Data Management, Co-located with SC'11

Volumn , Issue , 2011, Pages 49-56

  Blomer, Jakob ^a   Buncic, Predrag ^a   Fuhrmann, Thomas ^b  

^a CERN   (Switzerland)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Algorithms; Performance; Reliability

Indexed keywords

COMPUTING CLUSTERS; COMPUTING FACILITIES; COMPUTING RESOURCE; DATA INTEGRITY; DISSEMINATION PROTOCOLS; DISTRIBUTED COMPUTING RESOURCES; DISTRIBUTED MEMORY; FILE SYSTEMS; HETEROGENEOUS RESOURCES; HOME-PCS; LARGE HADRON COLLIDER; LARGE-SCALE DEPLOYMENT; LHC COMPUTING GRIDS; PERFORMANCE; PRE-PROCESSING SOFTWARE; PROCESS DATA; SCIENTIFIC SOFTWARES; WORKER NODES;

ALGORITHMS; DISTRIBUTED COMPUTER SYSTEMS; EXPERIMENTS; FAULT TOLERANCE; INFORMATION MANAGEMENT; RELIABILITY; RELIABILITY ANALYSIS;

SOFTWARE RELIABILITY;

EID: 84857950870     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2110217.2110225     Document Type: Conference Paper

References (32)

1. R. Ahlswede et al. Fault-tolerant minimum broadcast networks. Networks, 27(4):293-308, 1996. (Pubitemid 126091458)
2. T. E. Anderson et al. Serverless network file systems. ACM Transactions on Computer Systems, 14(1):41-79, February 1996. (Pubitemid 126418621)
3. I. Bird et al. LHC computing grid: Technical design report. Technical Report LCG-TDR-001, CERN, 2005.
4. K. Birman. The promise, and limitations, of gossip protocols. ACM SIGOPS Operating Systems Review, 41(5):8-13, October 2007.
5. K. P. Birman et al. Bimodal multicast. ACM Transactions on Computer Systems (TOCS), 17(2):41-88, May 1999. (Pubitemid 129541506)
6. J. Blomer and T. Fuhrmann. A fully decentralized file system cache for the CernVM-FS. In Proc. 10th int. conf. on Computer and Communications Networks (ICCCN), August 2010.
7. P. Buncic et al. CernVM: a virtual appliance for LHC applications. Journal of Physics: Conference Series, 219, 2010.
8. F. Chang et al. Bigtable: A distributed storage system for structured data. In Proc. of the 7th Conf. on USENIX Symposium on Operating Systems Design and Implementation, pages 205-218, 2006.
9. G. Compostella et al. CDF software distribution on the grid using Parrot. Journal of Physics: Conference Series, 219, 2010.
10. G. DeCandia et al. Dynamo: Amazon's highly available key-value store. ACM SIGOPS Operating Systems Review, 41(6):205-220, 2007. (Pubitemid 351429377)
11. A. Dorigo, P. Elmer, F. Furano, and A. Hanushevsky. XROOTD - a highly scalable architecture for data access. WSEAS Transactions on Computers, 4(4):348-353, April 2005. (Pubitemid 40760830)
12. P. Druschel and A. Rowstron. PAST: A large-scale, persistent peer-to-peer storage utility. In Proc. of the Eighth Workshop on Hot Topics in Operating Systems, pages 75-81, 2001.
13. L. Dusseault. HTTP Extensions for Web Distributed Authoring and Versioning (WebDAV). RFC 4918, Internet Engineering Task Force, June 2007.
14. P. Eugster et al. Epidemic information dissemination in distributed systems. Computer, 37(5):60-67, 2004.
15. P. T. Eugster, R. Guerraoui, S. B. Handurukande, and P. Kouznetsov. Lightweight probabilistic broadcast. ACM Transactions on Computer Systems, 21(4):341-374, November 2003.
16. L. Fan, P. Cao, J. Almeida, and A. Z. Broder. Summary cache: A scalable wide-area web cache sharing protocol. IEEE/ACM Transactions on Networking, 8(3):281-293, June 2000.
17. W. Feller. An Introduction to Probability Theory and Its Applications, volume 1. Wiley, 1968.
18. B. Fitzpatrick. Distributed caching with memcached. Linux Journal, 2004(124), 2004.
19. B. Fitzpatrick et al. Camlistore. http://camlistore.org.
20. S. M. Hedetniemi, S. T. Hedetniemi, and A. L. Liestman. A survey of gossiping and broadcasting in communication networks. Networks, 18(4):319-349, 1988.
21. S. Iyer, A. Rowstron, and P. Druschel. Squirrel: a decentralized peer-to-peer web cache. In PODC '02: Proceedings of the twenty-first annual symposium on Principles of distributed computing, pages 213-222, New York, NY, USA, 2002. ACM.
22. R. Královič and R. Královič. Rapid almost-complete broadcasting in faulty networks. Theoretical Computer Science, 410(14):1377-1387, March 2009.
23. K. Kutzner. The Decentralized File System Igor-FS as an Application for Overlay-Networks. PhD thesis, University of Karlsruhe, 2008.
24. A. Lakshman and P. Malik. Cassandra: structured storage system on a p2p network. In Proceedings of the 28th ACM symposium on Principles of distributed computing, 2009.
25. L. Lamport. The part-time parliament. ACM Transactions on Computer Systems, 16(2):133-169, 1998. (Pubitemid 128482394)
26. R. Melhem. Low diameter interconnections for routing in high-performance parallel systems. IEEE Transactions on Computers, 56(4):502-510, Apr 2007. (Pubitemid 46523082)
27. J. H. Morris et al. Andrew: A distributed personal computing environment. Communications of the ACM, 29(3):184-201, 1986.
28. A. Muthitacharoen et al. Ivy: A read/write peer-to-peer file system. ACM SIGOPS Operating Systems Review, 36(SI):31-44, 2002.
29. M. N. Nelson, B. B. Welch, and J. K. Ousterhout. Caching in the Sprite network file system. ACM Transactions on Computer Systems, 6(1):134-154, February 1988.
30. P. Sarkar and J. Hartman. Efficient cooperative caching using hints. ACM SIGOPS Operating Systems Review, 30(SI):35-46, 1996.
31. T. Schütt, F. Schintke, and A. Reinefeld. Scalaris: reliable transactional p2p key/value store. Proceedings of the 7th ACM SIGPLAN workshop on ERLANG, pages 41-48, 2008.
32. B. Segal et al. LHC cloud computing with CernVM. PoS, ACAT(004), 2010.