VisageFS translucent directories: Efficient POSIX consistencies for wide-area workflows

Proceedings of the 17th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2009

Volumn , Issue , 2009, Pages 36-43

  Thiebolt, François ^a   Ortiz, Aureiien ^a   M'Zoughi, Abdelaziz ^a  

^a IRIT   (France)

Author keywords

[No Author keywords available]

Indexed keywords

CONSTANT TIME; FILE SYSTEMS; GRID ENVIRONMENTS; LOCK MECHANISM; STORAGE RESOURCES; VIRTUALISATION; WIDE AREA; WORK-FLOWS;

EID: 70349103807     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/pdp.2009.26     Document Type: Conference Paper

References (41)

1. I. Foster, C. Kesselman, and S. Tueke, "The anatomy of the grid - enabling scalable virtual organizations," Intl J. Supercomputer Applications, 2001.
2. O. Tatebe, Y. Morita, S. Matsuoka, N. Soda, and S. Sekiguchi, "Grid datafarm architecture for petascale data intensive computing," in CC- GRID '02: Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid. Washington, DC, USA: IEEE Computer Society, 2002, p. 102.
3. "The xtreemfs project," http://www.xtreemfs.org/.
4. Y. Saito, C. Karamanolis, M. Karlsson, and M. Mahalingam, "Taming aggressive replication in the pangaea wide-area file system," in OSDI '02: Proceedings of the 5th symposium on Operating systems design and implementation. New York, NY, USA: ACM, 2002, pp. 15-30.
5. E. Walker, "A distributed file system for a wide-area high performance computing infrastructure," in WORLDS'06: Proceedings of the 3rd conference on USENIX Workshop on Real, Large Distributed Systems. Berkeley, CA, USA: USENIX Association, 2006, pp. 9-9
6. C. Baru, R. Moore, A. Rajasekar, and M. Wan, "The sdsc storage resource broker," in CASCON '98: Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research. IBM Press, 1998, p. 5.
7. F. García-Carballeira, J. Carretero, A. Calderón, J. D. García, and L. M. Sanchez, "A global and parallel file system for grids," Future Gener. Comput. Syst., vol.23, no.1, pp. 116-122, 2007.
8. P. J. Braam, "Lustre: A scalable, high-performance file system," November 2002, cluster File System Incorporated.
9. P. H. Carns, W. B. Ligon Ill, R. B. Ross, and R. Thakur, "PVFS: A parallel file system for linux clusters," in Proceedings of the 4th Annual Linux Showcase and Conference. Atlanta, GA: USENIX Association, 2000, pp. 317-327. [Online]. Available: citeseer.ist.psu.edu/article/carns00pvfs.html
10. S. R. Soltis, T. M. Ruwart, and M. T. O'Keefe, "The Global File System," in Proceedings ofthe Fifth NASA Goddard Conference on Mass Storage Systems. College Park, MD: IEEE Computer Society Press, 1996, pp. 319-342. [Online]. Available: citeseer.ist.psu.edu/ soltis96global.html
11. "CXFS : A high performance multi-os san file system from sgi," Silicon Graphics Incorporated, Tech. Rep., July 2003.
12. F. Thiebolt, I. Frain, and A. M'zoughi, "Visage - virtualisation du stockage dans les grilles informatiques," in 16ème Rencontres Francophones en Parallélisme Architecture Systèm0e et Composant, April 2005, pp. 219-224.
13. F. Thiebolt, A. M'zoughi, and J. Jorda, "Visagefs - système de fichiers pour grilles à qos intégrées," in 17ème Rencontres Francophones en Parallélisme Architecture Système et Composant, October 2006, pp. 196-203.
14. S. Traboulsi, A. Ortiz, J. Jorda, and A. M'zoughi, "Admon: ViSaGe Administration And Monitoring Service For Storage Virtualization in Grid Environment," in IEEE International Conference on Information and Communication Technologies: from Theory to Applications (ICTTA), Damascus, Syria, 07/04/08-11/04/08, avril 2008, pp. 1-6.
15. F. Thiebolt, A. Ortiz, and A. M'zoughi, "Visagefs dynamic storage features for wide-area workflows," in PDCS '07: Proceedings of the 19th international conference on Parallel and Distributed Computing and Systems. ACTA press, November 2007, pp. 61-67.
16. X. Wei, W. W. Li, O. Tatebe, G. Xu, L. Hu, and J. Ju, "Implementing data aware scheduling in gfarm(r) using lsf(tm) scheduler plugin mechanism." in GCA, H. R. Arabnia and J. Ni, Eds. CSREA Press, 2005, pp. 3-10.
17. L. G. Valiant, "A bridging model for parallel computation," Commun. ACM, vol.33, no.8, pp. 103-111, 1990.
18. J. M. D. Hill, B. McColl, D. C. Stefanescu, M. W. Goudreau, K. Lang, S. B. Rao, T. Suel, T. Tsantilas, and R. H. Bisseling, "BSPlib: The BSP programming library," Parallel Computing, vol.24, no.14, pp. 1947-1980, 1998. [Online]. Available: citeseer.ist.psu.edu/hill98bsplib.html
19. "The filesystem in userpace (fuse) project," http://fuse.sourceforge.net/.
20. T. Anderson, M. Dahlin, J. Neefe, D. Pattterson, D. Roselli, and R. Wang, "xfs - serverless network file systems," in Proceedings ofthe 15th Symposium on Operating System Principles. ACM, Copper Mountain Resort, Colorado, December 1995, pp. 109-126. [Online]. Available: citeseer.ist.psu.edu/ anderson95serverless.html
21. "The gluster project," http://www.gluster.org/.
22. F. Cappello, F. Desprez, M. Dayde, E. Jeannot, Y. Jegou, S. Lanteri, N. Melab, R. Namyst, P. V.-B. Primet, O. Richard, E. Caron, J. Leduc, and G. Mornet, "Grid5000: a nation wide experimental grid testbed," in International Journal on High Performance Computing Applications, 2006.
23. "Grid5000, 5000 processors distributed in 9 sites France wide, for research in Grid Computing, eScience and Cyber-infrastructures," http://www.grid5000.org/.
24. P. d'Anfray and F. Simon, "Renater dark fibre project architecture," High Performance Distributed Computing, 2006 15th IEEE International Symposium on, pp. 383-384, 0-0 2006.
25. S. Hemminger, "Network emulation with netem," in LCA '05: Proceedings of Australia's National Linux Conference, April 2005.
26. M. R. Ebling, "Translucent cache management for mobile computing," Ph.D. dissertation, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, 1998.
27. M. Satyanarayanan, J. J. Kistler, P. Kumar, M. E. Okasaki, E. H. Siegel, and D. C. Steere, "Coda: A highly available file system for a distributed workstation environment," IEEE Transactions on Computers, vol.39, no.4, pp. 447-459, 1990. [Online]. Available: citeseer.ist.psu.edu/satyanarayanan90coda. html (Pubitemid 20702255)
28. Y. Saito and M. Shapiro, "Optimistic replication," ACM Comput. Surv., vol.37, no.1, pp. 42-81, 2005.
29. P. Reiher, J. Heidemann, D. Ratner, G. Skinner, and G. Popek, "Resolving file conflicts in the ficus file system," in USTC'94: Proceedings of the USENIX Summer 1994 Technical Conference on USENIX Summer 1994 Technical Conference. Berkeley, CA, USA: USENIX Association, 1994, pp. 12-12
30. J. D S Parker, G. J. Popek, G. Rudisin, A. Stoughton, B. J. Walker, E. Walton, J. M. Chow, D. Edwards, S. Kiser, and C. Kline, "Detection of mutual inconsistency in distributed systems," pp. 306-312, 1986.
31. J. Stribling, E. Sit, M. F. Kaashoek, J. Li, and R. Morris, "Don't give up on distributed file systems," in IPTPS'07 : Proc. of the 6th International Workshop on Peer-to-Peer Systems, February 2007.
32. D. Hitz, J. Lau, and M. Malcolm, "File system design for an NFS file server appliance," in Proceedings of the USENIX Winter 1994 Technical Conference, San Fransisco, CA, USA, 17-21 1994, pp. 235-246. [Online]. Available: citeseer.ist.psu.edu/hitz95file.html
33. J. H. Morris, M. Satyanarayanan, M. H. Conner, J. H. Howard, D. S. H. Rosenthal, and F. Donel, "Andrew: a distributed personal computing environment," Communications ofthe ACM, vol.29, no.3, pp. 184-201, March 1986.
34. B. Gronvall, A. Westerlund, and S. Pink, "The design of a multicast- based distributed file system," in OSDI'99: Proceedings of the 3rd symposium on Operating Systems Design and Implementation, 1999, pp. 251-264. [Online]. Available: citeseer.ist.psu.edu/gronvall99design.html
35. H. C. Rao and L. L. Peterson, "Accessing files in an internet: The jade file system," Software Engineering, vol.19, no.6, pp. 613-624, 1993. [Online]. Available: citeseer.ist.psu.edu/rao93accessing.html
36. F. Schmuck and R. Haskin, "GPFS: A shared-disk file system for large computing clusters," in Proc. ofthe First Conference on File and Storage Technologies (FAST), 2002, pp. 231-244. [Online]. Available: citeseer.ist.psu.edu/schmuck02gpfs.html
37. S. Fadden, "An introduction to gpfs version 3.2," IBM Corporation, White paper, September 2007, http://www- 03.ibm.com/systems/ clusters/software/whitepapers/gpf-intro.html.
38. P. Andrews, M. Buechli, R. Harkness, R. Hatzky, C. Jordan, H. Led- erer, R. Niederberger, A. Rimovsky, A. Schott, T. Soddemann, and V. Springel, "Exploring the hyper-grid idea with grand challenge applications: the deisa-teragrid interoperability demonstration," Challenges of Large Applications in Distributed Environments, 2006 IEEE, pp. 43-52, June 2006.
39. P. Andrews, P. Kovatch, and C. Jordan, "Massive high-performance global file systems for grid computing," in SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2005, p. 53.
40. O. Tatebe, N. Soda, Y. Morita, S. Matsuoka, and S. Sekiguchi, "Gfarm v2: A grid file system that supports high-performance distributed and parallel data computing," in CHEP '04: Proceedings of the 2004 Computing in High Energy and Nuclear Physics, 2004.
41. D. Thain, C. Moretti, and J. Hemmes, "Chirp: a practical global filesys- tem for cluster and grid computing," in Journal ofGrid Computing, ser. Lecture Notes in Computer Science. Springer Netherlands, February 2008.