Balancing the use of remote I/O versus staging in distributed environments

Proceedings of the 5th ICEIS Doctoral Consortium, DCEIS 2007 - In Conjunction with ICEIS 2007

Volumn , Issue , 2007, Pages 75-81

  Suslu, Ibrahim H ^a   Kosar, Tevfik ^a  

^a Louisiana State University   (United States)

Author keywords

Data intensive applications; Distributed environments; Grid computing; Remote I O; Staging

Indexed keywords

GRID COMPUTING; INFORMATION SYSTEMS;

APPLICATION DEVELOPERS; DATA ACCESS; DATA INTENSIVES; DATA STAGINGS; DATA-INTENSIVE APPLICATIONS; DISTRIBUTED APPLICATIONS; DISTRIBUTED ENVIRONMENTS; END-TO-END PERFORMANCE; GENERIC MODELS; PERFORMANCE MODELS; REMOTE DATUM; REMOTE I/O; STAGING;

APPLICATIONS;

EID: 61849178042     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Kosar, T., 2005. Data Placement in Widely Distributed Systems Ph.D. Thesis, University of Wisconsin-Madison.
2. Sandberg, R., Goldberg, D., Kleiman, S., Walsh, D., and Lyon, B., 1985. Design and implementation of the Sun network file system. In Proc. Summer USENIX, pages 119- 130.
3. Morris, J., Satyanarayanan, M., Conner, M., Howard, J., Rosenthal, D., and Smith F., 1986. A distributed personal computing environment. Communications of the ACM, 29(3): 184-201.
4. Foster, I., Kohr, D., Krishnaiyer, R., Mogill, J., 1997. Remote I/O: Fast Access to Distant Storage. Proc. Workshop on I/O in Parallel and Distributed Systems (IOPADS),pp. 14-25.
5. Thain,D., Bent, J., Arpaci-Dusseau, A., Arpaci-Dusseau, R., and Livny, M., 2001. Gathering at the well: Creating communities for grid I/O. In Proc. of SC2001.
6. Vahdat, A., Eastham, P., and Anderson, T., 1996. WebFS: A global cache coherent flesystem. Technical report, Department of Computer Science, UC Berkeley.
7. Alexandrov, A. D., Ibel, M., Schauser, K. E., and Scheiman, C. J., 1997. Extending the operating system at the user level: The UFO global file system. In 1997 Annual Technical Conference on UNIX and Advanced Computing Systems (USENIX'97).
8. Tierney, B., Johnston, W., Chen, L., Herzog, H., Hoo, G., Jin, G., and Lee, J., 1994. Distributed parallel data storage systems: A scalable approach to high speed image servers. In Proc. ACM Multimedia 94. ACM Press.
9. Buddhikot, M., Parulkar, G., and Cox, J., 1994. Design of a large scale multimedia storage server. In Proc. INET '94.
10. Nieuwejaar N., and Kotz, D., 1997. The Galley parallel file system. Parallel Computing, 23(4):447-476.
11. Corbett, P., Feitelson, D., Prost, J. P., and Baylor, S., 1993. Overview of the Vesta parallel file system. In IPPS '93 Workshop on Input/Output in Parallel Computer Systems, pages 1-16.
12. Bennett, R., Bryant, K., Sussman, A., Das, R., and Saltz, J., 1994. Jovian: A framework for optimizing parallel I/O. In Proceedings of the 1994 Scalable Parallel Libraries Conference, pages 10-20. IEEE Computer Society Press.
13. Corbett, P., Feitelson, D., Hsu, Y., Prost, J. P., Snir, M., Fineberg, S., Nitzberg, B., Traversat, B., and Wong, P., 1995. MPI-IO: A parallel file I/O interface for MPI. Technical Report NAS-95-002, NAS, NASA Ames Research Center, Mofiett Field, CA, Version 0.3.
14. Litzkow, M., Livney, M., and Mutka, M., 1988. Condor a hunter of idle workstations. In Proc. 8th Intl Conf. on Distributed Computing Systems, pages 104-111.
15. Thakur, R., Gropp, W., and Lusk, E., 1996. An abstract-device interface for implementing portable parallel-I/O intervaces. In Proceeding of the Symposium on the Frontiers of Massively Parallel Computation.
16. Thakur, R., Gropp, W., and Lusk, E., 1999. Data sieving and collective I/O in ROMIO. In proceeding of the Symposium on the Frontiers of Massively Parallel Computation.
17. Lee, J., Ross, R., Atchley, S., Beck, M., and Thakur, R., 2006. MPI-IO/L: Efficient Remote I/O for MPI-IO via Logistical Networking. In Proc. of the 20th IEEE Int'l Parallel and Distributed Processing Symposium (IPDPS 2006).
18. Lee, J., Ma, X., Ross, R., Thakur, R., and Winslett, M., 2004. RFS: Efficient and Flexible Remote File Access for MPI-IO. In Proc. of the IEEE Int'l Conference on Cluster Computing (Cluster 2004).
19. Lee, J., Ma, X., Winslett, M., and Yu, S., 2002. Active buffering plus compresses migration: An integrated solution to parallel simulations' data transport needs. In Proceedings of the International Conference on Supercomputing.
20. Stone, N. T. B., Balog, D., Gill, B., Johanson, B., Marsteller, J., Nowoczynski, P., Porter, D., Reddy, R., 2006. PDIO: High-Performance Remote File I/O for Portals Enabled Compute Nodes. In Proceedings of the 2006 Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, NV.
21. Bent, J., Thain, D., Arpaci-Dusseau, A., Arpaci-Dusseau, R., and Livny, M., 2004. Explicit Control in a Batch Aware Distributed File System. Proceedings of the First USENIX/ACM Conference on Networked Systems Design and Implementation, San Francisco, CA.
22. Blanchet, C, Mollon R., Thain, D., Deleage, G., 2006. Grid Deployment of Lagesy Bioinformatics Applications with Transparent Data Access. IEEE Conference on Grid Computing.
23. Wang Y., and Kaeli, D., 2005. Load Balancing using Grid-based Peer-to-Peer Parallel I/O. Proceedings of the IEEE Cluster Computing Conference.
24. Ali, N., Lauria, M., 2006. Improving the Performance of Remote I/O using Asynchronous Primitives. HPDC-15.
25. Postel, J., Reynolds, J., 1985. File Transfer Protocol (ftp). RFC 0959.
26. Allcock, W., 2003. Gridftp protocol specification. Global grid forum Recommrndation GFD.20.
27. Madduri, R. K., Hood, C. S., Allcock, W. E., 2002. Reliable File Transfer in Grid Environments. Proceedings of the 27th Annual IEEE Conference on Local Computer Networks (LCN'02).
28. Thain, D., Basney, J., Son, S. C, Livny, M., 2001. The Kangaroo Approach to Data Movement on the Grid. In Proc. of the 10th IEEE Symposium on High performance Distributed Computing (HPDC10) (San Francisco, CA). IEEE CS Press, Los Alamitos, CA, USA.
29. Foster, I., and Kesselman, C, 1997. Globus: A Metacomputing Infrastructure Toolkit. Intl. J. Supercomputer Applications, 11(2):115-128.
30. Kosar, T., and Livny, M., 2004. Stork: Making Data Placement a First Class Citizen in the Grid. In International Conference on Distributed Computing Systems.
31. Plank, J., Beck, M., R. Elwasif, W., Moore, T., 1996. The Internet Backplane Protocol: Storage in the Network. In Proceedings of the 1999 Network Storage Symposium NetStore99, Seattle, WA, USA.
32. Koranda, S., and Moe, B., 2003. Lightweight Data Replicator. http://www.lscgroup.phys.uwm.edu/lscdatagrid/LDR/ overview.html.
33. Stockinger, H., 2005. Data Management in Data Grids Habilitation Overview. Research Lab for Computational Technologies and Applications.
34. Stockinger, H., Stockinger, K., Schikuta, E., Willers, I., 2001. Towards a Cost Model for Distributed and Replicated Data Stores. 9th Euromicro Workshop on Parallel and Distributed Processing (PDP 2001), IEEE Computer Society Press, Mantova, Italy, February 7-9.
35. Laure, E., Stockinger, H., Stockinger, K., 2005. Performance Engineering in Data Grids Journal of Concurrency and Computation: Practice and Experience, Wiley Press, 17(2-4): 171-191.
36. Shivam, P., Babu, S., Chase, J., 2006. Active and Accelerated Learning of Cost Models for Optimizing Scientific Applications. International Conference on Very Large Data Bases (VLDB).