Predicting the performance of wide area data transfers

Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2002

Volumn , Issue , 2002, Pages 319-328

  Vazhkudai, S ^a,b   Schopf, J M ^a,c   Foster, I ^a,d  

^a ARGONNE NATIONAL LABORATORY   (United States)

^b UNIVERSITY OF MISSISSIPPI   (United States)

^c NORTHWESTERN UNIVERSITY   (United States)

^d THE UNIVERSITY OF CHICAGO   (United States)

Author keywords

data transfer prediction; Grids; information services; replica selection

Indexed keywords

EID: 84966628877     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2002.1015510     Document Type: Conference Paper

References (46)

1. V.S. Adve, Analyzing the Behavior and Performance of Parallel Programs, PhD Thesis, Technical Report TR1201, Department of Computer Science, University of Wisconsin, December 1993.
2. W. Allcock, J. Bester, J. Bresnahan, A. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, and S. Tuecke, Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing, IEEE Mass Storage Conference, 2001.
3. W. Allcock, I. Foster, V. Nefedova, A. Chevrenak, E. Deelman, C. Kesselman, A. Sim, A. Shoshani, B. Drach, and D. Williams, High-Performance Remote Access to Climate Simulation Data: A Challenge Problem for Data Grid Technologies, Proceedings of Supercomputing (SC'01), November, 2001.
4. S. Basu, A. Mukherjee, and S. Kilvansky, Time Series Models for Internet Traffic, Technical report GIT-CC-95-27, Georgia Institute of Technology, 1996.
5. N. Cardwell, S. Savage, and T. Anderson, Modeling the Performance of Short TCP Connections, Technical report, Computer Science Department, Washington University, November 1998.
6. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, and S. Tuecke, The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets, Journal of Network and Computer Applications, 23:187-200, 2001.
7. M. Cole, Algorithmic Skeletons: Structured Management of Parallel Computation, Pitman/MIT Press, 1989.
8. M.E. Crovella, Performance prediction and tuning of parallel programs, PhD Thesis, University of Rochester, 1999.
9. K. Czajkowski, S. Fitzgerald, I. Foster, and C. Kesselman, Grid Information Services for Distributed Resource Sharing, Proceedings of the Tenth IEEE International Symposium on High-Performance Distributed Computing (HPDC-10), IEEE Press, August 2001.
10. The Data Grid Project, http://www.eu-datagrid.org.
11. P. Dinda and D. O'Hallaron, Host Load Prediction Using Linear Models, Cluster Computing, Volume 3, no. 4, 2000.
12. th International Parallel Processing Symposium, 1997.
13. M. Faerman Alan Su, Rich Wolski, and Francine Berman, Adaptive Performance Prediction for Distributed Data-Intensive Applications, Proceedings of the ACM/IEEE SC99 Conference on High Performance Networking and Computing, Portland, Oregon, November 1999.
14. I. Foster and C. Kesselman, The Globus Project: A Status Report, Proceedings of IPPS/SPDP '98 Heterogeneous Computing Workshop, pp. 4-18, 1998.
15. GridFTP predictor Trace Data, http://www.mcs.anl.gov/~vazhkuda/Traces.
16. GridFTP Information Provider Schema, http://www.mcs.anl.gov/~vazhkuda/Schema.
17. N. Groschwitz and G. Polyzos, A Time Series Model of Long-Term Traffic on the NSFnet Backbone, Proceedings of the IEEE Conference on Communications (ICC'94), May 1994.
18. The GriPhyN Project, http://www.griphyn.org.
19. L. Guo and I. Matta, The War between Mice and Elephants, Technical report BU-CS-2001-005, Computer Science Department, Boston University, May 2001.
20. R. Haddad and T. Parsons, Digital Signal Processing: Theory, Applications, and Hardware, Computer Science Press, 1991.
21. M. Hafeez, A. Samar, and H. Stockinger, A Data Grid Prototype for Distributed Data Production in CMS, 7th International Workshop on Advanced Computing and Analysis Techniques in Physics Research (ACAT2000), October 2000.
22. M. Harchol-balter and A. Downey, Exploiting Process Lifetime Distributions for Dynamic Load Balancing, Proceedings of the 1996 Sigmetrics Conference on Measurement and Modeling of Computer Systems, 1996.
23. K. Holtman, Object Level Replication for Physics, Proceedings of 4th Annual Globus Retreat, Pittsburgh, July 2000.
24. W. Hoschek, J. Jaen-Martinez, A. Samar, and H. Stockinger, Data Management in an International Grid Project, 2000 International Workshop on Grid Computing (GRID 2000), Bangalore, India, December 2000.
25. T.A. Howes and M.C. Smith, LDAP Programming Directory-Enabled Application with Lightweight Directory Access Protocol. Technology Series, Macmillan, 1997.
26. The LIGO Experiment, http://www.ligo.caltech.edu/.
27. V. W. Mak and S. F. Lundstrom, Predicting the Performance of Parallel Computations, IEEE Transactions on Parallel and Distributed Systems, pp. 106-113, IEEE Computer Society Press, July, 1990.
28. D. Malon, E. May, S. Resconi, J. Shank, A. Vaniachine, T. Wenaus, and S. Youssef, Grid-enabled Data Access in the ATLAS Athena Framework, Proceedings of Computing and High Energy Physics 2001 (CHEP'01) Conference, 2001.
29. Mark J. Clement and Michael J. Quinn, Analytical Performance Prediction on Multicomputers, Proceedings of SuperComputing '93, 1993.
30. NetLogger: A Methodology for Monitoring and Analysis of Distributed Systems, http://www-didc.lbl.gov/NetLogger.
31. H. Newman and R. Mount, The Particle Physics Data Grid, www.cacr.caltech.edu/ppdg.
32. A. Samar and H. Stockinger, Grid Data Management Pilot (GDMP): A Tool for Wide Area Replication, IASTED International Conference on Applied Informatics (AI2001), Innsbruck, Austria, February 2001.
33. J. M. Schopf and F. Berman, Performance Prediction in Production Environments, Proceedings of IPPS/SPDP '98, 1998.
34. J.M. Schopf, Structural Prediction Models for High Performance Distributed Applications, Proceedings of the Cluster Computing Conference (CCC '97), March 1997.
35. X. Shen and A. Choudhary, A Multi-Storage Resource Architecture and I/O, Performance Prediction for Scientific Computing, Proceedings of the 9th IEEE Symposium on High Performance Distributed Computing, pp. 21-30. IEEE-Press, 2000.
36. W. Smith, I. Foster, and V. Taylor, Predicting Application Run Times Using Historical Information, Proceedings of the IPPS/SPDP '98 Workshop on Job Scheduling Strategies for Parallel Processing, 1998.
37. A. Thomasian and P. F. Bay, Analysis Queuing Network Models for Parallel Processing of Task Systems, IEEE Transactions on Computers c-35 12, December 1986.
38. I. Terekhov, R. Pordes, V. White, L. Lueking, L. Carpenter, H. Schellman, J. Trumbo, S. Veseli, and M. Vranicar, Distributed Data Access and Resource Management in the D0 SAM System, Proceedings of HPDC 2000, San Francisco, August 2000.
39. A. Tirumala, J. Ferguson, Iperf 1.2 - The TCP/UDP Bandwidth Measurement Tool, http://dast.nlanr.net/Projects/Iperf/, May 2001.
40. Universal Format for Logger Messages, http://www-didc.lbl.gov/NetLogger/draft-abela-ulm-05.txt.
41. S. Vazhkudai, S. Tuecke, and I. Foster, Replica Selection in the Globus Data Grid, Proceedings of the First IEEE/ACM International Conference on Cluster Computing and the Grid (CCGRID 2001), pp. 106-113, IEEE Computer Society Press, May 2001.
42. R. Wolski, Dynamically Forecasting Network Performance Using the Network Weather Service, Journal of Cluster Computing, Volume 1, pp. 119-132, January, 1998.
43. S. Yilmaz and I. Matta, On Class-based Isolation of UDP, Short-lived and Long-lived TCP Flows, Technical report BU-CS-2001-011, Computer Science Department, Boston University, June 2001.
44. M.J. Zaki, W. Li, and S. Parthasarathy, Customized Dynamic Load Balancing for Network of Workstations, Proceedings of HPDC'96, 1996.
45. Y. Zhang, L. Qiu, and S. Keshav, Speeding Up Short Data Transfers: Theory, Architecture Support, and Simulation Results, Proceedings of NOSSDAV 2000, Chapel Hill, N.C., June 2000.
46. Y. Zhang. L. Qiu, and S. Keshav, Optimizing {TCP} Start-up Performance, Technical report TR99-1731, Department of Computer Science, Cornell University, 1999.