Exploiting replication and data reuse to efficiently schedule data-intensive applications on grids

Lecture Notes in Computer Science

Volumn 3277, Issue , 2005, Pages 210-232

  Santos Neto, Elizeu ^a   Cirne, Walfredo ^a   Brasileiro, Francisco ^a   Lima, Aliandro ^a  

^a FEDERAL UNIVERSITY OF CAMPINA GRANDE   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER NETWORKS; DATA STORAGE EQUIPMENT; HEURISTIC METHODS; INFORMATION RETRIEVAL; KNOWLEDGE ACQUISITION; SCHEDULING;

COMPUTATIONAL GRIDS; DATA-INTENSIVE APPLICATIONS; REPLICATION STRATEGY; STORAGE AFFINITY;

DATA TRANSFER;

EID: 23944488273     PISSN: 03029743     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1007/11407522_12     Document Type: Conference Paper

References (29)

1. P. Lyman, Hal R. Varian, J. Dunn, A. Strygin and K. Swearingen. How much information ?, http://www.sims.berkeley.edu/research/projects/how-much-info- 2003, October, 2003.
2. S. F. Altschul, W. Gish, W. Miller, E. W. Myers and D. J. Lipman. Basic local alignment search tool. Journal of Molecular Biology, vol. 1, 215, pp. 403-410, 1990.
3. GriPhyN Group. http://www.GriPhyN.org, 2002, http://www.GriPhyN.org.
4. E. L. Santos-Neto, L. E. F. Tenório, E. J. S. Fonseca, S. B. Cavalcanti and J. M. Hickmann. Parallel Visualization of the optical pulse through a doped optical fiber. in Proceedings of Annual Meeting of the Division of Computational Physics (abstract), June, 2001.
5. W. Cirne, D. Paranhos, L. Costa, E. Santos-Neto, F. Brasileiro, J. Sauvé, F. A. B. da Silva, C. O. Barros and C. Silveira. Running Bag-of-Tasks Applications on Computational Grids: The MyGrid Approach, in Proceedings of the ICCP'2003 - International Conference on Parallel Processing, October, 2003.
6. J. Smith and S. K. Shrivastava. A System for Fault-Tolerant Execution of Data and Compute Intensive Programs over a Network of Workstations, Lecture Notes in Computer Science, vol. 1123, pp. 487-495, 1996.
7. I. Foster and C. Kesselman (eds.). The Grid: Blueprint for a Future Computing Infrastructure, 1999.
8. O. Beaumont, L. Carter, J. Ferrante and Y. Robert. Bandwidth-centric Allocation of Independent Task on Heterogeneous Plataforms, in Proceedings of the Interactional Parallel and Distributed Processing Symposium, April, 2002.
9. H. Casanova, A. Legrand, D. Zagorodnov and F. Herman. Heuristics for Scheduling Parameter Sweep Applications in Grid environments, in Proceedings of the 9th Heterogeneous Computing Workshop, May, 2000.
10. M. Faerman, A. Su, R. Wolski and Francine Berman. Adaptive Performance Prediction for Distributed Data-Intensive Applications, in Proceedings of the ACM/IEEE SC99 Conference on High Performance Networking and Computing, 1999.
11. K. Marzullo, M. Ogg, A. Ricciardi, A. Amoroso, A. Calkins and E. Rothfus. NILE: Wide-Area Computing for High Energy Physics, in Proceedings 7th ACM European Operating Systems Principles Conference. System Support for Worldwide Applications", September, 1996.
12. D. Paranhos and W. Cirne and F. Brasileiro. Trading Cycles for Information: Using Replication to Schedule Bag-of-Tasks Applications on Computational Grids, in Proceedings of the Euro-Par 2003: International Conference on Parallel and Distributed Computing, August, 2003.
13. Z. M. Kedem and K. V. Palem and P. G. Spirakis. Efficient Robust Parallel Computations (Extended Abstract), in Proceedings of ACM Symposium on Theory of Computing, 1990.
14. M. Pinedo. Scheduling: Theory, Algorithms and Systems, 2nd edition, August, 2001.
15. A. Downey. Predicting queue times on space-sharing parallel computers, in Proceedings of 11th International Parallel Processing Symposium (IPPS'97), April, 1997.
16. R. Gibbons. A Historical Application Profiler for Use by Parallel Schedulers, Lecture Notes in Computer Science, vol. 1291, pp. 58-77, 1997.
17. W. Smith, I. Foster and V. Taylor. Predicting Application Run Times Using Historical Information, Lecture Notes in Computer Science, vol. 1459, pp. 122-142, 1998.
18. R. Wolski, N. Spring and J. Hayes. Predicting the CPU Availability of Time-shared Unix Systems on the Computational Grid, in Proceedings of 8th International Symposium on High Performance Distributed Computing (HPDC'99), August, 1999.
19. P. Francis, S. Jamin, V. Paxson, L. Zhang, D. F. Gryniewicz and Y. Jim. An Architecture for a Global Internet Host Distance Estimation Service, in Proceedings of IEEE INFOCOM, 1999.
20. O. H. Ibarra and C. E. Kim. Heuristic Algorithms for Scheduling Independent Tasks on Nonidentical Processors, Journal of the ACM (JACM), vol. 24, n. 2, pp. 280-289, 1977.
21. D. Feitelson and L. Rudolph. Metrics and Benchmarking for Parallel Job Scheduling, in Proceedings of Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science, vol. 1459, pp. 1-24, 1998.
22. D. G. Feitelson. Metric and workload effects on computer systems evaluation, Computer, vol. 36(9), pp. 18-25, September, 2003.
23. V. Lo, J. Mache and K. Windisch. A Comparative Study of Real Workload Traces and Synthetic Workload Models for Parallel Job Scheduling, in Proceedings of Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science, vol. 1459, pp. 25-46, 1998.
24. R. Wolski, N. T. Spring and J. Hayes. The network weather service: a distributed resource performance forecasting service for metacomputing, Future Generation Computer Systems, vol. 15, numbers 5-6, pp. 757-768, 1999.
25. H. Casanova. Simgrid: A Toolkit for the Simulation of Application Scheduling, in Proceedings of the First IEEE/ACM International Symposium on Cluster Computing and the Grid, May, 2001.
26. J. L. Devore. Probability and Statistics for Engineering and The Sciences, vol. 1, 2000.
27. MyGrid Site, http://www.ourgrid.org/mygrid, 2004.
28. BLAST Webpage. http://www.ncbi.nlm.nih.giv/BLAST.
29. J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells and B. Zhao. OceanStore: An Architecture for Global-Scale Persistent Storage, in Proceedings of the Ninth International Conference on Architectural Support for Programming Languages and Operating Systems, November, 2000.