Robust data placement in urgent computing environments

IPDPS 2009 - Proceedings of the 2009 IEEE International Parallel and Distributed Processing Symposium

Volumn , Issue , 2009, Pages

  Cope, Jason M ^a   Trebon, Nick ^c   Tufo, Henry M ^a   Beckman, Pete ^b  

^a UCB 450   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

^c THE UNIVERSITY OF CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL RESOURCES; COMPUTING ENVIRONMENTS; DATA PLACEMENT; DATA RESOURCES; RESOURCE SELECTION; RESOURCE USAGE; SCHEDULING HEURISTICS; URGENT COMPUTING; WORK-FLOWS;

COMPUTER SCIENCE; DISTRIBUTED PARAMETER NETWORKS;

MANAGEMENT;

EID: 70450104076     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2009.5160914     Document Type: Conference Paper

References (31)

1. S. Ali, A. Maciejewski, H. Siegel, and J. Kim. Measuring the robustness of a resource allocation. IEEE Transactions on Parallel and Distributed Systems, 15(1), July 2004.
2. P. Beckman, I. Beschatnikh, S. Nadella, and N. Trebon. Building an Infrastructure for Urgent Computing. High Performance Computing and Grids in Action, 2007.
3. P. Bogden, T. Gale, G. Allen, J. MacLaren, G. Almes, G. Creager, J. Bintz, L. Wright, H. Graber, N. Williams, S. Graves, H. Conover, K. Galluppi, R. Luettich, W. Perrie, B. Toulany, Y. Sheng, J. Davis, H.Wang, and D. Forrest. Architecture of a Community Infrastructure for Predicting and Analyzing Coastal Inundation. Marine Technology Society Journal, 41(1):53-71, 2007.
4. L. Cannon and E. Jeannot. A comparison of robustness metrics for scheduling dags on heterogeneous systems. In Procedings of the 2007 IEEE International Conference on Cluster Computing, September 2007.
5. A. Chervenak, E. Deelman, M. Livny, M. Su, R. Schuler, S. Bharathi, G. Mehta, and K. Vahi. Data placement for scientific applications in distributed environments. In Proceedings of the 8th IEEE/ACM International Conference on Grid Computing (Grid 2007), September 2007.
6. J. Cope and H. Tufo. A Data Management Framework for Urgent Geoscience Workflows. In Proceedings of the International Conference on Computational Science (ICCS 2008), June 2008.
7. J. Cope and H. Tufo. Adapting grid services for urgent computing environments. In Proceedings of the 2008 International Conference on Software and Data Technologies (ICSOFT 2008), July 2008.
8. J. Cope and H. Tufo. Supporting storage resources in urgent computing environments. In Proceedings of the 2008 IEEE International Conference on Cluster Computing (Cluster 2008), September 2008.
9. K. Czajkowski, I. Foster, N. Karonis, C. Kesselman, S. Martin, W. Smith, and S. Tuecke. A resource management architecture for metacomputing systems. In Proceedings of the IPPS/SPDP 1998 Workshop on Job Scheduling Strategies for Parallel Processing, 1998.
10. N. Desai, E. Lusk, A. Cherry, and T. Voran. The computer as software component: A mechanism for developing and testing resource management software. In Proceedings of IEEE Cluster 2007, 2007.
11. K. Droegemeier, V. Chandrasekar, R. Clark, D. Gannon, S. Graves, E. Joesph, M. Ramamurthy, R. Wilhelmson, K. Brewster, B. Domenico, T. Leyton, V. Morris, D. Murray, B. Pale, R. Ramachandran, D. Reed, J. Rushing, D.Weber, A. Wilson, M. Xue, and S. Yalda. Linked Environments for atmospheric discovery (LEAD): A Cyberinfrastructure for Mesoscale Meteorology Research and Education. In Proceedings of the 20th Conference on Interactive Information Processing Systems for Meteorology, Oceanography, and Hydrology, Seattle,WA, January 2004. American Meteorological Society.
12. I. Foster. Globus toolkit version 4: Software for serviceoriented systems. In IFIP International Conference on Network and Parallel Computing, 2005.
13. R. Henderson. Job scheduling under the portable batch system. In Proceedinsg of the Workshop on Job Scheduling Strategies for Parallel Processing, 1995.
14. D. Katramatos, D. Yu, B. Gibbard, and S. McKee. The TeraPaths Testbed: Exploring End-to-End Network QoS. In 2007 3rd International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities (TridentCom 2007), May 2007.
15. K. Kennedy. Why Performance Models Matter for Grid Computing. Grid Based Problem Solving Environments, 239:19-29, 2007.
16. G. Kola, T. Kosar, and M. Livny. Run-time adaptation of grid data placement jobs. In In Proceedings of the International Workshop on Adaptive Grid Middleware, 2003.
17. T. Kosar and M. Livny. Stork: Making data placement a first class citizen in the grid. In Proceedings of 24th IEEE International Conference on Distributed Computing Systems (ICDCS2004), Tokyo, Japan, March 2004.
18. J. MacLaren. Harc: The highly-available resource coallocator. In In Proceedings of International Symposium on Grid computing, high-performAnce and Distributed Applications 2007 (GADA07), 2007.
19. A. Mehta, J. Smith, H. Siegel, A. Maciejewski, A. Jayaseelan, and B. Ye. Dynamic resource allocation heuristics that manage tradeoff between makespan and robustness. Journal of Supercomputing, 42(1), 2007.
20. D. Nurmi, J. Brevik, and R.Wolski. QBETS: Queue Bounds Estimation from Time Series. In Proceedings of the 13th Workshop on Job Scheduling Strategies for Parallel Processing, June 2007.
21. D. Nurmi, A. Mandal, J. Brevik, C. Koelbel, R. Wolski, and K. Kennedy. Evaluation of a workflow scheduler using integrated performance modeling and batch queue wait time prediction. In Proceedings of the 2006 IEEE International Conference on Supercomputing (IEEE SC06), Novemember 2006.
22. D. Nurmi, R. Wolski, and J. Brevik. Probabilistic advanced reservations for batch-scheduled parallel machines. In Proceedings of the 13th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2008.
23. I. Raicu, Y. Zhao, C. Dumitrescu, I. Foster, and M. Wilde. Falkon: a fast and light-weight task execution framework. I Proceedings of IEEE/ACM SuperComputing 2007, 2007.
24. A. Ramakrishnan, G. Singh, H. Zhao, E. Deelman, R. Sakellariou, K. Vahi, K. Blackburn, D. Meyers, and M. Samidi. Scheduling data-intensive workflows onto storage-constrained distributed resources. In Procceedings of the 7th IEEE International Symposium on Cluster Computing and the Grid 2007 (CCGrid 2007), 2007.
25. K. Ranganathan and I. Foster. Simulation studies of computation and data scheduling algorithms for data grids. Journal of Grid Computing, 1(1), March 2003.
26. V. Shestak, H. Siegel, A. Maciejewski, and S. Ali. Robust resource allocations in parallel computing systems: Models and heuristics. Proceedings of the 8th International Symposium on Parallel Architectures,Algorithms and Networks, 2005.
27. D. Thain, T. Tannenbaum, and M. Livny. Distributed computing in practice: the condor experience. Concurrency - Practice and Experience, 17(2-4):323-356, 2005.
28. N. Trebon. Deadline-based grid resource selection for urgent computing. Master's thesis, University of Chicago, 2008.
29. N. Trebon and P. Beckman. Empirical-based probabilistic upper bounds for urgent computing applications. In Proceedings of the 2008 IEEE International Conference on luster Computing (Cluster 2008), September 2008.
30. R. Wolski, G. Obertelli, M. Allen, D. Numri, and J. Brevik. Predicting grid resource performance on-line. Handbook of Innovative Computing: Models, Enabling Technologies, and Applications, 2005.
31. W. Xiaohui, W. Li, O. Tatebe, G. X, H. Liang, and J. Jiubin. Implementing data aware scheduling in gfarm using lsf scheduler plugin mechanism. In Proceedings of the 2005 International Conference on Grid Computing and Applications (GCA'05), 2005.