Task scheduling and file replication for data-intensive jobs with batch-shared I/O

Proceedings of the IEEE International Symposium on High Performance Distributed Computing

Volumn 2006, Issue , 2006, Pages 241-252

  Khanna, Gaurav ^a   Vydyanathan, Nagavijayalakshmi ^a   Catalyurek, Umit ^b   Kurc, Tahsin ^b   Krishnamoorthyt, Sriram ^a   Sadayappan, P ^a   Saltz, Joel ^b  

^a Dept of Computer Science and Engineering ^*

^b OHIO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BATCH-SHARED I/O BEHAVIOR; COMPUTE CLUSTERS; DATA REPLICATION; HYPERGRAPH PARTITIONING;

DATA STORAGE EQUIPMENT; FILE ORGANIZATION; HEURISTIC METHODS; NETWORK PROTOCOLS; PROBLEM SOLVING; SCHEDULING;

INPUT OUTPUT PROGRAMS;

EID: 33845869918     PISSN: 10828907     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. J. Bent, D. Rotem, A. Romosan, and A. Shoshani. Coordination of Data Movement with Computation Scheduling on a Cluster. In Workshop on Challenges of Large Applications in Distributed Environments (CLADE2005), pages 25-34, Research Triangle Park, NC, July 2005. IEEE Computer Society Press.
2. M. Berkelaar, K. Eikland, and P. Notebaert. lp-solve open source mixed integer linear programming system. In Version 5.5.0.7, May 2005. http://lpsolve.sourceforge.net/5.5/.
3. S. Bokhari, B. Rutt, P. Wyckoff, and P. Buerger. An evaluation of the OSC FAStT600 Turbo storage pool. Technical Report OSUBMI_TR_2004_n02, Dept. of Biomedical Informatics, The Ohio State University, 2004. http://web.bmi.ohio- state.edu/resources/techreports/OSUBMI_TR_2004_n02.pdf.
4. H. Casanova, D. Zagorodnov, F. Berman, and A. Legrand. Heuristics for scheduling parameter sweep applications in grid environments. In 9th Heterogeneous Computing Workshop (HCW'00), pages 349-363, Cancun, Mexico, 2000. IEEE Computer Society.
5. U. Catalyurek and C. Aykanat. Hypergraph-partitioningbased decomposition for parallel sparse-matrix vector multiplication. IEEE Trans. on Parallel and Distributed Systems., 10(7): 673-693, 1999.
6. U. V. Çatalyürek and C. Aykanat. PaToH: A Multilevel Hypergraph Partitioning Tool, Version 3.0. Bilkent University, Department of Computer Engineering, Ankara, 06533 Turkey. PaToH is available at http://bmi.osu.edu/~umit/software.htm, 1999.
7. C. Chang, B. Moon, A. Acharya, C. Shock, A. Sussman, and J. H. Saltz. Titan: A high-performance remote sensing database. In Proc. of the 13th International Conference on Data Engineering (ICDE1997), pages 375-384, Washington, DC, USA, 1997. IEEE Computer Society.
8. F. Desprez and A. Vernois. Simultaneous Scheduling of Replication and Computation for Bioinformatic Applications on the Grid. In Workshop on Challenges of Large Applications in Distributed Environments (CLADE2005), pages 66-74, Research Triangle Park, NC, July 2005. IEEE Computer Society Press.
9. C. Faloutsos and S. Roseman. Fractals for secondary key retrieval. In Proc. of the 8th ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems (PODS 1989), pages 247-252, New York, USA, 1989.
10. G. Khanna, N. Vydyanathan, T. Kurc, U. Catalyurek, P. Wyckoff, J. Saltz, and P. Sadayappan. A hypergraph partitioning based approach for scheduling of tasks with batch-shared I/O. In Proc. of the 5th IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2005), May 2005.
11. S. Krishnamoorthy, U. Catalyurek, J. Nieplocha, and P. Sadayappan. An approach to locality-conscious load balancing and transparent memory hierarchy management with a global-address-space parallel programming model. In Proc. of 20th International Parallel and Distributed Processing Symposium (IPDPS), Workshop on Performance Optimization for High-Level Languages and Libraries (POHLL), Rhodes Island, Greece, 2006. to appear.
12. M. Maheswaran, S. Ali, H. J. Siegel, D. A. Hensgen, and R. F. Freund. Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems. In 8th Heterogeneous Computing Workshop (HCW'99), pages 30-44, San Juan, Puerto Rico, 1999. IEEE Computer Society.
13. K. Ranganathan and I. T. Foster. Decoupling computation and data scheduling in distributed data-intensive applications. In Proc. of the 11th IEEE International Symposium on High Performance Distributed Computing (HPDC2002), Edinburgh, UK, pages 352-358, 2002.
14. D. Thain, J. Bent, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, and M. Livny. Pipeline and batch sharing in grid workloads. In Proc. of the 12th International Symposium on High-Performance Distributed Computing (HPDC 2003), Seattle, USA, pages 152-161, 2003.
15. M. Uysal, T. M. Kurc, A. Sussman, and J. Saltz. A performance prediction framework for data intensive applications on large scale parallel machines. In Proc. of the 4th Workshop on Languages, Compilers and Runtime Systems for Scalable Computers, Lecture Notes in Computer Science, Vol. 1511, pages 243-258. Springer-Verlag, May 1998.