A hypergraph partitioning based approach for scheduling of tasks with batch-shared I/O

2005 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2005

Volumn 2, Issue , 2005, Pages 792-799

  Khanna, Gaurav ^a   Vydyanathan, Nagavijayalakshmi ^a   Kurc, Tahsin ^b   Catalyurek, Umit ^b   Wyckoff, Pete ^c   Saltz, Joel ^b   Sadayappan, P ^a  

^a Ohio State University   (United States)

^b OHIO STATE UNIVERSITY   (United States)

^c OHIO SUPERCOMPUTER CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BATCH-SHARED I/O BEHAVIOR; FILE TRANSFER; REMOTELY-SENSED DATA;

DATA REDUCTION; DATA TRANSFER; INPUT OUTPUT PROGRAMS; MEDICAL IMAGING; REMOTE SENSING;

GRAPH THEORY;

EID: 33845325178     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2005.1558643     Document Type: Conference Paper

References (17)

1. H. Andrade, T. Kurc, A. Sussman, and J. Saltz. Scheduling multiple data visualization query workloads on a shared memory machine. In Proceedings of the 2002 IEEE International Parallel and Distributed Processing Symposium (IPDPS 2002), Fort Lauderdale, FL, April 2002.
2. S. Bokhari, B. Rutt, P. Wyckoff, and P. Buerger. An evaluation of the osc fastt600 turbo storage pool. Technical Report OSUBMI_TR_2004_n02, The Ohio State University, Department of Biomedical Informatics, Sep 2004.
3. H. Casanova, G. Obertelli, F. Berman, and R. Wolski. The AppLeS parameter sweep template: User-level middleware for the grid. In Proceedings of the 2000 ACM/IEEE SC00 Conference, pages 75-76, 2000.
4. H. Casanova, D. Zagorodnov, F. Berman, and A. Legrand. Heuristics for scheduling parameter sweep applications in grid environments. In Proceedings of the 9th Heterogeneous Computing Workshop (HCW'00), pages 349-363, 2000.
5. U. V. Catalyürek and C. Aykanat. Hypergraph-partitioning based decomposition for parallel sparse-matrix vector multiplication. IEEE Transactions on Parallel and Distributed Systems, 10(7):673-693, 1999.
6. C. Chang, T. Kurc, A. Sussman, U. Catalyurek, and J. Saltz. A hypergraph-based workload partitioning strategy for parallel data aggregation. In Proceedings of the Eleventh SIAM Conference on Parallel Processing for Scientific Computing. SIAM, Mar. 2001.
7. C. Chang, B. Moon, A. Acharya, C. Shock, A. Sussman, and J. Saltz. Titan: A high performance remote-sensing database. In Proceedings of the 1997 International Conference on Data Engineering, pages 375-384. IEEE Computer Society Press, Apr. 1997.
8. C. Faloutsos and S. Roseman. Fractals for secondary key retrieval. In the 8th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, Philadelphia, PA, Mar. 1989.
9. A. Giersch, Y. Robert, and F. Vivien. Scheduling tasks sharing files from distributed repositories. In Euro-Par 2004: Parallel Processing: 10th International Euro-Par Conference, volume 3149 of Lecture Notes in Computer Science, pages 246-253, Sept. 2004.
10. A. Giersch, Y. Robert, and F. Vivien. Scheduling tasks sharing files on heterogeneous master-slave platforms. In PDF'2004, 12th Euromicro Workshop on Parallel, Distributed and Network-based Processing, pages 364-371, 2004.
11. O. Ibarra and C. Kim. Heuristic algorithms for scheduling independent tasks on nonindentical processors. Journal of the ACM, 24(2):280-289, Apr 1977.
12. R. Jain, K. Somalwar, J. Werth, and J. Browne. Heuristics for scheduling i/o operations. IEEE Transactions on Parallel and Distributed Systems, 8(3):310-320, Mar 1997.
13. K. Kaya and C. Aykanat. Iterative-improvement-based heuristics for adaptive scheduling of tasks sharing files on heterogeneous master-slave environments. IEEE Transactions on Parallel and Distributed Systems, 2005. accepted subject to minor revision.
14. K. Ranganathan and I. Foster. Decoupling computation and data scheduling in distributed data-intensive applications. In Proceedings of the Eleventh IEEE Symposium on High Performance Distributed Computing (HPDC), Edinburgh, Scotland, July 2002.
15. D. Thain, J. Bent, A. Arpaci-Dusseau, R. Arpaci-Dusseau, and M. Livny. Pipeline and batch sharing in grid workloads. In Proceedings of High-Performance Distributed Computing (HPDC-12), pages 152-161, Seattle, Washington, June 2003.
16. M. Uysal, T. M. Kurc, A. Sussman, and J. Saltz. A performance prediction framework for data intensive applications on large scale parallel machines. In Proceedings of the Fourth Workshop on Languages, Compilers and Runtime Systems for Scalable Computers, number 1511 in Lecture Notes in Computer Science, pages 243-258. Springer-Verlag, May 1998.
17. N. Vydyanathan, G. Khanna, T. Kurc, U. Catalyurek, P. Wyckoff, J. Saltz, and P. Sadayappan. Use of pvfs for efficient execution of jobs with pipeline-shared i/o. In Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing (Grid 2004), 2004.