A duplication based algorithm for optimizing latency under throughput constraints for streaming workflows

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2008, Pages 254-261

  Vydyanathant, Naga ^a   Catalyurek, Umit ^b   Kurc, Tahsin ^b   Sadayappan, Ponnuswamy ^a   Saltz, Joel ^b  

^a Ohio State University

^b OHIO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION DOMAINS; COMMUNICATION MODELS; COMMUNICATION OVERHEADS; DATA PARALLELISMS; INPUT DATUMS; LOW LATENCIES; NOVEL ALGORITHMS; PERFORMANCE METRICS; PIPELINED SCHEDULES; RESPONSE TIMES; TASK DUPLICATIONS; THROUGHPUT CONSTRAINTS; TIME CONSTRAINTS; WORKFLOWS;

ALGORITHMS; APPLICATIONS; BENCHMARKING; INFORMATION THEORY; SCHEDULING; THROUGHPUT;

SCHEDULING ALGORITHMS;

EID: 55849147034     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2008.68     Document Type: Conference Paper

References (21)

1. T. F. Abdelzaher, E. M. Atkins, and K. G. Shin. Qos negotiation in real-time systems and its application to automated flight control. In Proc. of the IEEE Real-Time Technology and Applications Symposium (RTAS '97), page 228, 1997.
2. B. Agarwalla, N. Ahmed, D. Hilley, and U. Ramachandran. Streamline: A Scheduling Heuristic for Streaming Application on the Grid. In Proc. of the Multimedia Comp. and Networking Conf., 2006.
3. I. Ahmad and Y.-K. Kwok. On exploiting task duplication in parallel program scheduling. IEEE Trans, on Par. and Dist. Systems, 9(9):872-892, 1998.
4. A. Bar-Noy and C.-T. Ho. Broadcasting multiple messages in the multiport model. IEEE Trans. Par. Dist. Syst., 10(5):500-508, 1999.
5. A. Benpit, V. Rehn-Sonigo, and Y. Robert. Multi-criteria scheduling of pipeline workflows. Technical Report LIP RR-2007-32, 2007.
6. A. Benoit and Y. Robert. Mapping pipeline skeletons onto heterogeneous platforms. Technical Report LIP RR-2006-40, 2006.
7. A. Benoit and Y. Robert. Complexity results for throughput and latency optimization of replicated and data-parallel workflows. Technical Report LIP RR-2007-12, 2007.
8. D. Bozdag, F. Ozguner, E. Ekici, and U. Catalyurek. A task duplication based scheduling algorithm using partial schedules. In Proc. of the Intl. Conf. on Parallel Processing, pages 630-637, 2005.
9. A. Choudhary, W. Lio, D. Weiner, P. Varshney, R. Linderman, and M. Linderman. Design, implementation and evaluation of parallel pipelined stap on parallel computers. In Proc. of the Intl. Par. Proc. Symp., page 220, 1998.
10. M. R. Garey and D. S. Johnson. Computers and Intractability; A Guide to the Theory of NP-Completeness. W. H. Freeman & Co., USA, 1990.
11. F. Guirado, A.Ripoll, C. Roig, and E. Luque. Optimizing latency under throughput requirements for streaming applications on cluster execution. In Proc. of the IEEE Intl. Conf. on Cluster Comp., 2005.
12. J. Jonsson and J. Vasell. Real-time scheduling for pipelined execution of data flow graphs on a realistic multiprocessor architecture. In ICASSP-96: Proc. of the 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing, volume 6, pages 3314-3317, 1996.
13. V. S. Kumar, B. Rutt, T. Kurc, U. Catalyurek, J. Saltz, S. Chow, S. Lamont, and M. Martone. Imaging and visual analysis-large image correction and warping in a cluster environment. In Proc. of the Supercomputing Conf., page 79, 2006.
14. Y.-K. Kwok and I. Ahmad. Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Comput. Surv., 31(4):406-471, 1999.
15. S. B. Shukla and D. P. Agrawal. Scheduling pipelined communication in distributed memory multiprocessors for real-time applications. SIGARCH Comput. Archit. News, 19(3), 1991.
16. M. Spencer, R. Ferreira, M. Beynon, T. Kurc, U. Catalyurek, A. Sussman, and J. Saltz. Executing multiple pipelined data analysis operations in the grid. In Proc. of the Supercomputing Conf., 2002.
17. J. Subhlok and G. Vondran. Optimal latency-throughput tradeoffs for data parallel pipelines. In Proc. of the 8th ACM Symp. on Par. Algorithms and Arch., pages 62-71, 1996.
18. K. Vallerio. Task graphs for free. http://ziyang.ece.northwestern.edu/ tgff/maindoc.pdf.
19. N. Vydyanathan, Ü. V. Çatalyurek, T. M. Kurç, P. Sadayappan, and J. H. Saltz. Toward optimizing latency under throughput constraints for application workflows on clusters. In 13th Intl. Euro. Conf. on Par. and Dist. Computing, pages 173-183, 2007.
20. M. Yang, T. Gandhi, R. Kasturi, L. Coraror, O. Camps, and J. McCandless. Real-time obstacle detection system for high speed civil transport supersonic aircraft. In Proc. of the IEEE Nat. Aerospace and Electr. Conf., pages 595-601, 2000.
21. M.-T. Yang, R. Kasturi, and A. Sivasubramaniam. A pipeline-based approach for scheduling video processing algorithms on now. IEEE Trans. Par. Distrib. Syst., 14(2) : 119-130, 2003.