Optimizing latency and throughput of application workflows on clusters

Parallel Computing

Volumn 37, Issue 10-11, 2011, Pages 694-712

  Vydyanathan, Naga ^a   Catalyurek, Umit ^a,b   Kurc, Tahsin ^c   Sadayappan, Ponnuswamy ^a   Saltz, Joel ^c  

^a The Ohio State University   (United States)

^b OHIO STATE UNIVERSITY   (United States)

^c EMORY UNIVERSITY   (United States)

Author keywords

Data parallelism; Latency; Pipelined parallelism; Streaming applications; Task parallelism; Throughput

Indexed keywords

DATA PARALLELISM; LATENCY; PIPELINED-PARALLELISM; STREAMING APPLICATIONS; TASK PARALLELISM;

BENCHMARKING; COMMUNICATION; INFORMATION THEORY; OPTIMIZATION; PARALLEL PROCESSING SYSTEMS; SCHEDULING ALGORITHMS;

THROUGHPUT;

EID: 80053195132     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2010.05.003     Document Type: Conference Paper

References (36)

1. A. Choudhary, W. Lio, D. Weiner, P. Varshney, R. Linderman, M. Linderman, Design, implementation and evaluation of parallel pipelined STAP on parallel computers, in: Proceedings of the 12th International Parallel Processing Symposium, IEEE Computer Society, Washington, DC, USA, 1998, pp. 220-225.
2. V.S. Kumar, B. Rutt, T. Kurc, U. Catalyurek, J. Saltz, S. Chow, S. Lamont, M. Martone, Imaging and visual analysis - large image correction and warping in a cluster environment, in: Proceedings of the 2006 ACM/IEEE Conf. on Supercomputing, 2006, p. 79.
3. M. Yang, T. Gandhi, R. Kasturi, L. Coraror, O. Camps, J. McCandless, Real-time obstacle detection system for high speed civil transport supersonic aircraft, in: Proceedings of the IEEE National Aerospace and Electronics Conference, 2000, pp. 595-601. (Pubitemid 32873242)
4. N. Vydyanathan, Ü.V. atalyürek, T.M. Kur, P. Sadayappan, J.H. Saltz, Toward optimizing latency under throughput constraints for application workflows on clusters, in: 13th Intl. Euro. Conf. on Par. and Dist. Computing, 2007, pp. 173-183.
5. N. Vydyanathan, Ü.V. atalyürek, T. Kur, P. Sadayappan, J. Saltz, A duplication based algorithm for scheduling of streaming workflows, in: 37th Intl. Conf. on Parallel Processing, 2008.
6. M. Spencer, R. Ferreira, M. Beynon, T. Kurc, U. Catalyurek, A. Sussman, and J. Saltz Executing multiple pipelined data analysis operations in the grid Proceedings of the 2002 ACM/IEEE Conf. on Supercomputing 2002 IEEE Computer Society Press Los Alamitos, CA, USA 1 18
7. F. Guirado, A.Ripoll, C. Roig, E. Luque, Optimizing latency under throughput requirements for streaming applications on cluster execution, in: Proceedings of the IEEE Intl. Conf. on Cluster Computing, 2005.
8. B. Agarwalla, N. Ahmed, D. Hilley, U. Ramachandran, Streamline: A scheduling heuristic for streaming application on the grid, in: Proceedings of the 13th annual Multimedia Computing and Networking Conference, San Jose, CA, 2006.
9. S.B. Shukla, and D.P. Agrawal Scheduling pipelined communication in distributed memory multiprocessors for real-time applications ACM SIGARCH Computer Architecture News 19 3 1991
10. The placenta image analysis pipeline, .
11. M. Lee, W. Liu, V.K. Prasanna, A mapping methodology for designing software task pipelines for embedded signal processing, in: Proceedings of the Workshop on Embedded HPC Systems and Applications of IPPS/SPDP, 1998, pp. 937-944. (Pubitemid 128055466)
12. J. Jonsson, J. Vasell, Real-time scheduling for pipelined execution of data flow graphs on a realistic multiprocessor architecture, in: Proceedings of the 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 6, 1996, pp. 3314-3317.
13. S.L. Hary, and F. Ozguner Precedence-constrained task allocation onto point-to-point networks for pipelined execution IEEE Transactions on Parallel and Distributed Systems 10 8 1999 838 851
14. M.-T. Yang, R. Kasturi, and A. Sivasubramaniam A pipeline-based approach for scheduling video processing algorithms on now IEEE Transactions on Parallel and Distributed Systems 14 2 2003 119 130
15. A. Benoit, and Y. Robert Mapping pipeline skeletons onto heterogeneous platforms Journal of Parallel and Distributed Systems 68 6 2008 790 808
16. V. Suhendra, C. Raghavan, T. Mitra, Integrated scratchpad memory optimization and task scheduling for MPSoC architectures, in: ACM/IEEE International Conference on Compilers, Architecture, and Synthesis for Embedded Systems, 2005.
17. B. Agarwalla, N. Ahmed, D. Hilley, and U. Ramachandran Streamline: scheduling streaming applications in a wide area environment Multimedia Systems 13 1 2007 69 85 (Pubitemid 47150832)
18. L. Chen, and G. Agrawal Resource allocation in a middleware for streaming data MGC '04: Proceedings of the 2nd Workshop on Middleware for Grid Computing 2004 ACM New York, NY, USA 5 10
19. L. Chen, and G. Agrawal A static resource allocation framework for grid-based streaming applications: research articles Concurrency and Computation - Practice & Experience 18 6 2006 653 666
20. J. Subhlok, and G. Vondran Optimal latency-throughput tradeoffs for data parallel pipelines Proceedings of the 8th ACM Symposium on Parallel Algorithms and Architecture 1996 ACM Press New York, NY, USA 62 71
21. A.N. Choudhary, B. Narahari, D.M. Nicol, and R. Simha Optimal processor assignment for a class of pipelined computations IEEE Transactions on Parallel and Distributed Systems 5 4 1994 439 445
22. A. Benoit, Y. Robert, Complexity results for throughput and latency optimization of replicated and data-parallel workflows, in: Proceedings of the 2007 IEEE International Conference on Cluster Computing, 2007, pp. 497-506.
23. A. Benoit, V. Rehn-Sonigo, Y. Robert, Multi-criteria scheduling of pipeline workflows, in: Proceedings of the 2007 IEEE International Conference on Cluster Computing, 2007, pp. 515-524.
24. A. Benoit, H. Kosch, V. Rehn-Sonigo, Y. Robert, Bi-criteria pipeline mappings for parallel image processing, in: Computational Science - ICCS 2008, 8th International Conference, 2008, pp. 215-225.
25. A. Benoit, V. Rehn-Sonigo, Y. Robert, Optimizing latency and reliability of pipeline workflow applications, in: 22nd IEEE International Symposium on Parallel and Distributed Processing, 2008, pp. 1-10.
26. N. Vydyanathan, U. Catalyurek, T. Kurc, P. Sadayappan, J. Saltz, An Approach for Optimizing Latency under Throughput Constraints for Application Workflows on Clusters, Tech. Rep. OSU-CISRC-1/07-TR03, The Ohio State University, 2007.
27. Y.-K. Kwok, and I. Ahmad Static scheduling algorithms for allocating directed task graphs to multiprocessors ACM Computing Surveys 31 4 1999 406 471
28. B. Kruatrachue, and T. Lewis Grain size determination for parallel processing IEEE Software 5 1 1988 23 32 (Pubitemid 18596651)
29. C. Papadimitriou, and M. Yannakakis Towards an architecture independent analysis of parallel algorithms SIAM Journal of Computing 19 1990 322 328 (Pubitemid 20670116)
30. J. Colin, and P. Chretienne C.P.M. scheduling with small computation delays and task duplication Operations Research 1991 680 684
31. Y. Chung, and S. Ranka Application and performance analysis of a compile-time optimization approach for list scheduling algorithms on distributed-memory multiprocessors Proceedings of Supercomputing 1992 512 521
32. B. Shirazi, H. Chen, and J. Marquis Comparative study of task duplication static scheduling versus clustering and non-clustering techniques Concurrency: Practice and Experience 7 5 1995 371 390
33. I. Ahmad, and Y.-K. Kwok On exploiting task duplication in parallel program scheduling IEEE Transactions on Parallel and Distributed Systems 9 9 1998 872 892 (Pubitemid 128752026)
34. D. Bozda, U. Catalyurek, and F. Özgüner A task duplication based bottom-up scheduling algorithm for heterogeneous environments Proceedings of the 15th Heterogeneous Computing Workshop 2006 IEEE Computer Society
35. D. Bozda, F. Özgüner, and U. Catalyurek Compaction of schedules and a two-stage approach for duplication-based dag scheduling IEEE Transactions on Parallel and Distributed Systems 20 6 2009 857 871
36. K. Vallerio, Task graphs for free, 2003, .