Detecting bottlenecks in parallel DAG-based data flow programs

2010 3rd Workshop on Many-Task Computing on Grids and Supercomputers, MTAGS10

Volumn , Issue , 2010, Pages

  Battré, Dominic ^a   Hovestadt, Matthias ^a   Lohrmann, Björn ^a   Stanik, Alexander ^a   Warneke, Daniel ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COST EFFECTIVENESS; DATA HANDLING; DATA TRANSFER; EFFICIENCY; FAULT TOLERANCE; SUPERCOMPUTERS;

COMPUTE CLOUDS; COST EFFICIENCY; DATA FLOW PROGRAM; MASSIVELY PARALLELS; PARALLELIZATIONS; PROCESSING TIME; RESOURCE UTILIZATIONS; SHARED NOTHING;

PARALLEL FLOW;

EID: 79951836687     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/mtags.2010.5699429     Document Type: Conference Paper

References (28)

1. I. Raicu, I. Foster, and Y. Zhao, "Many-task computing for grids and supercomputers," in Many-Task Computing on Grids and Supercomputers, 2008. MTAGS 2008. Workshop on, Nov. 2008, pp. 1-11.
2. B. Fan, W. Tantisiriroj, L. Xiao, and G. Gibson, "DiskReduce: RAID for data-intensive scalable computing," in PDSW '09: Proceedings of the 4th Annual Workshop on Petascale Data Storage. New York, NY, USA: ACM, 2009, pp. 6-10.
3. The Apache Software Foundation, "Map/Reduce tutorial," http://hadoop. apache.org/common/docs/current/mapred-tutorial.html, 2010.
4. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: Distributed data-parallel programs from sequential building blocks," in Proceedings of the 2007 EuroSys Conference, 2007, pp. 59-72.
5. "Cascading," http://www.cascading.org/.
6. D. Battré, S. Ewen, F. Hueske, O. Kao, V. Markl, and D. Warneke, "Nephele/PACTs: A programming model and execution framework for web-scale analytical processing," in SoCC '10: Proceedings of the 1st ACM symposium on Cloud computing. New York, NY, USA: ACM, 2010, pp. 119-130.
7. Amazon Web Services LLC, "Amazon Elastic Compute Cloud (Amazon EC2)," http://aws.amazon.com/ec2/, 2009.
8. Rackspace US, Inc., "The Rackspace Cloud," http://www. rackspacecloud.com/, 2010.
9. D. Warneke and O. Kao, "Nephele: Efficient parallel data processing in the cloud," in MTAGS '09: Proceedings of the 2nd Workshop on Many- Task Computing on Grids and Supercomputers. New York, NY, USA: ACM, 2009, pp. 1-10.
10. D. Gottfrid, "Self-service, prorated super computing fun!" http://open.blogs.nytimes.com/2007/11/01/ self-service-prorated-super-computing- fun/, 2007.
11. Amazon Web Services LLC, "Amazon Elastic Block Storage (Amazon EBS)," http://aws.amazon.com/ebs/, 2009.
12. A. Kivity, "kvm: the Linux virtual machine monitor," in OLS '07: The 2007 Ottawa Linux Symposium, July 2007, pp. 225-230.
13. R. Russell, "virtio: towards a de-facto standard for virtual I/O devices," SIGOPS Oper. Syst. Rev., vol. 42, no. 5, pp. 95-103, 2008.
14. D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. Soman, L. Youseff, and D. Zagorodnov, "The Eucalyptus open-source cloud-computing system," in CCGRID '09: Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid. Washington, DC, USA: IEEE Computer Society, 2009, pp. 124-131.
15. "iText home page," http://www.itextpdf.com/, 2010.
16. A. Benoit, M. Cole, S. Gilmore, and J. Hillston, "Evaluating the performance of skeleton-based high level parallel programs," in The International Conference on Computational Science (ICCS 2004), Part III, LNCS. Springer Verlag, 2004, pp. 299-306.
17. L. Li and A. D. Malony, "Model-based performance diagnosis of master-worker parallel computations," in Euro-Par, ser. Lecture Notes in Computer Science, W. E. Nagel, W. V. Walter, and W. Lehner, Eds., vol. 4128. Springer, 2006, pp. 35-46.
18. G. Jung, G. S. Swint, J. Parekh, C. Pu, and A. Sahai, "Detecting bottle-neck in n-tier it applications through analysis," in DSOM, ser. Lecture Notes in Computer Science, R. State, S. van der Meer, D. O'Sullivan, and T. Pfeifer, Eds., vol. 4269. Springer, 2006, pp. 149-160.
19. S. Malkowski, M. Hedwig, J. Parekh, C. Pu, and A. Sahai, "Bottle-neck detection using statistical intervention analysis," in DSOM'07: Proceedings of the Distributed systems: operations and management 18th IFIP/IEEE international conference on Managing virtualization of networks and services. Berlin, Heidelberg: Springer-Verlag, 2007, pp. 122-134.
20. S. Malkowski, M. Hedwig, D. Jayasinghe, C. Pu, and D. Neumann, "CloudXplor: a tool for configuration planning in clouds based on empirical data," in SAC '10: Proceedings of the 2010 ACM Symposium on Applied Computing. New York, NY, USA: ACM, 2010, pp. 391-398.
21. A. Espinosa, T. Margalef, and E. Luque, "Automatic performance evaluation of parallel programs," in Parallel and Distributed Processing, 1998. PDP '98. Proceedings of the Sixth Euromicro Workshop on, Jan. 1998, pp. 43-49.
22. J. Subhlok and G. Vondran, "Optimal latency-throughput tradeoffs for data parallel pipelines," in SPAA '96: Proceedings of the eighth annual ACM symposium on Parallel algorithms and architectures. New York, NY, USA: ACM, 1996, pp. 62-71.
23. N. Vydyanathan, U. Catalyurek, T. Kurc, P. Sadayappan, and J. Saltz, "A duplication based algorithm for optimizing latency under throughput constraints for streaming workflows," in ICPP '08, the 37th International Conference Parallel Processing. Washington, DC, USA: IEEE Computer Society, 2008, pp. 254-261.
24. E. Cesar, J. Mesa, J. Sorribes, and E. Luque, "Modeling master-worker applications in POETRIES," in High-Level Parallel Programming Models and Supportive Environments, 2004. Proceedings. Ninth International Workshop on, Apr. 2004, pp. 22-30.
25. S. Malkowski, M. Hedwig, and C. Pu, "Experimental evaluation of N-tier systems: Observation and analysis of multi-bottlenecks," in Workload Characterization, 2009. IISWC 2009. IEEE International Symposium on, Oct. 2009, pp. 118-127.
26. A. Chanda, A. L. Cox, and W. Zwaenepoel, "Whodunit: transactional profiling for multi-tier applications," in EuroSys '07: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007. New York, NY, USA: ACM, 2007, pp. 17-30.
27. H. Kannan, M. Budiu, J. D. Davis, and G. Venkataramani, "Tuning SoCs using the global dynamic critical path," in SOC Conference, 2009. SOCC 2009. IEEE International, 2009, pp. 407-411.
28. G. Venkataramani, M. Budiu, T. Chelcea, and S. C. Goldstein, "Global critical path: a tool for system-level timing analysis," in DAC '07: Proceedings of the 44th annual Design Automation Conference. New York, NY, USA: ACM, 2007, pp. 783-786.