Optimizing load balancing and data-locality with data-aware scheduling

Proceedings - 2014 IEEE International Conference on Big Data, IEEE Big Data 2014

Volumn , Issue , 2014, Pages 119-128

  Wang, Ke ^a   Zhou, Xraobing ^b   Li, Tonglin ^a   Zhao, Dongfang ^a   Lang, Michael ^c   Raicu, Ioan ^a,d  

^a ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

^b Hortonworks Inc   (United States)

^c LOS ALAMOS NATIONAL LABORATORY   (United States)

^d ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Data aware scheduling; Data intensive computing; Key value stores; Many task computing; Work stealing

Indexed keywords

MULTITASKING; SCHEDULING;

DATA LOCALITY; DATA-AWARE SCHEDULING; DATA-INTENSIVE COMPUTING; DISTRIBUTED TASKS; KEY-VALUE STORES; LOAD BALANCING TECHNIQUE; LOAD DATA; LOAD-BALANCING; MANY-TASK COMPUTING; WORK STEALING;

BENCHMARKING;

EID: 84921748797     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigData.2014.7004220     Document Type: Conference Paper

References (56)

1. I. Raicu, I. Foster, Y. Zhao. "Many-Task Computing for Grids and Supercomputers", Invited Paper, IEEE MTAGS 2008.
2. V. Sarkar, S. Amarasinghe, et al. "ExaScale Software Study: Software Challenges in Extreme Scale Systems", ExaScale Computing Study, DARPA IPTO, 2009.
3. X. Besseron and T. Gautier. "Impact of Over-Decomposition on Coordinated Checkpoint/Rollback Protocol", Euro-Par 2011: Parallel Processing Workshops, Lecture Notes in Computer Science Volume 7156, 2012, pp 322-332.
4. D. Zhao, D. Zhang, K. Wang, I. Raicu. "Exploring reliability of exascale systems through simulations." ACM HPC 2013.
5. M. A. Jette, A. B. Yoo, M. Grondona. "SLURM: Simple Linux utility for resource management." Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP) 2003.
6. D. Thain, T. Tannenbaum, M. Livny, "Distributed Computing in Practice: The Condor Experience" Concurrency and Computation: Practice and Experience 17 (2-4), pp. 323-356, 2005.
7. W. Gentzsch, et. al. "Sun Grid Engine: Towards Creating a Compute Power Grid," 1st International Symposium on Cluster Computing and the Grid, 2001.
8. Cobalt: http: //trac.mcs.anl.gov/projects/cobalt, 2014.
9. I. Raicu, Y. Zhao et al. "Falkon: A Fast and Light-weight tasK executiON Framework," IEEE/ACM SC 2007.
10. I. Raicu. "Many-Task Computing: Bridging the Gap between High Throughput Computing and High Performance Computing", ISBN: 978-3-639-15614-0, VDM Verlag Dr. Muller Publisher, 2009.
11. I. Raicu, Z. Zhang, M. Wilde, I. Foster, P. Beckman, K. Iskra, B. Clifford. "Toward Loosely Coupled Programming on Petascale Systems", IEEE/ACM Supercomputing 2008.
12. M. H. Willebeek-LeMair, A. P. Reeves. "Strategies for dynamic load balancing on highly parallel computers," In IEEE Transactions on Parallel and Distributed Systems, volume 4, September 1993.
13. R. D. Blumofe and C. E. Leiserson. "Scheduling multithreaded computations by work stealing", Symposium on Foundations of Computer Science 1994.
14. K. Wang, A. Rajendran, K. Brandstatter, Z. Zhang, I. Raicu. "Paving the Road to Exascale with Many-Task Computing", Doctoral Showcase, IEEE/ACM Supercomputing/SC 2012.
15. K. Wang, K. Brandstatter, I. Raicu. "SimMatrix: Simulator for MAny-Task computing execution fabRIc at eXascales," ACM HPC 2013.
16. K. Wang, J. Munuera, I. Raicu, H. Jin. "Centralized and Distributed Job Scheduling System Simulation at Exascale." Tech Report, IIT, 2011.
17. A. S. Szalay et al. "GrayWulf: Scalable Clustered Architecture for Data-Intensive Computing", Proceedings of the 42nd Hawaii International Conference on System Sciences, Hawaii, 5 to 8 January 2009, paper no. 720; available as Microsoft Tech Report MSR-TR-2008-187 at http: //research.microsoft.com/apps/pubs/default.aspx?id=79429.
18. J. D. Ullman. "NP-complete scheduling problems", Journal of Computer and System Sciences, Volume 10 Issue 3, June, 1975, Pages 384-393.
19. Gibson, G., Grider, G., Jacobson, A. and Lloyd, W. "PRObE: A thousand-node experimental cluster for computer systems research." Usenix;login: 38, 3 (2013).
20. D. Chase, Y. Lev. "Dynamic circular work-stealing deque", Proceedings of the seventeenth annual ACM symposium on Parallelism in algorithms and architectures (SPAA'05), 2005, pp 21-28.
21. T. Li, X. Zhou, et al. "ZHT: A Light-weight Reliable Persistent Dynamic Scalable Zero-hop Distributed Hash Table", IPDPS, 2013.
22. K. Wang, A. Rajendran, I. Raicu. "MATRIX: MAny-Task computing execution fabRIc at eXascale," tech report, IIT, 2013.
23. K. Wang, A. Kulkarni, M. Lang, D. Arnold, I. Raicu. "Using Simulation to Explore Distributed Key-Value Stores for Extreme-Scale Systems Services," IEEE/ACM Supercomputing/SC 2013.
24. K. Wang, A. Kulkami, M. Lang, I. Raicu. "Exploring Design Tradeoffs for Exascale System Services through Simulation." Tech Report, Los Alamos National Laboratory, 2013.
25. J. Dinan, D. B. Larkins. "Scalable work stealing", IEEE/ACM SC 2009.
26. V. G. Cerf, R. E. Kahn. "A Protocol for Packet Network Intercommunication," IEEE Transactions on Communications 22 (5): 637-648, May 1974.
27. K. Shvachko, H. Huang, S. Radia, R. Chansler. "The hadoop distributed file system", in: 26th IEEE (MSST2010) Symposium on Massive Storage Systems and Technologies, May, 2010.
28. A. Bialecki, et al. "Hadoop: A Framework for Running Applications on Large Clusters Built of Commodity Hardware", http: //lucene.apache.org/hadoop/, 2005.
29. Google. "Google Protocol Buffers," available at http: //code.google.com/apis/protocolbuffers/, 2014.
30. I. Raicu, Y. Zhao, et al. "Accelerating Large-scale Data Exploration through Data Diffusion", International Workshop on Data-Aware Distributed Computing 2008, co-locate with ACM/IEEE HPDC 2008.
31. Christopher Moretti, Hoang Bui, Karen Hollingsworth, Brandon Rich, Patrick Flynn, and Douglas Thain. 2010. All-Pairs: An Abstraction for Data-Intensive Computing on Campus Grids. IEEE Trans. Parallel Distrib. Syst. 21, 1 (January 2010), 33-46.
32. I. Raicu, I. Foster, et al. "The Quest for Scalable Support of Data Intensive Workloads in Distributed Systems", ACM HPDC 2009.
33. G. Zhang, E. Meneses, A. Bhatele, and L. V. Kale. "Hierarchical Load Balancing for Charm++ Applications on Large Supercomputers", Conference on Parallel Processing Workshops, ICPPW10, 2010.
34. K. Wang, Z. Ma, I. Raicu. "Modeling Many-Task Computing Workloads on a Petaflop IBM Blue Gene/P Supercomputer." IEEE 27th International Parallel and Distributed Processing Symposium Workshops &PhD Forum (IPDPSW) 2013.
35. K. Ousterhout, P. Wendell, M. Zaharia, I. Stoica. "Sparrow: distributed, low latency scheduling", Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, SOSP'13, pp. 69-84.
36. B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. Katz, S. Shenker, and I. Stoica. "Mesos: A PlatformFor Fine-Grained Resource Sharing in the Data Center", NSDI 2011.
37. M. Isard, V. Prabhakaran, et al. "Quincy: fair scheduling for distributed computing clusters", Proceedings of the ACM Symposium on Operating Systems Principles, SOSP'09, pp. 261-276.
38. M. Isard, M. Budiu, et al. "Dryad: Distributed data-parallel programs from sequential building blocks", In Proc. Eurosys, March 2007.
39. I. Sadooghi, S. Palur, et al. "Achieving Efficient Distributed Scheduling with Message Queues in the Cloud for Many-Task Computing and High-Performance Computing", CCGRID, 2014.
40. Amazon Simple Queue Service. Avaible online: http: //aws.amazon.com/documentation/sqs/. 2014.
41. G. DeCandia, D. Hastorun, M. Jampani, et al. "Dynamo: Amazon's highly available key-value store", ACM SOSP, 2007.
42. Y. Guo, J. Zhao, V. Cave, V. Sarkar. "SLAW: a scalable locality-aware adaptive work-stealing scheduler for multi-core systems", Proceedings of the 15th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP), 2010.
43. Y. Guo, R. Barik, R. Raman, and V. Sarkar, "Work-first and help-first scheduling policies for async-finish task parallelism," IPDPS, 2009.
44. J. Paudel, O. Tardieu and J. Amaral. "On the merits of distributed work-stealing on selective locality-aware tasks", ICPP, 2013.
45. P. Charles, C. Grothoff, et al. "X10: An Object-oriented Approach to Non-uniform Cluster Computing," ACM Conference on Object-oriented Programming Systems Languages and Applications(OOPSLA), 2005.
46. K. Wang, X. Zhou, et al. "Next Generation Job Management Systems for Extreme-Scale Ensemble Computinig", ACM HPDC 2014.
47. K. Ramamurthy, K. Wang, I. Raicu. "Exploring Distributed HPC Scheduling in MATRIX". Tech Report, IIT, 2013.
48. X. Zhou, H. Chen, K. Wang, M. Lang, I. Raicu. "Exploring Distributed Resource Allocation Techniques in the SLURM Job Management System." Tech Report, IIT, 2013.
49. Y. Zhao, M. Hategan, et al. "Swift: Fast, Reliable, Loosely Coupled Parallel Computation," IEEE Workshop on Scientific Workflows 2007.
50. J. Dean and S. Ghemawat. "MapReduce: Simplified Data Processing on Large Clusters", OSDI'04, CA, December, 2004.
51. D. Zhao, Z. Zhang, X. Zhou, T. Li, K. Wang, D. Kimpe, P. Carns, R. Ross, and I. Raicu. "FusionFS: Towards Supporting Data-Intensive Scientific Applications on Extreme-Scale High-Performance Computing Systems." IEEE BigData, 2014.
52. T. Li, R. Verma, X. Duan, H. Jin, and I. Raicu. "Exploring Distributed Hash Tables in High-End Computing", ACM Performance Evaluation Review (PER), 2011.
53. S. Krieder and I. Raicu. "Towards the Support for Many-Task Computing on Many-Core Computing Platforms", Doctoral Showcase, IEEE/ACM Supercomputing/SC 2012.
54. H. Jin, X. Yang, X. Sun and I. Raicu. "ADAPT: Availability-aware MapReduce Data Placement in Non-Dedicated Distributed Computing Environment", IEEE International Conference on Distributed Computing Systems (ICDCS) 2012.
55. M. Wilde, I. Raicu et al. "Extreme-scale scripting: Opportunities for large task-parallel applications on petascale computers", Poster Presentation, Scientific Discovery through Advanced Computing Conference (SciDAC09) 2009.
56. I. Raicu, I. Foster, A. Szalay and G. Turcu. "AstroPortal: A Science Gateway for Large-scale Astronomy Data Analysis," TeraGrid Conference 2006, June 2006