FatTreeSim: Modeling large-scale fat-tree networks for HPC systems and data centers using parallel and discrete event simulation

SIGSIM-PADS 2015 - Proceedings of the 3rd ACM Conference on SIGSIM-Principles of Advanced Discrete Simulation

Volumn , Issue , 2015, Pages 199-210

  Liu, Ning ^a   Haider, Adnan ^a   Sun, Xian He ^a   Jin, Dong ^a  

^a ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Blue Gene Q; Datacenter interconnection network; Fat tree networks; Parallel discrete event simulation; Supercomputer interconnection networks

Indexed keywords

EID: 84953877083     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2769458.2769474     Document Type: Conference Paper

References (37)

1. Apache Hadoop. http://hadoop.apache.org. [Last accessed May 2015].
2. Cisco Global Cloud Index: Forecast and Methodology, 2013-2018. http://cisco.com/c/en/us/solutions/collateral/service- provider/global-cloud-index- gci/Cloud Index White Paper.html. [Last accessed November 2014].
3. Gartner Report. http://www.gartner.com/newsroom/id/2313915. [Last accessed May 2015].
4. IDC: Amount of World Data Centers to Start Declining in 2017. http://www.datacenterknowledge.com/archives/2014/11/11/idc- amount-of-worlds-data-centers/-to-start-declining-in- 2017/. [Last accessed November 2014].
5. Mumak: Map-Reduce Simulator. https://issues.apache.org/jira/browse/MAPREDUCE- 728. [Last accessed May 2015].
6. ns-3. https://www.nsnam.org/. [Last accessed May 2015].
7. Real Cost Comparison of Fat-tree and Torus Networks j ClusterDesign.org. http://clusterdesign.org/2013/01/real-cost-comparison -of-fat-tree-and-torus-networks/. [Last accessed May 2015].
8. Summit. Scale new heights. Discover new solutions. http://www.olcf.ornl.gov/summit/. [Last accessed May 2015].
9. Yarn Scheduler Load Simulator (SLS). http://hadoop.apache.org/docs/r2.4.1/hadoop- sls/SchedulerLoadSimulator.html. [Last accessed May 2015].
10. D. Abts and B. Felderman. A guided tour through data-center networking. Queue, 10(5):10:10-10:23, May 2012.
11. M. Al-Fares, A. Loukissas, and A. Vahdat. A scalable, commodity data center network architecture. ACM SIGCOMM Computer Communication Review, 38(4):63-74, Oct. 2008.
12. M. Al-Fares, S. Radhakrishnan, B. Raghavan, N. Huang, and A. Vahdat. Hedera: Dynamic flow scheduling for data center networks. In Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation, NSDI'10, pages 19-19, Berkeley, CA, USA, Apr. 2010. USENIX Association.
13. A. Alexandrov, M. F. Ionescu, K. E. Schauser, and C. Scheiman. LogGP: Incorporating Long Messages into the LogP Model-One Step Closer Towards a Realistic Model for Parallel Computation. In Proceedings of the Seventh Annual ACM Symposium on Parallel Algorithms and Architectures, SPAA '95, pages 95-105, New York, NY, USA, July 1995. ACM.
14. C. Carothers, D. Bauer, and S. Pearce. ROSS: a high-performance, low memory, modular time warp system. In Fourteenth Workshop on Parallel and Distributed Simulation, 2000. PADS 2000. Proceedings, pages 53-60, Bologna, Italy, May 2000.
15. J. Cope, N. Liu, S. Lang, P. Carns, C. D. Carothers, and R. Ross. CODES: Enabling co-design of multilayer exascale storage architectures. In Proceedings of the Workshop on Emerging Supercomputing Technologies (WEST), Tuscon, AZ, June 2011.
16. C. Cutler, M. Hibler, E. Eide, and R. Ricci. Trusted disk loading in the emulab network testbed. In Proceedings of the 3rd International Conference on Cyber Security Experimentation and Test, CSET'10, pages 1-8, Berkeley, CA, USA, Aug. 2010. USENIX Association.
17. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. Communications of the ACM, 51(1):107-113, Jan. 2008.
18. S. Hammoud, M. Li, Y. Liu, N. Alham, and Z. Liu. MRSim: A discrete event based MapReduce simulator. In 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), volume 6, pages 2993-2997, Yantai, China, Aug. 2010.
19. C. E. Hopps and D. Thaler. Multipath Issues in Unicast and Multicast Next-Hop Selection. https://tools.ietf.org/html/rfc2991. [Last accessed May 2015].
20. T. Issariyakul and E. Hossain. Introduction to Network Simulator NS2. Springer Publishing Company, Incorporated, 1 edition, 2008.
21. T. Li, X. Zhou, K. Brandstatter, D. Zhao, K. Wang, A. Rajendran, Z. Zhang, and I. Raicu. ZHT: A light-weight reliable persistent dynamic scalable zero-hop distributed hash table. IPDPS '13, pages 775-787, Boston, MA, May 2013.
22. X.-Y. Lin, Y.-C. Chung, and T.-Y. Huang. A multiple LID routing scheme for fat-tree-based InfiniBand networks. In Parallel and Distributed Processing Symposium, 2004. Proceedings. 18th International, pages 11-, Santa Fe, New Mexico, Apr. 2004.
23. N. Liu, C. Carothers, J. Cope, P. Carns, and R. Ross. Model and simulation of exascale communication networks. Journal of Simulation, 6(4):227-236, Nov. 2012.
24. N. Liu and C. D. Carothers. Modeling Billion-Node Torus Networks Using Massively Parallel Discrete-Event Simulation. In Proceedings of the 2011 IEEE Workshop on Principles of Advanced and Distributed Simulation, PADS '11, pages 1-8, Washington, DC, USA, 2011. IEEE Computer Society.
25. N. Liu, X. Yang, X.-H. Sun, J. Jenkins, and R. Ross. Yarnsim: Simulating hadoop yarn. In 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid '15, Shenzhen, China, May 2015.
26. Y. Liu, M. Li, N. K. Alham, and S. Hammoud. HSim: A MapReduce Simulator in Enabling Cloud Computing. Future Generation Computer Systems, 29(1):300-308, Jan. 2013.
27. T. Mori, M. Uchida, R. Kawahara, J. Pan, and S. Goto. Identifying elephant ows through periodically sampled packets. In Proceedings of the 4th ACM SIGCOMM Conference on Internet Measurement, IMC '04, pages 115-120, New York, NY, USA, Nov. 2004. ACM.
28. M. Mubarak, C. Carothers, R. Ross, and P. Carns. Modeling a Million-Node Dragony Network Using Massively Parallel Discrete-Event Simulation. In 2012 SC Companion: High Performance Computing, Networking, Storage and Analysis (SCC), pages 366-376, Washington, DC, USA, Nov. 2012.
29. M. Mubarak, C. D. Carothers, R. B. Ross, and P. Carns. A case study in using massively parallel simulation for extreme-scale torus network codesign. In Proceedings of the 2Nd ACM SIGSIM/PADS Conference on Principles of Advanced Discrete Simulation, SIGSIM-PADS '14, pages 27-38, New York, NY, USA, 2014. ACM.
30. K. S. Perumalla and A. J. Park. Simulating billion-task parallel programs. In Performance Evaluation of Computer and Telecommunication Systems (SPECTS 2014), International Symposium on, pages 585-592, Monterey, CA, USA, July 2014.
31. S. Snyder, P. Carns, J. Jenkins, K. Harms, R. Ross, M. Mubarak, and C. Carothers. A case for epidemic fault detection and group membership in hpc storage systems. In the 5th International Workshop on Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS14)., pages 237-248, New Orleans, LA, USA, Nov. 2014. Springer International Publishing.
32. W. Tang, J. Jenkins, F. Meyer, R. B. Ross, R. Kettimuthu, L. Winkler, X. Yang, T. Lehman, and N. L. Desai. Data-aware resource scheduling for multicloud workows: Afine-grained simulation approach. In 2014 IEEE 6th International Conference on Cloud Computing Technology and Science (CloudCom), pages 887-892, Singapore, Dec. 2014.
33. G. Wang, A. Butt, P. Pandey, and K. Gupta. A simulation approach to evaluating design decisions in MapReduce setups. In IEEE International Symposium on Modeling, Analysis Simulation of Computer and Telecommunication Systems, MASCOTS '09, pages 1-11, London, UK, Sept. 2009.
34. B. Zhang, D. T. Yehdego, K. L. Johnson, M.-Y. Leung, and M. Taufer. Enhancement of accuracy and efficiency for RNA secondary structure prediction by sequence segmentation and MapReduce. BMC Structural Biology, 13(Suppl 1):S3, Nov. 2013.
35. D. Zhao, D. Zhang, K. Wang, and I. Raicu. Exploring reliability of exascale systems through simulations. In Proceedings of the High Performance Computing Symposium, HPC '13, pages 1:1-1:9, San Diego, CA, USA, 2013. Society for Computer Simulation International.
36. D. Zhao, Z. Zhang, X. Zhou, T. Li, K. Wang, D. Kimpe, P. Carns, R. Ross, and I. Raicu. Fusionfs: Toward supporting data-intensive scientific applications on extreme-scale high-performance computing systems. In 2014 IEEE International Conference on Big Data, pages 61-70, Washington, DC, Oct 2014.
37. G. Zheng, G. Gupta, E. Bohm, I. Dooley, and L. V. Kale. Simulating Large Scale Parallel Applications using Statistical Models for Sequential Execution Blocks. In Proceedings of the 16th International Conference on Parallel and Distributed Systems