Tuple switching network - When slower may be better

Journal of Parallel and Distributed Computing

Volumn 72, Issue 11, 2012, Pages 1521-1534

  Shi, Justin Y ^a   Taifi, Moussa ^a   Khreishah, Abdallah ^a   Wu, Jie ^a  

^a Temple University   (United States)

Author keywords

Application dependent networking; Sustainable high performance computing

Indexed keywords

COMMUNICATION RESOURCES; COMPUTATIONAL EXPERIMENT; DATA PARALLEL; EXTREME SCALE; GAIN PERFORMANCE; GENERIC DATA; HIGH PERFORMANCE COMPUTING; HIGH PERFORMANCE COMPUTING (HPC); HIGH-PERFORMANCE COMPUTING APPLICATIONS; MEAN TIME BETWEEN FAILURES; NETWORK DESIGN; PARALLEL PROCESSING; POINT-TO-POINT TRANSMISSIONS; SCALABLE NETWORKS; SEMANTIC DATA; SEMANTIC OBJECTS; SUSTAINED PERFORMANCE;

MULTIPLEXING; SEMANTICS; SUSTAINABLE DEVELOPMENT; SWITCHING NETWORKS;

DESIGN;

EID: 84866070787     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2012.01.014     Document Type: Article

References (43)

1. S. Ajuja, N. Carriero, and D. Gelernter Linda and friends Computer 19 1986 26 34
2. Apache, Hadoop tutorial, 2011.
3. Arvind, Decomposing a program for multiple processor system, in: Proceedings of the 1980 International Conference on Parallel Processing, pp. 7-14.
4. P. Baran, On distributed communications, RM-3420, Technical Report, 1964. http://www.rand.org/about/history/baran.list.html.
5. G. Bosilca, A. Bouteiller, F. Cappello, S. Djilali, G. Fedak, C. Germain, T. Herault, P. Lemarinier, O. Lodygensky, F. Magniette, V. Neri, A. Selikhov, MPICH-V: toward a scalable fault tolerant MPI for volatile nodes, in: Supercomputing, ACM/IEEE 2002 Conference, p. 29.
6. F. Cappello Fault tolerance in petascale/exascale systems: current knowledge, challenges and research opportunities Int. J. High Perform. Comput. Appl. 23 2009 212 226
7. N. Carriero, and D. Gelernter How to Write Parallel Programs - A First Course 1990 The MIT Press Cambridge, MA
8. R. Chandra Parallel Programming in OpenMP 2001 Morgan Kauffman
9. T. Cover, and J. Thomas Elements of Information Theory 1991 John Wiley & Sons, Inc.
10. CUDA-compute unified device architecture, 2010 [Online]. http://en.wikipedia.org/wiki/CUDA.
11. J.T. Daly A higher order estimate of the optimum checkpoint interval for restart dumps Future Gener. Comput. Syst. 22 2006 303 312
12. J.B. Dennis Data flow supercomputers Computer 13 1980 48 56
13. E.N. Elnozahy, and J.S. Plank Checkpointing for peta-scale systems: A look into the future of practical rollback-recovery IEEE Trans. Dependable Secure Comput. 1 2004 97 108
14. A. Fekete, N. Lynch, Y. Mansour, and J. Spinelli The impossibility of implementing reliable communication in the face of crashes J. ACM 40 1993 1087 1107
15. M.P.I. Forum, MPI: A message-passing interface standard, 1994.
16. M. Frigo, P. Halpern, C.E. Leiserson, S. Lewin-Berlin, Reducers and other cilk + + hyperobjects, in: ACM Symposium on Parallelism in Algorithms and Architectures, 2009.
17. E. Gabriel, G.E. Fagg, G. Bosilca, T. Angskun, J.J. Dongarra, J.M. Squyres, V. Sahay, P. Kambadur, B. Barrett, A. Lumsdaine, R.H. Castain, D.J. Daniel, R.L. Graham, and T.S. Woodall Open MPI: goals, concept, and design of a next generation MPI implementation D. Kranzlmller, P. Kacsuk, J.J. Dongarra, Recent Advances in Parallel Virtual Machine and Message Passing Interface Lecture Notes in Computer Science vol. 3241 2004 Springer Berlin, Heidelberg 353 377
18. G. Gibson, Reflections on failure in post-terascale parallel computing, in: Proceedings of 2007 International Conference on Parallel Processing.
19. W. Gropp, and E. Lusk Fault tolerance in message passing interface programs Int. J. High Perform. Comput. Appl. 18 2004 363 372
20. J. Gurd, I. Watson, A multilayered dataflow computer architecture, in: Proceedings International Conference on Parallel Processing.
21. P.H. Hargrove, and J.C. Duell Berkeley lab checkpoint/restart (BLCR) for linux clusters J. Phys. Conf. Ser. 46 2006 494 503
22. M. Herlihy, and N. Shavit The topological structure of asynchronous computability J. ACM 46 1999 858 923
23. High performance FPGA development group, 2010 [Online]. http://www.fhpca.org/.
24. HPC resilience consortium, 2010 [Online]. http://resilience.latech.edu.
25. Introduction to javaspace technology, 2010 [Online]. http://java.sun.com/ developer/technicalArticles/tools/JavaSpaces/.
26. Introduction to xap 8.0 - gigaspaces, 2011 [Online]. http://www. gigaspaces.com/wiki/display/XAP8/8.0+Documentation+Home.
27. M. Koop, T. Jones, D. Panda, Mvapich-aptus: scalable high-performance multi-transport MPI over infiniband, in: IPDPS 2008 International Symposium on Parallel and Distributed Processing, pp. 1-12.
28. J.F. Kurose, and K.W. Ross Computer Networking: A Top-Down Approach Featuring the Internet 2000 Addison-Wesley
29. S. Laosooksathit, C. Leangsuksan, A. Dhungana, C. Chandler, K. Chanchio, A. Farbin, Lightweight checkpoint mechanism and modeling in GPGPU, in: Proceedings of the hpcvirt2010 Conference.
30. A.M. Law, and W.D. Kelton Simulation Modeling and Analysis second ed. 1997 McGraw-Hill Higher Education
31. J. Layton, Petaflops for the common man - 5 challenges, 2011 [Online]. http://en.community.dell.com/techcenter/high-performance-computing/w/wiki/2279. aspx.
32. Multi-scale modeling and simulation, 2010 [Online]. http://www.math. princeton.edu/multiscale/.
33. H. Rolf High-performance computing and networking W. Gentzsch, U. Harms, The MPI Standard for Message Passing Lecture Notes in Computer Science vol. 797 1994 Springer Berlin, Heidelberg 247 252
34. J. Saltzer, D. Reed, D. Clark, End-to-end arguments in system design, in: Second International Conference on Distributed Computing Systems, 1981, pp. 509-512.
35. J.Y. Shi Fundamentals of cloud application architectures Cloud Computing: Methodology, System, and Applications 2011 CRC, Taylor & Francis Group (Chapter 19)
36. J.Y. Shi, Decoupling as a foundation for large scale parallel processing, in: Proceedings of 2009 High Performance Computing and Communications, Seoul, Korea.
37. J.Y. Shi, Synergy v3.0 manual, 2010.
38. M. Shultz, G.B.R. Fernandes, D.M.K. Pingali, P. Stodghill, Implementation and evaluation of a scalable application-level checkpoint-recovery scheme for MPI programs, in: Proceedings of Supercomputing 2004 Conference, Pittsburgh, PA.
39. F. Sun, Automatic program parallelization using stateless parallel processing architecture, Ph.D. Thesis, Temple University, 2004.
40. B. Szymanski, J.Y. Shi, and N.S. Prywes Synchronized distributed termination IEEE Trans. Softw. Eng. 11 1985 1136 1140
41. K.K.H. Takizawa, K. Sato, H. Kobayashi, Checuda: a checkpoint/restart tool for cuda applications, in: 2009 International Conference on Parallel and Distributed Computing, Applications and Technologies, 2009, pp. 408-413.
42. A.S. Tanenbaum, and M.V. Steen Distributed Systems: Principles and Paradigms first ed. 2001 Prentice Hall PTR Upper Saddle River, NJ, USA
43. Y. Yang, Fault tolerance protocol for multiple dependent master protection in a stateless parallel processing framework, Ph.D. Thesis, Temple University, 2007.