High-performance computing: To boldly go where no human has gone before

Concurrency and Computation: Practice and Experience

Volumn 27, Issue 13, 2015, Pages 3145-3165

  Limet, Sébastien ^a   Smari, Waleed W ^a   Spalazzi, Luca ^a  

^a UNIVERSITÉ D'ORLÉANS   (France)

Author keywords

algorithms; big data; clouds; clusters; grid computing; high performance computing; history; HPC; modeling; parallel and distributed computing; reconfigurable computing; simulation; supercomputing

Indexed keywords

ALGORITHMS; BIG DATA; CLOUDS; COMPUTATIONAL ELECTROMAGNETICS; COMPUTER OPERATING SYSTEMS; DIGITAL STORAGE; ELECTROMAGNETIC SIMULATION; ENERGY EFFICIENCY; FORECASTING; GRID COMPUTING; HISTORY; MODELS; PREDICTIVE ANALYTICS; RECONFIGURABLE ARCHITECTURES; SCHEDULING;

CLUSTERS; HIGH PERFORMANCE COMPUTING; PARALLEL AND DISTRIBUTED COMPUTING; RECONFIGURABLE COMPUTING; SIMULATION; SUPERCOMPUTING;

MATRIX ALGEBRA;

EID: 84939559176     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.3463     Document Type: Review

References (155)

1. Vetter J(ed.),. Contemporary High Performance Computing: From Petascale Toward Exascale. CRC Press: Boca Raton, Florida, USA, 2013.
2. TOP500 supercomputing sites. (Available from: http://www.top500.org) [Accessed on 2 April 2015].
3. Kogge P,. Exascale computing study: technology challenges in achieving exascale systems. In, DARPA-funded study on technology challenges of building exascale systems, 2008 (Available from: www.cse.nd.edu/Reports/2008/TR-2008-13.pdf).
4. Grier DA,. When Computers were Human. Princeton University Press: Princeton, NJ, USA, 2007.
5. Rojas R,. Konrad Zuses legacy: The architecture of the Z1 and Z3. IEEE Annals of the History of Computing. 1997; 19 (2): 5-16.
6. Feynman R,. "Surely you're joking Mr. Feynman!" Adventures of a Curious Character. W.W. Norton & Company: New York, USA, 1985.
7. Flowers TH,. The design of colossus (foreword by Howard Campaigne). IEEE Annals of the History of Computing. 1983; 5 (3): 239-252.
8. Rojas R, Hashagen U, (eds.) The First Computers: History and Architectures. MIT Press: Cambridge, MA, USA, 2000.
9. Lavington S,. A History of Manchester Computers (2nd edn.) The British Computer Society: Swindon, Wiltshire, UK, 1998.
10. Thornton J,. Design of a Computer-The Control Data 6600. Scott, Foresman and Co.: Glenview, IL, USA, 1970.
11. Russell RM,. The CRAY-1 computer system. Communications of the ACM. 1978; 21 (1): 63-72.
12. Kolodzey JS,. CRAY-1 computer technology. IEEE Transactions on Components, Hybrids and Manufacturing Technology. 1981; 4 (3): 181-186.
13. Bouknight WJ, Denenberg SA, McIntyre DE, Randall JM, Sameh AH, Slotnick DL,. The ILLIAC IV system. Proceedings of the IEEE. 1972; 60 (4): 369-388.
14. Dongarra J,. Frequently asked questions on the Linpack benchmark and Top500, 2007. (Available from: http://www.top500.org/resources/frequently-asked-questions/) [Accessed on 2 April 2015].
15. Trew A, Wilson G, (eds.) Past, Present, Parallel: A Survey of Available Parallel Computing Systems. Springer-Verlag: New York, 1991.
16. Tucker LW, Robertson GG,. Architecture and applications of the connection machine. Computer. 1988; 21 (8): 26-38.
17. Hillis WD, Tucker LW,. The CM-5 connection machine: A scalable supercomputer. Communications of the ACM. 1993; 36 (11): 31-40.
18. Iwaya A,. 1990. NEC supercomputer SX-3 series architecture and software. In Computing Methods in Applied Sciences and Engineering SIAM: Philadelphia, PA, USA; 353-360.
19. Burwell M,. CRAY T90 series differences: tutorial. In in: CUG 1996 Spring: Barcelona, Spain, 1996; 379-382.
20. Hirose N, Fukuda M,. 1997. Numerical Wind Tunnel (NWT) and CFD research at national aerospace laboratory. In HPC-Asia '97 IEEE Computer Society: Seoul; 99-103. 10.1109/HPC.1997.592130.
21. Esser R, Knecht R,. 1993. Intel paragon XP/S-architecture and software environment. In Supercomputer 93, Meuer HW, (ed.). Springer: Berlin, Germany; 121-141.
22. Fujii H, Yasuda Y, Akashi H, Inagami Y, Koga M, Ishihara O, Kashiyama M, Wada H, Sumimoto T,. Architecture and performance of the Hitachi SR2201 massively parallel processor system. In 11th International Parallel Processing Symposium: Geneva, Switzerland, 1997; 233-241.
23. Mattson T, Henry G,. An overview of the Intel TFLOPS supercomputer. Intel Technology Journal. 1998; 2 (1): 1-12.
24. Brightwell R, Riesen R, Underwood K, Hudson TB, Bridges P, Maccabe A,. A performance comparison of Linux and a lightweight kernel. In IEEE International Conference on Cluster Computing: Hong Kong, China, 2003; 251-258.
25. The world's fastest computer-meeting the challenge of stockpile stewardship. (Available from: http://computation.llnl.gov/casc/sc2001-fliers/ASCI-White/ASCI-White01.html) [Accessed on 2 April 2015].
26. Special issue of on NEC SX-9. NEC Technical Journal. 2008; 3 (4).
27. Alam SR, Barrett RF, Fahey MR, Kuehn JA O.E., Messer B, Mills RT, Roth PC, Vetter JS, Worley PH,. An evaluation of the Oak Ridge National Laboratory Cray XT3. International Journal of High Performance Computing Applications. 2008; 22 (1): 52-80.
28. Brooks J, Kirschner G,. 2011. Cray XT3 and Cray XT series of supercomputers. In Encyclopedia of Parallel Computing, Padua D, (ed.). Springer: US; 457-470.
29. Tomkins JL, Brightwell R, Camp WJ, Dosanjh S, Kelly SM, Lin PT, Vaughan CT, Levesque J, Tipparaju V,. The red storm architecture and early experiences with multi-core processors. International Journal of Distributed Systems and Technologies. 2010; 1 (2): 74-93.
30. Brightwell R, Underwood KD, Vaughan C, Stevenson J,. Performance evaluation of the red storm dual-core upgrade. Concurrency and Computation: Practice and Experience. 2010; 22: 310-327.
31. Hoisie A, Johnson G, Kerbyson DJ, Lang M, Pakin S,. A performance comparison through benchmarking and modeling of three leading supercomputers: Blue Gene/L, Red Storm, and Purple. In IEEE/ACM International Conference on High- Performance Computing, Networking, Storage, and Analysis: Tampa, FL, 2006; 3.
32. Allen F, Almasi G, Andreoni W, Beece D, Berne BJ, Bright A, Brunheroto J, Cascaval C, Castanos J, Coteus P, Crumley P, Curioni A, Denneau M, Donath W, Eleftheriou M, Fitch B, Fleischer B, Georgiou CJ, Germain R, Giampapa M, Gresh D, Gupta M, Haring R, Ho H, Hochschild P, Hummel S, Jonas T, Lieber D, Martyna G, Maturu K, Moreira J, Newns D, Newton M, Philhower R, Picunko T, Pitera J, Pitman M, Rand R, Royyuru A, Salapura V, Sanomiya A, Shah R, Sham Y, Singh S, Snir M, Suits F, Swetz R, Swope WC, Vishnumurthy N, Ward TJC, Warren H, Zhou R,. Blue Gene: A vision for protein science using a petaflop supercomputer. IBM Systems Journal. 2001; 40 (2): 310-327. Special Issue on Deep Computing for the Life Sciences.
33. Blue gene. IBM Journal of Research and Development. 2005; 49 (2/3).
34. Blue Gene team,. Overview of the IBM Blue Gene/P project. IBM Journal of Research and Development. 2008; 52: 199-220.
35. Rutgers-led experts assemble globe-spanning supercomputer cloud, Retrieved November 2013. (Available from: http://news.rutgers.edu/special-content/summer-2011/rutgers-led-experts-20110706\#.VGnAufTF9Gs) [Accessed on 2 April 2015].
36. Blue Gene Team,. The Blue Gene/Q compute Chip, August 17-19, 2011. Presented at the Hot Chips Conference 23.
37. Chen D, Eisley NA, Heidelberger P, Senger RM, Sugawara Y, Kumar S, Salapura V, Satterfield DL, Steinmacher-Burow B, Parker JJ,. The IBM Blue Gene/Q interconnection network and message unit. In 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC 2011): IEEE. Los Alamitos, CA, USA, 2011; 1-10.
38. Barney B, Shuler J, (eds.) Purple Computational Environment Version 2.0. Lawrence Livermore National Laboratory: Livermore, CA, USA, 2006. (Available from: https://asc.llnl.gov/computing\-resources/purple/ publications/PurpleCompEnv\-ACEmappings.v2.0.pdf) [Accessed on 2 April 2015].
39. Borrett A,. Roadrunner-integrated hybrid node, 2007.
40. Barker K, Davis K, Hoisie A, Kerbyson D, Lang M, Pakin S, Sancho J,. Entering the petaflop era: The architecture and performance of Roadrunner. In International Conference for High Performance Computing, Networking, Storage and Analysis: Austin, TX, USA, 2008; 1-11.
41. Bland A, Joubert W, Kendall R, Kothe D, Rogers J, Shipman G,. Jaguar: The world's most powerful computer-an update. In Cray User Group 2010: Edinburgh, Scotland, 2010; 1-15.
42. Department of Energy Exascale Strategy,. In, U.S. Department of Energy, June 2013 report to Congress.
43. Yang XJ, Liao XK, Hu QF, Song JQ, Su JS,. The TianHe-1A supercomputer: its hardware and software. Computer Science and Technology. 2011; 26 (3): 344-351.
44. Xie M, Lu Y, Wang K, Liu L, Cao H, Yang X,. Tianhe-1A interconnect and message-passing services. IEEE Micro. 2012; 32 (1): 8-20.
45. Miyazaki H, Kusano Y, Shinjou N, Shoji F, Yokokawa M, Watanabe T,. Overview of the K computer system. Fujitsu Scientific & Technical Journal. 2012; 48 (3): 255-265. Special Issue on K Computer.
46. Ajima Y, Inoue T, Hiramoto S, Shimizu T,. Tofu: interconnect for the K computer. Fujitsu Scientific & Technical Journal. 2012; 48 (3): 280-285.
47. Moroo J, Yamada M, Kato T,. Operating system for the K computer. Fujitsu Scientific & Technical Journal. 2012; 48 (3): 295-301.
48. Chen D, Eisley N, Heidelberger P, Kumar S, Mamidala A, Petrini F, Senger R, Sugawara Y, Walkup R, Choudhury A, Sabharwal Y, Singhal S, Steinmacher-Burow B, Parker JJ,. 2012. Looking under the hood of the IBM Blue Gene/Q network. In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC '12 IEEE Computer Society Press: Los Alamitos, CA, USA; 69:1-69:12.
49. Blue Gene Team,. The IBM Blue Gene/Q compute chip. IEEE Micro. 2012; 32 (2): 48-60.
50. Dongarra JJ, van der Steen AJ,. High-performance computing systems: status and outlook. Acta Numerica 21. 2012; 21: 379-474.
51. Pfister, G (ed.),. Search of Clusters (2nd edn.) Prentice Hall: Upper Saddle River, NJ, USA, 1998.
52. Kronenberg N, Levy H, Strecker W,. VAXcluster: A closely-coupled distributed system. ACM Transactions on Computer Systems. 1986; 4 (2): 130-146.
53. Becker D, Sterling T, Savarese D, Dorband J, Ranawak U, Packer C,. 1995. BEOWULF: A parallel workstation for scientific computation. In Proceedings of the 24th International Conference on Parallel Processing CRC Press: London, UK; 11-14.
54. U.S. Dept. of Energy Lawrence Livermore National Lab, System Attributes: ASCI Blue-Pacific System.
55. Takizawa H, Kobayashi H,. Hierarchical parallel processing of large scale data clustering on a PC cluster with GPU co-processing. Journal of Supercomputing. 2006; 36: 219-234.
56. Kindratenko VV, Enos J, Shi G, Showerman MT, Arnold GW, Stone JE, Phillips JC, Mei W, Hwu W,. 2009. GPU clusters for high-performance computing. In Proceedings of the 2009 IEEE International Conference on Cluster Computing IEEE: Los Alamitos, CA, USA; 1-8.
57. Nussbaum L, Anhalt F, Mornard O, Gelas J-P,. Linux-based virtualization for HPC clusters. In Linux Symposium: Montreal, Quebec, Canada, 2009; 221-234.
58. Mauer R,. Xen virtualization and linux clustering (Parts I and II). Linux Journal. 2006.
59. Foster I, Kesselman C, (eds.) The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann: San Francisco, CA, USA, 1999.
60. Berman F, Hey AJG, Fox GC,. Grid Computing: Making The Global Infrastructure a Reality. Wiley: Chichester, West Sussex, UK, 2003.
61. Garfinkel S, Abelson H,. Architects of the Information Society: 35 Years of the Laboratory for Computer Science at MIT. MIT Press: Cambridge, MA, USA, 1999. see also S. Garfinkel, The Cloud Imperative, MIT Technology Review, October 3, 2011.
62. Litzkow MJ, Livny M, Mutka MW,. Condor-a hunter of idle workstations. In 8th International Conference on Distributed Computing Systems: San Jose, CA, USA, 1988; 104-11.
63. Kleinrock L,. UCLA to be first station in nationwide computer network. UCLA Press Release (July 1969).
64. Catlett C, Smarr L,. Metacomputing. Communications of the ACM. 1992; 35 (6): 44-52.
65. Zhou S, Zheng X, Wang J, Delisle P,. Utopia: A load sharing facility for large, heterogeneous distributed computer systems. Software: Practice and Experience. 1993; 23 (12): 1305-1336.
66. Grimshaw A, Wulf W, French J, Weaver A, Reynolds J,. Legion: The next logical step toward a nationwide virtual computer. In CS-94-21, Department of Computer Science, University of Virginia, 1994.
67. DeFanti T, Foster I, Papka M, Stevens R, Kuhfuss T,. Overview of the I-WAY: wide area visual supercomputing. International Journal of Supercomputer Applications. 1996; 10 (2): 123-130.
68. Baratloo A, Karaul M, Kedem ZM, Wijckoff P,. Charlotte: metacomputing on the web. Future Generation Computer Systems. 1999; 15 (5-6): 559-570.
69. Camiel N, London S, Nisan N, Regev O,. The POPCORN project: distributed computation over the internet in java. In 6th International World Wide Web Conference: Santa Clara, CA USA, 1997.
70. Foster I, Kesselman C,. The Globus project: A status report. In 7th Heterogeneous Computing Workshop (HCW 98): Orlando, FL, USA, 1998; 4-18.
71. Globus. (Available from: http://toolkit.globus.org/toolkit/about.html) [Accessed on 2 April 2015].
72. Romberg M,. The unicore architecture: seamless access to distributed resources. In 1999. Proceedings. The Eighth International Symposium on High Performance Distributed Computing: Redondo Beach, CA, USA, 1999; 287-293.
73. Streit A, Bergmann S, Breu R, Daivandy JM, Demuth B, Giesler A, Hagemeier B, Holl S, Huber V, Mallmann D, Memon AS, Memon MS, Menday R, Rambadt M, Riedel M, Romberg M, Schuller B, Lippert T,. 2008. Unicore 6-a European grid technology. In High Performance Computing Workshop, Gentzsch W, Grandinetti L, Joubert GR, (eds)., Advances in Parallel Computing, vol. 18 IOS Press: Amsterdam, The Netherlands; 157-173.
74. Lamanna M,. The LHC computing grid project at CERN. In Proceedings of the IXth International Workshop on Advanced Computing and Analysis Techniques in Physics Research, 2004; 1-6.
75. Gannon D, Plale B, Christie M, Fang L, Huang Y, Jensen S, Kandaswamy G, Marru S, Pallickara SL, Shirasuna S,. 2005. Service oriented architectures for science gateways on grid systems. In Service-oriented Computing-ICSOC 2005, Benatallah B, Casati F, Traverso P, (eds)., Lecture Notes in Computer Science, vol. 3826 Springer: Berlin, Germany; 21-32. 10.1007/11596141-3.
76. Catlett C, Allcock WE, Andrews P, Aydt R, Bair R, Balac N, Banister B, Barker T, Bartelt M, Beckman P, Berman F, Bertoline G, Blatecky A, Boisseau J, Bottum J, Brunett S, Bunn J, Butler M, Carver D, Cobb J, Cockerill T, Couvares PF, Dahan M, Diehl D, Dunning T, Foster I, Gaither K, Gannon D, Goasguen S, Grobe M, Hart D, Heinzel M, Hempel C, Huntoon W, Insley J, Jordan C, Judson I, Kamrath A, Karonis N, Kesselman C, Kovatch P, Lane L, Lathrop S, Levine M, Lifka D, Liming L, Livny M, Loft R, Marcusiu D, Marsteller J, Martin S, McCaulay S, McGee J, McGinnis L, McRobbie M, Messina P, Moore R, Moore Richard, Navarro JP, Nichols Jeff, Papka ME, Pennington R, Pike G, Pool J, Reddy R, Reed D, Rimovsky T, Roberts E, Roskies R, Sanielevici S, Scott JR, Shankar A, Sheddon M, Showerman M, Simmel D, Singer A, Skow D, Smallen S, Smith W, Song C, Stevens R, Stewart C, Stock RB, Stone N, Towns J, Urban T, Vildibill M, Walker E, Welch V, Wilkins-Diehr N, Williams R, Winkler L, Zhao L, Zimmerman A,. Teragrid: Analysis of organization, system architecture, and middleware enabling new types of applications. In High Performance Computing and Grids in Action: Cetraro, Italy, 2006; 225-249.
77. NES. (Available from: http://www.ngs.ac.uk/nes) [Accessed on 2 April 2015].
78. Kerzel M, Gentzsch W,. 2007. German Grid Initiative D-Grid, Neuroth H, (ed.). Universitätsverlag Göttingen: Göttingen, Germany.
79. Bachmann F, Foster I, Grimshaw A, Lifka D, Liming L, Riedel M, Tuecke S,. XSEDE architecture overview. In, 2014 (Available from: http://hdl.handle.net/2142/50274) [Accessed on 2 April 2015].
80. Gagliardi F, Jones B, Reale M, Burke S,. 2002. European datagrid project: experiences of deploying a large scale testbed for e-Science applications. In Performance Evaluation of Complex Systems: Techniques and Tools, Performance 2002, Tutorial Lectures Springer: Berlin, Germany; 480-500.
81. Mineter M, Warner G,. Talk at grids: what are they and where are they going?.
82. Dimitrakos T,. 2010. Grid and Cloud Computing. In The BEinGRID Project, Stanoevska-Slabeva K, Wozniak T, Ristol S, (eds). Springer; 13-17.
83. European grid infrastructure. (Available from: http://www.egi.eu/) [Accessed on 2 April 2015].
84. Childers L, Disz T, Olson R, Papka ME, Stevens R, Udeshi T,. Access grid: immersive group-to-group collaborative visualization. In 4th International Immersive Projection Technology Workshop, 2000; 62-82.
85. Bertenthal B, Grossman R, Hanley D, Hereld M, Kenny S, Levow G, Papka ME, Porges S, Rajavenkateshwaran K, Stevens R, Uram T, Wu W,. Social informatics data grid. In E-Social Science Conference, 2007.
86. Foster I, Kesselman C, Tuecke S,. The anatomy of the grid: enabling scalable virtual organizations. International Journal of Supercomputer Applications. 2011; 15 (3): 200-222.
87. Mell P, Grance T, SP 800-145,. The NIST definition of cloud computing. In, National Institute of Standards & Technology, Gaithersburg, MD, United States, 2011.
88. Licklider JC, Taylor RW,. The computer as a communication device. Science and Technology. 1968; 76 (2): 1-3.
89. Seawright LH, MacKinnon RA,. VM/370-a study of multiplicity and usefulness. IBM Systems Journal. 1979; 18 (1): 4-17.
90. Regalado A,. Who coined 'Cloud Computing'?. In, MIT Technology Review, 2011 (Available from: http://www.technologyreview.com/news/425970/who-coined-cloud-computing/) [Accessed on 2 April 2015].
91. Gillett SE, Kapor M,. 1997. The self-governing internet: coordination by design. In Workshop at Kennedy School of Government: Coordination of the Internet, September 8-10 1996, Kahin B, Keller J, (eds). Harvard University, MIT Press: MA, USA. (Available from: http://ccs.mit.edu/papers/CCSWP197/CCSWP197.html) [Accessed on 2 April 2015].
92. Chellappa R,. Intermediaries in cloud-computing: A new computing paradigm. In INFORMS Annual Meeting, 1997.
93. Conversation with Eric Schmidt hosted by Danny Sullivan. In Search Engine Strategies Conference: San Jose, CA, USA, 2006. (Available from: http://www.google.com/press/podium/ses2006.html) [Accessed on 2 April 2015].
94. Dean J, Ghemawat S,. MapReduce: simplified data processing on large clusters. Communications of the ACM. 2008; 51 (1): 107-113.
95. Cattell R,. Scalable SQL and NoSQL data stores. ACM SIG-MOD Record. 2011; 39 (4): 12-27.
96. Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A, Lee G, Patterson DA, Rabkin A, Stoica I, Zaharia M,. A view of cloud computing. Communications of the ACM. 2010; 53 (4): 50-58.
97. Subashini S, Kavitha V,. A survey on security issues in service delivery models of cloud computing. Network and Computer Applications. 2011; 34 (1): 1-11.
98. Gantz J, Reinsel D,. Extracting value from chaos. In, IDC iView, 2001 (Available from: http://www.emc.com/collateral/analyst-reports/idc-extracting-value-from-chaos-ar.pdf) [Accessed on 2 April 2015].
99. Laney D,. 3D data management: controlling data volume, velocity, and variety. In, META Group Research Note, 2001 (Available from: http://blogs.gartner.com/doug-laney/files/2012/01/ ad949-3D-Data-Management-Controlling-Data-Volume-Velocity-and-Variety.pdf) [Accessed on 2 April 2015].
100. Chen M, Mao S, Liu Y,. Big data: A survey. Mobile networks and applications. 2014; 19 (2): 171-209.
101. Ghemawat S, Gobioff H, Leung ST,. The google file system. ACM SIGOPS Operating Systems review. 2003; 37: 29-43.
102. HADOOP. (Available from: http://hadoop.apache.org/) [Accessed on 2 April 2015].
103. Chang F, Dean J, Ghemawat S, Hsieh WC, Wallach DA, Burrows M, Chandra T, Fikes A, Gruber RE,. Bigtable: A distributed storage system for structured data. ACM Transactions on Computer Systems. 2008; 26 (2): 4:1-4:26.
104. Manyika J, Chui M, Brown B, Bughin J, Dobbs R, Roxburgh C, Byers AH,. Big data: The next frontier for innovation, competition, and productivity. In, McKinsey Global Institute, 2011.
105. Hey T, Tansley S, Tolle K, (eds.) The Fourth Paradigm: Data-intensive Scientific Discovery. Microsoft Research: Redmond, Washington, 2009.
106. Stuart J, Owens J,. Multi-GPU mapReduce on GPU clusters. In 25th IEEE International Symposium on Parallel and Distributed Processing IEEE: Los Alamitos, CA, USA; 1068-1079.
107. Flynn M,. Some computer organizations and their effectiveness. IEEE Transactions on Computers. 1972; 21 (9): 948-960.
108. Intel: Advanced vector extensions programming reference, Document no. 319433-011 (June 2011). (Available from: http://software.intel.com/sites/default/files/4f/5b/36945) [Accessed on 2 April 2015].
109. Patterson D, Hennesy J,. Computer Architecture: A Quantitative Approach (5th edn.) Morgan Kaufmann Publishers: Waltham, MA, USA, 2011.
110. El-Rewini H, Abd-El-Barr M,. Advanced Computer Architecture and Parallel Processing. Wiley-Interscience: Hoboken, NJ, USA, 2005.
111. Manchanda N, Anand K,. Non-uniform memory access (NUMA), 2010. (Available from: http://www.cs.nyu.edu/~lerner/spring10/projects/NUMA.pdf) [Accessed on 2 April 2015].
112. Stenstromt P, Joe T, Gupta A,. 1992. Comparative performance evaluation of cache-coherent NUMA and COMA architectures. In Proceedings of the 19th Annual International Symposium on Computer Architecture (ISCA '92) ACM: New York, NY, USA; 80-91.
113. Dahlgren F, Torrellas J,. Cache-only memory architectures. IEEE Commputer. 1999; 32 (6): 72-79.
114. Nitzberg B, Lo V,. Distributed shared memory: A survey of issues and algorithms. IEEE Commputer. 1991; 24 (8): 52-60.
115. Ramesh T, Sudhakar C,. An improved DSM system design and implementation. Next Generation Computing. 2012; 3 (3): 312-327.
116. Shivnath B, Govindarajan R,. An efficient implementation of software DSM on IBM-SP2. In 5th International Conference on High Performance Computing: Chennai (Madras), India, 1998. (Available from: http://infolab.stanford.edu/~shivnath/PUBLICATIONS/dsmpaper.ps) [Accessed on 2 April 2015].
117. Basumallik A, Min S-J, Eigenmann R,. 2002. Towards OpenMP execution on software distributed shared memory systems. In Proceedings of International Symposium on HPC (ISHPC), Zima H, (ed.)., LNCS, vol. et al., 2337 Springer: Berlin, Germany; 457-468.
118. Stallings W,. Operating Systems: Internals and Design Principles (9th edn.) Prentice Hall: Upper Saddle River, NJ, USA, 2014. Part 3.
119. Wilson P, Johnstone M, Neely M, Boles D,. 1995. Dynamic storage allocation: A survey and critical review. In Proceedings of International Workshop on Memory Management, LNCS, vol. 986 Springer-Verlag: Kinross, Scotland U.K.; 1-116.
120. Basu A, Gandhi J, Chang J, Hill MD, Swift M,. 2013. Efficient virtual memory for big memory servers. In Proceedings of the 40th Annual International Symposium on Computer Architecture (ISCA 2013) ACM: New York, NY, USA; 237-248.
121. Iskra K, Yoshii K, Gupta R, Beckman P,. Advanced virtual memory for exascale. In Proceedings of the Workshop ExaOSR, 2012. (Available from: http://www.mcs.anl.gov/papers/P3010-0712.pdf) [Accessed on 2 April 2015].
122. Shiva SG,. Advanced Computer Architectures. CRC Press: Boca Raton, FL, USA, 2005.
123. Darema F, George D, Norton V, Pster G,. A single-program-multiple-data computational model for EPEX/FORTRAN. Parallel Computing. 1988; 7 (1): 11-24.
124. CUDA. (Available from: http://www.nvidia.com/object/cuda-home-new.html) [Accessed on November 2013].
125. Chang CC, Czajkowski G, von Eicken T, Kesselman C,. 1997. Evaluating the performance limitations of mpmd communication. In Proceedings of the 1997 ACM/IEEE Conference on Supercomputing, SC '97. ACM: New York, NY, USA; 1-10.
126. Gropp W, Huss-Lederman S, Lumsdaine A, Lusk E, Nitzberg B, Saphir W, Snir M,. MPI-The Complete Reference: Volume 2, The MPI Extensions. MIT Press: Cambridge, MA, USA, 1988.
127. MPI forum, Message Passing Interface (MPI) forum home page. (Available from: http://www.mpi-forum.org/) [Accessed on 2 April 2015].
128. Hawick KA,. Trends in high performance computing. In Fourth IDEA Workshop: Magnetic Island, 1997.
129. Asanovic K, Bodik R, Demmel J, Keaveny T, Keutzer K, Kubiatowicz J, Morgan N, Patterson D, Sen K, Wawrzynek J, Wessel D, David, Yelick K,. A view of the parallel computing landscape. Communications of the ACM. 2009; 52 (10): 56-67.
130. Pingali K, Nguyen D, Kulkarni M, Burtscher M, Hassaan M, Kaleem R, Lee TH, Lenharth A, Manevich R, Mndez-Lojo M, Prountzos D, Sui X,. The tao of parallelism in algorithms. In 32nd ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2011): San Jose, CA, USA, 2011; 12-25.
131. Dongarra J, Sterling T, Simon H, Strohmaier E,. High-performance computing: clusters, constellations, MPPs, and future directions. Computing In Science & Engineering. 2005; 7 (2): 51-59.
132. Giles MB, Reguly I,. Trends in high-performance computing for engineering calculations. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences. 2014; 372 (2022): 20130319.
133. Moore GE,. Cramming more components onto integrated circuits. Electronics. 1965; 38 (8): 114-117.
134. Benini L,. Designing and managing HPC systems in Moores Law twilight zone. In In Proceedings of the 2014 International Conference on High Performance Computing & Simulation (HPCS2014). IEEE: Los Alamitos, CA, USA, 2014; 1-2.
135. Iyer A, Marculescu D,. 2002. Power and performance evaluation of globally asynchronous locally synchronous processors. In Proceedings of the 29th Annual International Symposium on Computer Architecture (ISCA '02) IEEE Computer Society; 158-168.
136. Yelick K, Bonachea D, Chen W-Y, Colella P, Datta K, Duell J, Graham SL, Hargrove P, Hilfinger P, Husbands P, Iancu C, Kamil A, Nishtala R, Su J, Wen T,. 2007. Productivity and performance using partitioned global address space languages. In Proceedings of the International Workshop on Parallel Symbolic Computation (PASCO '07) ACM: New York, NY, USA; 24-32.
137. Saraswat V, Almasi G, Bikshandi G, Cascaval C, Cunningham D, Grove D, Kodali S, Peshansky I, Tardieu O,. The asynchronous partitioned global address space model. In, Toronto, Canada, 2010 (Available from: http://www.cs.rochester.edu/u/cding/amp/papers/full/The\ %20Asynchronous\%20Partitioned\%20Global\%20Address\%20Space\%20Model.pdf) [Accessed on 2 April 2015].
138. Subramaniam B, Saunders W, Scogland T, Feng W,. Trends in energy-efficient computing: A perspective from the green500. In International Green Computing Conference: Arlington, VA, USA, 2013; 1-8.
139. Green 500. (Available from: http://www.green500.org/) [Accessed on 2 April 2015].
140. Orgerie A-C, Assuncao MD, Lefevre L,. A survey on techniques for improving the energy efficiency of large scale distributed systems. ACM Computing Surveys. 2014; 46 (4): 1-35.
141. Kandemir M, Srikantaiah S,. The Green Computing Book: Tackling Energy Efficiency at Large Scale. CRC Press: Boca Raton, FL, USA, 2014. Ch. Compiler-Driven Energy Efficiency.
142. Smari, WW (ed.),. International Conference on High Performance Computing & Simulation (HPCS 2012). IEEE: Madrid, Spain, 2012. Also available from IEEE Digital Library (Available from: http://ieeexplore.ieee.org/xpl/ mostRecentIssue.jsp?punumber=6260982).
143. Trunfio P,. A two-layer model for improving the energy efficiency of file sharing peer-to-peer networks. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3166-3183.
144. Zeljkovic V, Bojic M, Zhao S, Tameze C, Valev V,. Exudates and optic disc detection in retina images of diabetic patients. Concurrency and Computation: Practice and Experience. 2015; 27 (1): 172-192.
145. Alexandru M, Monteil T, Lorenz P, Coccetti F, Aubert H,. Large electromagnetic simulation by hybrid approach on large scale parallel computing systems. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3184-3204.
146. Ortega G, Lobera J, Garca I, Arroyo MP, Garzn EM,. Parallel resolution of the 3D Helmholtz equation based on multi-GPU clusters. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3205-3219.
147. Rubio-Montero AJ, Castejn F, Huedo H, Mayo-Garca R,. A novel pilot job approach for improving the execution of distributed codes: Application to the study of ordering in collisional transport in fusion plasmas. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3220-3244.
148. Neves S, Araujo F,. Straight-line programs for fast sparse matrix-vector multiplication. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3245-3261.
149. Schneible J, Riha L, Malik M, El-Ghazawi T, Alexandru A,. Communication efficient work distributions in stencil operation based applications. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3262-3280.
150. Guo P, Wang L,. Accurate cross-architecture performance modeling for sparse matrix-vector multiplication (SpMV) on GPUs. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3281-3294.
151. Picone M, Amoretti M, Martal M, Zanichelli F, Ferrari G,. Combining geo-referencing and network coding for distributed large scale information management. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3295-3315.
152. Manno G, Smari WW, Spalazzi L, Taccari G,. A semantic-based federated cloud system for emergency response. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3316-3344.
153. Yeh T, Yang S, Sun Y,. Improving the program performance through prioritized memory management and disk operation. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3345-3361.
154. Carlini E, Ricci L, Coppola M,. Integrating centralized and P2P architectures to support interest management in massively multiplayer on-line games. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3362-3382.
155. Passerat-Palmbach J, Mazel C, Hill DRC,. TaskLocalRandom: A statistically sound substitute to pseudorandom number generation in parallel java tasks frameworks. Concurrency and Computation: Practice and Experience. 2015; 27 (13): 3383-3398.