Multi-threaded architectures: Evolution, costs, opportunities

Handbook of Research on Computational Science and Engineering: Theory and Practice

Volumn , Issue , 2011, Pages 22-47

  Girotto, Ivan ^a   Farber, Robert M ^b  

^a NATIONAL UNIVERSITY OF IRELAND   (Ireland)

^b PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84862125941     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-61350-116-0.ch002     Document Type: Chapter

References (39)

1. Alerstam, E., Svensson, T., & Engels, S. A. (2008). Parallel computing with graphics processing units for high-speed Monte Carlo simulation of photon migration. Journal of Biomedical Optics, 13(6), 060504. doi:10.1117/1.3041496
2. Atkins, D. E., Droegemeier, K. K., Feldman, S. I., Garcia-Molina, H., Klein, M. L., & Messerschmitt, D. G.Wright, M. H. (2003). Revolutionizing science and engineering through cyberinfrastructure. Report of the National Science Foundation blue-ribbon advisory panel on cyberinfrastructure. Arlington, VA: US National Science Foundation. Retrieved September 8, 2010, from http://www.nsf.gov/od/oci/reports/atkins.pdf
3. Beichl, I., & Sullivan, F. (2000). The metropolis algorithm. Computing in Science and Engineering, 2(1), 65-69. ISSN: 1521-9615
4. Burtscher, M., & Pingali, K. (2011). An efficient CUDA implementation of the tree-based Barnes hut n-body algorithm. In W.-M. W. Hwu (Ed.), GPU computing gems, Emerald ed., (pp. 75-92). ISBN: 978-0-12-384988-5
5. CAPS-Entreprise. (2011). HMPP workbench. Retrieved April 22, 2011, from http://www.caps-entreprise.com/hmpp.html
6. Chu, C. T., Kim, S. K., Lin, Y. A., Yu, Y., Bradski, G. R., Ng, A. Y., & Olukotun, K. (2006). Map-reduce for machine learning on multicore. In B., Schölkopf, J. C. Platt, & T. Hoffman, (Eds.), NIPS, (pp. 281-288). MIT Press. Retrieved April 22, 2011, from http://www.cs.stanford.edu/people/ang/papers/nips06-mapreducemulticore.pdf
7. CUDA-EC. (2010). Sourceforge.net: cuda-ec. Retrieved April 22, 2011, from http://cuda-ec.sourceforge.net/
8. Diaconis, P., & Saloff-Coste, L. (1995). What do we know about the metropolis algorithm? In STOC '95: Proceedings of the Twenty-Seventh Annual ACM Symposium on Theory of Computing, (pp. 112-129). New York, NY: ACM Press. DOI: 10.1145/225058.225095
9. Farber, R. (2009, July/August). Numerical precision: How much is enough? Scientific Computing. Retrieved September 8, 2010, from http://www.scientificcomputing.com/article-hpc-Numerical-Precision-How-Much-is-Enough-063009.aspx
10. Farber, R. (2010). Massively parallel mappings with near-linear scaling behavior. Retrieved April 22, 2011, from http://www.gpucomputing.net/?q=node/176
11. Farber, R., Lapedes, A., Rico-Martinez, R., & Kevrekidis, I. (1993). Identification of continuous-time dynamical systems: Neural network based algorithms and parallel implementation. Proceedings of the 6th SIAM Conference on Parallel Processing for Scientific Computing, Norfolk, Virginia.
12. Farber, R., Lapedes, A., & Sirotkin, K. (1992). Determination of eukaryotic protein coding regions using neural networks and information theory. Journal of Molecular Biology, 226(2), 471-479. doi:10.1016/0022-2836(92)90961-I
13. Farber, R., & Trease, H. (2008). Massively parallel near-linear scalability algorithms with application to unstructured video analysis. In TACC TeraGrid08 (pp. 9-13). Las Vegas, NV: Conference. June.
14. Hanweck Associate, L. L. C. (2011). CUDA for finance. Retrieved April 22, 2011, from http://www.nvidia.com/object/cuda_finance.html
15. Harvard. (2011). The Connectome initiative. Retrieved April 22, 2011, from http://iic.seas.harvard.edu/research/the-connectome/
16. HPCS. (2010). HPCS challenge. Retrieved September 8, 2010, from http://icl.cs.utk.edu/hpcc/hpcc_results_kiviat.cgi
17. Hwu, W. (2011). GPU computing gems, Emerald edition. Morgan Kaufmann. ISBN: 978-0-12-384988
18. IEEE. (2007). The impact of Dennard's scaling theory. IEEE Solid-State Circuits Society News,12(1). Retrieved July 6, 2010, from http://www.ieee.org/portal/cms_docs_societies/sscs/PrintEditions/200701.pdf
19. Kevrekidis, I., Rico-Martinez, R., Ecke, R., Farber, R., & Lapedes, A. (1994). Global bifurcations in Rayleigh-Benard convection. Experiments, empirical maps and numerical bifurcation analysis. Physica D. Nonlinear Phenomena, 71(3), 342-362. doi:10.1016/0167-2789(94)90152-X
20. Kogge, P. (2011, February). Next generation supercomputers. IEEE Spectrum: Technology, Engineering, and Science News. Retrieved April 15, 2011, from http://spectrum.ieee.org/computing/hardware/nextgeneration-supercomputers
21. Lapedes, A., Barnes, C., Burks, C., Farber, R., & Sirotkin, K. (1989). Applications of neural net and other machine learning algorithms to DNA sequence analysis. In Bell, G., & Marr, T. (Eds.), Computers and DNA: SFI studies in the sciences of complexity (Vol. 7). Addison Wesley.
22. Lapedes, A., & Farber, R. (1987). Nonlinear signal processing using neural networks, prediction and system modeling. (. LANL Technical Report, LA UR, 87, 2662.
23. Lapedes, A., & Farber, R. (1994). Learning affinity landscapes: Prediction of novel peptides. Los Alamos National Laboratory Technical Report, (LA-UR-94-4391).
24. Lundstrom, M. (2003). Moore's law forever? Science, 299, 210. DOI: 10.1126/science.1079567
25. Mendes, C., & Bohm, E. (2009). Blue waters -Breaking through the limits. Retrieved July 6, 2011, from http://charm.cs.uiuc.edu/workshops/charmWorkshop2009/slides/2009_PPL_Blue-Waters.ppt
26. NVIDIA. (2011a). Cuda zone. Retrieved April 15, 2011, from http://www.nvidia.com/cuda
27. NVIDIA. (2011b). CUDA course map. Retrieved April 15, 2011, from http://www.nvidia.co.in/object/cuda_courses_and_map.html
28. Oja, E. (1982). A simplified neuron model as a principal component analyzer. Journal of Mathematical Biology, 15(3), 267-273. doi:10.1007/BF00275687
29. Preis, T., Virnau, P., Paul, W., & Schneider, J. (2009). Accelerated fluctuation analysis by graphic cards and complex pattern formation in financial markets. New Journal of Physics, 11. doi:10.1088/1367-2630/11/9/093024
30. Rath, J. (2009). Blue waters and the supercomputing frontier. Retrieved July 6, 2010, from http://www.datacenterknowledge.com/archives/2009/12/17/blue-waters-and-the-supercomputing-frontier/
31. Sandia. (2010). The qthread library. Retrieved September 8, 2010, from http://www.cs.sandia.gov/qthreads/
32. Singer, A. (1990). Implementations of artificial neural networks on the connection machine. (Technical Report RL90-2). Cambridge, MA: Thinking Machines Corporation.
33. Suess, M. (2007, April 11). Thinking in parallel. Retrieved September 8, 2010, from http://www.thinkingparallel.com/2007/04/11/ten-questions-with-david-butenhof-about-parallel-programming-and-posix-threads/
34. Taufer, M., Padron, O., Saponaro, P., & Patel, S. (2010). Improving numerical reproducibility and stability in large-scale numerical simulations on GPUs. In Proceedings of the IEEE/ACM International Parallel and Distributed Processing Symposium (IPDPS), April 2010, Atlanta, Georgia, USA.
35. Thearling, K. (1995). Lectures in complex systems. In L. Nadel and D. Stein (Eds.), Massively parallel architectures and algorithms for time series analysis. Addison-Wesley. Retrieved April 22, 2011, from http://www.thearling.com/text/csss93.htm
36. Wikipedia. (2011a). Nvidia Tesla. Retrieved April 22, 2011, from http://en.wikipedia.org/wiki/Nvidia_Tesla
37. Wikipedia. (2011b). Nehalem (microarchitecture). Retrieved April 22, 2011, from http://en.wikipedia.org/wiki/Nehalem_(microarchitecture)
38. Wikipedia. (2011c). Power7. Retrieved April 22, 2011, from http://en.wikipedia.org/wiki/POWER7
39. Yasuda, K. (2008). Accelerating density functional calculations with graphics processing unit. Journal of Chemical Theory and Computation, 4(8), 1230-1236. doi:10.1021/ct8001046