A perspective on the future of massively parallel computing: Fine-grain vs. coarse-grain parallel models

2004 Computing Frontiers Conference

Volumn , Issue , 2004, Pages 488-502

  Tosic, Predrag T ^a  

^a University of Illinois at Urbana Champaign   (United States)

Author keywords

Cellular automata; Distributed systems; Massively parallel computing; Multiprocessor computers; Neural networks; Parallel computation models

Indexed keywords

AUTOMATA THEORY; COMPUTATIONAL METHODS; DISTRIBUTED COMPUTER SYSTEMS; FUNCTIONS; MATHEMATICAL MODELS; MULTIPROCESSING SYSTEMS; NEURAL NETWORKS;

CELLULAR AUTOMATA; DISTRIBUTED ARCHITECTURES; MASSIVELY PARALLEL COMPUTING;

PARALLEL PROCESSING SYSTEMS;

EID: 4143112527     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. [ADAM] A. Adamatzky, "Computing in Nonlinear Media and Automata", IoP Publ., Bristol (UK), 2001
2. [AKFG] L. A. Akers, D. K. Ferry, R. O. Grondin, "VLSI Implementations of Neural Systems", in "The Computers and The Brain: Perspectives on Human and Artificial Intelligence", J. R. Brink, C. R. Haden (eds.), Elsevier Sci. Publ. North Holland, 1989
3. [ALKE] R. Allen, K. Kennedy, "Optimizing Compilers for Modern Architectures", Morgan Kaufmann, 2001
4. [ANAS] T. Anastasio, Introduction to neuroscience and computational brain theory, a lecture given in ANNCBT seminar, Beckman Institute, UIUC, Fall 2002
5. [ASHB] R. B. Ashby, "Design for a Brain", Wiley, 1960
6. [BALL] D. H. Ballard, "An introduction to natural computation", MIT Press, 1997
7. [BELA] C. H. Bennett, R. Landauer, "The fundamental physical limits of computation", Sci. Amer., 1985
8. [CODK] G. Coulouris, J. Dollimore, T. Kindberg, "Distributed Systems: Concepts and Design", 3rd ed., Addison - Wesley, 2001
9. [CHSE] P. S. Churchland, T. J. Sejnowski, "The Computational Brain", MIT Press, 1992
10. [CORY] D. Gory, A. Fahmy, T. Havel, "NMR Spectroscopy: An Experimentally Accessible Paradigm for Quantum Computing", 4th Workshop on Physics & Computation, Boston, 1996
11. [DEMA] M. Delorme, J. Mazoyer (eds.), "Cellular Automata: A Parallel Model" Kluwer Academic Publ., 1999
12. [FEYN] R. P. Feynman, "Quantum mechanical computers", Optics News, #11, 1985
13. [GAJO] M. R. Garey, D. S. Johnson, "Computers and Intractability: A Guide to the Theory of NP-Completeness", W. H. Freeman & Co., San Francisco, CA, 1979
14. [GARZ] Max Garzon, "Models of Massive Parallelism: Analysis of Cellular Automata and Neural Networks", Springer-Verlag, 1995
15. [GISP] A. Gibbons, P. Spirakis, "Lectures on parallel computation", Cambridge Int'l Series on Parallel Computation, Cambridge Univ. Press, 1993
16. [GOMA] E. Goles, S. Martinez, "Neural and Automata Networks", Kluwer Academic Publ., Dordrecht, 1990
17. [GIRY] A. Gibbons, W. Rytter, "Efficient Parallel Algorithms", Cambridge Univ. Press, 1988
18. [HAYK] S. Haykin, "Neural networks: a comprehensive foundation", Maxwell Macmillan Int'l, 1994
19. [HOFF] A. Hoffmann, "Paradigms of Artificial Intelligence: A Methodological & Computational Analysis", Springer - Verlag, Singapore, 1998
20. [HOMU] J. E. Hopcroft, R. Motwani, J. D. Ullman, "Introduction to Automata Theory, Languages, and Computation", 2nd ed., Addison-Wesley 2001
21. [JACK] R. Jackendoff, "Consciousness and The Computational Mind", Explorations in Cognitive Science series, MIT Press, 1990
22. [KARA] R. M. Karp, V. Ramachandran, "Parallel Algorithms for Shared-Memory Machines", Ch. §17 of "Handbook of Theoretical Computer Science", Vol. I (ed. J. van Leeuwen), Elsevier Sci. Pub. & MIT Press, 1991
23. [KOSE] C. Koch, I. Segev, "Methods in neuronal modeling: from synapses to networks", MIT Press, 1989
24. [LISV] D. Liu, C. Svensson, "Power Consumption Estimation in CMOS VLSI Chips", IEEE J. Solid-State Circuits, vol. 29, #6, 1994
25. [MCPI] W. S. McCullough, W. Pitts, "A logical calculus for the ideas immanent in nervous activity", Bull.Math. Biophysics, #5, 1942
26. [MEPA] S. Melvin, Y. Patt, "Exploiting fine-grained parallelism through a combination of hardware and software techniques", Proc. 18th Ann. Int'l. Symp. Comp. Arch., vol. 19, 1991
27. [MULL] S. Mullender (ed.), "Distributed Systems", 2nd ed., ACM Press & Addison-Wesley, 1993
28. [NEU1] J. von Neumann, "The computers and the brain", Yale Univ. Press, New Haven, 1958
29. [NEU2] J. von Neumann, "Theory of Self-Reproducing Automata", Univ. of Illinois Press, 1966
30. [PAPA] C. Papadimitriou, "Computational Complexity", Addison - Wesley, 1994
31. [SEJN] T. J. Sejnowski, "'The Computer and The Brain' Revisited", in "The Computers and The Brain: Perspectives on Human and Artificial Intelligence", J. R. Brink, C. R. Haden (eds.), Elsevier Sci. Publ., North Holland, 1989
32. [SIPS] M. Sipser, "Introduction to the Theory of Computation", PWS Publishing Co., 1997
33. [SRAY] S. Ray, lectures in CS442, "Artificial Neural Networks", Dept. of Computer Science, UIUC, Fall 2001
34. [SUBI] R. Suaya, G. Birtwistle (eds.), "VLSI and Parallel Computation", Frontiers, Morgan Kaufmann Publ., 1990
35. [TURI] A. M. Turing, "Computing machinery and intelligence", in "Mind: A Quarterly Review of Psychology and Philosophy", vol. LIX, No. 236, Oct. 1950
36. [ULLM] J. D. Ullman, "Computational Aspects of VLSI", Comp. Sci. Press, 1984
37. [VLSI] http://vlsi.wpi.edu/webcourse/toc.html (webcourse on VLSI by Daniel Mlynek and Yusuf Leblebici, Swiss Federal Institute of Technology - Lausanne)
38. [WOLF] S. Wolfram, "Cellular Automata and Complexity: Collected Papers", Addison - Wesley, 1994
39. [XAIY] C. Xavier, S. S. Iyengar, "Introduction to Parallel Algorithms", Wiley Series on Parallel & Distributed Computing, (ed. A. Y. Zomaya), J. Wiley & Sons, 1998
40. [ZOEO] A. Zomaya, F. Ercal, S. Olariou (eds.), "Solutions to Parallel and Distributed Computing Problems: Lessons from Biological Sciences", Wiley Series on Parallel & Distributed Computing, (ed. A. Y. Zomaya), J. Wiley & Sons, 2001