An Introduction to Computing with Neural Nets

IEEE ASSP Magazine

Volumn 4, Issue 2, 1987, Pages 4-22

  Lippmann, Richard P ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL NEURAL NETS; NEURAL NET MODELS; PATTERN CLASSIFICATION;

IMAGE PROCESSING; PATTERN RECOGNITION SYSTEMS - DESIGN; SPEECH - RECOGNITION;

SYSTEMS SCIENCE AND CYBERNETICS;

EID: 0023331258     PISSN: 07407467     EISSN: None     Source Type: Journal    
DOI: 10.1109/MASSP.1987.1165576     Document Type: Article

References (48)

1. Y. S. Abu-Mostafa and D. Pslatis, “Optical Neural Computers,” Scientific American, 256, 88–95, March 1987.
2. E. B. Baum, J. Moody, and F. Wilczek, “Internal Representations for Associative Memory,” NSF-ITP-86– 138 Institute for Theoretical Physics, University of California, Santa Barbara, California, 1986.
3. G. A. Carpenter, and S. Grossberg, “Neural Dynamics of Category Learning and Recognition: Attention, Memory Consolidation, and Amnesia,” in J. Davis, R. Newburgh, and E. Wegman (Eds.) Brain Structure, Learning, and Memory, AAAS Symposium Series, 1986.
4. M. A. Cohen, and S. Grossberg, “Absolute Stability of Global Pattern Formation and Parallel Memory Storage by Competitive Neural Networks,” IEEE Trans. Syst. Man Cybern, SMC-13, 815–826, 1983.
5. B. Delgutte, “Speech Coding in the Auditory Nerve: II. Processing Schemes for Vowel-Like Sounds,” J. Acoust. Soc. Am. 75, 879–886, 1984.
6. J. S. Denker, AIP Conference Proceedings 151, Neural Networks for Computing, Snowbird Utah, A IP, 1986.
7. R. O. Duda and P. E. Hart, Pattern Classification and. Scene Analysis, John Wiley & Sons, New York (1973).
8. J. L. Elman and D. Zipser, “Learning the Hidden Structure of Speech,” Institute for Cognitive Science, University of California at San Diego, ICS Report 8701, Feb; 1987.
9. J. A. Feldman and D.H. Ballard, “Connectionist Models and Their Properties,” Cognitive Science, Vol. 6, 205–254, 1982.
10. R. G. Gallager, Information Theory and Reliable Communication, John Wiley & Sons, New York (1968).
11. O. Ghitza, “Robustness Against Noise: The Role of Timing-Synchrony Measurement,” in Proceedings International Conference on Acoustics Speech and Signal Processing, ICASSP-87, Dallas, Texas, April 1987.
12. B. Gold, “Hopfield Model Applied to Vowel and Consonant Discrimination,” MIT Lincoln Laboratory Technical Report, TR-747, AD-A169742, June 1986.
13. H. P. Graf, L. D. Jackel, R. E. Howard, B. Straughn, J. S. Denker, W. Hubbard, D. M. Tennant, and D. Schwartz, “VLSI Implementation of a Neural, Network Memory With Several Hundreds of Neurons,” in J.S. Denker (Ed.) AIP Conference Proceedings 151, Neural Networks for Computing, Snowbird Utah, AIP, 1986.
14. P. M. Grant and J. P. Sage, “A Comparison of Neural Network and Matched Filter Processing for Detecting Lines in Images,” in J.S. Denker (Ed.) AIP Conference Proceedings 151, Neural Networks for Computing, Snowbird Utah, AIP, 1986.
15. S. Grossberg, The Adaptive Brain I: Cognition, Learning, Reinforcement, and Rhythm, and The Adaptive Brain II: Vision, Speech, Language, and Motor Control, Elsevier/North-Holland, Amsterdam (1986).
16. J. A. Hartigan, Clustering Algorithms, John Wiley & Sons, New York (1975).
17. D. O. Hebb, The Organization of Behavior, John Wiley & Sons, New York (1949).
18. J. J. Hopfield, “Neural Networks and Physical Systems with Emergent Collective Computational Abilities,” Proc. Natl. Acad. Sci. USA, Vol. 79, 2554–2558, April 1982.
19. J. J. Hopfield, “Neurons with Graded Response Have Collective Computational Properties Like Those of Two-State Neurons,” Proc. Natl. Acad. Sci. USA, Vol. 81, 3088–3092, May 1984.
20. J. J. Hopfield, and, D.W, Tank, “Computing with Neural Circuits: A Model,” Science, Vol. 233, 625–633, August 1986.
21. E. R. Kandel and J. H. Schwartz, Principles of Neural Science, Elsevier, New York (1985).
22. T. Kohonen, Self-Organization and Associative Memory, Springer-Verlag, Berlin(1984).
23. T. Kohonen, K. Masisara and T. Saramaki, “Phono-topic Maps—Insightful Representation of Phonological Features for Speech Representation,” Proceedings IEEE 7th Inter. Conf. on Pattern Recognition, Montreal, Canada, 1984.
24. F. L. Lewis, Optimal Estimation, John Wiley & Sons, New York (1986).
25. R. P. Lippmann, B. Gold, and M. L. Malpass, “A Comparison of Hamming and Hopfield Neural Nets for Pattern Classification,” MIT Lincoln Laboratory Technical Report, TR-769, to be published.
26. G. G. Lorentz, “The 13th Problem of Hilbert,” in F. E. Browder (Ed.), Mathematical Developments Arising from Hilbert Problems, American Mathematical Society, Providence, R.I. (1976).
27. R. F. Lyon and E. P. Loeb, “Isolated Digit Recognition Experiments with a Cochlear Model,” in Proceedings International Conference on Acoustics Speech and Signal Processing, ICASSP-87, Dallas, Texas, April 1987.
28. J. Makhoul, S. Roucos, and H. Gish, “Vector Quantization in Speech Coding,” IEEE Proceedings, 73, 1551–1588, Nov. 1985.
29. T. Martin, Acoustic Recognition of a Limited Vocabulary in Continuous Speech, Ph.D. Thesis, Dept. Electrical Engineering Univ. Pennsylvania, 1970.
30. W. S. McCulloch, and W. Pitts, “A Logical Calculus of the Ideas Imminent in Nervous Activity,” Bulletin of Mathematical Biophysics, 5, 115–133, 1943.
31. C. A. Mead, Analog VLSI and Neural Systems, Course Notes, Computer Science Dept., California Institute of Technology, 1986.
32. M. Minsky, and S. Papert, Perceptrons: An Introduction to Computational Geometry, MIT Press (1969).
33. A. R. Moller, Auditory Physiology, Academic Press, New York (1983).
34. P. Mueller, and J. Lazzaro, “A Machine for Neural Computation of Acoustical Patterns with Application to Real-Time Speech Recognition,” in J.S. Denker (Ed.) AIP Conference Proceedings 151, Neural Networks for Computing, Snowbird Utah, AIP, 1986.
35. D. B. Parker, “A Comparison of Algorithms for Neuron-Like Cells,” in J.S. Denker (Ed.) AIP Conference Proceedings 151, Neural Networks for Computing, Snowbird Utah, AIP, 1986.
36. T. Parsons, Voice and Speech Processing, McGraw-Hill, New York (1986).
37. S. M. Peeling, R. K. Moore, and M. J. Tomlinson, “The Multi-Layer Perceptron as a Tool for Speech Pattern Processing Research,” in Proc. loA Autumn Conf. on Speech and Hearing, 1986.
38. T. E. Posch, “Models of the Generation and Processing of Signals by Nerve Cells; A Categorically Indexed Abridged Bibliography,” USCEE Report 290, August 1968.
39. R. Rosenblatt, Principles of Neurodynamics, New York, Spartan Books (1959).
40. D. E. Rumelhart, G.E. Hinton, and R.J. Williams, “Learning Internal Representations by Error Propagation” in D. E. Rumelhart & J. L. McClelland (Eds.), Parallel Distributed Processing: Explorations in the Mi-crostructure of Cognition. Vol, 1: Foundations. MIT Press (1986).
41. D. E. Rumelhart, and J.L. McClelland, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, MIT Press (1986).
42. J. P. Sage, K. Thompson, and R.S. Withers, “An Artificial Neural Network Integrated Circuit Based on MNOS/CD Principles,” in J.S. Denker (Ed.) AIP Conference Proceedings 151, Neural Networks for Computing, Snowbird Utah, AIP, 1986.
43. T. Sejnowski and C. R. Rosenberg, “NETtalk: A Parallel Network That Learns to Read Aloud,” Johns Hopkins Univ. Technical Report JHU/EECS-86/01, 1986.
44. S. Seneff, “A Computational Model for the Peripheral Auditory System: Application to Speech Recognition Research,” in Proceedings International Conference on Acoustics Speech and Signal Processing, ICASSP-86, 4, 37.8.1–37.8.4, 1986.
45. D. W. Tank and J.J. Hopfield, “Simple ‘Neural’ Optimization Networks: An AID Converter, Signal Decision Circuit, and a Linear Programming Circuit,” IEEE Trans. Circuits Systems CAS-33, 533–541, 1986.
46. D. J. Wallace, “Memory and Learning in a Class of Neural Models,” in B. Bunk and K.H. Mutter (Eds.) Proceedings of the Workshop on Lattice Gauge Theory, Wuppertal, 1985, Plenum (1986)
47. B. Widrow, and M. E. Hoff. “Adaptive Switching Circuits,” 1960 IRE WESCON Conv. Record, Part 4, 96–104, August 1960.
48. B. Widrow and S. D. Stearns, Adaptive Signal Processing, Prentice-Hall, New Jersey (1985).