Fixed-weight on-line learning

IEEE Transactions on Neural Networks

Volumn 10, Issue 2, 1999, Pages 272-283

  Younger, A Steven ^a,b   Conwell, Peter R ^c   Cotter, Neil E ^a,d  

^a IEEE   (United States)

^b UNIVERSITY OF UTAH   (United States)

^c Collett Consulting Group ^*  (United States)

^d Department of Electrical and Computer Engineering   (United States)

Author keywords

Fixed weight learning; Integrated learning; Meta learning; On line learning; Optical neural networks; Short term memory; Working memory

Indexed keywords

COMPUTER SYSTEMS PROGRAMMING; NEURAL NETWORKS; ONLINE SYSTEMS; TOPOLOGY;

FIXED-WEIGHT ONLINE LEARNING; INTEGRATED LEARNING; METALEARNING; OPTICAL NEURAL NETWORKS;

LEARNING SYSTEMS;

EID: 0033100384     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.750553     Document Type: Article

References (21)

1. N. E. Cotter and P. R. Conwell, "Fixed-weight networks can learn," in Proc. Int. Joint Conf. Neural Networks, IEEE, San Diego, CA, 1990. New York: IEEE, 1990, pp. II553-II559.
2. _, "Methuselah networks and optimal control," in Proc. Int. Joint Conf. Neural Networks, IEEE, San Diego, CA, 1990. New York: IEEE, 1990. pp. III401-III406.
3. _, "Learning algorithms and fixed dynamics," in Proc. Int. Joint Conf. Neural Networks, IEEE, Seattle, WA, 1991. New York: IEEE, 1991. pp. 1799-1804.
4. _, "Universal approximation by phase series and fixed-weight networks," Neural Comput., vol. 5, pp. 359-362, 1993.
5. J. A. Hertz, A. Krogh, and R. G. Palmer, Introduction to the Theory of Neural Computation. Redwood City, CA: Addison-Wesley, 1991.
6. W. Wiegerinck and T. Heskes, "How dependencies between successive examples affect on-line learning," Neural Comput., vol. 8, pp. 1743-1765, 1996.
7. R. J. Williams and D. Zipser, "A learning algorithm for continually running fully recurrent neural networks," Univ. San Diego, La Jolla, CA, ICS Tech. Rep. 8805.
8. F. J. Pineda, "Generalization of back-propagation to recurrent neural networks," Phys. Rev. Lett., vol. 59, pp. 2229-2232, 1989.
9. L. B. Almeida, "A learning rule for asynchronous perceptrons with feedback in combinatorial environment," in Proc. IEEE 1st Int. Conf. Neural Networks, San Diego, CA, 1987. New York: IEEE, 1987, pp. II609-II618.
10. B. A. Pearlmutter, "Dynamic recurrent neural networks," School Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, Rep. CMU-CS-90-196, 1990.
11. D. O. Hebb, The Organization of Behavior. New York: Wiley, 1949.
12. W. S. McCulloch and W. Pitts, "A logical calculus of the ideas imminent in nervous activity," in Bull. Math. Biophys., vol. 5, 1943.
13. M. A. Holler, "VLSI implementation of learning and memory systems: A review," in Advances Neural Inform. Processing Syst. 3, R. P. Lippman, J. R. Moody, D. S. Toutetzky, Eds. San Mateo, CA: Morgan-Kaufmann, 1991.
14. C. Mao and K. M. Johnson, "Optoelectronic array that computes error and weight modification for a bipolar neural network," Appl. Opt., vol. 32, no. 8, pp. 1290-1296, 1993.
15. A. Lapedes and R. Farber, "Self-optimizing, nonsymmetrical neural net for content addressable memory and pattern recognition," Physica, vol. 22D, pp. 247-259, 1986.
16. _, "Programming a massively parallel, computation universal system: Static behavior," in Neural Networks for Computing, J. S. Denker, Ed. New York: Am. Inst. Phys., pp. 283-296.
17. A. Baddeley, Working Memory. Oxford, U.K.: Clarendon, 1986.
18. J. L. Gould and P. Marler, "Learning by instinct," Sci. Amer., 1987.
19. E. Fiesler, "Neural network classification and formalization," in Computer Standards and Interfaces, vol. 16, J. Fulcher, Ed. Amsterdam, The Netherlands: Elsevier, 1994.
20. M. C. Mozer, "A focused back-propagation algorithm for temporal pattern recognition," Complex Syst., vol. 3, pp. 349-381, 1989.
21. A. S. Younger, "Learning in fixed-weight recurrent neural networks," Ph.D. dissertation, Univ. Utah, 1996.