Gaussian activation functions using Markov chains

IEEE Transactions on Neural Networks

Volumn 13, Issue 6, 2002, Pages 1465-1471

  Card, Howard C ^a   McNeill, Dean K ^a  

^a UNIVERSITY OF MANITOBA   (Canada)

Author keywords

Neural pulse coding; Stochastic arithmetic; Stochastic signal processing (SSP)

Indexed keywords

COMPUTER HARDWARE; CONTROL NONLINEARITIES; MARKOV PROCESSES; SIGNAL PROCESSING;

GAUSSIAN ACTIVATION FUNCTIONS;

NEURAL NETWORKS;

EID: 0036858069     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2002.804285     Document Type: Article

References (23)

1. B.D. Brown and H.C. Card, "Stochastic neural computation," IEEE Trans. Comput., vol. 50, pp. 891-920, Sept. 2001.
2. B.R. Gaines, "Stochastic computing systems," in Advances in Information Systems Science, J.F. Tou, Ed. New York: Plenum, 1969, vol. 2, ch. 2, pp. 37-172.
3. P.D. Hortensius, R.D. McLeod, and H.C. Card, "Parallel random number generation for VLSI systems using cellular automata," IEEE Trans. Comput., vol. 38, pp. 1466-1472, Oct. 1989.
4. H. Zhou, H.C. Card, and G.E. Bridges, "Parallel pseudorandom number generation in GaAs cellular automata for high speed circuit testing," J. Electron. Testing: Theory Applicat., vol. 6, no. 3, pp. 325-330, June 1995.
5. J.E. Tomberg and K. Kaski, "Pulse density modulation technique in VLSI implementation of neural network algorithms," IEEE J. Solid-State Circuits, vol. 25, pp. 1277-1286, May 1990.
6. M.S. Tomlinson, D.J. Walker, and M.A. Sivilotti, "A digital neural network architecture for VLSI," in Proc. Int. Joint Conf. Neural Networks, vol. 2, San Diego, CA, 1990, pp. 545-550.
7. D.E. Van den Bout and T.K. Miller, "A digital architecture employing stochasticism for the simulation of Hopfield neural nets," IEEE Trans. Circuits Syst., vol. 36, pp. 732-738, May 1989.
8. M.S. Melton, T. Phan, D.S. Reeves, and D.E. Van den Bout, "The Tin-MANN VLSI chip," IEEE Trans. Neural Networks, vol. 3, pp. 375-384, May 1992.
9. A. Torralba, F. Colodro, E. Ibanez, and L.G. Frauquelo, "Two digital circuits for a fully parallel stochastic Hopfield neural network," IEEE Trans. Neural Networks, vol. 6, pp. 1264-1268, Sept. 1995.
10. Y. Kondo and Y. Sawada, "Functional abilities of a stochastic logic neural network," IEEE Trans. Neural Networks, vol. 3, pp. 434-443, May 1992.
11. C.L. Janer, J.M. Quero, J.G. Ortega, and L.G. Franquelo, "Fully parallel stochastic computation architecture," IEEE Trans. Signal Processing, vol. 44, pp. 2110-2117, Aug. 1996.
12. P.S. Burge, M.R. van Daalen, B.J.P. Rising, and J.S. Shawe-Taylor, Stochastic Bit-Stream Neural Networks, Pulsed Neural Networks, W. Maass and C.M. Bishop, Eds. Cambridge, MA: MIT Press, 1999.
13. J.A. Dickson, R.D. McLeod, and H.C. Card, "Stochastic arithmetic implementations of neural networks with in situ learning," in Proc. Int. Conf. Neural Networks, San Francisco, CA, 1993, pp. 711-716.
14. J. Zhao, J. Shawe-Taylor, and M. van Daalen, "Learning in stochastic bit-stream neural networks," Neural Networks, vol. 9, pp. 991-998, 1996.
15. Y.C. Kim and M.A. Shanblatt, "Architecture and statistical model of a pulse-mode digital multilayer neural network," IEEE Trans. Neural Networks, vol. 6, pp. 1109-1118, Sept. 1995.
16. A.F. Murray, "Pulse based computation in VLSI neural networks," in Pulsed Neural Networks, W. Maass and C.M. Bishop, Eds. Cambridge, MA: MIT Press, 1999, ch. 3.
17. W. Maass and C.M. Bishop, Eds., Pulsed Neural Networks. Cambridge, MA: MIT Press, 1999.
18. H.C. Card, "Doubly stochastic poisson processes in artificial neural learning," IEEE Trans. Neural Networks, vol. 9, pp. 229-231, Jan. 1998.
19. _, "Compound binomial processes in neural integration," IEEE Trans. Neural Networks, vol. 12, pp. 1505-1512, Nov. 2001.
20. K.S. Trivedi, Probability and Statistics With Reliability, Queueing, and Computer Science Applications. Englewood Cliffs: Prentice-Hall, 1982.
21. H.C. Card, "Dynamics of stochastic artificial neurons," Neurocomput. Lett., vol. 41, pp. 173-182, 2001.
22. _, "Stochastic radial basis functions," Int. J. Neural Syst., vol. 11, no. 2, pp. 203-210, 2001.
23. C.M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Clarendon, 1995.