Convergence of backward-error-propagation learning in photorefractive crystals

Applied Optics

Volumn 35, Issue 8, 1996, Pages 1328-1343

  Petrisor, Gregory C ^a   Goldstein, Adam A ^a   Jenkins, B Keith ^a   Herbulock, Edward J ^a   Tanguay, Armand R ^a  

^a University of Southern California ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0141761931     PISSN: 1559128X     EISSN: 21553165     Source Type: Journal    
DOI: 10.1364/AO.35.001328     Document Type: Article

References (36)

1. P. J. van Heerden, “Theory of optical information storage in solids, ”Appl. Opt. 2, 393-400 (1963).
2. F. H. Mok, “Angle-multiplexed storage of 5000 holograms in lithium niobate, ” Opt. Lett. 18, 915-917 (1993).
3. K. Wagner and D. Psaltis, “Multilayer optical learning net-works, ”Appl. Opt. 26, 5061-5076 (1987).
4. D. Psaltis, D. Brady, and K. Wagner, “Adaptive optical networks usingphotorefractive crystals, ”Appl. Opt. 27, 1752-1759 (1988).
5. P. Yeh, A. E. T. Chiou, and J. Hong, “Optical interconnection using photorefractive dynamic holograms, ” Appl. Opt. 27, 2093-2095 (1988).
6. H. Yoshinaga, K. Kitayama, and T. Hara, “All-optical error-signal generation for backpropagation learning in optical multilayer neural networks, ” Opt. Lett. 14, 262-264 (1989).
7. E. G. Paek, J. R. Wullert II, and J. S. Patel, “Holographic implementation of a learning machine based on a multicategory perceptron algorithm, ” Opt. Lett. 14, 1303-1305 (1989).
8. D. Psaltis, D. Brady, X.-G. Gu, and S. Lin, “Holography in artificial neural networks, ” Nature (London) 343, 325-343 (1990).
9. A. Marrakchi, W. M. Hubbard, S. F. Habiby, and J. S. Patel, “Dynamic holographic interconnects with analog weights in photorefractive crystals, ” Opt. Eng. 29, 215-224 (1990).
10. J. H. Hong, S. Campbell, and P. Yeh, “Optical pattern classifier with Perceptron learning, ” Appl. Opt. 29, 3019-3025 (1990).
11. C. Peterson, S. Redfield, J. D. Keeler, and E. Hartman, “Optoelectronic implementation of multilayer neural networks in a single photorefractive crystal, ” Opt. Eng. 29, 359-368 (1990).
12. Y. Owechko and B. H. Soffer, “Optical interconnection method for neural networks using self-pumped phase-conjugate mirrors, ” Opt. Lett. 16, 675-677 (1991).
13. G. J. Dunning, Y. Owechko, and B. H. Soffer, “Hybrid optoelectronic neural networks using a mutually pumped phase-conjugate mirror, ” Opt. Lett. 16, 928-930 (1991).
14. Y. Qiao and D. Psaltis, “Learning algorithms for optical multilayer neural networks, ” in Proceedings of the Third International Joint Conference on Neural Networks (IEEE, New York, 1991), Vol. 1, pp. 457-462.
15. Y. Qiao and D. Psaltis, “Local learning algorithm for optical neural networks, ”Appl. Opt. 31, 3285-3288 (1992).
16. B. K. Jenkins and A. R. Tanguay, Jr., Photonic implementations of neural networks, in Neural Networks for Signal Processing, Bart Kosko, ed. (Prentice-Hall, Englewood Cliffs, N.J., 1992), pp. 287-379.
17. Y. Owechko, “Cascaded-grating holography for artificial neu-ralnetworks, ”Appl. Opt. 32, 1380-1398 (1993).
18. J. Hong, “Applications of photorefractive crystals for optical neural networks, ”Opt. Quantum Electron. 25, 551-568 (1993).
19. K. Y. Hsu, S. H. Lin, and P. Yeh, “Conditional convergence of photorefractive perceptron learning, ” Opt. Lett. 18, 2135-2137 (1993).
20. K. Wagner and T. M. Slagle, “Optical competitive learning with VLSI/liquid-crystal winner-take-all modulators, ” Appl. Opt. 32, 1408-1435 (1993).
21. C. J. Cheng, P. C. Yeh, and K. Y. Hsu, “Generalizedperceptron learning rule and its implications for photorefractive neural networks, ”J. Opt. Soc. Am. B 11, 1619-1624 (1994).
22. T. Galstyan, G. Pauliat, A. Villing, and G. Roosen, “Adaptive photorefractive neurons for self-organizing networks, ” Opt. Commun. 109, 35-42 (1994).
23. Y. Qiao, D. Psaltis, C. Gu, J. Hong, P. Yeh, and R. R. Neurgaonkar, “Phase-locked sustainment of photorefractive holograms using phase conjugation, ” J. Appl. Phys. 70, 4646-4648 (1991).
24. A. Goldstein, G. C. Petrisor, and B. K. Jenkins, “Gain and exposure schedule to compensate for photorefractive neuralnetwork weight decay, ” Opt. Lett. 20, 611-613 (1995).
25. D. C. Plaut, S. J. Nowlan, and G. E. Hinton, “Experiments on learning by back propagation, ” Tech. Rep. CMU-CS-86-126 (Department of Computer Science, Carnegie-Mellon, Pittsburgh, Pa., 1986), p. 8.
26. P. Asthana, G. P. Nordin, A. R. Tanguay, Jr., and B. K. Jenkins, “Analysis of weighted fan-out/fan-in volume holographic optical interconnections, ” Appl. Opt. 32, 1441-1469 (1993).
27. N. V. Kukhtarev, “Kinetics of hologram recording and erasure in electrooptic crystals, ” Sov. Tech. Phys. Lett. 2, 438-448 (1976).
28. D. Brady and D. Psaltis, “Information capacity of 3-D holographic data storage, ” Opt. Quantum Electron. 25, 597-610 (1993).
29. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning internal representations by error propagation, ” in Parallel Distributed Processing, D. Rumelhart and J. McClelland, eds. (MIT, Cambridge, Mass., 1986), Vol. 1, Chap. 8, pp. 318-328.
30. H. Lee, X. G. Gu, and D. Psaltis, “Volume holographic interconnections with maximal capacity and minimal crosstalk, ”J. Appl. Phys. 65, 2191-2195 (1989).
31. D. Brady and D. Psaltis, “Control of volume holograms, ” J. Opt. Soc. Am. A 9, 1167-1182 (1992).
32. C. Slinger, “Analysis ofthe N-to-N volume-holographic neural interconnect, ”J. Opt. Soc. Am. A 8, 1074-1081 (1991).
33. B. K. Jenkins, G. C. Petrisor, S. Piazzolla, P. Asthana, and A. R. Tanguay Jr., “Photonic architecture for neural nets using incoherent/coherent holographic interconnections, ” in Optical Computing’90, J. Tsujinunchi, Y. Ichioka, and S. Ishihara, eds., Proc. Soc. Photo-Opt. Instrum. Eng. 1359, 317-318 (1990).
34. G. P. Nordin, “Analysis of volume diffraction phenomena for photonic neural network implementations and stratified volume holographic optical elements, ” Ph.D. dissertation University of Southern California, Los Angeles, Calif., (1992), pp. 99-130.
35. G. C. Petrisor, S. Piazzolla, G. P. Nordin, B. K. Jenkins, and A. R. Tanguay, Jr., “Volume holographic interconnections and copying architectures based on incoherent/coherent source arrays, ” in Fourth International Conference on Holographic Systems, Components, and Applications, IEEE Conf. Pub. (Institute of Electrical Engineering, London, September 1993), pp. 21-26.
36. D. Psaltis, X.-G. Gu, and D. Brady, “Fractal sampling grids for holographic interconnections, ” in Optical Computing’88, P. Chavel, J. W. Goodman, and G. Roblin, eds., Proc. Soc. Photo-Opt. Instrum. Eng. 963, 468-474 (1988).