Overview of hybrid optical neural networks

Optics and Laser Technology

Volumn 28, Issue 2 SPEC. ISS., 1996, Pages 59-72

  Jutamulia, Suganda ^a   Yu, Francis T S ^b  

^a Silicon Valley Office   (United States)

^b The Center for Nanotechnology Education and Utilization   (United States)

Author keywords

Hybrid optical processor; Neural networks; Optical architecture

Indexed keywords

HOLOGRAPHIC OPTICAL ELEMENTS; NEURAL NETWORKS; OPTICAL DATA PROCESSING;

HYBRID OPTICAL PROCESSOR; OPTICAL ARCHITECTURE; OPTICAL NEURAL NETWORKS;

OPTICAL SYSTEMS;

EID: 0030106872     PISSN: 00303992     EISSN: None     Source Type: Journal    
DOI: 10.1016/0030-3992(95)00070-4     Document Type: Article

References (76)

1. Psaltis, D., Farhat, N. Optical information processing based on associative-memory model of neural nets with thresholding and feedback, Opt Lett, 10 (1985) 98-100
2. Caulfield, H.J., Kinser, J., Rogers, S.K. Optical neural networks, Proc IEEE, 77 (1989) 1573-1583
3. Yu, F.T.S. Optical neural networks: architecture, design and models. In Progress in Optics, Vol. 32 (Ed. Wolf, E.) North-Holland Physics Publishing Co. (1993) 61-144
4. Jutamulia, S. (Ed) Selected Papers on Optical Neural Networks, SPIE Milestone Series MS96 (1994)
5. Yu, F.T.S., Jutamulia, S. Optical Signal Processing, Computing, and Neural Networks, Wiley, New York (1992)
6. McCulloch, W.S., Pitts, W.A. A logical calculus of the ideas immanent in nervous activity, Bull Math Biophys, 5 (1943) 115-133
7. Stevens, C.F. The neuron, Scientific American 241 (3) (September 1979) 54-65
8. Farhat, N.H. Neural net models and optical computing: a brief overview. In Optical and Hybrid Computing (Ed. Szu, H.H.) Proc SPIE 634 (1986) 307-311
9. Goodman, J.W., Dias, A.R., Woody, L.M. Fully parallel, high-speed incoherent optical method for performing discrete Fourier transform, Opt Lett, 2 (1978) 1-3
10. Kranzdorf, M., Bigner, B.J., Zhang, L., Johnson, K.M. Optical connectionist machine with polarization-based bipolar weight values, Opt Eng, 28 (1989) 844-848
11. Shariv, I., Gila, O., Friesem, A.A. All-optical bipolar neural network with polarization-modulating neurons, Opt Lett, 16 (1991) 1692-1694
12. Yu, F.T.S., Yang, X., Lu, T. Space-time-sharing optical neural networks, Opt Lett, 16 (1991) 247-249
13. Jang, J-S., Jung, S-W., Lee, S-Y., Shin, S-Y. Optical implementation of the Hopfield model for two-dimensional associative memory, Opt Lett, 13 (1988) 248-250
14. Wang, X-M., Mu, G-G. Optical neural network with bipolar neural states, Appl Opt, 31 (1992) 4712-4719
15. Uang, C-M., Lu, G., Yu, F.T.S. Unipolar interpattern association neural network, Opt Lett, 19 (1994) 52-54
16. Little, G.R., Gustafson, S.C., Senn, R. A. Generalization of the backpropagation neural network learning algorithm to permit complex weight, Appl Opt, 29 (1990) 1591-1592
17. Farhat, N.H., Psaltis, D. Optical implementation of associative memory based on models of neural networks. In Optical Signal Processing (Ed. Horner, J.L.) Academic Press, San Diego (1987) 129-162
18. Athale, R.A., Stirk, C.W. Compact architectures for adaptive neural nets, Opt Eng, 28 (1989) 447-455
19. Jutamulia, S., Storti, G.M., Seiderman, W., Lindmayer, J. Compact vector-matrix multiplier system employing electron trapping materials, US Patent 5, 134, 686 (1992)
20. Nitta, Y., Ohta, J., Tai, S., Kyuma, K. Optical learning neurochip with internal analog memory, Appl Opt, 32 (1993) 1264-1274
21. Wu, S., Lu, T., Xu, X., Yu, F.T.S. An adaptive optical neural network using a high resolution video monitor, Microwave & Opt Tech Lett, 2 (1989) 252-257
22. Lin, S., Liu, L., Wang, Z. Optical implementation of the 2-D Hopfield model for a 2-D associative memory, Opt Commun, 70 (1989) 87-91
23. Widjaja, J., Uozumi, J., Asakura, T. Optical implementation of artificial synapses by means of the Wigner distribution approach, Opt Eng, 33 (1994) 1655-1658
24. Jutamulia, S., Storti, G.M., Lindmayer, J., Seiderman, W. Use of electron trapping materials in optical signal processing. 2: two-dimensional associative memory, Appl Opt 30 (1991) 2879-2884
25. Lalanne, P., Chavel, P., Taboury, J. Optical inner-product implementation of neural networks model, Appl Opt, 28 (1989) 377-385
26. Jutamulia, S. Uses of joint transform correlators in supervised and unsupervised hybrid computational-optical neural networks, Opt Rev, 1 (1995) 39-40
27. Weaver, C.S., Goodman, J.W. A technique for optically convolving two functions, Appl Opt, 5 (1966) 1248-1249
28. Rau, J.E. Detection of differences in real distributions, J Opt Soc Am, 56 (1966) 1490-1494
29. Bracewell, R.N. The Fourier Transform and Its Application, 2nd Edn, McGraw-Hill, New York (1978)
30. Vander Lugt, A. Signal detection by complex spatial filtering, IEEE Trans Inf Theory, IT-10 (1964) 139-145
31. Chao, T-H., Stoner, W.W. Optical implementation of a feature-based neural network with application to automatic target recognition, Appl Opt, 32 (1993) 1359-1369
32. Psaltis, D., Park, C.H., Hong, J. Higher order associative memories and their optical implementations, Neural Networks, 1 (1988) 149-163
33. Hong, J., Campbell, S., Yeh, P. Optical pattern classifier with perceptron learning, Appl Opt, 29 (1990) 3019-3025
34. Goodman, J.W. Introduction to Fourier Optics, McGraw-Hill, New York (1968)
35. Jutamulia, S., Asakura, T. A general approach to noncoherent correlations, J Optics (Paris), 16, (1985) 121-125
36. Jutamulia, S. (Ed) Selected Papers on Optical Correlators, SPIE Milestone Series MS76 (1993)
37. White, H.J., Wright, W.A. Holographic implementation of a Hopfield model with discrete weights, Appl Opt, 27 (1988) 331-338
38. Ivanov, V.A., Kiselyov, B.S., Mikaelian, A.L., Okonov, D.E. Optoelectronic neuroprocessor based on holographic disk memory using 1-D hologram recording, Opt Mem Neur Netw, 1 (1992) 55-62
39. Psaltis, D., Brady, D., Gu, X-G., Lin, S. Holography in artificial neural networks, Nature, 343 (January 25, 1990) 325-330
40. Wagner, K., Psaltis, D. Multilayer optical learning networks, Appl Opt, 26 (1987) 5061-5076
41. Solymar, L., Cooke, D.J. Volume Holography and Volume Gratings, Academic Press, New York (1981)
42. Arrathoon, R. Historical perspective: optical crossbars and optical computing. In Digital Optical Computing (Ed. Arrathoon, R.) Proc SPIE, 752 (1987) 2-11
43. Goutzoulis, A.P. Comparison of laser diode and electronic residue position-coded look-up tables, Opt Eng, 28 (1989) 373-379
44. Ito, F., Kitayama, K. Optical implementation of the Hopfield neural network using multiple fiber nets, Appl Opt, 28 (1989) 4176-4181
45. Goodman, J.W., Leonberger, F.J., Kung, S-Y., Athale, R.A. Optical interconnections for VLSI systems, Proc IEEE 72 (1984) 850-866
46. Athale, R.A. Optical matrix algebraic processors: a survey, Proc 10th Int Opt Comp Conf IEEE Cat. No 83CH1880-4 (1983) 24-31
47. Sawchuck, A.A., Jenkins, B.K., Raghavendra, C.S., Varma, A. Optical crossbar networks, Computer (June 1987) 50-60
48. Rosenblatt, F. The perceptron: a probabilistic model for information storage and organization in the brain, Psych Rev, 65 (1958) 386-408
49. Lippmann, R.P. An introduction to computing with neural nets, IEEE ASSP Magazine (April 1987) 4-22
50. Widrow, B., Hoff, M.E. Adaptive switching circuits, IRE WESCON Conv Record Part 4 (1960) 96-104
51. McAulay, A.D., Wang, J., Xu, X. Optical perceptron learning for binary classification with spatial light rebroadcasters, Appl Opt, 32 (1993) 1346-1353
52. Itoh, F., Kitayama, K., Tamura, Y. Optical outer-product learning in a neural network using optically stimulable phosphors, Opt Lett, 15 (1990) 860-862
53. Fisher, A.D., Lippincott, W.L., Lee, J.N. Optical implementations of associative networks with versatile adaptive learning capabilities, Appl Opt, 26 (1987) 5039-5054
54. Remelhart, D.E., Hinton, G.E., Williams, R.J. Learning internal representations by error propagation. In Parallel Distributed Processing: Vol. 1 (Eds Rumelhart, D.E. and McClelland, J.L.) MIT Press, Cambridge (1988) 318-364
55. Jutamulia, S. An implementation of backpropagation learning using an adaptive joint transform correlator, Opt Mem Neur Netw 2 (1993) 177-183
56. Peterson, C., Redfield, S., Keeler, J.D., Hartman, E. Optoelectronic implementation of multilayer neural networks in a single photorefractive crystal, Opt Eng, 29 (1990) 359-368
57. Psaltis, D., Brady, D., Wagner, K. Adaptive optical networks using photorefractive crystals, Appl Opt, 27 (1988) 1752-1759
58. Kagan, D., Friedman, H. Backpropagating neurons from bichromatic interaction with a three-level system, Appl Opt, 28 (1989) 1697-1700
59. Hopfield, J.J. Neural networks and physical systems with emergent collective computational abilities, Proc of the National Academy of Sciences (USA), 79 (1982) 2554-2558
60. Hopfield, J.J., Tank, D.W. Computing with neural circuits: a model, Science, 233 (1986) 625-633
61. Jutamulia, S., Storti, G.M., Lindmayer, J., Seiderman, W. Use of electron trapping materials in optical signal processing. 3: modifiable Hopfield type neural networks, Appl Opt, 30 (1991) 1786-1790
62. Lu, T., Xu., X., Wu, S., Yu, F.T.S. Neural network model using interpattern association, Appl Opt, 29 (1990) 284-288
63. van Heerden, P. J. A new optical method of storing and retrieving information, Appl Opt, 2 (1963) 387-392
64. van Heerden, P.J. Theory of optical information storage in solids, Appl Opt, 2 (1963) 393-400
65. Gabor, D. Associative holographic memory. IBM J Res Dev 13 (1969) 156-159
66. Lohmann, A.W., Thum, Ch. Two-way code translation by computer-generated holographic filters, Opt Commun, 46 (1983) 74-78
67. Owechko, Y., Dunning, G.J., Marom, E., Soffer, B.H. Holographic associative memory with nonlinearities in the correlation domain, Appl Opt, 26 (1987) 1900-1910
68. Paek, E.G., Psaltis, D. Optical associative memory using Fourier transform holograms, Opt Eng, 26 (1987) 428-433
69. Yariv, A., Kwong, S-K., Kyuma, K. Demonstration of an all-optical associative memory, Appl Phys Lett, 48 (1986) 1114-1116
70. Anderson, D.Z., Erie, M.C. Resonator memories and optical novelty filters, Opt Eng, 26 (1987) 434-444
71. Mada, H. Architecture for optical computing using holographic associative memories, Appl Opt, 24 (1985) 2063-2066
72. Yu, F.T.S., Jutamulia, S. Implementation of symbolic substitution logic using optical associative memories, Appl Opt, 26 (1987) 2293-2294
73. Athale, R.A., Szu, H.H., Friedlander, C.B. Optical implementation of associative memory with controlled nonlinearity in the correlation domain, Opt Lett, 11 (1986) 484
74. Liu, H-K., Kung, S.Y., Davis, J.A. Real-time optical associative retrieval technique, Opt Eng, 25 (1986) 853-856
75. Widrow, B., Rumelhart, D.E., Lehr, M.A. Neural networks: applications in industry, business and science, Comms of the ACM, 37 (1994) 93-105
76. Bylinsky, G. Computers that learn by doing, Fortune, 128 (September 6, 1993) 96-98