Parallel reservoir computing using optical amplifiers

IEEE Transactions on Neural Networks

Volumn 22, Issue 9, 2011, Pages 1469-1481

  Vandoorne, Kristof ^a   Dambre, Joni ^a   Verstraeten, David ^a   Schrauwen, Benjamin ^a   Bienstman, Peter ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

Integrated optics; optical neural networks; photonic reservoir computing; semiconductor optical amplifiers; speech recognition

Indexed keywords

AMPLIFIER NOISE; BABBLE NOISE; COMPUTATIONAL PARADIGM; DESIGN PARAMETERS; HARDWARE IMPLEMENTATIONS; HYPERBOLIC TANGENT FUNCTION; INTEGRATED PHOTONICS; ISOLATED WORD RECOGNITION; NEURAL SYSTEMS; OPTICAL NEURAL NETWORKS; PARALLEL HARDWARE; PERFORMANCE BENEFITS; POWER EFFICIENCY; POWER EFFICIENT; PROCESS VARIATION; RESERVOIR ARCHITECTURE; RESERVOIR COMPUTING; SOFTWARE-BASED; TEST CASE;

HARDWARE; HYPERBOLIC FUNCTIONS; PHOTONICS; SEMICONDUCTOR OPTICAL AMPLIFIERS; SPEECH RECOGNITION;

OPTICAL SWITCHES;

AMPLIFIER; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATIC SPEECH RECOGNITION; COMPUTER SIMULATION; HUMAN; NOISE; OPTICAL INSTRUMENTATION; PATTERN RECOGNITION; SEMICONDUCTOR; SPECTROSCOPY;

AMPLIFIERS, ELECTRONIC; COMPUTER SIMULATION; HUMANS; NEURAL NETWORKS (COMPUTER); NOISE; OPTICAL DEVICES; PATTERN RECOGNITION, PHYSIOLOGICAL; SEMICONDUCTORS; SPECTRUM ANALYSIS; SPEECH RECOGNITION SOFTWARE;

EID: 80052392918     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2161771     Document Type: Review

References (28)

1. H. Jaeger and H. Haas, "Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication", Science, vol. 304, no. 5667, pp. 78-80, Apr. 2004.
2. W. Maass, T. Natschläger, and H. Markram, "Real-time computing without stable states: A new framework for neural computation based on perturbations", Neural Comput., vol. 14, no. 11, pp. 2531-2560, Nov. 2002.
3. M. D. Skowronski and J. G. Harris, "Automatic speech recognition using a predictive echo state network classifier", Neural Netw., vol. 20, no. 3, pp. 414-423, Apr. 2007.
4. E. Antonelo, B. Schrauwen, X. Dutoit, D. Stroobandt, and M. Nuttin, "Event detection and localization in mobile robot navigation using reservoir computing", in Proc. Int. Conf. Artif. Neural Netw., Porto, Portugal, Sep. 2007, pp. 660-669.
5. R. Legenstein and W. Maass, "What makes a dynamical system computationally powerful?" in New Directions in Statistical Signal Processing: From Systems to Brains, S. Haykin, J. C. Principe, T. Sejnowski, and J. McWhirter, Eds. Cambridge, MA: MIT Press, 2007, pp. 127-154.
6. D. Verstraeten, S. Xavier-de-Souza, B. Schrauwen, J. A. K. Suykens, D. Stroobandt, and J. Vandewalle, "Pattern classification with CNNs as reservoirs", in Proc. Int. Symp. Nonlin. Theory Appl., Budapest, Hungary, Sep. 2008, pp. 101-104.
7. K. P. Dockendorf, I. Park, P. He, J. C. Príncipe, and T. B. DeMarse, "Liquid state machines and cultured cortical networks: The separation property", Biosystems, vol. 95, no. 2, pp. 90-97, Feb. 2009.
8. C. Fernando and S. Sojakka, "Pattern recognition in a bucket", in Proc. 7th Eur. Conf. Artif. Life, LNAI 2801. Dortmund, Germany, Sep. 2003, pp. 588-597.
9. W. J. Goh and N. Crook, "Pattern recognition using chaotic transients", in Proc. 15th Eur. Symp. Artif. Neural Netw., Bruges, Belgium, Apr. 2007, pp. 7-12.
10. B. Jones, D. Stekel, J. Rowe, and C. Fernando, "Is there a liquid state machine in the bacterium escherichia coli?" in Proc. IEEE Symp. Artif. Life, Honolulu, HI, Apr. 2007, pp. 187-191.
11. K. Vandoorne, W. Dierckx, B. Schrauwen, D. Verstraeten, R. Baets, P. Bienstman, and J. Van Campenhout, "Toward optical signal processing using photonic reservoir computing", Opt. Exp., vol. 16, no. 15, pp. 11182-11192, Jul. 2008.
12. H. Jaeger, "Tutorial on training recurrent neural networks, covering BPTT, RTRL, EKF and the 'echo state network' approach", German Nat. Research Center Information Technology, St. Augustin, Germany, Tech. Rep. GMD 159, 2002.
13. D. Verstraeten, B. Schrauwen, M. D'Haene, and D. Stroobandt, "An experimental unification of reservoir computing methods", Neural Netw., vol. 20, no. 3, pp. 391-403, Apr. 2007.
14. L. Busing, B. Schrauwen, and R. Legenstein, "Connectivity, dynamics, and memory in reservoir computing with binary and analog neurons", Neural Comput., vol. 22, no. 5, pp. 1272-1311, May 2010.
15. B. E. A. Saleh and M. V. Teich, Fundamentals of Photonics. New York: Wiley, 1991.
16. P. De Heyn, B. Kuyken, D. Vermeulen, W. Bogaerts, and D. Van Thourhout, "High-performance low-loss silicon-on-insulator microring resonators using TM-polarized light", in Proc. Opt. Fiber Commun. Conf. Exposit. Nat. Fiber Opt. Eng. Conf., Los Angeles, CA, Mar. 2011, pp. 1-3.
17. W. Bogaerts, D. Taillaert, P. Dumon, D. Van Thourhout, and R. Baets, "A polarization-diversity wavelength duplexer circuit in silicon-oninsulator photonic wires", Opt. Exp., vol. 15, no. 4, pp. 1567-1578, Feb. 2007.
18. G. P. Agrawal and N. A. Olsson, "Self-phase modulation and spectral broadening of optical pulses in semiconductor laser amplifiers", IEEE J. Quantum Electron., vol. 25, no. 11, pp. 2297-2306, Nov. 1989.
19. W. Bogaerts, P. Dumon, D. Van Thourhout, and R. Baets, "Lowloss, low-cross-talk crossings for silicon-on-insulator nanophotonic waveguides", Opt. Lett., vol. 32, no. 19, pp. 2801-2803, Oct. 2007.
20. W. Bogaerts, S. K. Selvaraja, P. Dumon, J. Brouckaert, K. De Vos, D. Van Thourhout, and R. Baets, "Silicon-on-insulator spectral filters fabricated with CMOS technology", IEEE J. Sel. Topics Quantum Electron., vol. 16, no. 1, pp. 33-44, Jan.-Feb. 2010.
21. M. Tassaert, S. Keyvaninia, D. Van Thourhout, W. M. J. Green, Y. Vlasov, and G. Roelkens, "A nanophotonic InP/InGaAlAs optical amplifier integrated on a silicon-on-insulator waveguide circuit", in Proc. Inf. Photon., Ottawa, ON, Canada, May 2011, pp. 1-2.
22. A. J. Robinson, G. D. Cook, D. P. W. Ellis, E. Fosler-Lussier, S. J. Renals, and D. A. G. Williams, "Connectionist speech recognition of broadcast news", Speech Commun., vol. 37, nos. 1-2, pp. 27-45, May 2002.
23. A. J. Robinson, "An application of recurrent nets to phone probability estimation", IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 298-305, Mar. 1994.
24. G. R. Doddington and T. B. Schalk, "Speech recognition: Turning theory to practice", IEEE Spectr., vol. 18, no. 9, pp. 26-32, Sep. 1981.
25. R. Lyon, "A computational model of filtering, detection, and compression in the cochlea", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. 7. Paris, France, May 1982, pp. 1282-1285.
26. A. N. Tikhonov and V. I. Arsenin, Solutions of Ill-Posed Problems (Scripta in Mathematics). New York: Winston, 1977.
27. W. Bogaerts and S. K. Selvaraja, "Compact single-mode silicon hybrid rib/strip waveguide with adiabatic bends", IEEE Photon. J., vol. 3, no. 3, pp. 422-432, Jun. 2011.
28. N. A. Olsson, "Lightwave systems with optical amplifiers", J. Lightw. Technol., vol. 7, no. 7, pp. 1071-1082, Jul. 1989.