Reservoir computing: A powerful black-box framework for nonlinear audio processing

Proceedings of the International Conference on Digital Audio Effects, DAFx

Volumn , Issue , 2009, Pages 90-97

  Holzmann, Georg ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO ACOUSTICS; AUDIO SIGNAL PROCESSING; COMPUTATION THEORY; DYNAMICAL SYSTEMS; MUSIC; RECURRENT NEURAL NETWORKS;

ARBITRARY PRECISION; AUDIO PROCESSING; BLACK BOXES; NEURAL NETWORKS TRAININGS; NON-LINEAR RELATIONSHIPS; PROCESSING CAPABILITY; PROCESSING PROBLEMS; RESERVOIR COMPUTING; SIMPLE++; TEMPORAL PROCESSING;

NONLINEAR DYNAMICAL SYSTEMS;

EID: 84865064287     PISSN: 24136700     EISSN: 24136689     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (42)

1. Simon Haykin, "Neural networks expand sp's horizons," IEEE Signal Processing Magazine, vol. 13, pp. 24-49, 1996.
2. Aurelio Uncini, "Audio signal processing by neural networks," Neurocomputing, vol. 55, no. 3-4, pp. 593-625, 2003.
3. H. T. Siegelmann and E. D. Sontag, "Turing computability with neural nets," Applied Mathematics Letters, vol. 4, pp. 77-80, 1991.
4. Herbert Jaeger, "The "echo state" approach to analysing and training recurrent neural networks," Tech. Rep., 2001, German National Research Center for Information Technology Bremen, http://www.faculty.iu-bremen. de/hjaeger/pubs/EchoStatesTechRep.pdf.
5. Wolfgang Maass, Thomas Natschlaeger, and Henry Markram, "Realtime computing without stable states: a new framework for neural computation based on perturbations," Neural Computation, vol. 14, no. 11, pp. 2531-2560, 2002.
6. D. Verstraeten, B. Schrauwen, M. D'Haene, and D. Stroobandt, "2007 special issue: An experimental unification of reservoir computing methods," Neural Networks, vol. 20, no. 3, pp. 391-403, 2007.
7. Nello Cristianini and John Shawe-Taylor, An Introduction to Support Vector Machines and other kernel-based learning methods, Cambridge University Press, 2000.
8. Herbert Jaeger and Harald Hass, "Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication," Science, vol. 304, pp. 78-80, 2004.
9. Jochen J. Steil, "Backpropagation-decorrelation: Recurrent learning with o(n) complexity," in Proc. IJCNN, 2004, pp. 843-848.
10. Juergen Schmidhuber, DaanWierstra, Matteo Gagliolo, and Faustino Gomez, "Training recurrent networks by evolino," Neural Computation, vol. 19, no. 3, pp. 757-779, 2007.
11. W. Maass and C. Bishop, Pulsed Neural Networks, MIT Press, 2001.
12. Ulf D. Schiller and Jochen J. Steil, "Analyzing the weight dynamics of recurrent learning algorithms," Neurocomputing, 2005.
13. Peter F. Dominey, "Complex sensory-motor sequence learning based on recurrent state representation and reinforcement learning," Journal Biological Cybernetics, vol. 73, no. 3, pp. 265-274, 1995.
14. Wolfgang Maass, Prashant Joshi, and Eduardo Sontag, "Computational aspects of feedback in neural circuits," PLoS Computational Biology, vol. 3, no. 1, pp. 1-20, 2007.
15. Simon Haykin, Neural Networks: A Comprehensive Foundation, Prentice Hall, 1998.
16. Herbert Jaeger, "A tutorial on training recurrent neural networks, covering bppt, rtrl, ekf and the "echo state network" approach," Tech. Rep., 2002, German National Research Center for Information Technology Bremen, http://www.faculty.iu-bremen.de/hjaeger/pubs/ESNTutorialRev.pdf.
17. Herbert Jaeger, Mantas Lukoševičius, Dan Popovici, and Udo Siewert, "Optimization and applications of echo state networks with leaky-integrator neurons," Neural Networks, vol. 20, no. 3, pp. 335-352, 2007.
18. Georg Holzmann, "Echo state networks with filter neurons and a delay& sum readout with applications in audio signal processing," M.S. thesis, Institute for Theoretical Computer Science, TU Graz, 2008, http://grh.mur.at/misc/MasterThesis.pdf.
19. M. Lukosecicius and H. Jaeger, "Overview of reservoir recipes," Tech. Rep., 2007, Jacobs University Bremen, http://www.jacobsuniversity.de/ imperia/md/content/groups/research/techreports/reservoiroverview-techreport11. pdf.
20. C.W. Hsu, C. C. Chang, and C. J. Lin, "A practical guide to support vector classification," Tech. Rep., 2003, http://www.csie.ntu.edu.tw/ ~cjlin/papers/guide/guide.pdf.
21. M. Schetzen, The Volterra and Wiener Theories of Nonlinear Systems, John Wiley, New York, 1980.
22. Thomas Helie, "On the use of volterra series for real-time simulations of weakly nonlinear analog audio devices: application to the moog ladder filter," in Proc. of the Int. Conf. on Digital Audio Effects (DAFx-06), 2006.
23. A. Stenger and R. Rabenstein, "Adaptive volterra filters for nonlinear acoustic echo cancellation," Tech. Rep., 1999, http://www.ee.bilkent.edu.tr/~signal/Nsip99/papers/146.pdf.
24. H. Schurer, C. Slump, and O. Herrmann, "Second order volterra inverses for compensation of loudspeaker nonlinearity," in Proceedings of the IEEE ASSP Workshop on applications of signal processing to Audio & Acoustics, 1995, pp. 74-78.
25. W.G. Knecht, "Nonlinear noise filtering and beamforming using the perceptron and its volterra approximation," IEEE Trans. Speech Audio Process, pp. 55-62, 1994.
26. Simon Godsill and Peter Rayner, Digital Audio Restoration, Springer, 1997, http://www-sigproc.eng.cam.ac.uk/%7Esjg/book/digital-audio-restoration. zip.
27. W. Maass and E. D. Sontag, "Neural systems as nonlinear filters," Neural Computation, vol. 12, no. 8, pp. 1743-1772, 2000.
28. Jyri Pakarinen and David Yeh, "A review of digital techniques for modeling vacuum-tube guitar amplifiers," Computer Music Journal, vol. 33, pp. 85-100, 2009.
29. Swen Mueller and Paulo Massarani, "Transfer-function measurement with sweeps," Audio Engineering Society, vol. 49, pp. 443-471, 2001, http://www.anselmgoertz.de/Page10383/Monkey-Forest-dt/Manual-dt/Aes-swp.pdf.
30. Stephan Moeller, Martin Gromowski, and Udo Zoelzer, "A measurement technique for highly nonlinear transfer functions," in Proc. of the Int. Conf. on Digital Audio Effects (DAFx-02), 2002.
31. Jonathan Abel and David Berners, "A technique for nonlinear system measurement," in AES Convention 121, 2006.
32. Joern Schattschneider and Udo Zoelzer, "Discrete-time models for nonlinear audio systems," in Proc. of the Int. Conf. on Digital Audio Effects (DAFx-99), 1999.
33. Steve Harris, "Valve saturation ladspa plugin," Part of the plugin collection of Steve Harris, http://plugin.org.uk/ladspa-swh/docs/ ladspaswh.html, accessed Feb 22, 2009.
34. Tom Szilagyi, "Tap tubewarmth ladspa plugin," Part of the TAP plugin collection of Tom Szilagyi, http://tap-plugins.sourceforge.net/ladspa/ tubewarmth.html, accessed Feb 22, 2009.
35. Herbert Jaeger, "Adaptive nonlinear system identification with echo state networks," Advances in Neural Information Processing Systems 15, MIT Press, pp. 593-600, 2003.
36. Hubert Ausserlechner, "Untersuchungen von dropout- concealmentalgorithmen," M.S. thesis, Institute for Electronic Music and Acoustics, Graz, Austria, 2006, http://www.iem.at/projekte/dsp/untersuchungen/ index-html.
37. D. Goodman, G. Lockhart, O. Wasern, and Wong Wai-Choong, "Waveform substitution techniques for recovering missing speech segments in packet voice communications," IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 34, pp. 1440-1448, 1986.
38. Maciej Niedzwiecki and Krzysztof Cisowski, "Smart copying - a new approach to reconstruction of audio signals," IEEE Transactions on Signal Processing, vol. 49, pp. 2272-2282, 2001.
39. Ellis, P. Daniel, Poliner, and E. Graham, "Classification-based melody transcription," Machine Learning, vol. 65, no. 2-3, pp. 439-456, 2006.
40. G. Poliner, D.P.W. Ellis, A.F. Ehmann, E. Gomez, S. Streich, and Beesuan Ong, "Melody transcription from music audio: Approaches and evaluation," IEEE Transactions on Audio Speech and Language Processing, vol. 15, no. 4, pp. 1247-1256, 2007.
41. G. Poliner and D. Ellis, "A classification approach to melody transcription," in Proceedings of the 2005 International Conference on Music Information Retrieval, 2005.
42. Reservoir Lab Ghent, "Introduction to reservoir computing," http://snn.elis.ugent.be/rcbook, accessed March 30, 2009.