Application of Bayesian trained RBF networks to nonlinear time-series modeling

Signal Processing

Volumn 83, Issue 7, 2003, Pages 1393-1410

  Rank, Erhard ^a  

^a VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

Bayesian learning; Nonlinear modeling; Oscillator model

Indexed keywords

LEARNING SYSTEMS; NONLINEAR SYSTEMS; RADIAL BASIS FUNCTION NETWORKS; SIGNAL TO NOISE RATIO; TIME SERIES ANALYSIS;

BAYESIAN LEARNING;

SIGNAL PROCESSING;

EID: 0037508527     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0165-1684(03)00088-4     Document Type: Article

References (45)

1. Abarbanel H.D.I., Brown R., Sidorowich J.J., Tsimring L.Sh. The analysis of observed chaotic data in physical systems. Rev. Mod. Phys. 65(4):1993;1331-1392.
2. Abdulhai B., Ritchie S.G. Enhancing the universality and transferability of freeway incident detection using a Bayesian-based neural network. Transp. Res. C. 7:1999;261-280.
3. Baesens B., Viaene S., Van den Poel D., Vanthienen J., Dedene G. Bayesian neural network learning for repeat purchase modelling in direct marketing. Eur. J. Oper. Res. 138:2002;191-211.
4. Bailly G. A parametric. harmonic+noise model Keller E., Bailly G., Monaghan A., Terken J., Huckvale M. Improvements in Speech Synthesis, COST 258: The Naturalness of Synthetic Speech. 2002;Wiley, New York.
5. Banbrook M., McLaughlin S., Mann I. Speech characterization and synthesis by nonlinear methods. IEEE Trans. Speech Audio Process. 7(1):January 1999;1-17.
6. Bernhard H.-P. A tight upper bound on the gain of linear and nonlinear predictors for stationary stochastic processes. IEEE Trans. Signal Process. 43:November 1998;2909-2917.
7. H.-P. Bernhard, G. Kubin, Speech production and chaos, in: Proceedings of the International Congress of Phonetic Sciences, Aix-en-Provence, France, August 1991, pp. 394-397.
8. M. Beutnagel, A. Conkie, J. Schroeter, Y. Stylianou, A. Syrdal, The AT&T next-gen TTS system, in: Proceedings of the 137th Meeting of the Acoustical Society of America, 1999, http://www.research.att.com/projects/tts.
9. M. Birgmeier, A fully Kalman-trained radial basis function network for nonlinear speech modeling, in: Proceedings of the IEEE International Conference on Neural Networks, Perth, Australia, 1995, pp. 259-264.
10. M. Birgmeier, H.-P. Bernhard, G. Kubin, Nonlinear long-term prediction of speech signals, in: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Vol. 2, Munich, Germany, 1997, pp. 1283-1286.
11. A.W. Black, R. Clark, The festival speech synthesis system, URL: http://www.cstr.ed.ac.uk/projects/festival, January 2003.
12. Cowper M.R., Mulgrew B., Unsworth C.P. Nonlinear prediction of chaotic signals using a normalized radial basis function network. Signal Process. 82:2002;775-789.
13. G. de Krom, Acoustic correlates of breathiness and roughness, Ph.D. Thesis, Utrecht, 1994.
14. G. Fant, J. Liljencrants, Q.-G. Lin, A four parameter model of glottal flow, Quarterly Progress Status Report 4, Speech Transmission Laboratory/Royal Institute of Technology, Stockholm, Sweden, 1985.
15. H. Haas, G. Kubin, A multi-band nonlinear oscillator model for speech, in: Proceedings of the 32nd Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, 1998.
16. Haykin S., Príncipe J. Making sense of a complex world. IEEE Signal Process. Mag. 15(3):May 1998;66-81.
17. Hegger R., Kantz H., Schreiber T. Practical implementation of nonlinear time series methods. the TISEAN package CHAOS. 9:1999;413-435.
18. Ishizaka K., Flanagan J.L. Synthesis of voiced sounds from a two-mass model of the vocal cords. Bell Systems Tech. J. 51:1972;1233-1267.
19. E. Keller, G. Bailly, A. Monaghan, J. Terken, M. Huckvale (Eds.), Improvements in Speech Synthesis, COST 258: The Naturalness of Synthetic Speech, Wiley, New York, 2002.
20. G. Kubin, Synthesis and coding of continuous speech with the nonlinear oscillator model, in: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Vol. 1, Atlanta, GA, 1996, pp. 267-270.
21. G. Kubin, W.B. Kleijn, Time-scale modification of speech based on a nonlinear oscillator model, in: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Vol. 1, Adelaide, South Australia, 1994, pp. 453-456.
22. J. Laroche, Y. Stylianou, E. Moulines, HNS: speech modification based on a harmonic+noise model, in: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Vol. 2, 1993, pp. 550-553.
23. MacKay D.J.C. Bayesian non-linear modelling for the prediction competition. ASHRAE Trans. 100:1994;1053-1062.
24. MacKay D.J.C. Bayesian interpolation. Neural Comput. 4(3):1992;415-447.
25. MacKay D.J.C. The evidence framework applied to classification networks. Neural Comput. 4(5):1992;698-714.
26. MacKay D.J.C. A practical Bayesian framework for backprop networks. Neural Comput. 4(3):1992;448-472.
27. MacKay D.J.C. Comparison of approximate methods for handling hyperparameters. Neural Comput. 11(5):1999;1035-1068.
28. I. Mann, An investigation of nonlinear speech synthesis and pitch modification techniques, Ph.D. Thesis, University of Edinburgh, 1999.
29. Mann I., McLaughlin S. Synthesising natural-sounding vowels using a nonlinear dynamical model. Signal Process. 81(8):2001;1743-1756.
30. I. Mann, S. McLaughlin, Stable speech synthesis using recurrent radial basis functions, in: Proceedings of the European Conference on Speech Communication and Technology, Budapest, Hungary, 1999.
31. Markel J.D., Gray A.H. Jr. Linear Prediction of Speech. 1976;Springer, Berlin, Heidelberg, New York.
32. Moon T.K. The expectation-maximization algorithm. IEEE Signal Process. Mag. 13(6):November 1996;47-60.
33. K. Narasimhan, J.C. Príncipe, D.G. Childers, Nonlinear dynamic modeling of the voiced excitation for improved speech synthesis, in: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Phoenix, Arizona, 1999, pp. 389-392.
34. Neal R.M. Bayesian learning for neural networks. Lecture Notes in Statistics. Vol. 118:1996;Springer, Berlin.
35. T. Poggio, F. Girosi, A theory of networks for approximation and learning, A.I. Memo 1140, Massachusetts Institute of Technology, 1989.
36. J. Príncipe, L. Wang, J.-M. Kuo, Nonlinear dynamic modeling with neural networks, in: Proceedings of the First European Conference on Signal Analysis and Prediction, 1997.
37. E. Rank, Synthese von Vokalen mit einem Oszillatormodell unter Berücksichtigung der stimmlosen Anregung, in: Wolfgang Hess, Karlheinz Stöber (Eds.), Zwölfte Konferenz Elektronische Sprachsignalverarbeitung ESSV, Rüdiger Hoffmann: Studientexte zur Sprachkommunikation, Band 22, 2001, pp. 136-143.
38. E. Rank, G. Kubin, Nonlinear synthesis of vowels in the LP residual domain with a regularized RBF network, in: J. Mira, A. Prieto (Eds.), Proceedings of the Sixth International Work-Conference on Artificial and Natural Neural Networks, IWANN2001, Lecture Notes in Computer Science, Vol. 2085, part II, Granada, Spain, Springer, Berlin, 2001, pp. 746-753.
39. Sauer T., Yorke J.A., Casdagli M. Embedology. J. Statist. Phys. 65(3/4):1991;579-616.
40. J.C. Sprott, Chaos and Time-series Analysis, Oxford University Press, 2003.
41. Stylianou Y. Applying the harmonic plus noise model in concatenative synthesis. IEEE Trans. Speech Audio Process. 9(1):2001;21-29.
42. Takens F. On the numerical determination of the dimension of an attractor. Rand D., Young L.S. Dynamic Systems and Turbulence. Warwick 1980 Lecture Notes in Mathematics. Vol. 898:1981;366-381 Springer, Berlin.
43. Tipping M.E. Sparse Bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 1:2001;211-244.
44. W. van Kempelen, Mechanismus der menschlichen Sprache nebst Beschreibung einer sprechenden Maschine, Grammatica Universalis 4. Herbert E. Brekle, 1970 (including a facsimile of the original publication, J.V. Degen, 1791).
45. Vehtari A., Lampinen J. Bayesian MLP neural networks for image analysis. Pattern Recognition Lett. 21:2000;1183-1191.