Self-organizing multilayer perceptron

IEEE Transactions on Neural Networks

Volumn 21, Issue 11, 2010, Pages 1766-1779

  Gas, Bruno ^a  

^a UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

Author keywords

Functional data analysis; multilayer perceptron; multivariate functions quantization; self organizing feature maps; speech processing

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATIC SPEECH RECOGNITION; MATHEMATICAL COMPUTING; NONLINEAR SYSTEM; SIGNAL PROCESSING; STANDARD;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; MATHEMATICAL COMPUTING; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; SIGNAL PROCESSING, COMPUTER-ASSISTED; SPEECH RECOGNITION SOFTWARE;

EID: 78149358308     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2010.2072790     Document Type: Article

References (55)

1. T. Kohonen, "Self-organized formation of topologically correct feature maps," Biol. Cybern., vol. 43, no. 1, pp. 59-69, Jan. 1982.
2. T. Kohonen, Self-Organizing Maps, 3rd ed. Berlin, Germany: Springer-Verlag, 2001.
3. M. Faundez, S. McLaughlin, A. Esposito, A. Hussain, J. Schoentgen, G. Kubin, W. Kleijn, and P. Maragos, "Nonlinear speech processing: Overview and applications," Control Intell. Syst., vol. 30, no. 1, pp. 1-10, 2002.
4. G. Kubin, "Nonlinear processing of speech," in Speech Coding and Synthesis, W. B. Kleijn and K. K. Paliwal, Eds. New York: Elsevier, 1995, pp. 557-609.
5. H. Teager and S. Teager, "Evidence for nonlinear sound production mechanisms in the vocal tract," in Proc. Speech Prod. Speech Model., vol. 55. Bonas, France, 1989, pp. 241-261.
6. S. Katagiri, C. Lee, and B. Juang, "A generalized probabilistic descent method," in Proc. Acoust. Soc. Jpn., 1990, pp. 141-142.
7. J. O. Ramsay and B. Silverman, Functional Data Analysis, 2nd ed. New York: Springer-Verlag, 2006.
8. J. O. Ramsay and B. W. Silverman, Applied Functional Data Analysis: Methods and Case Studies. New York: Springer-Verlag, 2002.
9. p norm for time series and its application to self-organizing maps," in Proc. Workshop Self-Organizing Maps, Paris, France, Sep. 2005, pp. 733-740.
10. M. Cottrell, B. Girard, and P. Rousset, "Forecasting of curves using a Kohonen classification," J. Forecasting, vol. 17, nos. 5-6, pp. 429-439, Sep.-Nov. 1998.
11. B. Conan-Guez and F. Rossi, "Multilayer perceptrons for functional data analysis: A projection based approach," in Artificial Neural Networks-ICANN (LNCS), vol. 2415. New York: Springer-Verlag, Jan. 2002, pp. 136-141.
12. F. Rossi and B. Conan-Guez, "Functional multilayer perceptron: A nonlinear tool for functional data analysis," Neural Netw., vol. 18, no. 1, pp. 45-60, Jan. 2005.
13. F. Rossi, B. Conan-Guez, and F. Fleuret, "Theoretical properties of functional multilayer perceptrons," in Proc. Eur. Symp. Artificial Neural Netw., Bruges, Belgium, Germany, Apr. 2002, pp. 7-12.
14. F. Rossi, N. Delannay, B. Conan-Guez, and M. Verleysen, "Representation of functional data in neural networks," Neurocomputing, vol. 64, pp. 183-210, Mar. 2005.
15. F. Rossi, B. Conan-Guez, and E. Golli, "Clustering functional data with the SOM algorithm," in Proc. Eur. Symp. Artificial Neural Netw., Bruges, Belgium, Germany, Apr. 2004, pp. 305-312.
16. H. Luschgy and G. Pagès, "Functional quantization of gaussian processes," J. Funct. Anal., vol. 196, no. 2, pp. 486-531, Dec. 2002.
17. G. Pagès and J. Printems, "Functional quantization for numerics with an application to option pricing," Monte Carlo Methods & Appl., vol. 11, no. 4, pp. 407-446, 2005.
18. T. Tarpey and K. Kinateder, "Clustering functional data," J. Classification, vol. 20, no. 1, pp. 93-114, 2003.
19. B. D. Fleury and T. Tarpey, "Representing a large collection of curves: A case for principal points," The American Statistician, vol. 47, no. 4, pp. 304-306, Nov. 1993.
20. C. Abraham, P. A. Cornillon, E. Matzener-Lober, and N. Molinari, "Un-supervised curve clustering using b-splines," Scandinavian J. Statist., vol. 30, no. 3, pp. 581-595, Sep. 2003.
21. A. Debregeas and G. Hebrail, "Interactive interpretation of Kohonen maps applied to curves," in Proc. Int. Conf. Knowl. Discovery Data Mining, New York, Aug. 1998, pp. 179-183.
22. B. Hammer, A. Micheli, A. Sperduti, and M. Strickert, "Recursive self-organizing network models," Neural Netw., vol. 17, nos. 8-9, pp. 1061-1085, Oct.-Nov. 2004.
23. B. Hammer and T. Villmann, "Generalized relevance learning vector quantization," Neural Netw., vol. 15, nos. 8-9, pp. 1059-1068, Oct. 2002.
24. S. Kaski, J. Sinkkonen, and J. Peltonen, "Bankruptcy analysis with self-organizing maps in learning metrics," IEEE Trans. Neural Netw., vol. 12, no. 4, pp. 936-947, Jul. 2001. (Pubitemid 32732831)
25. M. Cottrell, J. C. Fort, and G. Pagès, "Theoretical aspects of the SOM algorithm," Neurocomputing, vol. 21, nos. 1-3, pp. 119-138, Nov. 1998.
26. T. Villmann and B. Hammer, "Functional principal component learning using Oja's method and Sobolev norms," in Proc. Workshop Self-Organizing Maps, St. Augustine, FL, Jun. 2009, pp. 325-333.
27. B. Gas, J. Zarader, C. Chavy, and M. Chetouani, "Discriminant neural predictive coding applied to phoneme recognition," Neurocomputing, vol. 56, pp. 141-166, Jan. 2004.
28. F. Itakura, "Minimum prediction residual principle applied to speech recognition," IEEE Trans. Acoust., Speech Signal Process., vol. 23, no. 1, pp. 67-72, Feb. 1975.
29. D. E. Rumelhart and G. E. Hinton, "Learning representations by backpropagating errors," Nature, vol. 323, pp. 533-536, Oct. 1986.
30. A. Lapedes and R. Farber, "Nonlinear signal processing using neural networks: Prediction and system modelling," Los Alamos Nat. Lab., Los Alamos, NM, Tech. Rep. LA-UR 87-2662, Jul. 1987.
31. G. Dreyfus, O. Macchi, S. Marcos, O. Nerrand, L. Personnaz, P. Roussel-Ragot, D. Urbani, and C. Vignat, "Adaptive training of feedback neural networks for non-linear filtering," in Proc. IEEE-SP Workshop Neural Netw. Signal Process., vol. 2. Sep. 1992, pp. 550-559.
32. J. Thyssen, H. Nielsen, and S. Hansen, "Non-linear short-term prediction in speech coding," in Proc. Int. Conf. Acoust. Speech Signal Process., vol. 1. Adelaide, SA, Australia, Apr. 1994, pp. 185-188.
33. B. Townshend, "Non linear prediction of speech," in Proc. Int. Conf. Acoust. Speech Signal Process., vol. 1. New York, 1991, pp. 425-428.
34. A. S. Weigend, B. A. Huberman, and D. E. Rumelhart, "Predicting the future: A connectionist approach," Int. J. Neural Syst., vol. 1, no. 3, pp. 193-209, 1990.
35. J. Walter, H. Riter, and K. Schulten, "Nonlinear prediction with self-organizing maps," Neural Netw., vol. 1, pp. 589-594, Jun. 1990.
36. A. Lendasse, J. Lee, V. Wertz, and M. Verleysen, "Time series forecasting using CCA and Kohonen maps-application to electricity consumption," in Proc. Eur. Symp. Artificial Neural Netw., Bruges, Belgium, Germany, Apr. 2000, pp. 329-334.
37. A. R. Webb, "Functional approximation by feed-forward networks: A least square approach to generalisation," IEEE Trans. Neural Netw., vol. 5, no. 3, pp. 363-371, May 1994.
38. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Clarendon, 1995.
39. The Tecator Data Set. (1995) [Online]. Available: http://lib.stat.cmu. edu/datasets/tecator
40. M. C. Mackey and L. Glass, "Oscillation and chaos in physiological control systems," Science, vol. 197, no. 4300, pp. 287-289, Jul. 1977.
41. G. Atsalakis, C. Skiadas, and D. Nezis, "Forecasting chaotic time series by a neural network," in Proc. Int. Conf. Chaotic Model. Simulat., Chania, Greece, Jun. 2008, pp. 77-82.
42. T. Kohonen, "The 'neural' phonetic typewriter," Computer, vol. 21, no. 3, pp. 11-22, Mar. 1988.
43. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, and D. S. Pallett, "DARPA TIMIT acoustic-phonetic continuous speech corpus CD-ROM. NIST speech disc 1-1.1," Nat. Inst. Standards Technol., Gaithersburg, MD, Tech. Rep. NISTIR 4930, Feb. 1993.
44. B. S. Atal and S. L. Hanauer, "Speech analysis and synthesis by linear prediction of the peech wave," J. Acoust. Soc. Amer., vol. 50, no. 2B, pp. 637-655, Aug. 1971.
45. F. Itakura and S. Saito, "Analysis synthesis telephony based on the maximum likelihood method," in Proc. 6th Int. Congr. Acoust., Tokyo, Japan, 1968, pp. 17-20.
46. K. J. Lang, A. H. Waibel, and G. Hinton, "A time-delay neural network architecture for isolated word recognition," Neural Netw., vol. 3, no. 1, pp. 23-43, 1990.
47. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. J. Lang, "Phoneme recognition using time-delay neural networks," IEEE Trans. Acoust., Speech Signal Process., vol. 37, no. 3, pp. 328-339, Mar. 1989.
48. F. Girosi and T. Poggio, "Representation properties of networks: Kolmogorov's theorem is irrelevant," Neural Comput., vol. 1, no. 4, pp. 465-469, 1989.
49. K. Hornik, M. Stinchcombe, A. White, and P. Auer, "Degree of approximation results for feedforward networks approximating unknown mappings and their derivatives," Neural comput., vol. 6, no. 6, pp. 1262-1275, Nov. 1994.
50. A. Gallant and H. White, "There exists a neural network that does not make avoidable mistakes," in Proc. IEEE Int. Conf. Neural Netw., vol. 1. San Diego, CA, Jul. 1988, pp. 657-664.
51. A. Barron, "Universal approximation bounds for superposition of a sigmoidal function," IEEE Trans. Inform. Theory, vol. 39, no. 3, pp. 930-945, May 1993.
52. A. Erwin, K. Obermayer, and K. Shulten, "Self-organizing maps: Ordering, convergence properties and energy functions," Biol. Cybern., vol. 67, no. 1, pp. 47-55, 1992.
53. H. U. Bauer and T. Villmann, "Growing a hypercubical output space in a self-organizing feature map," IEEE Trans. Neural Netw., vol. 8, no. 2, pp. 218-226, Mar. 1997.
54. T. Hastie and W. Stuetzle, "Principal curves," J. Amer. Statist. Assoc., vol. 84, no. 406, pp. 502-516, Jun. 1989.
55. H. Ritter, T. Martinez, and K. Schulten, Neural Computation and Self-Organizing Maps; An Introduction. Reading, MA: Addison-Wesley, 1992