A general framework for unsupervised processing of structured data

Neurocomputing

Volumn 57, Issue 1-4, 2004, Pages 3-35

  Hammer, Barbara ^a   Micheli, Alessio ^b   Sperduti, Alessandro ^c   Strickert, Marc ^a  

^a UNIVERSITY OF OSNABRÜCK   (Germany)

^b UNIVERSITY OF PISA   (Italy)

^c UNIVERSITY OF PADOVA   (Italy)

Author keywords

Kohonen map; Recurrent networks; Self organizing map; SOM for structured data

Indexed keywords

ALGORITHMS; DATA REDUCTION; FUNCTION EVALUATION; GRADIENT METHODS; LEARNING SYSTEMS; RECURRENT NEURAL NETWORKS; RECURSIVE FUNCTIONS; SELF ORGANIZING MAPS; STOCHASTIC PROGRAMMING; VECTOR QUANTIZATION;

VECTOR SPACES;

DATA STRUCTURES;

NERVE GAS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER; DECISION THEORY; DYNAMICS; INFORMATION PROCESSING; INTERNET; LEARNING; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; PROCESS MODEL; PROCESS OPTIMIZATION; SCIENTIFIC LITERATURE; STATISTICS;

EID: 1542786232     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2004.01.008     Document Type: Article

References (52)

1. P. Baldi, S. Brunak, P. Frasconi, G. Pollastri, G. Soda, Exploiting the past and the future in protein secondary structure prediction, Bioinformatics 15 (11) (1999) 918-929.
2. Barreto G. Araújo A. Time in self-organizing maps: an overview of models Int. J. Comput. Res. 10 2 2001 139-179
3. Bengio Y. Simard P. Frasconi P. Learning long-term dependencies with gradient descent is difficult IEEE Trans. Neural Networks 5 2 1994 157-166
4. Bianucci A.M. Micheli A. Sperduti A. Starita A. Application of cascade correlation networks for structures to chemistry J. Appl. Intell. 12 2000 117-146
5. Chappell G. Taylor J. The temporal Kohonen map Neural Networks 6 1993 441-445
6. F. Costa, P. Frasconi, V. Lombardo, G. Soda, Towards incremental parsing of natural language using recursive neural networks, Appl. Intell., to appear.
7. Cottrell M. Fort J.C. Pagèt G. Theoretical aspects of the SOM algorithm Neurocomputing 21 1998 119-138
8. M. Cottrell, P. Letrémy, ImFra94, in: M. Verleysen (Ed.), European Symposium on Artificial Neural Networks 2003, d-side publication, 2003, pp. 85-92.
9. M. Cottrell, P. Rousset, The Kohonen algorithm: a powerful tool for analysing and representing multidimensional quantitative and qualitative variables, in: Proceedings IWANN'97, Springer, Berlin, 1997, pp. 861-871.
10. Erwin E. Obermayer K. Schulten K. Self-organizing maps, convergence properties, and energy functions Biol. Cybern. 67 1 1992 47-55
11. Euliano N.R. Principe J.C. A spatiotemporal memory based on SOMs with activity diffusion in: Oja E. Kaski S. (Eds.), Kohonen Maps 1999 Elsevier Amsterdam
12. I. Farkas, R. Miikkulainen, Modeling the self-organization of directional selectivity in the primary visual cortex, in: Proceedings of the International Conference on Artificial Neural Networks, Springer, Berlin, 1999, pp. 251-256.
13. Frasconi P. Gori M. Küchler A. Sperduti A. A field guide to dynamical recurrent networks in: Kolen J.F. Kremer S.C. (Eds.), From Sequences to Data Structures: Theory and Applications 2001 351-374 IEEE Silverspring, MD
14. Frasconi P. Gori M. Sperduti A. A general framework for adaptive processing of data structures IEEE Trans. Neural Network 9 5 1998 768-786
15. P. Frasconi, M. Gori, A. Sperduti, Learning efficiently with neural networks: a theoretical comparison between structured and flat representations, in: ECAI 2000, Proceedings of the 14th European Conference on Artificial Intelligence, IOS Press, Amsterdam, 2000.
16. C.L. Giles, G.M. Kuhn, R.J. Williams, Special issue on dynamic recurrent neural networks, IEEE Trans. Neural Networks 5 (2) (1994).
17. M. Gori, M. Mozer, A. C. Tsoi, R.L. Watrous, Special issue on recurrent neural networks for sequence processing, Neurocomputing 15 (3-4) (1997).
18. Günter S. Buhnke H. Validation indices for graph clustering in: Jolion J.-M. Kropatsch W.G. Vento M. (Eds.), Proceedings of the Third IAPR-TC15 Workshop on Graph-based Representations in Pattern Recognition 2001 229-238 Ischia Italy
19. Hagenbuchner M. Sperduti A. Tsoi A.C. A self-organizing map for adaptive processing of structured data IEEE Trans. Neural Networks 14 3 2003 491-505
20. Hagenbuchner M. Tsoi A.C. Sperduti A. A supervised self-organizing map for structured data in: Allison N. Yin H. Allinson L. Slack J. (Eds.), Advances in Self-Organizing Maps 2001 21-28 Springer Berlin
21. B. Hammer, Learning with Recurrent Neural Networks, Lecture Notes in Control and Information Sciences, Vol. 254, Springer, Berlin, 2000.
22. B. Hammer, A. Micheli, A. Sperduti, A general framework for self-organizing structure processing neural networks, Technical Report TR-03-04, Dipartimento di Informatica, Università di Pisa, 2003.
23. Hammer B. Villmann T. Generalized relevance learning vector quantization Neural Networks 15 8-9 2002 1059-1068
24. B. Hammer, T. Villmann, Mathematical aspects of neural networks, in: M. Verleysen (Ed.), European Symposium of Artificial Neural Networks 2003, 2003, pp. 59-72.
25. Heskes T. Self-organizing maps, vector quantization, and mixture modeling IEEE Trans. Neural Networks 12 2001 1299-1305
26. Hochreiter S. Schmidhuber J. Long short-term memory Neural. Comput. 9 8 1997 1735-1780
27. Hoekstra A. Drossaers M.F.J. An extended Kohonen feature map for sentence recognition in: Gielen S. Kappen B. (Eds.), Proceedings of ICANN'93, International Conference on Artif. Neural Networks 1993 404-407 Springer Berlin
28. D.L. James, R. Miikkulainen, SARDNET: a self-organizing feature map for sequences, in: G. Tesauro, D. Touretzky, T. Leen (Eds.), Advances in Neural Information Processing Systems, Vol. 7, MIT Press, Cambridge, MA, 1995, pp. 577-584.
29. J. Kangas, Time-delayed self-organizing maps, In: Proceedings of IEEE/INNS International Joint Conjecture on Neural Networks 1990, Vol. 2, 1990, pp. 331-336.
30. Kaski S. Bankruptcy analysis with self-organizing maps in learning metrics IEEE Trans. Neural Networks 12 2001 936-947
31. Kohonen T. Learning vector quantization in: Arbib M. (Ed.), The Handbook of Brain Theory and Neural Networks 1995 537-540 MIT Press Cambridge, MA
32. Kohonen T. Self-Organizing Maps 1997 Springer Berlin
33. Kohonen T. Kaski S. Lagus K. Honkela T. Very large two-level SOM for the browsing of newsgroups in: von der Malsburg C. von Seelen W. Vorbrüggen J.C. Sendhoff B. (Eds.), Proceedings of ICANN'96 1996 269-274 Springer Berlin
34. T. Koskela, M. Varsta, J. Heikkonen, K. Kaski, Recurrent SOM with local linear models in time series prediction, in: M. Verleysen (Ed.), Sixth European Symposium on Artificial Neural Networks, De facto, 1998, p. 167-172.
35. Kremer S.C. Spatio-temporal connectionist networks: a taxonomy and review Neural Comput. 13 2 2001 249-306
36. Kuan C.-M. Hornik K. Convergence of learning algorithms with constant learning rates IEEE Trans. Neural Networks 2 5 1991 484-489
37. Kushner H.J. Clark D.S. Stochastic Approximation Methods for Constrained and Unconstrained Systems 1978 Springer Berlin
38. Martinetz T. Berkovich S. Schulten K. "Neural-gas" network for vector quantization and its application to time-series prediction IEEE Trans. Neural Networks 4 4 1993 558-569
39. Martinetz T. Schulten K. Topology representing networks Neural Networks 7 3 1993 507-522
40. Pearlmutter B.A. Gradient calculations for dynamic recurrent neural networks: a survey IEEE Trans. Neural Networks 6 5 1995 1212-1228
41. Ritter H. Self-organizing maps in non-euclidean spaces in: Oja E. Kaski S. (Eds.), Kohonen Maps 1999 97-108 Springer Berlin
42. Ritter H. Martinetz T. Schulten K. Neural Computation and Self-Organizing Maps, An Introduction 1992 Addison-Wesley Reading, MA
43. A. Sadeghi, Asymptotic behaviour of self-organizing maps with non-uniform stimuli distribution, Technical Report, Universität Kaiserslautern, FB Mathematik, Germany, July 1996.
44. A.S. Sato, K. Yamada, Generalized learning vector quantization, in: G. Tesauro, D. Touretzky, T. Leen, (Eds.), Advances in Neural Information Processing Systems, Vol. 7, MIT Press, Cambridge, MA, 1995, pp. 423-429.
45. Sinkkonen J. Kaski S. Clustering based on conditional distribution in an auxiliary space Neural Comput. 14 2002 217-239
46. Sperduti A. Neural networks for adaptive processing of structured data in: Dorffner G. Bischof H. Hornik K. (Eds.), ICANN'2001 2001 5-12 Springer Berlin
47. Sperduti A. Starita A. Supervised neural networks for the classification of structures IEEE Trans. Neural Networks 8 3 1997 714-735
48. J. Vesanto, Using the SOM and local models in time-series prediction, in: Proceedings of the Workshop on Self-Organizing Maps 1997, Helsinki, Finland, 1997, pp. 209-214.
49. Villmann T. Der R. Herrmann M. Martinetz T. Topology preservation in self-organizing maps: exact definition and measurement IEEE Trans. Neural Networks 8 2 1997 256-266
50. T. Voegtlin, Context quantization and contextual self-organizing maps, in: Proceedings of the International Joint Conference on Neural Networks, Vol. 5, 2000, pp. 20-25.
51. Voegtlin T. Recursive self-organizing maps Neural Networks 15 8-9 2002 979-992
52. Voegtlin T. Dominey P.F. Recursive self-organizing maps in: Allison N. Yin H. Allinson L. Slack J. (Eds.), Advances in Self-Organizing Maps 2001 210-215 Springer Berlin