Efficient learning in adaptive processing of data structures

Neural Processing Letters

Volumn 17, Issue 2, 2003, Pages 175-190

  Cho, Siu Yeung ^a   Chi, Zheru ^a   Wang, Zhiyong ^a   Siu, Wan Chi ^a  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Adaptive processing of data structures; Backpropagation through structures; Long term dependency problem

Indexed keywords

ALGORITHMS; BACKPROPAGATION; LEARNING SYSTEMS; NEURAL NETWORKS;

LONG-TERM DEPENDENCY PROBLEM;

DATA STRUCTURES;

EID: 0038511948     PISSN: 13704621     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1023680629977     Document Type: Article

References (13)

1. Tsoi, A. C.: Adaptive processing of data structures: an expository overview and comments. Technical report, Faculty of Informatics, University of Wollongong, Australia, 1998.
2. Frasconi, P., Gori, M. and Sperduti, A.: A general framework for adaptive processing of data structures, IEEE Transactions on Neural Networks, 9 (1998), 768-785.
3. Sperduti, A. and Starita, A.: Supervised Neural Networks for Classification of Structures, IEEE Transactions on Neural Networks, 8(3) (1997), 714-735.
4. Goller, C. and Kuchler, A.: Learning task-dependent distributed representations by back-propagation through structure, in IEEE International Conference on Neural Networks, pp. 347-352, 1996.
5. Rumelhart, D. E. and McClelland, J. L.: Parallel Distributed Processing: Explorations in the Microstructure of Cognition. MIT Press, 1986.
6. Gori, M. and Tesi, A.: On the problem of local minima in backpropagation, IEEE Transactions on Pattern Analysis Machine Intelligence, 14(1) (1992), 76-86.
7. Bengio, Y., Simard, P. and Frasconi, P.: Learning Long-Term Dependencies with Gradient Descent is Difficult, IEEE Transactions on Neural Networks, 5(2) March (1994), 157-166.
8. Aarts, E. and Korst, J.: Simulated Annealing and Boltzmann Machines: A Stochastic Approach to Combinatorial Optimization and Neural Computing, Wiley, New York, 1999.
9. Dodd, N.: Optimization of network structure using genetic techniques, International Joint Conference on Neural Networks, San Diego, 1990.
10. Battiti, R. and Tecchiolli, G.: Training neural nets with the reactive tabu search, IEEE Transactions on Neural Networks, 6(5) (1995), 1185-1200.
11. Shang, Y. and Wah, B. W.: Global optimization for neural networks training, IEEE Computer, 29(3) (1996), 45-54.
12. Cho, S. Y. and Chow, T. W. S.: Training multi-layer neural networks using fast global learning algorithm - least squares and penalized optimization methods, Neurocomputing, 25(1999), 115-131.
13. Wang, Z., Chi, Z., Feng, D. and Cho, S. Y.: Adaptive processing of tree-structure image representation, In: H. Y. Shum et al., (eds), Lecture Notes in Computer Science 2195: Advances in Multimedia Information Processing, pp. 989-995, 2002, Springer-Verlag.