Dynamic tunneling technique for efficient training of multilayer perceptrons

IEEE Transactions on Neural Networks

Volumn 10, Issue 1, 1999, Pages 48-55

  RoyChowdhury, Pinaki ^a   Singh, Y P ^b   Chansarkar, R A ^c  

^a Ministry of Defence   (India)

^b BANARAS HINDU UNIVERSITY   (India)

^c NONE

Author keywords

DTT; Lipschitz condition; MLP

Indexed keywords

COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; FEEDFORWARD NEURAL NETWORKS; LEARNING ALGORITHMS; LEARNING SYSTEMS;

DYNAMIC TUNNELING METHOD; GRADIENT DESCENT METHOD; LIPSCHITZ CONDITION;

MULTILAYER NEURAL NETWORKS;

EID: 0032785934     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.737492     Document Type: Article

References (20)

1. G. E. Hinton, "How neural networks learn from experience," Sci. Amer., pp. 145-151, Sept. 1992.
2. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by backpropagating errors," Nature, vol. 323, pp. 533-536, 1986.
3. R. Beale and T. Jackson, Neural Computing: An Introduction. Bristol, U.K.: Inst. Phys., 1992.
4. X.-H. Yu and G.-A. Chen, "Efficient backpropagation learning using optimal learning rate and momentum," Neural Networks, vol. 10, no. 3, pp. 517-527, 1997.
5. R. Battiti, "First- and second-order methods for learning: Between steepest descent and Newton methods," Neural Comput., vol. 4, pp. 141-166, 1992.
6. S. Osowski, P. Bojarczak, and M. Stodolski, "Fast second-order learning algorithm for feedforward multilayer neural networks and its applications," Neural Networks, vol. 9, no. 9, pp. 1583-1596, 1996.
7. T. H. Martin and B. M. Mohammad, "Training feedforward network with Marquardt algorithm," IEEE Trans. Neural Networks, vol. 5, pp. 959-963, Nov. 1996.
8. E. M. Johansson, F. U. Dowla, and D. M. Goodman, "Backpropagation learning for multilayer feedforward neural networks using the conjugate gradient method," Int. J. Neural Systems, vol. 2, no. 4, pp. 291-302, 1992.
9. M. S. Moller, "A scaled conjugate gradient algorithm for fast supervised learning," Neural Networks, vol. 6, no. 4, pp. 525-534, 1993.
10. G. D. Magoulas, M. N. Vrahatis, and G. S. Androulakis, "Effective backpropagation training with variable stepsize," Neural Networks, vol. 10, no. 1, pp. 69-82, 1997.
11. G.-J. Wang and C.-C. Chen, "A fast multilayer neural-network training algorithm based on the layer-by-layer optimizing procedures," IEEE Trans. Neural Networks, vol. 7, pp. 768-775, May 1996.
12. R. Parisi, E. D. Di Claudio, G. Orlandi, and B. D. Rao, "A generalized learning paradigm exploiting the structure of feedforward neural networks," IEEE Trans. Neural Networks, vol. 7, pp. 1450-1460, Nov. 1996.
13. J. Barhen, V. Protopopescu, and D. Reister, "TRUST: A deterministic algorithm for global optimization," Science, vol. 276, pp. 1094-1097, May 1997.
14. B. C. Cetin, J. Barhen, and J. W. Burdick, "Terminal repeller unconstrained subenergy tunneling (TRUST) for fast global optimization," J. Optimization Theory Applicat., vol. 77, no. 1, pp. 97-126, Apr. 1993.
15. K. Deb, Optimization For Engineering Design, Algorithms and Examples. New Delhi, India: Prentice-Hall of India, 1995.
16. C. G. Looney, "Advances in feedforward neural networks: Demystifying knowledge acquiring black boxes," IEEE Trans. Knowledge Data Eng., vol. 8, pp. 211-226, Apr. 1996.
17. D. Gries, Science of Programming. New Delhi, India: Narosa.
18. P. RoyChowdhury, Y. P. Singh, and R. A. Chansarkar, "A new global minimization method for training feedforward neural networks," Neural Networks, to appear.
19. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by error propagation," in Parallel Distributed Processing: Explorations in the Microstructures of Cognition, D. E. Rumelhart and J. L. McClelland, Eds. Cambridge, MA: MIT Press, 1986, pp. 318-362.
20. M. M. Mano, Digital Design, 2nd ed. New Delhi, India: Prentice-Hall of India, 1995.