Fast and efficient and training of neural networks

3rd International Conference on Human System Interaction, HSI'2010 - Conference Proceedings

Volumn , Issue , 2010, Pages 175-181

  Yu, Hao ^a   Wilamowski, ^a  

^a AUBURN UNIVERSITY   (United States)

Author keywords

Levenberg Marquardt algorithm; Neural network training

Indexed keywords

HESSIAN MATRICES; LEVENBERG-MARQUARDT ALGORITHM; MATRIX MULTIPLICATION; MEMORY COST; NEURAL NETWORK TRAINING; SECOND-ORDER ALGORITHMS; TRAINING PROCESS; VECTOR OPERATIONS;

ALGORITHMS; JACOBIAN MATRICES;

NEURAL NETWORKS;

EID: 77955670448     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HSI.2010.5514571     Document Type: Conference Paper

References (13)

1. K. Levenberg, "A method for the solution of certain problems in least squares". Quarterly of Applied Machematics, 5, pp. 164-168, 1944.
2. Wu, J.-M., "Multilayer Potts Perceptrons with Levenberg- Marquardt Learning". IEEE Trans. on Neural Networks, vol.19, no.12, pp. 2032-2043, Feb 2008.
3. C. Alzate, J. A. K. Suykens, "Kernel Component Analysis Using an Epsilon-Insensitive Robust Loss Function," IEEE Trans. on Neural Networks, vol.19, no.9, pp. 1583-1598, Sept 2008.
4. H. Deng, H.-X. Li, Y.-H. Wu, "Feedback-Linearization-Based Neural Adaptive Control for Unknown Nonaffine Nonlinear Discrete-Time Systems," IEEE Trans. on Neural Networks, vol.19, no.9, pp. 1615-1625, Sept 2008.
5. B. M. Wilamowski, "Neural Network Architectures and Learning Algorithms: How Not to Be Frustrated with Neural Networks," IEEE Industrial Electronics Magazine, vol.3, no.4, pp. 56-63, Dec. 2009.
6. Werbos P. J., "Back-propagation: Past and Future". Proceeding of International Conference on Neural Networks, San Diego, CA, 1, 343-354, 1988.
7. Sheng Wan, L.E. Banta, "Parameter Incremental Learning Algorithm for Neural Networks," IEEE Trans. on Neural Networks, vol.17, no.6, pp. 1424-1438, June 2006.
8. Wilamowski, B.M. Cotton, N.J. Kaynak, O. Dundar, G., "Computing Gradient Vector and Jacobian Matrix in Arbitrarily Connected Neural Networks", IEEE Trans. on Industrial Electronics, vol. 55, no. 10, pp. 3784-3790, Oct. 2008.
9. Hao Yu and B. M. Wilamowski, "Efficient and reliable training of neural networks", in Proc. 2nd IEEE Human System Interaction Conf. HSI 2009, Catania, Italy, May 21-23, 2009, pp. 109-115.
10. Hagan, M.T. Menhaj, M.B., "Training feedforward networks with the Marquardt algorithm". IEEE Trans. on Neural Networks, vol.5, no.6, pp. 989-993, Nov. 1994.
11. Jian-Xun Peng, Kang Li, G.W. Irwin, "A New Jacobian Matrix for Optimal Learning of Single-Layer Neural Networks," IEEE Trans. on Neural Networks, vol.19, no.1, pp. 119-129, Jan 2008.
12. L.J. Cao, S.S. Keerthi, Chong-Jin Ong, J.Q. Zhang, U. Periyathamby, Xiu Ju Fu, H.P. Lee, "Parallel sequential minimal optimization for the training of support vector machines," IEEE Trans. on Neural Networks, vol.17, no.4, pp. 1039- 1049, April 2006. (Pubitemid 44194161)
13. Hao Yu and B. M. Wilamowski, "C++ Implementation of Neural Networks Trainer", 13-th International Conference on Intelligent Engineering Systems, INES-09, Barbados, April 16-18, 2009.