Weights direct determination of feedforward neural networks without iterative BP-training

Intelligent Soft Computation and Evolving Data Mining: Integrating Advanced Technologies

Volumn , Issue , 2010, Pages 197-225

  Zhang, Yunong ^a   Tan, Ning ^a  

^a SUN YAT SEN UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84866712461     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-61520-757-2.ch010     Document Type: Chapter

References (46)

1. Chen, Y., Wang, R., & Lin, H. (2002). The application and compare of training algorithms in MATLAB 6.0's neural network toolbox. Computer and Information Technology, 3, 1-6/18.
2. Corwin, E. M., Logar, A. M., & Oldham, W. J. B. (1994). An iterative method for training multilayer networks with threshold function. IEEE Transactions on Neural Networks, 5, 507-508. doi:10.1109/72.286926
3. Demuth, H., Beale, M., & Hagan, M. (2007). Neural network toolbox 5 user's guide. Natick, MA: MathWorks Inc.
4. Fang, T., Leng, X., Ma, X., & Guang, M. (2004). λ-PDF and Gegenbauer polynomial approximation for dynamic response problems of random structures. Acta Mechanica Sinica, 20(3), 292-298. doi:10.1007/BF02486721
5. Gao, X., & Cong, S. (2001). Comparative study on fast learning algorithms of BP networks. Control and Decision, 16(2), 167-171.
6. Goodman, R. M., & Zeng, Z. (1994) A learning algorithm for multi-layer perceptrons with hardlimiting threshold units. In IEEE Workshop of Neural Networks for Signal Processing, (pp. 219-228), Ermioni.
7. Hong, T. P., & Tseng, S. S. (1991). Trade-off between time complexity and accuracy of perceptron learning. In IEEE Region 10 International Conference on EC3 - Energy, Computer, Communication and Control Systems: Vol. 2 (pp. 157-161), New Delhi.
8. Jenkins, W. M. (2006). Neural network weight training by mutation. Computers & Structures, 84, 2107-2112. doi:10.1016/j.compstruc.2006.08.066
9. Jia, J. C., & Chong, C. C. (1995). Distributed normalisation input coding to speed up training process of BP-neural network classifier. Electronics Letters, 31(15), 1267-1269. doi:10.1049/el:19950854
10. Kincaid, D., & Cheney, W. (2003). Numerical analysis: mathematics of scientific computing. Beijing: China Machine Press.
11. Leithead, W. E., & Zhang, Y. (2007). O(N^2)operation approximation of covariance matrix inverse in Gaussian process regression based on quasi-Newton BFGS methods. Communications in Statistics Simulation and Computation, 36(2), 367-380. doi:10.1080/03610910601161298
12. Liang, X., & Tso, S. K. (2002). An improved upper bound on step-size parameters of discrete-time recurrent neural networks for linear inequality and equation system. IEEE Transactions on Circuits and Systems I, 49(5), 695-698. doi:10.1109/TCSI.2002.1001961
13. Lin, C. (2007). Numerical analysis. Beijing: Science Press.
14. Lippmann, R. P. (1987). An introduction to computing with neural nets. IEEE ASSP Magazine, 4(2), 4-22. doi:10.1109/MASSP.1987.1165576
15. Looney, C. G. (1996). Advances in feedforward neural networks: demystifying knowledge acquiring black boxes. IEEE Transactions on Knowledge and Data Engineering, 8(2), 211-226. doi:10.1109/69.494162
16. Mathews, J. H., & Fink, K. D. (2004). Numerical methods using MATLAB. Beijing: Pearson Education Inc.
17. Miller, D. A., Arguello, R., & Greenwood, G. W. (2004). Evolving artificial neural network structures: experimental results for biologicallyinspired adaptive mutations. In Congress on Evolutionary Computation: Vol. 2 (pp. 2114-2119), Portland, OR.
18. Mo, G., & Liu, K. (2003). Function approximation methods. Beijing: Science Press.
19. Pai, G. A. V. (2004). A fast converging evolutionary neural network for the prediction of uplift capacity of suction caissons. In IEEE Conference on Cybernetics and Intelligent Systems (pp. 654-659), Singapore.
20. Pu, C., Sun, Z., & Zhao, S. (2006). Comparison of BP algorithms in MATLAB NN toolbox. Computer Simulation, 23(5), 142-144.
21. Ren, Y., & Zhou, L. (2008). PMSM control research based on particle swarm optimization BP neural network. In International Conference on Cyberworlds (pp. 832-836), Hangzhou.
22. Rumelhart, D. E., McClelland, J. L., & PDP Research Group (1986). Parallel distributed processing. Cambridge, MA: MIT Press.
23. Sadeghi, B. H. M. (2000). A BP-neural network predictor model for plastic injection molding process. Journal of Materials Processing Technology, 103, 411-416. doi:10.1016/S09240136(00)00498-2
24. Steriti, R. J., & Fiddy, M. A. (1993). Regularized image reconstruction using SVD and a neural network method for matrix inversion. IEEE Transactions on Signal Processing, 41(10), 3074-3077. doi:10.1109/78.277813
25. Su, G., & Deng, F. (2003). On the improving backpropagation algorithms of the neural networks based on MATLAB language: a review. Bulletin of Science and Technology, 19(2), 130-135.
26. Wang, S. L., & Li, P. Y. (1991). Neural networks for medicine: two cases. In Electro International Conference (pp. 586-590), New York.
27. Wen, J. W., Zhao, J. L., Luo, S. W., & Han, Z. (2000). The improvements of BP neural network learning algorithm, In International Conference on Signal Processing: Vol. 3 (pp. 1647-1649), Beijing.
28. Wilson, D. R., & Martinez, T. R. (2001). The need for small learning rates on large problems. In International Joint Conference on Neural Networks: Vol. 1 (pp. 115-119), New York.
29. Wu, C., Zhang, H., & Fang, T. (2007). Flutter analysis of an airfoil with bounded random parameters in incompressible flow via Gegenbauer polynomial approximation. Aerospace Science and Technology, 11, 518-526. doi:10.1016/j.ast.2007.03.003
30. Yeung, D. S., & Zeng, X. (2002). Hidden neuron pruning for multilayer perceptrons using a sensitivity measure. In International Conference on Machine Learning and Cybernetics (pp. 1751-1757), New York.
31. Yu, X. H., & Chen, G. A. (1995). On the local minima free condition of backpropagation learning. IEEE Transactions on Neural Networks, 6(5), 1300-1303. doi:10.1109/72.410380
32. Yu, X. H., Chen, G. A., & Cheng, S. X. (1993). Acceleration of backpropagation learning using optimised learning rate and momentum. Electronics Letters, 29(14), 1288-1290. doi:10.1049/el:19930860
33. Zhang, C., Lin, M., & Tang, M. (2008). BP neural network optimized with PSO algorithm for daily load forecasting. In International Conference on Information Management, Innovation Management and Industrial Engineering: Vol. 3, (pp. 82-85). Taipei.
34. Zhang, Y. (1999). Software implementation of artificial neural networks using JAVA and object oriented programming (OOP) technique. Unpublished master's thesis, South China University of Technology, Guangzhou.
35. Zhang, Y. (2002). Analysis and design of recurrent neural networks and their applications to control and robotic systems. Unpublished doctoral dissertation, Chinese University of Hong Kong, Hong Kong.
36. Zhang, Y., & Chen, K. (2008). Global exponential convergence and stability of Wang neural network for solving online linear equations. Electronics Letters, 44(2), 145-146. doi:10.1049/el:20081928
37. Zhang, Y., & Ge, S. S. (2005). Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Transactions on Neural Networks, 16(6), 1477-1490. doi:10.1109/TNN.2005.857946
38. Zhang, Y., Ge, S. S., & Lee, T. H. (2004). A unified quadratic-programming based dynamical system approach to joint torque optimization of physically constrained redundant manipulators. IEEE Transactions on Systems, Man, and Cybernetics. Part B, 34(5), 2126-2132.
39. Zhang, Y., Jiang, D., & Wang, J. (2002). A recurrent neural network for solving Sylvester equation with time-varying coefficients. IEEE Transactions on Neural Networks, 13(5), 1053-1063. doi:10.1109/TNN.2002.1031938
40. Zhang, Y., Leithead, W. E., & Leith, D. J.(2005). Time-series Gaussian process regression based on Toeplitz computation of O(N^2) operations and O(N)-level storage. In IEEE Conference on Decision and Control (pp. 3711-3716), Seville.
41. Zhang, Y., Li, W., Liu, W., Tan, M., & Chen, K. (2007). Power-activation feed-forward neural network with its weights immediately determined. In Chinese Conference on Pattern Recognition (pp. 72-77). Beijing: Science Press.
42. Zhang, Y., Li, W., Yi, C., & Chen, K. (2008). A weights-directly-determined simple neural network for nonlinear system identification. In IEEE International Conference on Fuzzy Systems (pp. 455-460), Hong Kong.
43. Zhang, Y., & Wang, J. (2001). Recurrent neural networks for nonlinear output regulation. Automatica, 37, 1161-1173. doi:10.1016/S00051098(01)00092-9
44. Zhang, Y., & Wang, J. (2002). Global exponential stability of recurrent neural networks for synthesizing linear feedback control systems via pole assignment. IEEE Transactions on Neural Networks, 13(3), 633-644. doi:10.1109/TNN.2002.1000129
45. Zhang, Y., Zhong, T., Li, W., Xiao, X., & Yi, C. (2008). Growing algorithm of Laguerre orthogonal basis neural network with weights directly determined. In D.-S. Huang et al (Eds.), International Conference on Intelligent Computing: Vol. 5227. Lecture Notes in Artificial Intelligence (pp. 60-67), Shanghai. Berlin: Springer-Verlag.
46. Zhou, K., & Kang, Y. (2005). Neural network models and their MATLAB simulation program design. Beijing: Tsinghua University Press.