Neural network initialization with prototypes - Function approximation in engineering mechanics applications

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn , Issue , 2007, Pages 2110-2116

  Pei, Jin Song ^a   Mai, Eric C ^a   Wright, Joseph P ^b   Smyth, Andrew W ^c  

^a University of Oklahoma   (United States)

^b WEIDLINGER ASSOCIATES INC   (United States)

^c Department of Earth and Environmental Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER NETWORKS; MECHANICS; POLYNOMIAL APPROXIMATION; VEGETATION;

ENGINEERING MECHANICS; HIDDEN NODES; JOINT CONFERENCE;

NEURAL NETWORKS;

EID: 51749098219     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2007.4371284     Document Type: Conference Paper

References (26)

1. G. W. Housner, L. A. Bergman, T. K. Caughey, A. G. Chassiakos, R. O. Claus, S. F. Masri, R. E. Skelton, T. T. Soong, B. F. Spencer, and J. T. P. Yao, "Structural control: Past, present, and future," Journal of Engineering Mechanics, special issue, vol. 123, no. 9, pp. 897-971, 1997.
2. I. Flood, "Neural networks in civil engineering: A review," in Civil and Structural Engineering Computing: 2001, B. H. V. Topping, Ed. Saxe-Coburg Publications, 2002, pp. 185-209.
3. G. Cybenko, "Approximation by superpositions of sigmoidal function," Mathematics of Control, Signals, and Systems, vol. 2, pp. 303-314, 1989.
4. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximators," Neural Networks, vol. 2, pp. 359-366, 1989.
5. J. S. Pei, J. P. Wright, and A. W. Smyth, "Neural network initialization with prototypes - a case study in function approximation," in Proceedings of International Joint Conference on Neural Networks 2005 (IJCNN'05), Montreal, Canada, July 31 - August 4 2005, pp. 1377-1382.
6. D. Nguyen and B. Widrow, "Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights," in Proceedings of the IJCNN, vol. III, July 1990 pp. 21-26.
7. J. S. Pei, "Parametric and nonparametric identification of nonlinear systems," Ph.D. Dissertation, Columbia University, 2001.
8. J. S. Pei and A. W. Smyth, "A new approach to design multilayer feedforward neural network architecture in modeling nonlinear restoring forces: Part i - formulation," ASCE Journal of Engineering Mechanics, vol. 132 no. 12 pp. 1290-1300, December 2006.
9. _, "A new approach to design multilayer feedforward neural network architecture in modeling nonlinear restoring forces: Part ii - applications," ASCE Journal of Engineering Mechanics, vol. 132, no. 12, pp. 1310-1312, December 2006.
10. J. S. Pei, J. P. Wright, and A. W. Smyth, "Mapping polynomial fitting into feedforward neural networks for modeling nonlinear dynamic systems and beyond," Computer Methods in Applied Mechanics and Engineering, vol. 194, no. 42-44, pp. 4481-4505, 2005.
11. J. S. Pei and E. C. Mai, "Constructing multilayer feedforward neural networks to approximate nonlinear functions in engineering mechanics applications," ASME Journal of Applied Mechkanics, 2006, under review.
12. S. F. Masri and T. K. Caughey, "A nonparametric identification technique for nonlinear dynamic problems," Journal of Applied Mechanics, vol. 46, pp. 433-447, June 1979.
13. Y. K. Wen, "Methods of random vibration for inelastic structures," Appl. Mech. Rev., ASME, vol. 42, no. 2, pp. 39-52, 1989.
14. D. E. Adams and R. J. Allemang, "Non-linear vibrations classnotes, course 20-263-781," 2000.
15. K. Worden and G. R. Tomlinson, Nonlinearity in Structural Dynamics: Detection, Identification and Modelling, pp. 680. Institute of Physics Pub, 2001.
16. A. Lapedes and R. Farber, "How neural nets work," in Neural Information Processing Systems, D. Anderson, Ed. American Institute of Physics, 1988, pp. 442-456.
17. S. Osowski, "New approach to selection of initial values of weights in neural function approximation," Electronic Letters, vol. 29, no. 3, pp. 313-315, 1993.
18. M. T. Hagan, H. B. Demuth, and M. Beale, Neural Network Design. PWS Publishing Company, 1995.
19. H. N. Mhaskar, "Neural networks for optimal approximation of smooth and analytic functions," Neural Computation, vol. 8, pp. 164-177, 1995.
20. A. J. J. Meade, "Regularization of a programmed recurrent artificial neural network," Journal of Guidance, Control, and Dynamics, 2003.
21. S. F. Masri, J. P. Caffrey, T. K. Caughey, A. W. Smyth, and A. G. Chassiakos, "Identification of the state equation in complex non-linear systems," International Journal of Non-Linear Mechanics, vol. 39, pp. 1111-1127, 2004.
22. T. Denoeux and Lengellé, "Initializing back propagation networks with prototypes," Neural Networks, vol. 6, pp. 351-363, 1993.
23. J. S. Pei and K. Piyawat, "Deterministic excitation forces for simulation and identification of nonlinear hysteretic sdof systems," ASCE Journal of Engineering Mechanics, 2007, to appear.
24. S. Saarine, R. Bramley, and G. Cybenko, "Ill-conditioning in neural network training problems," SIAM J. Sci. Comput., vol. 14, no. 3, pp. 693-714, May 1993.
25. O. Nelles, Nonlinear System Identification: From Classical Approaches to Neural Networks and Fuzzy Models. Springer Verlag, 2000.
26. I. W. Sandberg, J. T. Lo, C. L. Fancourt, J. C. Principe, S. Katagiri, and S. Haykin, Nonlinear Dynamical Systems: Feedforward Neural Network Perspectives. Wiley-Interscience, 2001.