H∞ filtering in neural network training and pruning with application to system identification

Journal of Computing in Civil Engineering

Volumn 21, Issue 1, 2007, Pages 47-58

  Tang, He Sheng ^a   Xue, Songtao ^b   Sato, Tadanobu ^c  

^a TONGJI UNIVERSITY   (China)

^b KINKI UNIVERSITY   (Japan)

^c KYOTO UNIVERSITY   (Japan)

Author keywords

Algorithms; Neural networks; Training

Indexed keywords

ALGORITHMS; IDENTIFICATION (CONTROL SYSTEMS); MATHEMATICAL MODELS; STRUCTURAL ANALYSIS;

ARBITRARY NETWORK STRUCTURES; FILTERING ALGORITHMS; GENERALIZATION CAPACITY; ROBUST TRAINING ALGORITHMS;

NEURAL NETWORKS;

EID: 33845745826     PISSN: 08873801     EISSN: None     Source Type: Journal    
DOI: 10.1061/(ASCE)0887-3801(2007)21:1(47)     Document Type: Article

References (38)

1. Abid, S., Fnaiech, F., and Najim, M. (2001). " A fast feedforward training algorithm using a modified form of the standard back-propagation algorithm.. " IEEE Trans. Neural Netw., 12 (2), 424-434.
2. Abrahart, R. J., See, L., and Kneal, P. E. (2001). " Investigating the role of saliency analysis with neural network rainfall-runoff model.. " Comput. Geosci., 27 (8), 921-928.
3. Akaike, H. (1974). " A new look at the statistical model identification.. " IEEE Trans. Autom. Control, 19 (6), 716-723.
4. Bebis, G., Georgiopoulos, M., and Kasparis, T. (1997). " Coupling weight elimination with genetic algorithm to reduce network size and preserve generalization.. " Neurocomputing, 17 (3-4), 167-194.
5. Bojarczak, O. S. P., and Stodolski, M. (1996). " Fast second-order learning algorithm for feedforward multilayer neural networks and its application.. " Neural Networks, 9 (9), 1583-1596.
6. Chen, H. M., Qi, G. Z., Yang, J. C. S., and Amini, F. (1995). " Neural network for structural dynamic model identification.. " J. Eng. Mech., 121 (12), 1377-1381.
7. Chen, S., Cowan, C. F. N., Billings, S. A., and Grant, P. M. (1990). " Parallel recursive prediction error algorithm for training layered neural network.. " Int. J. Control, 51 (6), 1215-1228.
8. Didinsky, G., Pan, Z., and Basar, T. (1995). " Parameter identification of uncertain plants using H∞ methods.. " Automatica, 31 (9), 1227-1250.
9. Fukuda, W. K. T., and Tzafestas, S. G. (1991). " Learning algorithms of layered neural networks via extended Kalman filters.. " Int. J. Syst. Sci., 22 (4), 753-768.
10. Haddadnia, J., Faez, K., and Ahmadi, M. (2002). " N -feature neural network human face recognition.. " Proc., 15th Int. Conf. on Vision Interface, Calgary, Canada, 300-307.
11. Hassibi, B., Sayed, A. H., and Kailath, T. (1998). Indefinite-quadratic estimation and control: A unified approach to H2 and H∞ theories, SIAM, Philadelphia.
12. Hassibi, B., and Stork, D. G. (1993). " Second-order derivatives for network pruning: Optimal brain surgeon.. " Advances in neural information processing 4, S. J. Hanson, J. D. Cowan, and, C. Lee Giles, eds., Morgan Kaufmann, San Mateo, Calif., 164-171.
13. Haykin, S. (1996). Adaptive filter theory, 3rd Ed., Prentice-Hall, Englewood Cliffs, N.J.
14. Haykin, S. (1999). Neural networks: A comprehensive foundation, Prentice-Hall, Englewood Cliffs, N.J.
15. Iiguni, Y., Sakai, H., and Tokumaru, H. (1992). " A real-time learning algorithm for a multilayered neural network based on the extended Kalman filter.. " IEEE Trans. Signal Process., 40 (4), 959-966.
16. Jaakkola, T., Jordan, M., and Singh, S. (1994). " On the convergence of stochastic iterative dynamic programming algorithms.. " Neural Comput., 6 (6), 1185-1201.
17. Kollias, S., and Anastassiou, D. (1989). " An adaptive least-squares algorithm for the efficient training of artificial neural networks.. " IEEE Trans. Circuits Syst., 36 (8), 1092-1101.
18. Krogh, A., and Hertz, J. (1992). " A simple weight decay can improve generalization.. " Advances in neural information processing systems 4, D. S. Touretzky, ed., Morgan Kaufmann, San Mateo, Calif., 950-957.
19. LeCun, Y., Denker, J. S., and Solla, S. A. (1990). " Optimal brain damage.. " Advances in neural information processing 1, D. S. Touretzky, ed., Morgan Kaufmann, San Mateo, Calif., 396-404.
20. Leung, C. S., Wong, K. W., Sum, J., and Chan, L. W. (1996). " On-line training and pruning for RLS algorithms.. " Electron. Lett., 32 (23), 2152-2153.
21. Leung, C., Wong, K., Sum, P., and Chan, L. (2001). " A pruning method for the recursive least squared algorithm.. " Neural Networks, 14 (2), 147-174.
22. Makarynskyy, O., Pires-Silva, A. A., Makarynska, D., and Ventura-Soares, C. (2005). " Artificial neural networks in wave predictions at the west coast of Portugal.. " Comput. Geosci., 31 (4), 415-424.
23. Masri, S. F., Caffrey, J. P., Caughey, T. K., Smyth, A. W., and Chassiakos, A. G. (2004). " Identification of the state equation in complex nonlinear systems.. " Int. J. Non-Linear Mech., 39 (7), 1111-1127.
24. Masri, S. F., Nakamura, M., Chassiakos, A. G., and Caughey, T. K. (1996). " Neural network approach to detection of changes in structural parameters.. " J. Eng. Mech., 122 (4), 350-360.
25. Masri, S. F., Smyth, A. W., Chassiakos, A. G., Caughey, T. K., and Hunter, N. F. (2000). " Application of neural networks for detection of changes in nonlinear systems.. " J. Eng. Mech., 126 (7), 666-676.
26. Nakamura, M., Masri, S. F., and Caughey, T. K. (1998). " A method for nonparametric damage detection through the use of neural networks.. " Earthquake Eng. Struct. Dyn., 27 (9), 997-1010.
27. Prechelt, L. (1996). " A quantitative study of experimental evaluations of neural network learning algorithms: Current research practice.. " Neural Networks, 9 (3), 457-462.
28. Rumelhart, D., Hinton, G., and Williams, G. (1986). " Learning internal representations by error propagation.. " Parallel distributed processing 1, MIT, Cambridge, Mass., 318-362.
29. Sato, T., and Qi, K. (1998). " Adaptive H∞ filter: Its application to structural identification.. " J. Eng. Mech., 124 (11), 1233-1240.
30. Shah, S., Palmeieri, F., and Datum, M. (1992). " Optimal filtering algorithms for fast learning in feedforward neural networks.. " Neural Networks, 5 (5), 779-787.
31. Singhal, S., and Wu, L. (1989). " Training multiplayer perceptrons with the extended Kalman algorithm.. " Advances in neural information processing systems 1, D. S. Touretzky, ed., Morgan Kaufmann, San Mateo, Calif., 133-140.
32. Smyth, A. W., Masri, S. F., Kosmatopoulos, E. B., Chassiakos, A. G., and Caughey, T. K. (2002). " Development of adaptive modeling techniques for nonlinear hysteretic systems.. " Int. J. Non-Linear Mech., 37 (8), 1435-1451.
33. Stone, M. (1977). " An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion.. " J. R. Stat. Soc. Ser. B (Methodol.), 39 (l), 44-47.
34. Sum, J., Leung, C., Young, G. H., and Kan, W. (1999). " On the Kalman filtering method in neural-network training and pruning.. " IEEE Trans. Neural Netw., 10 (1), 161-166.
35. Tang, H., and Sato, T. (2004). " Structural damage detection using the neural network and H∞ algorithm.. " Proc. SPIE, 5394, 454-463.
36. Wen, Y.-K. (1976). " Method for random vibration of hysteretic systems.. " J. Engrg. Mech. Div., 102 (2), 249-263.
37. William, P. M. (1995). " Bayesian regularization and pruning use a Laplace prior.. " Neural Comput., 7 (1), 117-143.
38. Wu, Z., Xu, B., and Yokoyama, K. (2002). " Decentralized parametric damage detection based on neural networks.. " Comput. Aided Civ. Infrastruct. Eng., 17 (3), 175-184.