Randomized algorithms for nonlinear system identification with deep learning modification

Information Sciences

Volumn 364-365, Issue , 2016, Pages 197-212

  de la Rosa, Erick ^a   Yu, Wen ^a  

^a INSTITUTO POLITÉCNICO NACIONAL   (Mexico)

Author keywords

Deep learning; Nonlinear system modeling; Randomized algorithms

Indexed keywords

ALGORITHMS; LEARNING SYSTEMS; NONLINEAR SYSTEMS; RELIGIOUS BUILDINGS;

BENCH-MARK PROBLEMS; DEEP LEARNING; NONLINEAR SYSTEM MODELING; RANDOMIZED ALGORITHMS; RESTRICTED BOLTZMANN MACHINE; STATISTICAL FEATURES; SUPERVISED LEARNING METHODS; UNSUPERVISED TRAINING;

LEARNING ALGORITHMS;

EID: 84983314971     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2015.09.048     Document Type: Article

References (27)

1. [1] Ackley, D.H., Hinton, G.E., Sejnowski, T.J., A learning algorithm for Boltzmann machines. Cogn. Sci. 9 (1985), 147–169.
2. [2] Alhamdoosh, M., Wang, D., Fast decorrelated neural network ensembles with random weights. Inf. Sci. 264 (2014), 104–117.
3. [3] Bengio, Y., Delalleau, O., Justifying and generalizing contrastive divergence. Neural Comput. 21:6 (2009), 1601–1621.
4. [4] Bergstra, J., Bengio, Y., Random search for hyper-parameter optimization. J. Mach. Learn. Res., 2011, 281–305.
5. [5] Box, G., Jenkins, G., Reinsel, G., Time Series Analysis: Forecasting and Control, 4th edition, 2008, Wiley.
6. [6] Chakrabartty, S., Shaga, R.K., Aono, K., Noise-shaping gradient descent-based online adaptation algorithms for digital calibration of analog circuits. IEEE Trans. Neural Netw. Learn. Syst. 24:4 (2013), 554–565.
7. [7] De Brabanter, K., Dreesen, P., Karsmakers, P., Pelckmans, K., De Brabanter, J., Suykens, J.A.K., De Moor, B., Fixed-size LS-SVM applied to the Wiener–Hammerstein benchmark. Proceedings of the 15th IFAC Symposium on System Identification, 2009, 826–831.
8. [8] Erhan, D., Bengio, Y., Courville, A., Manzagol, P.A., Vincent, P., Why does unsupervised pre-training help deep learning?. J. Mach. Learn. Res. 11 (2010), 625–660.
9. [9] Haykin, S., Neural Networks—A Comprehensive Foundation, 1994, Macmillan College Publishing Company, New York.
10. [10] Hinton, G.E., Sejnowski, T.J., Learning and relearning in Boltzmann machines. Parallel Distributed Processing : Explorations in the Microstructure of Cognition, vol. 1, 1986, MIT Press, Cambridge, MA, 282–317.
11. [11] Hjalmarsson, H., Rojas, C.R., Rivera, D.E., System identification: a Wiener–Hammerstein benchmark. Control Eng. Pract. 20 (2012), 1095–1096.
12. [12] Igelnik, B., Pao, Y.-H., Stochastic choice of basis functions in adaptive function approximation and the functional-link net. IEEE Trans. Neural Netw. 6:2 (1995), 1320–1329.
13. [13] Jagannathan, S., Lewis, F.L., Identification of nonlinear dynamical systems using multilayered neural networks. Automatica 32:12 (1996), 1707–1712.
14. [14] Jang, J.S., ANFIS: Adaptive-network-based fuzzy inference system. IEEE Trans. Syst. Man Cybern. 23 (1993), 665–685.
15. [15] Leung, F.H.F., Lam, H.K., Ling, S.H., Tam, P.K.S., Tuning of the structure and parameters of a neural network using an improved genetic algorithm. IEEE Trans. Neural Netw. 14 (2003), 79–88.
16. [16] Liu, Y., Chan, K., Hua, K.A., Hybrid manifold embedding. IEEE Trans. Neural Netw. Learn. Syst. 25:12 (2014), 2295–2302.
17. [17] Marquardt, D., An algorithm for least-squares estimation of nonlinear parameters. SIAM J. Appl. Math. 11:2 (1963), 431–441.
18. [18] Mitra, S., Hayashi, Y., Neuro-fuzzy rule generation: survey in soft computing framework. IEEE Trans. Neural Netw. 11:3 (2000), 748–769.
19. [19] Narendra, K.S., Parthasarathy, K., Gradient methods for optimization of dynamical systems containing neural networks. IEEE Trans. Neural Netw. 3:2 (1991), 252–262.
20. [20] Rivals, I., Personnaz, L., Neural-network construction and selection in nonlinear modeling. IEEE Trans. Neural Netw. 14:4 (2003), 804–820.
21. [21] Schmidt, W.F., Kraaijveld, M.A., Duin, R.P.W., Feedforward neural networks with random weights. Proceedings of the 11th IAPR International Conference on Pattern Recognition, 1992, The Hague, Netherlands, 1–4.
22. [22] Schoukens, J., Suykens, J., Ljung, L., Wiener–Hammerstein benchmark. Proceedings of the 15th IFAC Symposium on System Identification, 2009, Saint-Malo, France.
23. [23] Song, Q., Robust initialization of a Jordan network with recurrent constrained learning. IEEE Trans. Neural Netw. 22:12 (2011), 2460–2473.
24. [24] Sugeno, M., Yasukawa, T., A fuzzy logic based approach to qualitative modeling. IEEE Trans. Fuzzy Syst. 1:1 (1993), 7–31.
25. [25] J. Tapson, A. van Schaik, Learning the pseudoinverse solution to network weights, Neural Netw. 45 (2013) 94–100.
26. [26] Wang, L., Langari, R., Complex systems modeling via fuzzy logic. IEEE Trans. Syst. Man Cybern. 26:1 (1996), 100–106.
27. [27] Yu, W., Li, X., Automated nonlinear system modeling with multiple fuzzy neural networks and kernel smoothing. Int. J. Neural Syst. 20:5 (2010), 429–435.