New parameter-free simplified swarm optimization for artificial neural network training and its application in the prediction of time series

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 4, 2013, Pages 661-665

  Yeh, Wei Chang ^a,b  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b NATIONAL TSING HUA UNIVERSITY   (Taiwan)

Author keywords

Artificial intelligence; evolutionary computation; machine learning; neural network

Indexed keywords

BENCHMARK DATA; ITS APPLICATIONS; MULTI LAYER PERCEPTRON; PARTICLE SWARM OPTIMIZATION ALGORITHM; RANDOM LEARNING; SIMPLIFIED SWARM OPTIMIZATIONS (SSO); SINGLE MULTIPLICATIVE NEURON MODELS; SOFT COMPUTING METHODS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BENCHMARKING; EVOLUTIONARY ALGORITHMS; LEARNING SYSTEMS; PARTICLE SWARM OPTIMIZATION (PSO); SOFT COMPUTING;

NEURAL NETWORKS;

ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COMPUTER ANALYSIS; FORECASTING; TIME; TRENDS;

ARTIFICIAL INTELLIGENCE; COMPUTING METHODOLOGIES; FORECASTING; NEURAL NETWORKS (COMPUTER); TIME FACTORS;

EID: 84875897462     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2232678     Document Type: Article

References (27)

1. A. Rodan and P. Tino, "Minimum complexity echo state network," IEEE Trans. Neural Netw., vol. 22, no. 1, pp. 131-144, Jan. 2011.
2. D. T. Mirikitani and N. Nikolaev, "Recursive Bayesian recurrent neural networks for time-series modeling," IEEE Trans. Neural Netw., vol. 21, no. 2, pp. 262-274, Feb. 2010.
3. L. V. Fausett, Fundamentals of Neural Networks. Upper Saddle River, NJ: Prentice Hall, 1994.
4. W. Yan, "Toward automatic time-series forecasting using neural networks," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 7, pp. 1028-1039, Jul. 2012.
5. L.-C. Chang, P.-A. Chen, and F.-J. Chang, "Reinforced two-step-ahead weight adjustment technique for online training of recurrent neural networks," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 8, pp. 1269-1278, Aug. 2012.
6. M. Qi and G. P. Zhang, "Trend time-series modeling and forecasting with neural networks," IEEE Trans. Neural Netw., vol. 19, no. 5, pp. 808-816, May 2008. (Pubitemid 351728817)
7. J. Liang, Z. Wang, and X. Liu, "Robust synchronization of an array of coupled stochastic discrete-time delayed neural networks," IEEE Trans. Neural Netw., vol. 19, no. 11, pp. 1910-1921, Nov. 2008.
8. C. Bergmeir, I. Triguero, D. Molina, J. L. Aznarte, and J. M. Benitez, "Time series modeling and forecasting using memetic algorithms for regime-switching models," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 11, pp. 1841-1847, Nov. 2012.
9. E. M. Iyoda, H. Nobuhara, and K. Hirota, "A solution for the N-bit parity problem using a single multiplicative neuron," Neural Process. Lett., vol. 18, no. 3, pp. 233-238, Dec. 2003.
10. D. E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning. Reading, MA: Addison Wesley, 1989.
11. J. T. Coshall, "Combining volatility and smoothing forecasts of UK demand for international tourism," Tourism Manag., vol. 30, no. 4, pp. 495-511, Aug. 2009.
12. D. Kang, R. Mathur, and S. T. Rao, "Real-time bias-adjusted O3 and PM2.5 air quality index forecasts and their performance evaluations over the continental United States," Atmosp. Environ., vol. 44, pp. 2203-2212, Apr. 2010.
13. J. Kennedy and R. C. Eberhart, "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Netw., Dec. 1995, pp. 1942-1948.
14. S. W. Fei, M.-J. Wang, Y.-B. Miao, J. Tu, and C.-L. Liu, "Particle swarm optimization-based support vector machine for forecasting dissolved gases content in power transformer oil," Energy Convers. Manage., vol. 50, no. 6, pp. 1604-1609, 2009.
15. L. Zhao and Y. Yang, "PSO-based single multiplicative neuron model for time series prediction," Expert Syst. Appl., vol. 36, no. 2, pp. 2805-2816, 2009.
16. J. Wang, S. Zhu, W. Zhang, and H. H. Lu, "Combined modeling for electric load forecasting with adaptive particle swarm optimization," Energy, vol. 35, no. 4, pp. 1671-1678, 2010.
17. W.-C. Yeh, "A two-stage discrete particle swarm optimization for the problem of multiple multi-level redundancy allocation in series systems," Expert Syst. Appl., vol. 36, no. 5, pp. 9192-9200, Jul. 2009.
18. W.-C. Yeh, "Simplified swarm optimization in disassembly sequencing problems with learning effects," Comput. Operat. Res., vol. 39, no. 9, pp. 2168-2177, 2012.
19. W.-C. Yeh, W. W. Chang, and Y. Y. Chung, "A new hybrid approach for mining breast cancer pattern using discrete particle swarm optimization and statistical method," Expert Syst. Appl., vol. 36, no. 4, pp. 8204-8211, May 2009.
20. W.-C. Yeh, "Optimization of the end-of-life disassembly sequencing problem based on the use of a novel method based on self-adaptive simplified swarm optimization and precedence preservative operator," IEEE Trans. Syst., Man, Cybern. Part A, vol. 42, no. 1, pp. 250-261, Jan. 2012.
21. W.-C. Yeh, "Novel swarm optimization for mining classification rules on thyroid gland data," Inf. Sci., vol. 197, pp. 65-76, Aug. 2012.
22. M. Mackey and L. Glass, "Oscillation and chaos in physiological control systems," Science, vol. 197, no. 4300, pp. 287-289, Jul. 1977. (Pubitemid 8130447)
23. Time Series Data Library. (1998) [Online]. Available: http://robjhyndman.com/TSDL/other/
24. Computer Science News. (2011) [Online]. Available: http://www.cs. colostate.edu
25. The Santa Fe Time Series Competition Data. (1991) [Online]. Available: http://www-psych.stanford.edu/andreas/Time-Series/SantaFe.html
26. U. Hübner, N. B. Abraham, and C. O. Weiss, "Dimensions and entropies of chaotic intensity pulsations in a single-mode far-infrared NH3 laser," Phys. Rev. A, vo1. 40, no. 11, pp. 6354-6365, 1989.
27. N. A. Gershenfeld and A. S. Weigend, The Future of Time Series, in Time Series Prediction: Forecasting the Future and Understanding the Past. Eds. A. S. Weigend and N. A. Gershenfeld, 1993.