Generalized neuron: Feedforward and recurrent architectures

Neural Networks

Volumn 22, Issue 7, 2009, Pages 1011-1017

  Kulkarni, Raghavendra V ^a   Venayagamoorthy, Ganesh K ^a  

^a Architectural and Environmental Engineering   (United States)

Author keywords

Classification; Density estimation; Generalized neuron; Nonlinear function approximation; Particle swarm optimization (PSO); Recurrent generalized neuron.

Indexed keywords

CLASSIFICATION; DENSITY ESTIMATION; GENERALIZED NEURON; NONLINEAR FUNCTION APPROXIMATION; RECURRENT GENERALIZED NEURON.;

ARCHITECTURAL DESIGN; ESTIMATION; FEEDFORWARD NEURAL NETWORKS; HARDWARE; MULTILAYER NEURAL NETWORKS; NONLINEAR ANALYSIS; PATTERN RECOGNITION SYSTEMS; PROBABILITY DENSITY FUNCTION; RECURRENT NEURAL NETWORKS; TIME SERIES;

PARTICLE SWARM OPTIMIZATION (PSO);

ARTICLE; ARTIFICIAL NEURAL NETWORK; CHAOS THEORY; CLASSIFICATION ALGORITHM; CLASSIFIER; COMPUTER MEMORY; COMPUTER PREDICTION; COMPUTER SIMULATION; MATHEMATICAL COMPUTING; NONLINEAR SYSTEM; NORMAL DISTRIBUTION; PERCEPTRON; PRIORITY JOURNAL; PROCESS OPTIMIZATION; TIME SERIES ANALYSIS;

ALGORITHMS; ANIMALS; COMPUTER SIMULATION; FEEDBACK; HUMANS; INFORMATION STORAGE AND RETRIEVAL; LEARNING; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; NONLINEAR DYNAMICS; PREDICTIVE VALUE OF TESTS; SIGNAL PROCESSING, COMPUTER-ASSISTED; TIME FACTORS;

EID: 69449087976     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2009.07.027     Document Type: Article

References (29)

1. Atiya A., El-shoura S.M., Shaheen S.I., and El-sherif M.S. A comparison between neural-network forecasting techniques - Case study: River flow forecasting. IEEE Transactions on Neural Networks 10 (1999) 402-409
2. Cai X., Zhang N., Venayagamoorthy G.K., and Wunsch II D.C. Time series prediction with recurrent neural networks trained by a hybrid PSO-EA algorithm. Neurocomputation 70 13-15 (2007) 2342-2353
3. Charytoniukand, W., Boxand, E. D., Lee, W. J., Chen, M. S., Kotas, P., & Van Olinda, P. (1999). Neural network based demand forecasting in a deregulated environment, In E. D. Box (Ed.) Proc. IEEE industrial and commercial power systems technical conference, p. 7
4. Chaturvedi D.K., Malik O.P., and Kalra P.K. Experimental studies with a generalized neuron based power system stabilizer. IEEE Transactions on Power Systems 19 (2004) 1445-1453
5. Cichocki, and Unbehauen R. Neural networks for optimization and signal processing (1993), Wiley
6. del Valle Y., Venayagamoorthy G.K., Mohagheghi S., Hernandez J.C., and Harley R.G. Particle swarm optimization: Basic concepts, variants and applications in power systems. IEEE Transactions on Evolutionary Computation 12 2 (2008) 171-195
7. Donelli M., Azaro R., De Natale F.G.B., and Massa A. An innovative computational approach based on a particle swarm strategy for adaptive phased-arrays control. IEEE Transactions on Antennas and Propagation 54 3 (2006) 888-898
8. Engelbrecht A.P. Computational intelligence: An introduction. 2 ed. (2007), John Wiley & Sons, New York, USA
9. Gudise, V. G., & Venayagamoorthy, G. K. (2003). Comparison of particle swarm optimization and backpropagation as training algorithms for neural networks, In Proc. IEEE swarm intelligence symposium SIS (pp. 110-117)
10. Haykin S., and Principe J. Making sense of a complex world [chaotic events modeling]. IEEE Signal Processing Magazine 15 3 (1998) 66-81
11. Hornik K., Stinchombe M., and White H. Multilayer feedforward networks are universal approximators. Neural Networks 2 (1989) 359-366
12. Kennedy, J. (1999). Small worlds and mega-minds: Effects of neighborhood topology onparticle swarm performance. In Proc. 1999 congress on evolutionary computation, 1999. CEC 99., Vol. 3
13. Kennedy, J., & Eberhart, R. (1995) Particle swarm optimization, In Proc. IEEE international conference on neural networks, (pp. 1942-1948) Vol. IV
14. Lapades, A., & Farber, R. (1987). How neural nets work. In Proc. advances in neural information processing systems (pp. 442-456)
15. Liu G.P., Kadirkamanthan V., and Billings S.A. Vairable neural networks for adaptive control of nonlinear systems. IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews 29 (1990) 34-43
16. Mackey M.C., and Glass L. Oscillation and chaos in physiological control systems. Science 197 (1977) 287-289
17. Minsky M.L., and Papert S.A. Perceptrons: An introduction to computational geometry (1969), MIT Press, Cambridge, MA
18. Mukherjee, S., Osuna, E., & Girosi, F. (1997). Nonlinear prediction of chaotic time series using support vector machines. In Proc. IEEE workshop neural networks for signal processing [1997] VII (pp. 511-520)
19. Niu, C. (2005). Medical image registration based on mutual information using kriging probability density estimation. In Proc. 27th annual international conference of the engineering in medicine and biology society IEEE-EMBS 2005 (pp. 3097-3099)
20. Ou G., and Murphey Y.L. Multi-class pattern classification using neural networks. Pattern Recognition 40 1 (2007) 4-18
21. Pazhayaveetil, D. C., & Franzon, P. (2007). Flexible low power probability density estimation unit for speech recognition, In Proc. IEEE international symposium on circuits and systems ISCAS (pp. 1117-1120)
22. Principe J.C., and Kuo J.M. Dynamic modeling of chaotic time series with neural networks. Advances in Neural Information Processing Systems Vol. 7 (1995), MIT Press, Cambridge, MA 311-318
23. Shi Y., and Eberhart R.C. Parameter selection in particle swarm optimization. EP'98: Proc. 7th int. conf. on evolutionary programming VII (1998), Springer-Verlag, London, UK 591-600
24. Shi Z., and Han M. Support vector echo-state machine for chaotic time-series prediction. IEEE Transactions on Neural Networks 18 2 (2007) 359-372
25. Venayagamoorthy G.K. A successful interdisciplinary course on computational intelligence. IEEE Computational Intelligence Magazine 4 1 (2009) 14-23
26. Wang J. Recurrent neural networks for optimization (1996), McGraw Hill Inc
27. Widrow B., and Lehr M.A. 30 years of adaptive neural networks: Perceptrons, madaline, and backproapagation. Proceedings of IEEE 78 (1990) 1415-1442
28. Wimalajeewa T., and Jayaweera S.K. Optimal power scheduling for correlated data fusion in wireless sensor networks via constrained PSO. IEEE Transactions on Wireless Communications 7 9 (2008) 3608-3618
29. Xu, H., Chen, C. H., Cong, F., Yang, L., & Shi, X. (2005). Independent component analysis based on nonparametric density estimation on time-frequency domain. In Proc. IEEE workshop on machine learning for signal processing (pp. 171-176)