On efficient learning machine with root-power mean neuron in complex domain

IEEE Transactions on Neural Networks

Volumn 22, Issue 5, 2011, Pages 727-738

  Tripathi, Bipin Kumar ^a   Kalra, Prem Kumar ^b  

^a INDIAN INSTITUTE OF TECHNOLOGY KANPUR   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY JODHPUR   (India)

Author keywords

Complex backpropagation; complex multilayer perceptron; complex resilient propagation; quasi arithmetic means

Indexed keywords

AGGREGATION OPERATION; APPROXIMATION ACCURACY; ARTIFICIAL NEURON STRUCTURE; ARTIFICIAL NEURONS; BACKTRACKING STEP; COMPLEX BACKPROPAGATION; COMPLEX DOMAINS; COMPLEX MULTILAYER PERCEPTRON; COMPLEX RESILIENT PROPAGATION; COMPLEX-VALUED SIGNAL; EFFICIENT LEARNING; INPUT SIGNAL; PERFORMANCE EVALUATION; QUASIARITHMETIC MEANS; RESILIENT PROPAGATION ALGORITHM; TRAINING SPEED; WEIGHTED ROOT-POWER;

NEURAL NETWORKS;

LEARNING ALGORITHMS;

ALGORITHM; ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COMPUTER PROGRAM; COMPUTER SIMULATION; HUMAN; MATHEMATICAL COMPUTING; MATHEMATICAL PHENOMENA; NERVE CELL; NONLINEAR SYSTEM; PHYSIOLOGY;

ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; HUMANS; MATHEMATICAL COMPUTING; MATHEMATICAL CONCEPTS; NEURAL NETWORKS (COMPUTER); NEURONS; NONLINEAR DYNAMICS; SOFTWARE DESIGN;

EID: 79955836516     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2115251     Document Type: Article

References (48)

1. B. W. Mel, "Information processing in dendritic tree," Neural Comput., vol. 6, no. 6, pp. 1013-1085, Nov. 1994.
2. C. Koch, Biophysics of Computation: Information Processing in Single Neurons. London, U.K.: Oxford Univ. Press, 1999.
3. M. M. Gupta, L. Jin, and N. Homma, Static and Dynamic Neural Networks: From Fundamentals to Advanced Theory. New York: Wiley, 2003.
4. C. Koch and T. Poggio, "Multiplying with synapses and neurons," in Single Neuron Computation, T. McKenna, J. Devis, and S. F. Zornetzer, Eds. San Diego, CA: Academic, 1992.
5. C. L. Giles and T. Maxwell, "Learning, invariance, and generalization in high-order neural networks," Appl. Opt., vol. 26, no. 23, pp. 4972-4978, 1987. (Pubitemid 18009624)
6. M. Sinha, K. Kumar, and P. K. Kalra, "Some new neural network architectures with improved learning schemes," Soft Comput., vol. 4, no. 4, pp. 214-223, 2000. (Pubitemid 33209036)
7. J. C. Patra, R. N. Pal, R. Baliarsingh, and G. Panda, "Nonlinear channel equalization for QAM signal constellation using artificial neural networks," IEEE Trans. Syst., Man, Cybern. Part B: Cybern., vol. 29, no. 2, pp. 262-271, Apr. 1999.
8. F. Hoppensteadt and E. Izhikevich, "Canonical neuron models," in Brain Theory and Neural Networks, M. A. Arbib, Ed., 2nd ed. Cambridge, MA: MIT Press, 2001.
9. C.-K. Li, "A sigma-pi-sigma neural network (SPSNN)," Neural Process. Lett., vol. 17, no. 1, pp. 1-19, 2003.
10. Y. Shin, K.-S. Jin, and B.-M. Yoon, "A complex pi-sigma network and its application to equalizaton of nonlinear satellite channels," in Proc. IEEE Int. Conf. Neural Netw., vol. 1. Houston, TX, Jun. 1997, pp. 148-152.
11. N. Homma and M. M. Gupta, "A general second-order neural unit," Bull. Coll. Med. Sci. Tohoku Univ., vol. 11, no. 1, pp. 1-6, 2002.
12. D. K. Chaturvedi, M. Mohan, R. K. Singh, and P. K. Kalra, "Improved generalized neuron model for short-term load forecasting," Soft Comput., vol. 8, no. 5, pp. 10-18, Apr. 2003.
13. B. K. Tripathi, B. Chandra, and P. K. Kalra, "The generalized product neuron model in complex domain," in Proc. Int. Conf. Neural Inf. Process., Auckland, New Zealand, Nov. 2008, pp. 867-876.
14. M. Zhang, S. Xu, and J. Fulcher, "Neuron-adaptive higher order neuralnetwork models for automated financial data modeling," IEEE Trans. Neural Netw., vol. 13, no. 1, pp. 188-204, Jan. 2002. (Pubitemid 34236846)
15. S. Sureka and M. Manry, "A functional link network with ordered basis functions," in Proc. Int. Joint Conf. Neural Netw., Orlando, FL, Aug. 2007, pp. 1-6.
16. H. Dyckhoff and W. Pedrycz, "Generalized means as model of compensative connectives," Fuzzy Sets Syst., vol. 14, no. 2, pp. 143-154, Nov. 1984. (Pubitemid 15438671)
17. A. van Ooyen and B. Nienhuis, "Improving the convergence of the backpropagation algorithm," Neural Netw., vol. 5, no. 3, pp. 465-472, 1992.
18. X. Chen, Z. Tang, and S. Li, "An modified error function for the complex-value backpropagation neural network," Neural Inf. Process., vol. 8, no. 1, pp. 1-8, Jul. 2005.
19. R. A. Jacobs, "Increased rates of convergence through learning rate adaptation," Neural Netw., vol. 1, no. 4, pp. 295-307, 1988.
20. S. E. Fahlman, "An empirical study of learning speed in backpropagation networks," Tech. Rep. CMU-CS-88-162, Sep. 1988.
21. M. Riedmiller and H. Braun, "A direct adaptive method for faster backpropagation learning: The RPROP algorithm," in Proc. IEEE Int. Conf. Neural Netw., vol. 1. San Francisco, CA, Apr. 1993, pp. 586-591.
22. C. Igel and M. Husken, "Empirical evaluation of the improved Rprop learning algorithms," Neurocomputing, vol. 50, pp. 105-123, Jan. 2003. (Pubitemid 36131033)
23. G. M. Georgiou and C. Koutsougeras, "Complex domain backpropagation," IEEE Trans. Circuits Syst. II: Analog Dig. Signal Process., vol. 39, no. 5, pp. 330-334, May 1992.
24. F. Piazza and N. Benvenuto, "On the complex backpropagation algorithm," IEEE Trans. Signal Process., vol. 40, no. 4, pp. 967-969, Apr. 1992.
25. T. Nitta, "An extension of the back-propagation algorithm to complex numbers," Neural Netw., vol. 10, no. 8, pp. 1391-1415, Nov. 1997. (Pubitemid 28260892)
26. T. Kim and T. Adali, "Approximation by fully complex multilayer perceptrons," Neural Comput., vol. 15, no. 7, pp. 1641-1666, Jul. 2003. (Pubitemid 37035564)
27. I. Aizenberg, D. V. Paliy, J. M. Zurada, and J. T. Astola, "Blur identification by multilayer neural network based on multivalued neurons," IEEE Trans. Neural Netw., vol. 19, no. 5, pp. 883-898, May 2008. (Pubitemid 351728823)
28. G. Tanaka and K. Aihara, "Complex-valued multistate associative memory with nonlinear multilevel functions for gray-level image reconstruction," IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1463-1473, Sep. 2009.
29. B. K. Tripathi and P. K. Kalra, "The novel aggregation function-based neuron models in complex domain," Soft Comput., vol. 14, no. 10, pp. 1069-1081, Aug. 2010.
30. D. Mandic and V. S. L. Goh, Complex Valued Nonlinear Adaptive Filters: Noncircularity, Widely Linear and Neural Models. New York: Wiley, 2009.
31. A. Hirose, Complex-Valued Neural Networks. New York: Springer-Verlag, 2006.
32. A. N. Kolmogoroff, "Sur la notion de la moyenne," Acad. Naz. Lincei Mem. Cl. Sci. Fis. Mat. Natur. Sez., vol. 12, no. 6, pp. 388-391, 1930.
33. M. Nagumo, "Über eine klasse der mittelwerte," Jpn. J. Math., vol. 7, pp. 71-79, 1930.
34. T. Nitta, "An analysis of the fundamental structure of complex-valued neurons," Neural Process. Lett., vol. 12, no. 3, pp. 239-246, 2000. (Pubitemid 32085921)
35. S.-S. Yang, S. Siu, and C.-L. Ho, "Analysis of the initial values in splitcomplex backpropagation algorithm," IEEE Trans. Neural Netw., vol. 19, no. 9, pp. 1564-1573, Sep. 2008.
36. K. Kreutz-Delgado, "The complex gradient operator and the CRcalculus," Dept. Electr. Comput. Eng., Jacobs School Eng., Univ. California, San Diego, Lect. Suppl. ECE275A, 2006.
37. M. Schmitt, "On the complexity of computing and learning with multiplicative neural networks," Neural Comput., vol. 14, no. 2, pp. 241-301, Feb. 2002.
38. P. K. Kalra, B. Chandra, and M. Shiblee, "New neuron model for blind source separation," in Proc. Int. Conf. Neural Inf. Process., Auckland, New Zealand, Nov. 2008, pp. 27-36.
39. G. M. Georgiou, "Exact interpolation and learning in quadratic neural networks," in Proc. Int. Joint Conf. Neural Netw., Vancouver, BC, Canada, Jul. 2006, pp. 230-234. (Pubitemid 351369311)
40. D. B. Foggel, "An information criterion for optimal neural network selection," IEEE Trans. Neural Netw., vol. 2, no. 5, pp. 490-497, Sep. 1991.
41. B. D. Ripley, "Neural networks and related methods for classification," J. Royal Stat. Soc. Ser. B, vol. 56, no. 3, pp. 409-456, 1994.
42. C. L. Blake and C. J. Merz. (1998). UCI Repository of Machine Learning Database. Dept. Inf. Comput. Sci., Univ. California, San Diego [Online]. Available: http://www.ics.uci.edu/∼mealrn/MLRepository.html
43. M. Mackey and L. Glass, "Oscillation and chaos in physiological control systems," Science, vol. 197, no. 4300, pp. 287-289, Jul. 1997.
44. M. Russo, "Genetic fuzzy learning," IEEE Trans. Evol. Comput., vol. 4, no. 3, pp. 259-273, Sep. 2000.
45. G. E. P. Box and G. M. Jenkins, and G. C. Reinse, Time Series Analysis: Forecasting and Control. Englewood Cliffs, NJ: Prentice-Hall, 1994.
46. J. G. Daugman, "Entropy reduction and decorrelation in visual coding by oriented neural receptive fields," IEEE Trans. Biomed. Eng., vol. 36, no. 1, pp. 107-114, Jan. 1989. (Pubitemid 19060688)
47. Y. Shin and J. Ghosh, "Ridge polynomial networks," IEEE Trans. Neural Netw., vol. 6, no. 3, pp. 610-622, May 1995.
48. J. W. Brown and R. V. Churchill, Complex Variables and Applications, 7th ed. New York: McGraw-Hill, 2003.