Comparison of the complex valued and real valued neural networks trained with gradient descent and random search algorithms

ESANN 2011 proceedings, 19th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning

Volumn , Issue , 2010, Pages 213-218

  Zimmermann, Hans Georg ^a   Minin, Alexey ^b,c   Kusherbaeva, Victoria ^c  

^a SIEMENS AG   (Germany)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c OOO Siemens   (Russian Federation)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX-VALUED; COMPLEX-VALUED NEURAL NETWORKS; GLOBAL-LOCAL; GRADIENT DESCENT; GRADIENTS COMPUTATION; LOCAL OPTIMIZATION ALGORITHM; RANDOM SEARCH ALGORITHM;

ALGORITHMS; LEARNING SYSTEMS;

NEURAL NETWORKS;

EID: 84887116230     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (8)

1. R. Neuneier, H.G. Zimmermann, How to Train Neural Networks, Neural Networks: Tricks of the Trade, Springer 1998, pp. 373-423.
2. D. H. Brandwood. A complex gradient operator and its application in adaptive array theory. IEE Proceedings, F: Communications, Radar and Signal Processing, 130(1):1116, 1983.
3. H. Leung, S. Haykin, The Complex Back Propagation, IEEE Transactions on Signal Processing., Vol.39, No.9, September 1991., pp. 2101-2104.
4. T. Kim, T. Adali, Fully Complex Multi-Layered Perceptron Network for Nonlinear Signal Processing, VLSI Signal Processing 32, pp. 29-43, 2002.
5. A. Hirose, Continuous Complex-Valued Back-propagation Learning, Electronics Letters, Vo1.28, No. 20, September 24, pp. 1854-1855, 1992.
6. T. Nitta, An Extension of the Back-Propagation Algorithm to Complex Numbers, Neural Networks, Vol.10, No.8, pp.1391-1415, 1997.
7. Yu. Sushkov and A. Abakarov, The algorithm of adaptive random search for discrete-continuous optimization, proceedings of the 5th St. Petersburg Workshop on Simulation, pp. 11-17, June 26- July 2, 2005.
8. V. Kusherbaeva and Yu. Sushkov, Statistical investigation of Random Search, Stochastic optimization in information science, 3:pp. 21-36, S.-Petersburg: SPbSU, 2007.