Wirtinger calculus based gradient descent and Levenberg-Marquardt learning algorithms in complex-valued neural networks

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7062 LNCS, Issue PART 1, 2011, Pages 550-559

  Amin, Md Faijul ^a   Amin, Muhammad Ilias ^a   Al Nuaimi, A Y H ^a   Murase, Kazuyuki ^a  

^a UNIVERSITY OF FUKUI   (Japan)

Author keywords

Complex valued neural networks (CVNNs); gradient descent; least squares; Levenberg Marquardt; Wirtinger calculus

Indexed keywords

COMPLEX-VALUED NEURAL NETWORKS; GRADIENT DESCENT; LEAST SQUARE; LEVENBERG-MARQUARDT; WIRTINGER CALCULUS;

CALCULATIONS; COMPUTER SIMULATION; DATA PROCESSING; NEURAL NETWORKS;

LEARNING ALGORITHMS;

EID: 81855172050     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-24955-6_66     Document Type: Conference Paper

References (17)

1. van Trees, H.L.: Optimum Array Processing. Wiley Interscience, New York (2002)
2. Hirose, A.: Complex-Valued Neural Networks. Springer, Heidelberg (2006)
3. Calhoun, V.D., Adali, T., Pearlson, G.D., van Zijl, P.C.M., Pekar, J.J.: Independent component analysis of fMRI data in the complex domain. Magnetic Resonance in Medicine 48(1), 180-192 (2002)
4. Stuber, G.L.: Principles of Mobile Communication. Kluwer, Boston (2001)
5. Helstrom, C.W.: Elements of Signal Detection and Estimation. Prentice Hall, New Jersey (1995)
6. Nitta, T.: An Extension of the Back-Propagation Algorithm to Complex Numbers. Neural Networks 10(8), 1391-1415 (1997)
7. Kim, T., Adali, T.: Approximation by Fully-Complex Multilayer Perceptrons. Neural Computation 15(7), 1641-1666 (2003)
8. Wirtinger, W.: Zur Formalen Theorie der Funktionen von mehr Complexen Veränderlichen. Mathematische Annalen 97, 357-375 (1927) (in German)
9. Brandwood, D.H.: Complex Gradient Operator and its Application in Adaptive Array Theory. IEE Proceedings F (Communications, Radar and Signal Processing) 130(1), 11-16 (1983)
10. van den Bos, A.: Complex Gradient and Hessian. IEEE Proceedings (Vision, Image and Signal Processing) 141(6), 380-382 (1994)
11. Bouboulis, P., Theodoridis, S.: Extension of Wirtinger's Calculus to Reproducing Kernel Hilbert Spaces and the Complex Kernel LMS. IEEE Trans. on Signal Processing 59(3), 964-978 (2011)
12. Li, H., Adali, T.: Algorithms for Complex ML ICA and Their Stability Analysis Using Wirtinger Calculus. IEEE Trans. on Signal Processing 58(12), 6156-6167 (2010)
13. Li, H., Adali, T.: Complex-Valued Adaptive Signal Processing Using Nonlinear Functions. EURASIP Journal on Advances in Signal Processing 2008, 1-9 (2008)
14. Marquardt, D.: An Algorithm for Least-Squares Estimation of Nonlinear Parameters. SIAM Journal on Applied Mathematics 11(2), 431-441 (1963)
15. Hagan, M., Menhaj, M.: Training Feedforward Networks with the Marquardt Algorithm. IEEE Trans. on Neural Networks 5(6), 989-993 (1994)
16. Remmert, R.: Theory of Complex Functions. Springer, New York (1991)
17. Kreutz-Delgado, K.: The Complex Gradient Operator and the CR-Calculus, http://dsp.ucsd.edu/~kreutz/PEI05.htm