Natural conjugate gradient on complex flag manifolds for complex independent subspace analysis

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5163 LNCS, Issue PART 1, 2008, Pages 165-174

  Nishimori, Yasunori ^a   Akaho, Shotaro ^a   Plumbley, Mark D ^b  

^a NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

^b QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CONJUGATE GRADIENT; INDEPENDENT SUBSPACE ANALYSIS; NATURAL GRADIENT; NUMERICAL EXPERIMENTS; RIEMANNIAN GEOMETRY; SEARCH METHOD;

BACKPROPAGATION; CONVERGENCE OF NUMERICAL METHODS; NEURAL NETWORKS;

CONJUGATE GRADIENT METHOD;

EID: 58849164502     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-87536-9_18     Document Type: Conference Paper

References (17)

1. Abrudan, T., Eriksson, J., Koivunen, V.: Steepest Descent Algorithms for Optimization under Unitary Matrix Constraint (preprint)
2. Adali, T., Li, H.: A practical formulation for computation of complex gradients and its application to maximum likelihood. In: Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing (ICASSP), Honolulu, Hawaii (April 2007)
3. Amari, S.: Natural gradient works efficiently in learning. Neural Computation 10, 251-276 (1998)
4. Brandwood, D.H.: A Complex Gradient Operator and its Application in Adaptive Array Theory. IEE Proceeding's H (Microwaves, Optics, and Antennas) 130(1), 11-16 (1983)
5. Edelman, A., Arias, T.A., Smith, S.T.: The geometry of algorithms with orthogonality constraints. SIAM Journal on Matrix Analysis and Applications 20(2), 303-353 (1998)
6. Fiori, S.: A Study on Neural Learning on Manifold Foliations: The Case of the Lie Group SU(3). Neural Computation 4, 1091-1197 (2008)
7. Honkela, A., Tornio, M., Raiko, T., Karhunen, J.: Natural Conjugate Gradient in Variational Inference. In: Ishikawa, M., Doya, K., Miyamoto, H., Yamakawa, T. (eds.) ICONIP 2007, Part II. LNCS, vol. 4985. Springer, Heidelberg (to appear, 2008)
8. Hyvärinen, A., Hoyer, P.O.: Emergence of phase and shift invariant features by decomposition of natural images into independent feature subspaces. Neural Computation 12(7), 1705-1720 (2000)
9. Kreutz-Delgado, K.: The Complex Gradient Operator and the CR -Calculus, Technical report, University of California, San Diego (2003)
10. Manton, J.: Optimization algorithms exploiting unitary constraints. IEEE Transactions on Signal Processing 50(3), 635-650 (2002)
11. Clemente, R.M., Puntonet, C.G., Catalina, J.I.A.: Blind Signal Separation Based on the Derivatives of the Output Cumulants and a Conjugate Gradient Algorithm. In: Proceedings of Int. Conf. Independent Component Analysis Signal Separation, San Diego, pp. 390-393 (2001)
12. Nishimori, Y., Akaho, S.: Learning algorithms utilizing quasi-geodesic flows on the Stiefel manifold. Neurocomputing 67, 106-135 (2005)
13. Nishimori, Y., Akaho, S., Plumbley, M.D.: Riemannian optimization method on the flag manifold for independent subspace analysis. In: Rosea, J.P., Erdogmus, D., Principe, J.C., Haykin, S. (eds.) ICA 2006. LNCS, vol. 3889, pp. 295-302. Springer, Heidelberg (2006)
14. Nishimori, Y., Akaho, S., Abdallah, S., Plumbley, M.D.: Flag manifolds for subspace ICA problems. In: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2007), Honolulu, Hawaii, USA, April 15-20, vol. IV, pp. 1417-1420 (2007)
15. Plumbley, M.D.: Algorithms for non-negative independent component analysis. IEEE Transactions on Neural Networks 14(3), 534-543 (2003)
16. Szabo, Z., Lorincz, A.: Real and Complex Independent Subspace Analysis by Generalized Variance, arXiv:math/0610438v1
17. van den Bos, A.: Complex Gradient and Hessian. IEE Proc.-Vis. Image Signal Processing 141(6), 380-382 (1994)