Adaptive projected subgradient method and set theoretic adaptive filtering with multiple convex constraints

Conference Record - Asilomar Conference on Signals, Systems and Computers

Volumn 1, Issue , 2004, Pages 960-964

  Slavakis, Konstantinos ^a   Yamada, Isao ^a   Ogura, Nobuhiko ^a   Yukawa, Masahiro ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE ALGORITHMS; COMPUTATIONAL COMPLEXITY; CONSTRAINT THEORY; ECHO SUPPRESSION; LEAST SQUARES APPROXIMATIONS; LINEAR SYSTEMS; OPTIMIZATION;

ADAPTIVE ARRAYS; AFFINE PROJECTION ALGORITHMS (APA); MULTIPLE CONVEX CONSTRAINTS; NORMALIZED LEAST MEAN SQUARE (NLMS);

ADAPTIVE FILTERING;

EID: 21644444200     PISSN: 10586393     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. J. Nagumo and J. Noda, "A learning method for system identification," IEEE Trans. Autom. Control, vol. 12, no. 3, pp. 282-287, 1967.
2. A. E. Albert and L. A. Gardner, Stochastic Approximation and Nonlinear Regression. MIT Press, 1967.
3. T. Hinamoto and S. Maekawa, "Extended theory of learning identification," Trans. IEE Japan, vol. 95-C, no. 10, pp. 227-234, 1975.
4. K. Ozeki and T. Umeda, "An adaptive filtering algorithm using an orthogonal projection to an affine subspace and its properties," IEICE Trans., vol. 67-A, no. 5, pp. 126-132, 1984.
5. S. C. Park and J. F. Doherty, "Generalized projection algorithm for blind interference suppression in DS/CDMA communications," IEEE Trans. Circuits Syst. II, vol. 44, no. 6, pp. 453-460, 1997.
6. M.-L. R. Campos, S. Werner, and J. A. Apolinário, "Constrained adaptive algorithm employing Householder transformation, " IEEE Trans. Signal Processing, vol. 50, no. 9, pp. 2187-2195, 2002.
7. I. Yamada, K. Slavakis, and K. Yamada, "An efficient robust adaptive filtering algorithm based on parallel subgradient projection techniques," IEEE Trans. Signal Processing, vol. 50, no. 5, pp. 1091-1101, 2002.
8. M. Brandstein and D. Ward, Eds., Microphone Arrays: Signal Processing Techniques and Applications. Berlin: Springer, 2001.
9. J. Benesty and Y. Huang, Eds., Adaptive Signal Processing: Applications to Real-World Problems. Berlin: Springer, 2002.
10. S. L. Gay and J. Benesty, Eds., Acoustic Signal Processing for Telecommunications. Boston: Kluwer, 2000.
11. A. H. Sayed, Fundamentals of Adaptive Filtering. New Jersey: John Wiley & Sons, 2003.
12. S. Haykin, Adaptive Filter Theory, 3rd ed. New Jersey: Prentice-Hall, 1996.
13. B. Hassibi, A. H. Sayed, and T. Kailath, "H∞ optimality of the LMS algorithm," IEEE Trans. Signal Processing, vol. 44, no. 2, pp. 267-280, 1996.
14. L. M. Bregman, "The method of successive projections for finding a common point of convex sets," Soviet Math. Dokl., vol. 6, pp. 688-692, 1965.
15. L. G. Gubin, B. T. Polyak, and E. V. Raik, "The method of projections for finding the common point of convex sets," USSR Comput. Math. Phys., vol. 7, pp. 1-24, 1967.
16. D. C. Youla and H. Webb, "Image restoration by the method of convex projections: Part 1-Theory," IEEE Trans. Med. Imaging, vol. MI-1, pp. 81-94, Oct. 1982.
17. P. L. Combettes, "The foundations of set theoretic estimation, " Proc. IEEE, vol. 81, no. 2, pp. 182-208, 1993.
18. H. H. Bauschke and J. M. Borwein, "On projection algorithms for solving convex feasibility problems," SIAM Review, vol. 38, no. 3, pp. 367-426, Sept 1996.
19. Y. Censor and S. A. Zenios, Parallel Optimization: Theory, Algorithm, and Optimization. Oxford University Press, 1997.
20. P. L. Combettes, "Convex set theoretic image recovery by extrapolated iterations of parallel subgradient projections," IEEE Trans. Image Proc., vol. 6, no. 4, pp. 493-506, April 1997.
21. I. Yamada, "Adaptive projected subgradient method: A unified view for projection based adaptive algorithms," The Journal of IEICE, vol. 86, no. 8, pp. 654-658, Aug. 2003, in Japanese.
22. I. Yamada and N. Ogura, "Adaptive projected subgradient method and its applications to set theoretic adaptive filtering," in Proceedings of the 37th Asilomar Conference on Signals, Systems and Computers, Nov. 2003, pp. 600-606.
23. _, "Adaptive projected subgradient method for asymptotic minimization of sequence of nonnegative convex functions," accepted for publication in Numerical Functional Analysis and Optimization.
24. B. T. Polyak, "Minimization of unsmooth functionals," USSR Comput. Math. Physics, vol. 9, pp. 14-29, 1969.
25. N. Ogura and I. Yamada, "Adaptive parallel outer projection algorithm based on supporting hyperplane approximation," IEICE (DSP/EA), Tech. Rep., May 2003.
26. M. Yukawa and I. Yamada, "Efficient adaptive stereo echo canceling schemes based on simultaneous use of multiple state data," IEICE Trans. Fundamentals, vol. E87-A, no. 8, pp. 1949-1957, 2004.
27. R. Cavalcante, I. Yamada, and K. Sakaniwa, "A fast blind multiple access interference reduction in DS/CDMA systems based on adaptive projected subgradient method," IEICE Trans. Fundamentals, vol. E87-A, no. 8, pp. 1973-1980, 2004.
28. K. Slavakis, I. Yamada, and N. Ogura, "The Adaptive Projected Subgradient Method over the fixed point set of strongly attracting nonexpansive mappings," submitted for publication.
29. K. Goebel and S. Reich, Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings, ser. Pure and Applied Math. New York: Marcel Dekker, 1984, vol. 83.
30. I. Ekeland and R. Témam, Convex Analysis and Variational Problems. Philadelphia: SIAM, 1999.
31. C. Breining, P. Dreiseitel, E. Hänsler, A. Mader, B. Nitsch, H. Puder, T. Schertier, G. Schmidt, and J. Tilp, "Acoustic echo control-An application of very-high-order adaptive filters," Signal Process. Mag., vol. 16, no. 4, pp. 42-69, July 1999.