Adaptive parallel quadratic-metric projection algorithms

IEEE Transactions on Audio, Speech and Language Processing

Volumn 15, Issue 5, 2007, Pages 1665-1680

  Yukawa, Masahiro ^a,b   Slavakis, Konstantinos ^c   Yamada, Isao ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b RIKEN   (Japan)

^c UNIVERSITY OF ATHENS   (Greece)

Author keywords

Acoustic echo cancellation; Adaptive filtering; Adaptive projected subgradient method (APSM); Quadratic metric

Indexed keywords

A-PRIORI; ACOUSTIC ECHO CANCELLATION; ADAPTIVE FILTERING ALGORITHMS; ADAPTIVE PROJECTED SUBGRADIENT METHOD (APSM); AFFINE PROJECTION ALGORITHMS; CONVEX SETS; FILTER LENGTHS; METRIC PROJECTIONS; MIN MAXES; MONOTONE PROPERTIES; NORMALIZED LEAST MEAN SQUARES; NUMERICAL EXAMPLES; POSTERIORI; QUADRATIC- METRIC;

ACOUSTIC SIGNAL PROCESSING; ACOUSTICS; ADAPTIVE FILTERING; ADAPTIVE FILTERS; APPROXIMATION THEORY; COMPUTATIONAL COMPLEXITY; CONVERGENCE OF NUMERICAL METHODS; ECHO SUPPRESSION; PARALLEL ALGORITHMS; SET THEORY;

ADAPTIVE ALGORITHMS;

EID: 45749144203     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2007.896655     Document Type: Article

References (56)

1. B. Hassibi, A. H. Sayed, and T. Kailath, " H ∞ optimality of the LMS algorithm," IEEE Trans. Signal Process., vol. 44, no. 2, pp. 267-280, Feb. 1996.
2. I. Yamada, K. Slavakis, and K. Yamada, "An efficient robust adaptive filtering algorithm based on parallel subgradient projection techniques," IEEE Trans. Signal Process., vol. 50, no. 5, pp. 1091-1101, May 2002.
3. S. Haykin, Adaptive Filter Theory, 4th ed. Upper Saddle River, NJ: Prentice-Hall, 2002.
4. A. H. Sayed, Fundamentals of Adaptive Filtering. New York: Wiley, 2003.
5. J. Nagumo and J. Noda, "A learning method for system identification," IEEE Trans. Autom. Control, vol. 12, no. 3, pp. 282-287, Jun. 1967.
6. A. E. Albert and L. S. Gardner, Jr., Stochastic Approximation and Nonlinear Regression. Cambridge, MA: MIT Press, 1967.
7. T. Hinamoto and S. Maekawa, "Extended theory of learning identification," (in Japanese) Trans. Inst. Elect. Eng. Jpn., vol. 95, no. 10, pp. 227-234, 1975.
8. K. Ozeki and T. Umeda, "An adaptive filtering algorithm using an orthogonal projection to an affine subspace and its properties," Electron. Commun. Jpn., vol. 67-A, no. 5, pp. 19-27, 1984.
9. D. Slock, "The block underdetermined covariance (BUC) fast transversal filter (FTF) algorithm for adaptive filtering," in Proc. Asilomar Conf. Signals, Syst., Comput., 1992, pp. 550-554.
10. D. R. Morgan and S. G. Kratzer, "On a class of computationally efficient, rapidly converging, generalized NLMS algorithms," IEEE Signal Process. Lett., vol. 3, no. 8, pp. 245-247, Aug. 1996.
11. M. Rupp, "A family of adaptive filter algorithms with decorrelating properties," IEEE Trans. Signal Process., vol. 46, no. 3, pp. 771-775, Mar. 1998.
12. S. Gollamudi, S. Nagaraj, S. Kapoor, and Y. H. Huang, "Set-membership filtering and a set-membership normalized LMS algorithm with an adaptive step size," IEEE Signal Process. Lett., vol. 5, no. 5, pp. 111-114, May 1998.
13. S. Werner and P. S. R. Diniz, "Setmembership affine projection algorithm," IEEE Signal Process. Lett., vol. 8, no. 8, pp. 231-235, Aug. 2001.
14. P. S. R. Diniz and S. Werner, "Set-membership binormalized datareusing LMS algorithms," IEEE Trans. Signal Process., vol. 51, no. 1, pp. 124-134, Jan. 2003.
15. J. A. Apolinário, Jr., S.Werner, P. S. R. Diniz, and T. I. Laakso, "Constrained normalized adaptive filters for CDMA mobile communications," in Proc. EUSIPCO, 1998, vol. IV, pp. 2053-2056.
16. M. L. R. de Campos, S.Werner, and J. A. Apolinário, Jr., "Constrained adaptation algorithms employing householder transformation," IEEE Trans. Signal Process., vol. 50, no. 9, pp. 2187-2195, Sep. 2002.
17. M. L. R. de Campos and J. A. Apolinário, Jr., "The constrained affine projection algorithm-Development and convergence issues," in Proc. 1st Balkan Conf. Signal Process., Commun., Circuits Syst., 2000.
18. I. Yamada, "Adaptive projected subgradient method: A unified view for projection based adaptive algorithms," (in Japanese) J. IEICE, vol. 86, no. 8, pp. 654-658, Aug. 2003.
19. I. Yamada and N. Ogura, "Adaptive projected subgradient method for asymptotic minimization of sequence of nonnegative convex functions," Numer. Funct. Anal. Optim., vol. 25, no. 7&8, pp. 593-617, 2004.
20. M. Yukawa and I. Yamada, "Pairwise optimal weight realization-Acceleration technique for set-theoretic adaptive parallel subgradient projection algorithm," IEEE Trans. Signal Process., vol. 54, no. 12, pp. 4557-4571, Dec. 2006.
21. M. Yukawa, R. L. G. Cavalcante, and I. Yamada, "Efficient blind MAI suppression in DS/CDMA systems by embedded constraint parallel projection techniques," IEICE Trans. Fundam., vol. E88-A, no. 8, pp. 2062-2071, Aug. 2005.
22. R. L. G. Cavalcante, M. Yukawa, and I. Yamada, "Set-theoretic DS/CDMA receivers for fading channels by adaptive projected subgradient method," in Proc. IEEE GLOBECOM, SP06-1, 2005.
23. M.Yukawa and I.Yamada, "Adaptive beamforming by constrained parallel projection in the presence of spatially correlated interferences," in Proc. IEEE ICASSP, 2006, pp. 1009-1012.
24. M. Yukawa and I. Yamada, "Efficient adaptive stereo echo canceling schemes based on simultaneous use of multiple state data," IEICE Trans. Fundam., vol. E87-A, no. 8, pp. 1949-1957, Aug. 2004.
25. M. Yukawa, N. Murakoshi, and I. Yamada, "Efficient fast stereo acoustic echo cancellation based on pairwise optimal weight realization technique," EURASIP J. Appl. Signal Process., 2006, Article ID 84797, 15 pp..
26. R. L. G. Cavalcante, I. Yamada, and K. Sakaniwa, "A fast blind MAI reduction based on adaptive projected subgradient method," IEICE Trans. Fundam., vol. E87-A, no. 8, pp. 1973-1980, Aug. 2004.
27. K. Slavakis, I. Yamada, N. Ogura, and M.Yukawa, "Adaptive projected subgradient method and set theoretic adaptive filtering with multiple convex constraints," in Proc. Asilomar Conf. Signals, Syst., Comput., 2004, pp. 960-964.
28. K. Slavakis, I. Yamada, and N. Ogura, "Adaptive projected subgradient method over the fixed point set of strongly attracting non-expansive mappings," Numer. Funct. Anal. Optim., vol. 27, no. 7 and 8, pp. 905-930, 2006.
29. K. Slavakis, M. Yukawa, and I. Yamada, "Robust Capon beamforming by the adaptive projected subgradient method," in Proc. IEEE ICASSP, 2006, pp. 1005-1008.
30. S. Makino and Y. Kaneda, "Exponentially weighted step-size projection algorithm for acoustic echo cancellers," IEICE Trans. Fundam., vol. E75-A, no. 11, pp. 1500-1508, Nov. 1992.
31. S. Makino, Y. Kaneda, and N. Koizumi, "Exponentially weighted stepsize NLMS adaptive filter based on the statistics of a room impulse response," IEEE Trans. Speech Audio Process., vol. 1, no. 1, pp. 101-108, Jan. 1993.
32. S. L. Gay, "An efficient fast converging adaptive filter for network echo cancellation," in Proc. Asilomar Conf. Signals, Syst., Comput., 1998, pp. 394-398.
33. D. L. Duttweiler, "Proportionate normalized least-mean-squares adaptation in echo cancelers," IEEE Trans. Speech Audio Process., vol. 8, no. 5, pp. 508-518, Sep. 2000.
34. J. Benesty and S. L. Gay, "An improved PNLMS algorithm," in Proc. IEEE ICASSP, 2002, pp. 1881-1884.
35. M. Nekuii and M. Atarodi, "A fast converging algorithm for network echo cancellation," IEEE Signal Process. Lett., vol. 11, no. 4, pp. 427-430, Apr. 2004.
36. H. Deng and M. Doroslovǎcki, "Improving convergence of the PNLMS algorithm for sparse impulse response identification," IEEE Signal Process. Lett., vol. 12, no. 3, pp. 181-184, Mar. 2005.
37. T. Gänsler, S. L. Gay, M. M. Sondhi, and J. Benesty, "Double-talk robust fast converging algorithms for network echo cancellation," IEEE Trans. Speech Audio Process., vol. 8, no. 6, pp. 656-663, Nov. 2000.
38. J. Benesty, T. Gänsler, D. R. Morgan, M. M. Sondhi, and S. L. Gay, Advances in Network and Acoustic Echo Cancellation. Berlin, Germany: Springer-Verlag, 2001.
39. O. Hoshuyama, R. A. Goubran, and A. Sugiyama, "A generalized proportionate variable step-size algorithm for fast changing acoustic environments," in Proc. IEEE ICASSP, 2004, pp. 161-164.
40. S. Werner, J. A. Apolinário, Jr., P. S. R. Diniz, and T. I. Laakso, "A set-membership approach to normalized proportionate adaptation algorithms," in Proc. EUSIPCO, Special Session Partial-Update Adaptive Filters Sparse Syst., 2005.
41. H. Kuttruff, Room Acoustics, 4th ed. New York: Elsevier, 2000.
42. M. Yukawa and I. Yamada, "Adaptive quadratic-metric parallel subgradient projection algorithm and its application to acoustic echo cancellation," in Proc. EUSIPCO, Tue.3.1: Reverberant Environment and Human Audition, 2006.
43. I. Yamada, "The hybrid steepest descent method for the variational inequality problem over the intersection of fixed point sets of nonexpansive mappings," in Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications, D. Butnariu, Y. Censor, and S. Reich, Eds. Amsterdam, The Netherlands: North-Holland, 2001, pp. 473-504.
44. H. H. Bauschke and J. M. Borwein, "On projection algorithms for solving convex feasibility problems," SIAM Rev., vol. 38, no. 3, pp. 367-426, 1996.
45. I. Yamada and N. Ogura, "Hybrid steepest descent method for variational inequality problem over the fixed point set of certain quasi-nonexpansive mappings," Numer. Funct. Anal. Optim., vol. 25, no. 7&8, pp. 619-655, 2004.
46. M. Yukawa and I. Yamada, "Adaptive parallel variable-metric projection algorithm-An application to acoustic echo cancellation," in Proc. IEEE ICASSP, 2007, pp. 1353-1356.
47. M. Doroslovǎcki and H. Deng, "On convergence of proportionate-type NLMS adaptive algorithms," in Proc. IEEE ICASSP, 2006, pp. 105-108.
48. Y. Censor and S. A. Zenios, Parallel Optimization: Theory, Algorithm, and Optimization. New York: Oxford Univ. Press, 1997.
49. D. Butnariu, Y. Censor, and S. Reich, Eds., Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications. New York: Elsevier, 2001.
50. C. Breining, P. Dreiseitel, E. Hänsler, A.Mader, B. Nitsch, H. Puder, T. Schertler, G. Schmidt, and J. Tilp, "Acoustic echo control-An application of very-high-order adaptive filters," IEEE Signal Process. Mag., vol. 16, no. 4, pp. 42-69, Jul. 1999.
51. L. Couvreur and C. Couvreur, "Blind model selection for automatic speech recognition in reverberant environments," J. VLSI Signal Process., vol. 36, no. 2-3, pp. 189-203, Mar. 2004.
52. N. Ogura and I. Yamada, "A deep outer approximating half space of the level set of certain quadratic functions," J. Nonlinear Convex Anal., vol. 6, no. 1, pp. 187-201, 2005.
53. V. V. Vasin and A. L. Ageev, Ill-Posed Problems With A Priori Information. Utrecht, The Netherlands: VSP, 1995.
54. H. H. Bauschke and P. L. Combettes, "A weak-to-strong convergence principle for Fejér monotone methods in Hilbert spaces," Math. Oper. Res., vol. 26, pp. 248-264, May 2001.
55. A. Ben-Israel and T. N. E. Greville, Generalized Inverse: Theory and Applications. New York: Wiley, 1974.
56. M. Z. Nashed, Generalized Inverse and Applications. New York: Academic, 1976.