Sparse linear prediction and its applications to speech processing

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 5, 2012, Pages 1644-1657

  Giacobello, Daniele ^a   Christensen, Mads Grsbll ^b   Murthi, Manohar N ^c   Jensen, Sren Holdt ^b   Moonen, Marc ^d  

^a BROADCOM CORPORATION   (United States)

^b AALBORG UNIVERSITY   (Denmark)

^c University of Miami College of Engineering   (United States)

^d Katholieke Universiteit Leuven   (Belgium)

Author keywords

1 norm minimization; compressed sensing; linear prediction; sparse representation; speech analysis; speech coding

Indexed keywords

CODING STRATEGY; COMPRESSED SENSING; CONVEX OPTIMIZATION PROBLEMS; ENCODING TECHNIQUES; INTERIOR-POINT METHOD; LINEAR PREDICTION; LINEAR PREDICTIVE CODING; SIGNAL COMPRESSION; SPARSE REPRESENTATION; SPARSITY CONSTRAINTS; SPEECH PRODUCTION; SPEECH SIGNALS; VOCAL TRACT TRANSFER FUNCTIONS; VOICED SPEECH;

CONVEX OPTIMIZATION; SIGNAL RECONSTRUCTION; SPEECH ANALYSIS; SPEECH CODING; SPEECH PROCESSING;

FORECASTING;

EID: 84859754192     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2186807     Document Type: Review

References (53)

1. J. H. L. Hansen, J. G. Proakis, and J. R. Deller Jr., Discrete-Time Processing of Speech Signals. Englewood Cliffs, NJ: Prentice-Hall, 1987.
2. J. Makhoul, "Linear prediction: A tutorial review," Proc. IEEE, vol. 63, no. 4, pp. 561-580, Apr. 1975.
3. F. Itakura and S. Saito, "Analysis synthesis telephony based on the maximum likelihood method," in Rep. 6th Int. Congr. Acoust., 1968, pp. C17-C20, C-5-5.
4. A. El-Jaroudi and J. Makhoul, "Discrete all-pole modeling," IEEE Trans. Signal Process., vol. 39, no. 2, pp. 411-423, Feb. 1991.
5. M. N. Murthi and B. D. Rao, "All-pole modeling of speech based on the minimum variance distortionless response spectrum," IEEE Trans. Speech and Audio Processing, vol. 8, pp. 221-239, 2000.
6. L. A. Ekman, W. B. Kleijn, and M. N. Murthi, "Regularized linear prediction of speech," IEEE Trans. Audio, Speech, Language Processing, vol. 16, no. 1, pp. 65-73, 2008.
7. H. Hermansky, H. Fujisaki, and Y. Sato, "Spectral envelope sampling and interpolation in linear predictive analysis of speech," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, 1984, vol. 9, pp. 53-56.
8. C.-H. Lee, "On robust linear prediction of speech," IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, no. 5, pp. 642-650, 1988.
9. E. Denoël and J.-P. Solvay, "Linear prediction of speech with a least absolute error criterion," IEEE Trans. Acoust., Speech, Signal Processing, vol. 33, no. 6, pp. 1397-1403, 1985.
10. J. Schroeder and R. Yarlagadda, "Linear predictive spectral estimation via the norm," Signal Process., vol. 17, no. 1, pp. 19-29, 1989.
11. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Norwell, MA: Kluwer, 1993.
12. B. S. Atal and J. R. Remde, "A new model of LPC excitation for producing natural sounding speech at low bit rates," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1982, vol. 7, pp. 614-617.
13. P. Kroon, E. D. F. Deprettere, and R. J. Sluyter, "Regular-pulse excitation - A novel approach to effective multipulse coding of speech," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-34, no. 5, pp. 1054-1063, Oct. 1986. (Pubitemid 17468661)
14. W. C. Chu, Speech Coding Algorithms: Foundation and Evolution of Standardized Coders. New York: Wiley, 2003.
15. J. Lansford and R. Yarlagadda, "Adaptive - approach to speech coding," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1988, vol. 1, pp. 335-338.
16. M. N. Murthi and B. D. Rao, "Towards a synergistic multistage speech coder," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1998, vol. 1, pp. 369-372.
17. P. Kabal and R. P. Ramachandran, "Joint optimization of linear predictors in speech coders," IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 5, pp. 642-650, May 1989.
18. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
19. S. J. Wright, Primal-Dual Interior-Point Methods. Philadelphia, PA: SIAM, 1997.
20. D. Giacobello, M. G. Christensen, J. Dahl, S. H. Jensen, and M. Moonen, "Sparse linear predictors for speech processing," in Proc. Interspeech, 2008, pp. 1353-1356.
21. D. Giacobello, M. G. Christensen, J. Dahl, S. H. Jensen, and M. Moonen, "Joint estimation of short-term and long-term predictors in speech coders," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2009, pp. 4109-4112.
22. D. Giacobello, M. G. Christensen, M. N. Murthi, S. H. Jensen, and M. Moonen, "Speech coding based on sparse linear prediction," in Proc. Eur. Signal Process. Conf., 2009, pp. 2524-2528.
23. D. Giacobello, M. G. Christensen, M. N. Murthi, S. H. Jensen, and M. Moonen, "Enhancing sparsity in linear prediction of speech by iteratively reweighted 1-norm minimization," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2010, pp. 4650-4653.
24. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
25. P. Stoica and R. Moses, Spectral Analysis of Signals. Upper Saddle River, NJ: Pearson Prentice Hall, 2005.
26. S. Nadarajah, "A generalized normal distribution," J. Appl. Statist., vol. 32, no. 7, pp. 685-694, 2005. (Pubitemid 41576633)
27. D. L. Donoho and M. Elad, "Optimally sparse representation from overcomplete dictionaries via -norm minimization," Proc. Nat. Acad. Sci. USA, vol. 100, no. 5, pp. 2197-2202, 2002.
28. E. J. Candés, M. B. Wakin, and S. P. Boyd, "Enhancing sparsity by reweighted minimization," J. Fourier Anal. Applicat., vol. 14, no. 5, pp. 877-905, 2008.
29. 1∞ norm approximate solutions to an overdetermined system of linear equations," Digital Signal Process., vol. 12, no. 4, pp. 524-560, 2002.
30. P. Stoica and T. Söderström, "High order Yule-Walker equations for estimating sinusoidal frequencies: The complete set of solutions," Signal Process., vol. 20, pp. 257-263, 1990. (Pubitemid 20731712)
31. D. Giacobello, T. van Waterschoot, M. G. Christensen, S. H. Jensen, and M. Moonen, "High-order sparse linear predictors for audio processing," in Proc. Eur. Signal Process. Conf., 2010, pp. 234-238.
32. J. J. Fuchs, "On sparse representations in arbitrary redundant bases," IEEE Trans. Inf. Theory, vol. 50, no. 6, pp. 1341-1344, Jun. 2004.
33. P. C. Hansen and D. P. O'Leary, "The use of the-curve in the regularization of discrete ill-posed problems," SIAM J. Sci. Comput., vol. 14, no. 6, pp. 1487-1503, 1993.
34. 2 methods for finding sparse solutions," IEEE J. Sel. Topics Signal Process., vol. 4, no. 2, pp. 317-329, Apr. 2010.
35. E. J. Candés and M. B. Wakin, "An introduction to compressive sampling," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 21-30, Mar. 2008.
36. T. V. Sreenivas and W. B. Kleijn, "Compressive sensing for sparsely excited speech signals," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2009, pp. 4125-4128.
37. D. Giacobello, M. G. Christensen, M. N. Murthi, S. H. Jensen, and M. Moonen, "Retrieving sparse patterns using a compressed sensing framework: Applications to speech coding based on sparse linear prediction," IEEE Signal Process. Lett., vol. 17, no. 1, pp. 103-106, Jan. 2010.
38. P. Kroon and W. B. Kleijn, "Linear-prediction based analysis-by-synthesis coding," in Speech Coding and Synthesis,W. B. Kleijn and K. K. Paliwal, Eds. Amsterdam, The Netherlands: Elsevier Science B.V., 1995, ch. 3, pp. 79-119.
39. R. Baraniuk, M. Davenport, R. DeVore, and M.Wakin, "A simple proof of the restricted isometry property for random matrices," Constructive Approximation, vol. 28, no. 3, pp. 253-263, 2008.
40. L. Scharf, Statistical Signal Processing. Reading, MA: Addison- Wesley, 1991.
41. M. G. Christensen, J. Østergaard, and S. H. Jensen, "On compressed sensing and its applications to speech and audio signals," in Rec. Asilomar Conf. Signals, Syst, Comput., 2009.
42. W. B. Johnson and J. Lindenstrauss, "Extensions of Lipschitz mapping into Hilbert space," in Proc. Conf. Modern Anal. Probab., 1984, vol. 26, pp. 189-206.
43. L. Knockaert, "Stability of linear predictors and numerical range of shift operators in normal spaces," IEEE Trans. Inf. Theory, vol. 38, no. 5, pp. 1483-1486, Sep. 1992.
44. A. D. Subramaniam and B. D. Rao, "PDF optimized parametric vector quantization of speech line spectral frequencies," IEEE Trans. Speech Audio Process., vol. 11, no. 2, pp. 130-142, Mar. 2003.
45. K. K. Paliwal and B. S. Atal, "Efficient vector quantization of LPC parameters at 24 bits/frame," IEEE Trans. Speech Audio Process., vol. 1, no. 1, pp. 3-14, Jan. 1993.
46. W. B. Kleijn and A. Ozerov, "Rate distribution between model and signal," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., 2007, pp. 243-246.
47. "Adaptive multi-rate (AMR) Speech codec; Transcoding functions," 2004, 3GPP TS 26.190.
48. "Method for the subjective assessment of intermediate quality level of coding systems," 2003, ITU-R BS.1534-1.
49. "Parameters and coding characteristics that must be common to assure interoperability of 2400 bps linear predictive encoded digital speech," NATO (unclassified), Annex X to AC/302 (NBDS) R/2.
50. C. Magi, J. Pohjalainen, T. Bäckström, and P. Alku, "Stabilised weighted linear prediction," Speech Commun., vol. 51, no. 5, pp. 401-411, 2009.
51. W. F. G. Mecklenbrauker, "Remarks on the minimum phase property of optimal prediction error filters and some related questions," IEEE Signal Process. Lett., vol. 5, no. 4, pp. 87-88, Apr. 1998.
52. P. Bloomfield and W. Steiger, "Least absolute deviations curve-fitting," SIAM J. Sci. Statist. Comput., vol. 1, no. 2, pp. 290-301, 1980.
53. M. Reed and B. Simon, Methods of Modern Mathematical Physics II: Fourier Analysis, Self-adjointness. New York: Academic, 1975.