Audio inpainting

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 3, 2012, Pages 922-932

  Adler, Amir ^a   Emiya, Valentin ^b   Jafari, Maria G ^c   Elad, Michael ^a   Gribonval, Rémi ^b   Plumbley, Mark D ^c  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b INRIA   (France)

^c QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Clipping; inpainting; matching pursuit (MP); sparse representation (SR)

Indexed keywords

ABSOLUTE VALUES; AUDIO DATA; AUDIO FRAMES; AUDIO SAMPLES; CLIPPING; CRUCIAL PARAMETERS; DISCRETE COSINES; HIGH QUALITY; INPAINTING; MATCHING PURSUIT; MAXIMUM AMPLITUDE; ORTHOGONAL MATCHING PURSUIT; SIGN PATTERNS; SIGNAL RESTORATION; SIGNAL TO NOISE; SPARSE REPRESENTATION; STATE-OF-THE-ART METHODS; TIME DOMAIN;

ACOUSTIC NOISE; ALGORITHMS; IMAGE CODING; IMPULSE NOISE; INVERSE PROBLEMS; RESTORATION; SIGNAL PROCESSING; SIGNAL TO NOISE RATIO; TIME DOMAIN ANALYSIS;

AUDIO ACOUSTICS;

EID: 84856271936     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2168211     Document Type: Article

References (45)

1. A. Adler, V. Emiya, M. Jafari, M. Elad, R. Gribonval, and M. D. Plumbley, "A constrained matching pursuit approach to audio declipping," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Prague, Czech Republic, May 2011, pp. 329-332.
2. A. Janssen, R. Veldhuis, and L. Vries, "Adaptive interpolation of discrete-time signals that can be modeled as autoregressive processes," IEEE Trans. Acoustics, Speech and Signal Process., vol. 34, no. 2, pp. 317-330, Apr. 1986. (Pubitemid 16576063)
3. W. Etter, "Restoration of a discrete-time signal segment by interpolation based on the left-sided and right-sided autoregressive parameters," IEEE Trans. Signal Process., vol. 44, no. 5, pp. 1124-1135, May 1996. (Pubitemid 126776460)
4. S. J. Godsill and P. J. W. Rayner, Digital Audio Restoration-A Statistical Model-Based Approach. Berlin, Germany: Springer-Verlag, 1998.
5. M. Lagrange and S. Marchand, "Long interpolation of audio signals using linear prediction in sinusoidal modeling," J. Audio Eng. Soc., vol. 53, pp. 891-905, 2005. (Pubitemid 46152774)
6. A. Dahimene, M. Noureddine, and A. Azrar, "A simple algorithm for the restoration of clipped speech signal," Informatica, vol. 32, pp. 183-188, 2008.
7. J. S. Abel and J. O. Smith, "Restoring a clipped signal," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Toronto, ON, Canada, May 1991, pp. 1745-1748.
8. R. C. Maher, "A method for extrapolation of missing digital audio data," in Proc.95th AES Conv., 1993.
9. M. Cooke, P. Green, L. Josifovski, and A. Vizinho, "Robust automatic speech recognition with missing and unreliable acoustic data," Speech Commun., vol. 34, no. 3, pp. 267-285, 2001. (Pubitemid 32284867)
10. J. Gemmeke, H. Van Hamme, B. Cranen, and L. Boves, "Compressive sensing for missing data imputation in noise robust speech recognition," IEEE J. Sel. Topics Signal Process., vol. 4, no. 2, pp. 272-287, Aug. 2010.
11. J. Le Roux, H. Kameoka, N. Ono, A. de Cheveigné, and S. Sagayama, "Computational auditory induction as a missing-data model-fitting problem with Bregman divergence," Speech Commun., vol. 53, no. 5, pp. 658-676, 2011.
12. M. Dietz, L. Liljeryd, K. Kjorling, and O. Kunz, "Spectral band replication, a novel approach in audio coding," in Proc. 112th AES Conv., Munich, Germany, May 2002, Audio Eng. Soc.; 1999.
13. E. Larsen and R. Aarts, Audio Bandwidth Extension: Application of Psychoacoustics, Signal Processing and Loudspeaker Design. New York: Wiley, 2004.
14. P. Smaragdis, B. Raj, and M. Shashanka, "Missing data imputation for spectral audio signals," in Proc. MLSP, Grenoble, France, Sep. 2009.
15. M. Moussallam, P. Leveau, and S. M. Aziz Sbai, "Sound enhancement using sparse approximation with speclets," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Dallas, TX, Mar. 2010, pp. 221-224.
16. C. Perkins, O. Hodson, and V. Hardman, "A survey of packet loss recovery techniques for streaming audio," IEEE Netw., vol. 12, no. 5, pp. 40-48, Sep. 1998. (Pubitemid 128570726)
17. H. Ofir, D. Malah, and I. Cohen, "Audio packet loss concealment in a combined MDCT-MDST domain," IEEE Signal Process. Lett., vol. 14, no. 12, pp. 1032-1035, Dec. 2007. (Pubitemid 350201271)
18. G. Cocchi and A. Uncini, "Subband neural networks prediction for on-line audio signal recovery," IEEE Trans. Neural Netw., vol. 13, no. 4, pp. 867-876, Jul. 2002.
19. S. J. Godsill, P. J. Wolfe, and W. N. W. Fong, "Statistical model-based approaches to audio restoration and analysis," J. New Music Res., vol. 30, no. 4, pp. 323-328, 2001.
20. J. Barker, "Robust automatic speech recognition," in Computational Auditory Scene Analysis: Principles, Algorithms, and Applications. New York: IEEE Press/Wiley-Interscience, 2006, pp. 297-350.
21. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting," in Proc. 27th Conf. Comput. Graphics Interactive Tech., 2000, pp. 417-424, ACM Press/Addison-Wesley Publishing Co.. (Pubitemid 32394006)
22. M. Elad, J. L. Starck, P. Querre, and D. L. Donoho, "Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA)," Appl. Comput. Harmonic Anal., vol. 19, pp. 340-358, 2005. (Pubitemid 41660098)
23. M. Elad, Sparse and Redundant Representations-From Theory to Applications in Signal and Image Processing. New York: Springer, 2010.
24. S. Mallat and Z. Zhang, "Matching pursuits with time-frequency dictionaries," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3397-3415, Dec. 1993.
25. M. D. Plumbley, T. Blumensath, L. Daudet, R. Gribonval, and M. Davies, "Sparse representations in audio and music: From coding to source separation," Proc. IEEE, vol. 98, no. 6, pp. 995-1005, Jun. 2010.
26. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
27. J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. Image Process., vol. 17, no. 1, pp. 53-69, Jan. 2008.
28. D. Griffin and J. Lim, "Signal estimation from modified short-time fourier transform," IEEE Trans. Acoust., Speech Signal Process., vol. ASSP-32, no. 2, pp. 236-243, Apr. 1984. (Pubitemid 14608418)
29. M. Davies and L. Daudet, "Sparse audio representations using the MCLT," Signal Process., vol. 86, no. 3, pp. 457-470, 2006. (Pubitemid 43106565)
30. E. Ravelli, G. Richard, and L. Daudet, "Union of mdct bases for audio coding," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 8, pp. 1361-1372, Nov. 2008.
31. B. Natarajan, "Sparse approximate solutions to linear systems," SIAM J. Comput., vol. 25, no. 2, pp. 227-234, 1995.
32. G. Davis, S. Mallat, and M. Avellaneda, "Adaptive greedy approximations," Constr. Approx., vol. 13, no. 1, pp. 57-98, 1997.
33. Y. Pati, R. Rezaiifar, and P. Krishnaprasad, "Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition," in Proc. Asilomar Conf. Signals, Syst., Comput., Nov. 1993, vol. 1, pp. 40-44.
34. R. Gribonval, "Fast matching pursuit with a multiscale dictionary of gaussian chirps," IEEE Trans. Signal Process., vol. 49, no. 5, pp. 994-1001, May 2001. (Pubitemid 32444198)
35. L. Peotta and P. Vandergheynst, "Matching pursuit with block incoherent dictionaries," IEEE Trans. Signal Process., vol. 55, no. 9, pp. 4549-4557, Sep. 2007. (Pubitemid 47323629)
36. R. Gribonval and E. Bacry, "Harmonic decomposition of audio signals with matching pursuit," IEEE Trans. Signal Process., vol. 51, no. 1, pp. 101-111, Jan. 2003.
37. Y. Eldar and H. Bolcskei, "Block-sparsity: Coherence and efficient recovery," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Taipei, Taiwan, 2009, pp. 2885-2888.
38. H. Mansour, R. Saab, P. Nasiopoulos, and R. Ward, "Color image desaturation using sparse reconstruction," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Dallas, TX, Mar. 2010, pp. 778-781.
39. Method for Objective Measurements of Perceived Audio Quality, ITU-R Std. BS. 1387, Dec. 1998.
40. R. Huber and B. Kollmeier, "Pemo-q-A new method for objective audio quality assessment using a model of auditory perception," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 6, pp. 1902-1911, 2006.
41. V. Emiya, E. Vincent, N. Harlander, and V. Hohmann, "Subjective and objective quality assessment of audio source separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 7, pp. 2046-2057, Sep. 2011.
42. E. Vincent, S. Araki, and P. Bofill, The 2008 Signal Separation Evaluation Campaign: A Community-Based Approach to Large-Scale Evaluation. Paraty, Brazil: Springer, Mar. 2009.
43. D. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
44. E. Candes, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006. (Pubitemid 43174093)
45. J. Tropp, "Greed is good: Algorithmic results for sparse approximation," IEEE Trans. Inf. Theory, vol. 50, no. 10, pp. 2231-2242, Oct. 2004.