Can we automatically transform speech recorded on common consumer devices in real-world environments into professional production quality speech? - A dataset, insights, and challenges

IEEE Signal Processing Letters

Volumn 22, Issue 8, 2015, Pages 1006-1010

  Mysore, Gautham J ^a  

^a ADOBE RESEARCH   (United States)

Author keywords

Automatic production; speech enhancement

Indexed keywords

AUDIO ACOUSTICS; AUDIO RECORDINGS; MOTION PICTURES; PROFESSIONAL ASPECTS; SPEECH ENHANCEMENT; SPEECH INTELLIGIBILITY; STUDIOS;

AUDIO EFFECTS; AUTOMATIC PRODUCTION; AUTOMATIC SPEECH RECOGNITION; CONSUMER DEVICES; PRODUCTION QUALITY; REAL WORLD ENVIRONMENTS; RECORDING STUDIOS; SPEECH CONTENT;

SPEECH RECOGNITION;

EID: 84919935005     PISSN: 10709908     EISSN: None     Source Type: Journal    
DOI: 10.1109/LSP.2014.2379648     Document Type: Article

References (25)

1. B. Owsinski, The Recording Engineer's Handbook, 3rd ed. Boston, MA, USA: Cengage Learning, 2013.
2. B. Owsinski, The Mixing Engineer's Handbook, 3rd ed. Boston, MA, USA: Cengage Learning, 2013.
3. A. Case, Sound FX. Unlocking the Creative Potential of Recording Studio Effects. New York, NY, USA: Focal, 2007.
4. B. Katz, Mastering Audio. The Art and the Science, 2nd ed. New York, NY, USA: Focal, 2007.
5. Y. Ephraim and D. Malah, "Speech enhancement using a minimum-mean square error short-time spectral amplitude estimator," IEEE Trans. Acoust., Speech, Signal Process, vol. 32, no. 6, Dec. 1984.
6. P. Scalart and V. Filho, "Speech enhancement based on a priori signal to noise estimation," in Proc. IEEE Int, Conf, Acoustics, Speech, and Signal Processing, May 1996.
7. Z. Duan, G. J. Mysore, and P. Smaragdis, "Speech enhancement by online non-negative spectrogram decomposition in non-stationary noise environments," in Proc. Interspeech, Sep. 2012.
8. P. C. Loizou, Speech Enhancement. Theory and Practice, 2nd ed. Boca Raton, FL, USA: CRC, 2013.
9. P. Naylor and N. D. Gaubitch, Speech Dereverberation. Amsterdam, The Netherlands: Springer, 2010.
10. K. Kinoshita, M. Delcroix, T. Yoshioka, T. Nakatani, E. Habets, R. Haeb-Umbach, V. Leutnant, A. Sehr, W. Kellermann, R. Maas, S. Gannot, and B. Raj, "The reverb challenge. A common evaluation framework for dereverberation and recognition of reverberant speech," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2013.
11. D. Liang, D. P. Ellis, M. D. Hoffman, and G. J. Mysore, "Speech de coloration based on the product of filters model," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, May 2014.
12. N. Enbom and B. Kleijn, "Bandwidth expansion of speech based on vector quantization of the mel frequency cepstral coefficients," in Proc. IEEE Workshop on Speech Coding, Jun. 1999.
13. J. Han, G. J. Mysore, and B. Pardo, "Language informed bandwidth expansion," in Proc. IEEE Int. Workshop on Machine Learning for Signal Processing, Sep. 2012.
14. V. Verfaille, U. Zölzer, and D. Arfib, "Adaptive digital audio effects (a-dafx). A new class of sound transformations," IEEE Trans. Audio, Speech Lang. Process., vol. 14, no. 5, pp. 1817-1831, Sep. 2006.
15. D. Giannoulis, M. Massberg, and J. D. Reiss, "Parameter automation in a dynamic range compressor," J. Audio Eng. Soc., vol. 61, no. 10, Oct. 2013.
16. Y. Bengio, A. Courville, and P. Vincent, "Representation learning. A review and new perspectives," IEEE Trans. Patt. Anal. Mach. Intell., vol. 35, no. 8, pp. 1798-1828, 2013.
17. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. Cambridge, MA, USA: MIT Press, 2006.
18. E. Vincent, J. Barker, S. Watanabe, J. L. Roux, F. Nesta, and M. Matas-soni, "The second 'CHIME' speech separation and recognition challenge. Datasets, tasks, and baselines," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, May 2013.
19. H.-G. Hirsch and D. Pearce, "The aurora experimental framework for the performance evaluation of speech recognition systems under noisy conditions," in Proc. ISCA Workshop ASR2000, Sep. 2000.
20. N. Parihar, J. Picone, D. Pearce, and H.-G. Hirsch, "Performance analysis of the aurora large vocabulary baseline system," in Proc. Eur. Signal Processing Conf., Sep. 2004.
21. D. Giannoulis, M. Massberg, and J. D. Reiss, "Digital dynamic range compressor design-a tutorial and analysis," J. Audio Eng. Soc., vol. 60, no. 6, Jun. 2012.
22. J. Sohn, N. S. Kim, and W. Sung, "A statistical model-based voice activity detection," IEEE Signal Process. Lett., vol. 6, no. 1, pp. 1-3, Jan. 1999.
23. F. G. Germain, D. Sun, and G. J. Mysore, "Speaker and noise independent voice activity detection," in Proc. Interspeech, Aug. 2013.
24. Y. Hu and P. C. Loizou, "Evaluation of objective quality measures for speech enhancement," IEEE Trans. Audio, Speech Lang. Process., vol. 16, no. 1, pp. 229-238, Jan. 2008.
25. V. Emiya, E. Vincent, N. Harlander, and V. Hohmann, "Subjective and objective quality assessment of audio source separation," IEEE Trans. Audio, Speech Lang. Process., vol. 19, no. 7, pp. 2046-2057, 2011.