Deep scattering spectrum

IEEE Transactions on Signal Processing

Volumn 62, Issue 16, 2014, Pages 4114-4128

  Andén, Joakim ^a,b   Mallat, Stéphane ^c  

^a CENTRE DE MATHÉMATIQUES APPLIQUÉES   (France)

^b PRINCETON UNIVERSITY   (United States)

^c ECOLE NORMALE SUPÉRIEURE   (France)

Author keywords

Audio classification; deep neural networks; MFCC; modulation spectrum; wavelets

Indexed keywords

MODULATION;

AUDIO CLASSIFICATION; DEEP NEURAL NETWORKS; MFCC; MODULATION SPECTRUM; WAVELETS;

AUDIO ACOUSTICS;

EID: 84896734479     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2014.2326991     Document Type: Article

References (50)

1. V. Chudáček, J. Andén, S. Mallat, P. Abry, and M. Doret, "Scattering transform for intrapartum fetal heart rate characterization and acidosis detection," presented at the IEEE Int. Conf. Eng. Med. Biol. Soc., 2013.
2. H. Hermansky, "The modulation spectrum in the automatic recognition of speech," in Proc. IEEE Autom. Speech Recognit. Understanding Workshop, 1997, pp. 140-147.
3. M. S. Vinton and L. E. Atlas, "Scalable and progressive audio codec," in Proc. 2001 IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'01), 2001, vol. 5, pp. 3277-3280.
4. J. McDermott and E. Simoncelli, "Sound texture perception via statistics of the auditory periphery: Evidence from sound synthesis," Neuron, vol. 71, no. 5, pp. 926-940, 2011.
5. M. Ramona and G. Peeters, "Audio identification based on spectral modeling of bark-bands energy and synchronization through onset detection," in Proc. IEEE ICASSP, 2011, pp. 477-480.
6. M. Slaney and R. Lyon, M. Cooke, S. Beet, and M. Crawford, Eds., Visual Representations of Speech Signals. Hoboken, NJ, USA: Wiley, 1993, pp. 95-116.
7. R. D. Patterson, "Auditory images: How complex sounds are represented in the auditory system," J. Acoust. Soc. Japan (E), vol. 21, no. 4, pp. 183-190, 2000.
8. C. Lee, J. Shih, K. Yu, and H. Lin, "Automatic music genre classification based on modulation spectral analysis of spectral and cepstral features," IEEE Trans. Multimedia, vol. 11, no. 4, pp. 670-682, Jun. 2009.
9. D. Ellis, X. Zeng, and J. McDermott, "Classifying soundtracks with audio texture features," in Proc. IEEE ICASSP, Prague, Czech Republic, May 22-27, 2011, pp. 5880-5883.
10. J. K. Thompson and L. E. Atlas, "A non-uniform modulation transform for audio coding with increased time resolution," in Proc. 2003 IEEE Int. Conf. Acoustics, Speech, Signal Process. (ICASSP'03), 2003, vol. 5, pp. V-397.
11. S. Mallat, "Group invariant scattering," Commun. Pure Appl. Math., vol. 65, no. 10, pp. 1331-1398, 2012.
12. Y. LeCun, K. Kavukvuoglu, and C. Farabet, "Convolutional networks and applications in vision," presented at the IEEE ISCAS, 2010.
13. H. Lee, P. Pham, Y. Largman, and A. Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks," presented at the NIPS, 2009.
14. G. Hinton et al., "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 82-97, Dec. 2012.
15. L. Deng, O. Abdel-Hamid, and D. Yu, "A deep convolutional neural network using heterogeneous pooling for trading acoustic invariance with phonetic confusion," presented at the ICASSP, 2013.
16. A. Graves, A.-R. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks," presented at the ICASSP, 2013.
17. E. J. Humphrey, T. Cho, and J. P. Bello, "Learning a robust tonnetz- space transform for automatic chord recognition," in Proc. IEEE ICASSP, 2012, pp. 453-456.
18. P. Hamel and D. Eck, "Learning features from music audio with deep belief networks," presented at the ISMIR, 2010.
19. E. Battenberg and D. Wessel, "Analyzing drum patterns using conditional deep belief networks," presented at the ISMIR, 2012.
20. T. Dau, B. Kollmeier, and A. Kohlrausch, "Modeling auditory processing of amplitude modulation. I. Detection and masking with narrow-band carriers," J. Acoust. Soc. Amer., vol. 102, no. 5, pp. 2892-2905, 1997. (Pubitemid 27486267)
21. T. Chi, P. Ru, and S. Shamma, "Multiresolution spectrotemporal analysis of complex sounds," J. Acoust. Soc. Am., vol. 118, no. 2, pp. 887-906, 2005. (Pubitemid 41129224)
22. N. Mesgarani, M. Slaney, and S. A. Shamma, "Discrimination of speech from nonspeech based on multiscale spectro-temporal modulations," IEEE Audio, Speech, Language Process., vol. 14, no. 3, pp. 920-930, 2006. (Pubitemid 46547653)
23. J. Bruna and S. Mallat, "Invariant scattering convolution networks," IEEE Trans. Pattern Anal.Mach. Intell., vol. 35, no. 8, pp. 1872-1886, Aug. 2013.
24. L. Sifre and S. Mallat, "Rotation, scaling and deformation invariant scattering for texture discrimination," presented at the CVPR, 2013.
25. S. Mallat, AWavelet Tour of Signal Processing. NewYork, NY, USA: Academic Press, 1999.
26. S. Schimmel and L. Atlas, "Coherent envelope detection for modulation filtering of speech," in Proc. ICASSP, 2005, vol. 1, pp. 221-224.
27. R. Turner and M. Sahani, "Probabilistic amplitude and frequency demodulation," Adv. Neural Inf. Process. Syst., pp. 981-989, 2011.
28. G. Sell and M. Slaney, "Solving demodulation as an optimization problem," IEEE Trans. Audio, Speech, Language Process., vol. 18, no. 8, pp. 2051-2066, Aug. 2010.
29. I.Waldspurger and S. Mallat, "Phase Retrieval for the Cauchy wavelet transform," J. Fourier Anal. Appl. [Online]. Available: http://arxiv.org/ abs/1404.1183, submitted for publication
30. M. Henaff, K. Jarrett, K. Kavukcuoglu, and Y. LeCun, "Unsupervised learning of sparse features for scalable audio classification," presented at the ISMIR, 2011.
31. J. Nam, J. Herrera, M. Slaney, and J. Smith, "Learning sparse feature representations for music annotation and retrieval," presented at the ISMIR, 2012.
32. E. C. Smith and M. S. Lewicki, "Efficient auditory coding," Nature, vol. 439, no. 7079, pp. 978-982, 2006. (Pubitemid 43292416)
33. W. Fisher, G. Doddington, and K. Goudie-Marshall, "The DARPA speech recognition research database: Specifications and status," in Proc. DARPA Workshop Speech Recognit., 1986, pp. 93-99.
34. L. Lucy, "An iterative technique for the rectification of observed distributions," Astron. J., vol. 79, p. 745, 1974.
35. E. J. Candès, Y. C. Eldar, T. Strohmer, and V. Voroninski, "Phase retrieval via matrix completion," SIAM J. Imaging Sci., vol. 6, no. 1, pp. 199-225, 2013.
36. I. Waldspurger, A. d'Aspremont, and S. Mallat, "Phase Recovery, Maxcut and Complex Semidefinite Programming," Math. Programm., pp. 1-35, 2013.
37. D. W. Griffin and J. S. Lim, "Signal estimation from modified shorttime Fourier transform," IEEE Trans. Acoust., Speech, Signal Process., vol. 32, no. 2, pp. 236-243, Feb. 1984.
38. S. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoust., Speech, Signal Process., vol. 28, no. 4, pp. 357-366, Apr. 1980. (Pubitemid 11464930)
39. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol. vol. 2, pp. 27:1-27:27, 2011 [Online]. Available: http://www.csie.ntu. edu.tw/~cjlin/libsvm, software available at
40. G. Tzanetakis and P. Cook, "Musical genre classification of audio signals," IEEE Trans. Speech Audio Process., vol. 10, no. 5, pp. 293-302, Jul. 2002. (Pubitemid 34950067)
41. J. Andén and S. Mallat, "Multiscale scattering for audio classification," in Proc. ISMIR, Miami, FL, USA, Oct. 24-28, 2011, pp. 657-662.
42. C. Baugé, M. Lagrange, J. Andén, and S. Mallat, "Representing environmental sounds using the separable scattering transform," presented at the IEEE ICASSP, 2013.
43. H.-A. Chang and J.R. Glass, "Hierarchical large-margin Gaussianmixture models for phonetic classification," in Proc. IEEE ASRU, 2007, pp. 272-277.
44. X. Chen and P. J. Ramadge, "Music genre classification using multiscale scattering and sparse representations," presented at the CISS, 2013.
45. B. L. Sturm, "An analysis of the GTZANmusic genre dataset," in Proc. 2nd Int. ACM Workshop Music Inf. Retrieval With User-Centered Multimodal Strategies, 2012, pp. 7-12.
46. K.-F. Lee and H.-W. Hon, "Speaker-independent phone recognition using hidden Markov models," IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 11, pp. 1641-1648, Nov. 1989.
47. P. Clarkson and P. J. Moreno, "On the use of support vector machines for phonetic classification," IEEE Trans. Acoust., Speech, Signal Process., vol. 2, pp. 585-588, Feb. 1999.
48. A. K. Halberstadt, "Heterogeneous Acoustic Measurements and Multiple Classifiers for Speech Recognition," Ph.D. dissertation, Massachusetts Inst. Technol., Cambridge, MA, USA, 1998.
49. T. N. Sainath, D. Nahamoo, D. Kanevsky, B. Ramabhadran, and P. Shah, "A convex hull approach to sparse representations for exemplarbased speech recognition," in Proc. IEEE ASRU, 2011, pp. 59-64.
50. J. Andén, "Time and Frequency Scattering for Audio Classification," Ph.D. dissertation, Ecole Polytechnique, Palaiseau, France, 2014.