Neural responses to speech-specific modulations derived from a spectro-temporal filter bank

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 08-12-September-2016, Issue , 2016, Pages 1368-1372

  Frye, Marina ^a,b   Micheli, Cristiano ^a   Schepers, Inga M ^a,b   Schalk, Gerwin ^c,d   Rieger, Jochem W ^a,b   Meyer, Bernd T ^e  

^a UNIVERSITY OF OLDENBURG   (Germany)

^b Cluster of Excellence Hearing4all   (Germany)

^c WADSWORTH CENTER   (United States)

^d ALBANY MEDICAL COLLEGE   (United States)

^e Johns Hopkins University   (United States)

Author keywords

Automatic speech recognition; ECoG; Robust feature extraction; Speech perception

Indexed keywords

BANDPASS FILTERS; ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGY; FEATURE EXTRACTION; FILTER BANKS; MODULATION; NEURONS; SPEECH; SPEECH COMMUNICATION; SPEECH PROCESSING;

AUTOMATIC SPEECH RECOGNITION; ECOG; ELECTROCORTICOGRAPHY (ECOG); MACHINE LISTENING; ROBUST FEATURE EXTRACTIONS; SPEECH APPLICATIONS; SPEECH PERCEPTION; SUPERIOR TEMPORAL GYRUS;

SPEECH RECOGNITION;

EID: 84994365864     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: 10.21437/Interspeech.2016-1327     Document Type: Conference Paper

References (27)

1. Hermansky, H. (1998). "Should recognizers have ears?," Speech Commun., 25, 3-24.
2. Stern, R. M., and Morgan, N. (2012). "Hearing is believing: Biologically inspired methods for robust automatic speech recognition," IEEE Signal Process. Mag., 29, 34-43.
3. Scharenborg, O. (2007). "Reaching over the gap: A review of efforts to link human and automatic speech recognition research," Speech Commun., 49, 336-347.
4. Cooke, M. (2006). "A glimpsing model of speech perception in noise," J. Acoust. Soc. Am., 119, 1562-1573.
5. Scharenborg, O., ten Bosch, L., Boves, L., and Norris, D. (2003). "Bridging automatic speech recognition and psycholinguistics: Extending Shortlist to an end-to-end model of human speech recognition," J. Acoust. Soc. Am., 114, 3032.
6. Qiu, A., Schreiner, C., and Escabi, M. (2003). "Gabor analysis of auditory mid-brain receptive fields: spectro-temporal and binaural composition," Journal of Neurophysiology, 90, pp. 456-476.
7. Kleinschmidt, M. and Gelbart, D. (2002). "Improving word accuracy with Gabor feature extraction," in Proc. Interspeech, pp. 25-28.
8. Schädler, M.R., Meyer, B.T., Kollmeier. B. (2012). "Spectrotemporal modulation subspace-spanning filter bank features for robust automatic speech recognition," J. Acoust. Soc. Am. Volume 131, Issue 5, pp. 4134-4151.
9. Meyer, B. T., Ravuri, S. R., Schädler, M. R., Morgan, N. (2011). "Comparing different flavors of spectro-temporal features for ASR," in Proc. Interspeech, pp. 1269-1272.
10. Castro Martinez, A.M., Moritz, N., Meyer, B.T. (2014). "Should deep neural nets have ears? The role of auditory features in deep learning approaches," in Proc. Interspeech, pp. 2435-2439.
11. Tsai, T. J., and Morgan, N. (2012). "Longer Features:They do a speech detector good," Proc. Interspeech 2012, Portland, OR, USA.
12. Lei, H., Meyer, B., Mirghafori, N. (2012). "Spectro-temporal Gabor features for speaker recognition," in Proc. ICASSP.
13. Kubanek, J., Brunner, P., Gunduz, A., Poeppel, D., Schalk, G. (2013). "The Tracking of Speech Envelope in the Human Cortex," PLoS ONE, 8, pp. 53398
14. Steinschneider, M., Nourski, K.V., Fischman, Y.I. (2013). "Representation of Speech in Human Auditory Cortex: Is it Special?," Hearing Research, 305, pp. 57-73.
15. Nourksi, K.V., Reale, R.A., Oya, H., Kawasaki, H., Kovach, C.K., Chen, H., Howard, M.A., Brugge, J.F. (2009) "Temporal Envelope of Time-Compressed Speech Represented in the Human Auditory Cortex," Journal of Neuroscience, 49, pp. 15564-15574.
16. Ahissar, E., Nagarajan, S., Ahissar, M., Protopapas, A., Mahncke, H., Merzenich, M.M. (2001). "Speech comprehension is correlated with temporal response patterns recorded from auditory cortex," in Proc. National Academy of Sciences, 98, pp.13367-13372.
17. Crone, N.E., Boatman, D., Gordon, B., Hao, L. (2001). "Induced electrocorticographic gamma activity during auditory perception," Clinical Neurophysiology, 112, pp.565-582.
18. Canolty, R.T. (2007). "Spatiotemporal dynamics of word processing in the human brain," Frontiers in Neuroscience, 1, pp.185-196.
19. Hullett, P.W., Hamilton, L.S., Mesgarani, N., Schreiner, C.E., Chang, E.F. (2016). "Human Superior Temporal Gyrus organization of spectrotemporal modulation tuning derived from speech stimuli," Journal of Neuroscience, 36, pp.2014-2026.
20. Pasley, B.N., David, S.V., Mesgarani, N., Flinker, A., Shamma, S.A., Crone, N.E., Knight, R.T., Chang, E.F. (2012). "Reconstructing speech from human auditory cortex," PLoS Biology, 10.
21. Mesgarani, N., Chang, E.F. (2012). "Selective cortical representation of attended speaker in multi-talker speech perception," Nature, 485, pp.233-236.
22. Herff, C., Heger, D., de Pesters, A., Telaar, D., Brunner, P., Schalk, G., Schultz, Tanja. (2015). "Brain-to-Text: decoding spoken phrases from phone representations in the brain," Frontiers in Neuroscience, 9.
23. Schalk, G., McFarland, D.J., Hinterberger, T., Birbaumer, N., Wolpaw, J.R. (2004). "BCI2000: a general-purpose braincomputer interface BCI system," in IEEE Transactions on Biomedical Engineering, 51, pp.1034-1043.
24. Oostenveld,R., Fries, P., Maris, E., Schoffelen, J.-M. (2011). "FieldTrip: Open Source Software for advanced analysis of MEG,EEG and invasive electrophysiological data," Computational Intelligence and Neuroscience, 2011, pp.1-9
25. Zokoll M., Hochmuth S., Warzybok A., Wagener K.C., Buschermöhle M., Kollmeier, B. (2013). "Speech-in-noise tests for multilingual hearing screening and diagnostics," American Journal of Audiology, 22, pp. 175-178.
26. Kanedera, N., Arai, T., Hermansky, H., and Pavel, M. (1997). "On the importance of various modulation frequencies for speech recognition," Proc. Eurospeech, pp. 1079-1082.
27. Hickok, G., Poeppel, D. (2007). "The cortical organization of speech processing," Nature Reviews Neuroscience, 8, pp.393-402