Identifying fragments of natural speech from the listener's MEG signals

Human Brain Mapping

Volumn 34, Issue 6, 2013, Pages 1477-1489

  Koskinen, Miika ^a   Viinikanoja, Jaakko ^a   Kurimo, Mikko ^a   Klami, Arto ^a   Kaski, Samuel ^a,b   Hari, Riitta ^a  

^a AALTO UNIVERSITY   (Finland)

^b UNIVERSITY OF HELSINKI   (Finland)

Author keywords

Auditory perception; Decoding; Encoding; Machine learning; Magnetoencephalography; Signal processing; Speech

Indexed keywords

ADULT; ALGORITHM; ARTICLE; BAYES THEOREM; CORRELATION ANALYSIS; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; MAGNETOENCEPHALOGRAPHY; MALE; NORMAL HUMAN; PRIORITY JOURNAL; SIGNAL PROCESSING; SOUND; SPEECH; SPEECH ANALYSIS; STIMULUS RESPONSE;

ADULT; BRAIN; FEMALE; HUMANS; MAGNETOENCEPHALOGRAPHY; MALE; SIGNAL PROCESSING, COMPUTER-ASSISTED; SPEECH; SPEECH PERCEPTION; YOUNG ADULT;

EID: 84876450629     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.22004     Document Type: Article

References (43)

1. Abrams DA, Nicol T, Zecker S, Kraus N ( 2008): Right-hemisphere auditory cortex is dominant for coding syllable patterns in speech. J Neurosci 28: 3958-3965.
2. Abrams DA, Nicol T, Zecker S, Krauss N ( 2009): Abnormal cortical processing of the syllable rate of speech in poor readers. J Neurosci 29: 7686-7693.
3. Ahissar E, Nagarajan S, Ahissar M, Protopapas A, Mahncke H, Merzenich, MM ( 2001): Speech comprehension is correlated with temporal response patterns recorded from auditory cortex. Proc Natl Acad Sci USA 98: 13367-13372.
4. Aiken, SJ, Picton TW ( 2008): Human cortical responses to the speech envelope. Ear Hearing 29: 139-157.
5. Bourguignon M, De Tiège X, Op de Beeck M, Ligot N, Paquier P, Van Bogaert P, Goldman S, Hari R, Jousmäki V ( 2011): The pace of prosodic phrasing couples the reader's voice to the listener's cortex. DOI:10.1002/hbm.21442.
6. Correa NM, Eichele T, Adali T, Li YO, Calhoun VD ( 2010): Multi-set canonical correlation analysis for the fusion of concurrent single trial ERP and functional MRI. Neuroimage 50: 1438-1445.
7. Cox DD, Savoy RL ( 2003): Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 19: 261-270.
8. Dehaene S, Le Clec'H G, Cohen L, Poline JB, van de Moortele PF, Le Bihan D ( 1998): Inferring behavior from functional brain images. Nat Neurosci 1: 549-550.
9. Drullman R, Festen JM, Plomp R ( 1994a): Effect of reducing slow temporal modulations on speech reception. J Acoust Soc Am 95: 2670-2680.
10. Drullman R, Festen JM, Plomp R ( 1994b): Effect of temporal envelope smearing on speech reception. J Acoust Soc Am 95: 1053-1064.
11. Friston K, Chu C, Mourão-Miranda J, Hulme O, Rees G, Penny W, Ashburner J ( 2008): Bayesian decoding of brain images. Neuroimage 39: 181-205.
12. Ghebreab S, Smeulders AWM, Adriaans P ( 2007): Predictive modeling of fMRI brain states using functional canonical correlation analysis. Artificial intelligence in medicine. Lecture Notes Comput Sci 4594/2007: 393-397, DOI: 10.1007/978-3-540-73599-1_53.
13. Guimaraes MP, Wong DK, Uy ET, Grosenick L, Suppes P ( 2007): Single-trial classification of MEG recordings. IEEE Trans Biomed Eng 54: 436-443.
14. Hardoon DR, Mourão-Miranda J, Brammer M, Shawe-Taylor J ( 2007): Unsupervised analysis of fMRI data using kernel canonical correlation. Neuroimage 37: 1250-1259.
15. Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, Pietrini P ( 2001): Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293: 2425-2430.
16. Hirsimäki T, Creutz M, Siivola V, Kurimo M, Virpioja S, Pylkkönen J ( 2006): Unlimited vocabulary speech recognition with morph language models applied to Finnish. Comput Speech Lang 20: 515-541.
17. Hotelling H ( 1936): Relations between two sets of variates. Biometrika 28: 321-377.
18. Houtgast T, Steeneken HJM ( 1985): A review of the MTF concept in room acoustics and its use for estimating speech intelligibility in auditoria. J Acoust Soc Am 77: 1069-1077.
19. Jordan MI, Ghahramani Z, Jaakkola TS, Saul LK ( 1999): An introduction to variational methods for graphical models. Machine Learn 37: 183-233.
20. Kay KN, Naselaris T, Prenger RJ, Gallant JL ( 2008): Identifying natural images from human brain activity. Nature 452: 352-355.
21. Klami A, Kaski S ( 2007): Local dependent components. In: Ghahramani Z, editor. Proceedings of the 24th International Conference on Machine Learning (ICML 2007), Madison, WI. Omni Press. pp 425-433.
22. Kriegeskorte N, Simmons WK, Bellgowan PS, Baker CI ( 2009): Circular analysis in systems neuroscience: The dangers of double dipping. Nat Neurosci 12: 535-540.
23. Luo H, Poeppel D ( 2007): Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex. Neuron 54: 1001-1010.
24. Nandy RR, Cordes D ( 2003): Novel nonparametric approach to canonical correlation analysis with applications to low CNR functional MRI data. Magn Reson Med 50: 354-365.
25. Naselaris T, Kay KN, Nishimoto S, Gallant JL ( 2011): Encoding and decoding in fMRI. Neuroimage 56: 400-410.
26. Naselaris T, Prenger RJ, Kay KN, Oliver M, Gallant JL ( 2009): Bayesian reconstruction of natural images from human brain activity. Neuron 63: 902-915.
27. McLachlan GJ, Peel D. 2000. Finite Mixture Models. New York: Wiley.
28. Miyawaki Y, Uchida H, Yamashita O, Sato MA, Morito Y, Tanabe HC, Sadato N, Kamitani Y ( 2008): Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron 60: 915-929.
29. Nourski KV, Reale RA, Oya H, Kawasaki H, Kovach CK, Chen H, Howard MA III, Brugge JF ( 2009): Temporal envelope of time-compressed speech represented in the human auditory cortex. J Neurosci 29: 15564-15574.
30. Rosen S ( 1992): Temporal information in speech: Acoustic, auditory and linguistic aspects. Phil Trans R Soc Lond B 336: 367-373.
31. Shannon R, Zeng F-G, Kamath V, Wygonski J, Ekelid M ( 1995): Speech recognition with primarily temporal cues. Science 270: 303-304.
32. Smith ZM, Delgutte B, Oxenham AJ ( 2002): Chimaeric sounds reveal dichotomies in auditory perception. Nature 416: 87-90.
33. Steeneken HJM, Houtgast T ( 1980): A physical method for measuring speech-transmission quality. J Acoust Soc Am 67: 318-326.
34. Suppes P, Han B, Lu Z-L ( 1997): Brain-wave recognition of words. Proc Natl Acad Sci USA 94: 14965-14969.
35. Suppes P, Han B, Lu Z-L ( 1998): Brain-wave recognition of sentences. Proc Natl Acad Sci USA 95: 15861-15866.
36. Suppes P, Han B, Epelboim J, Lu Z-L ( 1999): Invariance between subjects of brain wave representations of language. Proc Natl Acad Sci USA 96: 12953-12958.
37. Taulu S, Simola J ( 2006): Spatiotemporal signal space separation method for rejecting nearby interference in MEG measurements. Phys Med Biol 51: 1759-1768.
38. Taulu S, Simola J, Kajola M ( 2004): MEG recordings of DC fields using the signal space separation method (SSS). Neurol Clin Neurophysiol 2004: 35.
39. Thirion B, Duchesnay E, Hubbard E, Dubois J, Poline JB, Lebihan D, Dehaene S ( 2006): Inverse retinotopy: Inferring the visual content of images from brain activation patterns. Neuroimage 33: 1104-1116.
40. Viinikanoja J, Klami A, Kaski S ( 2010): Variational Bayesian mixture of robust CCA models. In: Balcázar JL, et al., editors. Machine Learning and Knowledge Discovery in Databases, European Conference. Berlin, Springer. pp 370-385.
41. Wang C ( 2007): Variational Bayesian approach to canonical correlation analysis. IEEE Trans Neural Netw 18: 905-910.
42. Ylipaavalniemi J, Savia E, Malinen S, Hari R, Vigário R, Kaski S ( 2009): Dependencies between stimuli and spatially independent fMRI sources: Towards brain correlates of natural stimuli. Neuroimage 48: 176-185.
43. Zumer JM, Brookes MJ, Stevenson CM, Francis ST, Morris PG ( 2010): Relating BOLD fMRI and neural oscillations through convolution and optimal linear weighting. Neuroimage 49: 1479-1489.