Sentence processing in the visual and auditory modality: Do comma and prosodic break have parallel functions?

Brain Research

Volumn 1224, Issue , 2008, Pages 102-118

  Kerkhofs, Roel ^a   Vonk, Wietske ^a,b   Schriefers, Herbert ^c   Chwilla, Dorothee J ^c,d  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^b MAX PLANCK INSTITUTE FOR PSYCHOLINGUISTICS   (Netherlands)

^c RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^d RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

CPS; ERP; LAN; Language processing; N400; P600; Prosodic break

Indexed keywords

ADULT; ARTICLE; AUDITORY CORTEX; EVENT RELATED POTENTIAL; FEMALE; HUMAN; MALE; NORMAL HUMAN; PRIORITY JOURNAL; PROCESSING; VISION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; LANGUAGE; LANGUAGE TESTS; MALE; PHOTIC STIMULATION; REACTION TIME; READING; SPEECH PERCEPTION; VERBAL BEHAVIOR; VISUAL PERCEPTION;

EID: 47649093076     PISSN: 00068993     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainres.2008.05.034     Document Type: Article

References (56)

1. Baayen H., Piepenbrock R., and Van Rijn H. The CELEX lexical database. CD-ROM (1993)
2. Balcony M., and Pozzoli U. Comprehending semantic and grammatical violations in Italian. N400 and P600 comparison with visual and auditory stimuli. J. Psycholinguist. Res. 35 (2005) 71-98
3. Bögels, S., Schriefers, H., Vonk, W., Chwilla, D.J., Kerkhofs, R., submitted for publication. The Interplay between prosody and syntax in sentence processing: the case of subject- and object-control verbs.
4. Cabeza R., and Nyberg L. Imaging cognition II: an empirical review of 275 PET and fMRI studies. J. Cogn. Neurosci. 12 (2000) 1-4
5. Chwilla D.J., Hagoort P., and Brown C.M. The mechanism underlying backward priming in a lexical decision task: spreading activation versus semantic matching. Q. J. Exp. Psychol. 51 (1998) 531-560
6. Coulson S., King J.W., and Kutas M. ERPs and domain specificity: beating a straw horse. Lang. Cogn. Processes 13 (1998) 653-672
7. Fodor J.D. Prosodic disambiguation in silent reading. In: Hirotani M. (Ed). Proceedings of NELS 32 (113-132) (2002), GLSA, Amherst, MA
8. Frazier L. Syntactic processing: evidence from Dutch. Nat. Lang. Linguist. Theory 5 (1987) 519-559
9. Friederici A.D. The time course of syntactic activation during language processing: a model based on neuropsychological and neurophysiological data. Brain Lang. 50 (1995) 259-281
10. Friederici A.D. Towards a neural basis of auditory sentence processing. Trends Cogn. Sci. 6 (2002) 78-84
11. Friederici A.D., Hahne A., and Mecklinger A. Temporal structure of syntactic parsing: early and late event-related brain potential effects. J. Exp. Psychol. Learn. 22 (1996) 1219-1248
12. Friederici A.D., Hahne A., and Saddy D. Distinct neurophysiological patterns reflecting aspects of syntactic complexity and syntactic repair. J. Psycholinguist. Res. 31 (2002) 45-63
13. Friederici A.D., Pfeifer E., and Hahne A. Event-related brain potentials during natural speech processing: effects of semantic, morphological and syntactic violations. Cogn. Brain Res. 1 (1993) 183-192
14. Friederici A.D., Steinhauer K., and Frisch S. Lexical integration: sequential effects of syntactic and semantic information. Mem. Cogn. 27 (1999) 438-453
15. Geerts G., Haeseryn W.W., de Rooij J., and van den Toorn M.C. Algemene Nederlandse Spraakkunst [General grammar and usage of Dutch] (1984), Wolters-Noordhof, Groningen
16. Gussenhoven C. Transcription of Dutch intonation. In: Jun S. (Ed). Prosodic typology and transcription: a unified approach (2004), Oxford University Press, Oxford
17. Hagoort P., and Brown C.M. ERP effects of listening to speech: semantic ERP effects. Neuropsychologia 38 (2000) 1518-1530
18. Hagoort P., and Brown C.M. ERP effects of listening to speech compared to reading: the P600/SPS to syntactic violations in spoken sentences and rapid serial visual presentation. Neuropsychologia 38 (2000) 1531-1549
19. Hagoort P., Brown C.M., and Osterhout L. The neural architecture of syntactic processing. In: Brown C.M., and Hagoort P. (Eds). The neurocognition of language (1999), Oxford University Press, Oxford
20. Hahne A., and Friederici A.D. Differential task effects on semantic and syntactic processes as revealed by ERPs. Cogn. Brain Res. 13 (2002) 339-356
21. Hoeks J.C.J., Vonk W., and Schriefers H. Processing coordinated structures in context: the effect of topic-structure on ambiguity resolution. J. Mem. Lang. 46 (2002) 99-119
22. Hoeks, J.C.J., Hendriks, P., Vonk, W., Brown, C.M., Hagoort, P., 2005. Processing the noun phrase versus subject coordination ambiguity: thematic information does not completely eliminate processing difficulty. Q. J. Exp. Psychol.
23. Holcomb P.J., and Neville H.J. The electrophysiology of spoken sentence processing. Psychobiology 19 (1991) 286-300
24. Ischebeck A.K., Friederici A.D., and Alter K. Processing prosodic boundaries in natural and hummed speech: an fMRI study. Cereb. Cortex 18 (2008) 541-552
25. Isel F., Alter K., and Friederici A.D. Influence of prosodic information on the processing of split particles: ERP evidence from spoken German. J. Cogn. Neurosci. 17 (2005) 154-167
26. Kaan E., and Swaab T.Y. Repair, revision, and complexity in syntactic analysis: an electrophysiological differentiation. J. Cogn. Neurosci. 15 (2003) 98-100
27. Kerkhofs R., Vonk W., Schriefers H., and Chwilla D.J. Discourse, syntax, and prosody: the brain reveals an immediate interaction. J. Cogn. Neurosci. 19 (2007) 1421-1434
28. Kim A., and Osterhout L. The independence of combinatory semantic processing: evidence from event-related potentials. J. Mem. Lang. 52 (2005) 205-225
29. King J.W., and Kutas M. Who did what and when? Using word and clause-level ERPs to monitor working memory usage in reading. J. Cogn. Neurosci. 7 (1995) 376-395
30. Knösche T.R., Neuhaus C., Haueisen J., Alter K., Maess B., Witte O.W., and Friederici A.D. Perception of phrase structure in music. Hum. Brain Mapp. 24 (2005) 259-273
31. Kutas M., and Hillyard S.A. Brain potentials reflect word expectancy and semantic association during reading. Nature 307 (1984) 161-163
32. Kutas M., and Schmitt B.M. Language in μV. In: Banich M.T., and Mack M. (Eds). Mind, brain, and language: multidisciplinary perspectives (2003), Erlbaum, Mahwah
33. McKinnon R., and Osterhout L. Constraints on movement phenomena in sentence processing: evidence from event-related brain potentials. Lang. Cogn. Processes 11 (1996) 495-523
34. Mietz A., Toepel U., Ischebeck A., and Alter K. Inadequate and infrequent are not alike: ERPs to deviant prosodic patterns in spoken language comprehension. Brain Lang. 104 (2008) 159-169
35. Neville H., Nicol J.L., Barss A., Forster K.I., and Garrett M.F. Syntactically based sentence processing classes: evidence from event-related brain potentials. J. Cogn. Neurosci. 3 (1991) 151-165
36. Oldfield R.C. The assessment and analysis of handedness: Edinburgh inventory. Neuropsychologia 9 (1971) 97-113
37. Osterhout L., and Holcomb P.J. Event-related potentials elicited by syntactic anomaly. J. Mem. Lang. 31 (1992) 785-806
38. Osterhout L., and Holcomb P.J. Event-related potentials and syntactic anomaly: evidence of anomaly detection during the perception of continuous speech. Lang. Cogn. Processes 8 (1993) 413-438
39. Osterhout L., Holcomb P.J., and Swinney D.A. Brain potentials elicited by garden-path sentences: evidence of the application of verb information during parsing. J. Exp. Psychol. Learn. 20 (1994) 786-803
40. Osterhout L., McLaughlin J., Kim A., and Inoue K. Sentences in the brain: event-related potentials as real-time reflections of sentence comprehension and language learning. In: Carreiras M., and Clifton Jr. C. (Eds). The on-line study of sentence comprehension: eyetracking, ERP, and beyond (2004), Psychology Press, East Sussex
41. Pannekamp A., Toepel U., Alter K., Hahne A., and Friederici A.D. Prosody-driven sentence processing: an event-related brain potential study. J. Cogn. Neurosci. 17 (2005) 407-421
42. Renkema J. Schrijfwijzer [Guidelines for writing: Handbook for transparent language use] (2004), SDU, Den Haag
43. Rösler F., Friederici A.D., Pötz P., and Hahne A. Event related brain potentials while encountering semantic and syntactic constraint violation. J. Cogn. Neurosci. 5 (1993) 345-362
44. Sanders E., and Metselaar K. Stijlboek NRC Handelsblad (2000), Van Dale Lexicografie, Utrecht
45. Schlesewsky M., and Bornkessel I. Context sensitive neural responses to conflict resolution: electrophysiological evidence from subject-object ambiguities in language comprehension. Brain Res. (2006) 139-157
46. Shattuck-Hufnagel S., and Turk A.E. A prosody tutorial for investigators of auditory sentence processing. J. Psycholinguist. Res. 25 (1996) 193-247
47. Steinhauer K. Electrophysiological correlates of prosody and punctuation. Brain Lang. 86 (2003) 142-164
48. Steinhauer K., and Friederici A.D. Prosodic boundaries, comma rules, and brain responses: the closure positive shift in ERPs as a universal marker for prosodic phrasing in listeners and readers. J. Psycholinguist. Res. 30 (2001) 267-295
49. Steinhauer K., Alter K., and Friederici A.D. Brain potentials indicate immediate use of prosodic cues in natural speech processing. Nat. Neurosci. 2 (1999) 191-196
50. Toepel U., Pannekamp A., and Alter K. Catching the news: processing strategies in listening to dialogs as measured by ERPs. Behav. Brain Funct. 3 (2007) 53-66
51. van Berkum J.J.A., Brown C.M., and Hagoort P. Early referential context effects in sentence processing: evidence from event-related potentials. J. Mem. Lang. 41 (1999) 147-182
52. van Berkum J.J.A., Hagoort P., and Brown C.M. Semantic integration in sentences and discourse: Evidence from the N400. J. Cogn. Neurosci. 11 (1999) 657-671
53. van Berkum J.J.A., Zwitserlood P., Hagoort P., and Brown C.M. When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect. Cogn. Brain Res. 17 (2003) 701-718
54. van Herten M., Kolk H.H.J., and Chwilla D.J. An ERP study of P600 effects elicited by semantic anomalies. Cogn. Brain Res. 22 (2005) 241-255
55. Vasey M.W., and Thayer J.F. The continuing problem of false positives in repeated measures ANOVA in psychophysiology: a multivariate solution. Psychophysiology 24 (1987) 479-486
56. Vos S.H., Gunter T.C., Kolk H.H.J., and Mulder G. Working memory constraints on syntactic processing: an electrophysiological investigation. Psychophysiology 38 (2001) 41-63