Audiovisual prosody and feeling of knowing

Journal of Memory and Language

Volumn 53, Issue 1, 2005, Pages 81-94

  Swerts, Marc ^a   Krahmer, Emiel ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

Audiovisual prosody; Facial expressions; Feeling of another's knowing; Feeling of knowing; Question answering; Speech perception; Speech production; Tip of the tongue

Indexed keywords

EID: 20444401897     PISSN: 0749596X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jml.2005.02.003     Document Type: Article

References (52)

1. J. Andersen Cognitive psychology and its implications 5th ed 1999 Worth Publishing London
2. M. Argyle & M. Cook Gaze and mutual gaze 1976 Cambridge University Press Cambridge
3. P. Barkhuysen E. Krahmer & M. Swerts Problem detection in human-machine interactions based on facial expressions of users Speech Communication 45 2005 343-359
4. C. Benoît T. Guiard-Marigny B. Le Goff & A. Adjoudani Which components of the face do humans and machines best speechread? In D. Stork M. Hennecke (Eds.) Speechreading by humans and machines: Models, systems, and applications 1996 Springer-Verlag New York 315-328
5. D. Bolinger Intonation and its parts 1985 Edward Arnold London
6. S.E. Brennan & M. Williams The feeling of another's knowing: Prosody and filled pauses as cues to listeners about the metacognitive states of speakers Journal of Memory and Language 34 1995 383-398
7. D. Bugenthal J. Kaswan L. Love & M. Fox Child versus adult perception of evaluative messages in verbal, vocal, and visual channels Developmental Psychology 2 1970 367-375
8. H. Clark Using language 1996 Cambridge University Press Cambridge
9. H. Clark & J. Fox Tree Using uh and um in spontaneous speech Cognition 84 2002 73-111
10. H. Clark & M. Krych Speaking while monitoring addressees for understanding Journal of Memory and Language 50 2004 62-81
11. A. Cruttenden Intonation 1986 Cambridge University Press Cambridge
12. B. de Gelder & J. Vroomen The perception of emotions by ear and by eye Cognition and Emotion 14 3 2000 289-311
13. P. Ekman About brows: Emotional and conversational signals In M. von Cranach K. Foppa W. Lepenies D. Plog (Eds.) Human ethology 1979 Cambridge University Press Cambridge 169-202
14. P. Ekman Facial expressions In T. Dalgleish T. Power (Eds.) The handbook of cognition and emotion 1999 John Wiley & Sons Ltd Sussex, UK 301-320
15. P. Ekman & W.V. Friesen The facial acting coding system 1978 Consulting Psychologists' Press Palo Alto
16. Farah, M.J. (2000). The neural bases of mental imagery. In M. Gazzaniga (Ed.), The cognitive neurosciences (2nd ed.). (pp. 965-974). Cambridge: MIT Press
17. D. Frick-Horbury The use of hand gestures as self-generated cues for recall of verbally associated targets American Journal of Psychology 115 2002 1-20
18. C. Gale & A. Monk Where am I looking? The accuracy of video-mediated gaze awareness Perception & Psychophysics 62 2000 586-595
19. R. Geluykens Intonation and speech act type. An experimental approach to rising intonation in declaratives Journal of Pragmatics 11 1987 483-494
20. A. Glenberg J. Schroeder & D. Robertson Averting gaze disengages the environment and facilitates remembering Memory & Cognition 26 1998 651-658
21. E. Goffman Interaction ritual: Essays on face to face behavior 1967 Doubleday Garden City, NY
22. M.H. Goodwin & C. Goodwin Gesture and coparticipation in the activity of searching for a word Semiotica 62 1986 51-75
23. Z. Griffin Gaze durations during speech reflect word selection and phonological encoding Cognition 82 2001 1-14
24. J.T. Hart Memory and the feeling-of-knowing experience Journal of Educational Psychology 56 1965 208-216
25. U. Hess A. Kappas & K. Scherer Multichannel communication of emotion: Synthetic signal production In K. Scherer (Ed.) Facets of emotion: Recent research 1988 Erlbaum Hillsdale, NJ 161-182
26. A. Jameson T.O. Nelson R.J. Leonesio & L. Narens The feeling of another person's knowing Journal of Memory and Language 32 1993 320-335
27. T. Jordan & P. Sergeant Effects of distance on visual and audio-visual speech recognition Language and Speech 43 1 2000 107-124
28. Keating, P., Baroni, M., Mattys, S., Scarborough, R., Alwan, A., & Auer, E., et al. (2003). Optical phonetics and visual perception of lexical and phrasal stress in English. In Proceedings of the International Conference of Phonetic Sciences (ICPhS) (pp. 2071-2074), Barcelona, Spain
29. A. Kendon Do gestures communicate? A review Research on Language and Social Interaction 27 1994 175-200
30. H. Kikyo K. Ohki & Y. Miyashita Neural correlates for feeling-of-knowing: An fMRI parametric analysis Neuron 36 1 2002 177-186
31. Kohlrausch, A. & van de Par, S. (2005). Audio-visual interaction In Blauert, J. (Ed.), Communication acoustics. Heidelberg: Springer (in press)
32. A. Koriat How do we know what we know. The accessibility account of the feeling of knowing Psychological Review 100 1993 609-637
33. E. Krahmer & M. Swerts More about brows In ZS. Ruttkay C. Pelachaud (Eds.) From brows to trust: Evaluating embodied conversational agents 2004 Kluwer Academic Press Dordrecht 191-216
34. R. Krauss Y. Chen & P. Chawla Nonverbal behavior and nonverbal communication: What do conversational hand gestures tell us Advances in Experimental Social Psychology 28 1996 389-450
35. R. Kraut & R. Johnson Social and emotional messages of smiling. An ethological approach Journal of Personality and Social Psychology 37 1979 1539-1553
36. D.R. Ladd Intonational phonology 1996 Cambridge University Press Cambridge
37. B. Lawrence J. Myerson H. Ooknk & R. Abrams The effects of eye and limb movements on working memory Memory 9 2001 433-444
38. D. Massaro & P. Egan Perceiving affect from the voice and the face Psychonomic Bulletin and Review 3 1996 215-221
39. H. McGurk & J. MacDonald Hearing lips and seeing voices Nature 264 1976 746-748
40. D. McNeill Hand and mind: What gestures reveal about thought 1992 Chicago University Press Chicago
41. A. Mehrabian & S. Ferris Inference of attitudes from nonverbal communication in two channels Journal of Consulting Psychology 31 1967 248-252
42. B. Morgan Question melodies in American English American Speech 2 1953 181-191
43. E. Morsella & R. Krauss The role of gestures in spatial working memory and speech The American Journal of Psychology 117 2004 411-424
44. K. Munhall J. Jones D. Callan T. Kuratate & E. Vatikiotis-Bateson Visual prosody and speech intelligibility Psychological Science 15 2004 133-137
45. T. Nelson Consciousness and metacognition American psychologist 51 1996 102-116
46. L. Reder & F. Ritter What determines initial feeling of knowing? Familiarity with question terms, not with the answer Journal of Experimental Psychology: Learning, Memory and Cognition 18 1992 435-452
47. M. Sabbagh & D. Baldwin Learning words from Knowledgeable versus Ignorant Speakers: Links between preschoolers' Theory of Mind and Semantic Development Child Development 72 4 2001 1054-1070
48. V.L. Smith & H.H. Clark On the course of answering questions Journal of Memory and Language 32 1993 25-38
49. R. Srinivasan & D. Massaro Perceiving prosody from the face and voice: Distinguishing statements from echoic questions in English Language and Speech 46 2003 1-22
50. W. Sumby & I. Pollack Visual contribution to speech intelligibility Journal of the Acoustical Society of America 26 1954 212-215
51. Swerts M., & Krahmer, E. (2004). Congruent and incongruent audiovisual cues to prominence. In Proceedings of Speech Prosody (pp. 271-274). Nara, Japan
52. A. Walker & W. Grolnick Discrimination of vocal expressions by young infants Infant Behavior and Development 6 1983 491-498