The effect of visual context on the identification of ambiguous environmental sounds

Acta Psychologica

Volumn 131, Issue 2, 2009, Pages 110-119

  Özcan, Elif ^a   Egmond, René van ^a  

^a FACULTY OF INDUSTRIAL DESIGN ENGINEERING   (Netherlands)

Author keywords

Ambiguity; Audio visual interactions; Environmental sounds; Product sounds; Sound identification; Visual context

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; ENVIRONMENT; FEMALE; HEARING; HUMAN; MALE; MEMORY; PHOTOSTIMULATION; PHYSIOLOGY; REACTION TIME; RECOGNITION; SOUND; SOUND DETECTION; VISION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; ENVIRONMENT; FEMALE; HUMANS; MALE; MEMORY; PHOTIC STIMULATION; REACTION TIME; RECOGNITION (PSYCHOLOGY); SOUND; SOUND LOCALIZATION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 67349201051     PISSN: 00016918     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.actpsy.2009.03.007     Document Type: Article

References (60)

1. Aldrich, K., Hellier, E., & Edworthy, J. (2009). What determines auditory similarity: The effect of stimulus group and methodology. Quarterly Journal of Experimental Psychology.
2. Antes J.R., Penland J.G., and Metzger R.L. Processing global information in briefly presented pictures. Psychological Research 43 3 (1981) 277-292
3. Ballas J.A. Common factors in the identification of an assortment of brief everyday sounds. Journal of Experimental Psychology: Human Perception and Performance 19 2 (1993) 250-267
4. Ballas J.A., and Mullins T. Effects of context on the identification of everyday sounds. Human Performance 4 3 (1991) 199-219
5. Bar M. Visual objects in context. Nature Reviews: Neuroscience 5 8 (2004) 617-629
6. Bar M., and Aminoff E. Cortical analysis of visual context. Neuron 38 2 (2003) 347-358
7. Bar M., and Ullman S. Spatial context in recognition. Perception 25 3 (1996) 343-352
8. Barsalou L.W. Ad hoc categories. Memory and Cognition 11 3 (1983) 211-227
9. Barsalou L.W. Perceptual symbol systems. Behavioral and Brain Sciences 22 (1999) 577-609
10. Barsalou L.W. Grounded cognition. Annual Review of Psychology 59 (2008) 617-645
11. Bartlett J.C. Remembering environmental sounds: Role of verbalization at input. Memory and Cognition 5 4 (1977) 404-414
12. Biederman I. On the semantics of a glance at a scene. In: Kubovy M., and Pomerantz J.R. (Eds). Perceptual organization (1981), Lawrence Erlbaum, New York 213-263
13. Bonitz V.S., and Gordon R.D. Attention to smoking-related and incongruous objects during scene viewing. Acta Psychologica 129 (2008) 255-263
14. Borghi A. Object concepts and action: Extracting affordances from objects parts. Acta Psychologica 115 (2004) 69-96
15. Cabe P., and Pittenger J.B. Human sensitivity to acoustic information from vessel filling. Journal of Experimental Psychology: Human Perception and Performance 26 1 (2000) 313-324
16. Chaigneau S.E., Barsalaou L.W., and Zamani M. Situational information contributes to object categorization and inference. Acta Psychologica 130 (2009) 81-94
17. Chiu C.Y.P., and Schacter D.L. Auditory priming for nonverbal information: Implicit and explicit memory for environmental sounds. Consciousness and Cognition 4 4 (1995) 440-458
18. Cummings A., Ceponiene R., Koyama A., Saygin A.P., Townsend J., and Dick F. Auditory semantic networks for words and natural sounds. Brain Research 1115 1 (2006) 92-107
19. Davenport J.L., and Potter M.C. Scene consistency in object and background perception. Psychological Science 15 8 (2004) 559-564
20. de Graef P., Christiaens D., and d'Ydewalle G. Perceptual effects of scene context on object identification. Psychological Research 52 4 (1990) 317-329
21. de Graef P., Lauwereyns J., and Verfaillie K. Attentional orienting and scene semantics (Psych. Rep. Nr. 268) (2000), University of Leuven, Laboratory of Experimental Psychology, Leuven
22. de Wilde E., Vanoverberghe V., Storms G., and de Boeck P. The instantiation principle re-evaluated. Memory 11 6 (2003) 533-548
23. Ecker A.J., and Heller L.M. Auditory-visual interactions in the perception of a ball's path. Perception 34 1 (2005) 59-75
24. Edworthy J., and Hards R. Learning auditory warnings: The effects of sound type, verbal labeling and imagery on the identification of alarm sounds. International Journal of Industrial Ergonomics 24 (1999) 603-618
25. Fabiani M., Kazmerski V.A., Cycowicz Y.M., and Friedman D. Naming norms for brief environmental sounds: Effects of age and dementia. Psychophysiology 33 4 (1996) 462-475
26. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience 11 5 (1999) 473-490
27. Gordon R.D. Attentional allocation during the perception of scenes. Journal of Experimental Psychology: Human Perception and Performance 30 4 (2004) 760-777
28. Hasegawa T., Matsuki K., Ueno T., Maeda Y., Matsue Y., Konishi Y., et al. Learned audio-visual cross-modal associations in observed piano playing activate the left planum temporale. An fMRI study. Cognitive Brain Research 20 3 (2004) 510-518
29. Heit E., and Barsalou L.W. The instantiation principle in natural categories. Memory 4 4 (1996) 413-451
30. Henderson J.M., and Hollingworth A. High-level scene perception. Annual Review of Psychology 50 (1999) 243-271
31. Hermes, D. J. (1998). Auditory material perception (annual progress report no. 33): IPO.
32. Hollingworth A., and Henderson J.M. Does consistent scene context facilitate object perception?. Journal of Experimental Psychology: General 127 4 (1998) 398-415
33. Hollingworth A., and Henderson J.M. Object identification is isolated from scene semantic constraint: Evidence from object type and token discrimination. Acta Psychologica 102 2-3 (1999) 319-343
34. Jescheniak J.D., Hantsch A., and Schriefers H. Context effects on lexical choice and lexical activation. Journal of Experimental Psychology: Learning, Memory and Cognition 31 5 (2005) 905-920
35. Jolicoeur P., Gluck M.A., and Kosslyn S.M. Pictures and names: Making the connection. Cognitive Psychology 16 2 (1984) 243-275
36. Kubovy M., and van Valkenburg D. Auditory and visual objects. Cognition 80 1-2 (2001) 97-126
37. Kunkler-Peck A.J., and Turvey M.T. Hearing shape. Journal of Experimental Psychology: Human Perception and Performance 26 1 (2000) 279-294
38. Marcell M.E., Borella D., Greene M., Kerr E., and Rogers S. Confrontation naming of environmental sounds. Journal of Clinical and Experimental Neuropsychology 22 6 (2000) 830-864
39. McCauley C., Parmelee C.M., Sperber R.D., and Carr T.H. Early extraction of meaning from pictures and its relation to conscious identification. Journal of Experimental Psychology: Human Perception and Performance 6 2 (1980) 265-276
40. McGurk H., and MacDonald J. Hearing lips and seeing voices. Nature 264 5588 (1976) 746-748
41. Medin D.L., Lynch E.B., and Solomon K.O. Are there kinds of concepts?. Annual Review of Psychology 51 (2000) 121-147
42. Mervis C.B., and Rosch E. Categorization of natural objects. Annual Review of Psychology 32 (1981) 89-115
43. Orgs G., Lange K., Dombrowski J.H., and Heil M. Conceptual priming for environmental sounds and words: An ERP study. Brain and Cognition 62 3 (2006) 267-272
44. Özcan, E., & van Egmond, R. (2005). Characterizing descriptions of product sounds. In Proceedings of the international conference on auditory display, Ireland (Vol. 11, pp. 55-60).
45. Özcan E., and van Egmond R. Memory for product sounds: The effect of sound and label type. Acta Psychologica 126 3 (2007) 196-215
46. Özcan, E., & van Egmond, R. (2007b). How well do we identify product sounds? In Proceedings of the international conference on auditory display, Canada (Vol. 13, pp. 234-241).
47. Özcan, E., van Egmond, R., Jacobs, J., & Ballas, J. A. (submitted for publication). Bases for categorization and identification of product sounds.
48. Paivio A. Dual coding theory: Retrospect and current status. Canadian Journal of Psychology - Revue Canadienne De Psychologie 45 3 (1991) 255-287
49. Palmer S.E. The effects of contextual scenes on the identification of objects. Memory and Cognition 3 5 (1975) 519-526
50. Palmer S., Rosch E., and Chase P. Canonical perspective and the perception of objects. In: Long J., and Baddeley A. (Eds). Attention and performance IX (1981), Lawrence Erlbaum, Hillsdale 135-151
51. Rosch E.H. Principles of categorization. In: Rosch E.H., and Lloyd B.B. (Eds). Cognition and categorization (1978), Lawrence Erlbaum Associates, Hillsdale, NJ 27-48
52. Saldaña H.M., and Rosenblum L.D. Visual influences on auditory pluck and bow judgments. Perception and Psychophysics 54 3 (1993) 406-416
53. Shimojo S., and Shams L. Sensory modalities are not separate modalities: Plasticity and interactions. Current Opinion in Neurobiology 11 4 (2001) 505-509
54. In: Spence C., and Driver J. (Eds). Crossmodal space and crossmodal attention (2004), Oxford University Press, Oxford
55. Stuart G.P., and Jones D.M. Priming the identification of environmental sounds. Quarterly Journal of Experimental Psychology 48A 3 (1995) 741-761
56. Te Linde J. Pictures and words in semantic decisions. In: Yuille J.C. (Ed). Imagery, memory and cognition (1983), Lawrence Erlbaum, New Jersey 117-130
57. Thompson V.A., and Paivio A. Memory for pictures and sounds: Independence of auditory and visual codes. Canadian Journal of Experimental Psychology 48 3 (1994) 380-398
58. Tversky B., and Hemenway K. Objects, parts, and categories. Journal of Experimental Psychology: General 113 2 (1984) 169-197
59. Vanderveer N.J. Confusion errors in identification of environmental sounds. Journal of the Acoustical Society of America 65 (1979) S60
60. Yost W.A. Auditory image perception and analysis: The basis for hearing. Hearing Research 56 1-2 (1991) 8-18