Keeping timbre in mind: Working memory for complex sounds that can't be verbalized

Journal of Experimental Psychology: Human Perception and Performance

Volumn 39, Issue 2, 2013, Pages 399-412

  Golubock, Jason L ^a   Janata, Petr ^b  

^a University of California ^*  (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Auditory object; Capacity; Complexity; Decay; Short term memory

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; ATTENTION; AUDITORY STIMULATION; FEMALE; HEARING; HUMAN; MALE; SHORT TERM MEMORY; SOUND DETECTION;

ACOUSTIC STIMULATION; ADOLESCENT; ATTENTION; FEMALE; HUMANS; LOUDNESS PERCEPTION; MALE; MEMORY, SHORT-TERM; PITCH DISCRIMINATION; SOUND SPECTROGRAPHY; YOUNG ADULT;

EID: 84880983366     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0029720     Document Type: Article

References (94)

1. Aboitiz, F. (2012). Gestures, vocalizations and memory in language origins. [Review]. Frontiers in Evolutionary Neuroscience, 4. doi:10.3389/ fnevo.2012.00002
2. Alvarez, G. A., & Cavanagh, P. (2004). The capacity of visual short-term memory is set both by visual information load and by number of objects. Psychological Science, 15, 106-111. doi:10.1111/j.0963-7214.2004 .01502006.x
3. Awh, E., Barton, B., & Vogel, E. K. (2007). Visual working memory represents a fixed number of items regardless of complexity. Psychological Science, 18, 622-628. doi:10.1111/j.1467-9280.2007.01949.x
4. Baddeley, A. D. (1966). Short-term memory for word sequences as a function of acoustic, semantic and formal similarity. The Quarterly Journal of Experimental Psychology, 18, 362-365. doi:10.1080/ 14640746608400055
5. Baddeley, A. D. (1986). Working memory. Oxford, UK: Clarendon Press.
6. Baddeley, A. D. (1992). Working memory. Science, 255, 556-559. doi: 10.1126/science.1736359
7. Baddeley, A. D., & Lewis, V. (1984). When does rapid presentation enhance digit span?. Bulletin of the Psychonomic Society, 22, 403-405.
8. Baddeley, A. D., Thomson, N., & Buchanan, M. (1975). Word length and structure of short-term-memory. Journal of Verbal Learning and Verbal Behavior, 14, 575-589. doi:10.1016/S0022-5371(75)80045-4
9. Broadbent, D. E. (1958). Perception and communication. Elmsford, NY: Pergamon Press. doi:10.1037/10037-000
10. Broadbent, D. E. (1975). The magic number seven after fifteen years. In A. Kennedy & A. Wilkes (Eds.), Studies in long-term memory (pp. 3-18). New York, NY: Wiley.
11. Caclin, A., Brattico, E., Tervaniemi, M., Naatanen, R., Morlet, D., Giard, M. H., & McAdams, S. (2006). Separate neural processing of timbre dimensions in auditory sensory memory. Journal of Cognitive Neuroscience, 18, 1959-1972. doi:10.1162/jocn.2006.18.12.1959
12. Caclin, A., McAdams, S., Smith, B. K., & Winsberg, S. (2005). Acoustic correlates of timbre space dimensions: A confirmatory study using synthetic tones. Journal of the Acoustical Society of America, 118, 471-482. doi:10.1121/1.1929229
13. Chen, Z., & Cowan, N. (2005). Chunk limits and length limits in immediate recall: A reconciliation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 1235-1249. doi:10.1037/0278-7393.31.6.1235
14. Chen, Z., & Cowan, N. (2009). Core verbal working-memory capacity: The limit in words retained without covert articulation. The Quarterly Journal Experimental Psychology, 62, 1420-1429. doi:10.1080/ 17470210802453977
15. Clement, S., Demany, L., & Semal, C. (1999). Memory for pitch versus memory for loudness. Journal of the Acoustical Society of America, 106, 2805-2811. doi:10.1121/1.428106
16. Conrad, R., & Hull, A. J. (1964). Information, acoustic confusion and memory span. British Journal of Psychology, 55, 429-432. doi:10.1111/ j.2044-8295.1964.tb00928.x
17. Copeland, D. E., & Radvansky, G. A. (2001). Phonological similarity in working memory. Memory and Cognition, 29, 774-776. doi:10.3758/ BF03200480
18. Cowan, N. (1984). On short and long auditory stores. Psychological Bulletin, 96, 341-370. doi:10.1037/0033-2909.96.2.341
19. Cowan, N. (1988). Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human informationprocessing system. Psychological Bulletin, 104, 163-191. doi:10.1037/ 0033-2909.104.2.163
20. Cowan, N. (1995). Attention and memory. New York, NY: Oxford University Press.
21. Cowan, N. (2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences, 24, 87-114. doi:10.1017/S0140525X01003922
22. Cowan, N. (2008). What are the differences between long-term, short-term, and working memory? In J.-C. Lacaille, V. F. Castellucci, Wayne S. Sossin, & B. Sylvie (Eds.), Progress in brain research (pp. 323-338). Amsterdam: Elsevier.
23. Cowan, N. (2010). The magical mystery four. Current Directions in Psychological Science, 19, 51-57. doi:10.1177/0963721409359277
24. Cowan, N., & AuBuchon, A. M. (2008). Short-term memory loss over time without retroactive stimulus interference. Psychonomic Bulletin & Review, 15, 230-235. doi:10.3758/PBR.15.1.230
25. Cowan, N., Chen, Z., & Rouder, J. N. (2004). Constant capacity in an immediate serial-recall task: A logical sequel to Miller (1956). Psychological Science, 15, 634-640. doi:10.1111/j.0956-7976.2004.00732.
26. Cowan, N., Day, L., Saults, J. S., Keller, T. A., Johnson, T., & Flores, L. (1992). The role of verbal output time in the effects of word-length on immediate memory. Journal of Memory and Language, 31, 1-17. doi: 10.1016/0749-596X(92)90002-F
27. Cowan, N., Saults, J., & Nugent, L. D. (1997). The role of absolute and relative amounts of time in forgetting within immediate memory: The case of tone-pitch comparisons. Psychonomic Bulletin & Review, 4, 393-397. doi:10.3758/BF03210799
28. Cowan, N., Wood, N. L., Nugent, L. D., & Treisman, M. (1997). There are two word-length effects in verbal short-term memory: Opposed effects of duration and complexity. Psychological Science, 8, 290-295. doi: 10.1111/j.1467-9280.1997.tb00440.x
29. Crowder, R. G. (1989). Imagery for musical timbre. Journal of Experimental Psychology: Human Perception and Performance, 15, 472-478. doi:10.1037/0096-1523.15.3.472
30. Daneman, M., & Carpenter, P. A. (1980). Individual differences in working memory and reading. Journal of Verbal Learning and Verbal Behavior, 19, 450-466. doi:10.1016/S0022-5371(80)90312-6
31. Demany, L., Clement, S., & Semal, C. (2001). Does auditory memory depend on attention? In D. J. Breebaart, A. J. M. Houtsma, A. Kohlrausch, V. F. Prijs, & R. Schoonhoven (Eds.), Physiological and psychophysical bases of auditory function (pp. 461-467). Maastricht, The Netherlands: Shaker.
32. Demany, L., Montandon, G., & Semal, C. (2004). Pitch perception and retention: Two cumulative benefits of selective attention. Perception and Psychophysics, 66, 609-617. doi:10.3758/BF03194905
33. Demany, L., Trost, W., Serman, M., & Semal, C. (2008). Auditory change detection: Simple sounds are not memorized better than complex sounds. Psychological Science, 19, 85-91. doi:10.1111/j.1467-9280.2008 .02050.x
34. Deutsch, D. (1970). Tones and numbers: Specificity of interference in short-term memory. Science, 168, 1604-1605.
35. Durlach, N. I., & Braida, L. D. (1969). Intensity perception. I. Preliminary theory of intensity resolution. Journal of the Acoustical Society of America, 46, 372-383. doi:10.1121/1.1911699
36. Dyson, B. J., & Ishfaq, F. (2008). Auditory memory can be object based. Psychonomic Bulletin & Review, 15, 409-412. doi:10.3758/PBR.15.2 .409
37. Egan, J. P., Schulman, A. I., & Greenberg, G. Z. (1961). Memory for waveform and time uncertainty in auditory detection. Journal of the Acoustical Society of America, 33, 779-781. doi:10.1121/1.1908797
38. Ericsson, K. A., & Kintsch, W. (1995). Long-term working memory. Psychological Review, 102, 211-245. doi:10.1037/0033-295X .102.2.211
39. Eriksen, C. W., & Johnson, H. J. (1964). Storage + decay characteristics of nonattended auditory-stimuli. Journal of Experimental Psychology, 68, 28-36. doi:10.1037/h0048460
40. Fukuda, K., Awh, E., & Vogel, E. K. (2010). Discrete capacity limits in visual working memory. Current Opinion in Neurobiology, 20, 177-182. doi:10.1016/j.conb.2010.03.005
41. Giard, M. H., Lavikainen, J., Reinikainen, K., Perrin, F., & Naatanen, R. (1995). Separate representation of stimulus frequency, intensity, and duration in auditory sensory memory: An event-related potential and dipolemodel analysis. Journal of Cognitive Neuroscience, 7, 133-143. doi:10.1162/jocn.1995.7.2.133
42. Gobet, F., & Clarkson, G. (2004). Chunks in expert memory: Evidence for the magical number four . . . or is it two? Memory, 12, 732-747. doi:10.1080/09658210344000530
43. Greene, R. L. (1988). Stimulus suffix effects in recognition memory. Memory and Cognition, 16, 206-209. doi:10.3758/BF03197753
44. Greene, R. L., & Samuel, A. G. (1986). Recency and suffix effects in serial recall of musical stimuli. Journal of Experimental Psychology: Learning, Memory, and Cognition, 12, 517-524. doi:10.1037/0278-7393.12.4 .517
45. Grey, J. M. (1977). Multidimensional perceptual scaling of musical timbres. Journal of the Acoustical Society of America, 61, 1270-1277. doi:10.1121/1.381428
46. Griffiths, T. D., & Warren, J. D. (2004). What is an auditory object?. Nature Reviews Neuroscience, 5, 887-892. doi:10.1038/nrn1538
47. Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007). Topics in semantic representation. Psychological Review, 114, 211-244. doi: 10.1037/0033-295X.114.2.211
48. Hall, M., & Wieberg, K. (2003). Illusory conjunctions of musical pitch and timbre. Acoustics Research Letters Online, 4, 65-70.
49. Handel, S. (1995). Timbre perception and auditory object identification. In B. C. J. Moore (Ed.), Hearing (pp. 425-461). San Diego, CA: Academic Press. doi:10.1016/B978-012505626-7/50014-5
50. Harris, J. D. (1952). The decline of pitch discrimination with time. Journal of Experimental Psychology: Human Learning and Memory, 43, 96-99.
51. Hecht, L. N., Abbs, B., & Vecera, S. P. (2008). Auditory object-based attention. Visual Cognition, 16, 1109-1114.
52. Hickok, G., Buchsbaum, B., Humphries, C., & Muftuler, T. (2003). Auditory-motor interaction revealed by fMRI: Speech, music, and working memory in area Spt. Journal of Cognitive Neuroscience, 15, 673-682.
53. Hickok, G., & Poeppel, D. (2007). The cortical organization of speech processing. Nature Reviews. Neuroscience, 8, 393-402.
54. Hulme, C., Maughan, S., & Brown, G. (1991). Memory for familiar and unfamiliar words-Evidence for a long-term-memory contribution to short-term-memory span. Journal of Memory and Language, 30, 685-701. doi:10.1016/0749-596X(91)90032-F
55. Kaernbach, C. (2004). The memory of noise. Experimental Psychology, 51, 240-248. doi:10.1027/1618-3169.51.4.240
56. Kaernbach, C., & Schlemmer, K. (2008). The decay of pitch memory during rehearsal. Journal of the Acoustical Society of America, 123, 1846-1849. doi:10.1121/1.2875365
57. Keller, T. A., & Cowan, N. (1994). Developmental increase in the duration of memory for tone pitch. Developmental Psychology, 30, 855-863. doi:10.1037/0012-1649.30.6.855
58. Keller, T. A., Cowan, N., & Saults, J. S. (1995). Can auditory memory for tone pitch be rehearsed. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21, 635-645. doi:10.1037/0278-7393.21.3.635
59. Koelsch, S., Schulze, K., Sammler, D., Fritz, T., Muller, K., & Gruber, O. (2009). Functional architecture of verbal and tonal working memory: An fMRI study. Human Brain Mapping, 30, 859-873. doi:10.1002/hbm .20550
60. Krumhansl, C. L., & Iverson, P. (1992). Perceptual interactions between musical pitch and timbre. Journal of Experimental Psychology: Human Perception and Performance, 18, 739-751. doi:10.1037/0096-1523.18 .3.739
61. Lange, E. B., & Oberauer, K. (2005). Overwriting of phonemic features in serial recall. Memory, 13, 333-339. doi:10.1080/09658210344000378
62. Lewandowsky, S., & Oberauer, K. (2009). No evidence for temporal decay in working memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 1545-1551. doi:10.1037/a0017010
63. Longoni, A. M., Richardson, J. T., & Aiello, A. (1993). Articulatory rehearsal and phonological storage in working memory. Memory and Cognition, 21, 11-22. doi:10.3758/BF03211160
64. Loui, P., Alsop, D., & Schlaug, G. (2009). Tone deafness: A new disconnection syndrome?. Journal of Neuroscience, 29, 10215-10220. doi: 10.1523/Jneurosci.1701-09.2009
65. Marozeau, J., de Cheveigne, A., McAdams, S., & Winsberg, S. (2003). The dependency of timbre on fundamental frequency. Journal of the Acoustical Society of America, 114, 2946-2957. doi:10.1121/1.1618239
66. McAdams, S., Winsberg, S., Donnadieu, S., Desoete, G., & Krimphoff, J. (1995). Perceptual scaling of synthesized musical timbres-Common dimensions, specificities, and latent subject classes. Psychological Research/ Psychologische Forschung, 58, 177-192. doi:10.1007/ BF00419633
67. McNulty, J. A. (1966). A partial learning model of recognition memory. Canadian Journal of Psychology, 20, 302-315. doi:10.1037/h0082992
68. Melara, R. D., & Marks, L. E. (1990). Interaction among auditory dimensions-timbre, pitch, and loudness. Perception & Psychophysics, 48, 169-178. doi:10.3758/BF03207084
69. Miller, G. A. (1956). The magical number seven, plus or minus two. Psychological Review, 63, 81-97. doi:10.1037/h0043158
70. Mondor, T. A., & Morin, S. R. (2004). Primacy, recency, and suffix effects in auditory short-term memory for pure tones: Evidence from a probe recognition paradigm. Canadian Journal of Experimental Psychology/ Revue Canadienne De Psychologie Experimentale, 58, 206-219. doi: 10.1037/h0087445
71. Morey, R. D. (2011). A Bayesian hierarchical model for the measurement of working memory capacity. Journal of Mathematical Psychology, 55, 8-24. doi:10.1016/j.jmp.2010.08.008
72. Moss, S. M., Myers, J. L., & Filmore, T. (1970). Short-term recognition memory of tones. Perception & Psychophysics, 7, 369-373. doi: 10.3758/BF03208669
73. Mueller, S. T., & Krawitz, A. (2009). Reconsidering the two-second decay hypothesis in verbal working memory. Journal of Mathematical Psychology, 53, 14-25. doi:10.1016/j.jmp.2008.11.001
74. Nairne, J. S. (1990). A feature model of immediate memory. Memory and Cognition, 18, 251-269. doi:10.3758/BF03213879
75. Nairne, J. S., & Kelley, M. R. (1999). Reversing the phonological similarity effect. Memory and Cognition, 27, 45-53. doi:10.3758/ BF03201212
76. Neath, I. (2000). Modeling the effects of irrelevant speech on memory. Psychonomic Bulletin & Review, 7, 403-423. doi:10.3758/BF03214356
77. Neath, I., & Nairne, J. S. (1995). Word-length effects in immediate memory: Overwriting trace decay theory. Psychonomic Bulletin & Review, 2, 429-441. doi:10.3758/BF03210981
78. Oberauer, K., & Kliegl, R. (2006). A formal model of capacity limits in working memory. Journal of Memory and Language, 55, 601-626. doi:10.1016/j.jml.2006.08.009
79. Pechmann, T., & Mohr, G. (1992). Interference in memory for tonal pitch: Implications for a working-memory model. Memory & Cognition, 20, 314-320. doi:10.3758/BF03199668
80. Peterson, L. R., & Peterson, M. J. (1959). Short-term retention of individual verbal items. Journal of Experimental Psychology, 58, 193-198. doi:10.1037/h0049234
81. Rouder, J. N., Morey, R. D., Cowan, N., Zwilling, C. E., Morey, C. C., & Pratte, M. S. (2008). An assessment, of fixed-capacity models of visual working memory. Proceedings of the National Academy of Sciences of the United States of America, 105, 5975-5979. doi:10.1073/pnas .0711295105
82. Samson, S., Zatorre, R. J., & Ramsay, J. O. (1997). Multidimensional scaling of synthetic musical timbre: Perception of spectral and temporal characteristics. Canadian Journal of Experimental Psychology, 51, 307-315. doi:10.1037/1196-1961.51.4.307
83. Schweickert, R., & Boruff, B. (1986). Short-term memory capacity: Magic number or magic spell? Journal of Experimental Psychology: Learning, Memory, and Cognition, 12, 419-425. doi:10.1037/0278-7393.12.3.419
84. Semal, C., & Demany, L. (1991). Dissociation of pitch from timbre in auditory short-term memory. Journal of the Acoustical Society of America, 89, 2404-2410. doi:10.1121/1.400928
85. Semal, C., & Demany, L. (1993). Further evidence for an autonomous processing of pitch in auditory short-term memory. Journal of the Acoustical Society of America, 94, 1315-1322. doi:10.1121/1.408159
86. Song, J. H., & Jiang, Y. (2006). Visual working memory for simple and complex features: An fMRI study. Neuroimage, 30, 963-972. doi: 10.1016/j.neuroimage.2005.10.006
87. Standing, L., Bond, B., Smith, P., & Isely, C. (1980). Is the immediate memory span determined by subvocalization rate? British Journal of Psychology, 71, 525-539. doi:10.1111/j.2044-8295.1980.tb01764.x
88. Starr, G. E., & Pitt, M. A. (1997). Interference effects in short-term memory for timbre. Journal of the Acoustical Society of America, 102, 486-494. doi:10.1121/1.419722
89. Swigger, D., Tchernichovski, O., Mitra, P. P., Cimenser, A.,&Baptista, R. (2004). Sound Analysis Pro [Software]. Retrieved from soundanalysispro .com
90. Tchernichovski, O., Nottebohm, F., Ho, C. E., Pesaran, B., & Mitra, P. P. (2000). A procedure for an automated measurement of song similarity. Animal Behaviour, 59, 1167-1176.
91. Tomic, S. T., & Janata, P. (2007). Ensemble: A web-based system for psychology survey and experiment management. Behavior Research Methods, 39, 635-650. doi:10.3758/BF03193036
92. Treisman, A. M., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12, 97-136. doi:10.1016/0010-0285(80)90005-5
93. Visscher, K. M., Kaplan, E., Kahana, M. J., & Sekuler, R. (2007). Auditory short-term memory behaves like visual short-term memory. PLoS Biol,, 5, e56. doi:10.1371/journal.pbio.0050056
94. Zhang, W. W., & Luck, S. J. (2008). Discrete fixed-resolution representations in visual working memory. Nature, 453, 233-U213. doi:10.1038/ nature06860