Beyond a mask and against the bottleneck: Retroactive dual-task interference during working memory consolidation of a masked visual target

Journal of Experimental Psychology: General

Volumn 143, Issue 3, 2014, Pages 1409-1427

  Nieuwenstein, Mark ^a   Wyble, Brad ^b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Attentional blink; Backward masking; Psychological refractory period; Retroactive dual task interference; Working memory consolidation

Indexed keywords

ADULT; ATTENTION; ATTENTIONAL BLINK; COLOR VISION; HUMAN; PATTERN RECOGNITION; PERCEPTION; PHYSIOLOGY; RANDOMIZATION; SHORT TERM MEMORY; TASK PERFORMANCE; VISION; YOUNG ADULT;

ADULT; ATTENTION; ATTENTIONAL BLINK; COLOR PERCEPTION; HUMANS; MEMORY, SHORT-TERM; PATTERN RECOGNITION, VISUAL; PERCEPTUAL MASKING; RANDOM ALLOCATION; TASK PERFORMANCE AND ANALYSIS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84901304032     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0035257     Document Type: Article

References (91)

1. Arnell, K. M., & Duncan, J. (2002). Separate and shared sources of dual-task cost in stimulus identification and response selection. Cognitive Psychology, 44, 105-147. doi:10.1006/cogp.2001.0762
2. Arnell, K. M., Helion, A. M., Hurdelbrink, J. A., & Pasieka, B. (2004). Dissociating sources of dual-task interference using human electrophysiology. Psychonomic Bulletin & Review, 11, 77- 83. doi:10.3758/ BF03206464
3. Arnell, K. M., & Jolicoeur, P. (1999). The attentional blink across stimulus modalities: Evidence for central processing limitations. Journal of Experimental Psychology: Human Perception and Performance, 25, 630- 648. doi:10.1037/0096-1523.25.3.630
4. Averbach, E., & Coriell, A. S. (1961). Short-term memory in vision. Bell System Technical Journal, 40, 309-328. doi:10.1002/j.1538-7305.1961 .tb03987.x
5. Bachmann, T., & Hommuk, K. (2005). How backward masking becomes attentional blink: Perception of successive in-stream targets. Psychological Science, 16, 740-742. doi:10.1111/j.1467-9280.2005.01604.x
6. Baddeley, A. (2012). Working memory: Theories, models, and controversies. Annual Review of Psychology, 63, 1-29. doi:10.1146/annurevpsych-120710-100422
7. Barrouillet, P., Bernardin, S., & Camos, V. (2004). Time constraints and resource sharing in adult's working memory spans. Journal of Experimental Psychology: General, 133, 83-100. doi:10.1037/0096-3445.133 .1.83
8. Barrouillet, P., Bernardin, S., Portrat, S., Vergauwe, E., & Camos, V. (2007). Time and cognitive load in working memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 570-585. doi:10.1037/0278-7393.33.3.570
9. Bays, P. M., Gorgoraptis, N., Wee, N., Marshall, L., & Husain, M. (2011). Temporal dynamics of encoding, storage, and reallocation of visual working memory. Journal of Vision, 11, Article no. 6. doi:10.1167/11.10.6
10. Bowman, H., & Wyble, B. (2007). The simultaneous type, serial token model of temporal attention and working memory. Psychological Review, 114, 38-70. doi:10.1037/0033-295X.114.1.38
11. Breitmeyer, B. G., & Ogmen, H. (2000). Recent models and findings in visual backward masking: A comparison, review, and update. Perception & Psychophysics, 62, 1572-1595. doi:10.3758/BF03212157
12. Bundesen, C. (1990). A theory of visual-attention. Psychological Review, 97, 523-547. doi:10.1037/0033-295X.97.4.523
13. Chun, M. M., & Potter, M. C. (1995). A two-stage model for multipletarget detection in rapid serial visual presentation. Journal of Experimental Psychology: Human Perception and Performance, 21, 109-127. doi:10.1037/0096-1523.21.1.109
14. Craston, P., Wyble, B., Chennu, S., & Bowman, H. (2009). The attentional blink reveals serial working memory encoding: Evidence from virtual and human event-related potentials. Journal of Cognitive Neuroscience, 21, 550-566. doi:10.1162/jocn.2009.21036
15. Davelaar, E. J., Goshen-Gottstein, Y., Ashkenazi, A., Haarmann, H. J., & Usher, M. (2005). The demise of short-term memory revisited: Empirical and computational investigations of recency effects. Psychological Review, 112, 3-42. doi:10.1037/0033-295X.112.1.3
16. Dehaene, S., Changeux, J. P., Naccache, L., & Sackur, J. (2006). Conscious, preconscious, and subliminal processing: A testable taxonomy. Trends in Cognitive Sciences, 10, 204-211. doi:10.1016/j.tics.2006.03 .007
17. Dehaene, S., Sergent, C., & Changeux, J. P. (2003). A neuronal network model linking subjective reports and objective neurophysiological data during conscious perception. Proceedings of the National Academy of Science of the United States, 100, 8520 - 8525. doi:10.1073/pnas .1332574100
18. De Jong, R., & Sweet, J. B. (1994). Preparatory strategies in overlappingtask performance. Perception & Psychophysics, 55, 142-151. doi: 103758/BF03211662
19. Dell'Acqua, R., Dux, P. E., Wyble, B., & Jolicoeur, P. (2012). Sparing from the attentional blink is not spared from structural limitations. Psychonomic Bulletin & Review, 19, 232-238. doi:10.3758/s13423-011-0209-3
20. Dux, P. E., & Marois, R. (2009). The attentional blink: A review of data and theory. Attention, Perception, & Psychophysics, 71, 1683-1700. doi:10.3758/APP.71.8.1683
21. Enns, J. T., & Di Lollo, V. (2000). What's new in visual masking. Trends in Cognitive Sciences, 4, 345-352. doi:10.1016/S1364-6613(00)01520-5
22. Ferrand, L., & Grainger, J. (1993). The time course of orthographic and phonological code activation in the early stages of visual word recognition. Bulletin of the Psychonomic Society, 31, 119-122.
23. Fuller, R. L., Luck, S. J., McMahon, R. P., & Gold, J. M. (2005). Working memory consolidation is abnormally slow in schizophrenia. Journal of Abnormal Psychology, 114, 279-290. doi:10.1037/0021-843X.114.2 .279
24. Fuster, J. M., & Alexander, G. E. (1971). Neuron activity related to short-term memory. Science, 173, 652-654. doi:10.1126/science.173 .3997.652
25. Gegenfurtner, K. R., & Sperling, G. (1993). Information transfer in iconic memory experiments. Journal of Experimental Psychology: Human Perception and Performance, 19, 845-866. doi:10.1037/0096-1523.19 .4.845
26. Grill-Spector, K., & Kanwisher, N. (2005). Visual recognition: As soon as you know it is there, you know what it is. Psychological Science, 16, 152-160.
27. Hommel, B., & Akyurek, E. G. (2005). Lag-1 sparing in the attentional blink: Benefits and costs of integrating two events into a single episode. The Quarterly Journal of Experimental Psychology, 58, 1415-1433.
28. Jolicoeur, P., & Dell'Acqua, R. (1998). The demonstration of short-term consolidation. Cognitive Psychology, 36, 138-202. doi:10.1006/cogp .1998.0684
29. Jolicoeur, P., & Dell'Acqua, R. (1999). Attentional and structural constraints on visual encoding. Psychological Research, 62, 154-164. doi: 10.1007/s004260050048
30. Jonides, J., Lewis, R. L., Nee, D. E., Lustig, C., Berman, M. G., & Moore, K. S. (2008). The mind and brain of short-term memory. Annual Review of Psychology, 59, 193-224. doi:10.1146/annurev.psych.59.103006 .093615
31. Juola, J. F., Botella, J., & Palacios, A. (2004). Task-and location-switching effects on visual attention. Perception & Psychophysics, 66, 1303-1317. doi:10.3758/BF03195000
32. Kahneman, D. (1968). Method, findings, and theory in studies of visual masking. Psychological Bulletin, 70, 404-425. doi:10.1037/h0026731
33. Keysers, C., Xiao, D. K., Foldiak, P., & Perrett, D. I. (2001). The speed of sight. Journal of Cognitive Neuroscience, 13, 90-101. doi:10.1162/ 089892901564199
34. Koch, I., & Rumiati, R. I. (2006). Task-set inertia and memoryconsolidation bottleneck in dual tasks. Psychological Research, 70, 448-458. doi:10.1007/s00426-005-0020-8
35. Kovács, G., Vogels, R., & Orban, G. A. (1995). Cortical correlate of pattern backward masking. PNAS Proceedings of the National Academy of Sciences of the United States of America, 92, 5587-5591. doi: 10.1073/pnas.92.12.5587
36. Lagroix, H. E. P., Spalek, T. M., Wyble, B., Jannati, A., & Di Lollo, V. (2012). The root cause of the attentional blink: First-target processing or disruption of input control? Attention, Perception, & Psychophysics, 74, 1606-1622. doi:10.3758/s13414-012-0361-5
37. Logothetis, N. K., & Sheinberg, D. L. (1996). Visual object recognition. Annual Review of Neuroscience, 19, 577-621. doi:10.1146/annurev.ne .19.030196.003045
38. Magnussen, S., & Greenlee, M. W. (1999). The psychophysics of perceptual memory. Psychological Research, 62, 81-92. doi:10.1007/ s004260050043
39. Magnussen, S., Greenlee, M. W., Asplund, R., & Dyrnes, S. (1991). Stimulus-specific mechanisms of visual short-term memory. Vision Research, 31, 1213-1219. doi:10.1016/0042-6989(91)90046-8
40. Marois, R., & Ivanoff, J. (2005). Capacity-limitations of information processing in the brain. Trends in Cognitive Sciences, 9, 296-305. doi:10.1016/j.tics.2005.04.010
41. Martens, S., & Wyble, B. (2010). The attentional blink: Past, present, and future of a blind spot in perceptual awareness. Neuroscience and Biobehavioral Reviews, 34, 947-957. doi:10.1016/j.neubiorev.2009.12.005
42. Marti, S., Sigman, M., & Dehaene, S. (2012). A shared cortical bottleneck underlying attentional blink and psychological refractory period. NeuroImage, 59, 2883-2898. doi:10.1016/j.neuroimage.2011.09.063
43. Miller, E. K., Erickson, C. A., & Desimone, R. (1996). Neural mechanisms of visual working memory in prefrontal cortex of the macaque. The Journal of Neuroscience, 16, 5154-5167.
44. Nakayama, K., & Mackeben, M. (1989). Sustained and transient components of focal visual attention. Vision Research, 29, 1631-1647. doi: 10.1016/0042-6989(89)90144-2
45. Nieuwenstein, M. R., Potter, M. C., & Theeuwes, J. (2009). Unmasking the attentional blink. Journal of Experimental Psychology: Human Perception and Performance, 35, 159-169. doi:10.1037/0096-1523.35.1.159
46. Nieuwenstein, M., Van der Burg, E., Theeuwes, J., Wyble, B., & Potter, M. (2009). Temporal constraints on conscious vision: On the ubiquitous nature of the attentional blink. Journal of Vision, 9, Article no. 18. doi:10.1167/9.9.18
47. Nieuwenstein, M. R., & Wyble, B. (2013). Retroactive dual-task interference in a whole-report RSVP task: A window into the formation of a durable short-term memory trace. Manuscript in preparation.
48. Oberauer, K. (2009). Design for a working memory. Psychology of Learning and Motivation, 51, 45-100. doi:10.1016/S0079-7421(09)51002-X
49. Oberauer, K., Lewandowsky, S., Farrell, S., Jarrold, C., & Greaves, M. (2012). Modeling working memory: An interference model of complex span. Psychonomic Bulletin & Review, 19, 779-819. doi:10.3758/ s13423-012-0272-4
50. Olivers, C. N. L., & Meeter, M. (2008). A boost and bounce theory of temporal attention. Psychological Review, 115, 836-863. doi:10.1037/ a0013395
51. Olson, I. R., Chun, M. M., & Anderson, A. K. (2001). Effects of phonological length on the attentional blink for words. Journal of Experimental Psychology: Human Perception and Performance, 27, 1116-1123. doi:10.1037/0096-1523.27.5.1116
52. Ouimet, C., & Jolicoeur, P. (2007). Beyond Task 1 difficulty: The duration of T1 encoding modulates the attentional blink. Visual Cognition, 15, 290-304. doi:10.1080/13506280600693741
53. Pashler, H. (1994). Dual-task interference in simple tasks: Data and theory. Psychological Bulletin, 116, 220-244. doi:10.1037/0033-2909.116.2 .220
54. Pashler, H. (1998). The psychology of attention. MIT Press. Cambridge, MA.
55. Potter, M. C. (1975). Meaning in visual search. Science, 187, 965-966. doi:10.1126/science.1145183
56. Potter, M. C. (1976). Short-term conceptual memory for pictures. Journal of Experimental Psychology: Human Learning and Memory, 2, 509- 522. doi:10.1037/0278-7393.2.5.509
57. Potter, M. C., Chun, M. M., Banks, B. S., & Muckenhoupt, M. (1998). Two attentional deficits in serial target search: The visual attentional blink and an amodal task-switch deficit. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24, 979-992. doi:10.1037/0278-7393.24.4.979
58. Potter, M. C., Staub, A., & O'Connor, D. H. (2002). The time course of competition for attention: Attention is initially labile. Journal of Experimental Psychology: Human Perception and Performance, 28, 1149- 1162. doi:10.1037/0096-1523.28.5.1149
59. Prinzmetal, W., Amiri, H., Allen, K., & Edwards, T. (1998). Phenomenology of attention: 1. Color, location, orientation, and spatial frequency. Journal of Experimental Psychology: Human Perception and Performance, 24, 261-282. doi:10.1037/0096-1523.24.1.261
60. Ratcliff, R., & Rouder, J. N. (2000). A diffusion model account of masking in two-choice letter identification. Journal of Experimental Psychology: Human Perception and Performance, 26, 127-140. doi:10.1037/0096-1523.26.1.127
61. Raymond, J. E., Shapiro, K. L., & Arnell, K. M. (1992). Temporary suppression of visual processing in an RSVP task: An attentional blink. Journal of Experimental Psychology: Human Perception and Performance, 18, 849-860. doi:10.1037/0096-1523.18.3.849
62. Ricker, T. J., & Cowan, N. (2010). Loss of visual working memory within seconds: The combined use of refreshable and non-refreshable features. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 1355-1368. doi:10.1037/a0020356
63. Rolls, E. T., Tovée, M. J., & Panzeri, S. (1999). The neurophysiology of backward visual masking: Information analysis. Journal of Cognitive Neuroscience, 11, 300-311. doi:10.1162/089892999563409
64. Ruthruff, E., & Pashler, H. (2001). Central and peripheral interference in RSVP displays. In K. Shapiro (Ed.), The limits of attention: Temporal constraints on human information processing (pp. 100-123). Oxford, England: Oxford University Press.
65. Saults, J. S., & Cowan, N. (2007). A central capacity limit to the simultaneous storage of visual and auditory arrays in working memory. Journal of Experimental Psychology: General, 136, 663-684. doi: 10.1037/0096-3445.136.4.663
66. Shibuya, H., & Bundesen, C. (1988). Visual selection from multielement displays: Measuring and modeling effects of exposure duration. Journal of Experimental Psychology: Human Perception and Performance, 14, 591-600. doi:10.1037/0096-1523.14.4.591
67. Shih, S. I. (2008). The attention cascade model and attentional blink. Cognitive Psychology, 56, 210-236. doi:10.1016/j.cogpsych.2007.06 .001
68. Spalek, T. M., Lagroix, H. E. P., Yanko, M. R., & Di Lollo, V. (2012). Perception of temporal order is impaired during the time course of the attentional blink. Journal of Experimental Psychology: Human Perception and Performance, 38, 402-413. doi:10.1037/a0025050
69. Stevanovski, B., & Jolicoeur, P. (2007). Visual short-term memory: Central capacity limitations in short-term consolidation. Visual Cognition, 15, 532-563. doi:10.1080/13506280600871917
70. Stevanovski, B., & Jolicoeur, P. (2011). Consolidation of multi-feature items in visual working memory: Central capacity requirements for visual consolidation. Attention, Perception, & Psychophysics, 73, 1108- 1119. doi:10.3758/s13414-011-0099-5
71. Sun, H., Zimmer, H. D., & Fu, X. (2011). The influence of expertise and of physical complexity on visual short-term memory consolidation. The Quarterly Journal of Experimental Psychology, 64, 707-729. doi: 10.1080/17470218.2010.511238
72. Taatgen, N. A., Juvina, I., Schipper, M., Borst, J., & Martens, S. (2009). Too much control can hurt: A threaded cognition model of the attentional blink. Cognitive Psychology, 59, 1-29. doi:10.1016/j.cogpsych .2008.12.002
73. Thorpe, S., Fize, D., & Marlot, C. (1996). Speed of processing in the human visual system. Nature, 381, 520-522. doi:10.1038/381520a0
74. Todd, J. J., Han, S. W., Harrison, S., & Marois, R. (2011). The neural correlates of visual working memory encoding: A time-resolved fMRI study. Neuropsychologia, 49, 1527-1536. doi:10.1016/j.neuropsychologia. 2011.01.040
75. Tombu, M. N., Asplund, C. L., Dux, P. E., Godwin, D., Martin, J. W., & Marois, R. (2011). A unified attentional bottleneck in the human brain. PNAS Proceedings of the National Academy of Sciences of the United States of America, 108, 13426-13431. doi:10.1073/pnas.1103583108
76. Tombu, M., & Jolicoeur, P. (2005). Testing the predictions of the central capacity sharing model. Journal of Experimental Psychology: Human Perception and Performance, 31, 790-802. doi:10.1037/0096-1523.31 .4.790
77. Ueno, T., Allen, R. J., Baddeley, A. D., Hitch, G. J., & Saito, S. (2011). Disruption of feature binding in working memory. Memory & Cognition, 39, 12-23. doi:10.3758/s13421-010-0013-8
78. Van der Burg, E., Brederoo, S. G., Nieuwenstein, M. R., Theeuwes, J., & Olivers, C. N. L. (2010). Audiovisual semantic interference and attention: Evidence from the attentional blink paradigm. Acta Psychologica, 134, 198-205. doi:10.1016/j.actpsy.2010.01.010
79. Visser, T. A. W., Bischof, W. F., & Di Lollo, V. (1999). Attentional switching in spatial and non-spatial domains: Evidence from the attentional blink. Psychological Bulletin, 125, 458-469. doi:10.1037/0033-2909.125.4.458
80. Vogel, E. K., Woodman, G. F., & Luck, S. J. (2006). The time course of consolidation in visual working memory. Journal of Experimental Psychology: Human Perception and Performance, 32, 1436-1451. doi: 10.1037/0096-1523.32.6.1436
81. Vuontela, V., Rämä, P., Raninen, A., Aronen, H. J., & Carlson, C. (1999). Selective interference reveals dissociation between memory for location and color. NeuroReport, 10, 2235-2240. doi:10.1097/00001756-199908020-00002
82. Welford, A. (1952). The "psychological refractory period" and the timing of high speed performance: A review and a theory. British Journal of Psychology, 43, 2-19.
83. Wilken, P., & Ma, W. J. (2004). A detection theory account of change detection. Journal of Vision, 4, Article no. 11. doi:10.1167/4.12.11
84. Wong, K. F. E. (2002). The relationship between attentional blink and psychological refractory period. Journal of Experimental Psychology: Human Perception and Performance, 28, 54-71. doi:10.1037/0096-1523.28.1.54
85. Woodman, G. F., & Vogel, E. K. (2005). Fractionating working memory: Consolidation and maintenance are independent processes. Psychological Science, 16, 106-113. doi:10.1111/j.0956-7976.2005.00790.x
86. Wutz, A., & Melcher, D. (2013). Temporal buffering and visual capacity: The time course of object formation underlies capacity limits in visual cognition. Attention, Perception, & Psychophysics, 75, 921-933. doi: 10.3758/s13414-013-0454-9
87. Wyble, B., Bowman, H., & Nieuwenstein, M. R. (2009). The attentional blink provides episodic distinctiveness: Sparing at a cost. Journal of Experimental Psychology: Human Perception and Performance, 35, 787-807. doi:10.1037/a0013902
88. Wyble, B., Potter, M. C., Bowman, H., & Nieuwenstein, M. R. (2011). Attentional episodes in visual perception. Journal of Experimental Psychology: General, 140, 488-505. doi:10.1037/a0023612
89. Zhang, W., & Luck, S. J. (2008). Discrete fixed-resolution representations in visual working memory. Nature, 453, 233-235. doi:10.1038/ nature06860
90. Zylberberg, A., Dehaene, S., Roelfsema, P. R., & Sigman, M. (2011). The human Turing machine: A neural framework for mental programs. Trends in Cognitive Sciences, 15, 293-300.
91. Zylberberg, A., Slezak, D. F., Roelfsema, P. R., Dehaene, S., & Sigman, M. (2010). The brain's router: A cortical network of serial processing in the primate brain. PLoS Computational Biology, 6, e1000765. doi: 10.1371/journal.pcbi.1000765