From a single decision to a multi-step algorithm

Current Opinion in Neurobiology

Volumn 22, Issue 6, 2012, Pages 937-945

  Dehaene, Stanislas ^a,b,c,d   Sigman, Mariano ^e  

^a l'alimentation et l'Environnement   (France)

^b Cognitive Neuroimaging Unit ^*  (France)

^c DIF   (France)

^d UNIVERSITÉ PARIS SACLAY   (France)

^e UNIVERSIDAD DE BUENOS AIRES   (Argentina)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; DECISION MAKING; HUMAN; NERVE CELL NETWORK; PHYSIOLOGY; PRIMATE; REVIEW;

ALGORITHMS; ANIMALS; DECISION MAKING; HUMANS; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); PRIMATES;

EID: 84878202025     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2012.05.006     Document Type: Review

References (95)

1. Gold JI, Shadlen MN: Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 2002, 36:299-308.
2. Beck JM, Ma WJ, Kiani R, Hanks T, Churchland AK, Roitman J, Shadlen MN, Latham PE, Pouget A: Probabilistic population codes for Bayesian decision making. Neuron 2008, 60:1142-1152.
3. Turing AM: On computable numbers, with an application to the Entscheidungsproblem. Proc London Math Soc 1936, 42.
4. Zylberberg A, Dehaene S, Roelfsema PR, Sigman M: The human Turing machine: a neural framework for mental programs. Trends Cogn Sci 2011, 15:293-300.
5. Zylberberg A, Fernandez Slezak D, Roelfsema PR, Dehaene S, Sigman M: The brain's router: a cortical network model of serial processing in the primate brain. PLoS Comput Biol 2010, 6:e1000765. The first spiking network that captured the coexistence of serial and parallel processes observed in dual-task experiments in humans. It is an effort to bring together decision making in non-human primates, and the vast literature of dual-task performance in humans.
6. Gilbert CD, Sigman M: Brain states: top-down influences in sensory processing. Neuron 2007, 54:677-696.
7. Shadlen MN, Kiani R, Hanks T, Churchland AK: Neurobiology of decision making: an intentional framework. In Better Than Conscious? Decision Making, the Human Mind, and Implications For Institutions. Strüngmann Forum Report. Edited by Engel C, Singer W. MIT Press; 2008.
8. Crammond DJ, Kalaska JF: Modulation of preparatory neuronal activity in dorsal premotor cortex due to stimulus-response compatibility. J Neurophysiol 1994, 71:1281-1284.
9. Gail A, Klaes C, Westendorff S: Implementation of spatial transformation rules for goal-directed reaching via gain modulation in monkey parietal and premotor cortex. J Neurosci 2009, 29:9490-9499.
10. Hernandez A, Nacher V, Luna R, Zainos A, Lemus L, Alvarez M, Vazquez Y, Camarillo L, Romo R: Decoding a perceptual decision process across cortex. Neuron 2010, 66:300-314. A careful analysis of the dynamics of decision making in a tactile comparison task, using multiple single-neuron recordings to show how multiple areas contribute to the sequence of processing steps that bridge from sensation to decision and response.
11. Hernandez A, Nacher V, Luna R, Zainos A, Lemus L, Alvarez M, Vazquez Y, Camarillo L, Romo R: Decoding a perceptual decision process across cortex. Neuron 2010, 66:300-314. A careful analysis of the dynamics of decision making in a tactile comparison task, using multiple single-neuron recordings to show how multiple areas contribute to the sequence of processing steps that bridge from sensation to decision and response.
12. Cisek P, Kalaska JF: Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action. Neuron 2005, 45:801-814.
13. Selen LP, Shadlen MN, Wolpert DM: Deliberation in the motor system: reflex gains track evolving evidence leading to a decision. J Neurosci 2012, 32:2276-2286.
14. Miller J: Discrete versus continuous stage models of human information processing: in search of partial output. J Exp Psychol Hum Percept Perform 1982, 8:273-296.
15. Requin J: Looking forward to moving soon: ante factum selective processes in motor control. In Attention and Performance X. Edited by Posner MI, Marin OSM. Erlbaum; 1985:147-167.
16. Roca M, Parr A, Thompson R, Woolgar A, Torralva T, Antoun N, Manes F, Duncan J: Executive function and fluid intelligence after frontal lobe lesions. Brain 2010, 133:234-247.
17. Woolgar A, Parr A, Cusack R, Thompson R, Nimmo-Smith I, Torralva T, Roca M, Antoun N, Manes F, Duncan J: Fluid intelligence loss linked to restricted regions of damage within frontal and parietal cortex. Proc Natl Acad Sci USA 2010, 107:14899-14902.
18. Marois R, Ivanoff J: Capacity limits of information processing in the brain. Trends Cogn Sci 2005, 9:296-305.
19. Pashler H: Processing stages in overlapping tasks: evidence for a central bottleneck. J Exp Psychol Hum Percept Perform 1984, 10:358-377. An elegant and seminal psychological study demonstrating the coexistence of serial and parallel stages in dual-task and pointing the functional locus of the serial bottleneck to response selection mechanisms.
20. Pashler H: Dual-task interference in simple tasks: data and theory. Psychol Bull 1994, 116:220-244.
21. Welford AT: The ''psychological refractory period'' and the timing of high speed performance-a review and a theory. Br J Psychol 1952, 43:2-19.
22. Telford CW: The refractory phase of voluntary and associative responses. J Exp Psychol 1931, 14:1-36.
23. Logan GD, Schulkind MD: Parallel memory retrieval in dual-task situations: I. Semantic memory. J Exp Psychol Hum Percept Perform 2000, 26:1072-1090.
24. Hesselmann G, Flandin G, Dehaene S: Probing the cortical network underlying the psychological refractory period: a combined EEG-fMRI study. Neuroimage 2011, 56:1608-1621.
25. Shin YK, Cho YS, Lien MC, Proctor RW: Is the psychological refractory period effect for ideomotor compatible tasks eliminated by speed-stress instructions? Psychol Res 2007, 71:553-567.
26. Lien MC, McCann RS, Ruthruff E, Proctor RW: Confirming and disconfirming theories about ideomotor compatibility in dualtask performance: a reply to Greenwald (2005). J Exp Psychol Hum Percept Perform 2005, 31:226-229.
27. Lien MC, McCann RS, Ruthruff E, Proctor RW: Dual-task performance with ideomotor-compatible tasks: is the central processing bottleneck intact, bypassed, or shifted in locus? J Exp Psychol Hum Percept Perform 2005, 31:122-144.
28. Dux PE, Tombu MN, Harrison S, Rogers BP, Tong F, Marois R: Training improves multitasking performance by increasing the speed of information processing in human prefrontal cortex. Neuron 2009, 63:127-138.
29. Kamienkowski JE, Pashler H, Dehaene S, Sigman M: Effects of practice on task architecture: combined evidence from interference experiments and random-walk models of decision making. Cognition 2011, 119:81-95. After training subjects for thousands of trials in a dual-task paradigm, the authors demonstrate that extensive practice can reduce the duration of serial decision stages, but that the qualitative property of central seriality remains a structural invariant.
30. Sigman M, Dehaene S: Parsing a cognitive task: a characterization of the mind's bottleneck. PLoS Biol 2005, 3:e37. A dissection of the sources of variability in response times in a dual-task setting. Introduces the hypothesis that the 'central bottleneck' stage identified by dual tasks is the same as the 'evidence accumulation' stage of stochastic decision-making models, and is responsible for the bulk of the variance in response times.
31. Wagenmakers E-J, van der Maas HLJ, Grasman RPPP: An EZdiffusion model for response time and accuracy. Psychon Bull Rev 2007, 14:3-22.
32. Dell'acqua R, Jolicoeur P, Vespignani F, Toffanin P: Central processing overlap modulates P3 latency. Exp Brain Res 2005, 165:54-68.
33. Arnell KM, Helion AM, Hurdelbrink JA, Pasieka B: Dissociating sources of dual-task interference using human electrophysiology. Psychon Bull Rev 2004, 11:77-83.
34. Sessa P, Luria R, Verleger R, Dell'Acqua R: P3 latency shifts in the attentional blink: further evidence for second target processing postponement. Brain Res 2007, 1137:131-139.
35. Marti S, Sigman M, Dehaene S: A shared cortical bottleneck underlying Attentional Blink and Psychological Refractory Period. Neuroimage 2012, 59:2883-2898.
36. Sigman M, Jobert A, Lebihan D, Dehaene S: Parsing a sequence of brain activations at psychological times using fMRI. Neuroimage 2007, 35:655-668.
37. Dux PE, Ivanoff J, Asplund CL, Marois R: Isolation of a central bottleneck of information processing with time-resolved FMRI. Neuron 2006, 52:1109-1120.
38. Sigman M, Dehaene S: Brain mechanisms of serial and parallel processing during dual-task performance. J Neurosci 2008, 28:7585-7598.
39. Tombu MN, Asplund CL, Dux PE, Godwin D, Martin JW, Marois R: A unified attentional bottleneck in the human brain. Proc Natl Acad Sci USA 2011, 108:13426-13431.
40. Dehaene S, Changeux JP, Naccache L, Sackur J, Sergent C: Conscious, preconscious, and subliminal processing: a testable taxonomy. Trends Cogn Sci 2006, 10:204-211.
41. Dehaene S, Kerszberg M, Changeux JP: A neuronal model of a global workspace in effortful cognitive tasks. Proc Natl Acad Sci USA 1998, 95:14529-14534.
42. Duncan J: The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour. Trends Cogn Sci 2010, 14:172-179.
43. Sigman M, Dehaene S: Dynamics of the central bottleneck: dual-task and task uncertainty. PLoS Biol 2006, 4:e220.
44. He BJ, Zempel JM, Snyder AZ, Raichle ME: The temporal structures and functional significance of scale-free brain activity. Neuron 2010, 66:353-369.
45. Posner NI, Snyder CRR: Attention and cognitive control. In Information Processing and Cognition: The Loyola Symposium. Edited by Solso RL. L. Erlbaum; 1975:55-85.
46. Ericsson KA, Simon HA: Verbal reports as data. Psychol Rev 1980, 87:215-251.
47. Dehaene S, Changeux JP: Experimental and theoretical approaches to conscious processing. Neuron 2011, 70:200-227. An extensive review of recent experimental research on the brain events that characterize conscious processing.
48. Sergent C, Baillet S, Dehaene S: Timing of the brain events underlying access to consciousness during the attentional blink. Nat Neurosci 2005, 8:1391-1400.
49. Vogel EK, Luck SJ, Shapiro KL: Electrophysiological evidence for a postperceptual locus of suppression during the attentional blink. J Exp Psychol Hum Percept Perform 1998, 24:1656-1674.
50. Vogel EK, Luck SJ: Delayed working memory consolidation during the attentional blink. Psychon Bull Rev 2002, 9:739-743.
51. Gross J, Schmitz F, Schnitzler I, Kessler K, Shapiro K, Hommel B, Schnitzler A: Modulation of long-range neural synchrony reflects temporal limitations of visual attention in humans. Proc Natl Acad Sci USA 2004, 101:13050-13055.
52. Wong KFE: The relationship between attentional blink and psychological refractory period. J Exp Psychol Hum Percept Perform 2002, 28:54-71.
53. Jolicoeur P: Concurrent response-selection demands modulate the attentional blink. J Exp Psychol Hum Percept Perform 1999, 25:1097-1113.
54. Jolicoeur P: Restricted attentional capacity between sensory modalities. Psychon Bull Rev 1999, 6:87-92.
55. Asplund CL, Todd JJ, Snyder AP, Gilbert CM, Marois R: Surpriseinduced blindness: a stimulus-driven attentional limit to conscious perception. J Exp Psychol Hum Percept Perform 2011, 36:1372-1381.
56. Nieuwenstein M, Van der Burg E, Theeuwes J, Wyble B, Potter M: Temporal constraints on conscious vision: on the ubiquitous nature of the attentional blink. J Vis 2009, 9:11-14. A series of behavioral experiments pursue the minimal conditions under which the attentional blink occurs. The results suggest that the mere conscious perception of the first target T1 suffices to induce a bottleneck on the processing of a subsequent target T2.
57. Marti S, Sackur J, Sigman M, Dehaene S: Mapping introspection's blind spot: reconstruction of dual-task phenomenology using quantified introspection. Cognition 2010, 115:303-313.
58. Corallo G, Sackur J, Dehaene S, Sigman M: Limits on introspection: distorted subjective time during the dual-task bottleneck. Psychol Sci 2008, 19:1110-1117.
59. de Lange FP, van Gaal S, Lamme VA, Dehaene S: How awareness changes the relative weights of evidence during human decision-making. PLoS Biol 2011, 9:e1001203. This paper uses magneto-encephalography to analyze the dynamics of a serial decision task in humans, while modulating the consciousness of the targets using masking. The results demonstrate evidence accumulation in near-invisibility conditions.
60. de Lange FP, Jensen O, Dehaene S: Accumulation of evidence during sequential decision making: the importance of topdown factors. J Neurosci 2010, 30:731-738.
61. Dumontheil I, Thompson R, Duncan J: Assembly and use of new task rules in fronto-parietal cortex. J Cogn Neurosci 2010, 23:168-182.
62. Miller EK, Cohen JD: An integrative theory of prefrontal cortex function. Annu Rev Neurosci 2001, 24:167-202.
63. Fan Z, Singh K, Muthukumaraswamy S, Sigman M, Dehaene S, Shapiro K: The cost of serially chaining two cognitive operations. Psychol Res 2011. Published online 30 August 2011.
64. Sackur J, Dehaene S: The cognitive architecture for chaining of two mental operations. Cognition 2009, 111:187-211.
65. Yang T, Shadlen MN: Probabilistic reasoning by neurons. Nature 2007, 447:1075-1080. A detailed behavioral, electrophysiological and theoretical analysis of how monkeys achieve a decision that requires pooling the evidence provided by four serially presented visual cues.
66. Roelfsema PR, Khayat PS, Spekreijse H: Subtask sequencing in the primary visual cortex. Proc Natl Acad Sci USA 2003, 100:5467-5472.
67. Lefebvre C, Dell'acqua R, Roelfsema PR, Jolicoeur P: Surfing the attentional waves during visual curve tracing: evidence from the sustained posterior contralateral negativity. Psychophysiology 2011, 48:1510-1516.
68. Roelfsema PR, Lamme VA, Spekreijse H: The implementation of visual routines. Vision Res 2000, 40:1385-1411.
69. Jolicoeur P, Ullman S, Mackay M: Visual curve tracing properties. J Exp Psychol Hum Percept Perform 1991, 17:997-1022.
70. Moro SI, Tolboom M, Khayat PS, Roelfsema PR: Neuronal activity in the visual cortex reveals the temporal order of cognitive operations. J Neurosci 2010, 30:16293-16303. A striking demonstration, using monkey electrophysiology, that different orderings of two visual subroutines are reflected in a serial organization of spiking activity in the primary visual area V1
71. Supèr H, Spekreijse H, Lamme VA: A neural correlate of working memory in the monkey primary visual cortex. Science 2001, 293:120-124.
72. Sigman M, Pan H, Yang Y, Stern E, Silbersweig D, Gilbert CD: Topdown reorganization of activity in the visual pathway after learning a shape identification task. Neuron 2005, 46:823-835.
73. Tombu M, Jolicoeur P: A central capacity sharing model of dualtask performance. J Exp Psychol Hum Percept Perform 2003, 29:3-18.
74. Jentzsch I, Leuthold H, Ulrich R: Decomposing sources of response slowing in the PRP paradigm. J Exp Psychol Hum Percept Perform 2007, 33:610-626.
75. Resulaj A, Kiani R, Wolpert DM, Shadlen MN: Changes of mind in decision-making. Nature 2009, 461:263-266. A careful analysis of the humans' hand trajectories reveals occasional 'changes of mind', sudden revisions of the subject's goals that suggest that two successive decisions were taken.
76. Del Cul A, Dehaene S, Reyes P, Bravo E, Slachevsky A: Causal role of prefrontal cortex in the threshold for access to consciousness. Brain 2009, 132:2531-2540.
77. Fleming SM, Weil RS, Nagy Z, Dolan RJ, Rees G: Relating introspective accuracy to individual differences in brain structure. Science 2010, 329:1541-1543. Inter-individual variability in second-order decision making (the capacity to assign confidence to a first-order judgment) is shown to relate specifically to fronto-polar cortex and its connections
78. Koechlin E, Summerfield C: An information theoretical approach to prefrontal executive function. Trends Cogn Sci 2007, 11:229-235.
79. Koechlin E, Hyafil A: Anterior prefrontal function and the limits of human decision-making. Science 2007, 318:594-598.
80. Koechlin E, Ody C, Kouneiher F: The architecture of cognitive control in the human prefrontal cortex. Science 2003, 302:1181-1185.
81. Koechlin E, Basso G, Pietrini P, Panzer S, Grafman J: The role of the anterior prefrontal cortex in human cognition. Nature 1999, 399:148-151.
82. Gegenfurtner KR, Sperling G: Information transfer in iconic memory experiments. J Exp Psychol Hum Percept Perform 1993, 19:845-866.
83. Enns JT, Di Lollo V: What's new in visual masking. Trends Cogn Sci 2000, 4:345-352.
84. Raymond JE, Shapiro KL, Arnell KM: Temporary suppression of visual processing in an RSVP task: an attentional blink? J Exp Psychol Hum Percept Perform 1992, 18:849-860.
85. Charron S, Koechlin E: Divided representation of concurrent goals in the human frontal lobes. Science 2010, 328:360-363. Using fMRI, this study identifies a remarkable subdivision of labor whereby, during dual tasking, left and right prefrontal areas encode the specific reward contingencies underlying each individual task.
86. Allman J, Hakeem A, Watson K: Two phylogenetic specializations in the human brain. Neuroscientist 2002, 8:335-346.
87. Elston GN, Benavides-Piccione R, DeFelipe J: The pyramidal cell in cognition: a comparative study in human and monkey. J Neurosci 2001, 21:RC163.
88. Schoenemann PT, Sheehan MJ, Glotzer LD: Prefrontal white matter volume is disproportionately larger in humans than in other primates. Nat Neurosci 2005, 8:242-252.
89. Fujii N, Graybiel AM: Representation of action sequence boundaries by macaque prefrontal cortical neurons. Science 2003, 301:1246-1249. Neurons in the prefrontal cortex of the macaque fire in relation to dynamic start-state and end-state computations. The prefrontal cortex thus contains phasic information that marks the transitions in a sequential program"
90. Fujii N, Graybiel AM: Time-varying covariance of neural activities recorded in striatum and frontal cortex as monkeys perform sequential-saccade tasks. Proc Natl Acad Sci USA 2005, 102:9032-9037.
91. Sigala N, Kusunoki M, Nimmo-Smith I, Gaffan D, Duncan J: Hierarchical coding for sequential task events in the monkey prefrontal cortex. Proc Natl Acad Sci USA 2008, 105:11969-11974. Using simultaneous recordings of multiple prefrontal neurons, the authors identify a hierarchical neuronal code, whereby distinct firing patterns label successive events of a complex sequential task. The authors suggest that ''by orthogonal coding, the frontal lobe may control transitions between the discrete steps of a mental program.''
92. Shima K, Isoda M, Mushiake H, Tanji J: Categorization of behavioural sequences in the prefrontal cortex. Nature 2007, 445:315-318.
93. Saga Y, Iba M, Tanji J, Hoshi E: Development of multidimensional representations of task phases in the lateral prefrontal cortex. J Neurosci 2011, 31:10648-10665.
94. Rougier NP, Noelle DC, Braver TS, Cohen JD, O'Reilly RC: Prefrontal cortex and flexible cognitive control: rules without symbols. Proc Natl Acad Sci USA 2005, 102:7338-7343.
95. von Neumann J: The Computer and the Brain. New Haven: Yale University Press; 1958.