Is neuroenhancement by noninvasive brain stimulation a net zero-sum proposition?

NeuroImage

Volumn 85, Issue , 2014, Pages 1058-1068

  Brem, Anna Katharine ^a   Fried, Peter J ^a,b   Horvath, Jared C ^c   Robertson, Edwin M ^a   Pascual Leone, Alvaro ^a,d  

^a BETH ISRAEL DEACONESS MEDICAL CENTER   (United States)

^b BOSTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF MELBOURNE   (Australia)

^d University Institute affiliated with the Autonomous University of Barcelona   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN DEPTH STIMULATION; BRAIN FUNCTION; BRAIN MAPPING; COGNITION; CONCEPTUAL FRAMEWORK; COST BENEFIT ANALYSIS; DECISION MAKING; ENERGY CONSERVATION; FACILITATION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; INDEPENDENT COMPONENT ANALYSIS; LEARNING; MENTAL PERFORMANCE; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NERVE CONDUCTION; NERVE STIMULATION; NET ZERO SUM MODEL; NEUROMODULATION; NONINVASIVE BRAIN STIMULATION; POSTERIOR PARIETAL CORTEX; PRIORITY JOURNAL; REVIEW; TRANSCRANIAL DIRECT CURRENT STIMULATION; TRANSCRANIAL MAGNETIC STIMULATION; WORKING MEMORY;

BIOMEDICAL ENHANCEMENT; BRAIN; COGNITION; ELECTRIC STIMULATION; HUMANS; NEURONAL PLASTICITY; TRANSCRANIAL MAGNETIC STIMULATION;

EID: 84889673829     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2013.07.038     Document Type: Review

References (109)

1. Baddeley A.D. The capacity for generating information by randomization. Q. J. Exp. Psychol. 1966, 18:119-129.
2. Bartolomeo P. Visual neglect. Curr. Opin. Neurol. 2007, 20:381-386.
3. Bartolomeo P., Thiebaut de Schotten M., Doricchi F. Left unilateral neglect as a disconnection syndrome. Cereb. Cortex 2007, 17:2479-2490.
4. Berryhill M.E., Jones K.T. tDCS selectively improves working memory in older adults with more education. Neurosci. Lett. 2012, 521:148-151.
5. Biswal B.B., Yetkin F.Z., Haughton V.M., Hyde J.S. Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn. Reson. Med. 1995, 34:537-541.
6. Bjoertomt O., Cowey A., Walsh V. Spatial neglect in near and far space investigated by repetitive transcranial magnetic stimulation. Brain 2002, 125:2012-2022.
7. Bogacz R., Wagenmakers E.-J., Forstmann B.U., Nieuwenhuis S. The neural basis of the speed-accuracy tradeoff. Trends Neurosci. 2010, 33:10-16.
8. Boggio P.S., Fregni F., Valasek C., Ellwood S., Chi R., Gallate J., Pascual-Leone A., Snyder A. Temporal lobe cortical electrical stimulation during the encoding and retrieval phase reduces false memories. PLoS One 2009, 4:e4959.
9. Brain W.R. Visual disorientation with special reference to lesions of the right cerebral hemisphere. Brain 1941, 64:244-272.
10. Brighina F., Bisiach E., Piazza A., Oliveri M., La Bua V., Daniele O., Fierro B. Perceptual and response bias in visuospatial neglect due to frontal and parietal repetitive transcranial magnetic stimulation in normal subjects. Neuroreport 2002, 13:2571-2575.
11. Brighina F., Bisiach E., Oliveri M., Piazza A., La Bua V., Daniele O., Fierro B. 1Hz repetitive transcranial magnetic stimulation of the unaffected hemisphere ameliorates contralesional visuospatial neglect in humans. Neurosci. Lett. 2003, 336:131-133.
12. Chai X.J., Whitfield-Gabrieli S., Shinn A.K., Gabrieli J.D.E., Nieto Castañón A., McCarthy J.M., Cohen B.M., Ongür D. Abnormal medial prefrontal cortex resting-state connectivity in bipolar disorder and schizophrenia. Neuropsychopharmacology 2011, 36:2009-2017.
13. Chai X.J., Castañón A.N., Ongür D., Whitfield-Gabrieli S. Anticorrelations in resting state networks without global signal regression. NeuroImage 2012, 59:1420-1428.
14. Chatterjee A. Cosmetic neurology: the controversy over enhancing movement, mentation, and mood. Neurology 2004, 63:968-974.
15. Cocchi L., Bramati I.E., Zalesky A., Furukawa E., Fontenelle L.F., Moll J., Tripp G., Mattos P. Altered functional brain connectivity in a non-clinical sample of young adults with attention-deficit/hyperactivity disorder. J. Neurosci. 2012, 32:17753-17761.
16. Cohen D.A., Robertson E.M. Preventing interference between different memory tasks. Nat. Neurosci. 2011, 14:953-955.
17. Corbetta M., Kincade M.J., Lewis C., Snyder A.Z., Sapir A. Neural basis and recovery of spatial attention deficits in spatial neglect. Nat. Neurosci. 2005, 8:1603-1610.
18. Curlik D.M., Shors T.J. Training your brain: do mental and physical (MAP) training enhance cognition through the process of neurogenesis in the hippocampus?. Neuropharmacology 2013, 64:506-514.
19. Dambeck N., Sparing R., Meister I.G., Wienemann M., Weidemann J., Topper R., Boroojerdi B. Interhemispheric imbalance during visuospatial attention investigated by unilateral and bilateral TMS over human parietal cortices. Brain Res. 2006, 1072:194-199.
20. Damoiseaux J.S., Rombouts S.A.R.B., Barkhof F., Scheltens P., Stam C.J., Smith S.M., Beckmann C.F. Consistent resting-state networks across healthy subjects. Proc. Natl. Acad. Sci. U. S. A. 2006, 103:13848-13853.
21. Danckert J., Ferber S. Revisiting unilateral neglect. Neuropsychologia 2006, 44:987-1006.
22. deCharms R.C. Applications of real-time fMRI. Nat. Rev. Neurosci. 2008, 9:720-729.
23. Ditye T., Jacobson L., Walsh V., Lavidor M. Modulating behavioral inhibition by tDCS combined with cognitive training. Exp. Brain Res. 2012, 219:363-368.
24. Eldaief M.C., Halko M.A., Buckner R.L., Pascual-Leone A. Transcranial magnetic stimulation modulates the brain's intrinsic activity in a frequency-dependent manner. Proc. Natl. Acad. Sci. U. S. A. 2011, 108:21229-21234.
25. Evers E.A., Klaassen E.B., Rombouts S.A., Backes W.H., Jolles J. The effects of sustained cognitive task performance on subsequent resting state functional connectivity in healthy young and middle-aged male schoolteachers. Brain Connect. 2012, 2:102-112.
26. Farah M.J., Illes J., Cook-Deegan R., Gardner H., Kandel E., King P., Parens E., Sahakian B., Wolpe P.R. Neurocognitive enhancement: what can we do and what should we do?. Nat. Rev. Neurosci. 2004, 5:421-425.
27. Farah M.J., Haimm C., Sankoorikal G., Smith M.E., Chatterjee A. When we enhance cognition with Adderall, do we sacrifice creativity? A preliminary study. Psychopharmacol. (Berl.) 2009, 202:541-547.
28. Fierro B., Brighina F., Oliveri M., Piazza A., La Bua V., Buffa D., Bisiach E. Contralateral neglect induced by right posterior parietal rTMS in healthy subjects. Neuroreport 2000, 11:1519-1521.
29. Fierro B., Brighina F., Giglia G., Palermo A., Francolini M., Scalia S. Paired pulse TMS over the right posterior parietal cortex modulates visuospatial perception. J. Neurol. Sci. 2006, 247:144-148.
30. Fox M.D., Snyder A.Z., Vincent J.L., Corbetta M., Van Essen D.C., Raichle M.E. The human brain is intrinsically organized into dynamic, anticorrelated functional networks. Proc. Natl. Acad. Sci. U. S. A. 2005, 102:9673-9678.
31. Fregni F., Boggio P.S., Nitsche M., Bermpohl F., Antal A., Feredoes E., Marcolin M.A., Rigonatti S.P., Silva M.T.A., Paulus W., Pascual-Leone A. Anodal transcranial direct current stimulation of prefrontal cortex enhances working memory. Exp. Brain Res. 2005, 166:23-30.
32. Gabrieli J., Whitfield-Gabrieli S. Attention to neglect. Neuron 2007, 53:776-777.
33. Galea J.M., Albert N.B., Ditye T., Miall R.C. Disruption of the dorsolateral prefrontal cortex facilitates the consolidation of procedural skills. J. Cogn. Neurosci. 2010, 22:1158-1164.
34. Gallate J., Chi R., Ellwood S., Snyder A. Reducing false memories by magnetic pulse stimulation. Neurosci. Lett. 2009, 449:151-154.
35. Gammaitoni L., Haenggi P., Jung P., Marchesoni F. Stochastic resonance. Rev. Mod. Phys. 1998, 223-288.
36. Gao W., Lin W. Frontal parietal control network regulates the anti-correlated default and dorsal attention networks. Hum. Brain Mapp. 2012, 33:192-202.
37. Gazzaley A., Nobre A.C. Top-down modulation: bridging selective attention and working memory. Trends Cogn. Sci. (Regul. Ed.) 2012, 16:129-135.
38. Giglia G., Mattaliano P., Puma A., Rizzo S., Fierro B., Brighina F. Neglect-like effects induced by tDCS modulation of posterior parietal cortices in healthy subjects. Brain Stimul. 2011, 4:294-299.
39. Greicius M.D., Krasnow B., Reiss A.L., Menon V. Functional connectivity in the resting brain: a network analysis of the default mode hypothesis. Proc. Natl. Acad. Sci. U. S. A. 2003, 100:253-258.
40. Grüner U., Eggers C., Ameli M., Sarfeld A.-S., Fink G.R., Nowak D.A. 1Hz rTMS preconditioned by tDCS over the primary motor cortex in Parkinson's disease: effects on bradykinesia of arm and hand. J. Neural Transm. 2010, 117:207-216.
41. Gruzelier J., Egner T., Vernon D. Validating the efficacy of neurofeedback for optimising performance. Prog. Brain Res. 2006, 159:421-431.
42. Guse B., Falkai P., Wobrock T. Cognitive effects of high-frequency repetitive transcranial magnetic stimulation: a systematic review. J. Neural Transm. 2010, 117:105-122.
43. Hamilton R., Messing S., Chatterjee A. Rethinking the thinking cap: ethics of neural enhancement using noninvasive brain stimulation. Neurology 2011, 76:187-193.
44. Heitz R.P., Schall J.D. Neural mechanisms of speed-accuracy tradeoff. Neuron 2012, 76:616-628.
45. Hilgetag C.C., Théoret H., Pascual-Leone A. Enhanced visual spatial attention ipsilateral to rTMS-induced "virtual lesions" of human parietal cortex. Nat. Neurosci. 2001, 4:953-957.
46. Iuculano T., Cohen Kadosh R. The mental cost of cognitive enhancement. J. Neurosci. 2013, 33:4482-4486.
47. Ivanoff J., Branning P., Marois R. fMRI evidence for a dual process account of the speed-accuracy tradeoff in decision-making. PLoS One 2008, 3:e2635.
48. Jang J.H., Jung W.H., Kang D.-H., Byun M.S., Kwon S.J., Choi C.-H., Kwon J.S. Increased default mode network connectivity associated with meditation. Neurosci. Lett. 2011, 487:358-362.
49. Jin Y., Hilgetag C.C. Perturbation of visuospatial attention by high-frequency offline rTMS. Exp. Brain Res. 2008, 189:121-128.
50. Kahn I., Pascual-Leone A., Theoret H., Fregni F., Clark D., Wagner A.D. Transient disruption of ventrolateral prefrontal cortex during verbal encoding affects subsequent memory performance. J. Neurophysiol. 2005, 94:688-698.
51. Kahnemann D. Attention and Effort 1973, Prentice Hall, Englewood Cliffs, NJ.
52. Kapur N. Paradoxical functional facilitation in brain-behaviour research. A critical review. Brain 1996, 119(Pt 5):1775-1790.
53. Keeser D., Meindl T., Bor J., Palm U., Pogarell O., Mulert C., Brunelin J., Möller H.-J., Reiser M., Padberg F. Prefrontal transcranial direct current stimulation changes connectivity of resting-state networks during fMRI. J. Neurosci. 2011, 31:15284-15293.
54. Kim B.R., Chun M.H., Kim D.-Y., Lee S.J. The effect of high and low frequency repetitive transcranial magnetic stimulation on visuospatial neglect in acute stroke patients: a double-blind, sham-controlled trial. Arch. Phys. Med. Rehabil. 2013, 94:803-807.
55. Kinsbourne M. A model for the mechanism of unilateral neglect of space. Trans. Am. Neurol. Assoc. 1970, 95:143-146.
56. Kinsbourne M. Direction of gaze and distribution of cerebral thought processes. Neuropsychologia 1974, 12:279-281.
57. Koch G., Oliveri M., Cheeran B., Ruge D., Lo Gerfo E., Salerno S., Torriero S., Marconi B., Mori F., Driver J., Rothwell J.C., Caltagirone C. Hyperexcitability of parietal-motor functional connections in the intact left-hemisphere of patients with neglect. Brain 2008, 131:3147-3155.
58. Kueider A.M., Parisi J.M., Gross A.L., Rebok G.W. Computerized cognitive training with older adults: a systematic review. PLoS One 2012, 7:e40588.
59. Lim J.Y., Kang E.K., Paik N.-J. Repetitive transcranial magnetic stimulation to hemispatial neglect in patients after stroke: an open-label pilot study. J. Rehabil. Med. 2010, 42:447-452.
60. Lomber S.G., Payne B.R. Task-specific reversal of visual hemineglect following bilateral reversible deactivation of posterior parietal cortex: a comparison with deactivation of the superior colliculus. Vis. Neurosci. 2001, 18:487-499.
61. Loo C., Martin D., Pigot M., Arul-Anandam P., Mitchell P., Sachdev P. Transcranial direct current stimulation priming of therapeutic repetitive transcranial magnetic stimulation: a pilot study. J. ECT 2009, 25:256-260.
62. Lu Z.-L., Li X., Tjan B.S., Dosher B.A., Chu W. Attention extracts signal in external noise: a BOLD fMRI study. J. Cogn. Neurosci. 2011, 23:1148-1159.
63. Maher B. Poll results: look who's doping. Nature 2008, 452:674-675.
64. Marshall L., Mölle M., Hallschmid M., Born J. Transcranial direct current stimulation during sleep improves declarative memory. J. Neurosci. 2004, 24:9985-9992.
65. Marshall L., Kirov R., Brade J., Mölle M., Born J. Transcranial electrical currents to probe EEG brain rhythms and memory consolidation during sleep in humans. PLoS One 2011, 6:e16905.
66. Meier T.B., Wildenberg J.C., Liu J., Chen J., Calhoun V.D., Biswal B.B., Meyerand M.E., Birn R.M., Prabhakaran V. Parallel ICA identifies sub-components of resting state networks that covary with behavioral indices. Front. Hum. Neurosci. 2012, 6.
67. Moray N. Where is capacity limited? A survey and a model. Acta Psychol. (Amst.) 1967, 27:84-92.
68. Mottaghy F.M., Krause B.J., Kemna L.J., Töpper R., Tellmann L., Beu M., Pascual-Leone A., Müller-Gärtner H.W. Modulation of the neuronal circuitry subserving working memory in healthy human subjects by repetitive transcranial magnetic stimulation. Neurosci. Lett. 2000, 280:167-170.
69. Müller U., Rowe J.B., Rittman T., Lewis C., Robbins T.W., Sahakian B.J. Effects of modafinil on non-verbal cognition, task enjoyment and creative thinking in healthy volunteers. Neuropharmacology 2013, 64:490-495.
70. Naeser M.A., Martin P.I., Nicholas M., Baker E.H., Seekins H., Kobayashi M., Theoret H., Fregni F., Maria-Tormos J., Kurland J., Doron K.W., Pascual-Leone A. Improved picture naming in chronic aphasia after TMS to part of right Broca's area: an open-protocol study. Brain Lang. 2005, 93:95-105.
71. Najib U., Pascual-Leone A. Paradoxical functional facilitation with noninvasive brain stimulation. Cambridge University Press 2011, 234-260. N. Kapur (Ed.).
72. Nyffeler T., Cazzoli D., Hess C.W., Muri R.M. One session of repeated parietal theta burst stimulation trains induces long-lasting improvement of visual neglect. Stroke 2009, 40:2791-2796.
73. Oliveri M., Bisiach E., Brighina F., Piazza A., La Bua V., Buffa D., Fierro B. rTMS of the unaffected hemisphere transiently reduces contralesional visuospatial hemineglect. Neurology 2001, 57:1338-1340.
74. Pascual-Leone A., Horvath J.C., Robertson E.M. Enhancement of normal cognitive abilities through noninvasive brain stimulation. Cortical Connectivity 2012, 207-249. Springer Berlin Heidelberg, Berlin, Heidelberg. R. Chen, J.C. Rothwell (Eds.).
75. Payne B.R., Rushmore R.J. Functional circuitry underlying natural and interventional cancellation of visual neglect. Exp. Brain Res. 2004, 154:127-153.
76. Posner M.I., Rossman E. Effect of size and location of informational transforms upon short-term retention. J. Exp. Psychol. 1965, 70:496-505.
77. Posner M.I., Walker J.A., Friedrich F.J., Rafal R.D. Effects of parietal injury on covert orienting of attention. J. Neurosci. 1984, 4:1863-1874.
78. Reichenbach A., Whittingstall K., Thielscher A. Effects of transcranial magnetic stimulation on visual evoked potentials in a visual suppression task. NeuroImage 2011, 54:1375-1384.
79. Reis J., Schambra H.M., Cohen L.G., Buch E.R., Fritsch B., Zarahn E., Celnik P.A., Krakauer J.W. Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation. Proc. Natl. Acad. Sci. U. S. A. 2009, 106:1590-1595.
80. Repantis D., Schlattmann P., Laisney O., Heuser I. Modafinil and methylphenidate for neuroenhancement in healthy individuals: a systematic review. Pharmacol. Res. 2010, 62:187-206.
81. Romei V., Driver J., Schyns P.G., Thut G. Rhythmic TMS over parietal cortex links distinct brain frequencies to global versus local visual processing. Curr. Biol. 2011, 21:334-337.
82. Rossi S., Hallett M., Rossini P.M., Pascual-Leone A. Safety, ethical considerations, and application guidelines for the use of transcranial magnetic stimulation in clinical practice and research. Clin. Neurophysiol. 2009, 120:2008-2039.
83. Sala-Llonch R., Peña-Gómez C., Arenaza-Urquijo E.M., Vidal-Piñeiro D., Bargalló N., Junqué C., Bartrés-Faz D. Brain connectivity during resting state and subsequent working memory task predicts behavioural performance. Cortex 2011, 48:1187-1196.
84. Saxe R., Wexler A. Making sense of another mind: the role of the right temporo-parietal junction. Neuropsychologia 2005, 43:1391-1399.
85. Schlee W., Leirer V., Kolassa I.-T., Weisz N., Elbert T. Age-related changes in neural functional connectivity and its behavioral relevance. BMC Neurosci. 2012, 13.
86. Schwarzkopf D.S., Silvanto J., Rees G. Stochastic resonance effects reveal the neural mechanisms of transcranial magnetic stimulation. J. Neurosci. 2011, 31:3143-3147.
87. Shehzad Z., Kelly A.M.C., Reiss P.T., Gee D.G., Gotimer K., Uddin L.Q., Lee S.H., Margulies D.S., Roy A.K., Biswal B.B., Petkova E., Castellanos F.X., Milham M.P. The resting brain: unconstrained yet reliable. Cereb. Cortex 2009, 19:2209-2229.
88. Shindo K., Sugiyama K., Huabao L., Nishijima K., Kondo T., Izumi S.-I. Long-term effect of low-frequency repetitive transcranial magnetic stimulation over the unaffected posterior parietal cortex in patients with unilateral spatial neglect. J. Rehabil. Med. 2006, 38:65-67.
89. Silvanto J., Pascual-Leone A. State-dependency of transcranial magnetic stimulation. Brain Topogr. 2008, 21:1-10.
90. Silvanto J., Muggleton N.G., Cowey A., Walsh V. Neural adaptation reveals state-dependent effects of transcranial magnetic stimulation. Eur. J. Neurosci. 2007, 25:1874-1881.
91. Smith S.M., Miller K.L., Moeller S., Xu J., Auerbach E.J., Woolrich M.W., Beckmann C.F., Jenkinson M., Andersson J., Glasser M.F., Van Essen D.C., Feinberg D.A., Yacoub E.S., Ugurbil K. Temporally-independent functional modes of spontaneous brain activity. Proc. Natl. Acad. Sci. U. S. A. 2012, 109:3131-3136.
92. Song W., Du B., Xu Q., Hu J., Wang M., Luo Y. Low-frequency transcranial magnetic stimulation for visual spatial neglect: a pilot study. J. Rehabil. Med. 2009, 41:162-165.
93. Sparing R., Mottaghy F.M. Noninvasive brain stimulation with transcranial magnetic or direct current stimulation (TMS/tDCS)-From insights into human memory to therapy of its dysfunction. Methods 2008, 44:329-337.
94. Sparing R., Thimm M., Hesse M.D., Küst J., Karbe H., Fink G.R. Bidirectional alterations of interhemispheric parietal balance by non-invasive cortical stimulation. Brain 2009, 132:3011-3020.
95. Sprague J.M. Interaction of cortex and superior colliculus in mediation of visually guided behavior in the cat. Science 1966, 153:1544-1547.
96. Sprague J.M. Neural mechanisms of visual orienting responses. Prog. Brain Res. 1996, 112:1-15.
97. Stern Y. What is cognitive reserve? Theory and research application of the reserve concept. J. Int. Neuropsychol. Soc. 2002, 8:448-460.
98. Stern Y. Cognitive reserve. Neuropsychologia 2009, 47:2015-2028.
99. Takeuchi N., Tada T., Matsuo Y., Ikoma K. Low-frequency repetitive TMS plus anodal transcranial DCS prevents transient decline in bimanual movement induced by contralesional inhibitory rTMS after stroke. Neurorehabil. Neural Repair 2012, 26:988-998.
100. Terry S. Learning and Memory 2008, Pearson. 4th ed.
101. Thut G., Schyns P.G., Gross J. Entrainment of perceptually relevant brain oscillations by non-invasive rhythmic stimulation of the human brain. Front. Psychol. 2011, 2:170.
102. Uddin L.Q., Clare Kelly A.M., Biswal B.B., Xavier Castellanos F., Milham M.P. Functional connectivity of default mode network components: correlation, anticorrelation, and causality. Hum. Brain Mapp. 2008, 30:625-637.
103. Utz K.S., Dimova V., Oppenländer K., Kerkhoff G. Electrified minds: transcranial direct current stimulation (tDCS) and galvanic vestibular stimulation (GVS) as methods of non-invasive brain stimulation in neuropsychology-a review of current data and future implications. Neuropsychologia 2010, 48:2789-2810.
104. Vallar G., Bolognini N. Behavioural facilitation following brain stimulation: implications for neurorehabilitation. Neuropsychol. Rehabil. 2011, 21:618-649.
105. Vuilleumier P., Hester D., Assal G., Regli F. Unilateral spatial neglect recovery after sequential strokes. Neurology 1996, 46:184-189.
106. Waites A.B., Stanislavsky A., Abbott D.F., Jackson G.D. Effect of prior cognitive state on resting state networks measured with functional connectivity. Hum. Brain Mapp. 2005, 24:59-68.
107. Weddell A.R. Subcortical modulation of spatial attention including evidence that the Sprague effect extends to man. Brain Cogn. 2004, 55:497-506.
108. Xiong G.L., Doraiswamy P.M. Does meditation enhance cognition and brain plasticity?. Ann. N. Y. Acad. Sci. 2009, 1172:63-69.
109. Zaehle T., Sandmann P., Thorne J.D., Jäncke L., Herrmann C.S. Transcranial direct current stimulation of the prefrontal cortex modulates working memory performance: combined behavioural and electrophysiological evidence. BMC Neurosci. 2011, 12.