Reconstructing perceived and retrieved faces from activity patterns in lateral parietal cortex

Journal of Neuroscience

Volumn 36, Issue 22, 2016, Pages 6069-6082

  Lee, Hongmi ^a   Kuhl, Brice A ^b  

^a NEW YORK UNIVERSITY   (United States)

^b UNIVERSITY OF OREGON   (United States)

Author keywords

Angular gyrus; Face perception; MVPA; Reconstruction; Retrieval; Working memory

Indexed keywords

ACCURACY; ADULT; ARTICLE; EIGENFACE; FACE PROFILE; FACIAL EXPRESSION; FACIAL RECOGNITION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE PROCESSING; IMAGE RECONSTRUCTION; IMAGE RETRIEVAL; MALE; NORMAL HUMAN; OCCIPITAL FACE AREA; PARIETAL CORTEX; PATTERN RECOGNITION; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; SCORING SYSTEM; TASK PERFORMANCE; VISUAL DISCRIMINATION; WORKING MEMORY; BLOOD; BRAIN MAPPING; DIAGNOSTIC IMAGING; FACE; HEMISPHERIC DOMINANCE; NUCLEAR MAGNETIC RESONANCE IMAGING; PARIETAL LOBE; PHOTOSTIMULATION; PHYSIOLOGY; RECALL; RECOGNITION; VISION; YOUNG ADULT;

OXYGEN;

ADULT; BRAIN MAPPING; FACE; FEMALE; FUNCTIONAL LATERALITY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MENTAL RECALL; OXYGEN; PARIETAL LOBE; PHOTIC STIMULATION; RECOGNITION (PSYCHOLOGY); VISUAL PERCEPTION; YOUNG ADULT;

EID: 84971655177     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.4286-15.2016     Document Type: Article

References (50)

1. Allison T, Puce A, McCarthy G (2000) Social perception from visual cues: role of the STS region. Trends Cogn Sci 4:267-278
2. Ben-Zvi S, Soroker N, Levy DA (2015) Parietal lesion effects on cued recall following pair associate learning. Neuropsychologia 73:176-194
3. Berryhill ME (2012) Insights from neuropsychology: pinpointing the role of the posterior parietal cortex in episodic and working memory. Front Integr Neurosci 6:31
4. Bettencourt KC, Xu Y (2016) Decoding the content of visual short-term memory under distraction in occipital and parietal areas. Nat Neurosci 19:150-157
5. Binder JR, Desai RH (2011) The neurobiology of semantic memory. Trends Cogn Sci 15:527-536
6. Bird CM, Keidel JL, Ing LP, Horner AJ, Burgess N (2015) Consolidation of complex events via reinstatement in posterior cingulate cortex. J Neurosci 35:14426-14434
7. Brainard DH (1997) The psychophysics toolbox. Spat Vis 10:433-436
8. Cabeza R, Ciaramelli E, Olson IR, Moscovitch M (2008) The parietal cortex and episodic memory: an attentional account. Nat Rev Neurosci 9: 613-625
9. Christophel TB, Haynes JD (2014) Decoding complex flow-field patterns in visual working memory. Neuroimage 91:43-51
10. Christophel TB, Hebart MN, Haynes JD (2012) Decoding the contents of visual short-term memory from human visual and parietal cortex. J Neurosci 32:12983-12989
11. Cowen AS, Chun MM, Kuhl BA (2014) Neural portraits of perception: re-constructing face images from evoked brain activity. Neuroimage 94: 12-22
12. Danker JF, Anderson JR (2010) The ghosts of brain states past: remembering reactivates the brain regions engaged during encoding. Psychol Bull 136:87-102
13. Daselaar SM, Prince SE, Dennis NA, Hayes SM, Kim H, Cabeza R (2009) Posterior midline and ventral parietal activity is associated with retrieval success and encoding failure. Front Hum Neurosci 3:13
14. Destrieux C, Fischl B, Dale A, Halgren E (2010) Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature. Neuroimage 53:1-15
15. Ester EF, Sprague TC, Serences JT (2015) Parietal and frontal cortex encode stimulus-specific mnemonic representations during visual working memory. Neuron 87:893-905
16. Harrison SA, Tong F (2009) Decoding reveals the contents of visual working memory in early visual areas. Nature 458:632-635
17. Huijbers W, Schultz AP, Vannini P, McLaren DG, Wigman SE, Ward AM, Hedden T, Sperling RA (2013) The encoding/retrieval flip: interactions between memory performance and memory stage and relationship to intrinsic cortical net-works. J Cogn Neurosci 25:1163-1179
18. Hutchinson JB, Uncapher MR, Wagner AD (2009) Posterior parietal cortex and episodic retrieval: convergent and divergent effects of attention and memory. Learn Mem 16:343-356
19. Jenkinson M, Smith S (2001) A global optimisation method for robust affine registration of brain images. Med Image Anal 5:143-156
20. Jenkinson M, Bannister P, Brady M, Smith S (2002) Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17:825-841
21. Joassin F, Pesenti M, Maurage P, Verreckt E, Bruyer R, Campanella S (2011) Cross-modal interactions between human faces and voices involved in person recognition. Cortex 47:367-376
22. Konkle T, Brady TF, Alvarez GA, Oliva A (2010) Scene memory is more detailed than you think: the role of categories in visual long-term memory. Psychol Sci 21:1551-1556
23. Kriegeskorte N, Mur M, Bandettini P (2008) Representational similarity analysis: connecting the branches of systems neuroscience. Front Syst Neurosci 2:4
24. Kuhl BA, Chun MM (2014) Successful remembering elicits event-specific activity patterns in lateral parietal cortex. J Neurosci 34:8051-8060
25. Kuhl BA, Johnson MK, Chun MM (2013) Dissociable neural mechanisms for goal-directed versus incidental memory reactivation. J Neurosci 33: 16099-16109
26. Mason W, Suri S (2011) Conducting behavioral research on Amazon’s Mechanical Turk. Behav Res Methods 44:1-23
27. McDonnell J, Martin J, Markant D, Coenen A, Rich A, Gureckis T (2014) psiTurk (Version 2.1.2)[Software]. New York: New York University. https://github.com/NYUCCL/psiTurk.
28. Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24:167-202
29. Naselaris T, Kay KN (2015) Resolving ambiguities of MVPA using explicit models of representation. Trends Cogn Sci 19:551-554
30. Norman KA, Polyn SM, Detre GJ, Haxby JV (2006) Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn Sci 10:424-430
31. Phillips PJ, Wechsler H, Huang J, Rauss PJ (1998) The FERET database and evaluation procedure for face-recognition algorithms. Image Vis Comput 16:295-306
32. Rugg MD, Vilberg KL (2013) Brain networks underlying episodic memory retrieval. Curr Opin Neurobiol 23:255-260
33. Shannon BJ, Buckner RL (2004) Functional-anatomic correlates of memory retrieval that suggest nontraditional processing roles for multiple distinct regions within posterior parietal cortex. J Neurosci 24:10084-10092
34. Shimamura AP (2011) Episodic retrieval and the cortical binding of relational activity. Cogn Affect Behav Neurosci 11:277-291
35. Smith SM (2002) Fast robust automated brain extraction. Hum Brain Mapp 17:143-155
36. Spaniol J, Davidson PS, Kim AS, Han H, Moscovitch M, Grady CL (2009) Event-related fMRI studies of episodic encoding and retrieval: meta-analyses using activation likelihood estimation. Neuropsychologia 47: 1765-1779
37. Sprague TC, Ester EF, Serences JT (2014) Reconstructions of information in visual spatial working memory degrade with memory load. Curr Biol 24:2174-2180
38. Stelzer J, Chen Y, Turner R (2013) Statistical inference and multiple testing correction in classification-based multi-voxel pattern analysis (MVPA): random permutations and cluster size control. Neuroimage 65:69-82
39. St-Laurent M, Abdi H, Buchsbaum BR (2015) Distributed patterns of reac-tivation predict vividness of recollection. J Cogn Neurosci 27:2000-2018
40. Todorov A, Said CP, Engell AD, Oosterhof NN (2008) Understanding eval-uation of faces on social dimensions. Trends Cogn Sci 12:455-460
41. Toth LJ, Assad JA (2002) Dynamic coding of behaviourally relevant stimuli in parietal cortex. Nature 415:165-168
42. Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3:71-86
43. Uddin LQ, Supekar K, Amin H, Rykhlevskaia E, Nguyen DA, Greicius MD, Menon V (2010) Dissociable connectivity within human angular gyrus and intraparietal sulcus: evidence from functional and structural connectivity. Cereb Cortex 20:2636-2646
44. Vannini P, O’Brien J, O’Keefe K, Pihlajamäki M, Laviolette P, Sperling RA (2011) What goes down must come up: role of the posteromedial cortices in encoding and retrieval. Cereb Cortex 21:22-34
45. Vilberg KL, Rugg MD (2008) Memory retrieval and the parietal cortex: a review of evidence from a dual-process perspective. Neuropsychologia 46:1787-1799
46. Wagner AD, Shannon BJ, Kahn I, Buckner RL (2005) Parietal lobe contri-butions to episodic memory retrieval. Trends Cogn Sci 9:445-453
47. Wagner IC, van Buuren M, Kroes MC, Gutteling TP, van der Linden M, Morris RG, Fernández G (2015) Schematic memory components converge within angular gyrus during retrieval. ELife 4:e09668
48. Wang JX, Rogers LM, Gross EZ, Ryals AJ, Dokucu ME, Brandstatt KL, Her-miller MS, Voss JL (2014) Targeted enhancement of cortical-hippocampal brain networks and associative memory. Science 345: 1054-1057
49. Xue G, Dong Q, Chen C, Lu ZL, Mumford JA, Poldrack RA (2013) Complementary role of frontoparietal activity and cortical pattern similarity in successful episodic memory encoding. Cereb Cortex 23:1562-1571
50. Yeo BT, Krienen FM, Sepulcre J, Sabuncu MR, Lashkari D, Hollinshead M, Roffman JL, Smoller JW, Zöllei L, Polimeni JR, Fischl B, Liu H, Buckner RL (2011) The organization of the human cerebral cortex estimated by intrinsic functional connectivity. J Neurophysiol 106:1125-1165