Direct instrumental conditioning of neural activity using functional magnetic resonance imaging-derived reward feedback

Journal of Neuroscience

Volumn 27, Issue 28, 2007, Pages 7498-7507

  Bray, Signe ^a   Shimojo, Shinsuke ^a   O'Doherty, John P ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Conditioned; Conditioning; Feedback; fMRI; Motor cortex; Operant; Reward

Indexed keywords

ADULT; ARTICLE; CONDITIONING; ELECTROENCEPHALOGRAM; FEEDBACK SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE PROCESSING; MALE; MOTOR CORTEX; NORMAL HUMAN; PRIORITY JOURNAL; REWARD; SOMATOSENSORY CORTEX; TRAINING;

ADULT; BRAIN; CONDITIONING, OPERANT; CUES; FEEDBACK; FEMALE; FINGERS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MOTOR CORTEX; REACTION TIME; REWARD; SOMATOSENSORY CORTEX; TOES;

EID: 34447529154     PISSN: 02706474     EISSN: 02706474     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2118-07.2007     Document Type: Article

References (40)

1. Balleine BW, Dickinson A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37:407-419.
2. Birbaumer N, Kubler A, Ghanayim N, Hinterberger T, Perelmouter J, Kaiser J, Iversen I, Kotchoubey B, Neumann N, Flor H (2000) The thought translation device (TTD) for completely paralyzed patients. IEEE Trans Rehabil Eng 8:190-193.
3. Chen XY, Wolpaw JR (1995) Operant-conditioning of H-reflex in freely moving rats. J Neurophysiol 73:411-415.
4. Cox RW, Jesmanowicz A (1999) Real-time 3D image registration for functional MRI. Magn Reson Med 42:1014-1018.
5. Cox RW, Jesmanowicz A, Hyde JS (1995) Real-time functional magnetic resonance imaging. Magn Reson Med 33:230-236.
6. deCharms RC, Christoff K, Glover GH, Pauly JM, Whitfield S, Gabrieli JDE (2004) Learned regulation of spatially localized brain activation using real-time fMRI. NeuroImage 21:436-443.
7. deCharms RC, Maeda F, Glover GH, Ludlow D, Pauly JM, Soneji D, Gabrieli JDE, Mackey SC (2005) Control over brain activation and pain learned by using real-time functional MRI. Proc Natl Acad Sci USA 102:18626-18631.
8. Ehrsson HH, Geyer S, Naito E (2003) Imagery of voluntary movement of fingers, toes, and tongue activates corresponding body-part-specific motor representations. J Neurophysiol 90:3304-3316.
9. Eickhoff S, Stephan KE, Mohlberg H, Grefkes C, Fink GR, Amunts K, Zilles K (2005) A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. NeuroImage 25:1325-1335.
10. Fetz EE (1969) Operant conditioning of cortical unit activity. Science 163:955-958.
11. Galbicka G (1994) Shaping in the 21st century: moving percentile schedules into applied settings. J Appl Behav Anal 27:739-760.
12. Gembris D, Taylor JG, Schor S, Frings W, Suter D, Posse S (2000) Functional magnetic resonance imaging in real time (FIRE): sliding-window correlation analysis and reference-vector optimization. Magn Reson Med 43:259-268.
13. Gerardin E, Sirigu A, Lehericy S, Poline JB, Gaymard B, Marsault C, Agid Y, Le Bihan D (2000) Partially overlapping neural networks for real and imagined hand movements. Cereb Cortex 10:1093-1104.
14. Gottfried JA, O'Doherty J, Dolan RJ (2002) Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J Neurosci 22:10829-10837.
15. Green PR, Gentle L, Peake TM, Scudamore RE, McGregor PK, Gilbert F, Dittrich WH (1999) Conditioning pigeons to discriminate naturally lit insect specimens. Behav Processes 46:97-102.
16. Hawkins RD, Clark GA, Kandel ER (2006) Operant conditioning of gill withdrawal in Aplysia. J Neurosci 26:2443-2448.
17. Hefferline RF, Keenan B, Harford RA (1959) Escape and avoidance conditioning in human subjects without their observation of the response. Science 130:1338-1339.
18. Keil A, Muller MM, Gruber T, Wienbruch C, Elbert T (2001) Human large-scale oscillatory brain activity during an operant shaping procedure. Cogn Brain Res 12:397-407.
19. Leonardo M, Fieldman J, Sadato N, Campbell G, Ibanez V, Cohen L, Deiber MP, Jezzard P, Pons T, Turner R, LeBihan D, Hallett M (1995) A functional magnetic resonance imaging study of cortical regions associated with motor task execution and motor ideation in humans. Hum Brain Mapp 3:83-92.
20. Ljungberg T, Apicella P, Schultz W (1992) Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67:145-163.
21. Musallam S, Corneil BD, Greger B, Scherberger H, Andersen RA (2004) Cognitive control signals for neural prosthetics. Science 305:258-262.
22. Neuper C, Scherer R, Reiner M, Pfurtscheller G (2005) Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. Cogn Brain Res 25:668-677.
23. Nyberg L, Eriksson J, Larsson A, Marklund P (2005) Learning by doing versus learning by thinking: an fMRI study of motor and mental training. Neuropsychologia 44:711-717.
24. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337.
25. Posse S, Fitzgerald D, Gao KX, Habel U, Rosenberg D, Moore GJ, Schneider F (2003) Real-time fMRI of temporolimbic regions detects amygdala activation during single-trial self-induced sadness. NeuroImage 18:760-768.
26. Samejima K, Ueda Y, Doya K, Kimura M (2005) Representation of action-specific reward values in the striatum. Science 310:1337-1340.
27. Schwartz MS (1995) Biofeedback - a practitioner's guide. New York: Guilford.
28. Skinner BF (1938) The behavior of organisms. New York: Appleton-Century-Crofts.
29. Skinner BF (1953) Science and human behavior. New York: MacMillan.
30. Small W (1901) An experimental study of the mental processes of the rat. Am J Psychol 12:206-239.
31. Stephan KM, Fink GR, Passingham RE, Silbersweig D, Ceballosbaumann AO, Frith CD, Frackowiak RSJ (1995) Functional anatomy of the mental representation of upper extremity movements in healthy subjects. J Neurophysiol 73:373-386.
32. Stinear CM, Byblow WD, Steyvers M, Levin O, Swinnen SP (2006) Kinesthetic, but not visual, motor imagery modulates corticomotor excitability. Exp Brain Res 168:157-164.
33. Svartdal F (1995) When feedback contingencies and rules compete - testing a boundary-condition for verbal control of instrumental performance. Learn Motiv 26:221-238.
34. Thorndike E (1911) Animal intelligence. New York: Macmillan.
35. Weiskopf N, Veit R, Erb M, Mathiak K, Grodd W, Goebel R, Birbaumer N (2003) Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data. NeuroImage 19:577-586.
36. Weiskopf N, Scharnowski F, Veit R, Goebel R, Birbaumer N, Mathiak K (2004) Self-regulation of local brain activity using real-time functional magnetic resonance imaging. J Physiol (Paris) 98:357-373.
37. Yacubian J, Glascher J, Schroeder K, Sommer T, Braus DF, Buchel C (2006) Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J Neurosci 26:9530-9537.
38. Yoo S-S, Jolesz FA (2002) Functional MRI for neurofeedback: feasibility study on hand motor task. NeuroReport 13:1377-1381.
39. Yoo SS, O'Leary HM, Fairneny T, Chen NK, Panych LP, Park H, Jolesz FA (2006) Increasing cortical activity in auditory areas through neuro-feedback functional magnetic resonance imaging. NeuroReport 17:1273-1278.
40. Yousry TA, Schmid UD, Alkadhi H, Schmidt D, Peraud A, Buettner A, Winkler P (1997) Localization of the motor hand area to a knob on the precentral gyrus: a new landmark. Brain 120:141-157.