Dopamine: Generalization and bonuses

Neural Networks

Volumn 15, Issue 4-6, 2002, Pages 549-559

  Kakade, Sham ^a   Dayan, Peter ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Dopamine; Exploration; Generalization; Reinforcement learning; Temporal difference

Indexed keywords

CALCULATIONS; ERRORS; NEUROLOGY;

DOPAMINE;

NEURAL NETWORKS;

DOPAMINE;

DOPAMINERGIC NERVE CELL; DOPAMINERGIC SYSTEM; EXPLORATORY BEHAVIOR; HUMAN; INFORMATION PROCESSING; LEARNING; NONHUMAN; PRIORITY JOURNAL; REVIEW; REWARD; THEORETICAL MODEL; ANIMAL; PHYSIOLOGY;

ANIMALS; DOPAMINE; EXPLORATORY BEHAVIOR; GENERALIZATION (PSYCHOLOGY); HUMANS; REWARD;

EID: 0036592029     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(02)00048-5     Document Type: Article

References (67)

1. Psychobiology of novelty seeking and drug seeking behavior
2. Neuronlike adaptive elements that can solve difficult learning control problems
3. Cognition and control in schizophrenia: A computational model of dopamine and prefrontal function
4. The misbehavior of organisms
5. Properties of the internal clock
6. Behavioral considerations suggest an average reward TD model of the dopamine system
7. Opponent interactions between serotonin and dopamine
8. Motivated reinforcement learning
9. Exploration bonuses and dual control
10. The role of learning in motivation
11. Reinforcement learning in continuous time and space
12. Association between novelty seeking and type 4 dopamine receptor gene in a large Finnish cohort sample
13. Orbitofrontal cortex and representation of incentive value in associative learning
14. Toward a neurobiology of temporal cognition: Advances and challenges
15. Dopamine's role
16. Neural dynamics of attentionally modulated pavlovian conditioning: Conditioned reinforcement, inhibition, and opponent processing
17. Neural dynamics of adaptive timing and temporal discrimination during associative learning
18. An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit
19. The role of an amygdalo-nigrostriatal pathway in associative learning
20. Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects
21. Amygdala circuitry in attentional and representational processes
22. Involvement of dopamine and excitatory amino acid transmission in novelty-induced motor activity
23. Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat
24. A model of how the basal ganglia generate and use neural signals that predict reinforcement
25. Importance of unpredictability for reward responses in primate dopamine neurons
26. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
27. Bee foraging in uncertain environments using predictive hebbian learning
28. A framework for mesencephalic dopamine systems based on predictive hebbian learning
29. Abstract reward and punishment representations in the human orbitofrontal cortex
30. Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain
31. Dopamine D4 receptor gene: Novelty or nonsense?
32. The influence of background stimuli on summation in autoshaping
33. Is the short-latency dopamine response too short to signal reward error?
34. Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task
35. A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement
36. The orbitofrontal cortex and reward
37. The involvement of nucleus accumbens dopamine in appetitive and aversive motivation
38. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning
39. Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning
40. Activity of dopamine neurons in the behaving primate
41. Predictive reward signal of dopamine neurons
42. Dopamine neurons of the monkey midbrain, contingencies of responses to stimuli eliciting immediate behavioral reactions
43. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task
44. A neural substrate of prediction and reward
45. Reward processing in primate orbitofrontal cortex and basal ganglia
46. An opponent-process theory of motivation. I. Temporal dynamics of affect
47. TD models of reward predictive responses in dopamine neurons
48. A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task
49. Learning to predict by the methods of temporal difference
50. Integrated architectures for learning, planning, and reacting based on approximating dynamic programming
51. Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex
52. Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex
53. Dopamine responses comply with basic assumptions of formal learning theory
54. Covert orienting of attention in the rat and the role of striatal dopamine
55. Excitotoxic lesions of the basolateral amygdala impair the acquisition of cocaine-seeking behaviour under a second-order schedule of reinforcement
56. Modulation of memory fields by dopamine D1 receptors in prefrontal cortex