Control of exploitation-exploration meta-parameter in reinforcement learning

Neural Networks

Volumn 15, Issue 4-6, 2002, Pages 665-687

  Ishii, Shin ^a,b   Yoshida, Wako ^a,b   Yoshimoto, Junichiro ^a,b  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

Attention; Exploitation exploration problem; Neuromodulator; Partially observable Markov decision process; Reinforcement learning

Indexed keywords

BRAIN; NEUROLOGY; SENSORY PERCEPTION;

NEURONS;

NEURAL NETWORKS;

ALGORITHM; COMPUTER SIMULATION; DECISION MAKING; EXPLORATORY BEHAVIOR; INFORMATION PROCESSING; LEARNING; LOCUS CERULEUS; MAZE TEST; NEUROTRANSMISSION; NORADRENERGIC NERVE; PERCEPTION; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; SELECTIVE ATTENTION; TECHNIQUE; ANIMAL; BIOLOGICAL MODEL; BRAIN; HUMAN; PHYSIOLOGY;

ANIMALS; BRAIN; EXPLORATORY BEHAVIOR; HUMANS; LEARNING; MODELS, BIOLOGICAL; REINFORCEMENT (PSYCHOLOGY);

EID: 0036592028     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(02)00056-4     Document Type: Article

References (65)

1. Discharge of noradrenergic locus coeruleus neurons in behaving rats and monkeys suggests a role in vigilance
2. Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task
3. Architecture and intrinsic connections of the pre-frontal cortex in the rhesus monkey
4. Neuronlike elements that can solve difficult learning control problems
5. Conflict monitoring versus selection-for-action in anterior cingulate cortex
6. Anterior cingulate cortex and response conflict: Effects of frequency, inhibition and errors
7. Dorsal anterior cingulate cortex: A role in reward-based decision making
8. Anterior cingulate cortex, error detection, and the online monitoring of performance
9. Electrical coupling synchronizes subthreshold activity in locus coeruleus neurons in vitro from neonatal rat
10. Anterior cingulate and prefrontal cortex: Who's in control?
11. Exploration bonuses and dual control
12. Reinforcement learning in continuous time and space
13. Metalearning, neuromodulation, and emotion
14. Dissociable functions in the medial and lateral orbitofrontal cortex: Evidence from human neuroimaging studies
15. Nucleus locus coeruleus: New evidence of anatomical and physiological specificity
16. A neural system for error detection and compensation
17. Amygdalonigral pathway: An anterograde study in the rat with Phaseolus vulgaris leucoagglutinin (PHA-L)
18. A tutorial on learning with Bayesian networks
19. Neuronal activity in the primate prefrontal cortex in the process of motor selection based on two behavioral rules
20. Synchronous activity in locus coeruleus results from dendritic interactions in pericoerulear regions
21. Motor sequence learning: A study with positron emission tomography
22. Anatomy of motor learning. I. Frontal cortex and attention to action
23. Planning and acting in partially observable stochastic domains
24. Dissociating the role of the medial and lateral anterior prefrontal cortex in human planning
25. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque
26. Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys
27. Prioritized sweeping: Reinforcement learning with less data and less real time
28. Noradrenergic and serotonergic innervation of cortical, thalamic and tectal visual structures in old and new world monkeys
29. Abstract reward and punishment representations in the human orbitofrontal cortex
30. The nucleus accumbens as a complex of functionally distinct neuronal ensembles: An integration of behavioural, electrophysiological and anatomical data
31. Motor areas of the medial wall: A review of their location and functional activation
32. Prominent projections from the anterior cingulate cortex to the locus coeruleus in rhesus monkey
33. Integration of what and where in the primate prefrontal cortex
34. The orbitofrontal cortex
35. Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage
36. On-line model selection based on the variational Bayes
37. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning
38. Predictive reward signal of dopamine neurons
39. A neural substrate of prediction and reward
40. A network model if catecholamine effects: Gain, signal-to-noise ratio, and behavior
41. Role for cingulate motor area cells in voluntary movement selection based on reward
42. The hippocampal formation participates in novel picture encoding: Evidence from functional magnetic resonance imaging
43. Anterior prefrontal cortex mediates rule learning in humans
44. Learning to predict by the methods of temporal differences
45. Behavioral planning in the prefrontal cortex
46. 6-Hydroxydopamine lesions of the nucleus accumbens, but not of the caudate nucleus, attenuate enhanced responding with reward-related stimuli produced by intra-accumbens d-amphetamine
47. Novelty and familiarity activations in PET studies of memory encoding and retrieval
48. The role of locus coeruleus in the regulation of cognitive performance
49. Functional heterogeneity in cingulate cortex: The anterior executive and posterior evaluative regions
50. Dopamine responses comply with basic assumptions of formal learning theory
51. Reward expectancy in primate prefrontal neurons
52. Technical note: Q-learning
53. The effects of stimulus novelty and familiarity on neuronal activity in the amygdala of monkeys performing recognition memory tasks
54. Low doses of accumbens dopamine modulate amygdala suppression of spontaneous exploratory activity in rats