publication . Article . 2002

Dopamine: generalization and bonuses

Sham M. Kakade; Peter Dayan;
Open Access
  • Published: 11 Oct 2002 Journal: Neural Networks, volume 15, pages 549-559 (issn: 0893-6080, Copyright policy)
  • Publisher: Elsevier BV
Abstract
In the temporal difference model of primate dopamine neurons, their phasic activity reports a prediction error for future reward. This model is supported by a wealth of experimental data. However, in certain circumstances, the activity of the dopamine cells seems anomalous under the model, as they respond in particular ways to stimuli that are not obviously related to predictions of reward. In this paper, we address two important sets of anomalies, those having to do with generalization and novelty. Generalization responses are treated as the natural consequence of partial information; novelty responses are treated by the suggestion that dopamine cells multiplex...
Subjects
free text keywords: Cognitive Neuroscience, Artificial Intelligence, Stimulus (physiology), Novelty, Psychology, Reinforcement learning, Neurotransmitter, chemistry.chemical_compound, chemistry, Neuromodulation, medicine.anatomical_structure, medicine, Dopamine, medicine.drug, Temporal difference learning, Novelty seeking, Neuroscience
Any information missing or wrong?Report an Issue