Value learning through reinforcement: The basics of dopamine and reinforcement learning
Daw,N.D. Tobler,P.N.
Daw,N.D.
Tobler,P.N.
Abstract
This chapter provides an overview of reinforcement learning and temporal difference learning and relates these topics to the firing properties of midbrain dopamine neurons. First, we review the RescorlaWagner learning rule and basic learning phenomena, such as blocking, which the rule explains. Then we introduce the basic functional anatomy of the dopamine system and review studies that reveal a close correspondence between responses emitted by dopamine neurons and signals predicted by reinforcement learning. Finally, we introduce the generalization of the RescorlaWagner rule to sequential redictions as provided by temporal difference learning, and discuss its application to phasic activation changes of dopamine neurons. Subsequent chapters in this section deal with more advanced topics in reinforcement learning and presume that the reader is familiar with material covered in this chapter.
Description
Pagination: 560
Date
2013
Journal Title
Journal ISSN
Volume Title
Publisher
Academic Press
Research Projects
Organizational Units
Journal Issue
Keywords
Citation
Daw, N D & Tobler, P N 2013, Value learning through reinforcement : The basics of dopamine and reinforcement learning. in P W Glimcher & E Fehr (eds), Neuroeconomics (2nd edition). Academic Press, Oxford, pp. 283-298.