{"product_id":"distributional-reinforcement-learning-isbn-9780262048019","title":"Distributional Reinforcement Learning","description":"\u003cb\u003eThe first comprehensive guide to distributional reinforcement learning, providing a new mathematical formalism for thinking about decisions from a probabilistic perspective.\u003c\/b\u003e\u003cbr\u003e\u003cbr\u003eDistributional reinforcement learning is a new mathematical formalism for thinking about decisions. Going beyond the common approach to reinforcement learning and expected values, it focuses on the total reward or return obtained as a consequence of an agent's choices—specifically, how this return behaves from a probabilistic perspective. In this first comprehensive guide to distributional reinforcement learning, Marc G. Bellemare, Will Dabney, and Mark Rowland, who spearheaded development of the field, present its key concepts and review some of its many applications. They demonstrate its power to account for many complex, interesting phenomena that arise from interactions with one's environment.\u003cbr\u003e\u003cbr\u003eThe authors present core ideas from classical reinforcement learning to contextualize distributional topics and include mathematical proofs pertaining to major results discussed in the text. They guide the reader through a series of algorithmic and mathematical developments that, in turn, characterize, compute, estimate, and make decisions on the basis of the random return. Practitioners in disciplines as diverse as finance (risk management), computational neuroscience, computational psychiatry, psychology, macroeconomics, and robotics are already using distributional reinforcement learning, paving the way for its expanding applications in mathematical finance, engineering, and the life sciences. More than a mathematical approach, distributional reinforcement learning represents a new perspective on how intelligent agents make predictions and decisions.Preface ix\u003cbr\u003e1 Introduction 1\u003cbr\u003e2 The Distribution of Returns 11\u003cbr\u003e3 Learning the Return Distribution 51\u003cbr\u003e4 Operators and Metrics 77\u003cbr\u003e5 Distributional Dynamic Programming 115\u003cbr\u003e6 Incremental Algorithms 161\u003cbr\u003e7 Control 197\u003cbr\u003e8 Statistical Functionals 233\u003cbr\u003e9 Linear Function Approximation 261\u003cbr\u003e10 Deep Reinforcement Learning 293\u003cbr\u003e11 Two Applications and a Conclusion 319\u003cbr\u003eNotation 333\u003cbr\u003eReferences 337\u003cbr\u003eIndex 365“This important book extends the machinery of reinforcement learning to encompass full outcome statistics. The brain inevitably got there first, but the authors’ brilliant insights show this, how, and why.”\u003cbr\u003e\u003cb\u003e—Peter Dayan, Director, Max Planck Institute for Biological Cybernetics, Tübingen\u003c\/b\u003e\u003cbr\u003e \u003cbr\u003e \u003cbr\u003e“This book shows how reinforcement learning agents can estimate and use full reward distributions to make better decisions. It is a significant enhancement that opens a new range of applications.”\u003cbr\u003e\u003cb\u003e—Andrew Barto, Professor Emeritus, University of Massachusetts Amherst; Co-author \u003ci\u003eReinforcement Learning: An Introduction\u003c\/i\u003e, \u003ci\u003esecond edition\u003c\/i\u003e (MIT Press)\u003c\/b\u003eMarc G. Bellemare is Senior Staff Research Scientist, Google Research and Adjunct Professor, McGill University. Will Dabney is Senior Staff Research Scientist, DeepMind. Mark Rowland is Senior Research Scientist, DeepMind.","brand":"The MIT Press","offers":[{"title":"Default Title","offer_id":46299717927141,"sku":"NP9780262048019","price":60.0,"currency_code":"USD","in_stock":false}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/1842\/7735\/files\/9780262048019.jpg?v=1767725256","url":"https:\/\/k12savings.com\/es\/products\/distributional-reinforcement-learning-isbn-9780262048019","provider":"K12savings","version":"1.0","type":"link"}