Temporal-Difference Reinforcement Learning with Distributed Representations

Reinforcement Learning: An Introduction

2005 • 27,230 citations

Reinforcement Learning: An Introduction

1998 • 23,138 citations

A Neural Substrate of Prediction and Reward

1997 • 8,991 citations

Parallel Organization of Functionally Segregated Circuits Linking Basal Ganglia and Cortex

1986 • 8,208 citations

A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement

1972 • 6,687 citations

Classical conditioning II: Current research and theory.

1972 • 4,453 citations

Predictive Reward Signal of Dopamine Neurons

1998 • 4,446 citations

Functional architecture of basal ganglia circuits: neural substrates of parallel processing

1990 • 4,029 citations

Separate Neural Systems Value Immediate and Delayed Monetary Rewards

2004 • 3,052 citations

On a routing problem

1958 • 2,601 citations

Getting Formal with Dopamine and Reward

2002 • 2,558 citations

The Psychology of Animal Learning

1976 • 2,451 citations

Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons

2003 • 2,034 citations

A framework for mesencephalic dopamine systems based on predictive Hebbian learning

1996 • 2,003 citations

The psychology of animal learning

1975 • 1,995 citations

Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum

2000 • 1,539 citations

Temporal Difference Models and Reward-Related Learning in the Human Brain

2003 • 1,488 citations

Society for Neuroscience Abstracts

1997 • 1,445 citations

Toward a modern theory of adaptive networks: Expectation and prediction.

1981 • 1,416 citations

Reward representations and reward-related learning in the human brain: insights from neuroimaging

2004 • 1,412 citations

Neuronal Coding of Prediction Errors

2000 • 1,411 citations

Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal

2005 • 1,279 citations

Internally Generated Cell Assembly Sequences in the Rat Hippocampus

2008 • 1,263 citations

Models of Information Processing in the Basal Ganglia

1994 • 1,152 citations

Dopamine neurons report an error in the temporal prediction of reward during learning

1998 • 1,115 citations

Subsecond dopamine release promotes cocaine seeking

2003 • 1,086 citations

Theoretical Neuroscience

2002 • 1,085 citations

Time, rate, and conditioning.

2000 • 1,066 citations

Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues

2000 • 1,062 citations

Markov Chains

1997 • 990 citations

Responses of monkey dopamine neurons during learning of behavioral reactions

1992 • 986 citations

Breakdown of Will

2001 • 933 citations

Representation of Action-Specific Reward Values in the Striatum

2005 • 932 citations

Complementary roles of basal ganglia and cerebellum in learning and motor control

2000 • 908 citations

Impulsive Choice Induced in Rats by Lesions of the Nucleus Accumbens Core

2001 • 908 citations

Measures of impulsivity in cigarette smokers and non-smokers

1999 • 900 citations

Handbook of Learning and Approximate Dynamic Programming

2004 • 848 citations

Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli

1996 • 826 citations

Opponent interactions between serotonin and dopamine

2002 • 821 citations

Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops

2004 • 788 citations

Markov Chains

1999 • 735 citations

What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?

1999 • 729 citations

One hundred years of forgetting: A quantitative description of retention.

1996 • 728 citations

A review of delay-discounting research with humans: relations to drug use and gambling

2006 • 709 citations

Dopamine Operates as a Subsecond Modulator of Food Seeking

2004 • 686 citations

Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens

2007 • 686 citations

Hippocampus and trace conditioning of the rabbit's classically conditioned nictitating membrane response.

1986 • 671 citations

Hyperbolic temporal discounting in social drinkers and problem drinkers.

1998 • 591 citations

Neuroeconomics: cross-currents in research on decision-making

2006 • 560 citations

Hippocampus and trace conditioning of the rabbit's classically conditioned nictitating membrane response.

1986 • 560 citations

Importance of unpredictability for reward responses in primate dopamine neurons

1994 • 543 citations

Pathological gambling severity is associated with impulsivity in a delay discounting procedure

2003 • 509 citations

Addiction as a Computational Process Gone Awry

2004 • 505 citations

Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology

2004 • 504 citations

Dopamine: generalization and bonuses

2002 • 479 citations

Foraging Theory

1987 • 478 citations

Multiple Model-Based Reinforcement Learning

2002 • 468 citations

Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network

2005 • 448 citations

Untitled

2001 • 447 citations

Adaptive Critics and the Basal Ganglia

1994 • 425 citations

A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal-like tasks

1996 • 403 citations

Reconciling reinforcement learning models with behavioral extinction and renewal: Implications for addiction, relapse, and problem gambling.

2007 • 359 citations

Probabilistic Interpretation of Population Codes

1999 • 332 citations

Probabilistic Interpretation of Population Codes

1998 • 316 citations

The temporal precision of reward prediction in dopamine neurons

2008 • 313 citations

Operant Conditioning

2002 • 311 citations

A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task

1999 • 297 citations

On hyperbolic discounting and uncertain hazard rates

1998 • 278 citations

Reinforcement Learning Methods for Continuous-Time Markov Decision Problems

1994 • 261 citations

Hyperbolic value addition and general models of animal choice.

2001 • 258 citations

Low-Serotonin Levels Increase Delayed Reward Discounting in Humans

2008 • 255 citations

Discounting of delayed rewards in opioid-dependent outpatients: Exponential or hyperbolic discounting functions?

1999 • 252 citations

The Role of the Hippocampus in Trace Conditioning: Temporal Discontinuity or Task Difficulty?

2001 • 237 citations

Discounting of delayed health gains and losses by current, never- and ex-smokers of cigarettes

2002 • 233 citations

Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making

2007 • 218 citations

Solving Semi-Markov Decision Problems Using Average Reward Reinforcement Learning

1999 • 212 citations

Coordinated Accumbal Dopamine Release and Neural Activity Drive Goal-Directed Behavior

2007 • 207 citations

Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms

2005 • 205 citations

Statistics of Midbrain Dopamine Neuron Spike Trains in the Awake Primate

2007 • 196 citations

Scalar expectancy theory and choice between delayed rewards.

1988 • 179 citations

Dopamine release is heterogeneous within microenvironments of the rat nucleus accumbens

2007 • 178 citations

Representation and Timing in Theories of the Dopamine System

2006 • 173 citations

Polydrug abuse in heroin addicts: a behavioral economic analysis

1998 • 167 citations

Temporal Difference Model Reproduces Anticipatory Neural Activity

2001 • 167 citations

Hyperbolic temporal discounting in social drinkers and problem drinkers.

1998 • 165 citations

Extinction of Cocaine Self-Administration Reveals Functionally and Temporally Distinct Dopaminergic Signals in the Nucleus Accumbens

2005 • 165 citations

Memory traces of trace memories: neurogenesis, synaptogenesis and awareness

2004 • 164 citations

The precise time course of retention.

1999 • 153 citations

Reward-related Signals Carried by Dopamine Neurons

1994 • 152 citations

Dopamine, uncertainty and TD learning

2005 • 146 citations

Choice, delay, probability, and conditioned reinforcement

1997 • 145 citations

The matching law

1997 • 140 citations

Batch Construction Heuristics and Storage Assignment Strategies for Walk/Ride and Pick Systems

1999 • 108 citations

Normative and Descriptive Models of Decision Making: Time Discounting and Risk Sensitivity

2007 • 103 citations

Discounting of delayed rewards in opioid-dependent outpatients: Exponential or hyperbolic discounting functions?

1999 • 88 citations

Efficient reinforcement learning: computational theories, neuroscience and robotics

2007 • 84 citations

Humans Can Adopt Optimal Discounting Strategy under Real-Time Constraints

2006 • 80 citations

One hundred years of forgetting: A quantitative description of retention.

1996 • 78 citations

Serotonin and the Evaluation of Future Rewards

2007 • 63 citations

Reinforcement learning models of the dopamine system and their behavioral implications

2003 • 63 citations

Inter-module credit assignment in modular reinforcement learning

2003 • 59 citations

Characterizing human psychological adaptations

1997 • 56 citations

Motivated Reinforcement Learning

2002 • 49 citations

Reconstruction of the postsubiculum head direction signal from neural ensembles

2004 • 47 citations

Striosomes and Matrisomes

1991 • 42 citations

Metalearning, neuromodulation, and emotion

2000 • 41 citations

The precise time course of retention.

1999 • 28 citations

Dorsal, ventral, and complete excitotoxic lesions of the hippocampus in rats failed to impair appetitive trace conditioning

2007 • 24 citations

A computational model of hippocampal function in trace conditioning

2008 • 23 citations

Measuring distributed properties of neural representations beyond the decoding of local variables: implications for cognition

2008 • 23 citations

Normative and descriptive models of decision making: time discounting and risk sensitivity

2000 • 23 citations

The formation of neural codes in the hippocampus: trace conditioning as a prototypical paradigm for studying the random recoding hypothesis

2005 • 21 citations

Detecting dynamical changes within a simulated neural ensemble using a measure of representational quality

2003 • 19 citations

Multiple model-based reinforcement learning explains dopamine neuronal activity

2007 • 19 citations

Responses of Monkey Dopamine Neurons to External Stimuli: Changes with Learning

1991 • 12 citations

Neural models of delay discounting.

2010 • 11 citations

Bridging temporal gaps between CS and US in autoshaping: A test of a local context hypothesis

1984 • 9 citations

Adaptive Critics and the Basal Ganglia

1994 • 7 citations

Dopamine and inference about timing

2003 • 5 citations

An economic perspective on addiction and matching

1996 • 5 citations