What is reinforced by phasic dopamine signals?

Reinforcement Learning: An Introduction

2005 • 27,230 citations

Reinforcement Learning: An Introduction

1998 • 23,138 citations

A Neural Substrate of Prediction and Reward

1997 • 8,991 citations

Parallel Organization of Functionally Segregated Circuits Linking Basal Ganglia and Cortex

1986 • 8,208 citations

Predictive Reward Signal of Dopamine Neurons

1998 • 4,446 citations

Neural systems of reinforcement for drug addiction: from actions to habits to compulsion

2005 • 3,624 citations

Dopamine, learning and motivation

2004 • 3,146 citations

THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS

1996 • 2,415 citations

The debate over dopamine’s role in reward: the case for incentive salience

2006 • 2,256 citations

Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons

2003 • 2,034 citations

A framework for mesencephalic dopamine systems based on predictive Hebbian learning

1996 • 2,003 citations

The merging of the senses

1994 • 1,958 citations

The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory

2005 • 1,895 citations

Behavioral Theories and the Neurophysiology of Reward

2005 • 1,605 citations

Neurons in the orbitofrontal cortex encode economic value

2006 • 1,563 citations

Temporal Difference Models and Reward-Related Learning in the Human Brain

2003 • 1,488 citations

Multiple Dopamine Functions at Different Time Courses

2007 • 1,333 citations

Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal

2005 • 1,279 citations

Multiple reward signals in the brain

2000 • 1,275 citations

Adaptive Coding of Reward Value by Dopamine Neurons

2005 • 1,259 citations

Lateral habenula as a source of negative reward signals in dopamine neurons

2007 • 1,193 citations

The basal ganglia: a vertebrate solution to the selection problem?

1999 • 1,162 citations

Models of Information Processing in the Basal Ganglia

1994 • 1,152 citations

The organization of the ascending catecholamine neuron systems in the rat brain as revealed by the glyoxylic acid fluorescence method.

1974 • 1,130 citations

Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission

2003 • 1,079 citations

Dopamine responses comply with basic assumptions of formal learning theory

2001 • 1,034 citations

Responses of monkey dopamine neurons during learning of behavioral reactions

1992 • 986 citations

Computational roles for dopamine in behavioural control

2004 • 957 citations

Subcortical face processing

2005 • 945 citations

A new view of pain as a homeostatic emotion

2003 • 943 citations

Representation of Action-Specific Reward Values in the Striatum

2005 • 932 citations

Basal ganglia

1998 • 902 citations

The primate amygdala represents the positive and negative value of visual stimuli during learning

2006 • 894 citations

Visual-Motor Function of the Primate Superior Colliculus

1980 • 887 citations

A cellular mechanism of reward-related learning

2001 • 863 citations

State-dependent opioid control of pain

2004 • 852 citations

Disinhibition as a basic process in the expression of striatal functions

1990 • 848 citations

Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus

1986 • 831 citations

Reward, Motivation, and Reinforcement Learning

2002 • 816 citations

Dopamine-mediated regulation of corticostriatal synaptic plasticity

2007 • 802 citations

Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine

2002 • 783 citations

Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli

2004 • 778 citations

The short-latency dopamine signal: a role in discovering novel actions?

2006 • 754 citations

Beyond the Dopamine Receptor

1999 • 742 citations

Dopamine Operates as a Subsecond Modulator of Food Seeking

2004 • 686 citations

The role of the amygdala in human fear: Automatic detection of threat

2005 • 655 citations

The Neuroscience of Mammalian Associative Learning

2004 • 645 citations

A computational model of action selection in the basal ganglia. I. A new functional anatomy

2001 • 618 citations

Parallel incentive processing: an integrated view of amygdala function

2006 • 616 citations

Solving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling

2007 • 603 citations

Event or emergency? Two response systems in the mammalian superior colliculus

1989 • 584 citations

The thalamostriatal system: a highly specific network of the basal ganglia circuitry

2004 • 580 citations

Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons

2004 • 573 citations

Mechanisms for selection of basic motor programs – roles for the striatum and pallidum

2005 • 569 citations

Importance of unpredictability for reward responses in primate dopamine neurons

1994 • 543 citations

Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex

2004 • 539 citations

Visual and oculomotor functions of monkey substantia nigra pars reticulata. I. Relation of visual and auditory responses to saccades

1983 • 517 citations

Is the short-latency dopamine response too short to signal reward error?

1999 • 514 citations

Dopamine-dependent plasticity of corticostriatal synapses

2002 • 509 citations

Midbrain dopamine neurons encode decisions for future action

2006 • 497 citations

Firing modes of midbrain dopamine cells in the freely moving rat

2002 • 494 citations

Dopamine: generalization and bonuses

2002 • 479 citations

Encoding Predicted Outcome and Acquired Value in Orbitofrontal Cortex during Cue Sampling Depends upon Input from Basolateral Amygdala

2003 • 476 citations

Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats

2005 • 473 citations

Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain

2006 • 450 citations

Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network

2005 • 448 citations

Neurons in the Thalamic CM-Pf Complex Supply Striatal Neurons With Information About Behaviorally Significant Sensory Events

2001 • 440 citations

Opponent appetitive-aversive neural processes underlie predictive learning of pain relief

2005 • 433 citations

Monkeys Pay Per View: Adaptive Valuation of Social Images by Rhesus Macaques

2005 • 420 citations

Subcortical loops through the basal ganglia

2005 • 414 citations

The role of prelimbic cortex in instrumental conditioning

2003 • 413 citations

Basal Ganglia Orient Eyes to Reward

2006 • 385 citations

Information processing, dimensionality reduction and reinforcement learning in the basal ganglia

2003 • 383 citations

Dopamine D-1/D-5 Receptor Activation Is Required for Long-Term Potentiation in the Rat Neostriatum In Vitro

2001 • 380 citations

A Physiologically Plausible Model of Action Selection and Oscillatory Activity in the Basal Ganglia

2006 • 362 citations

Neuroanatomy of the oculomotor system.

1988 • 361 citations

Dopaminergic control of synaptic plasticity in the dorsal striatum

2001 • 361 citations

Dopamine and cAMP-regulated phosphoprotein 32 kDa controls both striatal long-term depression and long-term potentiation, opposing forms of synaptic plasticity.

2000 • 345 citations

Corticothalamic projections from layer V cells in rat are collaterals of long-range corticofugal axons

1994 • 334 citations

Dopamine neurons of the monkey midbrain: contingencies of responses to stimuli eliciting immediate behavioral reactions

1990 • 326 citations

Dopamine and cAMP-Regulated Phosphoprotein 32 kDa Controls Both Striatal Long-Term Depression and Long-Term Potentiation, Opposing Forms of Synaptic Plasticity

2000 • 323 citations

Functional properties of monkey caudate neurons. II. Visual and auditory responses

1989 • 319 citations

Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm

2003 • 306 citations

When Things Are Better or Worse than Expected: The Medial Frontal Cortex and the Allocation of Processing Resources

2006 • 306 citations

Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons

2003 • 304 citations

A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour

2001 • 295 citations

Dopamine Neurons Can Represent Context-Dependent Prediction Error

2004 • 293 citations

Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat

1997 • 292 citations

Models of information processing in the basal ganglia

1996 • 292 citations

Neural mechanisms of reward-related motor learning

2003 • 287 citations

Neuroanatomy of the Oculomotor System

2006 • 285 citations

Sequential super-stereotypy of an instinctive fixed action pattern in hyper-dopaminergic mutant mice: a model of obsessive compulsive disorder and Tourette's

2005 • 282 citations

Transient changes in mesolimbic dopamine and their association with ‘reward’

2002 • 282 citations

Single cell studies of the primate putamen

1984 • 280 citations

A direct projection from superior colliculus to substantia nigra for detecting salient visual events

2003 • 279 citations

How Visual Stimuli Activate Dopaminergic Neurons at Short Latency

2005 • 278 citations

Space, time and dopamine

2006 • 276 citations

The tonic/phasic model of dopamine system regulation: its relevance for understanding how stimulant abuse can alter basal ganglia function

1995 • 263 citations

Visual and oculomotor functions of monkey subthalamic nucleus

1992 • 262 citations

Neuropsychiatry of the basal ganglia

2002 • 256 citations

Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus

2003 • 235 citations

Firing properties of substantia nigra dopaminergic neurons in freely moving rats

1985 • 235 citations

Contiguity and contingency in action-effect learning

2004 • 234 citations

Differential morphology of pyramidal tract‐type and intratelencephalically projecting‐type corticostriatal neurons and their intrastriatal terminals in rats

2003 • 232 citations

Evolution of the basal ganglia in tetrapods: a new perspective based on recent studies in amphibians

1998 • 227 citations

Amygdaloid projections to ventromedial striatal subterritories in the primate

2002 • 222 citations

Human Neural Learning Depends on Reward Prediction Errors in the Blocking Paradigm

2005 • 211 citations

Influence of Reward Expectation on Visuospatial Processing in Macaque Lateral Prefrontal Cortex

2002 • 210 citations

Sensorimotor integration in the primate superior colliculus. I. Motor convergence

1987 • 210 citations

An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit

1999 • 202 citations

Dopamine: the salient issue

2004 • 188 citations

Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey

1987 • 184 citations

How parallel is visual processing in the ventral pathway?

2004 • 184 citations

A robot model of the basal ganglia: Behavior and intrinsic processing

2005 • 181 citations

The 28th Bartlett Memorial Lecture Causal learning: An associative analysis

2001 • 175 citations

Neural correlates of decision processes: neural and mental chronometry

2003 • 170 citations

Dopamine-dependent synaptic plasticity in striatum during in vivo development

2001 • 169 citations

GABAergic output of the basal ganglia

2007 • 167 citations

Responses of tonically discharging neurons in the monkey striatum to primary rewards delivered during different behavioral states

1997 • 162 citations

Coding and Monitoring of Motivational Context in the Primate Prefrontal Cortex

2002 • 160 citations

Evolution of the basal ganglia: new perspectives through a comparative approach

2000 • 154 citations

A Theory of the Striatum

1993 • 151 citations

Corticostriatal projections from layer V cells in rat are collaterals of long-range corticofugal axons

1996 • 151 citations

Schizophrenia in Translation: The Presence of Absence: Habenular Regulation of Dopamine Neurons and the Encoding of Negative Outcomes

2005 • 144 citations

Neurotransmitter Organization and Connectivity of the Basal Ganglia in Vertebrates: Implications for the Evolution of Basal Ganglia (Part 1 of 2)

1995 • 144 citations

Prediction Error during Retrospective Revaluation of Causal Associations in Humans

2004 • 140 citations

Activity of single neurons in the monkey amygdala during performance of a visual discrimination task

1992 • 138 citations

Agents of the mind

2005 • 137 citations

Repetitive Behaviors in Monkeys Are Linked to Specific Striatal Activation Patterns

2004 • 135 citations

Comparison of Reward Modulation in the Frontal Eye Field and Caudate of the Macaque

2006 • 128 citations

Increased extracellular dopamine in nucleus accumbens in response to unconditioned and conditioned aversive stimuli: studies using 1 min microdialysis in rats

2004 • 125 citations

On Framing Effects in Decision Making: Linking Lateral versus Medial Orbitofrontal Cortex Activation to Choice Outcome Processing

2006 • 124 citations

Glutamate synaptic inputs to ventral tegmental area neurons in the rat derive primarily from subcortical sources

2007 • 120 citations

Plastic Corticostriatal Circuits for Action Learning

2007 • 117 citations

The 28th Bartlett Memorial Lecture. Causal learning: an associative analysis.

2001 • 109 citations

Sensitivity to Instrumental Contingency Degradation Is Mediated by the Entorhinal Cortex and Its Efferents via the Dorsal Hippocampus

2002 • 109 citations

Non-conscious recognition of emotional body language

2006 • 107 citations

Influences of Rewarding and Aversive Outcomes on Activity in Macaque Lateral Prefrontal Cortex

2006 • 106 citations

Neuronal Signals in the Monkey Basolateral Amygdala during Reward Schedules

2005 • 101 citations

Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat

2006 • 94 citations

Functional anatomy of movement disorders

2000 • 93 citations

Corticostriatal plasticity: life after the depression

2004 • 92 citations

Novel-object place conditioning: behavioral and dopaminergic processes in expression of novelty reward

2002 • 92 citations

Concentration-dependent actions of stimulated dopamine release on neuronal activity in rat striatum

1990 • 87 citations

Unit responses to visual stimuli in the superior colliculus of the unanesthetized, mid-pontine cat.

1968 • 86 citations

A direct projection from superior colliculus to substantia nigra pars compacta in the cat

2005 • 86 citations

Gaze control through superior colliculus: structure and function.

1988 • 86 citations

Prediction Error during Retrospective Revaluation of Causal Associations in HumansfMRI Evidence in Favor of an Associative Model of Learning

2004 • 85 citations

A Possible Role of Midbrain Dopamine Neurons in Short- and Long-Term Adaptation of Saccades to Position-Reward Mapping

2004 • 82 citations

Collateral projections of predorsal bundle cells of the superior colliculus in the rat

1989 • 80 citations

Preference for familiar versus novel stimuli as a function of the familiarity of the environment.

1969 • 69 citations

Phasic activation of substantia nigra and the ventral tegmental area by chemical stimulation of the superior colliculus: an electrophysiological investigation in the rat

2003 • 66 citations

Functional circuitry of the avian basal ganglia: implications for basal ganglia organization in stem amniotes

2002 • 61 citations

Effects of peripheral stimulation on the activity of neurons in the ventral tegmental area, substantia nigra and midbrain reticular formation of rats

1982 • 58 citations

Role of dopamine D₁ and D₂ receptors in novelty-maintained place preference.

1993 • 54 citations

The nigrostriatal DA pathway and Parkinson’s disease

2006 • 52 citations

Rewarding properties of visual stimuli

2005 • 51 citations

Inhibition of neuronal activity of the substantia nigra by noxious stimuli and its modification by the caudate nucleus

1980 • 48 citations

Effect of Removing the Neocortex on the Response to Repeated Sensory Stimulation of Neurones in the Mid-brain

1966 • 47 citations

Pharmacologically induced, subsecond dopamine transients in the caudate–putamen of the anesthetized rat

2006 • 44 citations

Reinforcement delay of one second severely impairs acquisition of brain self-stimulation

1985 • 43 citations

Dopamine neuronal responses in monkeys performing visually cued reward schedules

2006 • 42 citations

In cat four times as many lamina I neurons project to the parabrachial nuclei and twice as many to the periaqueductal gray as to the thalamus

2005 • 40 citations

Collateralization of the tectonigral projection with other major output pathways of superior colliculus in the rat

2006 • 40 citations

An Investigation of Two Mediation Strategies Suitable for Behavioural Control in Animals and Animats

1991 • 30 citations

Release from GABAA receptor-mediated inhibition unmasks interlaminar connection within superior colliculus in anesthetized adult rats

2003 • 22 citations