A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task

A New Approach to Linear Filtering and Prediction Problems

1960 • 28,714 citations

Reinforcement Learning: An Introduction

2005 • 27,230 citations

A Neural Substrate of Prediction and Reward

1997 • 8,991 citations

The neural basis of drug craving: An incentive-sensitization theory of addiction

1993 • 7,074 citations

A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement

1972 • 6,687 citations

Classical conditioning II: Current research and theory.

1972 • 4,453 citations

Predictive Reward Signal of Dopamine Neurons

1998 • 4,446 citations

Principles of Behavior

1944 • 4,124 citations

Neuronlike adaptive elements that can solve difficult learning control problems

1983 • 3,122 citations

Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex

1989 • 2,677 citations

The organization of learning

1990 • 2,556 citations

Neuron Activity Related to Short-Term Memory

1971 • 2,071 citations

A framework for mesencephalic dopamine systems based on predictive Hebbian learning

1996 • 2,003 citations

Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors

1976 • 1,931 citations

A Neostriatal Habit Learning System in Humans

1996 • 1,789 citations

Toward a modern theory of adaptive networks: Expectation and prediction.

1981 • 1,416 citations

The Basal Ganglia and Adaptive Motor Control

1994 • 1,295 citations

Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task

1993 • 1,279 citations

Dopamine neurons report an error in the temporal prediction of reward during learning

1998 • 1,115 citations

The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones

1990 • 1,021 citations

Responses of monkey dopamine neurons during learning of behavioral reactions

1992 • 986 citations

Contemporary Animal Learning Theory

1982 • 903 citations

Tyrosine hydroxylase-immunoreactive boutons in synaptic contact with identified striatonigral neurons, with particular reference to dendritic spines

1984 • 866 citations

Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli

1996 • 826 citations

COGNITIVE DEFICITS IN THE EARLY STAGES OF PARKINSON'S DISEASE

1983 • 807 citations

TD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level Play

1994 • 798 citations

Neuronal activity in monkey ventral striatum related to the expectation of reward

1992 • 755 citations

Temporal credit assignment in reinforcement learning

1984 • 746 citations

Prefrontal cortical unit activity and delayed alternation performance in monkeys.

1971 • 703 citations

Neuroleptic-Induced "Anhedonia" in Rats: Pimozide Blocks Reward Quality of Food

1978 • 643 citations

The premotor cortex of the monkey

1982 • 564 citations

Projection subtypes of rat neostriatal matrix cells revealed by intracellular injection of biocytin

1990 • 547 citations

Importance of unpredictability for reward responses in primate dopamine neurons

1994 • 543 citations

A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement

1994 • 532 citations

Behavioral functions of nucleus accumbens dopamine: Empirical and conceptual problems with the anhedonia hypothesis

1997 • 525 citations

The Cerebral Cortex of the Rat and Visual Attentional Function: Dissociable Effects of Mediofrontal, Cingulate, Anterior Dorsolateral, and Parietal Cortex Lesions on a Five-Choice Serial Reaction Time Task

1996 • 510 citations

Time-Derivative Models of Pavlovian Reinforcement

1990 • 494 citations

Dendritic spines as individual neuronal compartments for synaptic Ca2+ responses

1991 • 487 citations

Chemical and structural analysis of the relation between cortical inputs and tyrosine hydroxylase-containing terminals in rat neostriatum

1984 • 467 citations

Adaptive Critics and the Basal Ganglia

1994 • 425 citations

Long‐term Potentiation in the Striatum is Unmasked by Removing the Voltage‐dependent Magnesium Block of NMDA Receptor Channels

1992 • 408 citations

Dopamine functions in appetitive and defensive behaviours

1992 • 396 citations

Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey

1986 • 382 citations

Neural dynamics of adaptive timing and temporal discrimination during associative learning

1989 • 368 citations

Learning and Sequential Decision Making

1989 • 354 citations

Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements

1990 • 350 citations

Dopamine neurons of the monkey midbrain: contingencies of responses to stimuli eliciting immediate behavioral reactions

1990 • 326 citations

A neuronal model of classical conditioning

1988 • 323 citations

Bee foraging in uncertain environments using predictive hebbian learning

1995 • 321 citations

THE ROLE OF INTERFERENCE IN ASSOCIATION OVER A DELAY

1971 • 311 citations

Neural dynamics of attentionally modulated Pavlovian conditioning: blocking, interstimulus interval, and secondary reinforcement

1987 • 309 citations

Neuronal activity in monkey striatum related to the expectation of predictable environmental events

1992 • 309 citations

Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex In vitro

1996 • 299 citations

Abnormal Synaptic Plasticity in the Striatum of Mice Lacking Dopamine D2 Receptors

1997 • 279 citations

Delayed-matching and delayed-response deficit from cooling dorsolateral prefrontal cortex in monkeys.

1976 • 276 citations

Behavioral correlates of dopaminergic unit activity in freely moving cats

1983 • 264 citations

Value-dependent selection in the brain: Simulation in a synthetic neural model

1994 • 260 citations

Model of Cortical-Basal Ganglionic Processing: Encoding the Serial Order of Sensory Events

1998 • 242 citations

Supplementary motor area: neuronal response to motor instructions

1980 • 235 citations

Surround inhibition among projection neurons is weak or nonexistent in the rat neostriatum

1994 • 235 citations

Learning of sequential movements by neural network model with dopamine-like reinforcement signal

1998 • 206 citations

Morphological and physiological properties of neostriatal neurons: An intracellular horseradish peroxidase study in the rat

1982 • 198 citations

A conditioned stimulus decreases extracellular dopamine in the nucleus accumbens after the development of a learned taste aversion

1991 • 184 citations

Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey

1987 • 184 citations

Selective neuronal discharge in monkey putamen reflects intended direction of planned limb movements

1987 • 156 citations

Studies of cerebral function in primates. IV. The effects of frontal lobe lesions on the delayed alternation habit in monkeys.

1937 • 152 citations

Cellular Models of Reinforcement

1994 • 143 citations

5-hydroxydopamine-labeled dopaminergic axns: Three-dimensional reconstructions of axons, synapses and postsynaptic targets in rat neostriatum

1994 • 138 citations

Memory for temporal order and conditional associative-learning in patients with Parkinson's disease

1990 • 125 citations

Pimozide-induced suppression of responding: Evidence against a block of food reward

1980 • 117 citations

Context-dependent Activity in Primate Striatum Reflecting Past and Future Behavioral Events

1994 • 111 citations

Substantia nigra dopaminergic unit activity in behaving cats: Effect of arousal on spontaneous discharge and sensory evoked activity

1985 • 109 citations

A predictive reinforcement model of dopamine neurons for learning approach behavior.

1999 • 102 citations

A Model That Accounts for Activity in Primate Frontal Cortex during a Delayed Matching-to-Sample Task

1998 • 95 citations

Associative learning in degenerative neostriatal disorders: Contrasts in explicit and implicit remembering between Parkinson's and huntington's diseases

1995 • 73 citations

Single unit response of noradrenergic, serotonergic and dopaminergic neurons in freely moving cats to simple sensory stimuli

1986 • 62 citations

Neural Correlates of Learning in the Prefrontal Cortex of the Monkey: A Predictive Model

1995 • 52 citations

Selection of a solution containing histidine by rats fed a histidine-imbalanced diet.

1970 • 41 citations

Small Changes in Essential Amino Acid Concentrations Alter Diet Selection in Amino Acid–Deficient Rats

1997 • 37 citations

Learning admittance mappings for force-guided assembly

2002 • 36 citations

Frontal and parietal premovement slow brain potentials in Parkinson's disease and aging

1995 • 23 citations

Using Aperiodic Reinforcement for Directed Self-Organization During Development

1992 • 22 citations

Slow cortical potentials in Parkinsonian patients during the course of an associative learning task

1990 • 17 citations

Reinforcement Learning for Robotic Reaching and Grasping

1993 • 8 citations

Chapter 14 Reinforcement Learning for Robotic Reaching and Grasping

1994 • 4 citations