From recurrent choice to skill learning: A reinforcement-learning model.
Data up to Jan 2025
Total Citations Per Year
Abstract
References (109)
Reinforcement Learning: An Introduction
2005 • 27,230 citations
Reinforcement Learning: An Introduction
1998 • 23,138 citations
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
1986 • 15,232 citations
A Neural Substrate of Prediction and Reward
1997 • 8,991 citations
The Hippocampus as a Cognitive Map
1978 • 8,087 citations
A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement
1972 • 6,687 citations
Learning from delayed rewards
1989 • 5,606 citations
Unified theories of cognition
1991 • 4,508 citations
Classical conditioning II: Current research and theory.
1972 • 4,453 citations
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
2002 • 3,710 citations
A Learning Algorithm for Boltzmann Machines*
1985 • 3,285 citations
The Behavior of Organisms
1938 • 3,256 citations
An Integrated Theory of the Mind.
2004 • 2,809 citations
Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions.
1990 • 2,437 citations
RELATIVE AND ABSOLUTE STRENGTH OF RESPONSE AS A FUNCTION OF FREQUENCY OF REINFORCEMENT1,2
1961 • 2,238 citations
Intransitivity of preferences.
1969 • 2,223 citations
The Atomic Components of Thought
2014 • 2,214 citations
Visual Information Processing
1974 • 2,079 citations
Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons
2003 • 2,034 citations
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
1996 • 2,003 citations
The Hippocampus as a Cognitive Map
1979 • 1,966 citations
Chapter 6 Basal ganglia-thalamocortical circuits: Parallel substrates for motor, oculomotor, “prefrontal” and “limbic” functions
1991 • 1,897 citations
Decision field theory: A dynamic-cognitive approach to decision making in an uncertain environment.
1993 • 1,817 citations
A Neostriatal Habit Learning System in Humans
1996 • 1,789 citations
The Neural Basis of Error Detection: Conflict Monitoring and the Error-Related Negativity.
2004 • 1,773 citations
An adjusting procedure for studying delayed reinforcement.
1987 • 1,648 citations
Stevens' Handbook of Experimental Psychology
2002 • 1,620 citations
Stochastic models for learning.
1955 • 1,540 citations
The Atomic Components of Thought
1999 • 1,481 citations
Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning
1996 • 1,470 citations
Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses
2001 • 1,419 citations
Toward a modern theory of adaptive networks: Expectation and prediction.
1981 • 1,416 citations
A computational theory of executive cognitive processes and multiple-task performance: Part I. Basic mechanisms.
1997 • 1,391 citations
Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task
1993 • 1,279 citations
Models of Information Processing in the Basal Ganglia
1994 • 1,152 citations
Interactive memory systems in the human brain
2001 • 1,124 citations
Learning and Relearning in Boltzmann Machines
2001 • 1,056 citations
Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia
2005 • 1,027 citations
Responses of monkey dopamine neurons during learning of behavioral reactions
1992 • 986 citations
Independent Coding of Reward Magnitude and Valence in the Human Brain
2004 • 901 citations
Proceedings of the 26th annual conference of the cognitive science society
2004 • 827 citations
From conditioning to category learning: An adaptive network model.
1988 • 742 citations
Small feedback‐based decisions and their limited correspondence to description‐based decisions
2003 • 738 citations
A learning algorithm for boltzmann machines
1985 • 616 citations
The Neural Basis of Error Detection: Conflict Monitoring and the Error-Related Negativity.
2004 • 610 citations
From conditioning to category learning: An adaptive network model.
1988 • 587 citations
Feature Article: Distributed Modular Architectures Linking Basal Ganglia, Cerebellum, and Cerebral Cortex: Their Role in Planning and Controlling Action
1995 • 575 citations
The goal-gradient hypothesis and maze learning.
1932 • 563 citations
Importance of unpredictability for reward responses in primate dopamine neurons
1994 • 543 citations
The Science of Self-Control
2000 • 532 citations
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
1994 • 532 citations
PRODUCTION SYSTEMS: MODELS OF CONTROL STRUCTURES
1973 • 526 citations
Production System Models of Learning and Development
1987 • 497 citations
A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena.
1997 • 487 citations
On Adaptation, Maximization, and Reinforcement Learning Among Cognitive Strategies.
2005 • 477 citations
Multiple Model-Based Reinforcement Learning
2002 • 468 citations
Activity in human ventral striatum locked to errors of reward prediction
2002 • 445 citations
Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations
2003 • 433 citations
Negative Time Preference
1991 • 421 citations
An Economist’s Perspective on Probability Matching
2000 • 403 citations
Striatal activation during acquisition of a cognitive skill.
1999 • 400 citations
Tests of an equivalence rule for fixed and variable reinforcer delays.
1984 • 391 citations
Preference reversal and delayed reinforcement
1981 • 376 citations
Learning the temporal dynamics of behavior.
1997 • 371 citations
Studies in Mathematical Psychology.
1964 • 368 citations
The soft constraints hypothesis: A rational analysis approach to resource allocation for interactive behavior.
2006 • 356 citations
The effect of delay and of intervening events on reinforcement value.
1987 • 343 citations
University of California publications in psychology
1976 • 342 citations
Striatal activation during acquisition of a cognitive skill.
1999 • 332 citations
Glutamate infused posttraining into the hippocampus or caudate-putamen differentially strengthens place and response learning
1999 • 295 citations
Book Reviews
2000 • 293 citations
SNIF-ACT: a cognitive model of user navigation on the world wide web
2007 • 266 citations
The concept of the habit-family hierarchy and maze learning: Part II.
1934 • 262 citations
Hyperbolic value addition and general models of animal choice.
2001 • 258 citations
Mathematical principles of reinforcement
1994 • 257 citations
Human Symbol Manipulation Within an Integrated Cognitive Architecture
2005 • 250 citations
Macro-architecture of basal ganglia loops with the cerebral cortex: use of rabies virus to reveal multisynaptic circuits
2004 • 225 citations
SNIF-ACT: A Model of Information Foraging on the World Wide Web
2003 • 192 citations
Substitutability and similarity in binary choices
1969 • 191 citations
The concept of the habit-family hierarchy, and maze learning. Part I.
1934 • 183 citations
The William James Lectures
1963 • 177 citations
Rational Models of Cognition
2015 • 173 citations
Reinforcement, choice, and response strength.
1988 • 172 citations
Discrimination of operator schemata in problem solving: Learning from examples
1985 • 167 citations
Reward-related Signals Carried by Dopamine Neurons
1994 • 152 citations
A Computational Model of Information Processing in the Frontal Cortex and Basal Ganglia
2000 • 150 citations
Dopamine, uncertainty and TD learning
2005 • 146 citations
An adaptive approach to human decision making: Learning theory, decision theory, and human performance.
1992 • 146 citations
Soar-RL: integrating reinforcement learning with Soar
2004 • 132 citations
The effect of adding a constant to all payoffs: experimental investigation, and implications for reinforcement learning models
1999 • 122 citations
Making trade-offs: A probabilistic and context-sensitive model of choice behavior.
2002 • 113 citations
Preferences, prices, and ratings in risky decision making.
1992 • 104 citations
A Computational Role for Dopamine Delivery in Human Decision-Making
1998 • 101 citations
Model-based average reward reinforcement learning
1998 • 99 citations
The process of recurrent choice.
1993 • 89 citations
Traps in the route to models of memory and decision
2002 • 87 citations
Information Processing in Modular Circuits Linking Basal Ganglia and Cerebral Cortex
1994 • 80 citations
Degrees of hunger, reward and non-reward, and maze learning in rats.
1930 • 74 citations
The order of eliminating blinds in maze learning by the rat.
1932 • 40 citations
Planning Ability After Frontal and Temporal Lobe Lesions in Humans: The Effects of Selection Equivocation and Working Memory Load
1997 • 36 citations
A dynamic route finder for the cognitive map.
1998 • 35 citations
Contingent gains and losses in a risk-taking situation
1965 • 30 citations
Proceedings of the sixth international conference on cognitive modeling
2004 • 28 citations
Maze Performance a Function of Motivation and of Reward as well as of Knowledge of the Maze Paths
1930 • 21 citations
Latin America’s prospects in the financial markets
1989 • 16 citations
Memory for Reward in Probabilistic Choice: Markovian and Non-Markovian Properties
1990 • 14 citations
Gain, cost, and event probability as determiners of choice behavior
1964 • 11 citations
Learning Real-time Over-the-shoulder Instructions in a Dynamic Task.
2004 • 8 citations
Concurrent-chain performance in transition: Effects of terminal-link duration and individual reinforcers
2002 • 7 citations