Back to search

From recurrent choice to skill learning: A reinforcement-learning model.

Data up to Jan 2025

Published2006
Citations153
References109

Total Citations Per Year

Abstract

References (109)

Reinforcement Learning: An Introduction

2005 • 27,230 citations

Reinforcement Learning: An Introduction

1998 • 23,138 citations

Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations

1986 • 15,232 citations

A Neural Substrate of Prediction and Reward

1997 • 8,991 citations

The Hippocampus as a Cognitive Map

1978 • 8,087 citations

A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement

1972 • 6,687 citations

Learning from delayed rewards

1989 • 5,606 citations

Unified theories of cognition

1991 • 4,508 citations

Classical conditioning II: Current research and theory.

1972 • 4,453 citations

The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.

2002 • 3,710 citations

A Learning Algorithm for Boltzmann Machines*

1985 • 3,285 citations

The Behavior of Organisms

1938 • 3,256 citations

An Integrated Theory of the Mind.

2004 • 2,809 citations

Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions.

1990 • 2,437 citations

RELATIVE AND ABSOLUTE STRENGTH OF RESPONSE AS A FUNCTION OF FREQUENCY OF REINFORCEMENT1,2

1961 • 2,238 citations

Intransitivity of preferences.

1969 • 2,223 citations

The Atomic Components of Thought

2014 • 2,214 citations

Visual Information Processing

1974 • 2,079 citations

Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons

2003 • 2,034 citations

A framework for mesencephalic dopamine systems based on predictive Hebbian learning

1996 • 2,003 citations

The Hippocampus as a Cognitive Map

1979 • 1,966 citations

Chapter 6 Basal ganglia-thalamocortical circuits: Parallel substrates for motor, oculomotor, “prefrontal” and “limbic” functions

1991 • 1,897 citations

Decision field theory: A dynamic-cognitive approach to decision making in an uncertain environment.

1993 • 1,817 citations

A Neostriatal Habit Learning System in Humans

1996 • 1,789 citations

The Neural Basis of Error Detection: Conflict Monitoring and the Error-Related Negativity.

2004 • 1,773 citations

An adjusting procedure for studying delayed reinforcement.

1987 • 1,648 citations

Stevens' Handbook of Experimental Psychology

2002 • 1,620 citations

Stochastic models for learning.

1955 • 1,540 citations

The Atomic Components of Thought

1999 • 1,481 citations

Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning

1996 • 1,470 citations

Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses

2001 • 1,419 citations

Toward a modern theory of adaptive networks: Expectation and prediction.

1981 • 1,416 citations

A computational theory of executive cognitive processes and multiple-task performance: Part I. Basic mechanisms.

1997 • 1,391 citations

Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task

1993 • 1,279 citations

Models of Information Processing in the Basal Ganglia

1994 • 1,152 citations

Interactive memory systems in the human brain

2001 • 1,124 citations

Learning and Relearning in Boltzmann Machines

2001 • 1,056 citations

Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia

2005 • 1,027 citations

Responses of monkey dopamine neurons during learning of behavioral reactions

1992 • 986 citations

Independent Coding of Reward Magnitude and Valence in the Human Brain

2004 • 901 citations

Proceedings of the 26th annual conference of the cognitive science society

2004 • 827 citations

From conditioning to category learning: An adaptive network model.

1988 • 742 citations

Small feedback‐based decisions and their limited correspondence to description‐based decisions

2003 • 738 citations

A learning algorithm for boltzmann machines

1985 • 616 citations

The Neural Basis of Error Detection: Conflict Monitoring and the Error-Related Negativity.

2004 • 610 citations

From conditioning to category learning: An adaptive network model.

1988 • 587 citations

Feature Article: Distributed Modular Architectures Linking Basal Ganglia, Cerebellum, and Cerebral Cortex: Their Role in Planning and Controlling Action

1995 • 575 citations

The goal-gradient hypothesis and maze learning.

1932 • 563 citations

Importance of unpredictability for reward responses in primate dopamine neurons

1994 • 543 citations

The Science of Self-Control

2000 • 532 citations

A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement

1994 • 532 citations

PRODUCTION SYSTEMS: MODELS OF CONTROL STRUCTURES

1973 • 526 citations

Production System Models of Learning and Development

1987 • 497 citations

A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena.

1997 • 487 citations

On Adaptation, Maximization, and Reinforcement Learning Among Cognitive Strategies.

2005 • 477 citations

Multiple Model-Based Reinforcement Learning

2002 • 468 citations

Activity in human ventral striatum locked to errors of reward prediction

2002 • 445 citations

Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations

2003 • 433 citations

Negative Time Preference

1991 • 421 citations

An Economist’s Perspective on Probability Matching

2000 • 403 citations

Striatal activation during acquisition of a cognitive skill.

1999 • 400 citations

Tests of an equivalence rule for fixed and variable reinforcer delays.

1984 • 391 citations

Preference reversal and delayed reinforcement

1981 • 376 citations

Learning the temporal dynamics of behavior.

1997 • 371 citations

Studies in Mathematical Psychology.

1964 • 368 citations

The soft constraints hypothesis: A rational analysis approach to resource allocation for interactive behavior.

2006 • 356 citations

The effect of delay and of intervening events on reinforcement value.

1987 • 343 citations

University of California publications in psychology

1976 • 342 citations

Striatal activation during acquisition of a cognitive skill.

1999 • 332 citations

Glutamate infused posttraining into the hippocampus or caudate-putamen differentially strengthens place and response learning

1999 • 295 citations

Book Reviews

2000 • 293 citations

SNIF-ACT: a cognitive model of user navigation on the world wide web

2007 • 266 citations

The concept of the habit-family hierarchy and maze learning: Part II.

1934 • 262 citations

Hyperbolic value addition and general models of animal choice.

2001 • 258 citations

Mathematical principles of reinforcement

1994 • 257 citations

Human Symbol Manipulation Within an Integrated Cognitive Architecture

2005 • 250 citations

Macro-architecture of basal ganglia loops with the cerebral cortex: use of rabies virus to reveal multisynaptic circuits

2004 • 225 citations

SNIF-ACT: A Model of Information Foraging on the World Wide Web

2003 • 192 citations

Substitutability and similarity in binary choices

1969 • 191 citations

The concept of the habit-family hierarchy, and maze learning. Part I.

1934 • 183 citations

The William James Lectures

1963 • 177 citations

Rational Models of Cognition

2015 • 173 citations

Reinforcement, choice, and response strength.

1988 • 172 citations

Discrimination of operator schemata in problem solving: Learning from examples

1985 • 167 citations

Reward-related Signals Carried by Dopamine Neurons

1994 • 152 citations

A Computational Model of Information Processing in the Frontal Cortex and Basal Ganglia

2000 • 150 citations

Dopamine, uncertainty and TD learning

2005 • 146 citations

An adaptive approach to human decision making: Learning theory, decision theory, and human performance.

1992 • 146 citations

Soar-RL: integrating reinforcement learning with Soar

2004 • 132 citations

The effect of adding a constant to all payoffs: experimental investigation, and implications for reinforcement learning models

1999 • 122 citations

Making trade-offs: A probabilistic and context-sensitive model of choice behavior.

2002 • 113 citations

Preferences, prices, and ratings in risky decision making.

1992 • 104 citations

A Computational Role for Dopamine Delivery in Human Decision-Making

1998 • 101 citations

Model-based average reward reinforcement learning

1998 • 99 citations

The process of recurrent choice.

1993 • 89 citations

Traps in the route to models of memory and decision

2002 • 87 citations

Information Processing in Modular Circuits Linking Basal Ganglia and Cerebral Cortex

1994 • 80 citations

Degrees of hunger, reward and non-reward, and maze learning in rats.

1930 • 74 citations

The order of eliminating blinds in maze learning by the rat.

1932 • 40 citations

Planning Ability After Frontal and Temporal Lobe Lesions in Humans: The Effects of Selection Equivocation and Working Memory Load

1997 • 36 citations

A dynamic route finder for the cognitive map.

1998 • 35 citations

Contingent gains and losses in a risk-taking situation

1965 • 30 citations

Proceedings of the sixth international conference on cognitive modeling

2004 • 28 citations

Maze Performance a Function of Motivation and of Reward as well as of Knowledge of the Maze Paths

1930 • 21 citations

Latin America’s prospects in the financial markets

1989 • 16 citations

Memory for Reward in Probabilistic Choice: Markovian and Non-Markovian Properties

1990 • 14 citations

Gain, cost, and event probability as determiners of choice behavior

1964 • 11 citations

Learning Real-time Over-the-shoulder Instructions in a Dynamic Task.

2004 • 8 citations

Concurrent-chain performance in transition: Effects of terminal-link duration and individual reinforcers

2002 • 7 citations

Cited By (0)

Loading...