Modeling the role of working memory and episodic memory in behavioral tasks

Reinforcement Learning: An Introduction

2005 • 27,230 citations

Reinforcement Learning: An Introduction

1998 • 23,138 citations

A Neural Substrate of Prediction and Reward

1997 • 8,991 citations

The Psychology of Learning and Motivation: Advances in Research and Theory

2010 • 6,012 citations

Learning from delayed rewards

1989 • 5,606 citations

Working Memory

1974 • 4,629 citations

Episodic Memory: From Mind to Brain

2002 • 4,528 citations

Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning

1999 • 2,931 citations

Simple memory: a theory for archicortex

1971 • 2,722 citations

Cellular basis of working memory

1995 • 2,614 citations

Reverse replay of behavioural sequences in hippocampal place cells during the awake state

2006 • 1,662 citations

Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque

1996 • 1,471 citations

Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming

1990 • 1,358 citations

Models of Information Processing in the Basal Ganglia

1994 • 1,152 citations

A Distributed Representation of Temporal Context

2002 • 1,150 citations

Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia

2005 • 1,027 citations

Hippocampal Neurons Encode Information about Different Types of Memory Episodes Occurring in the Same Location

2000 • 961 citations

Computational roles for dopamine in behavioural control

2004 • 957 citations

Hippocampal conjunctive encoding, storage, and recall: Avoiding a trade‐off

1994 • 915 citations

Distributed representations of structure: A theory of analogical access and mapping.

1997 • 879 citations

The short-latency dopamine signal: a role in discovering novel actions?

2006 • 754 citations

Activity of neurons in anterior inferior temporal cortex during a short- term memory task

1993 • 747 citations

Trajectory Encoding in the Hippocampus and Entorhinal Cortex

2000 • 721 citations

The global record of memory in hippocampal neuronal activity

1999 • 675 citations

Reinforcement learning with replacing eligibility traces

1996 • 576 citations

A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement

1994 • 532 citations

Midbrain dopamine neurons encode decisions for future action

2006 • 497 citations

Contributions of the prefrontal cortex to the neural basis of human decision making

2002 • 497 citations

Reinforcement learning with selective perception and hidden state

1996 • 430 citations

Memory Representation within the Parahippocampal Region

1997 • 379 citations

Hippocampal synaptic plasticity: role in spatial learning or the automatic recording of attended experience?

1997 • 359 citations

The effects of visual stimulation and memory on neurons of the hippocampal formation and the neighboring parahippocampal gyrus and inferior temporal cortex of the primate

1991 • 341 citations

A model of hippocampally dependent navigation, using the temporal difference learning rule

2000 • 292 citations

Hippocampal mechanisms for the context-dependent retrieval of episodes

2005 • 289 citations

Evidence for task-dependent memory dysfunction in the aged monkey

1989 • 269 citations

Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity

2000 • 265 citations

Medial temporal and prefrontal contributions to working memory tasks with novel and familiar stimuli

2001 • 243 citations

The Hippocampus and Disambiguation of Overlapping Sequences

2002 • 233 citations

Neurotoxic Hippocampal Lesions Have No Effect on Odor Span and Little Effect on Odor Recognition Memory But Produce Significant Impairments on Spatial Span, Recognition, and Alternation

2000 • 200 citations

Entorhinal Cortex Lesions Disrupt the Relational Organization of Memory in Monkeys

2004 • 194 citations

Gradual Translocation of Spatial Correlates of Neuronal Firing in the Hippocampus toward Prospective Reward Locations

2006 • 194 citations

Exploring the role of context‐dependent hippocampal activity in spatial alternation behavior

2007 • 170 citations

Computational models of working memory: putting long-term memory into context

2005 • 157 citations

From view cells and place cells to cognitive map learning: processing stages of the hippocampal system

2002 • 152 citations

Hippocampal Sharp Waves and Reactivation during Awake States Depend on Repeated Sequential Experience

2006 • 132 citations

Sequential-Context-Dependent Hippocampal Activity Is Not Necessary to Learn Sequences with Repeated Elements

2005 • 127 citations

Integrating Orbitofrontal Cortex into Prefrontal Theory: Common Processing Themes across Species and Subdivisions

2001 • 125 citations

Spatial Representations of Hippocampal CA1 Neurons Are Modulated by Behavioral Context in a Hippocampus-Dependent Memory Task

2007 • 122 citations

Memory Approaches to Reinforcement Learning in Non-Markovian Domains

1992 • 105 citations

Cholinergic Deafferentation of the Entorhinal Cortex in Rats Impairs Encoding of Novel But Not Familiar Stimuli in a Delayed Nonmatch-to-Sample Task

2005 • 101 citations

Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model

2005 • 98 citations

The hippocampal debate: are we asking the right questions?

2001 • 91 citations

A Model of Prefrontal Cortical Mechanisms for Goal-directed Behavior

2005 • 90 citations

Perirhinal cortex neuronal activity related to long‐term familiarity memory in the macaque

2003 • 78 citations

A Hierarchy of Associations in Hippocampo-Cortical Systems: Cognitive Maps and Navigation Strategies

2005 • 59 citations

Place‐cell firing does not depend on the direction of turn in a Y‐maze alternation task

2001 • 56 citations

Ensemble codes involving hippocampal neurons are at risk during delayed performance tests

1996 • 48 citations

An Integrate-and-fire Model of Prefrontal Cortex Neuronal Activity during Performance of Goal-directed Decision Making

2005 • 45 citations

The role of the hippocampus in the retrieval of a spatial location

2004 • 40 citations

Prefrontal Cortex Lesions Augment the Location-related Firing Properties of Area TE/Perirhinal Cortex Neurons in a Working Memory Task

2001 • 22 citations