Samuel J Gershman, Arthur B Markman, A Ross Otto. J Exp Psychol Gen 2014
Times Cited: 96
Times Cited: 96
Times Cited
Times Co-cited
Similarity
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.
Nathaniel D Daw, Yael Niv, Peter Dayan. Nat Neurosci 2005
Nathaniel D Daw, Yael Niv, Peter Dayan. Nat Neurosci 2005
68
Model-based influences on humans' choices and striatal prediction errors.
Nathaniel D Daw, Samuel J Gershman, Ben Seymour, Peter Dayan, Raymond J Dolan. Neuron 2011
Nathaniel D Daw, Samuel J Gershman, Ben Seymour, Peter Dayan, Raymond J Dolan. Neuron 2011
66
States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning.
Jan Gläscher, Nathaniel Daw, Peter Dayan, John P O'Doherty. Neuron 2010
Jan Gläscher, Nathaniel Daw, Peter Dayan, John P O'Doherty. Neuron 2010
50
The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive.
A Ross Otto, Samuel J Gershman, Arthur B Markman, Nathaniel D Daw. Psychol Sci 2013
A Ross Otto, Samuel J Gershman, Arthur B Markman, Nathaniel D Daw. Psychol Sci 2013
45
38
Speed/accuracy trade-off between the habitual and the goal-directed processes.
Mehdi Keramati, Amir Dezfouli, Payam Piray. PLoS Comput Biol 2011
Mehdi Keramati, Amir Dezfouli, Payam Piray. PLoS Comput Biol 2011
35
Neural computations underlying arbitration between model-based and model-free learning.
Sang Wan Lee, Shinsuke Shimojo, John P O'Doherty. Neuron 2014
Sang Wan Lee, Shinsuke Shimojo, John P O'Doherty. Neuron 2014
34
Model-based choices involve prospective neural activity.
Bradley B Doll, Katherine D Duncan, Dylan A Simon, Daphna Shohamy, Nathaniel D Daw. Nat Neurosci 2015
Bradley B Doll, Katherine D Duncan, Dylan A Simon, Daphna Shohamy, Nathaniel D Daw. Nat Neurosci 2015
28
Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action.
Bernard W Balleine, John P O'Doherty. Neuropsychopharmacology 2010
Bernard W Balleine, John P O'Doherty. Neuropsychopharmacology 2010
26
Working-memory capacity protects model-based learning from stress.
A Ross Otto, Candace M Raio, Alice Chiang, Elizabeth A Phelps, Nathaniel D Daw. Proc Natl Acad Sci U S A 2013
A Ross Otto, Candace M Raio, Alice Chiang, Elizabeth A Phelps, Nathaniel D Daw. Proc Natl Acad Sci U S A 2013
25
Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans.
Peter Smittenaar, Thomas H B FitzGerald, Vincenzo Romei, Nicholas D Wright, Raymond J Dolan. Neuron 2013
Peter Smittenaar, Thomas H B FitzGerald, Vincenzo Romei, Nicholas D Wright, Raymond J Dolan. Neuron 2013
23
Dopamine enhances model-based over model-free choice behavior.
Klaus Wunderlich, Peter Smittenaar, Raymond J Dolan. Neuron 2012
Klaus Wunderlich, Peter Smittenaar, Raymond J Dolan. Neuron 2012
22
The mixed instrumental controller: using value of information to combine habitual choice and mental simulation.
Giovanni Pezzulo, Francesco Rigoli, Fabian Chersi. Front Psychol 2013
Giovanni Pezzulo, Francesco Rigoli, Fabian Chersi. Front Psychol 2013
22
Neural correlates of forward planning in a spatial decision task in humans.
Dylan Alexander Simon, Nathaniel D Daw. J Neurosci 2011
Dylan Alexander Simon, Nathaniel D Daw. J Neurosci 2011
18
The algorithmic anatomy of model-based evaluation.
Nathaniel D Daw, Peter Dayan. Philos Trans R Soc Lond B Biol Sci 2014
Nathaniel D Daw, Peter Dayan. Philos Trans R Soc Lond B Biol Sci 2014
22
Habitual control of goal selection in humans.
Fiery Cushman, Adam Morris. Proc Natl Acad Sci U S A 2015
Fiery Cushman, Adam Morris. Proc Natl Acad Sci U S A 2015
29
Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning.
Henry H Yin, Barbara J Knowlton, Bernard W Balleine. Eur J Neurosci 2004
Henry H Yin, Barbara J Knowlton, Bernard W Balleine. Eur J Neurosci 2004
17
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates.
B W Balleine, A Dickinson. Neuropharmacology 1998
B W Balleine, A Dickinson. Neuropharmacology 1998
16
Mapping value based planning and extensively trained choice in the human brain.
Klaus Wunderlich, Peter Dayan, Raymond J Dolan. Nat Neurosci 2012
Klaus Wunderlich, Peter Dayan, Raymond J Dolan. Nat Neurosci 2012
16
The ubiquity of model-based reinforcement learning.
Bradley B Doll, Dylan A Simon, Nathaniel D Daw. Curr Opin Neurobiol 2012
Bradley B Doll, Dylan A Simon, Nathaniel D Daw. Curr Opin Neurobiol 2012
16
Bonsai trees in your head: how the pavlovian system sculpts goal-directed choices by pruning decision trees.
Quentin J M Huys, Neir Eshel, Elizabeth O'Nions, Luke Sheridan, Peter Dayan, Jonathan P Roiser. PLoS Comput Biol 2012
Quentin J M Huys, Neir Eshel, Elizabeth O'Nions, Luke Sheridan, Peter Dayan, Jonathan P Roiser. PLoS Comput Biol 2012
15
Determining the neural substrates of goal-directed learning in the human brain.
Vivian V Valentin, Anthony Dickinson, John P O'Doherty. J Neurosci 2007
Vivian V Valentin, Anthony Dickinson, John P O'Doherty. J Neurosci 2007
15
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion.
Barry J Everitt, Trevor W Robbins. Nat Neurosci 2005
Barry J Everitt, Trevor W Robbins. Nat Neurosci 2005
15
Actions, action sequences and habits: evidence that goal-directed and habitual action control are hierarchically organized.
Amir Dezfouli, Bernard W Balleine. PLoS Comput Biol 2013
Amir Dezfouli, Bernard W Balleine. PLoS Comput Biol 2013
15
Cognitive control predicts use of model-based reinforcement learning.
A Ross Otto, Anya Skatova, Seth Madlon-Kay, Nathaniel D Daw. J Cogn Neurosci 2015
A Ross Otto, Anya Skatova, Seth Madlon-Kay, Nathaniel D Daw. J Cogn Neurosci 2015
18
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point.
Adam Johnson, A David Redish. J Neurosci 2007
Adam Johnson, A David Redish. J Neurosci 2007
14
Coordination of actions and habits in the medial prefrontal cortex of rats.
Simon Killcross, Etienne Coutureau. Cereb Cortex 2003
Simon Killcross, Etienne Coutureau. Cereb Cortex 2003
14
Preference by association: how memory mechanisms in the hippocampus bias decisions.
G Elliott Wimmer, Daphna Shohamy. Science 2012
G Elliott Wimmer, Daphna Shohamy. Science 2012
14
Hippocampal place-cell sequences depict future paths to remembered goals.
Brad E Pfeiffer, David J Foster. Nature 2013
Brad E Pfeiffer, David J Foster. Nature 2013
14
Model-based learning protects against forming habits.
Claire M Gillan, A Ross Otto, Elizabeth A Phelps, Nathaniel D Daw. Cogn Affect Behav Neurosci 2015
Claire M Gillan, A Ross Otto, Elizabeth A Phelps, Nathaniel D Daw. Cogn Affect Behav Neurosci 2015
15
Characterizing a psychiatric symptom dimension related to deficits in goal-directed control.
Claire M Gillan, Michal Kosinski, Robert Whelan, Elizabeth A Phelps, Nathaniel D Daw. Elife 2016
Claire M Gillan, Michal Kosinski, Robert Whelan, Elizabeth A Phelps, Nathaniel D Daw. Elife 2016
14
Hierarchically organized behavior and its neural foundations: a reinforcement learning perspective.
Matthew M Botvinick, Yael Niv, Andew G Barto. Cognition 2009
Matthew M Botvinick, Yael Niv, Andew G Barto. Cognition 2009
13
A specific role for posterior dorsolateral striatum in human habit learning.
Elizabeth Tricomi, Bernard W Balleine, John P O'Doherty. Eur J Neurosci 2009
Elizabeth Tricomi, Bernard W Balleine, John P O'Doherty. Eur J Neurosci 2009
13
A framework for mesencephalic dopamine systems based on predictive Hebbian learning.
P R Montague, P Dayan, T J Sejnowski. J Neurosci 1996
P R Montague, P Dayan, T J Sejnowski. J Neurosci 1996
13
The role of the dorsomedial striatum in instrumental conditioning.
Henry H Yin, Sean B Ostlund, Barbara J Knowlton, Bernard W Balleine. Eur J Neurosci 2005
Henry H Yin, Sean B Ostlund, Barbara J Knowlton, Bernard W Balleine. Eur J Neurosci 2005
13
Interplay of approximate planning strategies.
Quentin J M Huys, Níall Lally, Paul Faulkner, Neir Eshel, Erich Seifritz, Samuel J Gershman, Peter Dayan, Jonathan P Roiser. Proc Natl Acad Sci U S A 2015
Quentin J M Huys, Níall Lally, Paul Faulkner, Neir Eshel, Erich Seifritz, Samuel J Gershman, Peter Dayan, Jonathan P Roiser. Proc Natl Acad Sci U S A 2015
18
Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making.
Lorenz Deserno, Quentin J M Huys, Rebecca Boehme, Ralph Buchert, Hans-Jochen Heinze, Anthony A Grace, Raymond J Dolan, Andreas Heinz, Florian Schlagenhauf. Proc Natl Acad Sci U S A 2015
Lorenz Deserno, Quentin J M Huys, Rebecca Boehme, Ralph Buchert, Hans-Jochen Heinze, Anthony A Grace, Raymond J Dolan, Andreas Heinz, Florian Schlagenhauf. Proc Natl Acad Sci U S A 2015
13
Adaptive integration of habits into depth-limited planning defines a habitual-goal-directed spectrum.
Mehdi Keramati, Peter Smittenaar, Raymond J Dolan, Peter Dayan. Proc Natl Acad Sci U S A 2016
Mehdi Keramati, Peter Smittenaar, Raymond J Dolan, Peter Dayan. Proc Natl Acad Sci U S A 2016
17
Habits, action sequences and reinforcement learning.
Amir Dezfouli, Bernard W Balleine. Eur J Neurosci 2012
Amir Dezfouli, Bernard W Balleine. Eur J Neurosci 2012
12
What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?
K Doya. Neural Netw 1999
K Doya. Neural Netw 1999
12
Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates.
Alec Solway, Matthew M Botvinick. Psychol Rev 2012
Alec Solway, Matthew M Botvinick. Psychol Rev 2012
11
Habits as action sequences: hierarchical action control and changes in outcome value.
Amir Dezfouli, Nura W Lingawi, Bernard W Balleine. Philos Trans R Soc Lond B Biol Sci 2014
Amir Dezfouli, Nura W Lingawi, Bernard W Balleine. Philos Trans R Soc Lond B Biol Sci 2014
18
Orbitofrontal cortex as a cognitive map of task space.
Robert C Wilson, Yuji K Takahashi, G Schoenbaum, Yael Niv. Neuron 2014
Robert C Wilson, Yuji K Takahashi, G Schoenbaum, Yael Niv. Neuron 2014
11
Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task.
Thomas Akam, Rui Costa, Peter Dayan. PLoS Comput Biol 2015
Thomas Akam, Rui Costa, Peter Dayan. PLoS Comput Biol 2015
23
Cost-Benefit Arbitration Between Multiple Reinforcement-Learning Systems.
Wouter Kool, Samuel J Gershman, Fiery A Cushman. Psychol Sci 2017
Wouter Kool, Samuel J Gershman, Fiery A Cushman. Psychol Sci 2017
15
Predictive representations can link model-based reinforcement learning to model-free mechanisms.
Evan M Russek, Ida Momennejad, Matthew M Botvinick, Samuel J Gershman, Nathaniel D Daw. PLoS Comput Biol 2017
Evan M Russek, Ida Momennejad, Matthew M Botvinick, Samuel J Gershman, Nathaniel D Daw. PLoS Comput Biol 2017
12
Reverse replay of behavioural sequences in hippocampal place cells during the awake state.
David J Foster, Matthew A Wilson. Nature 2006
David J Foster, Matthew A Wilson. Nature 2006
10
Dissociable roles of ventral and dorsal striatum in instrumental conditioning.
John O'Doherty, Peter Dayan, Johannes Schultz, Ralf Deichmann, Karl Friston, Raymond J Dolan. Science 2004
John O'Doherty, Peter Dayan, Johannes Schultz, Ralf Deichmann, Karl Friston, Raymond J Dolan. Science 2004
10
Co-cited is the co-citation frequency, indicating how many articles cite the article together with the query article. Similarity is the co-citation as percentage of the times cited of the query article or the article in the search results, whichever is the lowest. These numbers are calculated for the last 100 citations when articles are cited more than 100 times.