Bradley B Doll, Katherine D Duncan, Dylan A Simon, Daphna Shohamy, Nathaniel D Daw. Nat Neurosci 2015
Times Cited: 129
Times Cited: 129
Times Cited
Times Co-cited
Similarity
Model-based influences on humans' choices and striatal prediction errors.
Nathaniel D Daw, Samuel J Gershman, Ben Seymour, Peter Dayan, Raymond J Dolan. Neuron 2011
Nathaniel D Daw, Samuel J Gershman, Ben Seymour, Peter Dayan, Raymond J Dolan. Neuron 2011
69
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.
Nathaniel D Daw, Yael Niv, Peter Dayan. Nat Neurosci 2005
Nathaniel D Daw, Yael Niv, Peter Dayan. Nat Neurosci 2005
54
Neural computations underlying arbitration between model-based and model-free learning.
Sang Wan Lee, Shinsuke Shimojo, John P O'Doherty. Neuron 2014
Sang Wan Lee, Shinsuke Shimojo, John P O'Doherty. Neuron 2014
41
38
States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning.
Jan Gläscher, Nathaniel Daw, Peter Dayan, John P O'Doherty. Neuron 2010
Jan Gläscher, Nathaniel Daw, Peter Dayan, John P O'Doherty. Neuron 2010
37
Working-memory capacity protects model-based learning from stress.
A Ross Otto, Candace M Raio, Alice Chiang, Elizabeth A Phelps, Nathaniel D Daw. Proc Natl Acad Sci U S A 2013
A Ross Otto, Candace M Raio, Alice Chiang, Elizabeth A Phelps, Nathaniel D Daw. Proc Natl Acad Sci U S A 2013
23
Retrospective revaluation in sequential decision making: a tale of two systems.
Samuel J Gershman, Arthur B Markman, A Ross Otto. J Exp Psychol Gen 2014
Samuel J Gershman, Arthur B Markman, A Ross Otto. J Exp Psychol Gen 2014
22
Speed/accuracy trade-off between the habitual and the goal-directed processes.
Mehdi Keramati, Amir Dezfouli, Payam Piray. PLoS Comput Biol 2011
Mehdi Keramati, Amir Dezfouli, Payam Piray. PLoS Comput Biol 2011
22
The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive.
A Ross Otto, Samuel J Gershman, Arthur B Markman, Nathaniel D Daw. Psychol Sci 2013
A Ross Otto, Samuel J Gershman, Arthur B Markman, Nathaniel D Daw. Psychol Sci 2013
22
Characterizing a psychiatric symptom dimension related to deficits in goal-directed control.
Claire M Gillan, Michal Kosinski, Robert Whelan, Elizabeth A Phelps, Nathaniel D Daw. Elife 2016
Claire M Gillan, Michal Kosinski, Robert Whelan, Elizabeth A Phelps, Nathaniel D Daw. Elife 2016
21
Habitual control of goal selection in humans.
Fiery Cushman, Adam Morris. Proc Natl Acad Sci U S A 2015
Fiery Cushman, Adam Morris. Proc Natl Acad Sci U S A 2015
31
Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action.
Bernard W Balleine, John P O'Doherty. Neuropsychopharmacology 2010
Bernard W Balleine, John P O'Doherty. Neuropsychopharmacology 2010
19
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point.
Adam Johnson, A David Redish. J Neurosci 2007
Adam Johnson, A David Redish. J Neurosci 2007
18
Dopamine enhances model-based over model-free choice behavior.
Klaus Wunderlich, Peter Smittenaar, Raymond J Dolan. Neuron 2012
Klaus Wunderlich, Peter Smittenaar, Raymond J Dolan. Neuron 2012
18
Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task.
Thomas Akam, Rui Costa, Peter Dayan. PLoS Comput Biol 2015
Thomas Akam, Rui Costa, Peter Dayan. PLoS Comput Biol 2015
40
Cost-Benefit Arbitration Between Multiple Reinforcement-Learning Systems.
Wouter Kool, Samuel J Gershman, Fiery A Cushman. Psychol Sci 2017
Wouter Kool, Samuel J Gershman, Fiery A Cushman. Psychol Sci 2017
25
Actions, action sequences and habits: evidence that goal-directed and habitual action control are hierarchically organized.
Amir Dezfouli, Bernard W Balleine. PLoS Comput Biol 2013
Amir Dezfouli, Bernard W Balleine. PLoS Comput Biol 2013
17
Preference by association: how memory mechanisms in the hippocampus bias decisions.
G Elliott Wimmer, Daphna Shohamy. Science 2012
G Elliott Wimmer, Daphna Shohamy. Science 2012
17
Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans.
Peter Smittenaar, Thomas H B FitzGerald, Vincenzo Romei, Nicholas D Wright, Raymond J Dolan. Neuron 2013
Peter Smittenaar, Thomas H B FitzGerald, Vincenzo Romei, Nicholas D Wright, Raymond J Dolan. Neuron 2013
16
Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making.
Lorenz Deserno, Quentin J M Huys, Rebecca Boehme, Ralph Buchert, Hans-Jochen Heinze, Anthony A Grace, Raymond J Dolan, Andreas Heinz, Florian Schlagenhauf. Proc Natl Acad Sci U S A 2015
Lorenz Deserno, Quentin J M Huys, Rebecca Boehme, Ralph Buchert, Hans-Jochen Heinze, Anthony A Grace, Raymond J Dolan, Andreas Heinz, Florian Schlagenhauf. Proc Natl Acad Sci U S A 2015
16
When Does Model-Based Control Pay Off?
Wouter Kool, Fiery A Cushman, Samuel J Gershman. PLoS Comput Biol 2016
Wouter Kool, Fiery A Cushman, Samuel J Gershman. PLoS Comput Biol 2016
32
From Creatures of Habit to Goal-Directed Learners: Tracking the Developmental Emergence of Model-Based Reinforcement Learning.
Johannes H Decker, A Ross Otto, Nathaniel D Daw, Catherine A Hartley. Psychol Sci 2016
Johannes H Decker, A Ross Otto, Nathaniel D Daw, Catherine A Hartley. Psychol Sci 2016
17
Hippocampal place-cell sequences depict future paths to remembered goals.
Brad E Pfeiffer, David J Foster. Nature 2013
Brad E Pfeiffer, David J Foster. Nature 2013
15
The algorithmic anatomy of model-based evaluation.
Nathaniel D Daw, Peter Dayan. Philos Trans R Soc Lond B Biol Sci 2014
Nathaniel D Daw, Peter Dayan. Philos Trans R Soc Lond B Biol Sci 2014
18
Human Orbitofrontal Cortex Represents a Cognitive Map of State Space.
Nicolas W Schuck, Ming Bo Cai, Robert C Wilson, Yael Niv. Neuron 2016
Nicolas W Schuck, Ming Bo Cai, Robert C Wilson, Yael Niv. Neuron 2016
15
Model-based learning protects against forming habits.
Claire M Gillan, A Ross Otto, Elizabeth A Phelps, Nathaniel D Daw. Cogn Affect Behav Neurosci 2015
Claire M Gillan, A Ross Otto, Elizabeth A Phelps, Nathaniel D Daw. Cogn Affect Behav Neurosci 2015
16
Learning the value of information in an uncertain world.
Timothy E J Behrens, Mark W Woolrich, Mark E Walton, Matthew F S Rushworth. Nat Neurosci 2007
Timothy E J Behrens, Mark W Woolrich, Mark E Walton, Matthew F S Rushworth. Nat Neurosci 2007
14
By carrot or by stick: cognitive reinforcement learning in parkinsonism.
Michael J Frank, Lauren C Seeberger, Randall C O'reilly. Science 2004
Michael J Frank, Lauren C Seeberger, Randall C O'reilly. Science 2004
14
Orbitofrontal cortex as a cognitive map of task space.
Robert C Wilson, Yuji K Takahashi, G Schoenbaum, Yael Niv. Neuron 2014
Robert C Wilson, Yuji K Takahashi, G Schoenbaum, Yael Niv. Neuron 2014
14
Determining the neural substrates of goal-directed learning in the human brain.
Vivian V Valentin, Anthony Dickinson, John P O'Doherty. J Neurosci 2007
Vivian V Valentin, Anthony Dickinson, John P O'Doherty. J Neurosci 2007
14
Disorders of compulsivity: a common bias towards learning habits.
V Voon, K Derbyshire, C Rück, M A Irvine, Y Worbe, J Enander, L R N Schreiber, C Gillan, N A Fineberg, B J Sahakian,[...]. Mol Psychiatry 2015
V Voon, K Derbyshire, C Rück, M A Irvine, Y Worbe, J Enander, L R N Schreiber, C Gillan, N A Fineberg, B J Sahakian,[...]. Mol Psychiatry 2015
14
Bonsai trees in your head: how the pavlovian system sculpts goal-directed choices by pruning decision trees.
Quentin J M Huys, Neir Eshel, Elizabeth O'Nions, Luke Sheridan, Peter Dayan, Jonathan P Roiser. PLoS Comput Biol 2012
Quentin J M Huys, Neir Eshel, Elizabeth O'Nions, Luke Sheridan, Peter Dayan, Jonathan P Roiser. PLoS Comput Biol 2012
14
Variability in Dopamine Genes Dissociates Model-Based and Model-Free Reinforcement Learning.
Bradley B Doll, Kevin G Bath, Nathaniel D Daw, Michael J Frank. J Neurosci 2016
Bradley B Doll, Kevin G Bath, Nathaniel D Daw, Michael J Frank. J Neurosci 2016
28
Adaptive integration of habits into depth-limited planning defines a habitual-goal-directed spectrum.
Mehdi Keramati, Peter Smittenaar, Raymond J Dolan, Peter Dayan. Proc Natl Acad Sci U S A 2016
Mehdi Keramati, Peter Smittenaar, Raymond J Dolan, Peter Dayan. Proc Natl Acad Sci U S A 2016
19
The ubiquity of model-based reinforcement learning.
Bradley B Doll, Dylan A Simon, Nathaniel D Daw. Curr Opin Neurobiol 2012
Bradley B Doll, Dylan A Simon, Nathaniel D Daw. Curr Opin Neurobiol 2012
14
Hierarchically organized behavior and its neural foundations: a reinforcement learning perspective.
Matthew M Botvinick, Yael Niv, Andew G Barto. Cognition 2009
Matthew M Botvinick, Yael Niv, Andew G Barto. Cognition 2009
13
Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning.
Henry H Yin, Barbara J Knowlton, Bernard W Balleine. Eur J Neurosci 2004
Henry H Yin, Barbara J Knowlton, Bernard W Balleine. Eur J Neurosci 2004
13
Neural correlates of forward planning in a spatial decision task in humans.
Dylan Alexander Simon, Nathaniel D Daw. J Neurosci 2011
Dylan Alexander Simon, Nathaniel D Daw. J Neurosci 2011
13
The expected value of control: an integrative theory of anterior cingulate cortex function.
Amitai Shenhav, Matthew M Botvinick, Jonathan D Cohen. Neuron 2013
Amitai Shenhav, Matthew M Botvinick, Jonathan D Cohen. Neuron 2013
13
Cognitive control predicts use of model-based reinforcement learning.
A Ross Otto, Anya Skatova, Seth Madlon-Kay, Nathaniel D Daw. J Cogn Neurosci 2015
A Ross Otto, Anya Skatova, Seth Madlon-Kay, Nathaniel D Daw. J Cogn Neurosci 2015
16
Organizing conceptual knowledge in humans with a gridlike code.
Alexandra O Constantinescu, Jill X O'Reilly, Timothy E J Behrens. Science 2016
Alexandra O Constantinescu, Jill X O'Reilly, Timothy E J Behrens. Science 2016
13
The role of the dorsomedial striatum in instrumental conditioning.
Henry H Yin, Sean B Ostlund, Barbara J Knowlton, Bernard W Balleine. Eur J Neurosci 2005
Henry H Yin, Sean B Ostlund, Barbara J Knowlton, Bernard W Balleine. Eur J Neurosci 2005
13
The successor representation in human reinforcement learning.
I Momennejad, E M Russek, J H Cheong, M M Botvinick, N D Daw, S J Gershman. Nat Hum Behav 2017
I Momennejad, E M Russek, J H Cheong, M M Botvinick, N D Daw, S J Gershman. Nat Hum Behav 2017
14
The hippocampus as a predictive map.
Kimberly L Stachenfeld, Matthew M Botvinick, Samuel J Gershman. Nat Neurosci 2017
Kimberly L Stachenfeld, Matthew M Botvinick, Samuel J Gershman. Nat Neurosci 2017
13
Interplay of approximate planning strategies.
Quentin J M Huys, Níall Lally, Paul Faulkner, Neir Eshel, Erich Seifritz, Samuel J Gershman, Peter Dayan, Jonathan P Roiser. Proc Natl Acad Sci U S A 2015
Quentin J M Huys, Níall Lally, Paul Faulkner, Neir Eshel, Erich Seifritz, Samuel J Gershman, Peter Dayan, Jonathan P Roiser. Proc Natl Acad Sci U S A 2015
17
How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis.
Anne G E Collins, Michael J Frank. Eur J Neurosci 2012
Anne G E Collins, Michael J Frank. Eur J Neurosci 2012
12
A framework for mesencephalic dopamine systems based on predictive Hebbian learning.
P R Montague, P Dayan, T J Sejnowski. J Neurosci 1996
P R Montague, P Dayan, T J Sejnowski. J Neurosci 1996
12
Co-cited is the co-citation frequency, indicating how many articles cite the article together with the query article. Similarity is the co-citation as percentage of the times cited of the query article or the article in the search results, whichever is the lowest. These numbers are calculated for the last 100 citations when articles are cited more than 100 times.