Wouter Kool, Samuel J Gershman, Fiery A Cushman. Psychol Sci 2017
Times Cited: 73
Times Cited: 73
Times Cited
Times Co-cited
Similarity
Model-based influences on humans' choices and striatal prediction errors.
Nathaniel D Daw, Samuel J Gershman, Ben Seymour, Peter Dayan, Raymond J Dolan. Neuron 2011
Nathaniel D Daw, Samuel J Gershman, Ben Seymour, Peter Dayan, Raymond J Dolan. Neuron 2011
57
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.
Nathaniel D Daw, Yael Niv, Peter Dayan. Nat Neurosci 2005
Nathaniel D Daw, Yael Niv, Peter Dayan. Nat Neurosci 2005
46
Neural computations underlying arbitration between model-based and model-free learning.
Sang Wan Lee, Shinsuke Shimojo, John P O'Doherty. Neuron 2014
Sang Wan Lee, Shinsuke Shimojo, John P O'Doherty. Neuron 2014
30
When Does Model-Based Control Pay Off?
Wouter Kool, Fiery A Cushman, Samuel J Gershman. PLoS Comput Biol 2016
Wouter Kool, Fiery A Cushman, Samuel J Gershman. PLoS Comput Biol 2016
42
The expected value of control: an integrative theory of anterior cingulate cortex function.
Amitai Shenhav, Matthew M Botvinick, Jonathan D Cohen. Neuron 2013
Amitai Shenhav, Matthew M Botvinick, Jonathan D Cohen. Neuron 2013
26
States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning.
Jan Gläscher, Nathaniel Daw, Peter Dayan, John P O'Doherty. Neuron 2010
Jan Gläscher, Nathaniel Daw, Peter Dayan, John P O'Doherty. Neuron 2010
26
Model-based choices involve prospective neural activity.
Bradley B Doll, Katherine D Duncan, Dylan A Simon, Daphna Shohamy, Nathaniel D Daw. Nat Neurosci 2015
Bradley B Doll, Katherine D Duncan, Dylan A Simon, Daphna Shohamy, Nathaniel D Daw. Nat Neurosci 2015
26
Toward a Rational and Mechanistic Account of Mental Effort.
Amitai Shenhav, Sebastian Musslick, Falk Lieder, Wouter Kool, Thomas L Griffiths, Jonathan D Cohen, Matthew M Botvinick. Annu Rev Neurosci 2017
Amitai Shenhav, Sebastian Musslick, Falk Lieder, Wouter Kool, Thomas L Griffiths, Jonathan D Cohen, Matthew M Botvinick. Annu Rev Neurosci 2017
24
The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive.
A Ross Otto, Samuel J Gershman, Arthur B Markman, Nathaniel D Daw. Psychol Sci 2013
A Ross Otto, Samuel J Gershman, Arthur B Markman, Nathaniel D Daw. Psychol Sci 2013
21
Characterizing a psychiatric symptom dimension related to deficits in goal-directed control.
Claire M Gillan, Michal Kosinski, Robert Whelan, Elizabeth A Phelps, Nathaniel D Daw. Elife 2016
Claire M Gillan, Michal Kosinski, Robert Whelan, Elizabeth A Phelps, Nathaniel D Daw. Elife 2016
20
Decision making and the avoidance of cognitive demand.
Wouter Kool, Joseph T McGuire, Zev B Rosen, Matthew M Botvinick. J Exp Psychol Gen 2010
Wouter Kool, Joseph T McGuire, Zev B Rosen, Matthew M Botvinick. J Exp Psychol Gen 2010
19
From Creatures of Habit to Goal-Directed Learners: Tracking the Developmental Emergence of Model-Based Reinforcement Learning.
Johannes H Decker, A Ross Otto, Nathaniel D Daw, Catherine A Hartley. Psychol Sci 2016
Johannes H Decker, A Ross Otto, Nathaniel D Daw, Catherine A Hartley. Psychol Sci 2016
19
Motivation and cognitive control: from behavior to neural mechanism.
Matthew Botvinick, Todd Braver. Annu Rev Psychol 2015
Matthew Botvinick, Todd Braver. Annu Rev Psychol 2015
17
What is the subjective cost of cognitive effort? Load, trait, and aging effects revealed by economic preference.
Andrew Westbrook, Daria Kester, Todd S Braver. PLoS One 2013
Andrew Westbrook, Daria Kester, Todd S Braver. PLoS One 2013
17
Working-memory capacity protects model-based learning from stress.
A Ross Otto, Candace M Raio, Alice Chiang, Elizabeth A Phelps, Nathaniel D Daw. Proc Natl Acad Sci U S A 2013
A Ross Otto, Candace M Raio, Alice Chiang, Elizabeth A Phelps, Nathaniel D Daw. Proc Natl Acad Sci U S A 2013
17
16
Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task.
Thomas Akam, Rui Costa, Peter Dayan. PLoS Comput Biol 2015
Thomas Akam, Rui Costa, Peter Dayan. PLoS Comput Biol 2015
26
Speed/accuracy trade-off between the habitual and the goal-directed processes.
Mehdi Keramati, Amir Dezfouli, Payam Piray. PLoS Comput Biol 2011
Mehdi Keramati, Amir Dezfouli, Payam Piray. PLoS Comput Biol 2011
16
Adaptive integration of habits into depth-limited planning defines a habitual-goal-directed spectrum.
Mehdi Keramati, Peter Smittenaar, Raymond J Dolan, Peter Dayan. Proc Natl Acad Sci U S A 2016
Mehdi Keramati, Peter Smittenaar, Raymond J Dolan, Peter Dayan. Proc Natl Acad Sci U S A 2016
16
Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action.
Bernard W Balleine, John P O'Doherty. Neuropsychopharmacology 2010
Bernard W Balleine, John P O'Doherty. Neuropsychopharmacology 2010
16
Deciding How To Decide: Self-Control and Meta-Decision Making.
Y-Lan Boureau, Peter Sokol-Hessner, Nathaniel D Daw. Trends Cogn Sci 2015
Y-Lan Boureau, Peter Sokol-Hessner, Nathaniel D Daw. Trends Cogn Sci 2015
15
Model-based learning protects against forming habits.
Claire M Gillan, A Ross Otto, Elizabeth A Phelps, Nathaniel D Daw. Cogn Affect Behav Neurosci 2015
Claire M Gillan, A Ross Otto, Elizabeth A Phelps, Nathaniel D Daw. Cogn Affect Behav Neurosci 2015
15
Disorders of compulsivity: a common bias towards learning habits.
V Voon, K Derbyshire, C Rück, M A Irvine, Y Worbe, J Enander, L R N Schreiber, C Gillan, N A Fineberg, B J Sahakian,[...]. Mol Psychiatry 2015
V Voon, K Derbyshire, C Rück, M A Irvine, Y Worbe, J Enander, L R N Schreiber, C Gillan, N A Fineberg, B J Sahakian,[...]. Mol Psychiatry 2015
15
Retrospective revaluation in sequential decision making: a tale of two systems.
Samuel J Gershman, Arthur B Markman, A Ross Otto. J Exp Psychol Gen 2014
Samuel J Gershman, Arthur B Markman, A Ross Otto. J Exp Psychol Gen 2014
15
An opportunity cost model of subjective effort and task performance.
Robert Kurzban, Angela Duckworth, Joseph W Kable, Justus Myers. Behav Brain Sci 2013
Robert Kurzban, Angela Duckworth, Joseph W Kable, Justus Myers. Behav Brain Sci 2013
13
13
Model-based and model-free decisions in alcohol dependence.
Miriam Sebold, Lorenz Deserno, Stephan Nebe, Daniel J Schad, Maria Garbusow, Claudia Hägele, Jürgen Keller, Elisabeth Jünger, Norbert Kathmann, Michael N Smolka,[...]. Neuropsychobiology 2014
Miriam Sebold, Lorenz Deserno, Stephan Nebe, Daniel J Schad, Maria Garbusow, Claudia Hägele, Jürgen Keller, Elisabeth Jünger, Norbert Kathmann, Michael N Smolka,[...]. Neuropsychobiology 2014
13
Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making.
Lorenz Deserno, Quentin J M Huys, Rebecca Boehme, Ralph Buchert, Hans-Jochen Heinze, Anthony A Grace, Raymond J Dolan, Andreas Heinz, Florian Schlagenhauf. Proc Natl Acad Sci U S A 2015
Lorenz Deserno, Quentin J M Huys, Rebecca Boehme, Ralph Buchert, Hans-Jochen Heinze, Anthony A Grace, Raymond J Dolan, Andreas Heinz, Florian Schlagenhauf. Proc Natl Acad Sci U S A 2015
13
Dopamine enhances model-based over model-free choice behavior.
Klaus Wunderlich, Peter Smittenaar, Raymond J Dolan. Neuron 2012
Klaus Wunderlich, Peter Smittenaar, Raymond J Dolan. Neuron 2012
13
Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans.
Peter Smittenaar, Thomas H B FitzGerald, Vincenzo Romei, Nicholas D Wright, Raymond J Dolan. Neuron 2013
Peter Smittenaar, Thomas H B FitzGerald, Vincenzo Romei, Nicholas D Wright, Raymond J Dolan. Neuron 2013
13
Reward reduces conflict by enhancing attentional control and biasing visual cortical processing.
Srikanth Padmala, Luiz Pessoa. J Cogn Neurosci 2011
Srikanth Padmala, Luiz Pessoa. J Cogn Neurosci 2011
12
Habits, action sequences and reinforcement learning.
Amir Dezfouli, Bernard W Balleine. Eur J Neurosci 2012
Amir Dezfouli, Bernard W Balleine. Eur J Neurosci 2012
12
Actions, action sequences and habits: evidence that goal-directed and habitual action control are hierarchically organized.
Amir Dezfouli, Bernard W Balleine. PLoS Comput Biol 2013
Amir Dezfouli, Bernard W Balleine. PLoS Comput Biol 2013
12
Cognitive control predicts use of model-based reinforcement learning.
A Ross Otto, Anya Skatova, Seth Madlon-Kay, Nathaniel D Daw. J Cogn Neurosci 2015
A Ross Otto, Anya Skatova, Seth Madlon-Kay, Nathaniel D Daw. J Cogn Neurosci 2015
12
Habitual control of goal selection in humans.
Fiery Cushman, Adam Morris. Proc Natl Acad Sci U S A 2015
Fiery Cushman, Adam Morris. Proc Natl Acad Sci U S A 2015
14
Reward Pays the Cost of Noise Reduction in Motor and Cognitive Control.
Sanjay G Manohar, Trevor T-J Chong, Matthew A J Apps, Amit Batla, Maria Stamelou, Paul R Jarman, Kailash P Bhatia, Masud Husain. Curr Biol 2015
Sanjay G Manohar, Trevor T-J Chong, Matthew A J Apps, Amit Batla, Maria Stamelou, Paul R Jarman, Kailash P Bhatia, Masud Husain. Curr Biol 2015
12
Tonic dopamine: opportunity costs and the control of response vigor.
Yael Niv, Nathaniel D Daw, Daphna Joel, Peter Dayan. Psychopharmacology (Berl) 2007
Yael Niv, Nathaniel D Daw, Daphna Joel, Peter Dayan. Psychopharmacology (Berl) 2007
12
The successor representation in human reinforcement learning.
I Momennejad, E M Russek, J H Cheong, M M Botvinick, N D Daw, S J Gershman. Nat Hum Behav 2017
I Momennejad, E M Russek, J H Cheong, M M Botvinick, N D Daw, S J Gershman. Nat Hum Behav 2017
12
The ubiquity of model-based reinforcement learning.
Bradley B Doll, Dylan A Simon, Nathaniel D Daw. Curr Opin Neurobiol 2012
Bradley B Doll, Dylan A Simon, Nathaniel D Daw. Curr Opin Neurobiol 2012
12
Incentives Boost Model-Based Control Across a Range of Severity on Several Psychiatric Constructs.
Edward H Patzelt, Wouter Kool, Alexander J Millner, Samuel J Gershman. Biol Psychiatry 2019
Edward H Patzelt, Wouter Kool, Alexander J Millner, Samuel J Gershman. Biol Psychiatry 2019
29
Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning.
Wouter van den Bos, Michael X Cohen, Thorsten Kahnt, Eveline A Crone. Cereb Cortex 2012
Wouter van den Bos, Michael X Cohen, Thorsten Kahnt, Eveline A Crone. Cereb Cortex 2012
10
Of goals and habits: age-related and individual differences in goal-directed decision-making.
Ben Eppinger, Maik Walter, Hauke R Heekeren, Shu-Chen Li. Front Neurosci 2013
Ben Eppinger, Maik Walter, Hauke R Heekeren, Shu-Chen Li. Front Neurosci 2013
12
Predictive representations can link model-based reinforcement learning to model-free mechanisms.
Evan M Russek, Ida Momennejad, Matthew M Botvinick, Samuel J Gershman, Nathaniel D Daw. PLoS Comput Biol 2017
Evan M Russek, Ida Momennejad, Matthew M Botvinick, Samuel J Gershman, Nathaniel D Daw. PLoS Comput Biol 2017
10
Computational rationality: A converging paradigm for intelligence in brains, minds, and machines.
Samuel J Gershman, Eric J Horvitz, Joshua B Tenenbaum. Science 2015
Samuel J Gershman, Eric J Horvitz, Joshua B Tenenbaum. Science 2015
10
Planning Complexity Registers as a Cost in Metacontrol.
Wouter Kool, Samuel J Gershman, Fiery A Cushman. J Cogn Neurosci 2018
Wouter Kool, Samuel J Gershman, Fiery A Cushman. J Cogn Neurosci 2018
66
Dopamine Does Double Duty in Motivating Cognitive Effort.
Andrew Westbrook, Todd S Braver. Neuron 2016
Andrew Westbrook, Todd S Braver. Neuron 2016
9
The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value.
Oscar Bartra, Joseph T McGuire, Joseph W Kable. Neuroimage 2013
Oscar Bartra, Joseph T McGuire, Joseph W Kable. Neuroimage 2013
9
Cortical substrates for exploratory decisions in humans.
Nathaniel D Daw, John P O'Doherty, Peter Dayan, Ben Seymour, Raymond J Dolan. Nature 2006
Nathaniel D Daw, John P O'Doherty, Peter Dayan, Ben Seymour, Raymond J Dolan. Nature 2006
9
Co-cited is the co-citation frequency, indicating how many articles cite the article together with the query article. Similarity is the co-citation as percentage of the times cited of the query article or the article in the search results, whichever is the lowest. These numbers are calculated for the last 100 citations when articles are cited more than 100 times.