List of publications by theme.
Credit assignment in hierarchical option transfer [PDF]
Li, Xia, Dong, and Collins (2022)
Proceedings of Cog Sci 2022
How the Mind Creates Structure: Hierarchical Learning of Action Sequences [PDF]
Eckstein and Collins (2021)
Cog Sci 2021 Proceedings
Context is key for learning motor skills [PDF]
Collins and McDougle (2021)
Nature
Temporal and state abstractions for efficient learning, transfer and composition in humans [PDF] [SI] [Data]
Xia and Collins (2021)
Psychological Review
Computational Evidence for Hierarchically-Structured Reinforcement Learning in Humans [PDF] [Data]
Eckstein and Collins (2020)
PNAS
Sequential control underlies robust ramping dynamics in the rostrolateral prefrontal cortex [PDF]
Desrochers, Collins, and Badre (2018)
Journal of Neuroscience
Prefrontal Cortex in Control: Broadening the Scope to Identify Mechanisms [PDF]
Alexander, WH, Brown, JW, Collins, AGE, Hayden, BY, and Vassena, E (2017)
Journal of Cognitive Neuroscience
The cost of structure learning [PDF]
Collins, AGE (2017)
Journal of Cognitive Neuroscience
Stimulus discriminability may bias value-based probabilistic learning [PDF]
Schutte, I, Slagter, HA, Collins, AGE, Frank, MJ, and Kenemans, JL (2017)
PLoS One
Role of Prefrontal Cortex in Learning and Generalizing Hierarchical Rules in 8-Month-Old Infants [PDF]
Werchan, DM, Collins, AGE, Frank, MJ, and Amso, D (2016)
The Journal of Neuroscience
Neural signature of hierarchically structured expectations predicts clustering and transfer of rule sets in reinforcement learning [PDF]
Collins, AGE, Frank, MJ (2016)
Cognition
Motor demands constrain cognitive rule structures [PDF]
Collins, AGE, and Frank, MJ (2016)
Plos Computational Biology
8-Month-Old infants spontaneously learn and generalize hierarchical rules [PDF]
Werchan, DM, Collins, AGE, Frank, MJ, and Amso, D (2015)
Psychological Science
Foundations of human reasoning in the prefrontal cortex [PDF]
Donoso, M, Collins, AGE, Koechlin, E. (2014)
Science
Human EEG uncovers latent generalizable rule structure during learning [PDF]
Collins, AGE, Cavanagh, JF, and Frank, MJ (2014)
Journal of Neuroscience
Cognitive control over learning: creating, clustering and generalizing task-set structure [PDF]
Collins, AGE and Frank, MJ. (2013)
Psychological Review
Reasoning, learning, and creativity: frontal lobe function and human decision-making [PDF]
Collins A, Koechlin E (2012)
PLoS Biology
A computational theory of prefrontal executive control
Collins, A. and Koechlin, E. (2009)
Frontiers in Systems Neuroscience
Age-related differences in prefrontal glutamate are associated with increased working memory decay that gives the appearance of learning deficits [PDF]
Rmus, He, Baribault, Walsh, Festa, Collins & Nassar (2023)
eLife
Neural index of reinforcement learning predicts improved stimulus-response retention under high working memory load [PDF]
Rac-Lubashevsky, Cremer, Collins, Frank, and Schwabe (2023)
Journal of Neuroscience
Three systems interact in one-shot reinforcement learning [PDF]
Zou and Collins (2022)
Proceedings of Cog Sci 2022
Modeling the influence of working memory, reinforcement, and action uncertainty on reaction time and choice during instrumental learning [PDF]
McDougle and Collins (2020)
Psychonomic Bulletin & Review
Event segmentation reveals working memory forgetting rate [PDF] [RLWM Data]
Jafarpour, Buffalo, Knight, and Collins (2022)
iScience
Within and across-trial dynamics of human EEG reveal cooperative interplay between reinforcement learning and working memory [PDF] [Data]
Collins, AGE and Frank, MJ (2018)
PNAS
Working memory load strengthens reward prediction errors [PDF] [SI] [Data]
Collins, AGE, Ciullo, B, Frank, MJ, and Badre, D. (2017)
Journal of Neuroscience
How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational and neurogenetic analysis [PDF] [Data]
Collins, AGE and Frank, MJ. (2012)
European Journal of Neuroscience
Lowered inter-stimulus discriminability hurts incremental contributions to learning [Cognitive, Affective, & Behavioral Neuroscience] [Data]
Yoo, Keglovits, and Collins (2023)
Cognitive, Affective, & Behavioral Neuroscience
Intrinsic rewards explain context-sensitive valuation in reinforcement learning [PLOS][Data]
Molinaro and Collins (2023)
PLOS Biology
Choice Type Impacts Human Reinforcement Learning [PDF] [Data]
Rmus, Zou, Collins (2023)
Journal of Cognitive Neuroscience
The interpretation of computational model parameters depends on the context [PDF] [Data]
Eckstein, Master, Xia, Dahl, Wilbrecht, and Collins (2022)
eLife
Reinforcement Learning and Bayesian Inference Provide Complementary Models for the Unique Advantage of Adolescents in Stochastic Reversal [PDF] [Data]
Eckstein, Master, Dahl, Wilbrecht, and Collins (2022)
Developmental Cognitive Neuroscience
Activation, but not inhibition, of the indirect pathway disrupts choice rejection in a freely moving, multiple-choice foraging task [PDF]
Delevich, Hoshal, Zhou, Zhang, Vedula, Lin, Chase, Collins, Wilbrecht (2022)
Cell Reports
Modeling Changes in Probabilistic Reinforcement Learning during Adolescence [PDF] [Data]
Xia, Master, Eckstein, Baribault, Dahl, Wilbrecht, Collins (2021)
PLoS Computational Biology
Executive Function Assigns Value to Novel Goal-Congruent Outcomes [PDF]
McDougle, Ballard, Baribault, Bishop, and Collins (2021)
Cerebral Cortex
What do reinforcement learning models measure? Interpreting model parameters in cognition and neuroscience [PDF]
Eckstein, Wilbrecht, and Collins (2021)
Current Opinion in Behavioral Sciences
Learning under uncertainty changes during adolescence [PDF]
Xia, Master, Eckstein, Wilbrecht, and Collins (2020)
CogSci 2020 Submission
What is a Choice in Reinforcement Learning? [PDF]
Rmus and Collins (2020)
CogSci 2020 Submission
Disentangling the systems contributing to changes in learning during adolescence [PDF]
Master, Eckstein, Gotlieb, Dahl, Wilbrecht, and Collins (2019)
Developmental Cognitive Neuroscience
Cross-Task Contributions of Frontobasal Ganglia Circuitry in Response Inhibition and Conflict-Induced
Slowing [PDF]
Jahfari, Ridderinkhof, Collins, Knapen, Waldorp, Frank (2019)
Cerebral Cortex
A reinforcement learning mechanism responsible for the valuation of free choice [PDF]
Cockburn, J, Collins, AGE, and Frank, MJ (2014)
Neuron
Opponent Actor Learning (OpAL): modeling interactive effect of striatal dopamine on reinforcement learning and choice incentive [PDF]
Collins, AGE and Frank, MJ. (2014)
Psychological Review
Impulsivity relates to multi-trial choice strategy in probabilistic reversal learning [PDF] [Data]
Zou, Muñoz Lopez, Johnson, Collins (2022)
Frontiers in Psychiatry
Proof-of-Mechanism Study of the PDE10 Inhibitor RG7203 in Patients with Schizophrenia and Negative Symptoms [PDF]
Umbricht D., Abt M., Tamburri P., Chatham C., Holiga Š., Frank M.J., Collins A.G.E., Walling D.P., Mofsen R., Gruener D., Gertsik L., Sevigny J., Keswani S. & Dukart J. (2021)
Biological Psychiatry Global Open Science
Dopaminergic activity and exercise behavior in anorexia nervosa [PDF]
Gorrell, Collins, Le Grange, Yang (2020)
OBM Neurobiol
Computational Mechanisms of Effort and Reward Decisions
in Patients With Depression and Their Association With Relapse After Antidepressant Discontinuation
[PDF]
Berwian, Wenzel, Collins, Seifritz, Stephan, Walter, Huys (2020)
JAMA Psychiatry
Interactions Among Working Memory, Reinforcement Learning, and Effort in Value-Based Choice: A New Paradigm and Selective Deficits in Schizophrenia [PDF]
Collins, AGE, Albrecht, MA, Waltz, JA, Gold, JM and Frank, MJ (2017)
Biological Psychiatry
Probabilistic Reinforcement Learning in Patients with Schizophrenia: Relationships to Anhedonia and Avolition [PDF]
Dowd, EC, Frank, MJ, Collins, AGE, Gold, JM, and Barch, DM (2016)
Biological Psychiatry
Working memory contributions to reinforcement learning impairments in schizophrenia [PDF] [Data]
Collins, AGE, Brown, J, Gold, J, Waltz, J, and Frank, MJ (2014)
Journal of Neuroscience
Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence [PDF] [Data]
Gold, JM; Waltz, JA; Matveeva, TM; Kasanova, Z; Strauss, G; Herbener, E; Collins, AGE; Frank, MJ (2012)
Arch Gen Psychiatry
Troubleshooting Bayesian cognitive models [PDF]
Baribault and Collins (2023)
Psychological Methods
How working memory and reinforcement learning are intertwined: a cognitive, neural, and computational perspective [PDF]
Yoo and Collins (2022)
Journal of Cognitive Neuroscience
Advances in modeling learning and decision-making in
neuroscience [PDF]
Collins and Shenhav (2021)
Neuropsychopharmacology
The Role of Executive Function in Shaping Reinforcement Learning [PDF]
Rmus, McDougle, and Collins (2020)
Current Opinion in Behavioral Sciences
Beyond simple dichotomies in reinforcement learning. [PDF]
Collins and Cockburn (2020)
Nature Reviews Neuroscience
Ten simple rules for the computational modeling of behavioral data [PDF] [example code]
Wilson and Collins (2019)
eLIFE
Reinforcement learning: bringing together computation and cognition [PDF]
Collins (2019)
Current Opinion in Behavioral Sciences
Chapter 5: Learning Structures Through Reinforcement [PDF]
Collins, AGE (2018)
Goal-Directed Decision Making
The tortoise and the hare: interactions between reinforcement learning and working memory [PDF] [summary]
Collins, AGE (2018)
Journal of Cognitive Neuroscience
Surprise! dopamine signals mix action, value and error [PDF]
Collins, AGE, and Frank, MJ (2015)
Nature Neuroscience
CCN Lab