{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"Research Square"}],"indexed":{"date-parts":[[2026,8,31]],"date-time":"2026-08-31T16:21:43Z","timestamp":1788193303238,"version":"build-2803163510"},"posted":{"date-parts":[[2026,3,17]]},"group-title":"In Review","reference-count":55,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T00:00:00Z","timestamp":1773705600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2026,2,20]]},"abstract":"<title>Abstract<\/title>\n                <p>\n                  <bold>BACKGROUND:<\/bold>\n                  Effort-based decision making evaluates rewards relative to the effort required to obtain it, an important process of healthy goal-directed motivation and behavior. Computational models provide mechanistic insights underlying choice behavior and potential alterations in neuropsychiatric disorders, including substance use disorders. We applied computational models to effort-based choice behavior to characterize underlying decision processes and if these mechanisms differ by substance use status.\n                  <bold>METHODS:<\/bold>\n                  Participants completed the Effort Expenditure for Rewards Task, choosing between low- and high-effort options for monetary rewards varying in magnitude and probability. Participants met criteria for no tobacco use (n = 23), current tobacco use disorder (n = 26), former tobacco use disorder (n = 22), and tobacco and opioid use disorder (n = 29). Computational models from two families, Subjective Value and Reinforcement Learning, were fit and compared. Parameters from the best-fitting model underwent principal components analysis and linear discriminant analysis.\n                  <bold>RESULTS:<\/bold>\n                  Temporal difference reinforcement learning model demonstrated greater model evidence and predictive accuracy, indicating better fit to effort-based choice behavior. Principal components analysis revealed meaningful multivariate distinctions: PC1 differentiated all groups except individuals without tobacco use versus individuals with tobacco use disorder; PC3 distinguished tobacco and opioid use disorder from all other groups. Linear discriminant analysis demonstrated group separation with 76% classification accuracy.\n                  <bold>CONCLUSIONS:<\/bold>\n                  A reinforcement learning framework better explained participants\u2019 effort-based choice behavior. Substance use status relates to dynamic behavioral changes (i.e. learning) as measured by the multivariate combination of learning rate, future discounting, and choice temperature.\n                <\/p>","DOI":"10.21203\/rs.3.rs-8928184\/v1","type":"posted-content","created":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T03:49:41Z","timestamp":1773719381000},"source":"Crossref","is-referenced-by-count":0,"title":["Effort and Substance Use: Differentiating Tobacco Use Through Reinforcement Learning of Effort Based Decision Making"],"prefix":"10.21203","author":[{"given":"Kasey","family":"Spry","sequence":"first","affiliation":[{"name":"Wake Forest University School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jazmyne","family":"James","sequence":"additional","affiliation":[{"name":"Wake Forest University School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alison","family":"Oliveto","sequence":"additional","affiliation":[{"name":"University of Arkansas for Medical Sciences"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Mancino","sequence":"additional","affiliation":[{"name":"University of Arkansas for Medical Sciences"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kenneth","family":"Kishida","sequence":"additional","affiliation":[{"name":"Wake Forest University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Merideth","family":"Addicott","sequence":"additional","affiliation":[{"name":"Wake Forest University School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","reference":[{"issue":"4","key":"ref1","doi-asserted-by":"publisher","first-page":"1081","DOI":"10.1007\/s00213-019-05437-3","article-title":"Effort-based decision making varies by smoking status","volume":"237","author":"Addicott MA","year":"2020","unstructured":"Addicott, M. A., Wardle, M. C., & Selig, J. P. (2020). Effort-based decision making varies by smoking status. Psychopharmacology (Berl), 237(4), 1081\u20131090. https:\/\/doi.org\/10.1007\/s00213-019-05437-3","journal-title":"Psychopharmacology (Berl)"},{"issue":"4","key":"ref2","doi-asserted-by":"publisher","first-page":"1119","DOI":"10.1007\/s00213-019-05196-1","article-title":"Tobacco smoking and dopaminergic function in humans: A meta-analysis of molecular imaging studies","volume":"236","author":"Ashok AH","year":"2019","unstructured":"Ashok, A. H., Mizuno, Y., & Howes, O. D. (2019). Tobacco smoking and dopaminergic function in humans: A meta-analysis of molecular imaging studies. Psychopharmacology (Berl), 236(4), 1119\u20131129. https:\/\/doi.org\/10.1007\/s00213-019-05196-1","journal-title":"Psychopharmacology (Berl)"},{"issue":"3","key":"ref3","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1016\/j.neubiorev.2008.10.010","article-title":"Dopamine modulates neural networks involved in effort-based decision-making","volume":"33","author":"Assadi SM","year":"2009","unstructured":"Assadi, S. M., Y\u00fccel, M., & Pantelis, C. (2009). Dopamine modulates neural networks involved in effort-based decision-making. Neuroscience & Biobehavioral Reviews, 33(3), 383\u2013393. https:\/\/doi.org\/10.1016\/j.neubiorev.2008.10.010","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1016\/j.nlm.2016.07.015","article-title":"Neural substrates underlying effort, time, and risk-based decision making in motivated behavior","volume":"133","author":"Bailey MR","year":"2016","unstructured":"Bailey, M. R., Simpson, E. H., & Balsam, P. D. (2016). Neural substrates underlying effort, time, and risk-based decision making in motivated behavior. Neurobiology of Learning and Memory, 133, 233\u2013256. https:\/\/doi.org\/10.1016\/j.nlm.2016.07.015","journal-title":"Neurobiology of Learning and Memory"},{"issue":"2","key":"ref5","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1037\/a0036299","article-title":"Effort, anhedonia, and function in schizophrenia: Reduced effort allocation predicts amotivation and functional impairment","volume":"123","author":"Barch DM","year":"2014","unstructured":"Barch, D. M., Treadway, M. T., & Schoen, N. (2014). Effort, anhedonia, and function in schizophrenia: Reduced effort allocation predicts amotivation and functional impairment. Journal of Abnormal Psychology, 123(2), 387\u2013397. https:\/\/doi.org\/10.1037\/a0036299","journal-title":"Journal of Abnormal Psychology"},{"issue":"1","key":"ref6","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/S0091-3057(00)00431-7","article-title":"Schedule-dependent effects of haloperidol and amphetamine: Multiple-schedule task shows within-subject effects","volume":"68","author":"Caul WF","year":"2001","unstructured":"Caul, W. F., & Brindle, N. A. (2001). Schedule-dependent effects of haloperidol and amphetamine: Multiple-schedule task shows within-subject effects. Pharmacology Biochemistry and Behavior, 68(1), 53\u201363. https:\/\/doi.org\/10.1016\/S0091-3057(00)00431-7","journal-title":"Pharmacology Biochemistry and Behavior"},{"issue":"7","key":"ref7","doi-asserted-by":"publisher","first-page":"710","DOI":"10.1037\/abn0000443","article-title":"Effortful goal-directed behavior in schizophrenia: Computational subtypes and associations with cognition","volume":"128","author":"Cooper JA","year":"2019","unstructured":"Cooper, J. A., Barch, D. M., Reddy, L. F., Horan, W. P., Green, M. F., & Treadway, M. T. (2019). Effortful goal-directed behavior in schizophrenia: Computational subtypes and associations with cognition. Journal of Abnormal Psychology, 128(7), 710\u2013722. https:\/\/doi.org\/10.1037\/abn0000443","journal-title":"Journal of Abnormal Psychology"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.cobeha.2017.12.003","article-title":"Effort-based decision-making in schizophrenia","volume":"22","author":"Culbreth AJ","year":"2018","unstructured":"Culbreth, A. J., Moran, E. K., & Barch, D. M. (2018). Effort-based decision-making in schizophrenia. Current Opinion in Behavioral Sciences, 22, 1\u20136. https:\/\/doi.org\/10.1016\/j.cobeha.2017.12.003","journal-title":"Current Opinion in Behavioral Sciences"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1002\/syn","article-title":"Reduced Dopamine D1 Receptor Binding in the Ventral Striatum of Cigarette Smokers","volume":"42","author":"Dagher A","year":"2001","unstructured":"Dagher, A., Bleicher, C., Aston, J. A. D., Gunn, R. N., Clarke, P. B. S., & Cumming, P. (2001). Reduced Dopamine D1 Receptor Binding in the Ventral Striatum of Cigarette Smokers. Synapse (New York, N. Y.), 42, 48\u201353. https:\/\/doi.org\/10.1002\/syn","journal-title":"Synapse (New York, N. Y.)"},{"issue":"9","key":"ref10","doi-asserted-by":"publisher","first-page":"2085","DOI":"10.1038\/npp.2015.60","article-title":"Reducing Ventral Tegmental Dopamine D2 Receptor Expression Selectively Boosts Incentive Motivation","volume":"40","author":"Jong JW","year":"2015","unstructured":"de Jong, J. W., Roelofs, T. J. M., Mol, F. M. U., Hillen, A. E. J., Meijboom, K. E., Luijendijk, M. C. M., van der Eerden, H. A. M., Garner, K. M., Vanderschuren, L. J. M. J., & Adan, R. A. H. (2015). Reducing Ventral Tegmental Dopamine D2 Receptor Expression Selectively Boosts Incentive Motivation. Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology, 40(9), 2085\u20132095. https:\/\/doi.org\/10.1038\/npp.2015.60","journal-title":"Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology"},{"issue":"4","key":"ref11","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1176\/appi.ajp.2007.07020352","article-title":"Association of Low Striatal Dopamine D2 Receptor Availability With Nicotine Dependence Similar to That Seen With Other Drugs of Abuse","volume":"165","author":"Fehr C","year":"2008","unstructured":"Fehr, C., Yakushev, I., Hohmann, N., Buchholz, H. G., Landvogt, C., Deckers, H., Eberhardt, A., Kl\u00e4ger, M., Smolka, M. N., Scheurich, A., Dielentheis, T., Schmidt, L. G., R\u00f6sch, F., Bartenstein, P., Gr\u00fcnder, G., & Schreckenberger, M. (2008). Association of Low Striatal Dopamine D2 Receptor Availability With Nicotine Dependence Similar to That Seen With Other Drugs of Abuse. American Journal of Psychiatry, 165(4), 507\u2013514. https:\/\/doi.org\/10.1176\/appi.ajp.2007.07020352","journal-title":"American Journal of Psychiatry"},{"issue":"8","key":"ref12","doi-asserted-by":"publisher","first-page":"1966","DOI":"10.1038\/sj.npp.1301565","article-title":"Dopaminergic and Glutamatergic Regulation of Effort- and Delay-Based Decision Making","volume":"33","author":"Floresco SB","year":"2008","unstructured":"Floresco, S. B., Tse, M. T. L., & Ghods-Sharifi, S. (2008). Dopaminergic and Glutamatergic Regulation of Effort- and Delay-Based Decision Making. Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology, 33(8), 1966\u20131979. https:\/\/doi.org\/10.1038\/sj.npp.1301565","journal-title":"Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology"},{"issue":"10","key":"ref13","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v092.i10","article-title":"bridgesampling: An R Package for Estimating Normalizing Constants","volume":"92","author":"Gronau QF","year":"2020","unstructured":"Gronau, Q. F., Singmann, H., & Wagenmakers, E. J. (2020). bridgesampling: An R Package for Estimating Normalizing Constants. Journal of Statistical Software, 92(10). https:\/\/doi.org\/10.18637\/jss.v092.i10","journal-title":"Journal of Statistical Software"},{"issue":"3","key":"ref14","doi-asserted-by":"publisher","first-page":"293","DOI":"10.3109\/00952998709001515","article-title":"Two New Rating Scales for Opiate Withdrawal","volume":"13","author":"Handelsman L","year":"1987","unstructured":"Handelsman, L., Cochrane, K. J., Aronson, M. J., Ness, R., Rubinstein, K. J., & Kanof, P. D. (1987). Two New Rating Scales for Opiate Withdrawal. The American Journal of Drug and Alcohol Abuse, 13(3), 293\u2013308. https:\/\/doi.org\/10.3109\/00952998709001515","journal-title":"The American Journal of Drug and Alcohol Abuse"},{"issue":"3","key":"ref15","doi-asserted-by":"publisher","first-page":"698","DOI":"10.1523\/JNEUROSCI.2489-13.2014","article-title":"Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term","volume":"34","author":"Hart AS","year":"2014","unstructured":"Hart, A. S., Rutledge, R. B., Glimcher, P. W., & Phillips, P. E. M. (2014). Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. Journal of Neuroscience, 34(3), 698\u2013704. https:\/\/doi.org\/10.1523\/JNEUROSCI.2489-13.2014","journal-title":"Journal of Neuroscience"},{"issue":"2","key":"ref16","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1093\/schbul\/sbu102","article-title":"Apathy But Not Diminished Expression in Schizophrenia Is Associated With Discounting of Monetary Rewards by Physical Effort","volume":"41","author":"Hartmann MN","year":"2015","unstructured":"Hartmann, M. N., Hager, O. M., Reimann, A. V., Chumbley, J. R., Kirschner, M., Seifritz, E., Tobler, P. N., & Kaiser, S. (2015). Apathy But Not Diminished Expression in Schizophrenia Is Associated With Discounting of Monetary Rewards by Physical Effort. Schizophrenia Bulletin, 41(2), 503\u2013512. https:\/\/doi.org\/10.1093\/schbul\/sbu102","journal-title":"Schizophrenia Bulletin"},{"issue":"6","key":"ref17","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1037\/neu0000284","article-title":"Neural substrates of the impaired effort expenditure decision making in schizophrenia","volume":"30","author":"Huang J","year":"2016","unstructured":"Huang, J., Yang, X., Lan, Y., Zhu, C., Liu, X., Wang, Y., Cheung, E. F. C., Xie, G., & Chan, R. C. K (2016). Neural substrates of the impaired effort expenditure decision making in schizophrenia. Neuropsychology, 30(6), 685\u2013696. https:\/\/doi.org\/10.1037\/neu0000284","journal-title":"Neuropsychology"},{"issue":"6","key":"ref18","doi-asserted-by":"publisher","first-page":"677","DOI":"10.1093\/ntr\/ntw204","article-title":"Does tobacco abstinence decrease reward sensitivity? A human laboratory test","volume":"19","author":"Hughes JR","year":"2017","unstructured":"Hughes, J. R., Budney, A. J., Muellers, S. R., Lee, D. C., Callas, P. W., Sigmon, S. C., Fingar, J. R., & Priest, J. (2017). Does tobacco abstinence decrease reward sensitivity? A human laboratory test. Nicotine and Tobacco Research, 19(6), 677\u2013685. https:\/\/doi.org\/10.1093\/ntr\/ntw204","journal-title":"Nicotine and Tobacco Research"},{"issue":"3","key":"ref19","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1038\/nn.4238","article-title":"Computational psychiatry as a bridge from neuroscience to clinical applications","volume":"19","author":"Huys QJM","year":"2016","unstructured":"Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016). Computational psychiatry as a bridge from neuroscience to clinical applications. Nature Neuroscience, 19(3), 404\u2013413. https:\/\/doi.org\/10.1038\/nn.4238","journal-title":"Nature Neuroscience"},{"issue":"4","key":"ref20","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1016\/j.tics.2018.01.007","article-title":"The Effort Paradox: Effort Is Both Costly and Valued","volume":"22","author":"Inzlicht M","year":"2018","unstructured":"Inzlicht, M., Shenhav, A., & Olivola, C. Y. (2018). The Effort Paradox: Effort Is Both Costly and Valued. Trends in Cognitive Sciences, 22(4), 337\u2013349. https:\/\/doi.org\/10.1016\/j.tics.2018.01.007","journal-title":"Trends in Cognitive Sciences"},{"issue":"40","key":"ref21","doi-asserted-by":"publisher","first-page":"7648","DOI":"10.1523\/JNEUROSCI.2223-21.2022","article-title":"Effort Reinforces Learning","volume":"42","author":"Jarvis H","year":"2022","unstructured":"Jarvis, H., Stevenson, I., Huynh, A. Q., Babbage, E., Coxon, J., & Chong, T. T. J. (2022). Effort Reinforces Learning. Journal of Neuroscience, 42(40), 7648\u20137658. https:\/\/doi.org\/10.1523\/JNEUROSCI.2223-21.2022","journal-title":"Journal of Neuroscience"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1016\/j.drugalcdep.2018.11.011","article-title":"Prevalence and patterns of opioid misuse and opioid use disorder among primary care patients who use tobacco","volume":"194","author":"John WS","year":"2019","unstructured":"John, W. S., Zhu, H., Mannelli, P., Subramaniam, G. A., Schwartz, R. P., McNeely, J., & Wu, L. T. (2019). Prevalence and patterns of opioid misuse and opioid use disorder among primary care patients who use tobacco. Drug and Alcohol Dependence, 194, 468\u2013475. https:\/\/doi.org\/10.1016\/j.drugalcdep.2018.11.011","journal-title":"Drug and Alcohol Dependence"},{"key":"ref23","doi-asserted-by":"publisher","author":"Kishida KT","unstructured":"Kishida, K. T., & Sands, L. P. (n.d.). Title A Dynamic Affective Core to bind the Contents, Context, and Value of Conscious Experience. https:\/\/doi.org\/10.1007\/978-3-030-82965-0_12","DOI":"10.1007\/978-3-030-82965-0_12"},{"issue":"3","key":"ref24","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004116","article-title":"Behavioral Modeling of Human Choices Reveals Dissociable Effects of Physical Effort and Temporal Delay on Reward Devaluation","volume":"11","author":"Klein-Fl\u00fcgge MC","year":"2015","unstructured":"Klein-Fl\u00fcgge, M. C., Kennerley, S. W., Saraiva, A. C., Penny, W. D., & Bestmann, S. (2015). Behavioral Modeling of Human Choices Reveals Dissociable Effects of Physical Effort and Temporal Delay on Reward Devaluation. PLoS Computational Biology, 11(3). https:\/\/doi.org\/10.1371\/journal.pcbi.1004116","journal-title":"PLoS Computational Biology"},{"issue":"7","key":"ref25","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1016\/j.tics.2010.05.001","article-title":"What to believe: Bayesian methods for data analysis","volume":"14","author":"Kruschke JK","year":"2010","unstructured":"Kruschke, J. K. (2010). What to believe: Bayesian methods for data analysis. Trends in Cognitive Sciences, 14(7), 293\u2013300. https:\/\/doi.org\/10.1016\/j.tics.2010.05.001","journal-title":"Trends in Cognitive Sciences"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1016\/j.bpsc.2025.02.006","article-title":"Computational Phenotyping of Effort-Based Decision Making in Unmedicated Adults with Remitted Depression","author":"Kuhn M","year":"2025","unstructured":"Kuhn, M., Palermo, E. H., Pagnier, G., Blank, J., Steinberger, M., Long, D. C., Nowicki, Y., Cooper, G., Treadway, J. A., Frank, M. T., M. J., & Pizzagalli, D. A. (2025). Computational Phenotyping of Effort-Based Decision Making in Unmedicated Adults with Remitted Depression. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging. https:\/\/doi.org\/10.1016\/j.bpsc.2025.02.006","journal-title":"Biological Psychiatry: Cognitive Neuroscience and Neuroimaging"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2011.00081","author":"Kurniawan IT","year":"2011","unstructured":"Kurniawan, I. T. (2011). Dopamine and effort-based decision making. Frontiers in Neuroscience, 5(JUN). https:\/\/doi.org\/10.3389\/fnins.2011.00081"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2022.886297","author":"Liebenow B","year":"2022","unstructured":"Liebenow, B., Jones, R., DiMarco, E., Trattner, J. D., Humphries, J., Sands, L. P., Spry, K. P., Johnson, C. K., Farkas, E. B., Jiang, A., & Kishida, K. T. (2022). Computational reinforcement learning, reward (and punishment), and dopamine in psychiatric disorders. Frontiers in Psychiatry, 13. https:\/\/doi.org\/10.3389\/fpsyt.2022.886297"},{"key":"ref29","volume-title":"Information theory, inference, and learning algorithms","author":"MacKay DJC","year":"2003","unstructured":"MacKay, D. J. C. (2003). Information theory, inference, and learning algorithms. Cambridge University Press."},{"issue":"7","key":"ref30","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1080\/10826084.2020.1725056","article-title":"Clinical Correlates of Smoking Status in Men and Women with Opioid Use Disorder","volume":"55","author":"McHugh RK","year":"2020","unstructured":"McHugh, R. K., Janes, A. C., Griffin, M. L., Taghian, N., Greenfield, S. F., & Weiss, R. D. (2020). Clinical Correlates of Smoking Status in Men and Women with Opioid Use Disorder. Substance Use & Misuse, 55(7), 1054\u20131058. https:\/\/doi.org\/10.1080\/10826084.2020.1725056","journal-title":"Substance Use & Misuse"},{"issue":"5","key":"ref31","doi-asserted-by":"publisher","first-page":"819","DOI":"10.1080\/14622200412331296002","article-title":"Effects of short-term nicotine deprivation on decision-making: Delay, uncertainty and effort discounting","volume":"6","author":"Mitchell S","year":"2004","unstructured":"Mitchell, S. (2004). Effects of short-term nicotine deprivation on decision-making: Delay, uncertainty and effort discounting. Nicotine & Tobacco Research, 6(5), 819\u2013828. https:\/\/doi.org\/10.1080\/14622200412331296002","journal-title":"Nicotine & Tobacco Research"},{"issue":"4","key":"ref32","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1007\/PL00005491","article-title":"Measures of impulsivity in cigarette smokers and non-smokers","volume":"146","author":"Mitchell SH","year":"1999","unstructured":"Mitchell, S. H. (1999). Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology (Berl), 146(4), 455\u2013464. https:\/\/doi.org\/10.1007\/PL00005491","journal-title":"Psychopharmacology (Berl)"},{"issue":"5","key":"ref33","doi-asserted-by":"publisher","first-page":"1936","DOI":"10.1523\/JNEUROSCI.16-05-01936.1996","article-title":"A framework for mesencephalic dopamine systems based on predictive Hebbian learning","volume":"16","author":"Montague P","year":"1996","unstructured":"Montague, P., Dayan, P., & Sejnowski, T. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of Neuroscience, 16(5), 1936\u20131947. https:\/\/doi.org\/10.1523\/JNEUROSCI.16-05-01936.1996","journal-title":"The Journal of Neuroscience"},{"issue":"2","key":"ref34","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1016\/S0896-6273(03)00169-7","article-title":"Temporal Difference Models and Reward-Related Learning in the Human Brain","volume":"38","author":"O\u2019Doherty JP","year":"2003","unstructured":"O\u2019Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003). Temporal Difference Models and Reward-Related Learning in the Human Brain. Neuron, 38(2), 329\u2013337. https:\/\/doi.org\/10.1016\/S0896-6273(03)00169-7","journal-title":"Neuron"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"108164","DOI":"10.1016\/j.drugalcdep.2020.108164","article-title":"Quit ratios for cigarette smoking among individuals with opioid misuse and opioid use disorder in the United States","volume":"214","author":"Parker MA","year":"2020","unstructured":"Parker, M. A., Weinberger, A. H., & Villanti, A. C. (2020). Quit ratios for cigarette smoking among individuals with opioid misuse and opioid use disorder in the United States. Drug and Alcohol Dependence, 214, 108164. https:\/\/doi.org\/10.1016\/j.drugalcdep.2020.108164","journal-title":"Drug and Alcohol Dependence"},{"issue":"6","key":"ref36","doi-asserted-by":"publisher","first-page":"761","DOI":"10.1080\/00952990.2025.2564757","article-title":"Randomized, placebo-controlled trial of gabapentin during outpatient buprenorphine-assisted taper and transition to injectable naltrexone","volume":"51","author":"Ray A","year":"2025","unstructured":"Ray, A., Mancino, M. J., Thostenson, J. D., Guise, J. B., Hendrickson, H. P., Nunes, E. V., & Oliveto, A. H. (2025). Randomized, placebo-controlled trial of gabapentin during outpatient buprenorphine-assisted taper and transition to injectable naltrexone. The American Journal of Drug and Alcohol Abuse, 51(6), 761\u2013775. https:\/\/doi.org\/10.1080\/00952990.2025.2564757","journal-title":"The American Journal of Drug and Alcohol Abuse"},{"issue":"1","key":"ref37","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1186\/1471-2105-12-77","article-title":"pROC: an open-source package for R and S\u2009+\u2009to analyze and compare ROC curves","volume":"12","author":"Robin X","year":"2011","unstructured":"Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J. C., & M\u00fcller, M. (2011). pROC: an open-source package for R and S\u2009+\u2009to analyze and compare ROC curves. Bmc Bioinformatics, 12(1), 77. https:\/\/doi.org\/10.1186\/1471-2105-12-77","journal-title":"Bmc Bioinformatics"},{"issue":"3","key":"ref38","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1007\/s00213-006-0668-9","article-title":"Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits","volume":"191","author":"Salamone JD","year":"2007","unstructured":"Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology (Berl), 191(3), 461\u2013482. https:\/\/doi.org\/10.1007\/s00213-006-0668-9","journal-title":"Psychopharmacology (Berl)"},{"key":"ref39","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.brainresbull.2022.01.019","article-title":"Complexities and paradoxes in understanding the role of dopamine in incentive motivation and instrumental action: Exertion of effort vs. Anhedonia","volume":"182","author":"Salamone JD","year":"2022","unstructured":"Salamone, J. D., Ecevitoglu, A., Carratala-Ros, C., Presby, R. E., Edelstein, G. A., Fleeher, R., Rotolo, R. A., Meka, N., Srinath, S., Masthay, J. C., & Correa, M. (2022). Complexities and paradoxes in understanding the role of dopamine in incentive motivation and instrumental action: Exertion of effort vs. Anhedonia. Brain Research Bulletin, 182, 57\u201366. https:\/\/doi.org\/10.1016\/j.brainresbull.2022.01.019","journal-title":"Brain Research Bulletin"},{"issue":"5","key":"ref40","doi-asserted-by":"publisher","first-page":"1325","DOI":"10.1093\/brain\/aww050","article-title":"Activational and effort-related aspects of motivation: Neural mechanisms and implications for psychopathology","volume":"139","author":"Salamone JD","year":"2016","unstructured":"Salamone, J. D., Yohn, S. E., L\u00f3pez-Cruz, L., San Miguel, N., & Correa, M. (2016). Activational and effort-related aspects of motivation: Neural mechanisms and implications for psychopathology. Brain, 139(5), 1325\u20131347. https:\/\/doi.org\/10.1093\/brain\/aww050","journal-title":"Brain"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.1101\/2023.03.17.533213","article-title":"Valence-partitioned learning signals drive choice behavior and phenomenal subjective experience in humans","author":"Sands LP","year":"2023","unstructured":"Sands, L. P., Jiang, A., Jones, R. E., Trattner, J. D., & Kishida, K. T. (2023). Valence-partitioned learning signals drive choice behavior and phenomenal subjective experience in humans. bioRxiv. https:\/\/doi.org\/https:\/\/doi.org\/10.1101\/2023.03.17.533213","journal-title":"bioRxiv"},{"issue":"48","key":"ref42","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.adi4927","article-title":"Subsecond fluctuations in extracellular dopamine encode reward and punishment prediction errors in humans","volume":"9","author":"Sands LP","year":"2023","unstructured":"Sands, L. P., Jiang, A., Liebenow, B., DiMarco, E., Laxton, A. W., Tatter, S. B., Montague, P. R., & Kishida, K. T. (2023). Subsecond fluctuations in extracellular dopamine encode reward and punishment prediction errors in humans. Science Advances, 9(48). https:\/\/doi.org\/10.1126\/sciadv.adi4927","journal-title":"Science Advances"},{"issue":"5306","key":"ref43","doi-asserted-by":"publisher","first-page":"1593","DOI":"10.1126\/science.275.5306.1593","article-title":"A Neural Substrate of Prediction and Reward","volume":"275","author":"Schultz W","year":"1997","unstructured":"Schultz, W., Dayan, P., & Montague, P. R. (1997). A Neural Substrate of Prediction and Reward. Science, 275(5306), 1593\u20131599. https:\/\/doi.org\/10.1126\/science.275.5306.1593","journal-title":"Science"},{"issue":"1\u20133","key":"ref44","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1016\/j.ejphar.2007.09.042","article-title":"PET imaging of dopamine transporter and drug craving during methadone maintenance treatment and after prolonged abstinence in heroin users","volume":"579","author":"Shi J","year":"2008","unstructured":"Shi, J., Zhao, L. Y., Copersino, M. L., Fang, Y. X., Chen, Y., Tian, J., Deng, Y., Shuai, Y., Jin, J., & Lu, L. (2008). PET imaging of dopamine transporter and drug craving during methadone maintenance treatment and after prolonged abstinence in heroin users. European Journal of Pharmacology, 579(1\u20133), 160\u2013166. https:\/\/doi.org\/10.1016\/j.ejphar.2007.09.042","journal-title":"European Journal of Pharmacology"},{"issue":"1","key":"ref45","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1007\/BF00634151","article-title":"Smoking withdrawal symptoms in two weeks of abstinence","volume":"50","author":"Shiffman SM","year":"1976","unstructured":"Shiffman, S. M., & Jarvik, M. E. (1976). Smoking withdrawal symptoms in two weeks of abstinence. Psychopharmacology (Berl), 50(1), 35\u201339. https:\/\/doi.org\/10.1007\/BF00634151","journal-title":"Psychopharmacology (Berl)"},{"key":"ref46","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1007\/BF00115009","article-title":"Learning to Predict by the Methods of Temporal Differences","volume":"3","author":"Sutton RS","year":"1988","unstructured":"Sutton, R. S. (1988). Learning to Predict by the Methods of Temporal Differences. Machine Learning, 3, 9\u201344. https:\/\/doi.org\/https:\/\/doi.org\/10.1007\/BF00115009","journal-title":"Machine Learning"},{"key":"ref47","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton RS","year":"1998","unstructured":"Sutton, R. S., & Barto, A. G. (1998). Reinforcement Learning: An Introduction (Vol. 1). MIT Press."},{"issue":"3","key":"ref48","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1037\/a0028813","article-title":"Effort-based decision-making in major depressive disorder: A translational model of motivational anhedonia","volume":"121","author":"Treadway MT","year":"2012","unstructured":"Treadway, M. T., Bossaller, N. A., Shelton, R. C., & Zald, D. H. (2012). Effort-based decision-making in major depressive disorder: A translational model of motivational anhedonia. Journal of Abnormal Psychology, 121(3), 553\u2013558. https:\/\/doi.org\/10.1037\/a0028813","journal-title":"Journal of Abnormal Psychology"},{"issue":"8","key":"ref49","doi-asserted-by":"publisher","first-page":"e6598","DOI":"10.1371\/journal.pone.0006598","article-title":"Worth the \u2018EEfRT\u2019? The Effort Expenditure for Rewards Task as an Objective Measure of Motivation and Anhedonia","volume":"4","author":"Treadway MT","year":"2009","unstructured":"Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., & Zald, D. H. (2009). Worth the \u2018EEfRT\u2019? The Effort Expenditure for Rewards Task as an Objective Measure of Motivation and Anhedonia. Plos One, 4(8), e6598. https:\/\/doi.org\/10.1371\/journal.pone.0006598","journal-title":"Plos One"},{"issue":"3","key":"ref50","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1016\/j.neubiorev.2010.06.006","article-title":"Reconsidering anhedonia in depression: Lessons from translational neuroscience","volume":"35","author":"Treadway MT","year":"2011","unstructured":"Treadway, M. T., & Zald, D. H. (2011). Reconsidering anhedonia in depression: Lessons from translational neuroscience. Neuroscience & Biobehavioral Reviews, 35(3), 537\u2013555. https:\/\/doi.org\/10.1016\/j.neubiorev.2010.06.006","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"ref51","author":"Vehtari A","year":"2024","unstructured":"Vehtari, A., Gabry, J., Magnusson, M., Yao, Y., B\u00fcrkner, P., Paananen, T., & Gelman, A. (2024). loo: Efficient leave-one-out cross-validation and WAIC for Bayesian models. In R package version 2.8.0."},{"issue":"5","key":"ref52","doi-asserted-by":"publisher","first-page":"1413","DOI":"10.1007\/s11222-016-9696-4","article-title":"Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC","volume":"27","author":"Vehtari A","year":"2017","unstructured":"Vehtari, A., Gelman, A., & Gabry, J. (2017). Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Statistics and Computing, 27(5), 1413\u20131432. https:\/\/doi.org\/10.1007\/s11222-016-9696-4","journal-title":"Statistics and Computing"},{"issue":"46","key":"ref53","doi-asserted-by":"publisher","first-page":"16597","DOI":"10.1523\/JNEUROSCI.4387-11.2011","article-title":"Amping Up Effort: Effects of d-Amphetamine on Human Effort-Based Decision-Making","volume":"31","author":"Wardle MC","year":"2011","unstructured":"Wardle, M. C., Treadway, M. T., Mayo, L. M., Zald, D. H., & de Wit, H. (2011). Amping Up Effort: Effects of d-Amphetamine on Human Effort-Based Decision-Making. The Journal of Neuroscience, 31(46), 16597\u201316602. https:\/\/doi.org\/10.1523\/JNEUROSCI.4387-11.2011","journal-title":"The Journal of Neuroscience"},{"issue":"3\u20134","key":"ref54","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins CJCH","year":"1992","unstructured":"Watkins, C. J. C. H., & Dayan, P. (1992). Q-learning. Machine Learning, 8(3\u20134), 279\u2013292. https:\/\/doi.org\/10.1007\/BF00992698","journal-title":"Machine Learning"},{"issue":"5","key":"ref55","doi-asserted-by":"publisher","first-page":"1127","DOI":"10.1093\/schbul\/sbae024","article-title":"Using Computational Phenotyping to Identify Divergent Strategies for Effort Allocation Across the Psychosis Spectrum","volume":"50","author":"Whitton AE","year":"2024","unstructured":"Whitton, A. E., Cooper, J. A., Merchant, J. T., Treadway, M. T., & Lewandowski, K. E. (2024). Using Computational Phenotyping to Identify Divergent Strategies for Effort Allocation Across the Psychosis Spectrum. Schizophrenia Bulletin, 50(5), 1127\u20131136. https:\/\/doi.org\/10.1093\/schbul\/sbae024","journal-title":"Schizophrenia Bulletin"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/www.researchsquare.com\/article\/rs-8928184\/v1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.researchsquare.com\/article\/rs-8928184\/v1.html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,31]],"date-time":"2026-08-31T16:12:14Z","timestamp":1788192734000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.researchsquare.com\/article\/rs-8928184\/v1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,17]]},"references-count":55,"URL":"https:\/\/doi.org\/10.21203\/rs.3.rs-8928184\/v1","relation":{"is-preprint-of":[{"id-type":"doi","id":"10.1007\/s10827-026-00953-6","asserted-by":"subject"}]},"subject":[],"published":{"date-parts":[[2026,3,17]]},"subtype":"preprint"}}