{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T02:33:17Z","timestamp":1793068397557,"version":"4.5.0"},"reference-count":75,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T00:00:00Z","timestamp":1787875200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T00:00:00Z","timestamp":1787875200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Wake Forest University","id":[{"id":"https:\/\/ror.org\/0207ad724","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Comput Neurosci"],"published-print":{"date-parts":[[2026,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Effort-based decision making evaluates rewards relative to the effort required to obtain it, an important process of healthy goal-directed motivation and behavior. Computational models provide mechanistic insights underlying choice behavior and potential alterations in neuropsychiatric disorders, including substance use disorders. We applied computational models to effort-based choice behavior to characterize underlying decision processes and if these mechanisms differ by substance use status. Participants completed the Effort Expenditure for Rewards Task, choosing between low- and high-effort options for monetary rewards varying in magnitude and probability. Participants met criteria for no tobacco use (n\u2009=\u200923), current tobacco use disorder (n\u2009=\u200926), former tobacco use disorder (n\u2009=\u200922), and tobacco and opioid use disorder (n\u2009=\u200929). Computational models from two families, Subjective Value and Reinforcement Learning, were fit and compared. Parameters from the best-fitting model underwent principal components analysis and linear discriminant analysis. Temporal difference reinforcement learning model demonstrated greater model evidence and predictive accuracy, indicating better fit to effort-based choice behavior. Principal components analysis revealed meaningful multivariate distinctions: PC1 differentiated all groups except individuals without tobacco use versus individuals with current tobacco use disorder; PC3 distinguished tobacco and opioid use disorder from all other groups. Linear discriminant analysis demonstrated group separation with 84% classification accuracy. A reinforcement learning framework better explained participants\u2019 effort-based choice behavior. Substance use status relates to dynamic behavioral changes (i.e. learning) as measured by the multivariate combination of learning rate, future discounting, and choice temperature.<\/jats:p>","DOI":"10.1007\/s10827-026-00953-6","type":"journal-article","created":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T07:31:21Z","timestamp":1787902281000},"page":"709-723","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Effort and substance use: differentiating tobacco use through reinforcement learning of effort based decision making"],"prefix":"10.1007","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0822-3108","authenticated-orcid":false,"given":"Kasey P.","family":"Spry","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jazmyne","family":"James","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alison H.","family":"Oliveto","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Mancino","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kenneth T.","family":"Kishida","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Merideth A.","family":"Addicott","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,8,28]]},"reference":[{"issue":"4","key":"953_CR1","doi-asserted-by":"publisher","first-page":"1081","DOI":"10.1007\/s00213-019-05437-3","volume":"237","author":"MA Addicott","year":"2020","unstructured":"Addicott, M. A., Wardle, M. C., & Selig, J. P. (2020). Effort-based decision making varies by smoking status. Psychopharmacology (Berl), 237(4), 1081\u20131090. https:\/\/doi.org\/10.1007\/s00213-019-05437-3","journal-title":"Psychopharmacology (Berl)"},{"issue":"4","key":"953_CR2","doi-asserted-by":"publisher","first-page":"1119","DOI":"10.1007\/s00213-019-05196-1","volume":"236","author":"AH Ashok","year":"2019","unstructured":"Ashok, A. H., Mizuno, Y., & Howes, O. D. (2019). Tobacco smoking and dopaminergic function in humans: A meta-analysis of molecular imaging studies. Psychopharmacology (Berl), 236(4), 1119\u20131129. https:\/\/doi.org\/10.1007\/s00213-019-05196-1","journal-title":"Psychopharmacology (Berl)"},{"issue":"3","key":"953_CR3","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1016\/j.neubiorev.2008.10.010","volume":"33","author":"SM Assadi","year":"2009","unstructured":"Assadi, S. M., Y\u00fccel, M., & Pantelis, C. (2009). Dopamine modulates neural networks involved in effort-based decision-making. Neuroscience & Biobehavioral Reviews, 33(3), 383\u2013393. https:\/\/doi.org\/10.1016\/j.neubiorev.2008.10.010","journal-title":"Neuroscience & Biobehavioral Reviews"},{"issue":"1","key":"953_CR4","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1038\/s41386-021-01108-0","volume":"47","author":"B Averbeck","year":"2022","unstructured":"Averbeck, B., & O\u2019Doherty, J. P. (2022). Reinforcement-learning in fronto-striatal circuits. Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology, 47(1), 147\u2013162. https:\/\/doi.org\/10.1038\/s41386-021-01108-0","journal-title":"Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology"},{"key":"953_CR5","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1016\/j.nlm.2016.07.015","volume":"133","author":"MR Bailey","year":"2016","unstructured":"Bailey, M. R., Simpson, E. H., & Balsam, P. D. (2016). Neural substrates underlying effort, time, and risk-based decision making in motivated behavior. Neurobiology of Learning and Memory, 133, 233\u2013256. https:\/\/doi.org\/10.1016\/j.nlm.2016.07.015","journal-title":"Neurobiology of Learning and Memory"},{"issue":"2","key":"953_CR6","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1037\/a0036299","volume":"123","author":"DM Barch","year":"2014","unstructured":"Barch, D. M., Treadway, M. T., & Schoen, N. (2014). Effort, anhedonia, and function in schizophrenia: Reduced effort allocation predicts amotivation and functional impairment. Journal of Abnormal Psychology, 123(2), 387\u2013397. https:\/\/doi.org\/10.1037\/a0036299","journal-title":"Journal of Abnormal Psychology"},{"issue":"10","key":"953_CR7","doi-asserted-by":"publisher","first-page":"2397","DOI":"10.1038\/npp.2014.87","volume":"39","author":"MA Bloomfield","year":"2014","unstructured":"Bloomfield, M. A., Pepper, F., Egerton, A., Demjaha, A., Tomasi, G., Mouchlianitis, E., Maximen, L., Veronese, M., Turkheimer, F., Selvaraj, S., & Howes, O. D. (2014). Dopamine Function in Cigarette Smokers: An [18F]-DOPA PET Study. Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology, 39(10), 2397\u20132404. https:\/\/doi.org\/10.1038\/npp.2014.87","journal-title":"Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology"},{"issue":"23","key":"953_CR8","doi-asserted-by":"publisher","first-page":"3924","DOI":"10.1016\/j.neuron.2025.08.019","volume":"113","author":"P Branco","year":"2025","unstructured":"Branco, P., Cox, J., Wu, Y., Morison, S. L., Parker, J. G., Lerner, T. N., Martina, M., Awatramani, R., Surmeier, D. J., & Apkarian, A. V. (2025). The role of mesolimbic circuitry in aversive signaling and opioid dependence. Neuron, 113(23), 3924\u20133941. https:\/\/doi.org\/10.1016\/j.neuron.2025.08.019","journal-title":"Neuron"},{"issue":"1","key":"953_CR9","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/S0091-3057(00)00431-7","volume":"68","author":"WF Caul","year":"2001","unstructured":"Caul, W. F., & Brindle, N. A. (2001). Schedule-dependent effects of haloperidol and amphetamine: Multiple-schedule task shows within-subject effects. Pharmacology Biochemistry and Behavior, 68(1), 53\u201363. https:\/\/doi.org\/10.1016\/S0091-3057(00)00431-7","journal-title":"Pharmacology Biochemistry and Behavior"},{"key":"953_CR11","unstructured":"Centers for Disease Control and Prevention. (2025). Understanding the opioid overdose epidemic. Overdose Prevention. https:\/\/www.cdc.gov\/overdose-prevention\/about\/understanding-the-opioid-overdose-epidemic.html"},{"key":"953_CR10","unstructured":"Centers for Disease Control and Prevention. (2024). Cigarette smoking. Smoking and Tobacco Use. https:\/\/www.cdc.gov\/tobacco\/about\/index.html"},{"issue":"7","key":"953_CR12","doi-asserted-by":"publisher","first-page":"710","DOI":"10.1037\/abn0000443","volume":"128","author":"JA Cooper","year":"2019","unstructured":"Cooper, J. A., Barch, D. M., Reddy, L. F., Horan, W. P., Green, M. F., & Treadway, M. T. (2019). Effortful goal-directed behavior in schizophrenia: Computational subtypes and associations with cognition. Journal of Abnormal Psychology, 128(7), 710\u2013722. https:\/\/doi.org\/10.1037\/abn0000443","journal-title":"Journal of Abnormal Psychology"},{"key":"953_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.cobeha.2017.12.003","volume":"22","author":"AJ Culbreth","year":"2018","unstructured":"Culbreth, A. J., Moran, E. K., & Barch, D. M. (2018). Effort-based decision-making in schizophrenia. Current Opinion in Behavioral Sciences, 22, 1\u20136. https:\/\/doi.org\/10.1016\/j.cobeha.2017.12.003","journal-title":"Current Opinion in Behavioral Sciences"},{"key":"953_CR14","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1002\/syn","volume":"42","author":"A Dagher","year":"2001","unstructured":"Dagher, A., Bleicher, C., Aston, J. A. D., Gunn, R. N., Clarke, P. B. S., & Cumming, P. (2001). Reduced Dopamine D1 Receptor Binding in the Ventral Striatum of Cigarette Smokers. Synapse (New York, N. Y.), 42, 48\u201353. https:\/\/doi.org\/10.1002\/syn","journal-title":"Synapse (New York, N. Y.)"},{"issue":"9","key":"953_CR15","doi-asserted-by":"publisher","first-page":"2085","DOI":"10.1038\/npp.2015.60","volume":"40","author":"JW de Jong","year":"2015","unstructured":"de Jong, J. W., Roelofs, T. J. M., Mol, F. M. U., Hillen, A. E. J., Meijboom, K. E., Luijendijk, M. C. M., van der Eerden, H. A. M., Garner, K. M., Vanderschuren, L. J. M. J., & Adan, R. A. H. (2015). Reducing Ventral Tegmental Dopamine D2 Receptor Expression Selectively Boosts Incentive Motivation. Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology, 40(9), 2085\u20132095. https:\/\/doi.org\/10.1038\/npp.2015.60","journal-title":"Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology"},{"issue":"4","key":"953_CR16","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1176\/appi.ajp.2007.07020352","volume":"165","author":"C Fehr","year":"2008","unstructured":"Fehr, C., Yakushev, I., Hohmann, N., Buchholz, H. G., Landvogt, C., Deckers, H., Eberhardt, A., Kl\u00e4ger, M., Smolka, M. N., Scheurich, A., Dielentheis, T., Schmidt, L. G., R\u00f6sch, F., Bartenstein, P., Gr\u00fcnder, G., & Schreckenberger, M. (2008). Association of Low Striatal Dopamine D2 Receptor Availability With Nicotine Dependence Similar to That Seen With Other Drugs of Abuse. American Journal of Psychiatry, 165(4), 507\u2013514. https:\/\/doi.org\/10.1176\/appi.ajp.2007.07020352","journal-title":"American Journal of Psychiatry"},{"issue":"8","key":"953_CR17","doi-asserted-by":"publisher","first-page":"1966","DOI":"10.1038\/sj.npp.1301565","volume":"33","author":"SB Floresco","year":"2008","unstructured":"Floresco, S. B., Tse, M. T. L., & Ghods-Sharifi, S. (2008). Dopaminergic and Glutamatergic Regulation of Effort- and Delay-Based Decision Making. Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology, 33(8), 1966\u20131979. https:\/\/doi.org\/10.1038\/sj.npp.1301565","journal-title":"Neuropsychopharmacology : Official Publication Of The American College Of Neuropsychopharmacology"},{"key":"953_CR18","doi-asserted-by":"publisher","unstructured":"Gronau, Q. F., Singmann, H., & Wagenmakers, E. J. (2020). Bridgesampling: An R package for estimating normalizing constants. Journal of Statistical Software, 92(10). https:\/\/doi.org\/10.18637\/jss.v092.i10","DOI":"10.18637\/jss.v092.i10"},{"key":"953_CR19","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.pbb.2016.07.006","volume":"149","author":"JJ Hammersley","year":"2016","unstructured":"Hammersley, J. J., Gilbert, D. G., Rzetelny, A., & Rabinovich, N. E. (2016). Moderation of nicotine effects on covert orienting of attention tasks by poor placebo performance and cue validity. Pharmacology Biochemistry and Behavior, 149, 9\u201316. https:\/\/doi.org\/10.1016\/j.pbb.2016.07.006","journal-title":"Pharmacology Biochemistry and Behavior"},{"issue":"3","key":"953_CR20","doi-asserted-by":"publisher","first-page":"293","DOI":"10.3109\/00952998709001515","volume":"13","author":"L Handelsman","year":"1987","unstructured":"Handelsman, L., Cochrane, K. J., Aronson, M. J., Ness, R., Rubinstein, K. J., & Kanof, P. D. (1987). Two New Rating Scales for Opiate Withdrawal. The American Journal of Drug and Alcohol Abuse, 13(3), 293\u2013308. https:\/\/doi.org\/10.3109\/00952998709001515","journal-title":"The American Journal of Drug and Alcohol Abuse"},{"issue":"3","key":"953_CR21","doi-asserted-by":"publisher","first-page":"698","DOI":"10.1523\/JNEUROSCI.2489-13.2014","volume":"34","author":"AS Hart","year":"2014","unstructured":"Hart, A. S., Rutledge, R. B., Glimcher, P. W., & Phillips, P. E. M. (2014). Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. Journal of Neuroscience, 34(3), 698\u2013704. https:\/\/doi.org\/10.1523\/JNEUROSCI.2489-13.2014","journal-title":"Journal of Neuroscience"},{"issue":"2","key":"953_CR22","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1093\/schbul\/sbu102","volume":"41","author":"MN Hartmann","year":"2015","unstructured":"Hartmann, M. N., Hager, O. M., Reimann, A. V., Chumbley, J. R., Kirschner, M., Seifritz, E., Tobler, P. N., & Kaiser, S. (2015). Apathy But Not Diminished Expression in Schizophrenia Is Associated With Discounting of Monetary Rewards by Physical Effort. Schizophrenia Bulletin, 41(2), 503\u2013512. https:\/\/doi.org\/10.1093\/schbul\/sbu102","journal-title":"Schizophrenia Bulletin"},{"issue":"10","key":"953_CR23","doi-asserted-by":"publisher","first-page":"e0240291","DOI":"10.1371\/journal.pone.0240291","volume":"15","author":"JA Holst-Hansen","year":"2020","unstructured":"Holst-Hansen, J. A., & Bergenholtz, C. (2020). Does the size of rewards influence performance in cognitively demanding tasks? PLOS ONE, 15(10), e0240291. https:\/\/doi.org\/10.1371\/journal.pone.0240291","journal-title":"PLOS ONE"},{"issue":"6","key":"953_CR24","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1037\/neu0000284","volume":"30","author":"J Huang","year":"2016","unstructured":"Huang, J., Yang, X., Lan, Y., Zhu, C., Liu, X., Wang, Y., Cheung, E. F. C., Xie, G., & Chan, R. C. K (2016). Neural substrates of the impaired effort expenditure decision making in schizophrenia. Neuropsychology, 30(6), 685\u2013696. https:\/\/doi.org\/10.1037\/neu0000284","journal-title":"Neuropsychology"},{"issue":"3","key":"953_CR25","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1038\/nn.4238","volume":"19","author":"QJM Huys","year":"2016","unstructured":"Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016). Computational psychiatry as a bridge from neuroscience to clinical applications. Nature Neuroscience, 19(3), 404\u2013413. https:\/\/doi.org\/10.1038\/nn.4238","journal-title":"Nature Neuroscience"},{"issue":"4","key":"953_CR26","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1016\/j.tics.2018.01.007","volume":"22","author":"M Inzlicht","year":"2018","unstructured":"Inzlicht, M., Shenhav, A., & Olivola, C. Y. (2018). The Effort Paradox: Effort Is Both Costly and Valued. Trends in Cognitive Sciences, 22(4), 337\u2013349. https:\/\/doi.org\/10.1016\/j.tics.2018.01.007","journal-title":"Trends in Cognitive Sciences"},{"issue":"40","key":"953_CR27","doi-asserted-by":"publisher","first-page":"7648","DOI":"10.1523\/JNEUROSCI.2223-21.2022","volume":"42","author":"H Jarvis","year":"2022","unstructured":"Jarvis, H., Stevenson, I., Huynh, A. Q., Babbage, E., Coxon, J., & Chong, T. T. J. (2022). Effort Reinforces Learning. Journal of Neuroscience, 42(40), 7648\u20137658. https:\/\/doi.org\/10.1523\/JNEUROSCI.2223-21.2022","journal-title":"Journal of Neuroscience"},{"key":"953_CR28","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1016\/j.drugalcdep.2018.11.011","volume":"194","author":"WS John","year":"2019","unstructured":"John, W. S., Zhu, H., Mannelli, P., Subramaniam, G. A., Schwartz, R. P., McNeely, J., & Wu, L. T. (2019). Prevalence and patterns of opioid misuse and opioid use disorder among primary care patients who use tobacco. Drug and Alcohol Dependence, 194, 468\u2013475. https:\/\/doi.org\/10.1016\/j.drugalcdep.2018.11.011","journal-title":"Drug and Alcohol Dependence"},{"key":"953_CR29","doi-asserted-by":"publisher","unstructured":"Kishida, K. T., & Sands, L. P. (n.d.). Title a dynamic affective core to bind the contents, context, and value of conscious experience. https:\/\/doi.org\/10.1101\/2021.05.20.444839","DOI":"10.1101\/2021.05.20.444839"},{"key":"953_CR30","doi-asserted-by":"publisher","unstructured":"Klein-Fl\u00fcgge, M. C., Kennerley, S. W., Saraiva, A. C., Penny, W. D., & Bestmann, S. (2015). Behavioral modeling of human choices reveals dissociable effects of physical effort and temporal delay on reward devaluation. PLoS Computational Biology, 11(3). https:\/\/doi.org\/10.1371\/journal.pcbi.1004116","DOI":"10.1371\/journal.pcbi.1004116"},{"issue":"16","key":"953_CR31","doi-asserted-by":"publisher","first-page":"4459","DOI":"10.1002\/hbm.25085","volume":"41","author":"B Klugah-Brown","year":"2020","unstructured":"Klugah-Brown, B., Di, X., Zweerings, J., Mathiak, K., Becker, B., & Biswal, B. (2020). Common and separable neural alterations in substance use disorders: A coordinate\u2010based meta\u2010analyses of functional neuroimaging studies in humans. Human Brain Mapping, 41(16), 4459\u20134477. https:\/\/doi.org\/10.1002\/hbm.25085","journal-title":"Human Brain Mapping"},{"key":"953_CR32","doi-asserted-by":"publisher","unstructured":"Koppel, L., Lindkvist, A. M., & Tingh\u00f6g, G. (2026). Money talks? How different incentive schemes influence prosocial behavior in economic games. Experimental Economics, 1\u201321. https:\/\/doi.org\/10.1017\/eec.2026.10044","DOI":"10.1017\/eec.2026.10044"},{"key":"953_CR33","doi-asserted-by":"publisher","DOI":"10.1016\/j.bpsc.2025.02.006","author":"M Kuhn","year":"2025","unstructured":"Kuhn, M., Palermo, E. H., Pagnier, G., Blank, J., Steinberger, M., Long, D. C., Nowicki, Y., Cooper, G., Treadway, J. A., Frank, M. T., M. J., & Pizzagalli, D. A. (2025). Computational Phenotyping of Effort-Based Decision Making in Unmedicated Adults with Remitted Depression. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging. https:\/\/doi.org\/10.1016\/j.bpsc.2025.02.006","journal-title":"Biological Psychiatry: Cognitive Neuroscience and Neuroimaging"},{"key":"953_CR34","doi-asserted-by":"publisher","unstructured":"Kurniawan, I. T. (2011). Dopamine and effort-based decision making. Frontiers in Neuroscience, 5(JUN). https:\/\/doi.org\/10.3389\/fnins.2011.00081","DOI":"10.3389\/fnins.2011.00081"},{"key":"953_CR35","doi-asserted-by":"publisher","first-page":"1028121","DOI":"10.3389\/fninf.2022.1028121","volume":"16","author":"AM Kustubayeva","year":"2022","unstructured":"Kustubayeva, A. M., Nelson, E. B., Smith, M. L., Allendorfer, J. B., & Eliassen, J. C. (2022). Functional MRI study of feedback-based reinforcement learning in depression. Frontiers in Neuroinformatics, 16, 1028121. https:\/\/doi.org\/10.3389\/fninf.2022.1028121","journal-title":"Frontiers in Neuroinformatics"},{"issue":"1","key":"953_CR36","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/s11166-007-9028-3","volume":"36","author":"J Lee","year":"2008","unstructured":"Lee, J. (2008). The effect of the background risk in a simple chance improving decision model. Journal of Risk and Uncertainty, 36(1), 19\u201341. https:\/\/doi.org\/10.1007\/s11166-007-9028-3","journal-title":"Journal of Risk and Uncertainty"},{"key":"953_CR37","doi-asserted-by":"publisher","unstructured":"Liebenow, B., Jones, R., DiMarco, E., Trattner, J. D., Humphries, J., Sands, L. P., Spry, K. P., Johnson, C. K., Farkas, E. B., Jiang, A., & Kishida, K. T. (2022). Computational reinforcement learning, reward (and punishment), and dopamine in psychiatric disorders. Frontiers in Psychiatry, 13. https:\/\/doi.org\/10.3389\/fpsyt.2022.886297","DOI":"10.3389\/fpsyt.2022.886297"},{"key":"953_CR38","doi-asserted-by":"publisher","first-page":"1403604","DOI":"10.3389\/fpsyt.2025.1403604","volume":"16","author":"L Ma","year":"2025","unstructured":"Ma, L., Tao, Q., Dang, J., Sun, J., Niu, X., Zhang, M., Kang, Y., Wang, W., Cheng, J., & Zhang, Y. (2025). The structural and functional brain alternations in tobacco use disorder: A systematic review and meta-analysis. Frontiers in Psychiatry, 16, 1403604. https:\/\/doi.org\/10.3389\/fpsyt.2025.1403604","journal-title":"Frontiers in Psychiatry"},{"key":"953_CR39","unstructured":"MacKay, D. J. C. (2003). Information theory, inference, and learning algorithms. Cambridge University Press."},{"issue":"2","key":"953_CR40","doi-asserted-by":"publisher","first-page":"e12743","DOI":"10.1111\/adb.12743","volume":"25","author":"PA McConnell","year":"2020","unstructured":"McConnell, P. A., Garland, E. L., Zubieta, J., Newman-Norlund, R., Powers, S., & Froeliger, B. (2020). Impaired frontostriatal functional connectivity among chronic opioid using pain patients is associated with dysregulated affect. Addiction Biology, 25(2), e12743. https:\/\/doi.org\/10.1111\/adb.12743","journal-title":"Addiction Biology"},{"issue":"7","key":"953_CR41","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1080\/10826084.2020.1725056","volume":"55","author":"RK McHugh","year":"2020","unstructured":"McHugh, R. K., Janes, A. C., Griffin, M. L., Taghian, N., Greenfield, S. F., & Weiss, R. D. (2020). Clinical Correlates of Smoking Status in Men and Women with Opioid Use Disorder. Substance Use & Misuse, 55(7), 1054\u20131058. https:\/\/doi.org\/10.1080\/10826084.2020.1725056","journal-title":"Substance Use & Misuse"},{"issue":"4","key":"953_CR43","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1007\/PL00005491","volume":"146","author":"SH Mitchell","year":"1999","unstructured":"Mitchell, S. H. (1999). Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology (Berl), 146(4), 455\u2013464. https:\/\/doi.org\/10.1007\/PL00005491","journal-title":"Psychopharmacology (Berl)"},{"issue":"5","key":"953_CR42","doi-asserted-by":"publisher","first-page":"819","DOI":"10.1080\/14622200412331296002","volume":"6","author":"S Mitchell","year":"2004","unstructured":"Mitchell, S. (2004). Effects of short-term nicotine deprivation on decision-making: Delay, uncertainty and effort discounting. Nicotine & Tobacco Research, 6(5), 819\u2013828. https:\/\/doi.org\/10.1080\/14622200412331296002","journal-title":"Nicotine & Tobacco Research"},{"issue":"5","key":"953_CR44","doi-asserted-by":"publisher","first-page":"1936","DOI":"10.1523\/JNEUROSCI.16-05-01936.1996","volume":"16","author":"P Montague","year":"1996","unstructured":"Montague, P., Dayan, P., & Sejnowski, T. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of Neuroscience, 16(5), 1936\u20131947. https:\/\/doi.org\/10.1523\/JNEUROSCI.16-05-01936.1996","journal-title":"The Journal of Neuroscience"},{"issue":"1","key":"953_CR45","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1016\/j.tics.2011.11.018","volume":"16","author":"PR Montague","year":"2012","unstructured":"Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012). Computational psychiatry. Trends in Cognitive Sciences, 16(1), 72\u201380. https:\/\/doi.org\/10.1016\/j.tics.2011.11.018","journal-title":"Trends in Cognitive Sciences"},{"issue":"10","key":"953_CR46","doi-asserted-by":"publisher","first-page":"e0275027","DOI":"10.1371\/journal.pone.0275027","volume":"17","author":"C Nunez","year":"2022","unstructured":"Nunez, C., Hoots, J. K., Schepers, S. T., Bower, M., De Wit, H., & Wardle, M. C. (2022). Pharmacological investigations of effort-based decision-making in humans: Naltrexone and nicotine. PLOS ONE, 17(10), e0275027. https:\/\/doi.org\/10.1371\/journal.pone.0275027","journal-title":"PLOS ONE"},{"issue":"2","key":"953_CR47","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1016\/S0896-6273(03)00169-7","volume":"38","author":"JP O\u2019Doherty","year":"2003","unstructured":"O\u2019Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003). Temporal Difference Models and Reward-Related Learning in the Human Brain. Neuron, 38(2), 329\u2013337. https:\/\/doi.org\/10.1016\/S0896-6273(03)00169-7","journal-title":"Neuron"},{"issue":"16","key":"953_CR48","doi-asserted-by":"publisher","first-page":"4370","DOI":"10.1523\/JNEUROSCI.2524-16.2017","volume":"37","author":"IH Park","year":"2017","unstructured":"Park, I. H., Lee, B. C., Kim, J. J., Kim, J. I., & Koo, M. S. (2017). Effort-Based Reinforcement Processing and Functional Connectivity Underlying Amotivation in Medicated Patients with Depression and Schizophrenia. The Journal of Neuroscience, 37(16), 4370\u20134380. https:\/\/doi.org\/10.1523\/JNEUROSCI.2524-16.2017","journal-title":"The Journal of Neuroscience"},{"key":"953_CR49","doi-asserted-by":"publisher","first-page":"108164","DOI":"10.1016\/j.drugalcdep.2020.108164","volume":"214","author":"MA Parker","year":"2020","unstructured":"Parker, M. A., Weinberger, A. H., & Villanti, A. C. (2020). Quit ratios for cigarette smoking among individuals with opioid misuse and opioid use disorder in the United States. Drug and Alcohol Dependence, 214, 108164. https:\/\/doi.org\/10.1016\/j.drugalcdep.2020.108164","journal-title":"Drug and Alcohol Dependence"},{"issue":"3","key":"953_CR50","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1093\/schbul\/sbaa165","volume":"47","author":"DN Pratt","year":"2021","unstructured":"Pratt, D. N., Barch, D. M., Carter, C. S., Gold, J. M., Ragland, J. D., Silverstein, S. M., & MacDonald, A. W. (2021). Reliability and Replicability of Implicit and Explicit Reinforcement Learning Paradigms in People With Psychotic Disorders. Schizophrenia Bulletin, 47(3), 731\u2013739. https:\/\/doi.org\/10.1093\/schbul\/sbaa165","journal-title":"Schizophrenia Bulletin"},{"issue":"6","key":"953_CR51","doi-asserted-by":"publisher","first-page":"761","DOI":"10.1080\/00952990.2025.2564757","volume":"51","author":"A Ray","year":"2025","unstructured":"Ray, A., Mancino, M. J., Thostenson, J. D., Guise, J. B., Hendrickson, H. P., Nunes, E. V., & Oliveto, A. H. (2025). Randomized, placebo-controlled trial of gabapentin during outpatient buprenorphine-assisted taper and transition to injectable naltrexone. The American Journal of Drug and Alcohol Abuse, 51(6), 761\u2013775. https:\/\/doi.org\/10.1080\/00952990.2025.2564757","journal-title":"The American Journal of Drug and Alcohol Abuse"},{"issue":"3","key":"953_CR52","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1007\/s00213-006-0668-9","volume":"191","author":"JD Salamone","year":"2007","unstructured":"Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology (Berl), 191(3), 461\u2013482. https:\/\/doi.org\/10.1007\/s00213-006-0668-9","journal-title":"Psychopharmacology (Berl)"},{"issue":"5","key":"953_CR55","doi-asserted-by":"publisher","first-page":"1325","DOI":"10.1093\/brain\/aww050","volume":"139","author":"JD Salamone","year":"2016","unstructured":"Salamone, J. D., Yohn, S. E., L\u00f3pez-Cruz, L., San Miguel, N., & Correa, M. (2016). Activational and effort-related aspects of motivation: Neural mechanisms and implications for psychopathology. Brain, 139(5), 1325\u20131347. https:\/\/doi.org\/10.1093\/brain\/aww050","journal-title":"Brain"},{"issue":"4","key":"953_CR53","doi-asserted-by":"publisher","first-page":"747","DOI":"10.1124\/pr.117.015107","volume":"70","author":"JD Salamone","year":"2018","unstructured":"Salamone, J. D., Correa, M., Ferrigno, S., Yang, J. H., Rotolo, R. A., & Presby, R. E. (2018). The psychopharmacology of effort-related decision making: Dopamine, adenosine, and insights into the neurochemistry of motivation. Pharmacological Reviews, 70(4), 747\u2013762. https:\/\/doi.org\/10.1124\/pr.117.015107","journal-title":"Pharmacological Reviews"},{"key":"953_CR54","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.brainresbull.2022.01.019","volume":"182","author":"JD Salamone","year":"2022","unstructured":"Salamone, J. D., Ecevitoglu, A., Carratala-Ros, C., Presby, R. E., Edelstein, G. A., Fleeher, R., Rotolo, R. A., Meka, N., Srinath, S., Masthay, J. C., & Correa, M. (2022). Complexities and paradoxes in understanding the role of dopamine in incentive motivation and instrumental action: Exertion of effort vs. Anhedonia. Brain Research Bulletin, 182, 57\u201366. https:\/\/doi.org\/10.1016\/j.brainresbull.2022.01.019","journal-title":"Brain Research Bulletin"},{"key":"953_CR56","doi-asserted-by":"publisher","DOI":"10.1101\/2023.03.17.533213","author":"LP Sands","year":"2023","unstructured":"Sands, L. P., Jiang, A., Jones, R. E., Trattner, J. D., & Kishida, K. T. (2023a). Valence-partitioned learning signals drive choice behavior and phenomenal subjective experience in humans. bioRxiv. https:\/\/doi.org\/10.1101\/2023.03.17.533213","journal-title":"bioRxiv"},{"key":"953_CR57","doi-asserted-by":"publisher","unstructured":"Sands, L. P., Jiang, A., Liebenow, B., DiMarco, E., Laxton, A. W., Tatter, S. B., Montague, P. R., & Kishida, K. T. (2023b). Subsecond fluctuations in extracellular dopamine encode reward and punishment prediction errors in humans. Science Advances, 9(48). https:\/\/doi.org\/10.1126\/sciadv.adi4927","DOI":"10.1126\/sciadv.adi4927"},{"issue":"5306","key":"953_CR58","doi-asserted-by":"publisher","first-page":"1593","DOI":"10.1126\/science.275.5306.1593","volume":"275","author":"W Schultz","year":"1997","unstructured":"Schultz, W., Dayan, P., & Montague, P. R. (1997). A Neural Substrate of Prediction and Reward. Science, 275(5306), 1593\u20131599. https:\/\/doi.org\/10.1126\/science.275.5306.1593","journal-title":"Science"},{"issue":"1\u20133","key":"953_CR59","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1016\/j.ejphar.2007.09.042","volume":"579","author":"J Shi","year":"2008","unstructured":"Shi, J., Zhao, L. Y., Copersino, M. L., Fang, Y. X., Chen, Y., Tian, J., Deng, Y., Shuai, Y., Jin, J., & Lu, L. (2008). PET imaging of dopamine transporter and drug craving during methadone maintenance treatment and after prolonged abstinence in heroin users. European Journal of Pharmacology, 579(1\u20133), 160\u2013166. https:\/\/doi.org\/10.1016\/j.ejphar.2007.09.042","journal-title":"European Journal of Pharmacology"},{"issue":"1","key":"953_CR60","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1007\/BF00634151","volume":"50","author":"SM Shiffman","year":"1976","unstructured":"Shiffman, S. M., & Jarvik, M. E. (1976). Smoking withdrawal symptoms in two weeks of abstinence. Psychopharmacology (Berl), 50(1), 35\u201339. https:\/\/doi.org\/10.1007\/BF00634151","journal-title":"Psychopharmacology (Berl)"},{"issue":"4","key":"953_CR61","first-page":"971","volume":"81","author":"C Starmer","year":"1991","unstructured":"Starmer, C., & Sugden, R. (1991). Does the Random-Lottery Incentive System Elicit True Preferences? An Experimental Investigation. The American Economic Review, 81(4), 971\u2013978.","journal-title":"The American Economic Review"},{"key":"953_CR62","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1007\/BF00115009","volume":"3","author":"RS Sutton","year":"1988","unstructured":"Sutton, R. S. (1988). Learning to Predict by the Methods of Temporal Differences. Machine Learning, 3, 9\u201344. https:\/\/doi.org\/10.1007\/BF00115009","journal-title":"Machine Learning"},{"key":"953_CR63","doi-asserted-by":"crossref","unstructured":"Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction (Vol. 1). MIT Press.","DOI":"10.1109\/TNN.1998.712192"},{"issue":"3","key":"953_CR66","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1016\/j.neubiorev.2010.06.006","volume":"35","author":"MT Treadway","year":"2011","unstructured":"Treadway, M. T., & Zald, D. H. (2011). Reconsidering anhedonia in depression: Lessons from translational neuroscience. Neuroscience & Biobehavioral Reviews, 35(3), 537\u2013555. https:\/\/doi.org\/10.1016\/j.neubiorev.2010.06.006","journal-title":"Neuroscience & Biobehavioral Reviews"},{"issue":"8","key":"953_CR65","doi-asserted-by":"publisher","first-page":"e6598","DOI":"10.1371\/journal.pone.0006598","volume":"4","author":"MT Treadway","year":"2009","unstructured":"Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., & Zald, D. H. (2009). Worth the \u2018EEfRT\u2019? The Effort Expenditure for Rewards Task as an Objective Measure of Motivation and Anhedonia. Plos One, 4(8), e6598. https:\/\/doi.org\/10.1371\/journal.pone.0006598","journal-title":"Plos One"},{"issue":"3","key":"953_CR64","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1037\/a0028813","volume":"121","author":"MT Treadway","year":"2012","unstructured":"Treadway, M. T., Bossaller, N. A., Shelton, R. C., & Zald, D. H. (2012). Effort-based decision-making in major depressive disorder: A translational model of motivational anhedonia. Journal of Abnormal Psychology, 121(3), 553\u2013558. https:\/\/doi.org\/10.1037\/a0028813","journal-title":"Journal of Abnormal Psychology"},{"issue":"5","key":"953_CR68","doi-asserted-by":"publisher","first-page":"1413","DOI":"10.1007\/s11222-016-9696-4","volume":"27","author":"A Vehtari","year":"2017","unstructured":"Vehtari, A., Gelman, A., & Gabry, J. (2017). Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Statistics and Computing, 27(5), 1413\u20131432. https:\/\/doi.org\/10.1007\/s11222-016-9696-4","journal-title":"Statistics and Computing"},{"key":"953_CR67","unstructured":"Vehtari, A., Gabry, J., Magnusson, M., Yao, Y., B\u00fcrkner, P., Paananen, T., & Gelman, A. (2024). Loo: Efficient leave-one-out cross-validation and WAIC for Bayesian models. In R package version 2.8.0."},{"issue":"4","key":"953_CR69","doi-asserted-by":"publisher","first-page":"2115","DOI":"10.1152\/physrev.00014.2018","volume":"99","author":"ND Volkow","year":"2019","unstructured":"Volkow, N. D., Michaelides, M., & Baler, R. (2019). The Neuroscience of Drug Reward and Addiction. Physiological Reviews, 99(4), 2115\u20132140. https:\/\/doi.org\/10.1152\/physrev.00014.2018","journal-title":"Physiological Reviews"},{"issue":"3","key":"953_CR70","doi-asserted-by":"publisher","first-page":"638","DOI":"10.1016\/j.neuron.2014.10.018","volume":"84","author":"XJ Wang","year":"2014","unstructured":"Wang, X. J., & Krystal, J. H. (2014). Computational Psychiatry Neuron, 84(3), 638\u2013654. https:\/\/doi.org\/10.1016\/j.neuron.2014.10.018.","journal-title":"Computational Psychiatry Neuron"},{"issue":"46","key":"953_CR71","doi-asserted-by":"publisher","first-page":"16597","DOI":"10.1523\/JNEUROSCI.4387-11.2011","volume":"31","author":"MC Wardle","year":"2011","unstructured":"Wardle, M. C., Treadway, M. T., Mayo, L. M., Zald, D. H., & de Wit, H. (2011). Amping Up Effort: Effects of d-Amphetamine on Human Effort-Based Decision-Making. The Journal of Neuroscience, 31(46), 16597\u201316602. https:\/\/doi.org\/10.1523\/JNEUROSCI.4387-11.2011","journal-title":"The Journal of Neuroscience"},{"issue":"3\u20134","key":"953_CR72","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/BF00992698","volume":"8","author":"CJCH Watkins","year":"1992","unstructured":"Watkins, C. J. C. H., & Dayan, P. (1992). Q-learning. Machine Learning, 8(3\u20134), 279\u2013292. https:\/\/doi.org\/10.1007\/BF00992698","journal-title":"Machine Learning"},{"issue":"5","key":"953_CR73","doi-asserted-by":"publisher","first-page":"1127","DOI":"10.1093\/schbul\/sbae024","volume":"50","author":"AE Whitton","year":"2024","unstructured":"Whitton, A. E., Cooper, J. A., Merchant, J. T., Treadway, M. T., & Lewandowski, K. E. (2024). Using Computational Phenotyping to Identify Divergent Strategies for Effort Allocation Across the Psychosis Spectrum. Schizophrenia Bulletin, 50(5), 1127\u20131136. https:\/\/doi.org\/10.1093\/schbul\/sbae024","journal-title":"Schizophrenia Bulletin"},{"issue":"1","key":"953_CR74","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1124\/pharmrev.121.000299","volume":"74","author":"L Wills","year":"2022","unstructured":"Wills, L., Ables, J. L., Braunscheidel, K. M., Caligiuri, S. P. B., Elayouby, K. S., Fillinger, C., Ishikawa, M., Moen, J. K., & Kenny, P. J. (2022). Neurobiological Mechanisms of Nicotine Reward and Aversion. Pharmacological Reviews, 74(1), 271\u2013310. https:\/\/doi.org\/10.1124\/pharmrev.121.000299","journal-title":"Pharmacological Reviews"},{"key":"953_CR75","doi-asserted-by":"publisher","first-page":"108256","DOI":"10.1016\/j.neuropharm.2020.108256","volume":"177","author":"RE Wittenberg","year":"2020","unstructured":"Wittenberg, R. E., Wolfman, S. L., De Biasi, M., & Dani, J. A. (2020). Nicotinic acetylcholine receptors and nicotine addiction: A brief introduction. Neuropharmacology, 177, 108256. https:\/\/doi.org\/10.1016\/j.neuropharm.2020.108256","journal-title":"Neuropharmacology"}],"container-title":["Journal of Computational Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10827-026-00953-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10827-026-00953-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10827-026-00953-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T02:12:19Z","timestamp":1793067139000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10827-026-00953-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,28]]},"references-count":75,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,12]]}},"alternative-id":["953"],"URL":"https:\/\/doi.org\/10.1007\/s10827-026-00953-6","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-8928184\/v1","asserted-by":"object"}]},"ISSN":["0929-5313","1573-6873"],"issn-type":[{"value":"0929-5313","type":"print"},{"value":"1573-6873","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,28]]},"assertion":[{"value":"20 February 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 July 2026","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 August 2026","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 August 2026","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}]}}