{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T20:32:19Z","timestamp":1791664339973,"version":"4.3.4"},"reference-count":55,"publisher":"Royal College of Psychiatrists","issue":"3","license":[{"start":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T00:00:00Z","timestamp":1670889600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Br J Psychiatry"],"published-print":{"date-parts":[[2023,3]]},"abstract":"<jats:sec id=\"S0007125022001751_sec_a1\"><jats:title>Background<\/jats:title><jats:p>Recent developments in computational psychiatry have led to the hypothesis that mood represents an expectation (prior belief) on the likely interoceptive consequences of action (i.e. emotion). This stems from ideas about how the brain navigates its external world by minimising an upper bound on surprisal (free energy) of sensory information and echoes developments in other perceptual domains.<\/jats:p><\/jats:sec><jats:sec id=\"S0007125022001751_sec_a2\"><jats:title>Aims<\/jats:title><jats:p>In this paper we aim to present a simple partial observable Markov decision process that models mood updating in response to stressful or non-stressful environmental fluctuations while seeking to minimise surprisal in relation to prior beliefs about the likely interoceptive signals experienced with specific actions (attenuating or amplifying stress and pleasure signals).<\/jats:p><\/jats:sec><jats:sec id=\"S0007125022001751_sec_a3\" sec-type=\"methods\"><jats:title>Method<\/jats:title><jats:p>We examine how, by altering these prior beliefs we can model mood updating in depression, mania and anxiety.<\/jats:p><\/jats:sec><jats:sec id=\"S0007125022001751_sec_a4\" sec-type=\"results\"><jats:title>Results<\/jats:title><jats:p>We discuss how these models provide a computational account of mood and its related psychopathology and relate it to previous research in reward processing.<\/jats:p><\/jats:sec><jats:sec id=\"S0007125022001751_sec_a5\" sec-type=\"conclusions\"><jats:title>Conclusions<\/jats:title><jats:p>Models such as this can provide hypotheses for experimental work and also open up the potential modelling of predicted disease trajectories in individual patients.<\/jats:p><\/jats:sec>","DOI":"10.1192\/bjp.2022.175","type":"journal-article","created":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T08:37:44Z","timestamp":1670920664000},"page":"125-134","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":7,"title":["Modelling mood updating: a proof of principle study"],"prefix":"10.1192","volume":"222","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5763-6200","authenticated-orcid":false,"given":"James E.","family":"Clark","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2558-3367","authenticated-orcid":false,"given":"Stuart","family":"Watson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"170","published-online":{"date-parts":[[2022,12,13]]},"reference":[{"key":"S0007125022001751_ref54","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1016\/j.psyneuen.2011.07.003","article-title":"Adulthood trauma and HPA-axis functioning in healthy subjects and PTSD patients: a meta-analysis","volume":"37","author":"Klaassens","year":"2012","journal-title":"Psychoneuroendocrinology"},{"key":"S0007125022001751_ref13","doi-asserted-by":"crossref","first-page":"130","DOI":"10.3389\/fpsyg.2012.00130","article-title":"Free-energy minimization and the dark-room problem","volume":"3","author":"Friston","year":"2012","journal-title":"Front Psychol"},{"key":"S0007125022001751_ref30","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1007\/s00422-018-0753-2","article-title":"Planning and navigation as active inference","volume":"112","author":"Kaplan","year":"2018","journal-title":"Biol Cybern"},{"key":"S0007125022001751_ref18","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1017\/S0140525X12002142","article-title":"Active inference and free energy","volume":"36","author":"Friston","year":"2013","journal-title":"Behav Brain Sci"},{"key":"S0007125022001751_ref53","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1016\/j.tins.2008.06.006","article-title":"The HPA axis in major depression: classical theories and new developments","volume":"31","author":"Pariante","year":"2008","journal-title":"Trends Neurosci"},{"key":"S0007125022001751_ref38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v048.i04","article-title":"qgraph: network visualizations of relationships in psychometric data","volume":"48","author":"Epskamp","year":"2012","journal-title":"J Stat Softw"},{"key":"S0007125022001751_ref31","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1080\/17588928.2015.1020053","article-title":"Active inference and epistemic value","volume":"6","author":"Friston","year":"2015","journal-title":"Cogn Neurosci"},{"key":"S0007125022001751_ref32","first-page":"393","volume-title":"Advances in Neural Information Processing Systems","author":"Bradtke","year":"1995"},{"key":"S0007125022001751_ref39","doi-asserted-by":"crossref","first-page":"8227","DOI":"10.1523\/JNEUROSCI.4255-12.2013","article-title":"Free energy, precision and learning: the role of cholinergic neuromodulation","volume":"33","author":"Moran","year":"2013","journal-title":"J Neurosci"},{"key":"S0007125022001751_ref12","doi-asserted-by":"crossref","first-page":"1561","DOI":"10.1016\/0042-6989(90)90144-A","article-title":"Conditions for versatile learning, Helmholtz's unconscious inference, and the task of perception","volume":"30","author":"Barlow","year":"1990","journal-title":"Vision Research"},{"key":"S0007125022001751_ref14","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.jmp.2017.09.004","article-title":"The free energy principle for action and perception: a mathematical review","volume":"81","author":"Buckley","year":"2017","journal-title":"J Math Psychol"},{"key":"S0007125022001751_ref1","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/S2215-0366(14)70275-5","article-title":"Computational psychiatry: the brain as a phantastic organ","volume":"1","author":"Friston","year":"2014","journal-title":"Lancet Psychiatry"},{"key":"S0007125022001751_ref3","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.tics.2011.11.018","article-title":"Computational psychiatry","volume":"16","author":"Montague","year":"2012","journal-title":"Trends Cogn Sci"},{"key":"S0007125022001751_ref17","doi-asserted-by":"crossref","first-page":"2100","DOI":"10.3390\/e14112100","article-title":"A free energy principle for biological systems","volume":"14","author":"Karl","year":"2012","journal-title":"Entropy"},{"key":"S0007125022001751_ref15","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1038\/nrn2787","article-title":"The free-energy principle: a unified brain theory?","volume":"11","author":"Friston","year":"2010","journal-title":"Nat Rev Neurosci"},{"key":"S0007125022001751_ref21","doi-asserted-by":"crossref","first-page":"2178","DOI":"10.1093\/brain\/awz211","article-title":"Bayesian inference and hallucinations in schizophrenia","volume":"142","author":"Siemerkus","year":"2019","journal-title":"Brain"},{"key":"S0007125022001751_ref11","doi-asserted-by":"crossref","first-page":"20170792","DOI":"10.1098\/rsif.2017.0792","article-title":"The Markov blankets of life: autonomy, active inference and the free energy principle","volume":"15","author":"Kirchhoff","year":"2018","journal-title":"J R Soc Interface"},{"key":"S0007125022001751_ref36","article-title":"POMDP: introduction to partially observable Markov decision processes","author":"Kamalzadeh","year":"2019","journal-title":"Tekn Rapport"},{"key":"S0007125022001751_ref40","doi-asserted-by":"crossref","first-page":"6751","DOI":"10.1523\/JNEUROSCI.0291-17.2017","article-title":"The cumulative effects of predictability on synaptic gain in the auditory processing stream","volume":"37","author":"Auksztulewicz","year":"2017","journal-title":"J Neurosci"},{"key":"S0007125022001751_ref43","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.1093\/scan\/nsu158","article-title":"Altered neural reward and loss processing and prediction error signalling in depression","volume":"10","author":"Ubl","year":"2015","journal-title":"Soc Cogn Affect Neurosci"},{"key":"S0007125022001751_ref37","unstructured":"37 Team RC. R: A language and environment for statistical computing. R, 2013."},{"key":"S0007125022001751_ref44","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1038\/s41386-018-0032-x","article-title":"Impaired reward prediction error encoding and striatal-midbrain connectivity in depression","volume":"43","author":"Kumar","year":"2018","journal-title":"Neuropsychopharmacol"},{"key":"S0007125022001751_ref48","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1016\/j.biopsych.2017.07.007","article-title":"Computational dysfunctions in anxiety: failure to differentiate signal from noise","volume":"82","author":"Huang","year":"2017","journal-title":"Biol Psychiatry"},{"key":"S0007125022001751_ref29","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1016\/j.tics.2012.08.006","article-title":"Planning as inference","volume":"16","author":"Botvinick","year":"2012","journal-title":"Trends Cogn Sci"},{"key":"S0007125022001751_ref42","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.neubiorev.2018.04.017","article-title":"Interoceptive inference: from computational neuroscience to clinic","volume":"90","author":"Owens","year":"2018","journal-title":"Neurosci Biobehav Rev"},{"key":"S0007125022001751_ref24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/scan\/nsx060","article-title":"The theory of constructed emotion: an active inference account of interoception and categorization","volume":"12","author":"Barrett","year":"2017","journal-title":"Soc Cogn Affect Neurosci"},{"key":"S0007125022001751_ref47","doi-asserted-by":"crossref","first-page":"670","DOI":"10.3389\/fpsyg.2017.00670","article-title":"Clinical depression and punishment sensitivity on the BART","volume":"8","author":"Hevey","year":"2017","journal-title":"Front Psychol"},{"key":"S0007125022001751_ref7","doi-asserted-by":"crossref","first-page":"2277","DOI":"10.1017\/S0033291718000430","article-title":"What is mood? A computational perspective","volume":"48","author":"Clark","year":"2018","journal-title":"Psychol Med"},{"key":"S0007125022001751_ref51","doi-asserted-by":"crossref","first-page":"616","DOI":"10.3389\/fpsyt.2019.00616","article-title":"Altered interoceptive processing in generalized anxiety disorder \u2013 a heartbeat-evoked potential research","volume":"10","author":"Pang","year":"2019","journal-title":"Front Psychiatry"},{"key":"S0007125022001751_ref52","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1192\/bjp.bp.108.051193","article-title":"Why do antidepressants take so long to work? A cognitive neuropsychological model of antidepressant drug action","volume":"195","author":"Harmer","year":"2009","journal-title":"Br J Psychiatry"},{"key":"S0007125022001751_ref46","doi-asserted-by":"crossref","first-page":"810","DOI":"10.1037\/abn0000641","article-title":"Reward and punishment reversal learning in major depressive disorder","volume":"129","author":"Mukherjee","year":"2020","journal-title":"Journal of Abnormal Psychology"},{"key":"S0007125022001751_ref28","first-page":"9","volume-title":"International Workshop on Artificial Intelligence and Statistics","author":"Attias","year":"2003"},{"key":"S0007125022001751_ref55","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1016\/j.psyneuen.2015.10.014","article-title":"The HPA axis in bipolar disorder: systematic review and meta-analysis","volume":"63","author":"Murri","year":"2016","journal-title":"Psychoneuroendocrinology"},{"key":"S0007125022001751_ref27","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1098\/rstb.1996.0125","article-title":"The somatic marker hypothesis and the possible functions of the prefrontal cortex","volume":"351","author":"Damasio","year":"1996","journal-title":"Philos Trans R Soc London B Biol Sci"},{"key":"S0007125022001751_ref20","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.tics.2018.12.001","article-title":"Hallucinations and strong priors","volume":"23","author":"Corlett","year":"2019","journal-title":"Trends Cogn Sci"},{"key":"S0007125022001751_ref2","doi-asserted-by":"crossref","first-page":"e1460","DOI":"10.1002\/wcs.1460","article-title":"Generative models for clinical applications in computational psychiatry","volume":"9","author":"Fr\u00e4ssle","year":"2018","journal-title":"Wiley Interdiscip Rev Cogn Sci"},{"key":"S0007125022001751_ref19","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1162\/CPSY_a_00022","article-title":"Active inference and auditory hallucinations","volume":"2","author":"Benrimoh","year":"2018","journal-title":"Comput Psychiatry"},{"key":"S0007125022001751_ref22","first-page":"80","article-title":"Delusion proneness is linked to a reduced usage of prior beliefs in perceptual decisions","volume":"45","author":"Stuke","year":"2019","journal-title":"Schizophr Bull"},{"key":"S0007125022001751_ref9","volume-title":"What Is Life","author":"Schrodinger","year":"1944"},{"key":"S0007125022001751_ref25","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1016\/j.tics.2013.09.007","article-title":"Interoceptive inference, emotion, and the embodied self","volume":"17","author":"Seth","year":"2013","journal-title":"Trends Cogn Sci"},{"key":"S0007125022001751_ref8","volume-title":"Meditations, Objections, and Replies","author":"Descartes","year":"2006"},{"key":"S0007125022001751_ref5","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1016\/j.biopsych.2018.05.015","article-title":"The predictive coding account of psychosis","volume":"84","author":"Sterzer","year":"2018","journal-title":"Biol Psychiatry"},{"key":"S0007125022001751_ref26","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.copsyc.2017.04.020","article-title":"Interoception and emotion","volume":"17","author":"Critchley","year":"2017","journal-title":"Curr Opin Psychol"},{"key":"S0007125022001751_ref23","doi-asserted-by":"crossref","first-page":"20160007","DOI":"10.1098\/rstb.2016.0007","article-title":"Active interoceptive inference and the emotional brain","volume":"371","author":"Seth","year":"2016","journal-title":"Philos Trans R Soc B Biol Sci"},{"key":"S0007125022001751_ref33","unstructured":"33 Zhou, R , Hansen, EA . An improved grid-based approximation algorithm for POMDPs. In: IJCAI: 707-16. 2001."},{"key":"S0007125022001751_ref16","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.tics.2009.04.005","article-title":"The free-energy principle: a rough guide to the brain?","volume":"13","author":"Friston","year":"2009","journal-title":"Trends Cogn Sci"},{"key":"S0007125022001751_ref34","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1007\/978-3-642-27645-3_12","volume-title":"Reinforcement Learning","author":"Spaan","year":"2012"},{"key":"S0007125022001751_ref41","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.neuroimage.2012.06.044","article-title":"Dynamic causal modelling of precision and synaptic gain in visual perception\u2014an EEG study","volume":"63","author":"Brown","year":"2012","journal-title":"Neuroimage"},{"key":"S0007125022001751_ref49","doi-asserted-by":"crossref","first-page":"1116","DOI":"10.1038\/s41562-019-0628-0","article-title":"Altered learning under uncertainty in unmedicated mood and anxiety disorders","volume":"3","author":"Aylward","year":"2019","journal-title":"Nat Hum Behav"},{"key":"S0007125022001751_ref50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cpr.2009.08.008","article-title":"Interoceptive sensitivity in anxiety and anxiety disorders: an overview and integration of neurobiological findings","volume":"30","author":"Domschke","year":"2010","journal-title":"Clin Psychol Rev"},{"key":"S0007125022001751_ref10","doi-asserted-by":"crossref","first-page":"20130475","DOI":"10.1098\/rsif.2013.0475","article-title":"Life as we know it","volume":"10","author":"Friston","year":"2013","journal-title":"J R Soc Interface"},{"key":"S0007125022001751_ref6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41398-019-0390-0","article-title":"Neurodevelopmental heterogeneity and computational approaches for understanding autism","volume":"9","author":"Jacob","year":"2019","journal-title":"Transl Psychiatry"},{"key":"S0007125022001751_ref35","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1287\/opre.39.1.162","article-title":"Computationally feasible bounds for partially observed Markov decision processes","volume":"39","author":"Lovejoy","year":"1991","journal-title":"Oper Res"},{"key":"S0007125022001751_ref45","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.biopsych.2010.01.027","article-title":"Reward and punishment processing in depression","volume":"68","author":"Eshel","year":"2010","journal-title":"Biol Psychiatry"},{"key":"S0007125022001751_ref4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.32872\/cpe.v1i3.39237","article-title":"Embracing computational approaches can stimulate clinical psychology research","volume":"1","author":"Van den Bergh","year":"2019","journal-title":"Clin Psychol Eur"}],"container-title":["The British Journal of Psychiatry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0007125022001751","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,14]],"date-time":"2023-02-14T13:37:51Z","timestamp":1676381871000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0007125022001751\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,13]]},"references-count":55,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,3]]}},"alternative-id":["S0007125022001751"],"URL":"https:\/\/doi.org\/10.1192\/bjp.2022.175","relation":{},"ISSN":["0007-1250","1472-1465"],"issn-type":[{"value":"0007-1250","type":"print"},{"value":"1472-1465","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,13]]},"assertion":[{"value":"Copyright \u00a9 The Author(s), 2022. Published by Cambridge University Press on behalf of the Royal College of Psychiatrists","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http:\/\/creativecommons.org\/licenses\/by\/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.","name":"license","label":"License","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}]}}