{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T16:31:00Z","timestamp":1772209860283,"version":"3.50.1"},"reference-count":44,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2021,1,7]],"date-time":"2021-01-07T00:00:00Z","timestamp":1609977600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100009033","name":"Center of Innovation Program","doi-asserted-by":"crossref","award":["JPMJCE1311"],"award-info":[{"award-number":["JPMJCE1311"]}],"id":[{"id":"10.13039\/501100009033","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Grant-in-Aid for Scientific Research","award":["18K03177"],"award-info":[{"award-number":["18K03177"]}]},{"name":"Grant-in-Aid for Scientific Research","award":["18K03173"],"award-info":[{"award-number":["18K03173"]}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>The value learning process has been investigated using decision-making tasks with a correct answer specified by the external environment (externally guided decision-making, EDM). In EDM, people are required to adjust their choices based on feedback, and the learning process is generally explained by the reinforcement learning (RL) model. In addition to EDM, value is learned through internally guided decision-making (IDM), in which no correct answer defined by external circumstances is available, such as preference judgment. In IDM, it has been believed that the value of the chosen item is increased and that of the rejected item is decreased (choice-induced preference change; CIPC). An RL-based model called the choice-based learning (CBL) model had been proposed to describe CIPC, in which the values of chosen and\/or rejected items are updated as if own choice were the correct answer. However, the validity of the CBL model has not been confirmed by fitting the model to IDM behavioral data. The present study aims to examine the CBL model in IDM. We conducted simulations, a preference judgment task for novel contour shapes, and applied computational model analyses to the behavioral data. The results showed that the CBL model with both the chosen and rejected value\u2019s updated were a good fit for the IDM behavioral data compared to the other candidate models. Although previous studies using subjective preference ratings had repeatedly reported changes only in one of the values of either the chosen or rejected items, we demonstrated for the first time both items\u2019 value changes were based solely on IDM choice behavioral data with computational model analyses.<\/jats:p>","DOI":"10.1371\/journal.pone.0244434","type":"journal-article","created":{"date-parts":[[2021,1,7]],"date-time":"2021-01-07T17:48:26Z","timestamp":1610041706000},"page":"e0244434","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":7,"title":["Computational modeling of choice-induced preference change: A Reinforcement-Learning-based approach"],"prefix":"10.1371","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9188-1381","authenticated-orcid":true,"given":"Jianhong","family":"Zhu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junya","family":"Hashimoto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kentaro","family":"Katahira","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Makoto","family":"Hirakawa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Takashi","family":"Nakao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2021,1,7]]},"reference":[{"key":"pone.0244434.ref001","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fnins.2012.00031","article-title":"Distinction between externally vs. Internally guided decision-making: Operational differences, meta-analytical comparisons and their theoretical implications","volume":"6","author":"T Nakao","year":"2012","journal-title":"Front Neurosci"},{"issue":"2","key":"pone.0244434.ref002","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.conb.2006.03.006","article-title":"The computational neurobiology of learning and reward","volume":"16","author":"ND Daw","year":"2006","journal-title":"Curr Opin Neurobiol"},{"key":"pone.0244434.ref003","volume-title":"Theoretical neuroscience: Computational and mathematical modeling of neural systems","author":"P Dayan","year":"2001"},{"issue":"2","key":"pone.0244434.ref004","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1016\/S0896-6273(02)00963-7","article-title":"Reward, motivation, and reinforcement learning","volume":"36","author":"P Dayan","year":"2002","journal-title":"Neuron"},{"issue":"18","key":"pone.0244434.ref005","doi-asserted-by":"crossref","first-page":"6741","DOI":"10.1073\/pnas.0711099105","article-title":"Neural correlates of mentalizing-related computations during strategic interactions in humans","volume":"105","author":"AN Hampton","year":"2008","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"2","key":"pone.0244434.ref006","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1523\/JNEUROSCI.5498-10.2012","article-title":"Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain","volume":"32","author":"Y Niv","year":"2012","journal-title":"J Neurosci"},{"key":"pone.0244434.ref007","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1196\/annals.1390.022","article-title":"Model-based fMRI and its application to reward learning and decision making","volume":"1104","author":"JP O\u2019Doherty","year":"2007","journal-title":"Ann N Y Acad Sci"},{"key":"pone.0244434.ref008","first-page":"384","article-title":"Postdecision changes in the desirability of alternatives","volume":"52","author":"JW Brehm","year":"1956","journal-title":"J Abnorm Psychol"},{"key":"pone.0244434.ref009","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1006\/ccog.1999.0395","article-title":"Adaptive versus veridical decision-making and the frontal lobes","volume":"8","author":"E Goldberg","year":"1999","journal-title":"Conscious. Cogn"},{"key":"pone.0244434.ref010","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1076\/1380-3395(200002)22:1;1-8;FT056","article-title":"Adaptive decision-making, ecological validity, and the frontal lobes","volume":"22","author":"E Goldberg","year":"2000","journal-title":"J. Clin. Exp. Neuropsychol"},{"key":"pone.0244434.ref011","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1097\/01.wco.0000236621.83872.71","article-title":"Decision-making and the frontal lobes","volume":"19","author":"KG Volz","year":"2006","journal-title":"Curr. Opin. Neurol"},{"issue":"4","key":"pone.0244434.ref012","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1037\/a0020217","article-title":"How choice affects and reflects preferences: revisiting the free-choice paradigm","volume":"99","author":"MK Chen","year":"2010","journal-title":"J Pers Soc Psychol"},{"key":"pone.0244434.ref013","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/j.jesp.2009.08.014","article-title":"Choice-induced preferences in the absence of choice: evidence from a blind two choice paradigm with young children and capuchin monkeys","volume":"46","author":"LC Egan","year":"2010","journal-title":"J. Exp. Soc. Psychol"},{"issue":"51","key":"pone.0244434.ref014","doi-asserted-by":"crossref","first-page":"22014","DOI":"10.1073\/pnas.1011879108","article-title":"Neural correlates of cognitive dissonance and choice-induced preference change","volume":"107","author":"K Izuma","year":"2010","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pone.0244434.ref015","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0956797610379235","article-title":"Do decisions shape preference? Evidence from blind choice","volume":"21","author":"T Sharot","year":"2010b","journal-title":"Psychol Sci"},{"issue":"10","key":"pone.0244434.ref016","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1177\/0956797612438733","article-title":"Is choice-induced preference change long lasting?","volume":"23","author":"T Sharot","year":"2012","journal-title":"Psychol Sci"},{"key":"pone.0244434.ref017","doi-asserted-by":"crossref","first-page":"5074","DOI":"10.1523\/JNEUROSCI.3209-16.2017","article-title":"Neural mechanisms of cognitive dissonance (revised): an EEG study","volume":"37","author":"M Colosio","year":"2017","journal-title":"J. Neurosci"},{"issue":"6","key":"pone.0244434.ref018","doi-asserted-by":"crossref","first-page":"e0180041","DOI":"10.1371\/journal.pone.0180041","article-title":"Relation between choice-induced preference change and depression","volume":"12","author":"M Miyagi","year":"2017","journal-title":"PLoS ONE"},{"key":"pone.0244434.ref019","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fpsyg.2013.00041","article-title":"Choice-induced preference change in the free-choice paradigm: A critical methodological review","volume":"4","author":"K Izuma","year":"2013","journal-title":"Front Psychol"},{"issue":"8","key":"pone.0244434.ref020","doi-asserted-by":"crossref","first-page":"e7207","DOI":"10.1371\/journal.pone.0072071","article-title":"I choose, therefore I like: preference for faces induced by arbitrary choice","volume":"8","author":"K Nakamura","year":"2013","journal-title":"PLoS ONE"},{"key":"pone.0244434.ref021","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.neuroimage.2012.10.034","article-title":"Resting-state EEG power predicts conflict-related brain activity in internally guided but not in externally guided decision-making","volume":"66","author":"T Nakao","year":"2013","journal-title":"NeuroImage"},{"key":"pone.0244434.ref022","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/srep32477","article-title":"Post-response \u03b2\u03b3 power predicts the degree of choice-based learning in internally guided decision-making","volume":"6","author":"T Nakao","year":"2016","journal-title":"Sci Rep"},{"key":"pone.0244434.ref023","doi-asserted-by":"crossref","first-page":"116015","DOI":"10.1016\/j.neuroimage.2019.116015","article-title":"From neuronal to psychological noise: long-range temporal correlations in EEG intrinsic activity reduce noise in internally-guided decision making","volume":"201","author":"T Nakao","year":"2019","journal-title":"NeuroImage"},{"key":"pone.0244434.ref024","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-019-40743-y","article-title":"Interindividual neural differences in moral decision-making are mediated by alpha power and delta\/theta phase coherence","volume":"9","author":"A Wolff","year":"2019","journal-title":"Sci Rep"},{"issue":"1","key":"pone.0244434.ref025","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.neuron.2013.10.018","article-title":"Autonomous mechanism of internal choice estimate underlies decision inertia","volume":"81","author":"R Akaishi","year":"2014","journal-title":"Neuron"},{"key":"pone.0244434.ref026","first-page":"661116","article-title":"Choosing what we like vs liking what we choose: How choice-induced preference change might actually be instrumental to decision-making","author":"D Lee","year":"2019","journal-title":"bioRxiv"},{"key":"pone.0244434.ref027","first-page":"1","article-title":"Pseudo-learning effects in reinforcement learning model-based analysis: A problem of misspecification of initial preference","author":"K Katahira","year":"2017","journal-title":"PsyArXiv"},{"issue":"1","key":"pone.0244434.ref028","doi-asserted-by":"crossref","first-page":"1024","DOI":"10.1016\/j.neuroimage.2009.07.060","article-title":"Brain and autonomic association accompanying stochastic decision-making","volume":"49","author":"H Ohira","year":"2010","journal-title":"Neuroimage"},{"issue":"3","key":"pone.0244434.ref029","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1016\/j.neuroimage.2009.04.088","article-title":"Regulation of natural killer cell redistribution by prefrontal cortex during stochastic learning","volume":"47","author":"H Ohira","year":"2009","journal-title":"Neuroimage"},{"issue":"4","key":"pone.0244434.ref030","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.1016\/j.jbtep.2012.05.007","article-title":"Effects of depression on reward-based decision making and variability of action in probabilistic learning","volume":"43","author":"Y Kunisato","year":"2012","journal-title":"J Behav Ther Exp Psychiatry"},{"key":"pone.0244434.ref031","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fpsyg.2011.00311","article-title":"Decision-making based on emotional images","volume":"2","author":"K Katahira","year":"2011","journal-title":"Front Psychol"},{"issue":"12","key":"pone.0244434.ref032","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1111\/j.1467-9280.2005.01646.x","article-title":"Using cognitive models to map relations between neuropsychological disorders and human decision-making deficits","volume":"16","author":"E Yechiam","year":"2005","journal-title":"Psychol Sci"},{"key":"pone.0244434.ref033","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.jmp.2015.03.006","article-title":"The relation between reinforcement learning parameters and the influence of reinforcement history on choice behavior","volume":"66","author":"K Katahira","year":"2015","journal-title":"J Math Psychol"},{"key":"pone.0244434.ref034","doi-asserted-by":"crossref","first-page":"346","DOI":"10.4992\/jjpsy.74.346","article-title":"Perceptual judgments of novel contour shapes and hierarchical descriptions of geometrical properties","volume":"74","author":"N Endo","year":"2003","journal-title":"Jpn J Psychol"},{"key":"pone.0244434.ref035","article-title":"PsychoPy2: Experiments in behavior made easy","author":"JW Peirce","year":"2019","journal-title":"Behav Res Methods"},{"key":"pone.0244434.ref036","first-page":"64","volume-title":"Wagner in classical conditioning II: Current research and theory","author":"RA Rescorla","year":"1972"},{"issue":"31","key":"pone.0244434.ref037","doi-asserted-by":"crossref","first-page":"9861","DOI":"10.1523\/JNEUROSCI.6157-08.2009","article-title":"Validation of decision-making models and analysis of decision variables in the rat basal ganglia","volume":"29","author":"M Ito","year":"2009","journal-title":"J Neurosci"},{"key":"pone.0244434.ref038","doi-asserted-by":"crossref","first-page":"e49547","DOI":"10.7554\/eLife.49547","article-title":"Ten simple rules for the computational modeling of behavioral data","volume":"8","author":"RC Wilson","year":"2019","journal-title":"eLife"},{"issue":"1","key":"pone.0244434.ref039","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10556789808805699","article-title":"Solving large-scale linear programs by interior-point methods under the MATLAB environment","volume":"10","author":"Z Yin","year":"1998","journal-title":"Optim. Methods Softw"},{"key":"pone.0244434.ref040","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1016\/j.neuroimage.2015.01.039","article-title":"Decision-making conflict and the neural efficiency hypothesis of intelligence: A functional near-infrared spectroscopy investigation","volume":"109","author":"SI Di Domenico","year":"2015","journal-title":"NeuroImage"},{"issue":"5","key":"pone.0244434.ref041","doi-asserted-by":"crossref","first-page":"848","DOI":"10.3758\/s13415-016-0436-1","article-title":"Basic psychological needs and neurophysiological responsiveness to decisional conflict: an event-related potential study of integrative self processes","volume":"16","author":"SI Di Domenico","year":"2016","journal-title":"Cogn Affect Behav Neurosci"},{"issue":"4","key":"pone.0244434.ref042","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1177\/0146167210363403","article-title":"Self-knowledge reduces conflict by biasing one of plural possible answers","volume":"36","author":"T Nakao","year":"2010","journal-title":"Pers Soc Psychol Bull"},{"key":"pone.0244434.ref043","doi-asserted-by":"crossref","DOI":"10.1515\/9781503620766","volume-title":"A theory of cognitive dissonance","author":"L Festinger","year":"1957"},{"issue":"1","key":"pone.0244434.ref044","doi-asserted-by":"crossref","first-page":"e1006499","DOI":"10.1371\/journal.pcbi.1006499","article-title":"Sour grapes and sweet victories: How actions shape preferences","volume":"15","author":"F Vinckier","year":"2019","journal-title":"PLoS Comput Biol"}],"updated-by":[{"DOI":"10.1371\/journal.pone.0248442","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T00:00:00Z","timestamp":1614902400000}}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0244434","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,10]],"date-time":"2022-12-10T18:25:41Z","timestamp":1670696741000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0244434"}},"subtitle":[],"editor":[{"given":"Baogui","family":"Xin","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,1,7]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1,7]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0244434","relation":{"has-preprint":[{"id-type":"doi","id":"10.31234\/osf.io\/zqrvw","asserted-by":"object"}]},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,7]]}}}