{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T15:24:05Z","timestamp":1772119445918,"version":"3.50.1"},"reference-count":81,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,2]],"date-time":"2024-03-02T00:00:00Z","timestamp":1709337600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,2]],"date-time":"2024-03-02T00:00:00Z","timestamp":1709337600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003141","name":"Consejo Nacional de Ciencia y Tecnolog\u00eda","doi-asserted-by":"publisher","award":["239027\/438354"],"award-info":[{"award-number":["239027\/438354"]}],"id":[{"id":"10.13039\/501100003141","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["UID\/PSI\/01662\/2013 and UIDB\/04810\/2020"],"award-info":[{"award-number":["UID\/PSI\/01662\/2013 and UIDB\/04810\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["UID\/PSI\/01662\/2013 and UIDB\/04810\/2020"],"award-info":[{"award-number":["UID\/PSI\/01662\/2013 and UIDB\/04810\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Instituto Nacional de Ci\u00eancia e Tecnologia sobre Comportamento, Cogni\u00e7\u00e3o e Ensino","award":["INCT-ECCE \/ CNPq Grant #465686\/2014-1),"],"award-info":[{"award-number":["INCT-ECCE \/ CNPq Grant #465686\/2014-1),"]}]},{"name":"Fulbright Grant for Scholars and Researchers","award":["AY2022\/2023"],"award-info":[{"award-number":["AY2022\/2023"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Anim Cogn"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    In a variety of laboratory preparations, several animal species prefer signaled over unsignaled outcomes. Here we examine whether pigeons prefer options that signal the delay to reward over options that do not and how this preference changes with the ratio of the delays. We offered pigeons repeated choices between two alternatives leading to a short or a long delay to reward. For one alternative (\n                    <jats:italic>informative<\/jats:italic>\n                    ), the short and long delays were reliably signaled by different stimuli (e.g.,\n                    <jats:italic>S<\/jats:italic>\n                    <jats:sup>S<\/jats:sup>\n                    for short delays,\n                    <jats:italic>S<\/jats:italic>\n                    <jats:sup>L<\/jats:sup>\n                    for long delays). For the other (\n                    <jats:italic>non-informative<\/jats:italic>\n                    ), the delays were not reliably signaled by the stimuli presented (\n                    <jats:italic>S<\/jats:italic>\n                    <jats:sup>1<\/jats:sup>\n                    and\n                    <jats:italic>S<\/jats:italic>\n                    <jats:sup>2<\/jats:sup>\n                    ). Across conditions, we varied the durations of the short and long delays, hence their ratio, while keeping the average delay to reward constant. Pigeons preferred the informative over the non-informative option and this preference became stronger as the ratio of the long to the short delay increased. A modified version of the\n                    <jats:italic>\u0394<\/jats:italic>\n                    \u2013\n                    <jats:italic>\u03a3<\/jats:italic>\n                    hypothesis (Gonz\u00e1lez et al., J Exp Anal Behav 113(3):591\u2013608.\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/doi.org\/10.1002\/jeab.595\" ext-link-type=\"uri\">https:\/\/doi.org\/10.1002\/jeab.595<\/jats:ext-link>\n                    , 2020a) incorporating a contrast-like process between the immediacies to reward signaled by each stimulus accounted well for our findings. Functionally, we argue that a preference for signaled delays hinges on the potential instrumental advantage typically conveyed by information.\n                  <\/jats:p>","DOI":"10.1007\/s10071-024-01856-8","type":"journal-article","created":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T22:01:35Z","timestamp":1709330495000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["On the value of advanced information about delayed rewards"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2958-9766","authenticated-orcid":false,"given":"Alejandro","family":"Mac\u00edas","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4380-3711","authenticated-orcid":false,"given":"Armando","family":"Machado","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1215-0749","authenticated-orcid":false,"given":"Marco","family":"Vasconcelos","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,3,2]]},"reference":[{"issue":"2","key":"1856_CR1","doi-asserted-by":"publisher","first-page":"623","DOI":"10.1007\/S10071-022-01698-2","volume":"26","author":"V Ajuwon","year":"2023","unstructured":"Ajuwon V, Ojeda A, Murphy RA, Monteiro T, Kacelnik A (2023) Paradoxical choice and the reinforcing value of information. Anim Cogn 26(2):623\u2013637. https:\/\/doi.org\/10.1007\/S10071-022-01698-2","journal-title":"Anim Cogn"},{"issue":"1","key":"1856_CR2","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1901\/jeab.1986.45-33","volume":"45","author":"B Alsop","year":"1986","unstructured":"Alsop B, Davison M (1986) Preference for multiple versus mixed schedules of reinforcement. J Exp Anal Behav 45(1):33\u201345. https:\/\/doi.org\/10.1901\/jeab.1986.45-33","journal-title":"J Exp Anal Behav"},{"issue":"2","key":"1856_CR3","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.beproc.2011.09.007","volume":"89","author":"J Aw","year":"2012","unstructured":"Aw J, Monteiro T, Vasconcelos M, Kacelnik A (2012) Cognitive mechanisms of risky choice: is there an evaluation cost? Behav Proc 89(2):95\u2013103. https:\/\/doi.org\/10.1016\/j.beproc.2011.09.007","journal-title":"Behav Proc"},{"issue":"7","key":"1856_CR4","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1005020","volume":"12","author":"D Bennett","year":"2016","unstructured":"Bennett D, Bode S, Brydevall M, Warren H, Murawski C (2016) Intrinsic valuation of information in decision making under uncertainty. PLoS Comput Biol 12(7):e1005020. https:\/\/doi.org\/10.1371\/journal.pcbi.1005020","journal-title":"PLoS Comput Biol"},{"issue":"3","key":"1856_CR5","doi-asserted-by":"publisher","first-page":"602","DOI":"10.1016\/j.neuron.2014.12.050","volume":"85","author":"TC Blanchard","year":"2015","unstructured":"Blanchard TC, Hayden BY, Bromberg-Martin ES (2015) Orbitofrontal cortex uses distinct codes for different choice attributes in decisions motivated by curiosity. Neuron 85(3):602\u2013614. https:\/\/doi.org\/10.1016\/j.neuron.2014.12.050","journal-title":"Neuron"},{"issue":"1","key":"1856_CR6","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1016\/S0031-9384(97)00382-X","volume":"63","author":"JE Blustein","year":"1997","unstructured":"Blustein JE, Ciccolone L, Bersh PJ (1997) Evidence that adaptation to cold water swim-induced analgesia is a learned response. Physiol Behav 63(1):147\u2013150. https:\/\/doi.org\/10.1016\/S0031-9384(97)00382-X","journal-title":"Physiol Behav"},{"issue":"2","key":"1856_CR7","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1037\/h0023682","volume":"62","author":"G Bower","year":"1966","unstructured":"Bower G, McLean J, Meacham J (1966) Value of knowing when reinforcement is due. J Comp Physiol Psychol 62(2):184\u2013192. https:\/\/doi.org\/10.1037\/h0023682","journal-title":"J Comp Physiol Psychol"},{"issue":"1","key":"1856_CR8","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/j.neuron.2009.06.009","volume":"63","author":"ES Bromberg-Martin","year":"2009","unstructured":"Bromberg-Martin ES, Hikosaka O (2009) Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 63(1):119\u2013126. https:\/\/doi.org\/10.1016\/j.neuron.2009.06.009","journal-title":"Neuron"},{"issue":"9","key":"1856_CR9","doi-asserted-by":"publisher","first-page":"1209","DOI":"10.1038\/nn.2902","volume":"14","author":"ES Bromberg-Martin","year":"2011","unstructured":"Bromberg-Martin ES, Hikosaka O (2011) Lateral habenula neurons signal errors in the prediction of reward information. Nat Neurosci 14(9):1209\u20131216. https:\/\/doi.org\/10.1038\/nn.2902","journal-title":"Nat Neurosci"},{"issue":"2","key":"1856_CR10","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/0023-9690(74)90023-X","volume":"5","author":"MP Browne","year":"1974","unstructured":"Browne MP, Dinsmoor JA (1974) Wyckoff\u2019s observing response: pigeons learn to observe stimuli for free food but not stimuli for extinction. Learn Motivat 5(2):165\u2013173. https:\/\/doi.org\/10.1016\/0023-9690(74)90023-X","journal-title":"Learn Motivat"},{"issue":"4","key":"1856_CR11","doi-asserted-by":"publisher","first-page":"1059","DOI":"10.3758\/BRM.42.4.1059","volume":"42","author":"RN Cardinal","year":"2010","unstructured":"Cardinal RN, Aitken MRF (2010) Whisker: a client-server high-performance multimedia research control system. Behav Res Methods 42(4):1059\u20131071. https:\/\/doi.org\/10.3758\/BRM.42.4.1059","journal-title":"Behav Res Methods"},{"issue":"2","key":"1856_CR12","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1016\/0040-5809(76)90040-x","volume":"9","author":"EL Charnov","year":"1976","unstructured":"Charnov EL (1976) Optimal foraging: the marginal value theorem. Theor Popul Biol 9(2):129\u2013136. https:\/\/doi.org\/10.1016\/0040-5809(76)90040-x","journal-title":"Theor Popul Biol"},{"key":"1856_CR13","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1016\/j.bbr.2016.12.013","volume":"320","author":"JJ Chow","year":"2017","unstructured":"Chow JJ, Smith AP, Wilson AG, Zentall TR, Beckmann JS (2017) Suboptimal choice in rats: incentive salience attribution promotes maladaptive decision-making. Behav Brain Res 320:244\u2013254. https:\/\/doi.org\/10.1016\/j.bbr.2016.12.013","journal-title":"Behav Brain Res"},{"issue":"1","key":"1856_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1037\/xan0000160","volume":"44","author":"PJ Cunningham","year":"2018","unstructured":"Cunningham PJ, Shahan TA (2018) Suboptimal choice, reward-predictive signals, and temporal information. J Exp Psychol: Anim Learn Cogn 44(1):1\u201322. https:\/\/doi.org\/10.1037\/xan0000160","journal-title":"J Exp Psychol: Anim Learn Cogn"},{"issue":"3","key":"1856_CR15","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1037\/xan0000211","volume":"45","author":"PJ Cunningham","year":"2019","unstructured":"Cunningham PJ, Shahan TA (2019) Rats engage in suboptimal choice when the delay to food is sufficiently long. J Exp Psychol: Anim Learn Cogn 45(3):301\u2013310. https:\/\/doi.org\/10.1037\/xan0000211","journal-title":"J Exp Psychol: Anim Learn Cogn"},{"key":"1856_CR16","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1037\/xan0000245","volume":"46","author":"PJ Cunningham","year":"2020","unstructured":"Cunningham PJ, Shahan TA (2020) Delays to food-predictive stimuli do not affect suboptimal choice in rats. J Exp Psychol: Anim Learn Cogn 46:385\u2013397. https:\/\/doi.org\/10.1037\/xan0000245","journal-title":"J Exp Psychol: Anim Learn Cogn"},{"issue":"3","key":"1856_CR17","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1037\/xan0000179","volume":"44","author":"CW Daniels","year":"2018","unstructured":"Daniels CW, Sanabria F (2018) An associability decay model of paradoxical choice. J Exp Psychol: Anim Learn Cogn 44(3):258\u2013271. https:\/\/doi.org\/10.1037\/xan0000179","journal-title":"J Exp Psychol: Anim Learn Cogn"},{"key":"1856_CR18","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1901\/jeab.1972.17-169","volume":"17","author":"MC Davison","year":"1972","unstructured":"Davison MC (1972) Preference for mixed-interval versus fixed-interval schedules: number of component intervals. J Exp Anal Behav 17:169\u2013176. https:\/\/doi.org\/10.1901\/jeab.1972.17-169","journal-title":"J Exp Anal Behav"},{"issue":"4","key":"1856_CR19","doi-asserted-by":"publisher","first-page":"693","DOI":"10.1017\/S0140525X00017969","volume":"6","author":"JA Dinsmoor","year":"1983","unstructured":"Dinsmoor JA (1983) Observing and conditioned reinforcement. Behav Brain Sci 6(4):693\u2013704. https:\/\/doi.org\/10.1017\/S0140525X00017969","journal-title":"Behav Brain Sci"},{"issue":"1","key":"1856_CR20","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1901\/jeab.1972.18-79","volume":"18","author":"JA Dinsmoor","year":"1972","unstructured":"Dinsmoor JA, Browne MP, Lawrence CE (1972) A test of the negative discriminative stimulus as a reinforcer of observing. J Exp Anal Behav 18(1):79\u201385. https:\/\/doi.org\/10.1901\/jeab.1972.18-79","journal-title":"J Exp Anal Behav"},{"issue":"1","key":"1856_CR21","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1146\/annurev.psych.55.090902.141409","volume":"56","author":"M Domjan","year":"2005","unstructured":"Domjan M (2005) Pavlovian conditioning: a functional perspective. Annu Rev Psychol 56(1):179\u2013206. https:\/\/doi.org\/10.1146\/annurev.psych.55.090902.141409","journal-title":"Annu Rev Psychol"},{"key":"1856_CR22","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1037\/0735-7036.100.4.413","volume":"100","author":"M Domjan","year":"1986","unstructured":"Domjan M, Lyons R, North NC, Bruell J (1986) Sexual Pavlovian conditioned approach behavior in male Japanese quail (Coturnix coturnix japonica). J Comp Psychol 100:413\u2013421. https:\/\/doi.org\/10.1037\/0735-7036.100.4.413","journal-title":"J Comp Psychol"},{"key":"1856_CR23","doi-asserted-by":"publisher","DOI":"10.1037\/rev0000416","author":"RM Dunn","year":"2023","unstructured":"Dunn RM, Pisklak JM, McDevitt MA, Spetch ML (2023) Suboptimal choice: a review and quantification of the signal for good news (SiGN) model. Psychol Rev. https:\/\/doi.org\/10.1037\/rev0000416","journal-title":"Psychol Rev"},{"issue":"2","key":"1856_CR24","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1257\/aer.97.2.166","volume":"97","author":"K Eliaz","year":"2007","unstructured":"Eliaz K, Schotter A (2007) Experimental testing of intrinsic preferences for noninstrumental information. Am Econ Rev 97(2):166\u2013169. https:\/\/doi.org\/10.1257\/aer.97.2.166","journal-title":"Am Econ Rev"},{"issue":"2","key":"1856_CR25","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1016\/0023-9690(82)90021-2","volume":"13","author":"MS Fanselow","year":"1982","unstructured":"Fanselow MS, Baackes MP (1982) Conditioned fear-induced opiate analgesia on the Formalin test: evidence for two aversive motivational systems. Learn Motivat 13(2):200\u2013221. https:\/\/doi.org\/10.1016\/0023-9690(82)90021-2","journal-title":"Learn Motivat"},{"key":"1856_CR26","first-page":"163","volume-title":"Conditioned reinforcement","author":"E Fantino","year":"1969","unstructured":"Fantino E (1969) Conditioned reinforcement, choice, and the psychological distance to reward. In: Hendry DP (ed) Conditioned reinforcement. The Dorsey Press, pp 163\u2013191"},{"issue":"4","key":"1856_CR27","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1037\/xan0000114","volume":"42","author":"I Fortes","year":"2016","unstructured":"Fortes I, Vasconcelos M, Machado A (2016) Testing the boundaries of \u201cparadoxical\u201d predictions: pigeons do disregard bad news. J Exp Psychol Anim Learn Cogn 42(4):336\u2013346. https:\/\/doi.org\/10.1037\/xan0000114","journal-title":"J Exp Psychol Anim Learn Cogn"},{"issue":"2","key":"1856_CR28","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1037\/xan0000165","volume":"44","author":"I Fortes","year":"2018","unstructured":"Fortes I, Pinto C, Machado A, Vasconcelos M (2018) The paradoxical effect of low reward probabilities in suboptimal choice. J Exp Psychol Anim Learn Cogn 44(2):180\u2013193. https:\/\/doi.org\/10.1037\/xan0000165","journal-title":"J Exp Psychol Anim Learn Cogn"},{"issue":"1","key":"1856_CR29","doi-asserted-by":"publisher","first-page":"71","DOI":"10.3758\/BF03211990","volume":"4","author":"PW Frankel","year":"1976","unstructured":"Frankel PW, Vom Saal W (1976) Preference between fixed-interval and variable-interval schedules of reinforcement: separate roles of temporal scaling and predictability. Anim Learn Behav 4(1):71\u201376. https:\/\/doi.org\/10.3758\/BF03211990","journal-title":"Anim Learn Behav"},{"issue":"4","key":"1856_CR30","doi-asserted-by":"publisher","first-page":"289","DOI":"10.3758\/lb.37.4.289","volume":"37","author":"CD Gipson","year":"2009","unstructured":"Gipson CD, Alessandri JJD, Miller HC, Zentall TR (2009) Preference for 50% reinforcement over 75% reinforcement by pigeons. Learn Behav 37(4):289\u2013298. https:\/\/doi.org\/10.3758\/lb.37.4.289","journal-title":"Learn Behav"},{"issue":"3","key":"1856_CR31","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1002\/jeab.595","volume":"113","author":"VV Gonz\u00e1lez","year":"2020","unstructured":"Gonz\u00e1lez VV, Mac\u00edas A, Machado A, Vasconcelos M (2020a) The \u0394\u2013\u2211 hypothesis: How contrast and reinforcement rate combine to generate suboptimal choice. J Exp Anal Behav 113(3):591\u2013608. https:\/\/doi.org\/10.1002\/jeab.595","journal-title":"J Exp Anal Behav"},{"issue":"2","key":"1856_CR32","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1002\/jeab.621","volume":"114","author":"VV Gonz\u00e1lez","year":"2020","unstructured":"Gonz\u00e1lez VV, Mac\u00edas A, Machado A, Vasconcelos M (2020b) Testing the \u0394-\u2211 hypothesis in the suboptimal choice task: same delta with different probabilities of reinforcement. J Exp Anal Behav 114(2):233\u2013247. https:\/\/doi.org\/10.1002\/jeab.621","journal-title":"J Exp Anal Behav"},{"issue":"2","key":"1856_CR33","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1006\/jeth.1996.2458","volume":"83","author":"S Grant","year":"1998","unstructured":"Grant S, Kajii A, Polak B (1998) Intrinsic preference for information. J Econ Theory 83(2):233\u2013259. https:\/\/doi.org\/10.1006\/jeth.1996.2458","journal-title":"J Econ Theory"},{"issue":"4","key":"1856_CR34","doi-asserted-by":"publisher","first-page":"1029","DOI":"10.1016\/0091-3057(94)90260-7","volume":"49","author":"JE Grisel","year":"1994","unstructured":"Grisel JE, Wiertelak EP, Watkins LR, Maier SF (1994) Route of morphine administration modulates conditioned analgesic tolerance and hyperalgesia. Pharmacol Biochem Behav 49(4):1029\u20131035. https:\/\/doi.org\/10.1016\/0091-3057(94)90260-7","journal-title":"Pharmacol Biochem Behav"},{"key":"1856_CR35","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1037\/0097-7403.10.4.413","volume":"10","author":"KL Hollis","year":"1984","unstructured":"Hollis KL (1984) The biological function of Pavlovian conditioning: the best defense is a good offense. J Exp Psychol Anim Behav Process 10:413\u2013425. https:\/\/doi.org\/10.1037\/0097-7403.10.4.413","journal-title":"J Exp Psychol Anim Behav Process"},{"key":"1856_CR36","doi-asserted-by":"publisher","unstructured":"Hollis KL (1990) The role of Pavlovian conditioning in territorial aggression and reproduction. In: Contemporary issues in comparative psychology. Sinauer Associates, pp. 197\u2013219. https:\/\/doi.org\/10.1037\/11525-009","DOI":"10.1037\/11525-009"},{"key":"1856_CR37","doi-asserted-by":"publisher","first-page":"956","DOI":"10.1037\/0003-066X.52.9.956","volume":"52","author":"KL Hollis","year":"1997","unstructured":"Hollis KL (1997) Contemporary research on Pavlovian conditioning: a \u201cnew\u201d functional analysis. Am Psychol 52:956\u2013965. https:\/\/doi.org\/10.1037\/0003-066X.52.9.956","journal-title":"Am Psychol"},{"key":"1856_CR38","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1037\/0735-7036.103.2.115","volume":"103","author":"KL Hollis","year":"1989","unstructured":"Hollis KL, Cadieux EL, Colbert MM (1989) The biological function of Pavlovian conditioning: a mechanism for mating success in the blue gourami (Trichogaster trichopterus). J Comp Psychol 103:115\u2013121. https:\/\/doi.org\/10.1037\/0735-7036.103.2.115","journal-title":"J Comp Psychol"},{"key":"1856_CR39","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1037\/0735-7036.109.2.123","volume":"109","author":"KL Hollis","year":"1995","unstructured":"Hollis KL, Dumas MJ, Singh P, Fackelman P (1995) Pavlovian conditioning of aggressive behavior in blue gourami fish (Trichogaster trichopterus): winners become winners and losers stay losers. J Comp Psychol 109:123\u2013133. https:\/\/doi.org\/10.1037\/0735-7036.109.2.123","journal-title":"J Comp Psychol"},{"key":"1856_CR40","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1037\/0735-7036.111.3.219","volume":"111","author":"KL Hollis","year":"1997","unstructured":"Hollis KL, Pharr VL, Dumas MJ, Britton GB, Field J (1997) Classical conditioning provides paternity advantage for territorial male blue gouramis (Trichogaster trichopterus). J Comp Psychol 111:219\u2013225. https:\/\/doi.org\/10.1037\/0735-7036.111.3.219","journal-title":"J Comp Psychol"},{"issue":"1","key":"1856_CR41","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1901\/jeab.1974.22-31","volume":"22","author":"SR Hursh","year":"1974","unstructured":"Hursh SR, Fantino E (1974) An appraisal of preference for multiple versus mixed schedules. J Exp Anal Behav 22(1):31\u201338. https:\/\/doi.org\/10.1901\/jeab.1974.22-31","journal-title":"J Exp Anal Behav"},{"key":"1856_CR42","doi-asserted-by":"publisher","unstructured":"Kacelnik A, Vasconcelos M, Monteiro T, Awaa J (2011) Darwin\u2019s \u201ctug-of-war\u201d vs. starlings\u2019 \u201chorse-racing\u201d: how adaptations for sequential encounters drive simultaneous choice. Behav Ecol Sociobiol 65(3): 547\u2013558. https:\/\/doi.org\/10.1007\/S00265-010-1101-2","DOI":"10.1007\/S00265-010-1101-2"},{"issue":"1","key":"1856_CR43","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1007\/S10071-022-01723-4","volume":"26","author":"A Kacelnik","year":"2023","unstructured":"Kacelnik A, Vasconcelos M, Monteiro T (2023) Testing cognitive models of decision-making: selected studies with starlings. Anim Cogn 26(1):117\u2013127. https:\/\/doi.org\/10.1007\/S10071-022-01723-4","journal-title":"Anim Cogn"},{"issue":"26","key":"1856_CR44","doi-asserted-by":"publisher","first-page":"13061","DOI":"10.1073\/pnas.1820145116","volume":"116","author":"K Kobayashi","year":"2019","unstructured":"Kobayashi K, Hsu M (2019) Common neural code for reward and information value. Proc Natl Acad Sci USA 116(26):13061\u201313066. https:\/\/doi.org\/10.1073\/pnas.1820145116","journal-title":"Proc Natl Acad Sci USA"},{"issue":"1","key":"1856_CR45","doi-asserted-by":"publisher","first-page":"185","DOI":"10.2307\/1913656","volume":"46","author":"DM Kreps","year":"1978","unstructured":"Kreps DM, Porteus EL (1978) Temporal resolution of uncertainty and dynamic choice theory. Econometrica 46(1):185\u2013200. https:\/\/doi.org\/10.2307\/1913656","journal-title":"Econometrica"},{"issue":"2","key":"1856_CR46","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1901\/jeab.2012.98-139","volume":"98","author":"CH Lagorio","year":"2012","unstructured":"Lagorio CH, Hackenberg TD (2012) Risky choice in pigeons: preference for amount variability using a token-reinforcement system. J Exp Anal Behav 98(2):139\u2013154. https:\/\/doi.org\/10.1901\/jeab.2012.98-139","journal-title":"J Exp Anal Behav"},{"key":"1856_CR47","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1016\/S0091-3057(98)00072-0","volume":"61","author":"SJ Larson","year":"1998","unstructured":"Larson SJ, Siegel S (1998) Learning and tolerance to the ataxic effect of ethanol. Pharmacol Biochem Behav 61:131\u2013142. https:\/\/doi.org\/10.1016\/S0091-3057(98)00072-0","journal-title":"Pharmacol Biochem Behav"},{"issue":"1","key":"1856_CR48","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1037\/xan0000010","volume":"40","author":"JR Laude","year":"2014","unstructured":"Laude JR, Stagner JP, Zentall TR (2014) Suboptimal choice by pigeons may result from the diminishing effect of nonreinforcement. J Exp Psychol Anim Learn Cogn 40(1):12\u201321. https:\/\/doi.org\/10.1037\/xan0000010","journal-title":"J Exp Psychol Anim Learn Cogn"},{"key":"1856_CR49","doi-asserted-by":"publisher","first-page":"526","DOI":"10.1037\/h0041552","volume":"56","author":"JS Lockard","year":"1963","unstructured":"Lockard JS (1963) Choice of a warning signal or no warning signal in an unavoidable shock situation. J Comp Physiol Psychol 56:526\u2013530. https:\/\/doi.org\/10.1037\/h0041552","journal-title":"J Comp Physiol Psychol"},{"key":"1856_CR50","volume-title":"Individual choice behavior","author":"RD Luce","year":"1959","unstructured":"Luce RD (1959) Individual choice behavior. Wiley, New York"},{"issue":"1","key":"1856_CR51","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1007\/S10071-020-01418-8","volume":"24","author":"A Mac\u00edas","year":"2021","unstructured":"Mac\u00edas A, Gonz\u00e1lez VV, Machado A, Vasconcelos M (2021) The functional equivalence of two variants of the suboptimal choice task: choice proportion and response latency as measures of value. Anim Cogn 24(1):85\u201398. https:\/\/doi.org\/10.1007\/S10071-020-01418-8","journal-title":"Anim Cogn"},{"issue":"1","key":"1856_CR52","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1002\/jeab.192","volume":"105","author":"MA McDevitt","year":"2016","unstructured":"McDevitt MA, Dunn RM, Spetch ML, Ludvig EA (2016) When good news leads to bad choices. J Exp Anal Behav 105(1):23\u201340. https:\/\/doi.org\/10.1002\/jeab.192","journal-title":"J Exp Anal Behav"},{"issue":"4","key":"1856_CR53","doi-asserted-by":"publisher","first-page":"439","DOI":"10.3758\/S13420-012-0065-7","volume":"40","author":"M Molet","year":"2012","unstructured":"Molet M, Miller HC, Laude JR, Kirk C, Manning B, Zentall TR (2012) Decision making by humans in a behavioral task: do humans, like pigeons, show suboptimal choice? Learn Behav 40(4):439\u2013447. https:\/\/doi.org\/10.3758\/S13420-012-0065-7","journal-title":"Learn Behav"},{"key":"1856_CR54","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1037\/0097-7403.22.3.244","volume":"22","author":"DL Mongeluzi","year":"1996","unstructured":"Mongeluzi DL, Rosellini RA, Caldarone BJ, Stock HS, Abrahamsen GC (1996) Pavlovian aversive context conditioning using carbon dioxide as the unconditional stimulus. J Exp Psychol Anim Behav Process 22:244\u2013257. https:\/\/doi.org\/10.1037\/0097-7403.22.3.244","journal-title":"J Exp Psychol Anim Behav Process"},{"issue":"8","key":"1856_CR55","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.3000841","volume":"18","author":"T Monteiro","year":"2020","unstructured":"Monteiro T, Vasconcelos M, Kacelnik A (2020) Choosing fast and simply: construction of preferences by starlings through parallel option valuation. PLoS Biol 18(8):e3000841. https:\/\/doi.org\/10.1371\/journal.pbio.3000841","journal-title":"PLoS Biol"},{"issue":"1","key":"1856_CR56","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1901\/jeab.1974.21-37","volume":"21","author":"DE Mulvaney","year":"1974","unstructured":"Mulvaney DE, Dinsmoor JA, Jwaideh AR, Hughes LH (1974) Punishment of observing by the negative discriminative stimulus. J Exp Anal Behav 21(1):37\u201344. https:\/\/doi.org\/10.1901\/jeab.1974.21-37","journal-title":"J Exp Anal Behav"},{"issue":"976","key":"1856_CR57","doi-asserted-by":"publisher","first-page":"1055","DOI":"10.2307\/2460030","volume":"110","author":"GA Parker","year":"1976","unstructured":"Parker GA, Stuart RA (1976) Animal behavior as a strategy optimizer: evolution of resource assessment strategies and optimal emigration thresholds. Am Nat 110(976):1055\u20131076. https:\/\/doi.org\/10.2307\/2460030","journal-title":"Am Nat"},{"issue":"3","key":"1856_CR58","doi-asserted-by":"publisher","first-page":"735","DOI":"10.2466\/pr0.1963.13.3.735","volume":"13","author":"CC Perkins","year":"1963","unstructured":"Perkins CC, Levis DJ, Seymann R (1963) Preference for Signal-shock vs shock-signal. Psychol Rep 13(3):735\u2013738. https:\/\/doi.org\/10.2466\/pr0.1963.13.3.735","journal-title":"Psychol Rep"},{"key":"1856_CR59","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1037\/h0046740","volume":"49","author":"WF Prokasy Jr","year":"1956","unstructured":"Prokasy WF Jr (1956) The acquisition of observing responses in the absence of differential external reinforcement. J Comp Physiol Psychol 49:131\u2013134. https:\/\/doi.org\/10.1037\/h0046740","journal-title":"J Comp Physiol Psychol"},{"issue":"4","key":"1856_CR60","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1093\/beheco\/2.4.301","volume":"2","author":"JC Reboreda","year":"1991","unstructured":"Reboreda JC, Kacelnik A (1991) Risk sensitivity in starlings: variability in food amount and food delay. Behav Ecol 2(4):301\u2013308. https:\/\/doi.org\/10.1093\/beheco\/2.4.301","journal-title":"Behav Ecol"},{"issue":"2","key":"1856_CR61","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1901\/jeab.1981.35-145","volume":"35","author":"RW Richards","year":"1981","unstructured":"Richards RW (1981) A comparison of signaled and unsignaled delay of reinforcement. J Exp Anal Behav 35(2):145\u2013152. https:\/\/doi.org\/10.1901\/jeab.1981.35-145","journal-title":"J Exp Anal Behav"},{"key":"1856_CR62","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1016\/B978-0-08-057169-0.50013-9","volume-title":"Animal learning and cognition","author":"SJ Shettleworth","year":"1994","unstructured":"Shettleworth SJ (1994) Biological approaches to the study of learning. In: Mackintosh NJ (ed) Animal learning and cognition. Academic Press, pp 185\u2013219"},{"issue":"2","key":"1856_CR63","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1901\/jeab.1990.53-235","volume":"53","author":"RL Shull","year":"1990","unstructured":"Shull RL, Mellon RC, Sharp JA (1990) Delay and number of food reinforcers: effects on choice and latencies. J Exp Anal Behav 53(2):235\u2013246. https:\/\/doi.org\/10.1901\/jeab.1990.53-235","journal-title":"J Exp Anal Behav"},{"key":"1856_CR64","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1037\/h0077058","volume":"89","author":"S Siegel","year":"1975","unstructured":"Siegel S (1975) Evidence from rats that morphine tolerance is a learned response. J Comp Physiol Psychol 89:498\u2013506. https:\/\/doi.org\/10.1037\/h0077058","journal-title":"J Comp Physiol Psychol"},{"key":"1856_CR65","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1037\/1064-1297.8.3.276","volume":"8","author":"S Siegel","year":"2000","unstructured":"Siegel S, Baptista MAS, Kim JA, McDonald RV, Weise-Kelly L (2000) Pavlovian psychopharmacology: the associative basis of tolerance. Exp Clin Psychopharmacol 8:276\u2013293. https:\/\/doi.org\/10.1037\/1064-1297.8.3.276","journal-title":"Exp Clin Psychopharmacol"},{"issue":"7","key":"1856_CR66","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0159336","volume":"11","author":"AP Smith","year":"2016","unstructured":"Smith AP, Bailey AR, Chow JJ, Beckmann JS, Zentall TR (2016) Suboptimal choice in pigeons: stimulus value predicts choice over frequencies. PLoS ONE 11(7):e0159336. https:\/\/doi.org\/10.1371\/journal.pone.0159336","journal-title":"PLoS ONE"},{"issue":"3","key":"1856_CR67","doi-asserted-by":"publisher","first-page":"412","DOI":"10.3758\/PBR.17.3.412","volume":"17","author":"JP Stagner","year":"2010","unstructured":"Stagner JP, Zentall TR (2010) Suboptimal choice behavior by pigeons. Psychon Bull Rev 17(3):412\u2013116. https:\/\/doi.org\/10.3758\/PBR.17.3.412","journal-title":"Psychon Bull Rev"},{"key":"1856_CR68","doi-asserted-by":"publisher","unstructured":"Stevens JR, Stephens DW (2010) The adaptive nature of impulsivity. In: Impulsivity: The behavioral and neurological science of discounting (pp. 361\u2013387). American Psychological Association. https:\/\/doi.org\/10.1037\/12069-013","DOI":"10.1037\/12069-013"},{"issue":"3","key":"1856_CR69","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1016\/S0168-1591(01)00113-7","volume":"72","author":"V Tancin","year":"2001","unstructured":"Tancin V, Kraetzl W-D, Schams D, Bruckmaier RM (2001) The effects of conditioning to suckling, milking and of calf presence on the release of oxytocin in dairy cows. Appl Anim Behav Sci 72(3):235\u2013246. https:\/\/doi.org\/10.1016\/S0168-1591(01)00113-7","journal-title":"Appl Anim Behav Sci"},{"key":"1856_CR70","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0064934","author":"M Vasconcelos","year":"2013","unstructured":"Vasconcelos M, Monteiro T, Kacelnik A (2013) Context-dependent preferences in starlings: linking ecology, foraging and choice. PLoS ONE. https:\/\/doi.org\/10.1371\/journal.pone.0064934","journal-title":"PLoS ONE"},{"key":"1856_CR71","doi-asserted-by":"publisher","first-page":"13874","DOI":"10.1038\/Srep13874","volume":"5","author":"M Vasconcelos","year":"2015","unstructured":"Vasconcelos M, Monteiro T, Kacelnik A (2015) Irrational choice and the value of information. Sci Rep 5:13874. https:\/\/doi.org\/10.1038\/Srep13874","journal-title":"Sci Rep"},{"key":"1856_CR72","doi-asserted-by":"publisher","unstructured":"Vasconcelos M, Carvalho MP, Machado A (2017) Timing in animals: from the natural environment to the laboratory, from data to models. In: Call J, Burghardt GM, Pepperberg IM, Snowdon CT, Zentall T (eds) APA handbook of comparative psychology: perception, learning, and cognition, Vol. 2 (pp. 509\u2013534). American Psychological Association. https:\/\/doi.org\/10.1037\/0000012-023","DOI":"10.1037\/0000012-023"},{"key":"1856_CR73","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/j.beproc.2018.03.023","volume":"152","author":"M Vasconcelos","year":"2018","unstructured":"Vasconcelos M, Machado A, Pandeirada JNS (2018) Ultimate explanations and suboptimal choice. Behav Proc 152:63\u201372. https:\/\/doi.org\/10.1016\/j.beproc.2018.03.023","journal-title":"Behav Proc"},{"key":"1856_CR74","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1037\/0033-295X.98.4.488","volume":"98","author":"SC Woods","year":"1991","unstructured":"Woods SC (1991) The eating paradox: how we tolerate food. Psychol Rev 98:488\u2013505. https:\/\/doi.org\/10.1037\/0033-295X.98.4.488","journal-title":"Psychol Rev"},{"issue":"1","key":"1856_CR75","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1016\/S0166-4328(99)00194-1","volume":"110","author":"SC Woods","year":"2000","unstructured":"Woods SC, Ramsay DS (2000) Pavlovian influences over food and drug intake. Behav Brain Res 110(1):175\u2013182. https:\/\/doi.org\/10.1016\/S0166-4328(99)00194-1","journal-title":"Behav Brain Res"},{"issue":"2","key":"1856_CR76","doi-asserted-by":"publisher","first-page":"141","DOI":"10.3758\/BF03200770","volume":"1","author":"SC Woods","year":"1994","unstructured":"Woods SC, Strubbe JH (1994) The psychobiology of meals. Psychon Bull Rev 1(2):141\u2013155. https:\/\/doi.org\/10.3758\/BF03200770","journal-title":"Psychon Bull Rev"},{"key":"1856_CR77","first-page":"237","volume-title":"Conditioned reinforcement","author":"LB Wyckoff","year":"1969","unstructured":"Wyckoff LB (1969) The role of observing responses in discrimination learning. In: Wright GD (ed) Conditioned reinforcement. Dorsey Press, pp 237\u2013260"},{"key":"1856_CR78","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1016\/0023-9690(73)90026-X","volume":"4","author":"E Zamble","year":"1973","unstructured":"Zamble E (1973) Augmentation of eating following a signal for feeding in rats. Learn Motiv 4:138\u2013147. https:\/\/doi.org\/10.1016\/0023-9690(73)90026-X","journal-title":"Learn Motiv"},{"key":"1856_CR79","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1037\/0097-7403.11.4.598","volume":"11","author":"E Zamble","year":"1985","unstructured":"Zamble E, Hadad GM, Mitchell JB, Cutmore TRH (1985) Pavlovian conditioning of sexual arousal: First- and second-order effects. J Exp Psychol Anim Behav Process 11:598\u2013610. https:\/\/doi.org\/10.1037\/0097-7403.11.4.598","journal-title":"J Exp Psychol Anim Behav Process"},{"issue":"1","key":"1856_CR80","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1037\/xan0000085","volume":"42","author":"TR Zentall","year":"2016","unstructured":"Zentall TR (2016) Resolving the paradox of suboptimal choice. J Exp Psychol: Anim Learn Cogn 42(1):1\u201314. https:\/\/doi.org\/10.1037\/xan0000085","journal-title":"J Exp Psychol: Anim Learn Cogn"},{"issue":"1709","key":"1856_CR81","doi-asserted-by":"publisher","first-page":"1203","DOI":"10.1098\/rspb.2010.1607","volume":"278","author":"TR Zentall","year":"2011","unstructured":"Zentall TR, Stagner J (2011) Maladaptive choice behaviour by pigeons: an animal analogue and possible mechanism for gambling (sub-optimal human decision-making behaviour). Proc R Soc b: Biol Sci 278(1709):1203\u20131208. https:\/\/doi.org\/10.1098\/rspb.2010.1607","journal-title":"Proc R Soc b: Biol Sci"}],"container-title":["Animal Cognition"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10071-024-01856-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10071-024-01856-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10071-024-01856-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,19]],"date-time":"2025-01-19T23:46:40Z","timestamp":1737330400000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10071-024-01856-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,2]]},"references-count":81,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["1856"],"URL":"https:\/\/doi.org\/10.1007\/s10071-024-01856-8","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2773082\/v1","asserted-by":"object"}]},"ISSN":["1435-9456"],"issn-type":[{"value":"1435-9456","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,2]]},"assertion":[{"value":"3 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 October 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 March 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The pigeons were cared for according to the animal care guidelines of the Directorate-General for Food and Veterinary (DGAV), the Portuguese national authority for animal health, and the University of Minho. All experimental procedures were conducted in agreement with European (Directive 2010\/63\/EU) and Portuguese law (Ordinance 1005\/92 of October 23), and were approved by DGAV (Authorization #024946).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}],"article-number":"10"}}