{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,28]],"date-time":"2025-04-28T14:31:46Z","timestamp":1745850706537},"reference-count":60,"publisher":"MIT Press","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2019,2]]},"abstract":"<jats:p>Specialization and hierarchical organization are important features of efficient collaboration in economical, artificial, and biological systems. Here, we investigate the hypothesis that both features can be explained by the fact that each entity of such a system is limited in a certain way. We propose an information-theoretic approach based on a free energy principle in order to computationally analyze systems of bounded rational agents that deal with such limitations optimally. We find that specialization allows a focus on fewer tasks, thus leading to a more efficient execution, but in turn, it requires coordination in hierarchical structures of specialized experts and coordinating units. Our results suggest that hierarchical architectures of specialized units at lower levels that are coordinated by units at higher levels are optimal, given that each unit's information-processing capability is limited and conforms to constraints on complexity costs.<\/jats:p>","DOI":"10.1162\/neco_a_01153","type":"journal-article","created":{"date-parts":[[2018,12,21]],"date-time":"2018-12-21T23:50:52Z","timestamp":1545436252000},"page":"440-476","source":"Crossref","is-referenced-by-count":7,"title":["Systems of Bounded Rational Agents with Information-Theoretic Constraints"],"prefix":"10.1162","volume":"31","author":[{"given":"Sebastian","family":"Gottwald","sequence":"first","affiliation":[{"name":"Institute of Neural Information Processing, Faculty of Engineering, Computer Science and Psychology, University of Ulm, Ulm, Baden-W\u00fcrttemberg, 89081 Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel A.","family":"Braun","sequence":"additional","affiliation":[{"name":"Institute of Neural Information Processing, Faculty of Engineering, Computer Science and Psychology, University of Ulm, Ulm, Baden-W\u00fcrttemberg, 89081 Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.2307\/1913097"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003661"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1972.1054753"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1006\/game.1997.0585"},{"key":"B5","author":"Bishop C. M.","year":"2006","journal-title":"Pattern recognition and machine learning"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1972.1054855"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1613\/jair.4047"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2681(88)90016-9"},{"issue":"7","key":"B9","doi-asserted-by":"crossref","first-page":"350","DOI":"10.3844\/jcssp.2016.350.362","volume":"12","author":"Chehouri A.","year":"2016","journal-title":"Journal of Computer Sciences"},{"key":"B10","first-page":"205","volume":"1","author":"Csisz\u00e1r I.","year":"1984","journal-title":"Statistics and Decisions"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-2681(98)00096-1"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1023\/A:1020249912095"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2009.04.005"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2787"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2014.1383"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1162\/neco_a_00999"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1162\/NETN_a_00018"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1080\/17588928.2015.1020053"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1016\/0889-1583(91)90011-E"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2015.00027"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1126\/science.aac6076"},{"key":"B23","author":"Gigerenzer G.","year":"2001","journal-title":"Bounded rationality: The adaptive toolbox"},{"key":"B24","first-page":"39","volume":"7","author":"Graicunas V. A.","year":"1933","journal-title":"Bulletin of the International Management Institute"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1016\/j.jet.2016.02.007"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1037\/a0017187"},{"key":"B27","doi-asserted-by":"crossref","DOI":"10.1561\/9781680833690","author":"Jain P.","year":"2017","journal-title":"Non-convex optimization for machine learning"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1093\/jopart\/mug028"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(98)00023-X"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-012-5278-7"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0503610102"},{"key":"B32","author":"Knight F.","year":"1921","journal-title":"Risk, uncertainty and profit"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1111\/tops.12086"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.2307\/136022"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1006\/jeth.1997.2375"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1016\/S0899-8256(02)00014-3"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1006\/game.1995.1023"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780198570837.001.0001"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1016\/0165-1765(85)90026-6"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1006\/game.1995.1030"},{"key":"B41","first-page":"115","author":"Ortega P. A.","year":"2010","journal-title":"Proceedings of the Third Conference on Artificial General Intelligence"},{"key":"B42","first-page":"269","author":"Ortega P. A.","year":"2011","journal-title":"Information, utility and Bounded Rationality"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1098\/rspa.2012.0683"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1080\/17588928.2015.1051525"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.2307\/2951495"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1613\/jair.133"},{"key":"B47","first-page":"142","volume":"7","author":"Shannon C. E.","year":"1959","journal-title":"IRE International Convention Record"},{"key":"B48","author":"Simon H. A.","year":"1943","journal-title":"A theory of administrative decision"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.2307\/1884852"},{"issue":"4","key":"B50","first-page":"493","volume":"69","author":"Simon H. A.","year":"1979","journal-title":"American Economic Review"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-3932(03)00029-1"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195398717.001.0001"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1209\/0295-5075\/85\/28005"},{"key":"B54","first-page":"368","author":"Tishby N.","year":"1999","journal-title":"Proceedings of the 37th Allerton Conference on Communication, Control, and Computing"},{"key":"B55","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-1452-1_19"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0710743106"},{"key":"B57","author":"von Neumann J.","year":"1944","journal-title":"Theory of games and economic behavior"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1111\/cogs.12101"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1038\/nrg2267"},{"key":"B60","author":"Wolpert D. H.","year":"2006","journal-title":"Information theory: The bridge connecting bounded rational game theory and statistical physics"},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2005.850085"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/neco_a_01153","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T11:26:41Z","timestamp":1694518001000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/31\/2\/440-476\/8448"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2]]},"references-count":60,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,2]]}},"alternative-id":["10.1162\/neco_a_01153"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_01153","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2]]}}}