{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T07:48:17Z","timestamp":1783583297938,"version":"3.55.0"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1012086","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,6,5]],"date-time":"2024-06-05T00:00:00Z","timestamp":1717545600000}}],"reference-count":73,"publisher":"Public Library of Science (PLoS)","issue":"5","license":[{"start":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T00:00:00Z","timestamp":1716422400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003816","name":"Huawei Technologies","doi-asserted-by":"publisher","award":["YBN2020045132"],"award-info":[{"award-number":["YBN2020045132"]}],"id":[{"id":"10.13039\/501100003816","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Animals can learn in real-life scenarios where rewards are often only available when a goal is achieved. This \u2018distal\u2019 or \u2018sparse\u2019 reward problem remains a challenge for conventional reinforcement learning algorithms. Here we investigate an algorithm for learning in such scenarios, inspired by the possibility that axo-axonal gap junction connections, observed in neural circuits with parallel fibres such as the insect mushroom body, could form a resistive network. In such a network, an active node represents the task state, connections between nodes represent state transitions and their connection to actions, and current flow to a target state can guide decision making. Building on evidence that gap junction weights are adaptive, we propose that experience of a task can modulate the connections to form a graph encoding the task structure. We demonstrate that the approach can be used for efficient reinforcement learning under sparse rewards, and discuss whether it is plausible as an account of the insect mushroom body.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1012086","type":"journal-article","created":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T18:02:29Z","timestamp":1716487349000},"page":"e1012086","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":4,"title":["Learning with sparse reward in a gap junction network inspired by the insect mushroom body"],"prefix":"10.1371","volume":"20","author":[{"given":"Tianqi","family":"Wei","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qinghai","family":"Guo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8336-6926","authenticated-orcid":true,"given":"Barbara","family":"Webb","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2024,5,23]]},"reference":[{"issue":"5","key":"pcbi.1012086.ref001","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1177\/10738584221120804","article-title":"Gap junctions in the brain: hardwired but functionally versatile","volume":"29","author":"R Guti\u00e9rrez","year":"2023","journal-title":"The Neuroscientist"},{"issue":"2","key":"pcbi.1012086.ref002","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/S0306-4522(98)00755-6","article-title":"High-frequency population oscillations are predicted to occur in hippocampal pyramidal neuronal networks interconnected by axoaxonal gap junctions","volume":"92","author":"RD Traub","year":"1999","journal-title":"Neuroscience"},{"key":"pcbi.1012086.ref003","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/s11068-006-9005-9","article-title":"Electrical coupling between pyramidal cells in adult cortical regions","volume":"35","author":"A Mercer","year":"2006","journal-title":"Brain cell biology"},{"issue":"10","key":"pcbi.1012086.ref004","doi-asserted-by":"crossref","first-page":"2833","DOI":"10.1152\/jn.00709.2011","article-title":"Subthreshold somatic voltage in neocortical pyramidal cells can control whether spikes propagate from the axonal plexus to axon terminals: a model study","volume":"107","author":"E Munro","year":"2012","journal-title":"Journal of Neurophysiology"},{"issue":"3","key":"pcbi.1012086.ref005","doi-asserted-by":"crossref","first-page":"e1006025","DOI":"10.1371\/journal.pcbi.1006025","article-title":"Gap junction plasticity as a mechanism to regulate network-wide oscillations","volume":"14","author":"G Pernelle","year":"2018","journal-title":"PLoS computational biology"},{"issue":"24","key":"pcbi.1012086.ref006","doi-asserted-by":"crossref","first-page":"10229","DOI":"10.1073\/pnas.0703697104","article-title":"Robust coding of flow-field parameters by axo-axonal gap junctions between fly visual interneurons","volume":"104","author":"H Cuntz","year":"2007","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"5","key":"pcbi.1012086.ref007","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1016\/S0896-6273(01)00410-X","article-title":"Axo-axonal coupling: a novel mechanism for ultrafast neuronal communication","volume":"31","author":"D Schmitz","year":"2001","journal-title":"Neuron"},{"key":"pcbi.1012086.ref008","doi-asserted-by":"crossref","first-page":"e04577","DOI":"10.7554\/eLife.04577","article-title":"The neuronal architecture of the mushroom body provides a logic for associative learning","volume":"3","author":"Y Aso","year":"2014","journal-title":"eLife"},{"key":"pcbi.1012086.ref009","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.conb.2018.10.007","article-title":"Connectomics and function of a memory network: the mushroom body of larval Drosophila","volume":"54","author":"AS Thum","year":"2019","journal-title":"Current opinion in neurobiology"},{"key":"pcbi.1012086.ref010","first-page":"1","article-title":"The connectome of the adult Drosophila mushroom body provides insights into function","volume":"9","author":"F Li","year":"2020","journal-title":"eLife"},{"issue":"4","key":"pcbi.1012086.ref011","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1038\/nrn1074","article-title":"Mushroom body memoir: from maps to models","volume":"4","author":"M Heisenberg","year":"2003","journal-title":"Nature Reviews Neuroscience"},{"issue":"21","key":"pcbi.1012086.ref012","doi-asserted-by":"crossref","first-page":"R995","DOI":"10.1016\/j.cub.2009.08.023","article-title":"Are Bigger Brains Better?","volume":"19","author":"L Chittka","year":"2009","journal-title":"Current Biology"},{"key":"pcbi.1012086.ref013","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1146\/annurev-neuro-080317-0621333","article-title":"The Drosophila mushroom body: from architecture to algorithm in a learning circuit","volume":"43","author":"MN Modi","year":"2020","journal-title":"Annual review of neuroscience"},{"key":"pcbi.1012086.ref014","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.26975","article-title":"A connectome of a learning and memory center in the adult Drosophila brain","volume":"6","author":"S Takemura","year":"2017","journal-title":"eLife"},{"key":"pcbi.1012086.ref015","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.57443","article-title":"A connectome and analysis of the adult Drosophila central brain","volume":"9","author":"LK Scheffer","year":"2020","journal-title":"eLife"},{"issue":"33","key":"pcbi.1012086.ref016","doi-asserted-by":"crossref","first-page":"11772","DOI":"10.1523\/JNEUROSCI.1099-11.2011","article-title":"Cellular-resolution population imaging reveals robust sparse coding in the Drosophila mushroom body","volume":"31","author":"KS Honegger","year":"2011","journal-title":"Journal of Neuroscience"},{"issue":"3","key":"pcbi.1012086.ref017","first-page":"1","article-title":"Mushroom body output neurons encode valence and guide memory-based action selection in Drosophila","volume":"3","author":"Y Aso","year":"2014","journal-title":"eLife"},{"issue":"7666","key":"pcbi.1012086.ref018","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1038\/nature23455","article-title":"The complete connectome of a learning and memory centre in an insect brain","volume":"548","author":"K Eichler","year":"2017","journal-title":"Nature"},{"issue":"20","key":"pcbi.1012086.ref019","doi-asserted-by":"crossref","first-page":"4438","DOI":"10.1016\/j.cub.2022.09.007","article-title":"Lateral axonal modulation is required for stimulus-specific olfactory conditioning in Drosophila","volume":"32","author":"JE Manoim","year":"2022","journal-title":"Current Biology"},{"key":"pcbi.1012086.ref020","doi-asserted-by":"crossref","first-page":"e13238","DOI":"10.7554\/eLife.13238","article-title":"Gap junction networks in mushroom bodies participate in visual learning and memory in Drosophila","volume":"5","author":"Q Liu","year":"2016","journal-title":"eLife"},{"issue":"10","key":"pcbi.1012086.ref021","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1016\/j.cub.2011.02.041","article-title":"Heterotypic gap junctions between two neurons in the drosophila brain are critical for memory","volume":"21","author":"CL Wu","year":"2011","journal-title":"Current Biology"},{"key":"pcbi.1012086.ref022","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/B978-0-12-803471-2.00003-5","volume-title":"Network Functions and Plasticity","author":"MFM Shih","year":"2017"},{"issue":"5","key":"pcbi.1012086.ref023","doi-asserted-by":"crossref","first-page":"e1008153","DOI":"10.1371\/journal.pgen.1008153","article-title":"Electrical synapses between mushroom body neurons are critical for consolidated memory retrieval in Drosophila","volume":"15","author":"WH Shyu","year":"2019","journal-title":"PLoS Genetics"},{"key":"pcbi.1012086.ref024","first-page":"93","volume-title":"Parallel Analogue Computation for Real-Time Path Planning","author":"L Tarassenko","year":"1991"},{"key":"pcbi.1012086.ref025","first-page":"2778","volume-title":"International Conference on Machine Learning","author":"D Pathak","year":"2017"},{"key":"pcbi.1012086.ref026","unstructured":"Burda Y, Edwards H, Pathak D, Storkey A, Darrell T, Efros AA. Large-Scale Study of Curiosity-Driven Learning. In: Seventh International Conference on Learning Representations; 2019. p. 1\u201317."},{"key":"pcbi.1012086.ref027","unstructured":"Sekar R, Rybkin O, Daniilidis K, Abbeel P, Hafner D, Pathak D. Planning to explore via self-supervisedworld models. 37th International Conference on Machine Learning. 2020; p. 8541\u20138550."},{"issue":"4","key":"pcbi.1012086.ref028","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1037\/h0061626","article-title":"Cognitive maps in rats and men","volume":"55","author":"EC Tolman","year":"1948","journal-title":"Psychological Review"},{"issue":"1","key":"pcbi.1012086.ref029","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000086","article-title":"Model-based reinforcement learning: A survey","volume":"16","author":"TM Moerland","year":"2023","journal-title":"Foundations and Trends in Machine Learning"},{"issue":"1","key":"pcbi.1012086.ref030","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.bbamem.2012.05.026","article-title":"Gap junction-mediated electrical transmission: Regulatory mechanisms and plasticity","volume":"1828","author":"AE Pereda","year":"2013","journal-title":"Biochimica et Biophysica Acta (BBA)\u2014Biomembranes"},{"issue":"1","key":"pcbi.1012086.ref031","doi-asserted-by":"crossref","first-page":"3467","DOI":"10.1038\/s41467-020-17218-0","article-title":"NMDAR-mediated modulation of gap junction circuit regulates olfactory learning in C. elegans","volume":"11","author":"MK Choi","year":"2020","journal-title":"Nature Communications"},{"issue":"1","key":"pcbi.1012086.ref032","doi-asserted-by":"crossref","first-page":"12579","DOI":"10.1038\/s41598-018-30966-w","article-title":"Long-term potentiation in an innexin-based electrical synapse","volume":"8","author":"G Welzel","year":"2018","journal-title":"Scientific Reports"},{"issue":"35","key":"pcbi.1012086.ref033","doi-asserted-by":"crossref","first-page":"6751","DOI":"10.1523\/JNEUROSCI.2402-20.2022","article-title":"Timing-Dependent Potentiation and Depression of Electrical Synapses Contribute to Network Stability in the Crustacean Cardiac Ganglion","volume":"42","author":"DR Kick","year":"2022","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"pcbi.1012086.ref034","first-page":"1","article-title":"Learning with reinforcement prediction errors in a model of the Drosophila mushroom body","volume":"12","author":"JEM Bennett","year":"2021","journal-title":"Nature Communications 2021 12:1"},{"issue":"1","key":"pcbi.1012086.ref035","first-page":"1","article-title":"Predictive olfactory learning in Drosophila","volume":"11","author":"C Zhao","year":"2021","journal-title":"Scientific reports"},{"issue":"3","key":"pcbi.1012086.ref036","doi-asserted-by":"crossref","DOI":"10.1523\/ENEURO.0549-20.2021","article-title":"A mechanistic model for reward prediction and extinction learning in the fruit fly","volume":"8","author":"M Springer","year":"2021","journal-title":"ENeuro"},{"issue":"1","key":"pcbi.1012086.ref037","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1613\/jair.639","article-title":"Hierarchical reinforcement learning with the MAXQ value function decomposition","volume":"13","author":"TG Dietterich","year":"2000","journal-title":"Journal of Artificial Intelligence Research"},{"issue":"1","key":"pcbi.1012086.ref038","first-page":"1","article-title":"Fast Poisson disk sampling in arbitrary dimensions","volume":"10","author":"R Bridson","year":"2007","journal-title":"ACM SIGGRAPH Sketches"},{"issue":"1604","key":"pcbi.1012086.ref039","doi-asserted-by":"crossref","first-page":"2965","DOI":"10.1098\/rspb.2006.3673","article-title":"Outcome expectations drive learned behaviour in larval Drosophila","volume":"273","author":"B Gerber","year":"2006","journal-title":"Proceedings of the Royal Society B: Biological Sciences"},{"key":"pcbi.1012086.ref040","first-page":"81","volume-title":"Handbook of Behavioral Neuroscience","author":"B Webb","year":"2013"},{"key":"pcbi.1012086.ref041","doi-asserted-by":"crossref","first-page":"473","DOI":"10.3758\/s13415-014-0277-8","article-title":"Model-based and model-free Pavlovian reward learning: revaluation, revision, and revelation","volume":"14","author":"P Dayan","year":"2014","journal-title":"Cognitive, Affective, & Behavioral Neuroscience"},{"key":"pcbi.1012086.ref042","doi-asserted-by":"crossref","unstructured":"Bellemare MG, Srinivasan S, Ostrovski G, Schaul T, Saxton D, Munos R. Unifying count-based exploration and intrinsic motivation. In: Proceedings of the 30th International Conference on Neural Information Processing Systems; 2016. p. 1479\u20131487.","DOI":"10.1609\/aaai.v30i1.10303"},{"key":"pcbi.1012086.ref043","unstructured":"Tang H, Houthooft R, Foote D, Stooke A, Chen X, Duan Y, et al. # Exploration: a study of count-based exploration for deep reinforcement learning. In: Proceedings of the 31st International Conference on Neural Information Processing Systems; 2017. p. 2750\u20132759."},{"key":"pcbi.1012086.ref044","unstructured":"Mirowski P, Pascanu R, Viola F, Soyer H, Ballard A, Banino A, et al. Learning to Navigate in Complex Environments. In: International Conference on Learning Representations; 2016."},{"key":"pcbi.1012086.ref045","unstructured":"Andrychowicz M, Wolski F, Ray A, Schneider J, Fong R, Welinder P, et al. Hindsight experience replay. In: Proceedings of the 31st International Conference on Neural Information Processing Systems; 2017. p. 5055\u20135065."},{"issue":"4","key":"pcbi.1012086.ref046","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1162\/neco.1993.5.4.613","article-title":"Improving generalization for temporal difference learning: The successor representation","volume":"5","author":"P Dayan","year":"1993","journal-title":"Neural Computation"},{"issue":"33","key":"pcbi.1012086.ref047","doi-asserted-by":"crossref","first-page":"7193","DOI":"10.1523\/JNEUROSCI.0151-18.2018","article-title":"The successor representation: its computational logic and neural substrates","volume":"38","author":"SJ Gershman","year":"2018","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1012086.ref048","doi-asserted-by":"crossref","unstructured":"Sutton RS. Integrated architecture for learning, planning, and reacting based on approximating dynamic programming. In: Proceedings of the seventh international conference on Machine Learning; 1990. p. 216\u2013224.","DOI":"10.1016\/B978-1-55860-141-3.50030-4"},{"issue":"4","key":"pcbi.1012086.ref049","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/0146-664X(74)90022-7","article-title":"Determining lightness from an image","volume":"3","author":"K P H Berthold","year":"1974","journal-title":"Computer Graphics and Image Processing"},{"key":"pcbi.1012086.ref050","doi-asserted-by":"crossref","unstructured":"Tarassenko L, Blake A. Analogue computation of collision-free paths. In: Proceedings IEEE International Conference on Robotics and Automation; 1991. p. 540\u2013545.","DOI":"10.1109\/ROBOT.1991.131636"},{"key":"pcbi.1012086.ref051","doi-asserted-by":"crossref","unstructured":"Koziol S, Hasler P. Reconfigurable Analog VLSI circuits for robot path planning. Proceedings of the 2011 NASA\/ESA Conference on Adaptive Hardware and Systems. 2011; p. 36\u201343.","DOI":"10.1109\/AHS.2011.5963964"},{"key":"pcbi.1012086.ref052","doi-asserted-by":"crossref","unstructured":"Koziol S, Hasler P, Stilman M. Robot path planning using Field Programmable Analog Arrays. Proceedings\u2014IEEE International Conference on Robotics and Automation. 2012; p. 1747\u20131752.","DOI":"10.1109\/ICRA.2012.6225303"},{"key":"pcbi.1012086.ref053","unstructured":"Marshall GF, Tarassenko L. Robot path planning using resistive grids. In: Second International Conference on Artificial Neural Networks; 1991. p. 149\u2013152."},{"key":"pcbi.1012086.ref054","doi-asserted-by":"crossref","unstructured":"Yun LJ, Liu ZJ, Sun HX, Yuan J. A path planner of mobile robot based on multi-grid circuit map. In: 2005 International Conference on Machine Learning and Cybernetics. vol. 2. IEEE; 2005. p. 1279\u20131284.","DOI":"10.1109\/ICMLC.2005.1527140"},{"key":"pcbi.1012086.ref055","doi-asserted-by":"crossref","unstructured":"Petavratzis EK, Volos CK, Stouboulos IN, Kyprianidis IM, Nistazakis HE, Tombras GS. Robot\u2019s path planning based on emulated finite resistive grids. In: 7th International Conference on Modern Circuits and Systems Technologies (MOCAST). IEEE; 2018. p. 1\u20134.","DOI":"10.1109\/MOCAST.2018.8376608"},{"key":"pcbi.1012086.ref056","doi-asserted-by":"crossref","DOI":"10.1155\/2020\/4348964","article-title":"Exploring a Novel Electrical-Modeling-Based Route Planning for Vehicle Guidance","volume":"2020","author":"RA Callejas-Molina","year":"2020","journal-title":"Mathematical Problems in Engineering"},{"issue":"22","key":"pcbi.1012086.ref057","doi-asserted-by":"crossref","first-page":"1960","DOI":"10.1049\/el:19951313","article-title":"Rapid path planning for robotic manipulators using an emulated resistive grid","volume":"31","author":"K Althofer","year":"1995","journal-title":"Electronics Letters"},{"issue":"9","key":"pcbi.1012086.ref058","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3390\/s21093274","article-title":"Exploring a novel multiple-query resistive grid-based planning method applied to high-DOF robotic manipulators","volume":"21","author":"J Huerta-Chua","year":"2021","journal-title":"Sensors"},{"issue":"4","key":"pcbi.1012086.ref059","first-page":"267","article-title":"Robot path planning using VLSI resistive grids","volume":"141","author":"GF Marshall","year":"1994","journal-title":"IEE Proceedings: Vision, Image and Signal Processing"},{"key":"pcbi.1012086.ref060","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1007\/978-3-319-46376-6_23","article-title":"Physical maze solvers. All twelve prototypes implement 1961 Lee algorithm","volume-title":"Emergent computation","author":"A Adamatzky","year":"2017"},{"key":"pcbi.1012086.ref061","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1007\/978-3-319-77510-4_16","article-title":"The Electron in the Maze","volume-title":"Shortest Path Solvers. From Software to Wetware, Emergence, Complexity and Computation 32","author":"S Ayrinhac","year":"2018"},{"issue":"6","key":"pcbi.1012086.ref062","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1085\/jgp.107.6.663","article-title":"The hippocampus as a cognitive graph","volume":"107","author":"RU Muller","year":"1996","journal-title":"The Journal of General Physiology"},{"issue":"6","key":"pcbi.1012086.ref063","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1007\/BF00209422","article-title":"A biologically inspired neural net for trajectory formation and obstacle avoidance","volume":"74","author":"R Glasius","year":"1996","journal-title":"Biological Cybernetics"},{"issue":"5","key":"pcbi.1012086.ref064","doi-asserted-by":"crossref","first-page":"e1002045","DOI":"10.1371\/journal.pcbi.1002045","article-title":"Spatial learning and action planning in a prefrontal cortical network model","volume":"7","author":"LE Martinet","year":"2011","journal-title":"PLoS Computational Biology"},{"issue":"2","key":"pcbi.1012086.ref065","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1007\/s00422-011-0454-6","article-title":"A computational model of the hippocampus that represents environmental structure and goal location, and guides movement","volume":"105","author":"J Matsumoto","year":"2011","journal-title":"Biological Cybernetics"},{"key":"pcbi.1012086.ref066","doi-asserted-by":"crossref","first-page":"RP84141","DOI":"10.7554\/eLife.84141.3","article-title":"Endotaxis: A neuromorphic algorithm for mapping, goal-learning, navigation, and patrolling","volume":"12","author":"T Zhang","year":"2024","journal-title":"Elife"},{"issue":"6","key":"pcbi.1012086.ref067","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1016\/j.neuron.2020.03.010","article-title":"Visualization of a distributed synaptic memory code in the Drosophila brain","volume":"106","author":"F Bilz","year":"2020","journal-title":"Neuron"},{"issue":"1","key":"pcbi.1012086.ref068","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1534\/g3.118.200726","article-title":"Nuclear transcriptomes of the seven neuronal cell types that constitute the Drosophila mushroom bodies","volume":"9","author":"MFM Shih","year":"2019","journal-title":"G3: Genes, Genomes, Genetics"},{"key":"pcbi.1012086.ref069","first-page":"415","volume-title":"Lecture Notes in Computer Science","author":"L Zhu","year":"2021"},{"key":"pcbi.1012086.ref070","doi-asserted-by":"crossref","first-page":"e56954","DOI":"10.7554\/eLife.56954","article-title":"Localized inhibition in the Drosophila mushroom body","volume":"9","author":"H Amin","year":"2020","journal-title":"Elife"},{"key":"pcbi.1012086.ref071","unstructured":"Jafari O, Maurya P, Nagarkar P, Islam KM, Crushev C. A survey on locality sensitive hashing algorithms and their applications. arXiv preprint arXiv:210208942. 2021;."},{"key":"pcbi.1012086.ref072","unstructured":"Schulman J, Wolski F, Dhariwal P, Radford A, Klimov O. Proximal Policy Optimization Algorithms. arXiv. 2017;."},{"key":"pcbi.1012086.ref073","article-title":"Dopamine signals integrate innate and learnt valences to regulate memory dynamics","author":"M Schnitzer","year":"2022","journal-title":"Research Square"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1012086","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,6,5]],"date-time":"2024-06-05T00:00:00Z","timestamp":1717545600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012086","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T21:59:21Z","timestamp":1732053561000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012086"}},"subtitle":[],"editor":[{"given":"Joseph","family":"Ayers","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,5,23]]},"references-count":73,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5,23]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012086","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1012086","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,23]]}}}