{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:05:15Z","timestamp":1760101515828,"version":"3.37.3"},"reference-count":59,"publisher":"MIT Press","issue":"3","license":[{"start":{"date-parts":[[2025,1,9]],"date-time":"2025-01-09T00:00:00Z","timestamp":1736380800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,2,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Spiking neural networks (SNNs) have attracted significant interest in the development of brain-inspired computing systems due to their energy efficiency and similarities to biological information processing. In contrast to continuous-valued artificial neural networks, which produce results in a single step, SNNs require multiple steps during inference to achieve a desired accuracy level, resulting in a burden in real-time response and energy efficiency. Inspired by the tradeoff between speed and accuracy in human and animal decision-making processes, which exhibit correlations among reaction times, task complexity, and decision confidence, an inquiry emerges regarding how an SNN model can benefit by implementing these attributes. Here, we introduce a theory of decision making in SNNs by untangling the interplay between signal and noise. Under this theory, we introduce a new learning objective that trains an SNN not only to make the correct decisions but also to shape its confidence. Numerical experiments demonstrate that SNNs trained in this way exhibit improved confidence expression, reduced trial-to-trial variability, and shorter latency to reach the desired accuracy. We then introduce a stopping policy that can stop inference in a way that further enhances the time efficiency of SNNs. The stopping time can serve as an indicator to whether a decision is correct, akin to the reaction time in animal behavior experiments. By integrating stochasticity into decision making, this study opens up new possibilities to explore the capabilities of SNNs and advance SNNs and their applications in complex decision-making scenarios where model performance is limited.<\/jats:p>","DOI":"10.1162\/neco_a_01733","type":"journal-article","created":{"date-parts":[[2025,1,9]],"date-time":"2025-01-09T20:45:48Z","timestamp":1736455548000},"page":"481-521","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":2,"title":["Toward a Free-Response Paradigm of Decision Making in Spiking Neural Networks"],"prefix":"10.1162","volume":"37","author":[{"given":"Zhichao","family":"Zhu","sequence":"first","affiliation":[{"name":"Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China"},{"name":"Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Ministry of Education, 200433, China zachary_zhu@outlook.com"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Qi","sequence":"additional","affiliation":[{"name":"Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China, China"},{"name":"Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Ministry of Education, 200433, China"},{"name":"MOE Frontiers Center for Brain Science, Fudan University, Shanghai, 200433, China yang_qi@fudan.edu.cn"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenlian","family":"Lu","sequence":"additional","affiliation":[{"name":"Center for Applied Mathematics, Fudan University, Shanghai, 200438, China"},{"name":"School of Mathematical Sciences, Fudan University, Shanghai, 200433, China"},{"name":"Shanghai Center for Mathematical Sciences, Shanghai, 200438, China"},{"name":"Shanghai Key Laboratory for Contemporary Applied Mathematics, Shanghai, 200433, China"},{"name":"Key Laboratory of Mathematics for Nonlinear Science, Shanghai, 200433, China wenlian@fudan.edu.cn"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhigang","family":"Wang","sequence":"additional","affiliation":[{"name":"Intel Labs China, Beijing, 100190, China zhi.gang.wang@intel.com"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lu","family":"Cao","sequence":"additional","affiliation":[{"name":"Intel Labs China, Beijing, 100190, China lu.cao@outlook.com"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianfeng","family":"Feng","sequence":"additional","affiliation":[{"name":"Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China"},{"name":"Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Ministry of Education, 200433, China"},{"name":"MOE Frontiers Center for Brain Science, Fudan University, Shanghai, 200433, China"},{"name":"Zhangjiang Fudan International Innovation Center, Shanghai, 200433, China jffeng@fudan.edu.cn"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2025,2,14]]},"reference":[{"issue":"5","key":"2025021816410080200_bib1","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1038\/nrn1888","article-title":"Neural correlations, population coding and computation","volume":"7","author":"Averbeck","year":"2006","journal-title":"Nature Reviews Neuroscience"},{"issue":"1","key":"2025021816410080200_bib2","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1146\/annurev-neuro-120320-082744","article-title":"The geometry of information coding in correlated neural populations","volume":"44","author":"Azeredo da Silveira","year":"2021","journal-title":"Annual Review of Neuroscience"},{"issue":"1","key":"2025021816410080200_bib3","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1016\/j.neuron.2012.03.016","article-title":"Not noisy, just wrong: The role of suboptimal inference in behavioral variability","volume":"74","author":"Beck","year":"2012","journal-title":"Neuron"},{"issue":"1","key":"2025021816410080200_bib4","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-17236-y","article-title":"A solution to the learning dilemma for recurrent networks of spiking neurons","volume":"11","author":"Bellec","year":"2020","journal-title":"Nature Communications"},{"issue":"4","key":"2025021816410080200_bib5","doi-asserted-by":"publisher","first-page":"700","DOI":"10.1037\/0033-295x.113.4.700","article-title":"The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks","volume":"113","author":"Bogacz","year":"2006","journal-title":"Psychological Review"},{"issue":"1","key":"2025021816410080200_bib6","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.tins.2009.09.002","article-title":"The neural basis of the speed-accuracy tradeoff","volume":"33","author":"Bogacz","year":"2010","journal-title":"Trends in Neurosciences"},{"issue":"6","key":"2025021816410080200_bib7","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1007\/BF00288750","article-title":"Diffusion approximation and first passage time problem for a model neuron","volume":"8","author":"Capocelli","year":"1971","journal-title":"Kybernetik"},{"issue":"6","key":"2025021816410080200_bib8","doi-asserted-by":"publisher","first-page":"693","DOI":"10.1038\/nn.2123","article-title":"Decision-making with multiple alternatives","volume":"11","author":"Churchland","year":"2008","journal-title":"Nature Neuroscience"},{"issue":"1","key":"2025021816410080200_bib9","doi-asserted-by":"publisher","DOI":"10.1103\/physrevx.6.011017","article-title":"Maximal adaptive-decision speedups in quantum-state readout","volume":"6","author":"D\u2019Anjou","year":"2016","journal-title":"Physical Review X"},{"issue":"1","key":"2025021816410080200_bib10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.pneurobio.2009.01.006","article-title":"Stochastic dynamics as a principle of brain function","volume":"88","author":"Deco","year":"2009","journal-title":"Progress in Neurobiology"},{"key":"2025021816410080200_bib11","doi-asserted-by":"publisher","DOI":"10.1109\/cvpr.2009.5206848","article-title":"ImageNet: A large-scale hierarchical image database","author":"Deng","year":"2009","journal-title":"Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"2025021816410080200_bib12","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1016\/j.neunet.2019.09.005","article-title":"Rethinking the performance comparison between SNNs and ANNs","volume":"121","author":"Deng","year":"2020","journal-title":"Neural Networks"},{"journal-title":"Temporal efficient training of spiking neural network via gradient re-weighting","year":"2022","author":"Deng","key":"2025021816410080200_bib13"},{"issue":"99","key":"2025021816410080200_bib14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/tai.2024.3374268","article-title":"Temporal knowledge sharing enable spiking neural network learning from past and future","volume":"PP","author":"Dong","year":"2024","journal-title":"IEEE Transactions on Artificial Intelligence"},{"issue":"8","key":"2025021816410080200_bib15","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recognition Letters"},{"key":"2025021816410080200_bib16","doi-asserted-by":"publisher","DOI":"10.1103\/physreve.73.041906","article-title":"Dynamics of moment neuronal networks","volume":"73","author":"Feng","year":"2006","journal-title":"Physical Review E"},{"issue":"S1","key":"2025021816410080200_bib17","doi-asserted-by":"publisher","first-page":"1513","DOI":"10.1007\/s10462-023-10562-9","article-title":"A survey of uncertainty in deep neural networks","volume":"56","author":"Gawlikowski","year":"2023","journal-title":"Artificial Intelligence Review"},{"issue":"1","key":"2025021816410080200_bib18","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1146\/annurev.neuro.29.051605.113038","article-title":"The neural basis of decision making","volume":"30","author":"Gold","year":"2007","journal-title":"Annual Review of Neuroscience"},{"issue":"1","key":"2025021816410080200_bib19","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-024-44880-5","article-title":"Trial-history biases in evidence accumulation can give rise to apparent lapses in decision-making","volume":"15","author":"Gupta","year":"2024","journal-title":"Nature Communications"},{"issue":"3","key":"2025021816410080200_bib20","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1016\/j.neuron.2016.03.020","article-title":"Perceptual decision-making as probabilistic inference by neural sampling","volume":"90","author":"Haefner","year":"2016","journal-title":"Neuron"},{"issue":"1","key":"2025021816410080200_bib21","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1609\/aaai.v37i1.25071","article-title":"Reducing ANN-SNN conversion error through residual membrane potential","volume":"37","author":"Hao","year":"2023","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"2025021816410080200_bib22","article-title":"Interpreting neural response variability as Monte Carlo sampling of the posterior","volume-title":"Advances in neural information processing systems","author":"Hoyer","year":"2002"},{"issue":"1594","key":"2025021816410080200_bib23","doi-asserted-by":"publisher","first-page":"1322","DOI":"10.1098\/rstb.2012.0037","article-title":"A computational framework for the study of confidence in humans and animals","volume":"367","author":"Kepecs","year":"2012","journal-title":"Philosophical Transactions of the Royal Society B: Biological Sciences"},{"issue":"7210","key":"2025021816410080200_bib24","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1038\/nature07200","article-title":"Neural correlates, computation and behavioural impact of decision confidence","volume":"455","author":"Kepecs","year":"2008","journal-title":"Nature"},{"issue":"6","key":"2025021816410080200_bib25","doi-asserted-by":"publisher","first-page":"1329","DOI":"10.1016\/j.neuron.2014.12.015","article-title":"Choice certainty is informed by both evidence and decision time","volume":"84","author":"Kiani","year":"2014","journal-title":"Neuron"},{"volume-title":"Learning multiple layers of features from tiny images","year":"2009","author":"Krizhevsky","key":"2025021816410080200_bib26"},{"issue":"7553","key":"2025021816410080200_bib27","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"issue":"11","key":"2025021816410080200_bib28","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proceedings of the IEEE"},{"issue":"10","key":"2025021816410080200_bib29","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003859","article-title":"Ensembles of spiking neurons with noise support optimal probabilistic inference in a dynamically changing environment","volume":"10","author":"Legenstein","year":"2014","journal-title":"PLOS Computational Biology"},{"key":"2025021816410080200_bib30","first-page":"13350","article-title":"Unleashing the potential of spiking neural networks with dynamic confidence","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Li","year":"2023"},{"issue":"6","key":"2025021816410080200_bib31","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1109\/JPROC.2024.3429360","article-title":"Brain inspired computing: A systematic survey and future trends","volume":"112","author":"Li","year":"2024","journal-title":"Proceedings of the IEEE"},{"issue":"1","key":"2025021816410080200_bib32","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-15581-6","article-title":"Confidence reports in decision-making with multiple alternatives violate the Bayesian confidence hypothesis","volume":"11","author":"Li","year":"2020","journal-title":"Nature Communications"},{"journal-title":"Converting artificial neural networks to spiking neural networks via parameter calibration","year":"2022","author":"Li","key":"2025021816410080200_bib33"},{"key":"2025021816410080200_bib34","article-title":"SEENN: Towards temporal spiking early exit neural networks","volume-title":"Advances in neural information processing systems","author":"Li","year":"2024"},{"issue":"3","key":"2025021816410080200_bib35","doi-asserted-by":"publisher","first-page":"913","DOI":"10.1016\/j.neuroimage.2010.02.075","article-title":"On a gaussian neuronal field model","volume":"52","author":"Lu","year":"2010","journal-title":"NeuroImage"},{"issue":"9","key":"2025021816410080200_bib36","doi-asserted-by":"publisher","first-page":"1659","DOI":"10.1016\/s0893-6080(97)00011-7","article-title":"Networks of spiking neurons: The third generation of neural network models","volume":"10","author":"Maass","year":"1997","journal-title":"Neural Networks"},{"issue":"1","key":"2025021816410080200_bib37","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1146\/annurev-vision-111815-114630","article-title":"Visual confidence","volume":"2","author":"Mamassian","year":"2016","journal-title":"Annual Review of Vision Science"},{"issue":"11","key":"2025021816410080200_bib38","doi-asserted-by":"publisher","first-page":"1257","DOI":"10.1093\/cercor\/bhg097","article-title":"A role for neural integrators in perceptual decision making","volume":"13","author":"Mazurek","year":"2003","journal-title":"Cerebral Cortex"},{"issue":"6","key":"2025021816410080200_bib39","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1109\/msp.2019.2931595","article-title":"Surrogate gradient learning in spiking neural networks: Bringing the power of gradient-based optimization to spiking neural networks","volume":"36","author":"Neftci","year":"2019","journal-title":"IEEE Signal Processing Magazine"},{"issue":"5","key":"2025021816410080200_bib40","doi-asserted-by":"publisher","DOI":"10.1167\/5.5.1","article-title":"The effect of stimulus strength on the speed and accuracy of a perceptual decision","volume":"5","author":"Palmer","year":"2005","journal-title":"Journal of Vision"},{"issue":"9","key":"2025021816410080200_bib41","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1038\/s41583-022-00606-4","article-title":"The structures and functions of correlations in neural population codes","volume":"23","author":"Panzeri","year":"2022","journal-title":"Nature Reviews Neuroscience"},{"key":"2025021816410080200_bib42","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2018.00774","article-title":"Deep learning with spiking neurons: Opportunities and challenges","volume":"12","author":"Pfeiffer","year":"2018","journal-title":"Frontiers in Neuroscience"},{"key":"2025021816410080200_bib43","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-2341-0","volume-title":"An introduction to signal detection and estimation","author":"Poor","year":"1994"},{"issue":"3","key":"2025021816410080200_bib44","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1038\/nn.4240","article-title":"Confidence and certainty: Distinct probabilistic quantities for different goals","volume":"19","author":"Pouget","year":"2016","journal-title":"Nature Neuroscience"},{"issue":"2","key":"2025021816410080200_bib45","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.110.024310","article-title":"Moment neural network and an efficient numerical method for modeling irregular spiking activity","volume":"110","author":"Qi","year":"2024","journal-title":"Physical Review E"},{"journal-title":"Toward spike-based stochastic neural computing","year":"2023","author":"Qi","key":"2025021816410080200_bib46"},{"issue":"4","key":"2025021816410080200_bib47","doi-asserted-by":"publisher","first-page":"873","DOI":"10.1162\/neco.2008.12-06-420","article-title":"The diffusion decision model: Theory and data for two-choice decision tasks","volume":"20","author":"Ratcliff","year":"2008","journal-title":"Neural Computation"},{"issue":"2","key":"2025021816410080200_bib48","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1037\/0033-295x.111.2.333","article-title":"A comparison of sequential sampling models for two-choice reaction time","volume":"111","author":"Ratcliff","year":"2004","journal-title":"Psychological Review"},{"issue":"7784","key":"2025021816410080200_bib49","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1038\/s41586-019-1677-2","article-title":"Towards spike-based machine intelligence with neuromorphic computing","volume":"575","author":"Roy","year":"2019","journal-title":"Nature"},{"key":"2025021816410080200_bib50","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2017.00682","article-title":"Conversion of continuous-valued deep networks to efficient event-driven networks for image classification","volume":"11","author":"Rueckauer","year":"2017","journal-title":"Frontiers in Neuroscience"},{"key":"2025021816410080200_bib51","article-title":"Spatio-temporal representations of uncertainty in spiking neural networks","volume-title":"Advances in neural information processing systems","author":"Savin","year":"2014"},{"key":"2025021816410080200_bib52","article-title":"Slayer: Spike layer error reassignment in time","volume-title":"Advances in neural information processing system","author":"Shrestha","year":"2018"},{"issue":"2","key":"2025021816410080200_bib53","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/0001-6918(82)90006-3","article-title":"Effects of alternating set for speed or accuracy on response time, accuracy and confidence in a unidimensional discrimination task","volume":"50","author":"Vickers","year":"1982","journal-title":"Acta Psychologica"},{"volume-title":"Sequential analysis","year":"1973","author":"Wald","key":"2025021816410080200_bib54"},{"issue":"7972","key":"2025021816410080200_bib55","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1038\/s41586-023-06221-2","article-title":"Scientific discovery in the age of artificial intelligence","volume":"620","author":"Wang","year":"2023","journal-title":"Nature"},{"key":"2025021816410080200_bib56","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2018.00331","article-title":"Spatio-temporal backpropagation for training high-performance spiking neural networks","volume":"12","author":"Wu","year":"2018","journal-title":"Frontiers in Neuroscience"},{"issue":"1","key":"2025021816410080200_bib57","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-27653-2","article-title":"Brain-inspired global-local learning incorporated with neuromorphic computing","volume":"13","author":"Wu","year":"2022","journal-title":"Nature Communications"},{"article-title":"Fashion-mnist: A novel image dataset for benchmarking machine learning algorithms","year":"2017","author":"Xiao","key":"2025021816410080200_bib58"},{"issue":"1","key":"2025021816410080200_bib59","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-023-41743-3","article-title":"Sampling-based Bayesian inference in recurrent circuits of stochastic spiking neurons","volume":"14","author":"Zhang","year":"2023","journal-title":"Nature Communications"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/37\/3\/481\/2497061\/neco_a_01733.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/37\/3\/481\/2497061\/neco_a_01733.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,18]],"date-time":"2025-02-18T16:41:46Z","timestamp":1739896906000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/37\/3\/481\/127433\/Toward-a-Free-Response-Paradigm-of-Decision-Making"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,14]]},"references-count":59,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,2,14]]},"published-print":{"date-parts":[[2025,2,14]]}},"URL":"https:\/\/doi.org\/10.1162\/neco_a_01733","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"type":"print","value":"0899-7667"},{"type":"electronic","value":"1530-888X"}],"subject":[],"published-other":{"date-parts":[[2025,3]]},"published":{"date-parts":[[2025,2,14]]}}}