{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T22:01:19Z","timestamp":1769637679441,"version":"3.49.0"},"reference-count":54,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,8,5]],"date-time":"2023-08-05T00:00:00Z","timestamp":1691193600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>The use of back propagation through the time learning rule enabled the supervised training of deep spiking neural networks to process temporal neuromorphic data. However, their performance is still below non-spiking neural networks. Previous work pointed out that one of the main causes is the limited number of neuromorphic data currently available, which are also difficult to generate. With the goal of overcoming this problem, we explore the usage of auxiliary learning as a means of helping spiking neural networks to identify more general features. Tests are performed on neuromorphic DVS-CIFAR10 and DVS128-Gesture datasets. The results indicate that training with auxiliary learning tasks improves their accuracy, albeit slightly. Different scenarios, including manual and automatic combination losses using implicit differentiation, are explored to analyze the usage of auxiliary tasks.<\/jats:p>","DOI":"10.3390\/make5030052","type":"journal-article","created":{"date-parts":[[2023,8,5]],"date-time":"2023-08-05T10:25:36Z","timestamp":1691231136000},"page":"1010-1022","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Improving Spiking Neural Network Performance with Auxiliary Learning"],"prefix":"10.3390","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7362-279X","authenticated-orcid":false,"given":"Paolo G.","family":"Cachi","sequence":"first","affiliation":[{"name":"Department of Computer Science, Virginia Commonwealth University, Richomnd, VA 23220, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4216-6378","authenticated-orcid":false,"given":"Sebasti\u00e1n","family":"Ventura","sequence":"additional","affiliation":[{"name":"Department of Computing and Artificial Intelligence, Universidad de C\u00f3rdoba, 14071 C\u00f3rdoba, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Krzysztof J.","family":"Cios","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Virginia Commonwealth University, Richomnd, VA 23220, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1142\/S0129065709002002","article-title":"Spiking Neural Networks","volume":"19","author":"Adeli","year":"2009","journal-title":"Int. J. Neural Syst."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Gerstner, W., and Kistler, W.M. (2002). Spiking Neuron Models: Single Neurons, Populations, Plasticity, Cambridge University Press.","DOI":"10.1017\/CBO9780511815706"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1659","DOI":"10.1016\/S0893-6080(97)00011-7","article-title":"Networks of spiking neurons: The third generation of neural network models","volume":"10","author":"Maass","year":"1997","journal-title":"Neural Netw."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1186\/s40537-021-00444-8","article-title":"Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions","volume":"8","author":"Alzubaidi","year":"2021","journal-title":"J. Big Data"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4","DOI":"10.3389\/frai.2020.00004","article-title":"An Introductory Review of Deep Learning for Prediction Models with Big Data","volume":"3","author":"Yang","year":"2020","journal-title":"Front. Artif. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Orchard, G., Frady, E.P., Rubin, D.B.D., Sanborn, S., Shrestha, S.B., Sommer, F.T., and Davies, M. (2021, January 19\u201321). Efficient Neuromorphic Signal Processing with Loihi 2. Proceedings of the 2021 IEEE Workshop on Signal Processing Systems (SiPS), Coimbra, Portugal.","DOI":"10.1109\/SiPS52927.2021.00053"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1109\/JPROC.2021.3067593","article-title":"Advancing Neuromorphic Computing with Loihi: A Survey of Results and Outlook","volume":"109","author":"Davies","year":"2021","journal-title":"Proc. IEEE"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"044005","DOI":"10.1088\/2634-4386\/ac94f3","article-title":"Static hand gesture recognition for American sign language using neuromorphic hardware","volume":"2","author":"Mohammadi","year":"2022","journal-title":"Neuromorphic Comput. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"637","DOI":"10.3389\/fnins.2020.00637","article-title":"Hand-Gesture Recognition Based on EMG and Event-Based Camera Sensor Fusion: A Benchmark in Neuromorphic Computing","volume":"14","author":"Ceolini","year":"2020","journal-title":"Front. Neurosci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Buettner, K., and George, A.D. (2021, January 7\u20139). Heartbeat Classification with Spiking Neural Networks on the Loihi Neuromorphic Processor. Proceedings of the 2021 IEEE Computer Society Annual Symposium on VLSI (ISVLSI), Tampa, FL, USA.","DOI":"10.1109\/ISVLSI51109.2021.00035"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hajizada, E., Berggold, P., Iacono, M., Glover, A., and Sandamirskaya, Y. (2022, January 27\u201329). Interactive Continual Learning for Robots: A Neuromorphic Approach. Proceedings of the International Conference on Neuromorphic Systems, Knoxville, TN, USA.","DOI":"10.1145\/3546790.3546791"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Smith, J.D., Severa, W., Hill, A.J., Reeder, L., Franke, B., Lehoucq, R.B., Parekh, O.D., and Aimone, J.B. (2020, January 28\u201330). Solving a Steady-State PDE Using Spiking Networks and Neuromorphic Hardware. Proceedings of the International Conference on Neuromorphic Systems, Oak Ridge, TN, USA.","DOI":"10.1145\/3407197.3407202"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Avidan, S., Brostow, G., Ciss\u00e9, M., Farinella, G.M., and Hassner, T. (2022, January 23\u201327). Neuromorphic Data Augmentation for Training Spiking Neural Networks. Proceedings of the Computer Vision\u2014ECCV 2022: 17th European Conference, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19827-4"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yin, B., Corradi, F., and Boht\u00e9, S.M. (2020, January 28\u201330). Effective and Efficient Computation with Multiple-timescale Spiking Recurrent Neural Networks. Proceedings of the International Conference on Neuromorphic Systems, Oak Ridge, TN, USA.","DOI":"10.1145\/3407197.3407225"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"439","DOI":"10.3389\/fnins.2020.00439","article-title":"Efficient Processing of Spatio-Temporal Data Streams With Spiking Neural Networks","volume":"14","author":"Kugele","year":"2020","journal-title":"Front. Neurosci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2351","DOI":"10.1007\/s10462-021-10066-4","article-title":"A comprehensive survey of recent trends in deep learning for digital images augmentation","volume":"55","author":"Khalifa","year":"2022","journal-title":"Artif. Intell. Rev."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on Image Data Augmentation for Deep Learning","volume":"6","author":"Shorten","year":"2019","journal-title":"J. Big Data"},{"key":"ref_19","first-page":"7148","article-title":"Auxiliary Task Reweighting for Minimum-data Learning","volume":"33","author":"Shi","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_20","unstructured":"Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E., and Garnett, R. (2019, January 8\u201314). Self-Supervised Generalisation with Meta Auxiliary Learning. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_21","unstructured":"Du, Y., Czarnecki, W.M., Jayakumar, S.M., Farajtabar, M., Pascanu, R., and Lakshminarayanan, B. (2018). Adapting Auxiliary Losses Using Gradient Similarity. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fang, W., Yu, Z., Chen, Y., Masquelier, T., Huang, T., and Tian, Y. (2020, January 13\u201319). Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seattle, WA, USA.","DOI":"10.1109\/ICCV48922.2021.00266"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Schr\u00f6der, F., and Biemann, C. (2020, January 5\u201310). Estimating the influence of auxiliary tasks for multi-task learning of sequence tagging tasks. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Virtual Event.","DOI":"10.18653\/v1\/2020.acl-main.268"},{"key":"ref_24","unstructured":"Eshraghian, J.K., Ward, M., Neftci, E., Wang, X., Lenz, G., Dwivedi, G., Bennamoun, M., Jeong, D.S., and Lu, W.D. (2021). Training Spiking Neural Networks Using Lessons From Deep Learning. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.neunet.2018.12.002","article-title":"Deep learning in spiking neural networks","volume":"111","author":"Tavanaei","year":"2019","journal-title":"Neural Netw."},{"key":"ref_26","unstructured":"Wu, Y., Deng, L., Li, G., Zhu, J., Xie, Y., and Shi, L. (February, January 27). Direct Training for Spiking Neural Networks: Faster, Larger, Better. Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, Honolulu, HW, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"508","DOI":"10.3389\/fnins.2016.00508","article-title":"Training Deep Spiking Neural Networks Using Backpropagation","volume":"10","author":"Lee","year":"2016","journal-title":"Front. Neurosci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1007\/s00422-002-0353-y","article-title":"Mathematical formulations of Hebbian learning","volume":"87","author":"Gerstner","year":"2002","journal-title":"Biol. Cybern."},{"key":"ref_29","unstructured":"Hebb, D.O. (1949). The Organization of Behavior: A Neuropsychological Theory, Wiley."},{"key":"ref_30","unstructured":"Konorski, J. (1948). Conditioned Reflexes and Neuron Organization, Cambridge University Press."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"13326","DOI":"10.1523\/JNEUROSCI.6249-09.2010","article-title":"Functional requirements for reward-modulated spike-timing-dependent plasticity","volume":"30","author":"Sprekeler","year":"2010","journal-title":"J. Neurosci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1000180","article-title":"A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback","volume":"4","author":"Legenstein","year":"2008","journal-title":"PLoS Comput. Biol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"424","DOI":"10.3389\/fnins.2020.00424","article-title":"Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE)","volume":"14","author":"Kaiser","year":"2020","journal-title":"Front. Neurosci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1109\/MSP.2019.2931595","article-title":"Surrogate Gradient Learning in Spiking Neural Networks: Bringing the Power of Gradient-Based Optimization to Spiking Neural Networks","volume":"36","author":"Neftci","year":"2019","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_35","unstructured":"Shrestha, S.B., and Orchard, G. (2018). SLAYER: Spike Layer Error Reassignment in Time. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1162\/neco.2009.11-08-901","article-title":"Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting","volume":"22","author":"Ponulak","year":"2010","journal-title":"Neural Comput."},{"key":"ref_37","first-page":"101","article-title":"Comparison of supervised learning methods for spike time coding in spiking neural networks","volume":"16","author":"Nski","year":"2006","journal-title":"Int. J. Appl. Math. Comput. Sci."},{"key":"ref_38","first-page":"348","article-title":"A Focused Backpropagation Algorithm for Temporal Pattern Recognition","volume":"3","author":"Mozer","year":"1989","journal-title":"Complex Syst."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wang, Z., Dai, Z., P\u00f3czos, B., and Carbonell, J. (2018, January 18\u201323). Characterizing and Avoiding Negative Transfer. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2019.01155"},{"key":"ref_40","unstructured":"Standley, T., Zamir, A.R., Chen, D., Guibas, L., Malik, J., and Savarese, S. (2020, January 12\u201318). Which Tasks Should Be Learned Together in Multi-task Learning?. Proceedings of the 37th International Conference on Machine Learning, Virtual Event."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Gerstner, W., Kistler, W.M., Naud, R., and Paninski, L. (2014). Neuronal Dynamics: From Single Neurons to Networks and Models of Cognition, Cambridge University Press.","DOI":"10.1017\/CBO9781107447615"},{"key":"ref_42","unstructured":"Kandel, E.R., Schwartz, J.H., Jessell, T.M., Siegelbaum, S., and Hudspeth, A. (2013). Principles of Neural Science, McGraw-hill."},{"key":"ref_43","unstructured":"Navon, A., Achituve, I., Maron, H., Chechik, G., and Fetaya, E. (2020). Auxiliary Learning by Implicit Differentiation. arXiv."},{"key":"ref_44","unstructured":"Fang, W., Chen, Y., Ding, J., Chen, D., Yu, Z., Zhou, H., Masquelier, T., and Tian, Y. (2023, July 08). SpikingJelly. Available online: https:\/\/github.com\/fangwei123456\/spikingjelly."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"309","DOI":"10.3389\/fnins.2017.00309","article-title":"CIFAR10-DVS: An Event-Stream Dataset for Object Classification","volume":"11","author":"Li","year":"2017","journal-title":"Front. Neurosci."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Amir, A., Taba, B., Berg, D., Melano, T., McKinstry, J., Di Nolfo, C., Nayak, T., Andreopoulos, A., Garreau, G., and Mendoza, M. (2017, January 21\u201326). A Low Power, Fully Event-Based Gesture Recognition System. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.781"},{"key":"ref_47","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Zheng, H., Wu, Y., Deng, L., Hu, Y., and Li, G. (2020, January 7\u201312). Going Deeper With Directly-Trained Larger Spiking Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v35i12.17320"},{"key":"ref_49","first-page":"23426","article-title":"Differentiable Spike: Rethinking Gradient-Descent for Training Spiking Neural Networks","volume":"Volume 34","author":"Ranzato","year":"2021","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"ref_50","unstructured":"Na, B., Mok, J., Park, S., Lee, D., Choe, H., and Yoon, S. (2022, January 17\u201323). AutoSNN: Towards Energy-Efficient Spiking Neural Networks. Proceedings of the International Conference on Machine Learning, Baltimore, MD, USA."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Guo, Y., Tong, X., Chen, Y., Zhang, L., Liu, X., Ma, Z., and Huang, X. (2022, January 18\u201324). RecDis-SNN: Rectifying Membrane Potential Distribution for Directly Training Spiking Neural Networks. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00042"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Meng, Q., Xiao, M., Yan, S., Wang, Y., Lin, Z., and Luo, Z.Q. (2023, January 18\u201324). Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52688.2022.01212"},{"key":"ref_53","unstructured":"Zhou, Z., Zhu, Y., He, C., Wang, Y., YAN, S., Tian, Y., and Yuan, L. (2023, January 1\u20135). Spikformer: When Spiking Neural Network Meets Transformer. Proceedings of the Eleventh International Conference on Learning Representations, Kigali, Rwanda."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Shen, H., Luo, Y., Cao, X., Zhang, L., Xiao, J., and Wang, T. (2023, January 4\u201310). Training Stronger Spiking Neural Networks with Biomimetic Adaptive Internal Association Neurons. Proceedings of the ICASSP 2023\u20142023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.","DOI":"10.1109\/ICASSP49357.2023.10096958"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/5\/3\/52\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:26:29Z","timestamp":1760127989000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/5\/3\/52"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,5]]},"references-count":54,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["make5030052"],"URL":"https:\/\/doi.org\/10.3390\/make5030052","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,5]]}}}