{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,1]],"date-time":"2026-03-01T05:16:42Z","timestamp":1772342202295,"version":"3.50.1"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,11,5]],"date-time":"2021-11-05T00:00:00Z","timestamp":1636070400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,11,5]],"date-time":"2021-11-05T00:00:00Z","timestamp":1636070400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Brain Inf."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Quickly and accurately tracing neuronal morphologies in large-scale volumetric microscopy data is a very challenging task. Most automatic algorithms for tracing multi-neuron in a whole brain are designed under the Ultra-Tracer framework, which begins the tracing of a neuron from its soma and traces all signals via a block-by-block strategy. Some neuron image blocks are easy for tracing and their automatic reconstructions are very accurate, and some others are difficult and their automatic reconstructions are inaccurate or incomplete. The former are called low Tracing Difficulty Blocks (low-TDBs), while the latter are called high Tracing Difficulty Blocks (high-TDBs). We design a model named 3D-SSM to classify the tracing difficulty of 3D neuron image blocks, which is based on 3D Residual neural Network (3D-ResNet), Fully Connected Neural Network (FCNN) and Long Short-Term Memory network (LSTM). 3D-SSM contains three modules: Structure Feature Extraction (SFE), Sequence Information Extraction (SIE) and Model Fusion (MF). SFE utilizes a 3D-ResNet and a FCNN to extract two kinds of features in 3D image blocks and their corresponding automatic reconstruction blocks. SIE uses two LSTMs to learn sequence information hidden in 3D image blocks. MF adopts a concatenation operation and a FCNN to combine outputs from SIE. 3D-SSM can be used as a stop condition of an automatic tracing algorithm in the Ultra-Tracer framework. With its help, neuronal signals in low-TDBs can be traced by the automatic algorithm and in high-TDBs may be reconstructed by annotators. 12732 training samples and 5342 test samples are constructed on neuron images of a whole mouse brain. The 3D-SSM achieves classification accuracy rates 87.04% on the training set and 84.07% on the test set. Furthermore, the trained 3D-SSM is tested on samples from another whole mouse brain and its accuracy rate is 83.21%.<\/jats:p>","DOI":"10.1186\/s40708-021-00146-0","type":"journal-article","created":{"date-parts":[[2021,11,5]],"date-time":"2021-11-05T12:02:40Z","timestamp":1636113760000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Classifying the tracing difficulty of 3D neuron image blocks based on deep learning"],"prefix":"10.1186","volume":"8","author":[{"given":"Bin","family":"Yang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiajin","family":"Huang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gaowei","family":"Wu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8922-7687","authenticated-orcid":false,"given":"Jian","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,11,5]]},"reference":[{"issue":"7","key":"146_CR1","doi-asserted-by":"publisher","first-page":"693","DOI":"10.1002\/cyto.a.20895","volume":"77","author":"E Meijering","year":"2010","unstructured":"Meijering E (2010) Neuron tracing in perspective. Cytom Part A 77(7):693\u2013704","journal-title":"Cytom Part A"},{"key":"146_CR2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/10292.001.0001","volume-title":"Trees of the brain roots of the mind","author":"GA Ascoli","year":"2015","unstructured":"Ascoli GA (2015) Trees of the brain roots of the mind. MIT Press, Cambridge"},{"issue":"6","key":"146_CR3","doi-asserted-by":"publisher","first-page":"1017","DOI":"10.1016\/j.neuron.2013.03.008","volume":"77","author":"R Parekh","year":"2013","unstructured":"Parekh R, Ascoli GA (2013) Neuronal morphology goes digital: a research hub for cellular and system neuroscience. Neuron 77(6):1017\u20131038","journal-title":"Neuron"},{"key":"146_CR4","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1038\/nprot.2014.011","volume":"9","author":"H Peng","year":"2014","unstructured":"Peng H, Bria A, Zhou Z, Iannello G, Long F (2014) Extensible visualization and analysis for multidimensional images using Vaa3D. Nat Protoc 9:193\u2013208","journal-title":"Nat Protoc"},{"issue":"2","key":"146_CR5","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1016\/j.neuron.2015.06.036","volume":"87","author":"H Peng","year":"2015","unstructured":"Peng H, Hawrylycz M, Roskams J, Hill S, Spruston N, Meijering E, Ascoli GA (2015) BigNeuron: large-scale 3D neuron reconstruction from optical microscopy images. Neuron 87(2):252\u2013256","journal-title":"Neuron"},{"issue":"6009","key":"146_CR6","doi-asserted-by":"publisher","first-page":"1404","DOI":"10.1126\/science.1191776","volume":"330","author":"A Li","year":"2010","unstructured":"Li A, Gong H, Zhang B, Wang Q, Yan C, Wu J, Liu Q, Zeng S, Luo Q (2010) Micro-optical sectioning tomography to obtain a high-resolution atlas of the mouse brain. Science 330(6009):1404\u20131408","journal-title":"Science"},{"issue":"2","key":"146_CR7","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1073\/pnas.1703601115","volume":"115","author":"X Li","year":"2018","unstructured":"Li X, Yu B, Sun Q, Zhang Y, Ren M, Zhang X, Li A, Yuan J, Madisen L, Luo Q, Zeng H, Gong H, Qiu Z (2018) Generation of a whole-brain atlas for the cholinergic system and mesoscopic projectome analysis of basal forebrain cholinergic neurons. Proc Natl Acad Sci U S A 115(2):415\u2013420","journal-title":"Proc Natl Acad Sci U S A"},{"key":"146_CR8","doi-asserted-by":"crossref","unstructured":"Bria A, Iannello G, Peng H (2015) An open-source Vaa3D plugin for real-time 3D visualization of terabyte-sized volumetric images. In: Proceedings of the IEEE International Symposium on Biomedical Imaging (ISBI), pp. 520\u2013523","DOI":"10.1109\/ISBI.2015.7163925"},{"key":"146_CR9","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1038\/nmeth.4233","volume":"14","author":"H Peng","year":"2017","unstructured":"Peng H, Zhou Z, Meijering E, Zhao T, Ascoli GA, Hawrylycz M (2017) Automatic tracing of ultra-volumes of neuronal images. Nat Methods 14:332\u2013333","journal-title":"Nat Methods"},{"key":"146_CR10","unstructured":"Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations (ICLR) . arXiv:1409.1556"},{"key":"146_CR11","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1\u20139","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"146_CR12","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"146_CR13","doi-asserted-by":"crossref","unstructured":"Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3431\u20133440","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"146_CR14","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings of the International Conference on Medical Image Computing and Computer-assisted Intervention (MICCAI), pp. 234\u2013241","DOI":"10.1007\/978-3-319-24574-4_28"},{"issue":"4","key":"146_CR15","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","volume":"40","author":"L-C Chen","year":"2018","unstructured":"Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2018) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell 40(4):834\u2013848","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"6","key":"146_CR16","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","volume":"39","author":"S Ren","year":"2017","unstructured":"Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137\u20131149","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"146_CR17","doi-asserted-by":"crossref","unstructured":"Liu W, Anguelov D, Erhan D, Szegedy C, Reed SE, Fu C-Y, Berg AC (2016) SSD: single shot multibox detector. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 21\u201337","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"146_CR18","unstructured":"Bochkovskiy A, Wang C-Y, Liao H-YM (2020) Yolov4: optimal speed and accuracy of object detection. arXiv:2004.10934"},{"key":"146_CR19","doi-asserted-by":"crossref","unstructured":"Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) ImageNet: a large-scale hierarchical image database. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 248\u2013255","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"146_CR20","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2818\u20132826","DOI":"10.1109\/CVPR.2016.308"},{"issue":"2","key":"146_CR21","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1186\/s40708-018-0081-2","volume":"5","author":"Z Zhou","year":"2018","unstructured":"Zhou Z, Kuo H-C, Peng H, Long F (2018) DeepNeuron: an open deep learning toolbox for neuron tracing. Brain Inform 5(2):3","journal-title":"Brain Inform"},{"issue":"2","key":"146_CR22","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1109\/TMI.2020.3031289","volume":"40","author":"W Chen","year":"2021","unstructured":"Chen W, Liu M, Zhan Q, Tan Y, Meijering E, Radojevi\u0107 M, Wang Y (2021) Spherical-patches extraction for deep-learning-based critical points detection in 3D neuron microscopy images. IEEE Trans Med Imaging 40(2):527\u2013538","journal-title":"IEEE Trans Med Imaging"},{"key":"146_CR23","doi-asserted-by":"crossref","unstructured":"Liu M, Luo H, Tan Y, Wang X, Chen W (2018) Improved V-Net based image segmentation for 3D neuron reconstruction. In: Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 443\u2013448","DOI":"10.1109\/BIBM.2018.8621126"},{"key":"146_CR24","unstructured":"Shi X, Chen Z, Wang H, Yeung D-Y, Wong W-K, Woo W-C (2015) Convolutional LSTM network: a machine learning approach for precipitation nowcasting. In: Proceedings of the Advances in Neural Information Processing Systems (NIPS), pp. 802\u2013810"},{"issue":"1","key":"146_CR25","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1109\/TMI.2020.3021493","volume":"40","author":"Y Jiang","year":"2021","unstructured":"Jiang Y, Chen W, Liu M, Wang Y, Meijering E (2021) 3D neuron microscopy image segmentation via the ray-shooting model and a DC-BLSTM network. IEEE Trans Med Imaging 40(1):26\u201337","journal-title":"IEEE Trans Med Imaging"},{"issue":"1","key":"146_CR26","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1207\/s15516709cog0901_7","volume":"9","author":"DH Ackley","year":"1985","unstructured":"Ackley DH, Hinton GE, Sejnowski TJ (1985) A learning algorithm for boltzmann machines. Cogn Sci 9(1):147\u2013169","journal-title":"Cogn Sci"},{"key":"146_CR27","doi-asserted-by":"publisher","first-page":"866","DOI":"10.1038\/nprot.2008.51","volume":"3","author":"R Scorcioni","year":"2008","unstructured":"Scorcioni R, Polavaram S, Ascoli GA (2008) L-Measure: a web-accessible tool for the analysis, comparison and search of digital reconstructions of neuronal morphologies. Nat Protoc 3:866\u2013876","journal-title":"Nat Protoc"},{"key":"146_CR28","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1007\/s12021-018-9392-y","volume":"17","author":"J Yang","year":"2019","unstructured":"Yang J, Hao M, Liu X, Wan Z, Zhong N, Peng H (2019) FMST: an automatic neuron tracing method based on fast marching and minimum spanning tree. Neuroinformatics 17:185\u2013196","journal-title":"Neuroinformatics"},{"issue":"1\u20132","key":"146_CR29","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1016\/S0165-0270(98)00091-0","volume":"84","author":"R Cannon","year":"1998","unstructured":"Cannon R, Turner D, Pyapali G, Wheal H (1998) An on-line archive of reconstructed hippocampal neurons. J Neurosci Methods 84(1\u20132):49\u201354","journal-title":"J Neurosci Methods"},{"issue":"11","key":"146_CR30","doi-asserted-by":"publisher","first-page":"1448","DOI":"10.1093\/bioinformatics\/btt170","volume":"29","author":"H Xiao","year":"2013","unstructured":"Xiao H, Peng H (2013) APP2: automatic tracing of 3D neuron morphology based on hierarchical pruning of a gray-weighted image distance-tree. Bioinformatics 29(11):1448\u20131454","journal-title":"Bioinformatics"},{"key":"146_CR31","unstructured":"Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, Lin Z, Desmaison A, Antiga L, Lerer A (2017) Automatic differentiation in PyTorch. In: NIPS 2017 Workshop on Autodiff. https:\/\/openreview.net\/forum?id=BJJsrmfCZ"},{"key":"146_CR32","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825\u20132830","journal-title":"J Mach Learn Res"},{"key":"146_CR33","doi-asserted-by":"crossref","unstructured":"Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L-C (2018) MobileNetV2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4510\u20134520","DOI":"10.1109\/CVPR.2018.00474"},{"key":"146_CR34","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Van Der\u00a0Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2261\u20132269","DOI":"10.1109\/CVPR.2017.243"},{"key":"146_CR35","doi-asserted-by":"crossref","unstructured":"Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H, Wang X, Tang X (2017) Residual attention network for image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6450\u20136458","DOI":"10.1109\/CVPR.2017.683"},{"key":"146_CR36","unstructured":"Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: International Conference on Learning Representations (ICLR) . arXiv:1412.6980"}],"container-title":["Brain Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40708-021-00146-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40708-021-00146-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40708-021-00146-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,5]],"date-time":"2021-11-05T12:09:16Z","timestamp":1636114156000},"score":1,"resource":{"primary":{"URL":"https:\/\/braininformatics.springeropen.com\/articles\/10.1186\/s40708-021-00146-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,5]]},"references-count":36,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["146"],"URL":"https:\/\/doi.org\/10.1186\/s40708-021-00146-0","relation":{},"ISSN":["2198-4018","2198-4026"],"issn-type":[{"value":"2198-4018","type":"print"},{"value":"2198-4026","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,5]]},"assertion":[{"value":"25 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 October 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 November 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"This paper has the consent for publication from all authors.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"25"}}