{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T08:53:18Z","timestamp":1765356798628,"version":"3.37.3"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"15","license":[{"start":{"date-parts":[[2020,10,23]],"date-time":"2020-10-23T00:00:00Z","timestamp":1603411200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,23]],"date-time":"2020-10-23T00:00:00Z","timestamp":1603411200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper proposes an improved brain tumor segmentation method based on visual saliency features on MRI image volumes. The proposed method introduces a novel combination of multiple MRI modalities used as pseudo-color channels for highlighting the potential tumors. The novel pseudo-color model incorporates healthy templates generated from the MRI slices without tumors. The constructed healthy templates are also used during the training of neural network models. Based on a saliency map built using the pseudo-color templates, combination models are proposed, fusing the saliency map with convolutional neural networks\u2019 prediction maps to improve predictions and to reduce the networks\u2019 eventual overfitting which may result in weaker predictions for previously unseen cases. By introducing the combination technique for deep learning techniques and saliency-based, handcrafted feature models, the fusion approach shows good abstraction capabilities and it is able to handle diverse cases that the networks were less trained for. The proposed methods were tested on the BRATS2015 and BRATS2018 databases, and the quantitative results show that hybrid models (including both trained and handcrafted features) can be promising alternatives for reaching higher segmentation performance. Moreover, healthy templates can provide additional information for the training process, enhancing the prediction performance of neural network models.<\/jats:p>","DOI":"10.1007\/s11042-020-09871-w","type":"journal-article","created":{"date-parts":[[2020,10,23]],"date-time":"2020-10-23T07:02:52Z","timestamp":1603436572000},"page":"22533-22550","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A fusion of salient and convolutional features applying healthy templates for MRI brain tumor segmentation"],"prefix":"10.1007","volume":"80","author":[{"given":"Petra","family":"Tak\u00e1cs","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Levente","family":"Kov\u00e1cs","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9392-379X","authenticated-orcid":false,"given":"Andrea","family":"Manno-Kovacs","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,10,23]]},"reference":[{"key":"9871_CR1","doi-asserted-by":"crossref","unstructured":"Agn M, Puonti O, Law I, af Rosensch\u00f6ld P, van Leemput K (2015) Brain tumor segmentation by a generative model with a prior on tumor shape. Proceeding of the Multimodal Brain Tumor Image Segmentation Challenge, pp 1\u20134","DOI":"10.1007\/978-3-319-30858-6_15"},{"key":"9871_CR2","doi-asserted-by":"crossref","unstructured":"Bakas S, Zeng K, Sotiras A, Rathore S, Akbari H, Gaonkar B, Rozycki M, Pati S, Davazikos C (2015) Segmentation of gliomas in multimodal magnetic resonance imaging volumes based on a hybrid generative-discriminative framework. Proceeding of the Multimodal Brain Tumor Image Segmentation Challenge, pp 5\u201312","DOI":"10.1007\/978-3-319-55524-9_18"},{"key":"9871_CR3","unstructured":"Bakas S, Akbari H, Sotiras A, Bilello M, Rozycki M, Kirby J, Freymann J, Farahani K, Davatzikos C (2017) Segmentation labels and radiomic features for the pre-operative scans of the tcga-lgg collection. The Cancer Imaging Archive, pp 286"},{"key":"9871_CR4","doi-asserted-by":"publisher","first-page":"170117","DOI":"10.1038\/sdata.2017.117","volume":"4","author":"S Bakas","year":"2017","unstructured":"Bakas S, Akbari H, Sotiras A, Bilello M, Rozycki M, Kirby J, Freymann JB, Farahani K, Davatzikos C (2017) Advancing the cancer genome atlas glioma mri collections with expert segmentation labels and radiomic features. Sci Data 4:170117","journal-title":"Sci Data"},{"key":"9871_CR5","doi-asserted-by":"crossref","unstructured":"Banerjee S, Mitra S, Shankar BU, Hayashi Y (2016) A novel GBM saliency detection model using multi-channel MRI. Plos one 11(1):e0146388","DOI":"10.1371\/journal.pone.0146388"},{"key":"9871_CR6","doi-asserted-by":"crossref","unstructured":"Bauer S, Nolte LP, Reyes M (2011) Fully automatic segmentation of brain tumor images using support vector machine classification in combination with hierarchical conditional random field regularization. In: International conference on medical image computing and computer-assisted intervention, pp 354\u2013361","DOI":"10.1007\/978-3-642-23626-6_44"},{"key":"9871_CR7","doi-asserted-by":"crossref","unstructured":"Gibson E, Li W, Sudre C, Fidon L, Shakir DI, Wang G, Eaton-Rosen Z, Gray R, Doel T, Hu Y, Whyntie T, Nachev P, Modat M, Barratt DC, Ourselin S, Cardoso MJ, Vercauteren T (2018) Niftynet: a deep-learning platform for medical imaging. Comput Methods Program Biomed 158:113\u2013122","DOI":"10.1016\/j.cmpb.2018.01.025"},{"key":"9871_CR8","unstructured":"Guotai W, Wenqi L, Sebastien O, Tom V (2018) Automatic brain tumor segmentation using cascaded anisotropic convolutional neural networks. In: Brainlesion: glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. Springer, pp 179\u2013190"},{"issue":"6","key":"9871_CR9","doi-asserted-by":"publisher","first-page":"683","DOI":"10.1097\/00019052-200112000-00002","volume":"14","author":"EC Holland","year":"2001","unstructured":"Holland EC (2001) Progenitor cells and glioma formation. Curr Opin Neurol 14(6):683\u2013688","journal-title":"Curr Opin Neurol"},{"key":"9871_CR10","doi-asserted-by":"crossref","unstructured":"Isensee F, Kickingereder P, Wick W, Bendszus M, Maier-Hein KH (2018) Brain tumor segmentation and radiomics survival prediction: Contribution to the brats 2017 challenge. In: Brainlesion: glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, pp 287\u2013297","DOI":"10.1007\/978-3-319-75238-9_25"},{"issue":"11","key":"9871_CR11","doi-asserted-by":"publisher","first-page":"1254","DOI":"10.1109\/34.730558","volume":"20","author":"L Itti","year":"1998","unstructured":"Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254\u20131259","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"9871_CR12","doi-asserted-by":"crossref","unstructured":"Kamnitsas K, Ledig C, Newcombe VFJ, Simpson JP, Kane AD, Menon DK, Rueckert D, Glocker B (2017) Efficient multi-scale 3d cnn with fully connected crf for accurate brain lesion segmentation. Med Image Anal 36:61\u201378","DOI":"10.1016\/j.media.2016.10.004"},{"key":"9871_CR13","unstructured":"Kayalibay B, Jensen G, van der Smagt P (2017) CNN-based Segmentation of Medical Imaging Data. arXiv:1701.03056"},{"key":"9871_CR14","doi-asserted-by":"crossref","unstructured":"Koch C, Ullman S (1987) Shifts in selective visual attention: towards the underlying neural circuitry. In: Matters of intelligence. Springer, pp 115\u2013141","DOI":"10.1007\/978-94-009-3833-5_5"},{"issue":"1","key":"9871_CR15","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1109\/TMI.2003.809072","volume":"22","author":"D Mattes","year":"2003","unstructured":"Mattes D, Haynor DR, Vesselle H, Lewellen TK, Eubank W (2003) Pet-ct image registration in the chest using free-form deformations. IEEE Trans Med Imaging 22(1):120\u2013128","journal-title":"IEEE Trans Med Imaging"},{"key":"9871_CR16","doi-asserted-by":"crossref","unstructured":"Mehmood I, Sajjad M, Muhammad K, Shah SIA, Sangaiah AK, Shoaib M, Baik SW (2018) An efficient computerized decision support system for the analysis and 3d visualization of brain tumor. Multimedia Tools and Applications, pp 1\u201326","DOI":"10.1007\/s11042-018-6027-0"},{"issue":"10","key":"9871_CR17","doi-asserted-by":"publisher","first-page":"1993","DOI":"10.1109\/TMI.2014.2377694","volume":"34","author":"BH Menze","year":"2015","unstructured":"Menze BH, Jakab A, Bauer S, Kalpathy-Cramer J, Farahani K, Kirby J, Burren Y, Porz N, Slotboom J, Wiest R et al (2015) The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 34(10):1993\u20132024","journal-title":"IEEE Trans Med Imaging"},{"key":"9871_CR18","doi-asserted-by":"crossref","unstructured":"Pereira S, Pinto A, Alves V, Silva CA (2015) Deep convolutional neural networks for the segmentation of gliomas in multi-sequence MRI. In: International workshop on brainlesion: glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. Springer, pp 131\u2013143","DOI":"10.1007\/978-3-319-30858-6_12"},{"issue":"3","key":"9871_CR19","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/j.media.2004.06.007","volume":"8","author":"M Prastawa","year":"2004","unstructured":"Prastawa M, Bullitt E, Ho S, Gerig G (2004) A brain tumor segmentation framework based on outlier detection. Med Image Anal 8(3):275\u2013283","journal-title":"Med Image Anal"},{"key":"9871_CR20","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234\u2013241","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"9871_CR21","doi-asserted-by":"crossref","unstructured":"Shaikh M, Anand G, Acharya G, Amrutkar A, Alex V, Krishnamurthi G (2017) Brain tumor segmentation using dense fully convolutional neural network. In: International MICCAI brainlesion workshop. Springer, pp 309\u2013319","DOI":"10.1007\/978-3-319-75238-9_27"},{"key":"9871_CR22","doi-asserted-by":"crossref","unstructured":"Soltaninejad M, Zhang L, Lambrou T, Yang G, Allinson N, Ye X (2017) MRI brain tumor segmentation using random forests and fully convolutional networks. In: International MICCAI brainlesion workshop, pp 279\u2013283","DOI":"10.1007\/978-3-319-75238-9_18"},{"key":"9871_CR23","doi-asserted-by":"crossref","unstructured":"Tak\u00e1cs P, Manno-Kovacs A (2018) Mri brain tumor segmentation combining saliency and convolutional network features. In: 2018 International conference on content-based multimedia indexing (CBMI), pp 1\u20136","DOI":"10.1109\/CBMI.2018.8516544"},{"issue":"3","key":"9871_CR24","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1093\/neuros\/nyx103","volume":"81","author":"JE Villanueva-Meyer","year":"2017","unstructured":"Villanueva-Meyer JE, Mabray MC, Cha S (2017) Current Clinical Brain Tumor Imaging. Neurosurgery 81(3):397\u2013415","journal-title":"Neurosurgery"},{"key":"9871_CR25","unstructured":"Virupakshappa AB (2018) Computer-aided diagnosis applied to mri images of brain tumor using cognition based modified level set and optimized ann classifier. Multimedia Tools and Applications, pp 1\u201329"},{"issue":"2","key":"9871_CR26","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1007\/s11548-013-0922-7","volume":"9","author":"W Wu","year":"2014","unstructured":"Wu W, Chen AY, Zhao L, Corso JJ (2014) Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features. Int J CARS 9(2):241\u2013253","journal-title":"Int J CARS"},{"issue":"8","key":"9871_CR27","doi-asserted-by":"publisher","first-page":"1003","DOI":"10.1109\/TMI.2008.916954","volume":"27","author":"EI Zacharaki","year":"2008","unstructured":"Zacharaki EI, Shen D, Lee SK, Davatzikos C (2008) ORBIT: a multiresolution framework for deformable registration of brain tumor images. IEEE Trans Med Imaging 27(8):1003\u20131017","journal-title":"IEEE Trans Med Imaging"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-09871-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-020-09871-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-09871-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,22]],"date-time":"2021-10-22T19:06:37Z","timestamp":1634929597000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-020-09871-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,23]]},"references-count":27,"journal-issue":{"issue":"15","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["9871"],"URL":"https:\/\/doi.org\/10.1007\/s11042-020-09871-w","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"type":"print","value":"1380-7501"},{"type":"electronic","value":"1573-7721"}],"subject":[],"published":{"date-parts":[[2020,10,23]]},"assertion":[{"value":"2 March 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 February 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 September 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 October 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}