{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T14:00:05Z","timestamp":1781272805728,"version":"3.54.1"},"reference-count":47,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T00:00:00Z","timestamp":1726790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&amp;D Program of China","award":["2022YFF0706003"],"award-info":[{"award-number":["2022YFF0706003"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>In the computer-aided diagnosis of lung cancer, the automatic segmentation of pulmonary nodules and the classification of benign and malignant tumors are two fundamental tasks. However, deep learning models often overlook the potential benefits of task correlations in improving their respective performances, as they are typically designed for a single task only. Therefore, we propose a multi-task network (MT-Net) that integrates shared backbone architecture and a prediction distillation structure for the simultaneous segmentation and classification of pulmonary nodules. The model comprises a coarse segmentation subnetwork (Coarse Seg-net), a cooperative classification subnetwork (Class-net), and a cooperative segmentation subnetwork (Fine Seg-net). Coarse Seg-net and Fine Seg-net share identical structure, where Coarse Seg-net provides prior location information for the subsequent Fine Seg-net and Class-net, thereby boosting pulmonary nodule segmentation and classification performance. We quantitatively and qualitatively analyzed the performance of the model by using the public dataset LIDC-IDRI. Our results show that the model achieves a Dice similarity coefficient (DI) index of 83.2% for pulmonary nodule segmentation, as well as an accuracy (ACC) of 91.9% for benign and malignant pulmonary nodule classification, which is competitive with other state-of-the-art methods. The experimental results demonstrate that the performance of pulmonary nodule segmentation and classification can be improved by a unified model that leverages the potential correlation between tasks.<\/jats:p>","DOI":"10.3390\/jimaging10090234","type":"journal-article","created":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T07:38:57Z","timestamp":1726817937000},"page":"234","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["A Multi-Task Model for Pulmonary Nodule Segmentation and Classification"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7438-6474","authenticated-orcid":false,"given":"Tiequn","family":"Tang","sequence":"first","affiliation":[{"name":"School of Physics and Electronic Engineering, Fuyang Normal University, Fuyang 236037, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1387-7376","authenticated-orcid":false,"given":"Rongfu","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China"},{"name":"Key Laboratory of Optical Technology and Instrument for Medicine, Ministry of Education, University of Shanghai for Science and Technology, Shanghai 200093, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Yu, H., Li, J., Zhang, L., Cao, Y., Yu, X., and Sun, J. (2021). Design of lung nodules segmentation and recognition algorithm based on deep learning. BMC Bioinform., 22.","DOI":"10.1186\/s12859-021-04234-0"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1118\/1.3528204","article-title":"The lung image database consortium (LIDC) and image database resource initiative (IDRI): A completed reference database of lung nodules on CT scans","volume":"38","author":"Armato","year":"2011","journal-title":"Med. Phys."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Cao, G., Sun, Z., Pan, M., Pang, J., He, Z., and Shen, J. (2021, January 5\u20137). UUnet: An effective cascade Unet for automatic segmentation of renal parenchyma. Proceedings of the 2021 IEEE Symposium Series on Computational Intelligence (SSCI), Orlando, FL, USA.","DOI":"10.1109\/SSCI50451.2021.9660077"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.ejmp.2019.06.003","article-title":"A cascaded dual-pathway residual network for lung nodule segmentation in CT images","volume":"63","author":"Liu","year":"2019","journal-title":"Phys. Medica"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5004","DOI":"10.1002\/mp.15074","article-title":"An effective deep network for automatic segmentation of complex lung tumors in CT images","volume":"48","author":"Wang","year":"2021","journal-title":"Med. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Pezzano, G., Ripoll, V.R., and Radeva, P. (2021). CoLe-CNN: Context-learning convolutional neural network with adaptive loss function for lung nodule segmentation. Comput. Methods Programs Biomed., 198.","DOI":"10.1016\/j.cmpb.2020.105792"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1186\/s13640-021-00574-2","article-title":"HR-MPF: High-resolution representation network with multi-scale progressive fusion for pulmonary nodule segmentation and classification","volume":"2021","author":"Zhu","year":"2021","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"678","DOI":"10.1007\/s10278-019-00301-4","article-title":"Deep deconvolutional residual network based automatic lung nodule segmentation","volume":"33","author":"Singadkar","year":"2020","journal-title":"J. Digit. Imaging"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lyu, J., and Ling, S.H. (2018, January 18\u201321). Using multi-level convolutional neural network for classification of lung nodules on CT images. Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA.","DOI":"10.1109\/EMBC.2018.8512376"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Onishi, Y., Teramoto, A., Tsujimoto, M., Tsukamoto, T., Saito, K., Toyama, H., Imaizumi, K., and Fujita, H. (2019). Automated pulmonary nodule classification in computed tomography images using a deep convolutional neural network trained by generative adversarial networks. Biomed. Res. Int., 1.","DOI":"10.1155\/2019\/6051939"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/s11548-019-02092-z","article-title":"Multiplanar analysis for pulmonary nodule classification in CT images using deep convolutional neural network and generative adversarial networks","volume":"15","author":"Onishi","year":"2020","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"180317","DOI":"10.1109\/ACCESS.2020.3027812","article-title":"Multi-task learning for lung nodule classification on chest CT","volume":"8","author":"Zhai","year":"2020","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.1007\/s11277-021-08258-w","article-title":"Lung nodule classification on computed tomography images using fractalnet","volume":"119","author":"Naik","year":"2021","journal-title":"Wirel. Pers. Commun."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"110358","DOI":"10.1109\/ACCESS.2019.2933670","article-title":"Ensemble learners of multiple deep CNNs for pulmonary nodules classification using CT images","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Amyar, A., Modzelewski, R., Li, H., and Ruan, S. (2020). Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: Classification and segmentation. Comput. Biol. Med., 126.","DOI":"10.1016\/j.compbiomed.2020.104037"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1109\/TMI.2019.2934577","article-title":"Multi-task deep model with margin ranking loss for lung nodule analysis","volume":"39","author":"Liu","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"101814","DOI":"10.1016\/j.compmedimag.2020.101814","article-title":"3D deep learning based classification of pulmonary ground glass opacity nodules with automatic segmentation","volume":"88","author":"Wang","year":"2021","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft coco: Common objects in context. Proceedings of the Computer Vision\u2014ECCV 2014 13th European Conference, Zurich, Switzerland. Part V.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sudre, C.H., Li, W., Vercauteren, T., Ourselin, S., and Jorge Cardoso, M. (2017). Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Proceedings of the Third International Workshop, DLMIA 2017, and 7th International Workshop, ML-CDS 2017, Held in Conjunction with MICCAI 2017, Qu\u00e9bec City, QC, Canada, 14 September 2017, Springer.","DOI":"10.1007\/978-3-319-67558-9_28"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kong, S., Shen, X., Lin, Z., Mech, R., and Fowlkes, C. (2016;, January 11\u201314). Photo aesthetics ranking network with attributes and content adaptation. Proceedings of the Computer Vision\u2014ECCV 2016 European Conference, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_40"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2482","DOI":"10.1109\/TMI.2020.2972964","article-title":"A mutual bootstrapping model for automated skin lesion segmentation and classification","volume":"39","author":"Xie","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zhang, J., Zhao, L., Wei, X., and Zhang, Q. (2018, January 20\u201322). Classification of benign and malignant pulmonary nodules based on deep learning. Proceedings of the 2018 5th International Conference on Information Science and Control Engineering (ICISCE), Zhengzhou, China.","DOI":"10.1109\/ICISCE.2018.00042"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"798","DOI":"10.1007\/s10278-021-00453-2","article-title":"The effects of perinodular features on solid lung nodule classification","volume":"34","author":"Calheiros","year":"2021","journal-title":"J. Digit. Imaging"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Tyagi, S., and Talbar, S.N. (2022). CSE-GAN: A 3D conditional generative adversarial network with concurrent squeeze-and-excitation blocks for lung nodule segmentation. Comput. Biol. Med., 147.","DOI":"10.1016\/j.compbiomed.2022.105781"},{"key":"ref_28","unstructured":"Lan, T., Li, Y., Murugi, J.K., Ding, Y., and Qin, Z. (2018). Run: Residual U-Net for computer-aided detection of pulmonary nodules without candidate selection. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Sarker, M.M.K., Rashwan, H.A., Akram, F., Banu, S.F., Saleh, A., Singh, V.K., Chowdhury, F.U., Abdulwahab, S., Romani, S., and Radeva, P. (2018). SLSDeep: Skin lesion segmentation based on dilated residual and pyramid pooling networks. Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2018, Proceedings of the 21st International Conference, Granada, Spain, 16\u201320 September 2018, Springer. Part II.","DOI":"10.1007\/978-3-030-00934-2_3"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wu, B., Zhou, Z., Wang, J., and Wang, Y. (2018, January 4\u20137). Joint learning for pulmonary nodule segmentation, attributes and malignancy prediction. Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA.","DOI":"10.1109\/ISBI.2018.8363765"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chen, W., Wang, Q., Yang, D., Zhang, X., Liu, C., and Li, Y. (2021, January 10\u201315). End-to-End multi-task learning for lung nodule segmentation and diagnosis. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9412218"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"292","DOI":"10.21037\/qims-21-19","article-title":"Two-stage multitask U-Net construction for pulmonary nodule segmentation and malignancy risk prediction","volume":"12","author":"Ni","year":"2022","journal-title":"Quant. Imaging Med. Surg."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.compbiomed.2017.11.013","article-title":"Ground-glass nodule segmentation in chest CT images using asymmetric multi-phase deformable model and pulmonary vessel removal","volume":"92","author":"Jung","year":"2018","journal-title":"Comput. Biol. Med."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"105934","DOI":"10.1016\/j.asoc.2019.105934","article-title":"Dual-branch residual network for lung nodule segmentation","volume":"86","author":"Cao","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_35","unstructured":"Shen, S., Han, S.X., Aberle, D.R., Bui, A.A.T., and Hsu, W. (2019, January 15\u201320). Explainable Hierarchical Semantic Convolutional Neural Network for Lung Cancer Diagnosis. Proceedings of the CVPR Workshops 2019, Long Beach, CA, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3860","DOI":"10.1109\/JBHI.2022.3171851","article-title":"Self-supervised transfer learning based on domain adaptation for benign-malignant lung nodule classification on thoracic CT","volume":"26","author":"Huang","year":"2022","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27\u201330). Learning deep features for discriminative localization. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.319"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1007\/s13755-020-00135-3","article-title":"Classification of COVID-19 chest X-rays with deep learning: New models or fine tuning?","volume":"9","author":"Pham","year":"2021","journal-title":"Health Inf. Sci. Syst."},{"key":"ref_39","unstructured":"Li, H., Chaudhari, P., Yang, H., Lam, M., Ravichandran, A., Bhotika, R., and Soatto, S. (2020). Rethinking the hyperparameters for fine-tuning. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"13951","DOI":"10.1007\/s00521-022-07246-w","article-title":"On fine-tuning deep learning models using transfer learning and hyper-parameters optimization for disease identification in maize leaves","volume":"34","author":"Subramanian","year":"2022","journal-title":"Neural Comput. Appl."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1038\/s41419-021-04324-0","article-title":"MicroRNA-106a regulates autophagy-related cell death and EMT by targeting TP53INP1 in lung cancer with bone metastasis","volume":"12","author":"Han","year":"2021","journal-title":"Cell Death Dis."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"644","DOI":"10.1093\/ajcp\/aqaa278","article-title":"Analysis of microRNA expression in liquid-based cytology samples may be useful for primary lung cancer diagnosis","volume":"156","author":"Araki","year":"2021","journal-title":"Am. J. Clin. Pathol."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Boicean, A., Boeras, I., Birsan, S., Ichim, C., Todor, S.B., Onisor, D.M., Brusnic, O., Bacila, C., Dura, H., and Roman-Filip, C. (2024). In Pursuit of Novel Markers: Unraveling the Potential of miR-106, CEA and CA 19-9 in Gastric Adenocarcinoma Diagnosis and Staging. Int. J. Mol. Sci., 25.","DOI":"10.3390\/ijms25147898"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"9521","DOI":"10.1007\/s11033-023-08695-9","article-title":"miRNA as biomarker in lung cancer","volume":"50","author":"Lobera","year":"2023","journal-title":"Mol. Biol. Rep."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1097\/MEG.0000000000002383","article-title":"Transesophageal endoscopic ultrasound in the diagnosis of the lung masses: A multicenter experience with fine-needle aspiration and fine-needle biopsy needles","volume":"34","author":"Mangiavillano","year":"2022","journal-title":"Eur. J. Gastroenterol. Hepatol."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"17","DOI":"10.21037\/shc.2019.11.08","article-title":"Endoscopic ultrasound in interventional pulmonology","volume":"4","author":"Ho","year":"2020","journal-title":"Shanghai Chest"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Boicean, A., Prisca, D., Bratu, D.G., Bacila, C.I., Tanasescu, C., Chicea, R., Fleaca, S.R., Birsan, S.A., Ichim, C., and Mohor, C.I. (2024). Uncommon Presentation of Gastric Duplication Cyst with Left-Sided Portal Hypertension: A Ca se Report and Literature Review. Diagnostics, 14.","DOI":"10.3390\/diagnostics14070675"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/9\/234\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:00:39Z","timestamp":1760112039000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/9\/234"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,20]]},"references-count":47,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["jimaging10090234"],"URL":"https:\/\/doi.org\/10.3390\/jimaging10090234","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,20]]}}}