{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T09:45:00Z","timestamp":1770889500443,"version":"3.50.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,12,13]],"date-time":"2024-12-13T00:00:00Z","timestamp":1734048000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,12,13]],"date-time":"2024-12-13T00:00:00Z","timestamp":1734048000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["UIDB\/50026\/2020"],"award-info":[{"award-number":["UIDB\/50026\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["UIDP\/50026\/2020"],"award-info":[{"award-number":["UIDP\/50026\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["LA\/P\/0050\/2020"],"award-info":[{"award-number":["LA\/P\/0050\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["PTDC\/EMD-EMD\/1140\/2020"],"award-info":[{"award-number":["PTDC\/EMD-EMD\/1140\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["CEECIND\/03064\/2018"],"award-info":[{"award-number":["CEECIND\/03064\/2018"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Digit Imaging. Inform. med."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Point-of-care ultrasound (POCUS) stands as a safe, portable, and cost-effective imaging modality for swift bedside patient examinations. Specifically, lung ultrasonography (LUS) has proven useful in evaluating both acute and chronic pulmonary conditions. Despite its clinical value, automatic LUS interpretation remains relatively unexplored, particularly in multi-label contexts. This work proposes a novel deep learning (DL) framework tailored for interpreting lung POCUS videos, whose outputs are the finding(s) present in these videos (such as A-lines, B-lines, or consolidations). The pipeline, based on a residual (2+1)D architecture, initiates with a pre-processing routine for video masking and standardisation, and employs a semi-supervised approach to harness available unlabeled data. Additionally, we introduce an ensemble modeling strategy that aggregates outputs from models trained to predict distinct label sets, thereby leveraging the hierarchical nature of LUS findings. The proposed framework and its building blocks were evaluated through extensive experiments with both multi-class and multi-label models, highlighting its versatility. In a held-out test set, the categorical proposal, suited for expedite triage, achieved an average F1-score of 92.4%, while the multi-label proposal, helpful for patient management and referral, achieved an average F1-score of 70.5% across five relevant LUS findings. Overall, the semi-supervised methodology contributed significantly to improved performance, while the proposed hierarchy-aware ensemble provided moderate additional gains.<\/jats:p>","DOI":"10.1007\/s10278-024-01344-y","type":"journal-article","created":{"date-parts":[[2024,12,13]],"date-time":"2024-12-13T11:28:22Z","timestamp":1734089302000},"page":"2664-2676","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Semi-supervised Ensemble Learning for Automatic Interpretation of Lung Ultrasound Videos"],"prefix":"10.1007","volume":"38","author":[{"given":"B\u00e1rbara","family":"Malainho","sequence":"first","affiliation":[]},{"given":"Jo\u00e3o","family":"Freitas","sequence":"additional","affiliation":[]},{"given":"Catarina","family":"Rodrigues","sequence":"additional","affiliation":[]},{"given":"Ana Claudia","family":"Tonelli","sequence":"additional","affiliation":[]},{"given":"Andr\u00e9","family":"Santanch\u00e8","sequence":"additional","affiliation":[]},{"given":"Marco A.","family":"Carvalho-Filho","sequence":"additional","affiliation":[]},{"given":"Jaime C.","family":"Fonseca","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5259-1891","authenticated-orcid":false,"given":"Sandro","family":"Queir\u00f3s","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,12,13]]},"reference":[{"key":"1344_CR1","volume-title":"Human anatomy","author":"KM van de Graaff","year":"2002","unstructured":"van\u00a0de Graaff KM. Human anatomy. Boston: McGraw-Hill; 2002."},{"key":"1344_CR2","unstructured":"Forum of International Respiratory Societies. The Global Impact of Respiratory Disease. European Respiratory Society; 2021."},{"issue":"12","key":"1344_CR3","doi-asserted-by":"publisher","first-page":"1569","DOI":"10.1093\/ehjci\/jead169","volume":"24","author":"L Gargani","year":"2023","unstructured":"Gargani L, Girerd N, Platz E, Pellicori P, Stankovic I, Palazzuoli A, et\u00a0al. Lung ultrasound in acute and chronic heart failure: a clinical consensus statement of the European Association of Cardiovascular Imaging (EACVI). European Heart Journal-Cardiovascular Imaging. 2023;24(12):1569\u20131582.","journal-title":"European Heart Journal-Cardiovascular Imaging."},{"key":"1344_CR4","doi-asserted-by":"crossref","unstructured":"Laursen CB, Clive A, Hallifax R, Pietersen PI, Asciak R, Davidsen JR, et\u00a0al. European Respiratory Society statement on thoracic ultrasound. European Respiratory Journal. 2021;57(3).","DOI":"10.1183\/13993003.01519-2020"},{"key":"1344_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102125","volume":"72","author":"E \u00c7all\u0131","year":"2021","unstructured":"\u00c7all\u0131 E, Sogancioglu E, van Ginneken B, van Leeuwen KG, Murphy K. Deep learning for chest X-ray analysis: a survey. Medical Image Analysis. 2021;72:102125.","journal-title":"Medical Image Analysis."},{"issue":"16","key":"1344_CR6","doi-asserted-by":"publisher","first-page":"2617","DOI":"10.3390\/diagnostics13162617","volume":"13","author":"MA Thanoon","year":"2023","unstructured":"Thanoon MA, Zulkifley MA, Mohd\u00a0Zainuri MAA, Abdani SR. A Review of Deep Learning Techniques for Lung Cancer Screening and Diagnosis Based on CT Images. Diagnostics. 2023;13(16):2617.","journal-title":"Diagnostics."},{"key":"1344_CR7","doi-asserted-by":"crossref","unstructured":"Shoeibi A, Khodatars M, Jafari M, Ghassemi N, Sadeghi D, Moridian P, et\u00a0al. Automated detection and forecasting of COVID-19 using deep learning techniques: a review. Neurocomputing. 2024;p. 127317.","DOI":"10.1016\/j.neucom.2024.127317"},{"issue":"11","key":"1344_CR8","doi-asserted-by":"publisher","first-page":"2049","DOI":"10.3390\/diagnostics11112049","volume":"11","author":"R Arntfield","year":"2021","unstructured":"Arntfield R, Wu D, Tschirhart J, VanBerlo B, Ford A, Ho J, et\u00a0al. Automation of lung ultrasound interpretation via deep learning for the classification of normal versus abnormal lung parenchyma: a multicenter study. Diagnostics. 2021;11(11):2049.","journal-title":"Diagnostics."},{"issue":"16","key":"1344_CR9","doi-asserted-by":"publisher","first-page":"5486","DOI":"10.3390\/s21165486","volume":"21","author":"B Barros","year":"2021","unstructured":"Barros B, Lacerda P, Albuquerque C, Conci A. Pulmonary COVID-19: learning spatiotemporal features combining CNN and LSTM networks for lung ultrasound video classification. Sensors. 2021;21(16):5486.","journal-title":"Sensors."},{"issue":"8","key":"1344_CR10","doi-asserted-by":"publisher","first-page":"2676","DOI":"10.1109\/TMI.2020.2994459","volume":"39","author":"S Roy","year":"2020","unstructured":"Roy S, Menapace W, Oei S, Luijten B, Fini E, Saltori C, et\u00a0al. Deep learning for classification and localization of COVID-19 markers in point-of-care lung ultrasound. IEEE transactions on medical imaging. 2020;39(8):2676\u20132687.","journal-title":"IEEE transactions on medical imaging."},{"key":"1344_CR11","unstructured":"Born J, Br\u00e4ndle G, Cossio M, Disdier M, Goulet J, Roulin J, et\u00a0al. POCOVID-Net: automatic detection of COVID-19 from a new lung ultrasound imaging dataset (POCUS). arXiv preprint arXiv:2004.12084. 2020;."},{"issue":"3","key":"1344_CR12","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1109\/TMI.2021.3117246","volume":"41","author":"O Frank","year":"2021","unstructured":"Frank O, Schipper N, Vaturi M, Soldati G, Smargiassi A, Inchingolo R, et\u00a0al. Integrating domain knowledge into deep networks for lung ultrasound with applications to COVID-19. IEEE transactions on medical imaging. 2021;41(3):571\u2013581.","journal-title":"IEEE transactions on medical imaging."},{"issue":"2","key":"1344_CR13","doi-asserted-by":"publisher","first-page":"672","DOI":"10.3390\/app11020672","volume":"11","author":"J Born","year":"2021","unstructured":"Born J, Wiedemann N, Cossio M, Buhre C, Br\u00e4ndle G, Leidermann K, et\u00a0al. Accelerating detection of lung pathologies with explainable ultrasound image analysis. Applied Sciences. 2021;11(2):672.","journal-title":"Applied Sciences."},{"issue":"4","key":"1344_CR14","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1109\/JBHI.2019.2936151","volume":"24","author":"RJ Van Sloun","year":"2019","unstructured":"Van\u00a0Sloun RJ, Demi L. Localizing B-lines in lung ultrasonography by weakly supervised deep learning, in-vivo results. IEEE journal of biomedical and health informatics. 2019;24(4):957\u2013964.","journal-title":"IEEE journal of biomedical and health informatics."},{"issue":"1","key":"1344_CR15","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1002\/mp.15908","volume":"50","author":"W Xing","year":"2023","unstructured":"Xing W, Li G, He C, Huang Q, Cui X, Li Q, et\u00a0al. Automatic detection of A-line in lung ultrasound images using deep learning and image processing. Medical physics. 2023;50(1):330\u2013343.","journal-title":"Medical physics."},{"key":"1344_CR16","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.ejmp.2021.02.023","volume":"83","author":"CH Tsai","year":"2021","unstructured":"Tsai CH, van\u00a0der Burgt J, Vukovic D, Kaur N, Demi L, Canty D, et\u00a0al. Automatic deep learning-based pleural effusion classification in lung ultrasound images for respiratory pathology diagnosis. Physica Medica. 2021;83:38\u201345.","journal-title":"Physica Medica."},{"issue":"11","key":"1344_CR17","doi-asserted-by":"publisher","first-page":"2312","DOI":"10.1109\/TUFFC.2020.3002249","volume":"67","author":"C Baloescu","year":"2020","unstructured":"Baloescu C, Toporek G, Kim S, McNamara K, Liu R, Shaw MM, et\u00a0al. Automated lung ultrasound B-line assessment using a deep learning algorithm. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control. 2020;67(11):2312\u20132320.","journal-title":"IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control."},{"key":"1344_CR18","doi-asserted-by":"crossref","unstructured":"Ebadi SE, Krishnaswamy D, Bolouri SES, Zonoobi D, Greiner R, Meuser-Herr N, et\u00a0al. Automated detection of pneumonia in lung ultrasound using deep video classification for COVID-19. Informatics in Medicine Unlocked. 2021;25:100687.","DOI":"10.1016\/j.imu.2021.100687"},{"key":"1344_CR19","doi-asserted-by":"crossref","unstructured":"Lucassen RT, Jafari MH, Duggan NM, Jowkar N, Mehrtash A, Fischetti C, et\u00a0al. Deep learning for detection and localization of B-lines in lung ultrasound. IEEE Journal of Biomedical and Health Informatics. 2023;.","DOI":"10.1109\/JBHI.2023.3282596"},{"key":"1344_CR20","doi-asserted-by":"crossref","unstructured":"Li GY, Chen L, Zahiri M, Balaraju N, Patil S, Mehanian C, et\u00a0al. Weakly Semi-supervised Detector-based Video Classification with Temporal Context for Lung Ultrasound. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision; 2023. p. 2483\u20132492.","DOI":"10.1109\/ICCVW60793.2023.00262"},{"key":"1344_CR21","doi-asserted-by":"crossref","unstructured":"Ouyang J, Chen L, Li GY, Balaraju N, Patil S, Mehanian C, et\u00a0al. Weakly semi-supervised detection in lung ultrasound videos. In: International conference on information processing in medical imaging. Springer; 2023. p. 195\u2013207.","DOI":"10.1007\/978-3-031-34048-2_16"},{"key":"1344_CR22","unstructured":"Rizve MN, Duarte K, Rawat YS, Shah M. In defense of pseudo-labeling: an uncertainty-aware pseudo-label selection framework for semi-supervised learning. arXiv preprint arXiv:2101.06329. 2021;."},{"key":"1344_CR23","doi-asserted-by":"crossref","unstructured":"Tran D, Wang H, Torresani L, Ray J, LeCun Y, Paluri M. A closer look at spatiotemporal convolutions for action recognition. In: Proceedings of the IEEE conference on Computer Vision and Pattern Recognition; 2018. p. 6450\u20136459.","DOI":"10.1109\/CVPR.2018.00675"},{"key":"1344_CR24","unstructured":"Tiulpin A. Solt: Streaming over lightweight transformations. 2019;3702819. URL: https:\/\/doi.org\/105281\/zenodo"},{"key":"1344_CR25","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2016. p. 2818\u20132826.","DOI":"10.1109\/CVPR.2016.308"},{"key":"1344_CR26","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.101985","volume":"69","author":"X Xie","year":"2021","unstructured":"Xie X, Niu J, Liu X, Chen Z, Tang S, Yu S. A survey on incorporating domain knowledge into deep learning for medical image analysis. Medical Image Analysis. 2021;69:101985.","journal-title":"Medical Image Analysis."},{"key":"1344_CR27","unstructured":"Kingma DP, Ba J. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980. 2014."},{"key":"1344_CR28","unstructured":"Loshchilov I, Hutter F. Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983. 2016;."},{"issue":"10","key":"1344_CR29","doi-asserted-by":"publisher","first-page":"2044","DOI":"10.1016\/j.ins.2009.12.010","volume":"180","author":"S Garc\u00eda","year":"2010","unstructured":"Garc\u00eda S, Fern\u00e1ndez A, Luengo J, Herrera F. Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power. Information sciences. 2010;180(10):2044\u20132064.","journal-title":"Information sciences."},{"key":"1344_CR30","first-page":"1","volume":"7","author":"J Dem\u0161ar","year":"2006","unstructured":"Dem\u0161ar J. Statistical comparisons of classifiers over multiple data sets. The Journal of Machine learning research. 2006;7:1\u201330.","journal-title":"The Journal of Machine learning research."},{"key":"1344_CR31","doi-asserted-by":"crossref","unstructured":"Arazo E, Ortego D, Albert P, O\u2019Connor NE, McGuinness K. Pseudo-labeling and confirmation bias in deep semi-supervised learning. In: 2020 International joint conference on neural networks (IJCNN); 2020. p. 1\u20138.","DOI":"10.1109\/IJCNN48605.2020.9207304"}],"container-title":["Journal of Imaging Informatics in Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-024-01344-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10278-024-01344-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-024-01344-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T22:48:45Z","timestamp":1761778125000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10278-024-01344-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,13]]},"references-count":31,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,10]]}},"alternative-id":["1344"],"URL":"https:\/\/doi.org\/10.1007\/s10278-024-01344-y","relation":{},"ISSN":["2948-2933"],"issn-type":[{"value":"2948-2933","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,13]]},"assertion":[{"value":"5 June 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 November 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 November 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 December 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Approval for retrospective data collection was obtained from the Ethics Committee for Research (ECR) in Life and Health Sciences of the University of Minho (CEICVS 039\/202) and the ECR of\n                      Hospital Cl\u00ednicas de Porto Alegre\n                      (5.334.879).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}]}}