{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T19:14:13Z","timestamp":1791832453128,"version":"4.3.4"},"reference-count":49,"publisher":"IOP Publishing","issue":"21","license":[{"start":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T00:00:00Z","timestamp":1729728000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/page\/copyright"},{"start":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T00:00:00Z","timestamp":1729728000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Joint Fund for Medical Artificial Intelligence of the First Affiliated Hospital of University of Science and Technology of China","award":["MAI2022C005"],"award-info":[{"award-number":["MAI2022C005"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Phys. Med. Biol."],"published-print":{"date-parts":[[2024,11,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>\n                  <jats:italic>Objective.<\/jats:italic> Ultrasound is the primary screening test for breast cancer. However, providing an interpretable auxiliary diagnosis of breast lesions is a challenging task. This study aims to develop an interpretable auxiliary diagnostic method to enhance usability in human-machine collaborative diagnosis. <jats:italic>Approach.<\/jats:italic> To address this issue, this study proposes the deep multi-stage reasoning method (DMSRM), which provides individual and overall breast imaging-reporting and data system (BI-RADS) assessment categories for breast lesions. In the first stage of the DMSRM, the individual BI-RADS assessment network (IBRANet) is designed to capture lesion features from breast ultrasound images. IBRANet performs individual BI-RADS assessments of breast lesions using ultrasound images, focusing on specific features such as margin, contour, echogenicity, calcification, and vascularity. In the second stage, evidence reasoning (ER) is employed to achieve uncertain information fusion and reach an overall BI-RADS assessment of the breast lesions. <jats:italic>Main results.<\/jats:italic> To evaluate the performance of DMSRM at each stage, two test sets are utilized: the first for individual BI-RADS assessment, containing 4322 ultrasound images; the second for overall BI-RADS assessment, containing 175 sets of ultrasound image pairs. In the individual BI-RADS assessment of margin, contour, echogenicity, calcification, and vascularity, IBRANet achieves accuracies of 0.9491, 0.9466, 0.9293, 0.9234, and 0.9625, respectively. In the overall BI-RADS assessment of lesions, the ER achieves an accuracy of 0.8502. Compared to independent diagnosis, the human-machine collaborative diagnosis results of three radiologists show increases in positive predictive value by 0.0158, 0.0427, and 0.0401, in sensitivity by 0.0400, 0.0600 and 0.0434, and in area under the curve by 0.0344, 0.0468, and 0.0255. <jats:italic>Significance.<\/jats:italic> This study proposes a DMSRM that enhances the transparency of the diagnostic reasoning process. Results indicate that DMSRM exhibits robust BI-RADS assessment capabilities and provides an interpretable reasoning process that better suits clinical needs.<\/jats:p>","DOI":"10.1088\/1361-6560\/ad869f","type":"journal-article","created":{"date-parts":[[2024,10,14]],"date-time":"2024-10-14T22:56:41Z","timestamp":1728946601000},"page":"215025","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Interpretable diagnosis of breast lesions in ultrasound imaging using deep multi-stage reasoning"],"prefix":"10.1088","volume":"69","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-1770-8894","authenticated-orcid":false,"given":"Kaixuan","family":"Cui","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-4202-574X","authenticated-orcid":true,"given":"Weiyong","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongyue","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2024,10,24]]},"reference":[{"key":"pmbad869fbib1","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1148\/radiology.196.3.7644649","article-title":"Breast cancer: prediction with artificial neural network based on BI-RADS standardized lexicon","volume":"196","author":"Baker","year":"1995","journal-title":"Radiology"},{"key":"pmbad869fbib2","doi-asserted-by":"publisher","DOI":"10.1016\/j.critrevonc.2020.103174","article-title":"Breast cancer, screening and diagnostic tools: all you need to know","volume":"157","author":"Barba","year":"2021","journal-title":"Crit. Rev. Oncol. Hematol."},{"key":"pmbad869fbib3","doi-asserted-by":"publisher","first-page":"djv367","DOI":"10.1093\/jnci\/djv367","article-title":"Ultrasound as the primary screening test for breast cancer: analysis from ACRIN 6666","volume":"108","author":"Berg","year":"2016","journal-title":"J. Natl Cancer I"},{"key":"pmbad869fbib4","doi-asserted-by":"publisher","first-page":"900","DOI":"10.6004\/jnccn.2023.0046","article-title":"NCCN Guidelines\u00ae insights: breast cancer screening and diagnosis, version 1.2023: featured updates to the NCCN guidelines","volume":"21","author":"Bevers","year":"2023","journal-title":"J. Natl Compr. Cancer Netw."},{"key":"pmbad869fbib5","first-page":"1251","article-title":"Xception: deep learning with depthwise separable convolutions","author":"Chollet","year":"2017"},{"key":"pmbad869fbib6","author":"D\u2019Orsi","year":"2013","edition":"5th ed"},{"key":"pmbad869fbib7","first-page":"1","article-title":"Exploring residual networks for breast cancer detection from ultrasound images","author":"Das","year":"2021"},{"key":"pmbad869fbib8","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1148\/radiol.2017170770","article-title":"ACR BI-RADS assessment category 4 subdivisions in diagnostic mammography: utilization and outcomes in the national mammography database","volume":"287","author":"Elezaby","year":"2018","journal-title":"Radiology"},{"key":"pmbad869fbib9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11432-019-9866-3","article-title":"Data-driven group decision making for diagnosis of thyroid nodule","volume":"62","author":"Fu","year":"2019","journal-title":"Sci. China Inf. Sci."},{"key":"pmbad869fbib10","doi-asserted-by":"publisher","first-page":"3987","DOI":"10.1007\/s10462-022-10267-5","article-title":"Cross-domain decision making based on TrAdaBoost for diagnosis of breast lesions","volume":"56","author":"Fu","year":"2023a","journal-title":"Artif. Intell. Rev."},{"key":"pmbad869fbib11","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1007\/s10479-021-04249-z","article-title":"Multiple criteria decision making with reliability of assessment","volume":"312","author":"Fu","year":"2022","journal-title":"Ann. Oper. Res."},{"key":"pmbad869fbib12","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1080\/01605682.2021.2023674","article-title":"Multi-criteria appraisal recommendation","volume":"74","author":"Fu","year":"2023b","journal-title":"J. Oper. Res. Soc."},{"key":"pmbad869fbib13","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/j.ultrasmedbio.2017.09.012","article-title":"Ultrasound imaging technologies for breast cancer detection and management: a review","volume":"44","author":"Guo","year":"2018","journal-title":"Ultrasound Med. Biol."},{"key":"pmbad869fbib14","first-page":"630","article-title":"Identity mappings in deep residual networks","author":"He","year":"2016"},{"key":"pmbad869fbib15","doi-asserted-by":"publisher","first-page":"4868","DOI":"10.1007\/s00330-022-08558-0","article-title":"Fully automatic classification of automated breast ultrasound (ABUS) imaging according to BI-RADS using a deep convolutional neural network","volume":"32","author":"Hejduk","year":"2022","journal-title":"Eur. Radiol."},{"key":"pmbad869fbib16","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.120450","article-title":"A novel image-to-knowledge inference approach for automatically diagnosing tumors","volume":"229","author":"Huang","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"pmbad869fbib17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12938-019-0626-5","article-title":"Two-stage CNNs for computerized BI-RADS categorization in breast ultrasound images","volume":"18","author":"Huang","year":"2019","journal-title":"Biomed. Eng. Online"},{"key":"pmbad869fbib18","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2023.105534","article-title":"HiFuse: hierarchical multi-scale feature fusion network for medical image classification","volume":"87","author":"Huo","year":"2024","journal-title":"Biomed. Signal Process. Control"},{"key":"pmbad869fbib19","doi-asserted-by":"publisher","first-page":"15","DOI":"10.3348\/kjr.2019.0176","article-title":"Automated breast ultrasound screening for dense breasts","volume":"21","author":"Kim","year":"2020","journal-title":"Korean J. Radiol."},{"key":"pmbad869fbib20","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6560\/aaef0a","article-title":"Visually interpretable deep network for diagnosis of breast masses on mammograms","volume":"63","author":"Kim","year":"2018","journal-title":"Phys. Med. Biol."},{"key":"pmbad869fbib21","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1148\/radiol.2392042127","article-title":"BI-RADS lexicon for US and mammography: interobserver variability and positive predictive value","volume":"239","author":"Lazarus","year":"2006","journal-title":"Radiology"},{"key":"pmbad869fbib22","first-page":"1449","article-title":"Bilinear CNN models for fine-grained visual recognition","author":"Lin","year":"2015"},{"key":"pmbad869fbib23","doi-asserted-by":"publisher","first-page":"418","DOI":"10.3945\/an.116.012211","article-title":"World cancer report 2014. Geneva, Switzerland: world health organization, international agency for research on cancer, WHO Press, 2015","volume":"7","author":"McGuire","year":"2016","journal-title":"Adv. Nutrition"},{"key":"pmbad869fbib24","doi-asserted-by":"publisher","first-page":"1696","DOI":"10.1109\/TMI.2023.3236011","article-title":"Hover-trans: anatomy-aware hover-transformer for roi-free breast cancer diagnosis in ultrasound images","volume":"42","author":"Mo","year":"2023","journal-title":"IEEE Trans. Med. Imaging"},{"key":"pmbad869fbib25","doi-asserted-by":"crossref","DOI":"10.2139\/ssrn.4689420","article-title":"A deep learning based computer aided diagnosis (Cad) tool supported by explainable artificial intelligence for breast cancer exploration","author":"Naas","year":"2024"},{"key":"pmbad869fbib26","first-page":"1","article-title":"Classification of ultrasound breast images using fused ensemble of deep learning classifiers","author":"Nehary","year":"2022"},{"key":"pmbad869fbib27","article-title":"Smooth grad-cam++: an enhanced inference level visualization technique for deep convolutional neural network models","author":"Omeiza","year":"2019"},{"key":"pmbad869fbib28","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1016\/j.neucom.2020.04.123","article-title":"Automated diagnosis of multi-plane breast ultrasonography images using deep neural networks","volume":"403","author":"Pi","year":"2020","journal-title":"Neurocomputing"},{"key":"pmbad869fbib29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11042-023-17776-7","article-title":"Attention guided grad-CAM: an improved explainable artificial intelligence model for infrared breast cancer detection","volume":"83","author":"Raghavan","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"pmbad869fbib30","doi-asserted-by":"publisher","first-page":"752","DOI":"10.1109\/TCBB.2022.3163277","article-title":"Vggin-net: deep transfer network for imbalanced breast cancer dataset","volume":"20","author":"Saini","year":"2022","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform."},{"key":"pmbad869fbib31","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1053\/j.ro.2011.04.001","article-title":"The breast ultrasound lexicon: breast imaging reporting and data system (BI-RADS)","volume":"46","author":"Sedgwick","year":"2011","journal-title":"Semin. Roentgenol."},{"key":"pmbad869fbib32","doi-asserted-by":"publisher","first-page":"115","DOI":"10.3747\/co.25.3770","article-title":"Screening for breast cancer in 2018\u2014what should we be doing today?","volume":"25","author":"Seely","year":"2018","journal-title":"Curr. Oncol."},{"key":"pmbad869fbib33","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1007\/s10911-006-9018-0","article-title":"A review of breast ultrasound","volume":"11","author":"Sehgal","year":"2006","journal-title":"J. Mammary Gland Biol. Neoplasia"},{"key":"pmbad869fbib34","doi-asserted-by":"publisher","first-page":"980","DOI":"10.1016\/j.ultrasmedbio.2015.11.016","article-title":"Computer-aided diagnosis for breast ultrasound using computerized BI-RADS features and machine learning methods","volume":"42","author":"Shan","year":"2016","journal-title":"Ultrasound Med. Biol."},{"key":"pmbad869fbib35","doi-asserted-by":"publisher","first-page":"998","DOI":"10.1038\/bjc.2015.33","article-title":"A multi-centre randomised trial comparing ultrasound vs mammography for screening breast cancer in high-risk Chinese women","volume":"112","author":"Shen","year":"2015","journal-title":"Br. J. Cancer"},{"key":"pmbad869fbib36","doi-asserted-by":"publisher","first-page":"52","DOI":"10.3390\/jimaging6060052","article-title":"Explainable deep learning models in medical image analysis","volume":"6","author":"Singh","year":"2020","journal-title":"J. Imaging"},{"key":"pmbad869fbib37","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.106835","article-title":"An interpretable knowledge-based decision support system and its applications in pregnancy diagnosis","volume":"221","author":"Song","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"pmbad869fbib38","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1007\/978-3-319-21566-2_2","article-title":"Bi-rads reporting for breast tomosynthesis (3d-mammography)","author":"Sonnenschein","year":"2017"},{"key":"pmbad869fbib39","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/j.diii.2017.01.001","article-title":"BI-RADS\u00ae fifth edition: a summary of changes","volume":"98","author":"Spak","year":"2017","journal-title":"Diagn. Interventional Imaging"},{"key":"pmbad869fbib40","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1109\/TNN.2009.2036363","article-title":"Feature fusion using locally linear embedding for classification","volume":"21","author":"Sun","year":"2009","journal-title":"IEEE Trans. Neural Netw."},{"key":"pmbad869fbib41","doi-asserted-by":"publisher","first-page":"209","DOI":"10.3322\/caac.21660","article-title":"Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"71","author":"Sung","year":"2021","journal-title":"Cancer J. Clin."},{"key":"pmbad869fbib42","article-title":"Inception-v4, inception-resnet and the impact of residual connections on learning","volume":"vol 31","author":"Szegedy","year":"2017"},{"key":"pmbad869fbib43","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102470","article-title":"Explainable artificial intelligence (XAI) in deep learning-based medical image analysis","volume":"79","author":"Van der Velden","year":"2022","journal-title":"Med. Image Anal."},{"key":"pmbad869fbib44","first-page":"190","article-title":"Auto-weighting for breast cancer classification in multimodal ultrasound","author":"Wang","year":"2020"},{"key":"pmbad869fbib45","doi-asserted-by":"publisher","first-page":"8088","DOI":"10.1109\/TCYB.2021.3051676","article-title":"A new evidential reasoning rule with continuous probability distribution of reliability","volume":"52","author":"Wang","year":"2021","journal-title":"IEEE Trans. Cybern."},{"key":"pmbad869fbib46","doi-asserted-by":"publisher","first-page":"2058","DOI":"10.1109\/JBHI.2020.3034804","article-title":"Using BI-RADS stratifications as auxiliary information for breast masses classification in ultrasound images","volume":"25","author":"Xing","year":"2020","journal-title":"IEEE J. Biomed. Health Inf."},{"key":"pmbad869fbib47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.artint.2013.09.003","article-title":"Evidential reasoning rule for evidence combination","volume":"205","author":"Yang","year":"2013","journal-title":"Artif. Intell."},{"key":"pmbad869fbib48","doi-asserted-by":"publisher","first-page":"133349","DOI":"10.1109\/ACCESS.2020.3010863","article-title":"Breast lesion classification in ultrasound images using deep convolutional neural network","volume":"8","author":"Zeimarani","year":"2020","journal-title":"IEEE Access"},{"key":"pmbad869fbib49","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6560\/ab7e7d","article-title":"BIRADS features-oriented semi-supervised deep learning for breast ultrasound computer-aided diagnosis","volume":"65","author":"Zhang","year":"2020","journal-title":"Phys. Med. Biol."}],"container-title":["Physics in Medicine &amp; Biology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ad869f","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ad869f\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ad869f","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ad869f\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ad869f\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ad869f\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ad869f\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ad869f\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T06:29:37Z","timestamp":1729751377000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ad869f"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,24]]},"references-count":49,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2024,10,24]]},"published-print":{"date-parts":[[2024,11,7]]}},"URL":"https:\/\/doi.org\/10.1088\/1361-6560\/ad869f","relation":{},"ISSN":["0031-9155","1361-6560"],"issn-type":[{"value":"0031-9155","type":"print"},{"value":"1361-6560","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,24]]},"assertion":[{"value":"Interpretable diagnosis of breast lesions in ultrasound imaging using deep multi-stage reasoning","name":"article_title","label":"Article Title"},{"value":"Physics in Medicine & Biology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 Institute of Physics and Engineering in Medicine. All rights, including for text and data mining, AI training, and similar technologies, are reserved.","name":"copyright_information","label":"Copyright Information"},{"value":"2024-04-26","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-10-14","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-10-24","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}