{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T15:24:36Z","timestamp":1778253876891,"version":"3.51.4"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,6,28]],"date-time":"2023-06-28T00:00:00Z","timestamp":1687910400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,6,28]],"date-time":"2023-06-28T00:00:00Z","timestamp":1687910400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100008867","name":"Department of Education of Zhejiang Province","doi-asserted-by":"publisher","award":["Y202146098"],"award-info":[{"award-number":["Y202146098"]}],"id":[{"id":"10.13039\/501100008867","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This study aimed to evaluate the performance of traditional-deep learning combination model based on Doppler ultrasound for diagnosing malignant complex cystic and solid breast nodules. A conventional statistical prediction model based on the ultrasound features and basic clinical information was established. A deep learning prediction model was used to train the training group images and derive the deep learning prediction model. The two models were validated, and their accuracy rates were compared using the data and images of the test group, respectively. A logistic regression method was used to combine the two models to derive a combination diagnostic model and validate it in the test group. The diagnostic performance of each model was represented by the receiver operating characteristic curve and the area under the curve. In the test cohort, the diagnostic efficacy of the deep learning model was better than traditional statistical model, and the combined diagnostic model was better and outperformed the other two models (combination model vs traditional statistical model: AUC: 0.95\u2009&gt;\u20090.70, P\u2009=\u20090.001; combination model vs deep learning model: AUC: 0.95\u2009&gt;\u20090.87, P\u2009=\u20090.04). A combination model based on deep learning and ultrasound features has good diagnostic value.<\/jats:p>","DOI":"10.1038\/s41598-023-37319-2","type":"journal-article","created":{"date-parts":[[2023,6,28]],"date-time":"2023-06-28T16:02:38Z","timestamp":1687968158000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Deep learning and ultrasound feature fusion model predicts the malignancy of complex cystic and solid breast nodules with color Doppler images"],"prefix":"10.1038","volume":"13","author":[{"given":"Han","family":"Liu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chun-Jie","family":"Hou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing-Lan","family":"Tang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li-Tao","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ke-Feng","family":"Lu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ying","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pei","family":"Du","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,6,28]]},"reference":[{"key":"37319_CR1","doi-asserted-by":"publisher","first-page":"7","DOI":"10.3322\/caac.21708","volume":"72","author":"RL Siegel","year":"2022","unstructured":"Siegel, R. L., Miller, K. D., Fuchs, H. E. & Jemal, A. Cancer statistics, 2022. CA Cancer J. Clin. 72, 7\u201333. https:\/\/doi.org\/10.3322\/caac.21708 (2022).","journal-title":"CA Cancer J. Clin."},{"key":"37319_CR2","doi-asserted-by":"publisher","first-page":"316","DOI":"10.4048\/jbc.2016.19.3.316","volume":"19","author":"KR Cho","year":"2016","unstructured":"Cho, K. R. et al. Breast cancer detection in a screening population: Comparison of digital mammography, computer-aided detection applied to digital mammography and breast ultrasound. J. Breast Cancer 19, 316\u2013323. https:\/\/doi.org\/10.4048\/jbc.2016.19.3.316 (2016).","journal-title":"J. Breast Cancer"},{"key":"37319_CR3","doi-asserted-by":"publisher","first-page":"379","DOI":"10.2147\/CMAR.S36879","volume":"4","author":"I Masroor","year":"2012","unstructured":"Masroor, I. et al. Breast imaging reports for malignant lesions: Are we maintaining recommended BI-RADS(\u00ae) lexicon standards. Cancer Manag. Res. 4, 379\u2013382. https:\/\/doi.org\/10.2147\/CMAR.S36879 (2012).","journal-title":"Cancer Manag. Res."},{"key":"37319_CR4","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1016\/j.ejrad.2009.12.037","volume":"79","author":"HH Hsu","year":"2011","unstructured":"Hsu, H. H. et al. Complex cystic lesions of the breast on ultrasonography: Feature analysis and BI-RADS assessment. Eur. J. Radiol. 79, 73\u201379. https:\/\/doi.org\/10.1016\/j.ejrad.2009.12.037 (2011).","journal-title":"Eur. J. Radiol."},{"key":"37319_CR5","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.ultrasmedbio.2007.07.003","volume":"34","author":"RC Booi","year":"2008","unstructured":"Booi, R. C. et al. Characterization of cysts using differential correlation coefficient values from two dimensional breast elastography: Preliminary study. Ultrasound Med. Biol. 34, 12\u201321. https:\/\/doi.org\/10.1016\/j.ultrasmedbio.2007.07.003 (2008).","journal-title":"Ultrasound Med. Biol."},{"key":"37319_CR6","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/j.diii.2013.12.008","volume":"95","author":"A Athanasiou","year":"2014","unstructured":"Athanasiou, A., Aubert, E., Vincent Salomon, A. & Tardivon, A. Complex cystic breast masses in ultrasound examination. Diagn. Interv. Imaging 95, 169\u2013179. https:\/\/doi.org\/10.1016\/j.diii.2013.12.008 (2014).","journal-title":"Diagn. Interv. Imaging"},{"key":"37319_CR7","doi-asserted-by":"publisher","first-page":"672","DOI":"10.3760\/cma.j.issn.0253-3766.2018.09.006","volume":"40","author":"JP Yao","year":"2018","unstructured":"Yao, J. P. et al. The value of ultrasound classification in BI-RADS category 4 of breast complex cystic masses. Zhonghua Zhong Liu Za Zhi 40, 672\u2013675. https:\/\/doi.org\/10.3760\/cma.j.issn.0253-3766.2018.09.006 (2018).","journal-title":"Zhonghua Zhong Liu Za Zhi"},{"key":"37319_CR8","doi-asserted-by":"publisher","first-page":"1120","DOI":"10.1007\/s12282-021-01249-6","volume":"28","author":"K Nakashima","year":"2021","unstructured":"Nakashima, K. et al. Can breast MRI and adjunctive Doppler ultrasound improve the accuracy of predicting pathological complete response after neoadjuvant chemotherapy. Breast Cancer 28, 1120\u20131130. https:\/\/doi.org\/10.1007\/s12282-021-01249-6 (2021).","journal-title":"Breast Cancer"},{"key":"37319_CR9","doi-asserted-by":"publisher","first-page":"677","DOI":"10.3348\/kjr.2020.1166","volume":"22","author":"AY Park","year":"2021","unstructured":"Park, A. Y., Seo, B. K. & Han, M. R. Breast ultrasound microvascular imaging and radiogenomics. Korean J. Radiol. 22, 677\u2013687. https:\/\/doi.org\/10.3348\/kjr.2020.1166 (2021).","journal-title":"Korean J. Radiol."},{"key":"37319_CR10","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.ejca.2021.01.028","volume":"147","author":"M Jiang","year":"2021","unstructured":"Jiang, M. et al. Ultrasound-based deep learning radiomics in the assessment of pathological complete response to neoadjuvant chemotherapy in locally advanced breast cancer. Eur. J. Cancer 147, 95\u2013105. https:\/\/doi.org\/10.1016\/j.ejca.2021.01.028 (2021).","journal-title":"Eur. J. Cancer"},{"key":"37319_CR11","doi-asserted-by":"publisher","first-page":"773840","DOI":"10.3389\/fonc.2022.773840","volume":"12","author":"X Zhang","year":"2022","unstructured":"Zhang, X. et al. Deep learning with radiomics for disease diagnosis and treatment: Challenges and potential. Front. Oncol. 12, 773840. https:\/\/doi.org\/10.3389\/fonc.2022.773840 (2022).","journal-title":"Front. Oncol."},{"key":"37319_CR12","doi-asserted-by":"publisher","first-page":"786","DOI":"10.1007\/s00261-018-1517-0","volume":"43","author":"LJ Brattain","year":"2018","unstructured":"Brattain, L. J., Telfer, B. A., Dhyani, M., Grajo, J. R. & Samir, A. E. Machine learning for medical ultrasound: Status, methods, and future opportunities. Abdom. Radiol. 43, 786\u2013799. https:\/\/doi.org\/10.1007\/s00261-018-1517-0 (2018).","journal-title":"Abdom. Radiol."},{"key":"37319_CR13","doi-asserted-by":"publisher","first-page":"1318","DOI":"10.1016\/j.jacr.2019.06.004","volume":"16","author":"Z Akkus","year":"2019","unstructured":"Akkus, Z. et al. A survey of deep-learning applications in ultrasound: Artificial intelligence-powered ultrasound for improving clinical workflow. J. Am. Coll. Radiol. 16, 1318\u20131328. https:\/\/doi.org\/10.1016\/j.jacr.2019.06.004 (2019).","journal-title":"J. Am. Coll. Radiol."},{"key":"37319_CR14","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics13010161","author":"M Nasser","year":"2023","unstructured":"Nasser, M. & Yusof, U. K. Deep learning based methods for breast cancer diagnosis: A systematic review and future direction. Diagnostics (Basel) https:\/\/doi.org\/10.3390\/diagnostics13010161 (2023).","journal-title":"Diagnostics (Basel)"},{"key":"37319_CR15","doi-asserted-by":"publisher","first-page":"2071","DOI":"10.1002\/jum.15891","volume":"41","author":"F Kulali","year":"2022","unstructured":"Kulali, F. & Guner, G. Outcomes in sonographically categorized complex cystic breast lesions. J. Ultrasound Med. 41, 2071\u20132077. https:\/\/doi.org\/10.1002\/jum.15891 (2022).","journal-title":"J. Ultrasound Med."},{"key":"37319_CR16","doi-asserted-by":"publisher","first-page":"699","DOI":"10.7863\/ultra.16.05012","volume":"36","author":"JP Yao","year":"2017","unstructured":"Yao, J. P. et al. Value of ultrasonographic features for assessing malignant potential of complex cystic breast lesions. J. Ultrasound Med. 36, 699\u2013704. https:\/\/doi.org\/10.7863\/ultra.16.05012 (2017).","journal-title":"J. Ultrasound Med."},{"key":"37319_CR17","doi-asserted-by":"publisher","first-page":"76","DOI":"10.5114\/aoms.2014.40734","volume":"10","author":"M Chen","year":"2014","unstructured":"Chen, M., Zhan, W. W. & Wang, W. P. Cystic breast lesions by conventional ultrasonography: Sonographic subtype-pathologic correlation and BI-RADS Assessment. Arch. Med. Sci. 10, 76\u201383. https:\/\/doi.org\/10.5114\/aoms.2014.40734 (2014).","journal-title":"Arch. Med. Sci."},{"key":"37319_CR18","doi-asserted-by":"publisher","first-page":"1111","DOI":"10.1016\/j.ultrasmedbio.2020.01.006","volume":"46","author":"H Xiang","year":"2020","unstructured":"Xiang, H. et al. Value of hand-held ultrasound in the differential diagnosis and accurate breast imaging reporting and data system subclassification of complex cystic and solid breast lesions. Ultrasound Med. Biol. 46, 1111\u20131118. https:\/\/doi.org\/10.1016\/j.ultrasmedbio.2020.01.006 (2020).","journal-title":"Ultrasound Med. Biol."},{"key":"37319_CR19","doi-asserted-by":"publisher","first-page":"4089","DOI":"10.1210\/jcem.86.9.7824","volume":"86","author":"M Braga","year":"2001","unstructured":"Braga, M., Cavalcanti, T. C., Colla\u00e7o, L. M. & Graf, H. Efficacy of ultrasound-guided fine-needle aspiration biopsy in the diagnosis of complex thyroid nodules. J. Clin. Endocrinol. Metab. 86, 4089\u20134091. https:\/\/doi.org\/10.1210\/jcem.86.9.7824 (2001).","journal-title":"J. Clin. Endocrinol. Metab."},{"key":"37319_CR20","doi-asserted-by":"publisher","first-page":"99","DOI":"10.2739\/kurumemedj.MS653002","volume":"65","author":"Y Mizushima","year":"2019","unstructured":"Mizushima, Y., Morita, M. & Yamaguchi, R. Ultrasound findings in three complex cystic breast carcinomas: Correlation with intrinsic tumor subtype. Kurume Med. J. 65, 99\u2013104. https:\/\/doi.org\/10.2739\/kurumemedj.MS653002 (2019).","journal-title":"Kurume Med. J."},{"key":"37319_CR21","doi-asserted-by":"publisher","first-page":"575","DOI":"10.3349\/ymj.2006.47.4.575","volume":"47","author":"KH Ko","year":"2006","unstructured":"Ko, K. H., Kim, E. K. & Park, B. W. Invasive papillary carcinoma of the breast presenting as post-traumatic recurrent hemorrhagic cysts. Yonsei Med. J. 47, 575\u2013577. https:\/\/doi.org\/10.3349\/ymj.2006.47.4.575 (2006).","journal-title":"Yonsei Med. J."},{"key":"37319_CR22","doi-asserted-by":"publisher","first-page":"355","DOI":"10.3233\/CH-170252","volume":"69","author":"Y Zhang","year":"2018","unstructured":"Zhang, Y. et al. Complex cystic and solid breast lesions: Diagnostic performance of conventional ultrasound, strain imaging and point shear wave speed measurement. Clin. Hemorheol. Microcirc. 69, 355\u2013370. https:\/\/doi.org\/10.3233\/CH-170252 (2018).","journal-title":"Clin. Hemorheol. Microcirc."},{"key":"37319_CR23","doi-asserted-by":"publisher","DOI":"10.1002\/jum.16078","author":"S Shi","year":"2022","unstructured":"Shi, S., An, X. & Li, Y. Ultrasound radiomics-based logistic regression model to differentiate between benign and malignant breast nodules. J. Ultrasound Med. https:\/\/doi.org\/10.1002\/jum.16078 (2022).","journal-title":"J. Ultrasound Med."},{"key":"37319_CR24","doi-asserted-by":"publisher","DOI":"10.3233\/CH-221608","author":"C Li","year":"2022","unstructured":"Li, C. et al. Deep learning radiomics of ultrasonography for differentiating sclerosing adenosis from breast cancer. Clin. Hemorheol. Microcirc. https:\/\/doi.org\/10.3233\/CH-221608 (2022).","journal-title":"Clin. Hemorheol. Microcirc."},{"key":"37319_CR25","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1016\/j.semcancer.2020.04.002","volume":"72","author":"A Conti","year":"2021","unstructured":"Conti, A., Duggento, A., Indovina, I., Guerrisi, M. & Toschi, N. Radiomics in breast cancer classification and prediction. Semin. Cancer Biol. 72, 238\u2013250. https:\/\/doi.org\/10.1016\/j.semcancer.2020.04.002 (2021).","journal-title":"Semin. Cancer Biol."},{"key":"37319_CR26","doi-asserted-by":"publisher","first-page":"1236","DOI":"10.1038\/s41467-020-15027-z","volume":"11","author":"X Zheng","year":"2020","unstructured":"Zheng, X. et al. Deep learning radiomics can predict axillary lymph node status in early-stage breast cancer. Nat. Commun. 11, 1236. https:\/\/doi.org\/10.1038\/s41467-020-15027-z (2020).","journal-title":"Nat. Commun."},{"key":"37319_CR27","doi-asserted-by":"publisher","first-page":"20190948","DOI":"10.1259\/bjr.20190948","volume":"93","author":"W Rogers","year":"2020","unstructured":"Rogers, W. et al. Radiomics: From qualitative to quantitative imaging. Br. J. Radiol. 93, 20190948. https:\/\/doi.org\/10.1259\/bjr.20190948 (2020).","journal-title":"Br. J. Radiol."},{"key":"37319_CR28","doi-asserted-by":"publisher","first-page":"1239","DOI":"10.1016\/j.jacr.2019.05.047","volume":"16","author":"T Mart\u00edn Noguerol","year":"2019","unstructured":"Mart\u00edn Noguerol, T., Paulano-Godino, F., Mart\u00edn-Valdivia, M. T., Menias, C. O. & Luna, A. Strengths, weaknesses, opportunities, and threats analysis of artificial intelligence and machine learning applications in radiology. J. Am. Coll. Radiol. 16, 1239\u20131247. https:\/\/doi.org\/10.1016\/j.jacr.2019.05.047 (2019).","journal-title":"J. Am. Coll. Radiol."},{"key":"37319_CR29","doi-asserted-by":"publisher","first-page":"2050","DOI":"10.1111\/liv.14555","volume":"40","author":"J Wei","year":"2020","unstructured":"Wei, J. et al. Radiomics in liver diseases: Current progress and future opportunities. Liver Int. 40, 2050\u20132063. https:\/\/doi.org\/10.1111\/liv.14555 (2020).","journal-title":"Liver Int."},{"key":"37319_CR30","doi-asserted-by":"publisher","first-page":"R150","DOI":"10.1088\/0031-9155\/61\/13\/R150","volume":"61","author":"SS Yip","year":"2016","unstructured":"Yip, S. S. & Aerts, H. J. Applications and limitations of radiomics. Phys. Med. Biol. 61, R150-166. https:\/\/doi.org\/10.1088\/0031-9155\/61\/13\/R150 (2016).","journal-title":"Phys. Med. Biol."},{"key":"37319_CR31","doi-asserted-by":"publisher","first-page":"3458","DOI":"10.7150\/ijbs.71046","volume":"18","author":"L Zhang","year":"2022","unstructured":"Zhang, L. et al. The progress of multimodal imaging combination and subregion based radiomics research of cancers. Int. J. Biol. Sci. 18, 3458\u20133469. https:\/\/doi.org\/10.7150\/ijbs.71046 (2022).","journal-title":"Int. J. Biol. Sci."},{"key":"37319_CR32","doi-asserted-by":"publisher","first-page":"1089","DOI":"10.1186\/s12885-018-5003-4","volume":"18","author":"Z Yao","year":"2018","unstructured":"Yao, Z. et al. Preoperative diagnosis and prediction of hepatocellular carcinoma: Radiomics analysis based on multi-modal ultrasound images. BMC Cancer 18, 1089. https:\/\/doi.org\/10.1186\/s12885-018-5003-4 (2018).","journal-title":"BMC Cancer"},{"key":"37319_CR33","doi-asserted-by":"publisher","first-page":"7035","DOI":"10.12659\/MSM.914395","volume":"25","author":"J Niu","year":"2019","unstructured":"Niu, J. et al. Correlation between doppler ultrasound blood flow parameters and angiogenesis and proliferation activity in breast cancer. Med. Sci. Monit. 25, 7035\u20137041. https:\/\/doi.org\/10.12659\/MSM.914395 (2019).","journal-title":"Med. Sci. Monit."},{"key":"37319_CR34","doi-asserted-by":"publisher","first-page":"1822","DOI":"10.3892\/etm.2020.8868","volume":"20","author":"X Song","year":"2020","unstructured":"Song, X., Liang, B., Wang, C. & Shi, S. Clinical value of color Doppler ultrasound combined with serum CA153, CEA and TSGF detection in the diagnosis of breast cancer. Exp. Ther. Med. 20, 1822\u20131828. https:\/\/doi.org\/10.3892\/etm.2020.8868 (2020).","journal-title":"Exp. Ther. Med."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-37319-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-37319-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-37319-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,28]],"date-time":"2023-06-28T16:07:26Z","timestamp":1687968446000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-37319-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,28]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["37319"],"URL":"https:\/\/doi.org\/10.1038\/s41598-023-37319-2","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,28]]},"assertion":[{"value":"14 January 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 June 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 June 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"10500"}}