{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T23:05:20Z","timestamp":1792191920996,"version":"4.4.0"},"reference-count":27,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,1,18]],"date-time":"2023-01-18T00:00:00Z","timestamp":1674000000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>Background: This study aims to evaluate the diagnostic performance of Deep Learning (DL) machine for the detection of adenomyosis on uterine ultrasonographic images and compare it to intermediate ultrasound skilled trainees. Methods: Prospective observational study were conducted between 1 and 30 April 2022. Transvaginal ultrasound (TVUS) diagnosis of adenomyosis was investigated by an experienced sonographer on 100 fertile-age patients. Videoclips of the uterine corpus were recorded and sequential ultrasound images were extracted. Intermediate ultrasound-skilled trainees and DL machine were asked to make a diagnosis reviewing uterine images. We evaluated and compared the accuracy, sensitivity, positive predictive value, F1-score, specificity and negative predictive value of the DL model and the trainees for adenomyosis diagnosis. Results: Accuracy of DL and intermediate ultrasound-skilled trainees for the diagnosis of adenomyosis were 0.51 (95% CI, 0.48\u20130.54) and 0.70 (95% CI, 0.60\u20130.79), respectively. Sensitivity, specificity and F1-score of DL were 0.43 (95% CI, 0.38\u20130.48), 0.82 (95% CI, 0.79\u20130.85) and 0.46 (0.42\u20130.50), respectively, whereas intermediate ultrasound-skilled trainees had sensitivity of 0.72 (95% CI, 0.52\u20130.86), specificity of 0.69 (95% CI, 0.58\u20130.79) and F1-score of 0.55 (95% CI, 0.43\u20130.66). Conclusions: In this preliminary study DL model showed a lower accuracy but a higher specificity in diagnosing adenomyosis on ultrasonographic images compared to intermediate-skilled trainees.<\/jats:p>","DOI":"10.3390\/ijerph20031724","type":"journal-article","created":{"date-parts":[[2023,1,18]],"date-time":"2023-01-18T01:57:57Z","timestamp":1674007077000},"page":"1724","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["Application of Deep Learning Model in the Sonographic Diagnosis of Uterine Adenomyosis"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3235-4378","authenticated-orcid":false,"given":"Diego","family":"Raimondo","sequence":"first","affiliation":[{"name":"Division of Gynecology and Human Reproduction Physiopathology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, 40126 Bologna, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5443-2333","authenticated-orcid":false,"given":"Antonio","family":"Raffone","sequence":"additional","affiliation":[{"name":"Division of Gynecology and Human Reproduction Physiopathology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, 40126 Bologna, Italy"},{"name":"Department of Medical and Surgical Sciences (DIMEC), University of Bologna, 40126 Bologna, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna Chiara","family":"Aru","sequence":"additional","affiliation":[{"name":"Division of Gynecology and Human Reproduction Physiopathology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, 40126 Bologna, Italy"},{"name":"Department of Medical and Surgical Sciences (DIMEC), University of Bologna, 40126 Bologna, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7515-5782","authenticated-orcid":false,"given":"Matteo","family":"Giorgi","sequence":"additional","affiliation":[{"name":"Department of Molecular and Developmental Medicine, Obstetrics and Gynecological Clinic, University of Siena, 53100 Siena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ilaria","family":"Giaquinto","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, Morgagni\u2013Pierantoni Hospital, 47100 Forl\u00ec, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5566-8479","authenticated-orcid":false,"given":"Emanuela","family":"Spagnolo","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, Hospital Universitario La Paz, Paseo de la Castellana, 28046 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonio","family":"Travaglino","sequence":"additional","affiliation":[{"name":"Pathology Unit, Department of Woman and Child\u2019s Health and Public Health Sciences, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, 00168 Rome, Italy"},{"name":"Pathology Unit, Department of Advanced Biomedical Sciences, School of Medicine, University of Naples Federico II, 80138 Naples, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Federico Andrea","family":"Galatolo","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, University of Pisa, 56100 Pisa, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1031-1959","authenticated-orcid":false,"given":"Mario Giovanni Cosimo Antonio","family":"Cimino","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, University of Pisa, 56100 Pisa, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2882-4223","authenticated-orcid":false,"given":"Jacopo","family":"Lenzi","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Neuromotor Sciences, University of Bologna, 40126 Bologna, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6113-7401","authenticated-orcid":false,"given":"Gabriele","family":"Centini","sequence":"additional","affiliation":[{"name":"Department of Molecular and Developmental Medicine, Obstetrics and Gynecological Clinic, University of Siena, 53100 Siena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9513-1980","authenticated-orcid":false,"given":"Lucia","family":"Lazzeri","sequence":"additional","affiliation":[{"name":"Department of Molecular and Developmental Medicine, Obstetrics and Gynecological Clinic, University of Siena, 53100 Siena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonio","family":"Mollo","sequence":"additional","affiliation":[{"name":"Gynecology and Obstetrics Unit, Department of Medicine, Surgery and Dentistry \u201cSchola Medica Salernitana\u201d, University of Salerno, 84084 Baronissi, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7487-1333","authenticated-orcid":false,"given":"Renato","family":"Seracchioli","sequence":"additional","affiliation":[{"name":"Division of Gynecology and Human Reproduction Physiopathology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, 40126 Bologna, Italy"},{"name":"Department of Medical and Surgical Sciences (DIMEC), University of Bologna, 40126 Bologna, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paolo","family":"Casadio","sequence":"additional","affiliation":[{"name":"Division of Gynecology and Human Reproduction Physiopathology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, 40126 Bologna, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1576","DOI":"10.1148\/rg.2018180080","article-title":"Adenomyosis: A Sonographic Diagnosis","volume":"38","author":"Cunningham","year":"2018","journal-title":"RadioGraphics"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1002\/uog.14806","article-title":"Terms, definitions and measurements to describe sonographic features of myometrium and uterine masses: A consensus opinion from the Morphological Uterus Sonographic Assessment (MUSA) group","volume":"46","author":"Dueholm","year":"2015","journal-title":"Ultrasound Obstet. Gynecol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1002\/uog.19096","article-title":"Sonographic classification and reporting system for diagnosing adenomyosis","volume":"53","author":"Dueholm","year":"2019","journal-title":"Ultrasound Obstet. Gynecol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1308","DOI":"10.1016\/j.jmig.2019.09.788","article-title":"New Sonographic Clas-sification of Adenomyosis: Do Type and Degree of Adenomyosis Correlate to Severity of Symptoms?","volume":"27","author":"Exacoustos","year":"2020","journal-title":"J. Minim. Invasive Gynecol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1097\/OGX.0000000000000346","article-title":"The Impact of Adenomyosis on Women\u2019s Fertility","volume":"71","author":"Harada","year":"2016","journal-title":"Obstet. Gynecol. Survey."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1405","DOI":"10.1002\/jum.15237","article-title":"Question Mark Sign and Transvaginal Ultrasound Uterine Tenderness for the Diagnosis of Adenomyosis","volume":"39","author":"Zannoni","year":"2020","journal-title":"J. Ultrasound Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3432","DOI":"10.1093\/humrep\/des332","article-title":"How common is adenomyosis? A prospective study of prevalence using transvaginal ultrasound in a gynaecology clinic","volume":"27","author":"Naftalin","year":"2012","journal-title":"Hum. Reprod."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1016\/j.ejogrb.2014.08.016","article-title":"Prevalence of adenomyosis in women undergoing surgery for endometriosis","volume":"181","author":"Montanari","year":"2014","journal-title":"Eur. J. Obstet. Gynecol. Reprod. Biol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1016\/j.fertnstert.2018.07.005","article-title":"A new era in diagnosing adenomyosis is coming","volume":"110","author":"Exacoustos","year":"2018","journal-title":"Fertil. Steril."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.jmig.2017.08.653","article-title":"Transvaginal Ultrasound for the Diagnosis of Adenomyosis: Systematic Review and Meta-Analysis","volume":"25","author":"Andres","year":"2018","journal-title":"J. Minim. Invasive Gynecol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1016\/j.jmig.2019.11.001","article-title":"Noninvasive Diagnosis of Adenomyosis: A Structured Review and Meta-analysis of Diagnostic Accuracy in Imaging","volume":"27","author":"Tellum","year":"2020","journal-title":"J. Minim. Invasive Gynecol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2289","DOI":"10.1002\/jum.15635","article-title":"Diagnostic Accuracy of Transvaginal Ul-trasound and Magnetic Resonance Imaging for Adenomyosis","volume":"40","author":"Liu","year":"2021","journal-title":"J. Ultrasound Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1002\/uog.24786","article-title":"Consensus on revised definitions of Morphological Uterus Sonographic Assess-ment (MUSA) features of adenomyosis: Results of modified Delphi procedure","volume":"60","author":"Harmsen","year":"2022","journal-title":"Ultrasound Obstet. Gynecol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1002\/jum.14971","article-title":"Intra- and Inter-Rater Agreement Describing Myometrial Lesions Using Morphologic Uterus Sonographic Assessment: A Pilot Study","volume":"38","author":"Rasmussen","year":"2019","journal-title":"J. Ultrasound Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1154","DOI":"10.1016\/j.fertnstert.2018.06.031","article-title":"A sonographic classification of adeno-myosis: Interobserver reproducibility in the evaluation of type and degree of the myometrial involvement","volume":"110","author":"Lazzeri","year":"2018","journal-title":"Fertil. Steril."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3","DOI":"10.2196\/10010","article-title":"Artificial Intelligence Versus Clinicians in Disease Diagnosis: Systematic Review","volume":"7","author":"Shen","year":"2019","journal-title":"JMIR Med. Inform."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.ejogrb.2021.04.012","article-title":"Artificial intelligence (AI) in the detection of rectosigmoid deep endometriosis","volume":"261","author":"Guerriero","year":"2021","journal-title":"Eur. J. Obstet. Gynecol. Reprod. Biol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1318","DOI":"10.1016\/j.jacr.2019.06.004","article-title":"A Survey of Deep-Learning Applications in Ultrasound: Artificial Intelligence-Powered Ultrasound for Improving Clinical Workflow","volume":"16","author":"Akkus","year":"2019","journal-title":"J. Am. Coll. Radiol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2577","DOI":"10.1111\/jog.14818","article-title":"Application of artificial intelligence in gynecologic malignancies: A review","volume":"47","author":"Sone","year":"2021","journal-title":"J. Obstet. Gynaecol. Res."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1002\/uog.23530","article-title":"Ultrasound image analysis using deep neural networks for discriminating between benign and malignant ovarian tumors: Comparison with expert subjective assessment","volume":"57","author":"Christiansen","year":"2021","journal-title":"Ultrasound Obstet. Gynecol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"573","DOI":"10.7326\/0003-4819-147-8-200710160-00010","article-title":"The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies","volume":"147","author":"Altman","year":"2007","journal-title":"Ann. Intern. Med."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1093\/humupd\/dmu046","article-title":"Systematic review of endometriosis pain assessment: How to choose a scale?","volume":"21","author":"Bourdel","year":"2015","journal-title":"Hum. Reprod. Update"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1111\/j.1471-0528.1990.tb16249.x","article-title":"Assessment of menstrual blood loss using a pictorial chart","volume":"97","author":"Higham","year":"1990","journal-title":"Br. J. Obstet. Gynaecol."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Freytag, D., G\u00fcnther, V., Maass, N., and Alkatout, I. (2021). Uterine Fibroids and Infertility. Diagnostics, 11.","DOI":"10.3390\/diagnostics11081455"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1002\/uog.15955","article-title":"Systematic approach to sonographic evaluation of the pelvis in women with suspected endometriosis, including terms, definitions and measurements: A consensus opinion from the International Deep Endometriosis Analysis (IDEA) group","volume":"48","author":"Guerriero","year":"2016","journal-title":"Ultrasound Obstet. Gynecol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1016\/j.jmig.2017.12.026","article-title":"Isolated Ovarian Endometrioma: A History Between Myth and Reality","volume":"25","author":"Exacoustos","year":"2018","journal-title":"J. Minim. Invasive Gynecol."},{"key":"ref_27","first-page":"8757281","article-title":"Early Learning Curve in the Assessment of Deep Pelvic Endometriosis for Ultrasound and Magnetic Resonance Imaging","volume":"2020","author":"Fischerova","year":"2020","journal-title":"BioMed Res. Int."}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/20\/3\/1724\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:08:48Z","timestamp":1760119728000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/20\/3\/1724"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,18]]},"references-count":27,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["ijerph20031724"],"URL":"https:\/\/doi.org\/10.3390\/ijerph20031724","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,18]]}}}