{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T02:58:29Z","timestamp":1767841109391,"version":"3.49.0"},"reference-count":53,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2023,4,12]],"date-time":"2023-04-12T00:00:00Z","timestamp":1681257600000},"content-version":"vor","delay-in-days":6,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"MUR\u2014REASONING"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,4,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Soft-tissue sarcomas (STSs) of the extremities are a group of malignancies arising from the mesenchymal cells that may develop distant metastases or local recurrence. In this article, we propose a novel methodology aimed to predict metastases and recurrence risk in patients with these malignancies by evaluating magnetic resonance radiomic features that will be formally verified through formal logic models.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>This is a retrospective study based on a public dataset evaluating MRI scans T2-weighted fat-saturated or short tau inversion recovery and patients having \u201cmetastases\/local recurrence\u201d (group B) or \u201cno metastases\/no local recurrence\u201d (group A) as clinical outcomes. Once radiomic features are extracted, they are included in formal models, on which is automatically verified the logic property written by a radiologist and his computer scientists coworkers.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Evaluating the Formal Methods efficacy in predicting distant metastases\/local recurrence in STSs (group A vs group B), our methodology showed a sensitivity and specificity of 0.81 and 0.67, respectively; this suggests that radiomics and formal verification may be useful in predicting future metastases or local recurrence development in soft tissue sarcoma.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Authors discussed about the literature to consider Formal Methods as a valid alternative to other Artificial Intelligence techniques.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>An innovative and noninvasive rigourous methodology can be significant in predicting local recurrence and metastases development in STSs. Future works can be the assessment on multicentric studies to extract objective disease information, enriching the connection between the radiomic quantitative analysis and the radiological clinical evidences.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamiaopen\/ooad025","type":"journal-article","created":{"date-parts":[[2023,4,12]],"date-time":"2023-04-12T21:27:08Z","timestamp":1681334828000},"source":"Crossref","is-referenced-by-count":9,"title":["Predicting risk of metastases and recurrence in soft-tissue sarcomas via Radiomics and Formal Methods"],"prefix":"10.1093","volume":"6","author":[{"given":"Roberto","family":"Casale","sequence":"first","affiliation":[{"name":"Department of Radiology, Institut Jules Bordet\u2014Universit\u00e9 Libre de Bruxelles (ULB) , Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2489-6158","authenticated-orcid":false,"given":"Giulia","family":"Varriano","sequence":"additional","affiliation":[{"name":"Department of Medicine and Health Sciences Vincenzo Tiberio, University of Molise , Campobasso, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antonella","family":"Santone","sequence":"additional","affiliation":[{"name":"Department of Medicine and Health Sciences Vincenzo Tiberio, University of Molise , Campobasso, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carmelo","family":"Messina","sequence":"additional","affiliation":[{"name":"IRCCS Galeazzi Orthopedic Institute , Milan, Italy"},{"name":"Department of Biomedical Sciences for Health, University of Milan , Milan, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chiara","family":"Casale","sequence":"additional","affiliation":[{"name":"Allergology Service, Dermatology Unit, Azienda Ospedaliera Universitaria di Modena , Modena, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Salvatore","family":"Gitto","sequence":"additional","affiliation":[{"name":"IRCCS Galeazzi Orthopedic Institute , Milan, Italy"},{"name":"Department of Biomedical Sciences for Health, University of Milan , Milan, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luca Maria","family":"Sconfienza","sequence":"additional","affiliation":[{"name":"IRCCS Galeazzi Orthopedic Institute , Milan, Italy"},{"name":"Department of Biomedical Sciences for Health, University of Milan , Milan, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria Antonietta","family":"Bali","sequence":"additional","affiliation":[{"name":"Department of Radiology, Institut Jules Bordet\u2014Universit\u00e9 Libre de Bruxelles (ULB) , Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luca","family":"Brunese","sequence":"additional","affiliation":[{"name":"Department of Medicine and Health Sciences Vincenzo Tiberio, University of Molise , Campobasso, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,4,12]]},"reference":[{"issue":"1","key":"2023072901270668300_ooad025-B1","doi-asserted-by":"crossref","first-page":"129","DOI":"10.2214\/ajr.164.1.7998525","article-title":"Malignant soft-tissue tumors in a large referral population: distribution of diagnoses by age, sex, and location","volume":"164","author":"Kransdorf","year":"1995","journal-title":"AJR Am J Roentgenol"},{"issue":"2","key":"2023072901270668300_ooad025-B2","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1002\/(SICI)1097-0142(19990115)85:2<389::AID-CNCR17>3.0.CO;2-J","article-title":"Multifactorial analysis of the survival of patients with distant metastasis arising from primary extremity sarcoma","volume":"85","author":"Billingsley","year":"1999","journal-title":"Cancer"},{"issue":"3","key":"2023072901270668300_ooad025-B3","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/S1479-666X(05)80044-7","article-title":"Soft tissue sarcoma: advances in understanding and management","volume":"3","author":"Brennan","year":"2005","journal-title":"Surgeon"},{"issue":"3","key":"2023072901270668300_ooad025-B4","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1097\/00000658-200203000-00015","article-title":"Analysis of the prognostic significance of microscopic margins in 2,084 localized primary adult soft tissue sarcomas","volume":"235","author":"Stojadinovic","year":"2002","journal-title":"Ann Surg"},{"issue":"10","key":"2023072901270668300_ooad025-B5","doi-asserted-by":"crossref","first-page":"820","DOI":"10.1016\/S0011-3840(96)80013-X","article-title":"Soft tissue sarcomas","volume":"33","author":"Lewis","year":"1996","journal-title":"Curr Problems Surg"},{"issue":"2","key":"2023072901270668300_ooad025-B6","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1023\/A:1020893200768","article-title":"Metastasis in soft tissue sarcomas: prognostic criteria and treatment perspectives","volume":"21","author":"Komdeur","year":"2002","journal-title":"Cancer Metastasis Rev"},{"issue":"14","key":"2023072901270668300_ooad025-B7","doi-asserted-by":"crossref","first-page":"5471","DOI":"10.1088\/0031-9155\/60\/14\/5471","article-title":"A radiomics model from joint fdg-pet and MRI texture features for the prediction of lung metastases in soft-tissue sarcomas of the extremities","volume":"60","author":"Valli\u00e9res","year":"2015","journal-title":"Phys Med Biol"},{"issue":"10","key":"2023072901270668300_ooad025-B8","doi-asserted-by":"crossref","first-page":"956","DOI":"10.1056\/NEJMe1200656","article-title":"Tumor heterogeneity and personalized medicine","volume":"366","author":"Longo","year":"2012","journal-title":"N Engl J Med"},{"issue":"9","key":"2023072901270668300_ooad025-B9","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1016\/j.mri.2012.06.010","article-title":"Radiomics: the process and the challenges","volume":"30","author":"Kumar","year":"2012","journal-title":"Magn Resonance Imaging"},{"issue":"4","key":"2023072901270668300_ooad025-B10","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1016\/j.ejca.2011.11.036","article-title":"Radiomics: extracting more information from medical images using advanced feature analysis","volume":"48","author":"Lambin","year":"2012","journal-title":"Eur J Cancer"},{"issue":"1","key":"2023072901270668300_ooad025-B11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13244-021-01008-3","article-title":"Ct and mri radiomics of bone and soft-tissue sarcomas: a systematic review of reproducibility and validation strategies","volume":"12","author":"Gitto","year":"2021","journal-title":"Insights Imaging"},{"key":"2023072901270668300_ooad025-B12","first-page":"1","article-title":"Diffusion weighted MRI radiomics of spine bone tumors: feature stability and machine learning-based classification performance","author":"Gitto","year":"2022","journal-title":"La Radiol Med"},{"issue":"1","key":"2023072901270668300_ooad025-B13","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1002\/jmri.25335","article-title":"Haralick textural features on T2-weighted MRI are associated with biochemical recurrence following radiotherapy for peripheral zone prostate cancer","volume":"45","author":"Gnep","year":"2017","journal-title":"J Magn Reson Imaging"},{"issue":"2","key":"2023072901270668300_ooad025-B14","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1007\/s00330-014-3420-6","article-title":"Quantitative ct texture and shape analysis: can it differentiate benign and malignant mediastinal lymph nodes in patients with primary lung cancer?","volume":"25","author":"Bayanati","year":"2015","journal-title":"Eur Radiol"},{"issue":"2","key":"2023072901270668300_ooad025-B15","doi-asserted-by":"crossref","first-page":"e0171683","DOI":"10.1371\/journal.pone.0171683","article-title":"Radiomic analysis reveals DCE-MRI features for prediction of molecular subtypes of breast cancer","volume":"12","author":"Fan","year":"2017","journal-title":"PLoS One"},{"key":"2023072901270668300_ooad025-B16","volume-title":"Machine Learning","author":"Mitchell","year":"2007"},{"key":"2023072901270668300_ooad025-B17","doi-asserted-by":"crossref","DOI":"10.1051\/epn\/2018505","volume-title":"Artificial Intelligence and Its Limits","author":"M\u00e9zard","year":"2018"},{"key":"2023072901270668300_ooad025-B18","volume-title":"Model Checking","author":"Clarke","year":"2018"},{"issue":"6","key":"2023072901270668300_ooad025-B19","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1109\/TSE.2003.1205179","article-title":"Heuristic search + local model checking in selective mu-calculus","volume":"29","author":"Santone","year":"2003","journal-title":"IIEEE Trans Software Eng"},{"issue":"6","key":"2023072901270668300_ooad025-B20","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1007\/s10278-013-9622-7","article-title":"The cancer imaging archive (TCIA): maintaining and operating a public information repository","volume":"26","author":"Clark","year":"2013","journal-title":"J Digit Imaging"},{"issue":"1","key":"2023072901270668300_ooad025-B21","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1186\/s40644-021-00438-y","article-title":"PET\/MR fusion texture analysis for the clinical outcome prediction in soft-tissue sarcoma","volume":"22","author":"Zhao","year":"2022","journal-title":"Cancer Imaging"},{"issue":"9","key":"2023072901270668300_ooad025-B22","doi-asserted-by":"crossref","first-page":"1323","DOI":"10.1016\/j.mri.2012.05.001","article-title":"3d slicer as an image computing platform for the quantitative imaging network","volume":"30","author":"Fedorov","year":"2012","journal-title":"Magn Resonance Imaging"},{"issue":"21","key":"2023072901270668300_ooad025-B23","doi-asserted-by":"crossref","first-page":"e104\u20137","DOI":"10.1158\/0008-5472.CAN-17-0339","article-title":"Computational radiomics system to decode the radiographic phenotype","volume":"77","author":"Van Griethuysen","year":"2017","journal-title":"Cancer Res"},{"issue":"2","key":"2023072901270668300_ooad025-B24","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1148\/radiol.2020191145","article-title":"The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping","volume":"295","author":"Zwanenburg","year":"2020","journal-title":"Radiology"},{"issue":"1","key":"2023072901270668300_ooad025-B25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13244-020-00887-2","article-title":"Radiomics in medical imaging\u2014\u201chow-to\u201d guide and critical reflection","volume":"11","author":"van Timmeren","year":"2020","journal-title":". Insights Imaging"},{"issue":"1","key":"2023072901270668300_ooad025-B26","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1145\/1656274.1656278","article-title":"The weka data mining software: an update","volume":"11","author":"Hall","year":"2009","journal-title":"SIGKDD Explor Newsl"},{"key":"2023072901270668300_ooad025-B27","first-page":"4","volume-title":"Data Mining","author":"Witten","year":"2005"},{"key":"2023072901270668300_ooad025-B28","volume-title":"Communication and Concurrency","author":"Milner","year":"1989"},{"key":"2023072901270668300_ooad025-B29","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/j.mri.2019.08.030","article-title":"Formal methods for prostate cancer gleason score and treatment prediction using radiomic biomarkers","volume":"66","author":"Brunese","year":"2020","journal-title":"Magn Reson Imaging"},{"issue":"9","key":"2023072901270668300_ooad025-B30","doi-asserted-by":"crossref","first-page":"1346","DOI":"10.1016\/j.scico.2012.07.015","article-title":"Incremental construction of systems: an efficient characterization of the lacking sub-system","volume":"78","author":"Santone","year":"2013","journal-title":"Sci Comput Program"},{"issue":"3","key":"2023072901270668300_ooad025-B31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2560563","article-title":"Grease: a tool for efficient \u201cnonequivalence\u201d checking","volume":"23","author":"De Francesco","year":"2014","journal-title":"ACM Trans Softw Eng Methodol"},{"issue":"5","key":"2023072901270668300_ooad025-B32","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/MC.2016.131","article-title":"Insights on formal methods in cybersecurity","volume":"49","author":"Voas","year":"2016","journal-title":"Computer"},{"key":"2023072901270668300_ooad025-B33","first-page":"117","author":"Poorhadi","year":"2021"},{"key":"2023072901270668300_ooad025-B34","first-page":"263","author":"Cimitile","year":"2017"},{"key":"2023072901270668300_ooad025-B35","first-page":"26","author":"Ruvo","year":"2015"},{"key":"2023072901270668300_ooad025-B36","first-page":"185","volume-title":"Descriptive Complexity and Finite Models","author":"Emerson","year":"1996"},{"issue":"3","key":"2023072901270668300_ooad025-B37","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/s10654-011-9561-x","article-title":"Sensitivity \u00d7 ppv is a recognized test called the clinical utility index (CUI","volume":"26","author":"Mitchell","year":"2011","journal-title":"Eur J Epidemiol"},{"issue":"5","key":"2023072901270668300_ooad025-B38","doi-asserted-by":"crossref","first-page":"1439","DOI":"10.1016\/j.ijrobp.2004.08.036","article-title":"Histologic assessment of peritumoral edema in soft tissue sarcoma","volume":"61","author":"White","year":"2005","journal-title":"Int J Radiat Oncol Biol Phys"},{"key":"2023072901270668300_ooad025-B39","doi-asserted-by":"crossref","first-page":"e104","DOI":"10.1158\/0008-5472.CAN-17-0339","article-title":", et al. Computational radiomics system to decode the radiographic phenotype","author":"Van Griethuysen","year":"2017","journal-title":"Cancer Res"},{"issue":"6","key":"2023072901270668300_ooad025-B40","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1007\/s13244-012-0196-6","article-title":"Assessment of tumor heterogeneity: an emerging imaging tool for clinical practice?","volume":"3","author":"Davnall","year":"2012","journal-title":"Insights Imaging"},{"issue":"6","key":"2023072901270668300_ooad025-B41","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1097\/PAS.0b013e31821a0696","article-title":"Effect of tumor heterogeneity on the assessment of ki67 labeling index in well-differentiated neuroendocrine tumors metastatic to the liver: implications for prognostic stratification","volume":"35","author":"Yang","year":"2011","journal-title":"Am J Surg Pathol"},{"issue":"19","key":"2023072901270668300_ooad025-B42","first-page":"4509","article-title":"Association between tumor hypoxia and malignant progression in advanced cancer of the uterine cervix","volume":"56","author":"Hockel","year":"1996","journal-title":"Cancer Res"},{"issue":"12","key":"2023072901270668300_ooad025-B43","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1016\/j.crad.2004.07.008","article-title":"Texture analysis of medical images","volume":"59","author":"Castellano","year":"2004","journal-title":"Clin Radiol"},{"issue":"3","key":"2023072901270668300_ooad025-B44","doi-asserted-by":"crossref","first-page":"710","DOI":"10.1148\/radiol.2019181659","article-title":"Soft tissue sarcomas: assessment of MRI features correlating with histologic grade and patient outcome","volume":"291","author":"Cromb\u00e9","year":"2019","journal-title":"Radiology"},{"key":"2023072901270668300_ooad025-B45","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1016\/j.ebiom.2019.08.059","article-title":"Tumor grading of soft tissue sarcomas using mri-based radiomics","volume":"48","author":"Peeken","year":"2019","journal-title":"EBioMedicine"},{"key":"2023072901270668300_ooad025-B46","volume-title":"World Health Organization Classification of Tumours. Pathology and Genetics of Tumours of Soft Tissue and Bone","author":"Fletcher","year":"2002"},{"issue":"1","key":"2023072901270668300_ooad025-B47","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1111\/j.1365-2559.2005.02284.x","article-title":"The evolving classification of soft tissue tumours: an update based on the new who classification","volume":"48","author":"Fletcher","year":"2006","journal-title":"Histopathology"},{"issue":"5","key":"2023072901270668300_ooad025-B48","doi-asserted-by":"crossref","first-page":"2413","DOI":"10.1007\/s00330-019-06562-5","article-title":"Can radiomics improve the prediction of metastatic relapse of myxoid\/round cell liposarcomas?","volume":"30","author":"Cromb\u00e9","year":"2020","journal-title":"Eur Radiol"},{"issue":"1","key":"2023072901270668300_ooad025-B49","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1002\/jmri.27040","article-title":"High-grade soft-tissue sarcomas: Can optimizing dynamic contrast-enhanced mri postprocessing improve prognostic radiomics models?","volume":"52","author":"Cromb\u00e9","year":"2020","journal-title":"J Magn Reson Imaging"},{"issue":"1","key":"2023072901270668300_ooad025-B50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-020-72535-0","article-title":"Intensity harmonization techniques influence radiomics features and radiomics-based predictions in sarcoma patients","volume":"10","author":"Cromb\u00e9","year":"2020","journal-title":"Sci Rep"},{"issue":"2","key":"2023072901270668300_ooad025-B51","doi-asserted-by":"crossref","first-page":"158.e19","DOI":"10.1016\/j.crad.2020.08.038","article-title":"Radiomics-based machine learning method for prediction of distant metastasis from soft-tissue sarcomas","volume":"76","author":"Tian","year":"2021","journal-title":"Clin Radiol"},{"issue":"22","key":"2023072901270668300_ooad025-B52","doi-asserted-by":"crossref","first-page":"8536","DOI":"10.1088\/1361-6560\/aa8a49","article-title":"Enhancement of multimodality texture-based prediction models via optimization of PET and MR image acquisition protocols: a proof of concept","volume":"62","author":"Valli\u00e9res","year":"2017","journal-title":"Phys Med Biol"},{"key":"2023072901270668300_ooad025-B53","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1007\/978-81-322-3972-7_19","volume-title":"Fundamentals of Artificial Intelligence","author":"Chowdhary","year":"2020"}],"container-title":["JAMIA Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article-pdf\/6\/2\/ooad025\/51003499\/ooad025.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article-pdf\/6\/2\/ooad025\/51003499\/ooad025.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,29]],"date-time":"2023-07-29T01:28:06Z","timestamp":1690594086000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamiaopen\/article\/doi\/10.1093\/jamiaopen\/ooad025\/7116329"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,6]]},"references-count":53,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4,6]]}},"URL":"https:\/\/doi.org\/10.1093\/jamiaopen\/ooad025","relation":{},"ISSN":["2574-2531"],"issn-type":[{"value":"2574-2531","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,7,1]]},"published":{"date-parts":[[2023,4,6]]},"article-number":"ooad025"}}