{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T09:15:13Z","timestamp":1775121313325,"version":"3.50.1"},"reference-count":22,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T00:00:00Z","timestamp":1775088000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background\/Objectives: Natural language processing (NLP) has emerged as a promising approach for extracting clinically meaningful information from unstructured radiology reports. While most artificial intelligence applications in musculoskeletal imaging focus on image-based analysis, the potential of NLP for urgency assessment in superficial soft tissue ultrasound reports remains underexplored. This study aimed to develop and evaluate an NLP-based triage model to classify superficial soft tissue ultrasound reports according to clinical urgency in orthopedic practice. Methods: A curated dataset of superficial soft tissue ultrasound reports requested for palpable soft tissue masses and subcutaneous swellings was retrospectively collected from routine orthopedic outpatient practice. Reports were manually annotated into three triage categories: non-pathological (GREEN), non-urgent pathological (YELLOW), and urgent or potentially urgent findings (RED). A pretrained Turkish BERT model was fine-tuned for three-class classification. Model performance was evaluated using accuracy, macro-averaged F1 score, per-class precision and recall, and confusion matrices. An independent dataset of previously unseen reports was additionally used to assess robustness under real-world conditions. Results: After preprocessing and deduplication, 394 unique report segments were included. The baseline BERT model achieved an accuracy of 92.5% and a macro-averaged F1 score of 0.9106 on the test set. High classification performance was observed across all classes, with particularly reliable detection of RED reports representing urgent clinical conditions. External evaluation on independent reports demonstrated high agreement with physician annotations, with discrepancies mainly occurring in borderline or indeterminate cases. Conclusions: This study demonstrates that NLP-based analysis of superficial soft tissue ultrasound reports can effectively support urgency assessment in orthopedic practice. The proposed approach offers a practical, scalable, and image-independent solution for triage, with potential to improve workflow efficiency and facilitate timely clinical decision-making in musculoskeletal imaging.<\/jats:p>","DOI":"10.3390\/diagnostics16071068","type":"journal-article","created":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T07:57:55Z","timestamp":1775116675000},"page":"1068","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Natural Language Processing-Based Triage of Superficial Soft Tissue Ultrasound Reports in Orthopedic Practice"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0301-3432","authenticated-orcid":false,"given":"Nuri Koray","family":"\u00dclgen","sequence":"first","affiliation":[{"name":"Orthopaedics and Traumatology Clinic, Sincan Training and Research Hospital, University of Health Sciences, Ankara 06949, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mevl\u00fct Ayta\u00e7","family":"Demir","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Faculty of Engineering Architecture and Design, Bartin University, Bartin 74110, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ali Said","family":"Nazl\u0131g\u00fcl","sequence":"additional","affiliation":[{"name":"Orthopaedics and Traumatology Clinic, Sincan Training and Research Hospital, University of Health Sciences, Ankara 06949, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nihat","family":"Yi\u011fit","sequence":"additional","affiliation":[{"name":"Orthopaedics and Traumatology Clinic, Sincan Training and Research Hospital, University of Health Sciences, Ankara 06949, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4146-8318","authenticated-orcid":false,"given":"Sad\u0131k Emre","family":"Ergino\u011flu","sequence":"additional","affiliation":[{"name":"Orthopaedics and Traumatology Clinic, Sincan Training and Research Hospital, University of Health Sciences, Ankara 06949, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"\u00dcnal","family":"Demir","sequence":"additional","affiliation":[{"name":"Orthopaedics and Traumatology Clinic, Sincan Training and Research Hospital, University of Health Sciences, Ankara 06949, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mehmet Or\u00e7un","family":"Akkurt","sequence":"additional","affiliation":[{"name":"Orthopaedics and Traumatology Clinic, Sincan Training and Research Hospital, University of Health Sciences, Ankara 06949, T\u00fcrkiye"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,4,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Arzu, U., and Gencer, B. (2025). To Self-Treat or Not to Self-Treat: Evaluating the Diagnostic, Advisory and Referral Effectiveness of ChatGPT Responses to the Most Common Musculoskeletal Disorders. Diagnostics, 15.","DOI":"10.3390\/diagnostics15141834"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Gencer, B., Arzu, U., Orhan, S.S., Din\u00e7al, T., and Ekinci, M. (2025). Evaluation of ChatGPT Responses About Sexual Activity After Total Hip Arthroplasty: A Comparative Study with Observers of Different Experience Levels. J. Clin. Med., 14.","DOI":"10.3390\/jcm14092942"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","article-title":"High-performance medicine: The convergence of human and artificial intelligence","volume":"25","author":"Topol","year":"2019","journal-title":"Nat. Med."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Najjar, R. (2023). Redefining Radiology: A Review of Artificial Intelligence Integration in Medical Imaging. Diagnostics, 13.","DOI":"10.20944\/preprints202306.1124.v1"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","article-title":"A survey on deep learning in medical image analysis","volume":"42","author":"Litjens","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.clinimag.2023.02.014","article-title":"Natural language processing in radiology: Clinical applications and future directions","volume":"97","author":"Bobba","year":"2023","journal-title":"Clin. Imaging"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1007\/s10278-012-9531-1","article-title":"Automatic retrieval of bone fracture knowledge using natural language processing","volume":"26","author":"Do","year":"2013","journal-title":"J. Digit. Imaging"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1016\/j.jacr.2007.09.003","article-title":"Natural language processing using online analytic processing for assessing recommendations in radiology reports","volume":"5","author":"Dang","year":"2008","journal-title":"J. Am. Coll. Radiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1007\/s00330-023-09977-3","article-title":"Information extraction from weakly structured radiological reports with natural language queries","volume":"34","author":"Dada","year":"2024","journal-title":"Eur. Radiol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"439","DOI":"10.5435\/JAAOS-D-23-00839","article-title":"Applications of Natural Language Processing for Automated Clinical Data Analysis in Orthopaedics","volume":"32","author":"AlShehri","year":"2024","journal-title":"J. Am. Acad. Orthop. Surg."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1302\/2046-3758.127.BJR-2023-0111.R1","article-title":"Artificial intelligence in orthopaedic surgery","volume":"12","author":"Powling","year":"2023","journal-title":"Bone Jt. Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1016\/j.arth.2020.07.076","article-title":"Automated Detection of Periprosthetic Joint Infections and Data Elements Using Natural Language Processing","volume":"36","author":"Fu","year":"2021","journal-title":"J. Arthroplast."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1007\/s12178-021-09734-3","article-title":"Natural Language Processing and Its Use in Orthopaedic Research","volume":"14","author":"Wyatt","year":"2021","journal-title":"Curr. Rev. Musculoskelet. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.1016\/j.crad.2023.09.009","article-title":"Automatic classification and prioritisation of actionable BI-RADS categories using natural language processing models","volume":"79","author":"Luna","year":"2024","journal-title":"Clin. Radiol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1016\/j.jss.2020.07.015","article-title":"Thyroid Ultrasound Reports: Will the Thyroid Imaging, Reporting, and Data System Improve Natural Language Processing Capture of Critical Thyroid Nodule Features?","volume":"256","author":"Chen","year":"2020","journal-title":"J. Surg. Res."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Stewart, J., Lu, J., Goudie, A., Arendts, G., Meka, S.A., Freeman, S., Walker, K., Sprivulis, P., Sanfilippo, F., and Bennamoun, M. (2023). Applications of natural language processing at emergency department triage: A narrative review. PLoS ONE, 18.","DOI":"10.1371\/journal.pone.0279953"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Porto, B.M. (2024). Improving triage performance in emergency departments using machine learning and natural language processing: A systematic review. BMC Emerg. Med., 24.","DOI":"10.1186\/s12873-024-01135-2"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1902","DOI":"10.1016\/j.chest.2021.05.048","article-title":"Natural Language Processing to Identify Pulmonary Nodules and Extract Nodule Characteristics From Radiology Reports","volume":"160","author":"Zheng","year":"2021","journal-title":"Chest"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"108515","DOI":"10.1016\/j.cmpb.2024.108515","article-title":"Automatic TNM staging of colorectal cancer radiology reports using pre-trained language models","volume":"259","author":"Chizhikova","year":"2025","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1007\/s10278-024-01274-9","article-title":"A Large Language Model to Detect Negated Expressions in Radiology Reports","volume":"38","author":"Su","year":"2025","journal-title":"J. Imaging Inform. Med."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1002\/ohn.1244","article-title":"A Novel Natural Language Processing Model for Triaging Head and Neck Patient Appointments","volume":"173","author":"Seo","year":"2025","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3375","DOI":"10.1007\/s10278-024-01338-w","article-title":"Automated Detection of Cancer-Suspicious Findings in Japanese Radiology Reports with Natural Language Processing: A Multicenter Study","volume":"38","author":"Sugimoto","year":"2025","journal-title":"J. Imaging Inform. Med."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/16\/7\/1068\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T08:07:56Z","timestamp":1775117276000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/16\/7\/1068"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,2]]},"references-count":22,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2026,4]]}},"alternative-id":["diagnostics16071068"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics16071068","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,2]]}}}