{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T13:04:00Z","timestamp":1784120640892,"version":"3.55.0"},"reference-count":18,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,3,4]],"date-time":"2024-03-04T00:00:00Z","timestamp":1709510400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Med."],"abstract":"<jats:sec><jats:title>Objective<\/jats:title><jats:p>To develop an artificial intelligence (AI) model able to perform both segmentation of hand joint ultrasound images for osteophytes, bone, and synovium and perform osteophyte severity scoring following the EULAR-OMERACT grading system (EOGS) for hand osteoarthritis (OA).<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>One hundred sixty patients with pain or reduced function of the hands were included. Ultrasound images of the metacarpophalangeal (MCP), proximal interphalangeal (PIP), distal interphalangeal (DIP), and first carpometacarpal (CMC1) joints were then manually segmented for bone, synovium and osteophytes and scored from 0 to 3 according to the EOGS for OA. Data was divided into a training, validation, and test set. The AI model was trained on the training data to perform bone, synovium, and osteophyte identification on the images. Based on the manually performed image segmentation, an AI was trained to classify the severity of osteophytes according to EOGS from 0 to 3. Percent Exact Agreement (PEA) and Percent Close Agreement (PCA) were assessed on individual joints and overall. PCA allows a difference of one EOGS grade between doctor assessment and AI.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>A total of 4615 ultrasound images were used for AI development and testing. The developed AI model scored on the test set for the MCP joints a PEA of 76% and PCA of 97%; for PIP, a PEA of 70% and PCA of 97%; for DIP, a PEA of 59% and PCA of 94%, and CMC a PEA of 50% and PCA of 82%. Combining all joints, we found a PEA between AI and doctor assessments of 68% and a PCA of 95%.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>The developed AI model can perform joint ultrasound image segmentation and severity scoring of osteophytes, according to the EOGS. As proof of concept, this first version of the AI model is successful, as the agreement performance is slightly higher than previously found agreements between experts when assessing osteophytes on hand OA ultrasound images. The segmentation of the image makes the AI explainable to the doctor, who can immediately see why the AI applies a given score. Future validation in hand OA cohorts is necessary though.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fmed.2024.1297088","type":"journal-article","created":{"date-parts":[[2024,3,4]],"date-time":"2024-03-04T04:53:55Z","timestamp":1709528035000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Artificial intelligence model for segmentation and severity scoring of osteophytes in hand osteoarthritis on ultrasound images"],"prefix":"10.3389","volume":"11","author":[{"given":"Benjamin Schultz","family":"Overgaard","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anders Bossel Holst","family":"Christensen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lene","family":"Terslev","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thiusius Rajeeth","family":"Savarimuthu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S\u00f8ren Andreas","family":"Just","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,3,4]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1204","DOI":"10.1002\/art.40097","article-title":"Lifetime risk of symptomatic hand osteoarthritis: The Johnston county osteoarthritis project.","volume":"69","author":"Qin","year":"2017","journal-title":"Arthritis Rheumatol."},{"key":"B2","doi-asserted-by":"crossref","first-page":"1408","DOI":"10.1111\/1756-185X.14435","article-title":"Determinants of quality of life and hand function among people with hand osteoarthritis.","volume":"25","author":"Pathmanathan","year":"2022","journal-title":"Int J Rheum Dis."},{"key":"B3","doi-asserted-by":"crossref","DOI":"10.1136\/rmdopen-2022-002367","article-title":"Hand osteoarthritis is associated with limitations in paid and unpaid work participation and related societal costs: The HOSTAS cohort.","volume":"8","author":"Terpstra","year":"2022","journal-title":"RMD Open."},{"key":"B4","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1038\/nrrheum.2011.170","article-title":"Hand osteoarthritis\u2013a heterogeneous disorder.","volume":"8","author":"Kloppenburg","year":"2011","journal-title":"Nat Rev Rheumatol."},{"key":"B5","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1136\/annrheumdis-2011-201195","article-title":"Ultrasonographic assessment of osteophytes in 127 patients with hand osteoarthritis: Exploring reliability and associations with MRI, radiographs and clinical joint findings.","volume":"72","author":"Mathiessen","year":"2013","journal-title":"Ann Rheum Dis."},{"key":"B6","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1136\/ard.2007.077081","article-title":"The development of a preliminary ultrasonographic scoring system for features of hand osteoarthritis.","volume":"67","author":"Keen","year":"2008","journal-title":"Ann Rheum Dis."},{"key":"B7","doi-asserted-by":"publisher","first-page":"402","DOI":"10.1136\/annrheumdis-2014-206289","article-title":"Global ultrasound assessment of structural lesions in osteoarthritis: A reliability study by the OMERACT ultrasonography group on scoring cartilage and osteophytes in finger joints.","volume":"75","author":"Hammer","year":"2016","journal-title":"Ann Rheum Dis."},{"key":"B8","doi-asserted-by":"crossref","first-page":"2005","DOI":"10.1002\/acr.24734","article-title":"Ultrasonography of inflammatory and structural lesions in hand osteoarthritis: An outcome measures in rheumatology agreement and reliability study.","volume":"74","author":"Mathiessen","year":"2022","journal-title":"Arthritis Care Res."},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1186\/s42358-022-00263-2","article-title":"Ultrasound joint examination by an automated system versus by a rheumatologist: From a patient perspective.","volume":"62","author":"Frederiksen","year":"2022","journal-title":"Adv Rheumatol."},{"key":"B10","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1136\/annrheumdis-2019-216636","article-title":"Applying cascaded convolutional neural network design further enhances automatic scoring of arthritis disease activity on ultrasound images from rheumatoid arthritis patients.","volume":"79","author":"Christensen","year":"2020","journal-title":"Ann Rheum Dis."},{"key":"B11","doi-asserted-by":"crossref","DOI":"10.1136\/rmdopen-2018-000891","article-title":"Neural networks for automatic scoring of arthritis disease activity on ultrasound images.","volume":"5","author":"Andersen","year":"2019","journal-title":"RMD Open."},{"key":"B12","doi-asserted-by":"crossref","first-page":"1893","DOI":"10.1002\/art.42296","article-title":"Artificial intelligence and deep learning for rheumatologists.","volume":"74","author":"McMaster","year":"2022","journal-title":"Arthritis Rheumatol."},{"key":"B13","doi-asserted-by":"crossref","first-page":"2402","DOI":"10.1001\/jama.2016.17216","article-title":"Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs.","volume":"316","author":"Gulshan","year":"2016","journal-title":"JAMA."},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.105117","article-title":"A deep-learning framework for metacarpal-head cartilage-thickness estimation in ultrasound rheumatological images.","volume":"141","author":"Fiorentino","year":"2022","journal-title":"Comput Biol Med."},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2021.589197","article-title":"Artificial intelligence for ultrasound informative image selection of metacarpal head cartilage. A pilot study.","volume":"8","author":"Cipolletta","year":"2021","journal-title":"Front Med."},{"key":"B16","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1002\/jcu.23143","article-title":"A deep learning classification of metacarpophalangeal joints synovial proliferation in rheumatoid arthritis by ultrasound images.","volume":"50","author":"Wu","year":"2022","journal-title":"J Clin Ultrasound."},{"key":"B17","year":"2023","journal-title":"Computer vision annotation Tool (CVAT)."},{"key":"B18","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/978-3-030-00889-5_1","article-title":"UNet++: A nested u-net architecture for medical image segmentation.","volume":"11045","author":"Zhou","year":"2018","journal-title":"Deep Learn Med Image Anal Multimodal Learn Clin Decis Support (2018)."}],"container-title":["Frontiers in Medicine"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmed.2024.1297088\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,4]],"date-time":"2024-03-04T04:54:01Z","timestamp":1709528041000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmed.2024.1297088\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,4]]},"references-count":18,"alternative-id":["10.3389\/fmed.2024.1297088"],"URL":"https:\/\/doi.org\/10.3389\/fmed.2024.1297088","relation":{},"ISSN":["2296-858X"],"issn-type":[{"value":"2296-858X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,4]]},"article-number":"1297088"}}