{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T10:51:02Z","timestamp":1791888662869,"version":"4.3.4"},"reference-count":33,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,11,10]],"date-time":"2020-11-10T00:00:00Z","timestamp":1604966400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006196","name":"Oulun Yliopisto","doi-asserted-by":"publisher","award":["Strategic Funding (Infotech)"],"award-info":[{"award-number":["Strategic Funding (Infotech)"]}],"id":[{"id":"10.13039\/501100006196","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100009450","name":"KAUTE-S\u00e4\u00e4ti\u00f6","doi-asserted-by":"publisher","award":["Doctoral research grant 05\/2017"],"award-info":[{"award-number":["Doctoral research grant 05\/2017"]}],"id":[{"id":"10.13039\/100009450","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Knee osteoarthritis (OA) is the most common musculoskeletal disease in the world. In primary healthcare, knee OA is diagnosed using clinical examination and radiographic assessment. Osteoarthritis Research Society International (OARSI) atlas of OA radiographic features allows performing independent assessment of knee osteophytes, joint space narrowing and other knee features. This provides a fine-grained OA severity assessment of the knee, compared to the gold standard and most commonly used Kellgren\u2013Lawrence (KL) composite score. In this study, we developed an automatic method to predict KL and OARSI grades from knee radiographs. Our method is based on Deep Learning and leverages an ensemble of residual networks with 50 layers. We used transfer learning from ImageNet with a fine-tuning on the Osteoarthritis Initiative (OAI) dataset. An independent testing of our model was performed on the Multicenter Osteoarthritis Study (MOST) dataset. Our method yielded Cohen\u2019s kappa coefficients of 0.82 for KL-grade and 0.79, 0.84, 0.94, 0.83, 0.84 and 0.90 for femoral osteophytes, tibial osteophytes and joint space narrowing for lateral and medial compartments, respectively. Furthermore, our method yielded area under the ROC curve of 0.98 and average precision of 0.98 for detecting the presence of radiographic OA, which is better than the current state-of-the-art.<\/jats:p>","DOI":"10.3390\/diagnostics10110932","type":"journal-article","created":{"date-parts":[[2020,11,10]],"date-time":"2020-11-10T14:10:41Z","timestamp":1605017441000},"page":"932","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":119,"title":["Automatic Grading of Individual Knee Osteoarthritis Features in Plain Radiographs Using Deep Convolutional Neural Networks"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7852-4141","authenticated-orcid":false,"given":"Aleksei","family":"Tiulpin","sequence":"first","affiliation":[{"name":"Research Unit of Medical Imaging, Physics and Technology, University of Oulu, 90220 Oulu, Finland"},{"name":"Department of Diagnostic Radiology, Oulu University Hospital, 90220 Oulu, Finland"},{"name":"Ailean Technologies Oy, 90230 Oulu, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2850-5484","authenticated-orcid":false,"given":"Simo","family":"Saarakkala","sequence":"additional","affiliation":[{"name":"Research Unit of Medical Imaging, Physics and Technology, University of Oulu, 90220 Oulu, Finland"},{"name":"Department of Diagnostic Radiology, Oulu University Hospital, 90220 Oulu, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.berh.2005.09.007","article-title":"Osteoarthritis: Epidemiology","volume":"20","author":"Arden","year":"2006","journal-title":"Best Pract. Res. Clin. Rheumatol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1323","DOI":"10.1136\/annrheumdis-2013-204763","article-title":"The global burden of hip and knee osteoarthritis: Estimates from the global burden of disease 2010 study","volume":"73","author":"Cross","year":"2014","journal-title":"Ann. Rheum. Dis."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1038\/nrrheum.2012.224","article-title":"Tackling obesity in knee osteoarthritis","volume":"9","author":"Wluka","year":"2013","journal-title":"Nat. Rev. Rheumatol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1727","DOI":"10.1038\/s41598-018-20132-7","article-title":"Automatic knee osteoarthritis diagnosis from plain radiographs: A deep learning-based approach","volume":"8","author":"Tiulpin","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1136\/ard.16.4.494","article-title":"Radiological assessment of osteo-arthrosis","volume":"16","author":"Kellgren","year":"1957","journal-title":"Ann. Rheum. Dis."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"A1","DOI":"10.1016\/j.joca.2006.11.009","article-title":"Atlas of individual radiographic features in osteoarthritis, revised","volume":"15","author":"Altman","year":"2007","journal-title":"Osteoarthr. Cartil."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","article-title":"A guide to deep learning in healthcare","volume":"25","author":"Esteva","year":"2019","journal-title":"Nat. Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1002\/jmri.26246","article-title":"3D convolutional neural networks for detection and severity staging of meniscus and PFJ cartilage morphological degenerative changes in osteoarthritis and anterior cruciate ligament subjects","volume":"49","author":"Pedoia","year":"2019","journal-title":"J. Magn. Reson. Imaging"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1148\/radiol.2018172322","article-title":"Use of 2D U-Net convolutional neural networks for automated cartilage and meniscus segmentation of knee MR imaging data to determine relaxometry and morphometry","volume":"288","author":"Norman","year":"2018","journal-title":"Radiology"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tiulpin, A., Finnil\u00e4, M., Lehenkari, P., Nieminen, H.J., and Saarakkala, S. (2019). Deep-Learning for Tidemark Segmentation in Human Osteochondral Tissues Imaged with Micro-computed Tomography. arXiv.","DOI":"10.1007\/978-3-030-40605-9_12"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tiulpin, A., Klein, S., Bierma-Zeinstra, S., Thevenot, J., Rahtu, E., Van Meurs, J., Oei, E.H., and Saarakkala, S. (2019). Multimodal Machine Learning-based Knee Osteoarthritis Progression Prediction from Plain Radiographs and Clinical Data. arXiv.","DOI":"10.1038\/s41598-019-56527-3"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Antony, J., McGuinness, K., Moran, K., and O\u2019Connor, N.E. (2017). Automatic detection of knee joints and quantification of knee osteoarthritis severity using convolutional neural networks. Proceedings of the International Conference on Machine Learning and Data Mining in Pattern Recognition, Leipzig, Germany, 18\u201320 July 2007, Springer.","DOI":"10.1007\/978-3-319-62416-7_27"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1007\/s10278-018-0098-3","article-title":"Applying Densely Connected Convolutional Neural Networks for Staging Osteoarthritis Severity from Plain Radiographs","volume":"32","author":"Norman","year":"2018","journal-title":"J. Digit. Imaging"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Xue, Y., Zhang, R., Deng, Y., Chen, K., and Jiang, T. (2017). A preliminary examination of the diagnostic value of deep learning in hip osteoarthritis. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0178992"},{"key":"ref_15","unstructured":"Antony, A.J. (2018). Automatic Quantification of Radiographic Knee Osteoarthritis Severity and Associated Diagnostic Features Using Deep Convolutional Neural Networks. [Ph.D. Thesis, Dublin City University]."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Doll\u00e1r, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1462","DOI":"10.1109\/TMI.2013.2258030","article-title":"Fully automatic segmentation of the proximal femur using random forest regression voting","volume":"32","author":"Lindner","year":"2013","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TMI.2016.2528162","article-title":"Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning","volume":"35","author":"Shin","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1568","DOI":"10.1007\/s00330-004-2312-6","article-title":"Fixed-flexion radiography of the knee provides reproducible joint space width measurements in osteoarthritis","volume":"14","author":"Kothari","year":"2004","journal-title":"Eur. Radiol."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Tiulpin, A., Thevenot, J., Rahtu, E., and Saarakkala, S. (2017). A Novel Method for Automatic Localization of Joint Area on Knee Plain Radiographs. Proceedings of the Scandinavian Conference on Image Analysis, Troms\u00f8, Norway, 12\u201314 June 2017, Springer.","DOI":"10.1007\/978-3-319-59129-2_25"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_24","unstructured":"Qiu, S. (2018). Global Weighted Average Pooling Bridges Pixel-level Localization and Image-level Classification. arXiv."},{"key":"ref_25","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_26","unstructured":"Tiulpin, A. (2020, November 10). SOLT: Streaming over Lightweight Transformations. Available online: https:\/\/github.com\/MIPT-Oulu\/solt."},{"key":"ref_27","unstructured":"Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., and Lerer, A. (2020, November 10). Automatic Differentiation in PyTorch. NIPS-W. Available online: https:\/\/openreview.net\/forum?id=BJJsrmfCZ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e25","DOI":"10.3928\/01477447-20121217-14","article-title":"Validity and reliability of radiographic knee osteoarthritis measures by arthroplasty surgeons","volume":"36","author":"Riddle","year":"2013","journal-title":"Orthopedics"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1007\/s00776-010-1545-2","article-title":"Normal and threshold values of radiographic parameters for knee osteoarthritis using a computer-assisted measuring system (KOACAD): The ROAD study","volume":"15","author":"Oka","year":"2010","journal-title":"J. Orthop. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Thomson, J., O\u2019Neill, T., Felson, D., and Cootes, T. (2016). Detecting Osteophytes in Radiographs of the Knee to Diagnose Osteoarthritis. Proceedings of the International Workshop on Machine Learning in Medical Imaging, Athens, Greece, 17 October 2016, Springer.","DOI":"10.1007\/978-3-319-47157-0_6"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Antony, J., McGuinness, K., O\u2019Connor, N.E., and Moran, K. (2016, January 4\u20138). Quantifying radiographic knee osteoarthritis severity using deep convolutional neural networks. Proceedings of the 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico.","DOI":"10.1109\/ICPR.2016.7899799"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"20170387","DOI":"10.1098\/rsif.2017.0387","article-title":"Opportunities and obstacles for deep learning in biology and medicine","volume":"15","author":"Ching","year":"2018","journal-title":"J. R. Soc. Interface"},{"key":"ref_33","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/10\/11\/932\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:31:49Z","timestamp":1760178709000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/10\/11\/932"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,10]]},"references-count":33,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["diagnostics10110932"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics10110932","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,10]]}}}