{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T04:44:58Z","timestamp":1791866698448,"version":"4.3.4"},"reference-count":29,"publisher":"Optica Publishing Group","issue":"7","license":[{"start":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T00:00:00Z","timestamp":1782172800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T00:00:00Z","timestamp":1782172800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/opg.optica.org\/policies\/opg-tdm-policy.json"}],"funder":[{"name":"Science and Technology Department of Zhejiang Province","award":["2025C02159"],"award-info":[{"award-number":["2025C02159"]}],"id":[{"id":"https:\/\/ror.org\/05yj3y977","id-type":"ROR","asserted-by":"publisher"}]},{"name":"National Natural Science Foundation of China","award":["W2412107"],"award-info":[{"award-number":["W2412107"]}],"id":[{"id":"https:\/\/ror.org\/01h0zpd94","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Ministry of Science and Technology of the People's Republic of China","award":["2022YFB2804100"],"award-info":[{"award-number":["2022YFB2804100"]}],"id":[{"id":"https:\/\/ror.org\/027s68j25","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Ministry of Science and Technology of the People's Republic of China","award":["2022YFC3601003"],"award-info":[{"award-number":["2022YFC3601003"]}],"id":[{"id":"https:\/\/ror.org\/027s68j25","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Taizhou Municipal Science and Technology Bureau","award":["24gyz01"],"award-info":[{"award-number":["24gyz01"]}],"id":[{"id":"https:\/\/ror.org\/041fzeq08","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Taizhou Municipal Science and Technology Bureau","award":["2024G2009"],"award-info":[{"award-number":["2024G2009"]}],"id":[{"id":"https:\/\/ror.org\/041fzeq08","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Ningbo Science and Technology Bureau","award":["2024Z234"],"award-info":[{"award-number":["2024Z234"]}],"id":[{"id":"https:\/\/ror.org\/00gskyj95","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Ningbo Science and Technology Bureau","award":["2023Z179"],"award-info":[{"award-number":["2023Z179"]}],"id":[{"id":"https:\/\/ror.org\/00gskyj95","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Ningbo Science and Technology Bureau","award":["2023Z122"],"award-info":[{"award-number":["2023Z122"]}],"id":[{"id":"https:\/\/ror.org\/00gskyj95","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":["opg.optica.org"],"crossmark-restriction":false},"short-container-title":["Biomed. Opt. Express"],"published-print":{"date-parts":[[2026,7,1]]},"abstract":"<jats:p>Accurate assessment of knee osteoarthritis (KOA) is limited by the current arthroscopy's reliance on subjective visual inspection. We propose a 3D spatio-spectral automatic grading framework combining deep learning with chromatic differential confocal matrix-based 3D topography and hyperspectral imaging (CDCM-THI). Our digital micromirror device-based system simultaneously captures high-resolution 3D micro-topography and hyperspectral cartilage signatures (lateral: 3.91\u2005\u00b5m, axial: 1.96\u2005\u00b5m, spectral: \u223c15\u2005nm). To analyze this multi-modal data, we developed an improved ResNet50 late fusion network optimized with a consistency-enhanced loss function. Evaluated on ex vivo clinical samples, our framework achieved an average cross-validation accuracy of 94.83%, significantly outperforming single-modal baselines. This non-destructive approach bridges the gap between topographical assessment and broadband optical analysis, providing a powerful quantitative tool for future deep learning-assisted arthroscopic integration.<\/jats:p>","DOI":"10.1364\/boe.596126","type":"journal-article","created":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T16:00:08Z","timestamp":1780502408000},"page":"3794","update-policy":"https:\/\/doi.org\/10.1364\/crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Chromatic differential confocal matrix-based 3D topography and hyperspectral imaging with deep learning for osteoarthritis grading"],"prefix":"10.1364","volume":"17","author":[{"given":"Xiaer","family":"Zou","sequence":"first","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiajing","family":"Ye","sequence":"additional","affiliation":[{"name":"Zhejiang University"},{"name":"Taizhou Hospital of Zhejiang Province Affiliated with the Wenzhou Medical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dawei","family":"Gong","sequence":"additional","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinhua","family":"Zhu","sequence":"additional","affiliation":[{"name":"Taizhou Agility Smart Technologies Co., Ltd."},{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junbo","family":"Liang","sequence":"additional","affiliation":[{"name":"Taizhou Hospital of Zhejiang Province Affiliated with the Wenzhou Medical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3401-1125","authenticated-orcid":true,"given":"Sailing","family":"He","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/026vcq606","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Zhejiang University"},{"name":"Taizhou Agility Smart Technologies Co., Ltd."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"285","published-online":{"date-parts":[[2026,6,23]]},"reference":[{"key":"boe-17-7-3794-R1","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1038\/s41584-024-01130-8","type":"journal-article","volume":"20","author":"Miao","year":"2024","journal-title":"Nat. Rev. Rheumatol"},{"key":"boe-17-7-3794-R2","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1016\/j.jot.2024.06.014","type":"journal-article","volume":"47","author":"Kuang","year":"2024","journal-title":"J. Orthop. Transl"},{"key":"boe-17-7-3794-R3","doi-asserted-by":"publisher","first-page":"819","DOI":"10.1136\/annrheumdis-2019-216515","type":"journal-article","volume":"79","author":"Safiri","year":"2020","journal-title":"Ann. Rheum. Dis."},{"key":"boe-17-7-3794-R4","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1364\/BOE.1.000074","type":"journal-article","volume":"1","author":"Yuan","year":"2010","journal-title":"Biomed. Opt. Express"},{"key":"boe-17-7-3794-R5","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1007\/s11307-011-0480-8","type":"journal-article","volume":"14","author":"Jones","year":"2012","journal-title":"Mol Imaging Biol"},{"key":"boe-17-7-3794-R6","doi-asserted-by":"publisher","first-page":"1412","DOI":"10.1002\/art.27378","type":"journal-article","volume":"62","author":"Chu","year":"2010","journal-title":"Arthritis Rheum."},{"key":"boe-17-7-3794-R7","doi-asserted-by":"publisher","first-page":"096011","DOI":"10.1117\/1.JBO.20.9.096011","type":"journal-article","volume":"20","author":"Milanic","year":"2015","journal-title":"J. Biomed. Opt."},{"key":"boe-17-7-3794-R8","doi-asserted-by":"publisher","first-page":"046024","DOI":"10.1117\/1.3477190","type":"journal-article","volume":"15","author":"Kinnunen","year":"2010","journal-title":"J. Biomed. Opt."},{"key":"boe-17-7-3794-R9","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1016\/0002-9343(83)90328-5","type":"journal-article","volume":"75","author":"Altman","year":"1983","journal-title":"Am. J. Med."},{"key":"boe-17-7-3794-R10","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1007\/s12195-020-00612-5","type":"journal-article","volume":"13","author":"Afara","year":"2020","journal-title":"Cel. Mol. Bioeng."},{"key":"boe-17-7-3794-R11","doi-asserted-by":"publisher","first-page":"123120","DOI":"10.1016\/j.saa.2023.123120","type":"journal-article","volume":"302","author":"Zeng","year":"2023","journal-title":"Spectrochim. Acta, Part A"},{"key":"boe-17-7-3794-R12","first-page":"353","article-title":"Assessment of bone, cartilage, tendon and bone cells by confocal laser scanning microscopy","author":"JonesQin","year":"2007"},{"key":"boe-17-7-3794-R13","first-page":"173","article-title":"Application of laser scanning confocal microscopy in musculoskeletal research","author":"LeeQin","year":"2007"},{"key":"boe-17-7-3794-R14","doi-asserted-by":"publisher","first-page":"1080241","DOI":"10.3389\/fbioe.2023.1080241","type":"journal-article","volume":"11","author":"Gao","year":"2023","journal-title":"Front. Bioeng. Biotechnol."},{"key":"boe-17-7-3794-R15","doi-asserted-by":"publisher","first-page":"e0246395","DOI":"10.1371\/journal.pone.0246395","type":"journal-article","volume":"16","author":"Youssef","year":"2021","journal-title":"PLoS One"},{"key":"boe-17-7-3794-R16","first-page":"780","article-title":"In-situ measurement of surface roughness using chromatic confocal sensor","volume-title":"2020","volume":"94","author":"FuSchmidt","year":"2020"},{"key":"boe-17-7-3794-R17","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1109\/LPT.2022.3220401","type":"journal-article","volume":"35","author":"Ye","year":"2023","journal-title":"IEEE Photonics Technol. Lett."},{"key":"boe-17-7-3794-R18","doi-asserted-by":"publisher","first-page":"040023","DOI":"10.1063\/5.0236198","type":"journal-article","volume":"3232","author":"Abdalla","year":"2024","journal-title":"AIP Conf. Proc"},{"key":"boe-17-7-3794-R20","doi-asserted-by":"publisher","first-page":"15902","DOI":"10.1038\/s41598-024-66857-6","type":"journal-article","volume":"14","author":"Kok","year":"2024","journal-title":"Sci. Rep."},{"key":"boe-17-7-3794-R21","doi-asserted-by":"publisher","first-page":"343900","DOI":"10.1016\/j.aca.2025.343900","type":"journal-article","volume":"1351","author":"Jiao","year":"2025","journal-title":"Anal. Chim. Acta"},{"key":"boe-17-7-3794-R22","doi-asserted-by":"publisher","first-page":"e70546","DOI":"10.1002\/cpe.70546","type":"journal-article","volume":"38","author":"Yilmaz","year":"2026","journal-title":"Concurr. Comput.-Pract. Exp"},{"key":"boe-17-7-3794-R23","doi-asserted-by":"publisher","first-page":"9763","DOI":"10.1007\/s00521-023-08214-8","type":"journal-article","volume":"35","author":"Guida","year":"2023","journal-title":"Neural Comput. Appl"},{"key":"boe-17-7-3794-R24","doi-asserted-by":"publisher","first-page":"e15461","DOI":"10.1016\/j.heliyon.2023.e15461","type":"journal-article","volume":"9","author":"Liu","year":"2023","journal-title":"Heliyon"},{"key":"boe-17-7-3794-R25","doi-asserted-by":"publisher","first-page":"146698","DOI":"10.1109\/ACCESS.2024.3472654","type":"journal-article","volume":"12","author":"Yu Teh","year":"2024","journal-title":"IEEE Access"},{"key":"boe-17-7-3794-R26","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1186\/s40634-021-00442-y","type":"journal-article","volume":"9","author":"Newman","year":"2022","journal-title":"J Exp. Orthop"},{"key":"boe-17-7-3794-R27","doi-asserted-by":"publisher","first-page":"2380","DOI":"10.1002\/jor.24015","type":"journal-article","volume":"36","author":"Mezlini-Gharsallah","year":"2018","journal-title":"J. Orthop. Res."},{"key":"boe-17-7-3794-R28","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1007\/s00167-011-1705-8","type":"journal-article","volume":"20","author":"Madry","year":"2012","journal-title":"Knee surg. sports traumatol. arthrosc."},{"key":"boe-17-7-3794-R29","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1016\/j.actbio.2021.03.034","type":"journal-article","volume":"126","author":"Tschaikowsky","year":"2021","journal-title":"Acta Biomater."},{"key":"boe-17-7-3794-R30","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1186\/s12891-016-1226-1","type":"journal-article","volume":"17","author":"Zuo","year":"2016","journal-title":"BMC Musculoskeletal Disord."}],"container-title":["Biomedical Optics Express"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/opg.optica.org\/viewmedia.cfm?URI=boe-17-7-3794&seq=0","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T20:31:47Z","timestamp":1789763507000},"score":1,"resource":{"primary":{"URL":"https:\/\/opg.optica.org\/abstract.cfm?URI=boe-17-7-3794"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,23]]},"references-count":29,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2026]]},"published-print":{"date-parts":[[2026]]}},"URL":"https:\/\/doi.org\/10.1364\/boe.596126","relation":{},"ISSN":["2156-7085","2156-7085"],"issn-type":[{"value":"2156-7085","type":"print"},{"value":"2156-7085","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,23]]},"assertion":[{"value":"Optica Publishing Group","name":"publisher","label":"This article is maintained by"},{"value":"https:\/\/doi.org\/10.1364\/BOE.596126","name":"articlelink","label":"Crossref DOI link to publisher maintained version"},{"value":"research-article","name":"content_type","label":"Article type"},{"value":"Screened by Similarity Check","name":"cross_check","label":"Similarity check"},{"value":"Yes","order":0,"name":"peer_reviewed","label":"Peer reviewed","group":{"name":"peer_review","label":"Peer review"}},{"value":"Single blind","order":1,"name":"review_process","label":"Review process","group":{"name":"peer_review","label":"Peer review"}},{"value":"19 February 2026","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"1 June 2026","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"23 June 2026","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}},{"value":"Published by Optica Publishing Group under the terms of the Creative Commons Attribution 4.0 License. Further distribution of this work must maintain attribution to the author(s) and the published article\u2019s title, journal citation, and DOI.","name":"copyright","label":"Copyright"}]}}