{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T03:24:30Z","timestamp":1787973870401,"version":"build-2784847793"},"reference-count":49,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T00:00:00Z","timestamp":1732492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100001818","name":"Research to Prevent Blindness","doi-asserted-by":"publisher","award":["718740"],"award-info":[{"award-number":["718740"]}],"id":[{"id":"10.13039\/100001818","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Bioengineering"],"abstract":"<jats:p>Eye diseases such as age-related macular degeneration (AMD) are major causes of irreversible vision loss. Early and accurate detection of these diseases is essential for effective management. Optical coherence tomography (OCT) imaging provides clinicians with in vivo, cross-sectional views of the retina, enabling the identification of key pathological features. However, manual interpretation of OCT scans is labor-intensive and prone to variability, often leading to diagnostic inconsistencies. To address this, we leveraged the RETFound model, a foundation model pretrained on 1.6 million unlabeled retinal OCT images, to automate the classification of key disease signatures on OCT. We finetuned RETFound and compared its performance with the widely used ResNet-50 model, using single-task and multitask modes. The dataset included 1770 labeled B-scans with various disease features, including subretinal fluid (SRF), intraretinal fluid (IRF), drusen, and pigment epithelial detachment (PED). The performance was evaluated using accuracy and AUC-ROC values, which ranged across models from 0.75 to 0.77 and 0.75 to 0.80, respectively. RETFound models display comparable specificity and sensitivity to ResNet-50 models overall, making it also a promising tool for retinal disease diagnosis. These findings suggest that RETFound may offer improved diagnostic accuracy and interpretability for specific tasks, potentially aiding clinicians in more efficient and reliable OCT image analysis.<\/jats:p>","DOI":"10.3390\/bioengineering11121186","type":"journal-article","created":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T03:59:01Z","timestamp":1732507141000},"page":"1186","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Detection of Disease Features on Retinal OCT Scans Using RETFound"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1715-5426","authenticated-orcid":false,"given":"Katherine","family":"Du","sequence":"first","affiliation":[{"name":"Department of Ophthalmology, University of Pittsburgh Medical Center, Pittsburgh, PA 15219, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atharv Ramesh","family":"Nair","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Indian Institute of Technology Hyderabad, Hyderabad 502284, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stavan","family":"Shah","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, University of Pittsburgh Medical Center, Pittsburgh, PA 15219, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adarsh","family":"Gadari","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of North Carolina at Greensboro, Greensboro, NC 27412, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5957-4316","authenticated-orcid":false,"given":"Sharat Chandra","family":"Vupparaboina","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, University of Pittsburgh Medical Center, Pittsburgh, PA 15219, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sandeep Chandra","family":"Bollepalli","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, University of Pittsburgh Medical Center, Pittsburgh, PA 15219, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shan","family":"Sutharahan","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of North Carolina at Greensboro, Greensboro, NC 27412, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jos\u00e9-Alain","family":"Sahel","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, University of Pittsburgh Medical Center, Pittsburgh, PA 15219, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soumya","family":"Jana","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Indian Institute of Technology Hyderabad, Hyderabad 502284, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1772-3558","authenticated-orcid":false,"given":"Jay","family":"Chhablani","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, University of Pittsburgh Medical Center, Pittsburgh, PA 15219, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kiran Kumar","family":"Vupparaboina","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, University of Pittsburgh Medical Center, Pittsburgh, PA 15219, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1038\/s41572-021-00265-2","article-title":"Age-related macular degeneration","volume":"7","author":"Fleckenstein","year":"2021","journal-title":"Nat. Rev. Dis. Primers"},{"key":"ref_2","first-page":"75","article-title":"Diabetic retinopathy: Early diagnosis and effective treatment","volume":"107","author":"Kollias","year":"2010","journal-title":"Dtsch. Arztebl. Int."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Aumann, S., Donner, S., Fischer, J., and M\u00fcller, F. (2019). Optical coherence tomography (OCT): Principle and technical realization. High Resolution Imaging in Microscopy and Ophthalmology: New Frontiers in Biomedical Optics, Springer.","DOI":"10.1007\/978-3-030-16638-0_3"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zeppieri, M., Marsili, S., Enaholo, E.S., Shuaibu, A.O., Uwagboe, N., Salati, C., Spadea, L., and Musa, M. (2023). Optical coherence tomography (OCT): A brief look at the uses and technological evolution of ophthalmology. Medicina, 59.","DOI":"10.3390\/medicina59122114"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1080\/08820538.2021.1901123","article-title":"Artificial intelligence (AI) and retinal optical coherence tomography (OCT)","volume":"36","author":"Dahrouj","year":"2021","journal-title":"Semin. Ophthalmol."},{"key":"ref_6","first-page":"PB0090","article-title":"A machine learning method for optical coherence tomography scan quality assessment","volume":"61","author":"Elezaby","year":"2020","journal-title":"Investig. Ophthalmol. Vis. Sci."},{"key":"ref_7","first-page":"3313-F0122","article-title":"Automated scan quality assessment in low-cost OCT","volume":"63","author":"Kho","year":"2022","journal-title":"Investig. Ophthalmol. Vis. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1109\/JBHI.2015.2450362","article-title":"Big data for health","volume":"19","author":"Poon","year":"2015","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2050312120934839","DOI":"10.1177\/2050312120934839","article-title":"A review of big data and medical research","volume":"8","author":"Mallappallil","year":"2020","journal-title":"SAGE Open Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3","DOI":"10.23876\/j.krcp.2017.36.1.3","article-title":"Medical big data: Promise and challenges","volume":"36","author":"Lee","year":"2017","journal-title":"Kidney Res. Clin. Pract."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"79","DOI":"10.4258\/hir.2013.19.2.79","article-title":"Potentiality of big data in the medical sector: Focus on how to reshape the healthcare system","volume":"19","author":"Jee","year":"2013","journal-title":"Healthc. Inform. Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1038\/s41591-018-0272-7","article-title":"Privacy in the age of medical big data","volume":"25","author":"Price","year":"2019","journal-title":"Nat. Med."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liao, H., Tang, M., Luo, L., Li, C., Chiclana, F., and Zeng, X.J. (2018). A bibliometric analysis and visualization of medical big data research. Sustainability, 10.","DOI":"10.3390\/su10010166"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Merelli, I., P\u00e9rez-S\u00e1nchez, H., Gesing, S., and D\u2019Agostino, D. (2014). Managing, analysing, and integrating big data in medical bioinformatics: Open problems and future perspectives. BioMed Res. Int., 2014.","DOI":"10.1155\/2014\/134023"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1097\/APO.0000000000000304","article-title":"Big data in ophthalmology","volume":"9","author":"Cheng","year":"2020","journal-title":"Asia-Pac. J. Ophthalmol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"100036","DOI":"10.1016\/j.xops.2021.100036","article-title":"Big data and artificial intelligence in ophthalmology: Where are we now?","volume":"1","author":"Lee","year":"2021","journal-title":"Ophthalmol. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"123","DOI":"10.4103\/tjo.TJO-D-23-00069","article-title":"Application of big data in ophthalmology","volume":"13","author":"Cheng","year":"2023","journal-title":"Taiwan J. Ophthalmol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1016\/j.survophthal.2016.01.003","article-title":"Big data and ophthalmic research","volume":"61","author":"Clark","year":"2016","journal-title":"Surv. Ophthalmol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Devarakonda, S.T., Vupparaboina, K.K., Richhariya, A., Chhablani, J., and Jana, S. (2016, January 16). Automated detection of retinal disorders from OCT images using artificial neural network. Proceedings of the 2016 IEEE Annual India Conference (INDICON), Bengaluru, India.","DOI":"10.1109\/INDICON.2016.7838882"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Singh, L.K., Garg, H., and Khanna, M. (2023). An artificial intelligence-based smart system for early glaucoma recognition using OCT images. Research Anthology on Improving Medical Imaging Techniques for Analysis and Intervention, IGI Global.","DOI":"10.4018\/978-1-6684-7544-7.ch073"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Qiu, J., and Sun, Y. (2019). Self-supervised iterative refinement learning for macular OCT volumetric data classification. Comput. Biol., 111.","DOI":"10.1016\/j.compbiomed.2019.103327"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"ElTanboly, A., Shalaby, A., Mahmoud, A., Ghazal, M., Switala, A., Taher, F., Suri, J.S., Keynton, R., and El-Baz, A. (2019). Computer Aided Diagnosis System for Early Detection of Diabetic Retinopathy Using OCT Images. Big Data in Multimodal Medical Imaging, CRC Press.","DOI":"10.1201\/b22410-13"},{"key":"ref_23","first-page":"15","article-title":"A review of algorithms for segmentation of retinal image data using optical coherence tomography","volume":"1","author":"DeBuc","year":"2011","journal-title":"Image Segmentation"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1007\/s11831-022-09807-7","article-title":"Deep transfer learning approaches to predict glaucoma, cataract, choroidal neovascularization, diabetic macular edema, drusen and healthy eyes: An experimental review","volume":"30","author":"Kumar","year":"2022","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hassan, E., Elmougy, S., Ibraheem, M.R., Hossain, M.S., AlMutib, K., Ghoneim, A., AlQahtani, S.A., and Talaat, F.M. (2023). Enhanced deep learning model for classification of retinal optical coherence tomography images. Sensors, 23.","DOI":"10.3390\/s23125393"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_28","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Subasi, M.E., Patnaik, S., and Subasi, A. (2024). Optical coherence tomography image classification for retinal disease detection using artificial intelligence. Applications of Artificial Intelligence Healthcare and Biomedicine, Academic Press.","DOI":"10.1016\/B978-0-443-22308-2.00009-3"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"6204","DOI":"10.1364\/BOE.10.006204","article-title":"Deep learning-based automated detection of retinal diseases using optical coherence tomography images","volume":"10","author":"Li","year":"2019","journal-title":"Biomed. Opt. Express"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-023-41362-4","article-title":"Oct-based deep-learning models for the identification of retinal key signs","volume":"13","author":"Leandro","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_32","unstructured":"Bommasani, R., Hudson, D.A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M.S., Bohg, J., Bosselut, A., and Brunskill, E. (2021). On the opportunities and risks of foundation models. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1038\/s41586-023-05881-4","article-title":"Foundation models for generalist medical artificial intelligence","volume":"616","author":"Moor","year":"2023","journal-title":"Nature"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., and He, L. (2023). A comprehensive survey on pretrained foundation models: A history from bert to chatgpt. arXiv.","DOI":"10.1007\/s13042-024-02443-6"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhong, W., Cui, R., Guo, Y., Liang, Y., Lu, S., Wang, Y., Saied, A., Chen, W., and Duan, N. (2023). Agieval: A human-centric benchmark for evaluating foundation models. arXiv.","DOI":"10.18653\/v1\/2024.findings-naacl.149"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2924","DOI":"10.1038\/s41591-024-03141-0","article-title":"A foundation model for clinical-grade computational pathology and rare cancers detection","volume":"30","author":"Vorontsov","year":"2024","journal-title":"Nat. Med."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"5227","DOI":"10.1109\/TPAMI.2024.3362475","article-title":"SpectralGPT: Spectral remote sensing foundation model","volume":"46","author":"Hong","year":"2024","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Liang, Y., Wen, H., Nie, Y., Jiang, Y., Jin, M., Song, D., Pan, S., and Wen, Q. (2024, January 25\u201329). Foundation models for time series analysis: A tutorial and survey. Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Barcelona, Spain.","DOI":"10.1145\/3637528.3671451"},{"key":"ref_39","unstructured":"Wu, C., Yin, S., Qi, W., Wang, X., Tang, Z., and Duan, N. (2023). Visual chatgpt: Talking, drawing and editing with visual foundation models. arXiv."},{"key":"ref_40","unstructured":"Nguyen, T., Brandstetter, J., Kapoor, A., Gupta, J.K., and Grover, A. (2023). ClimaX: A foundation model for weather and climate. arXiv."},{"key":"ref_41","first-page":"5696","article-title":"Omnivl: One foundation model for image-language and video-language tasks","volume":"35","author":"Wang","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1038\/s41586-023-06555-x","article-title":"A foundation model for generalizable disease detection from retinal images","volume":"622","author":"Zhou","year":"2023","journal-title":"Nature"},{"key":"ref_43","unstructured":"Du, K., Shah, S., Gadari, A., Bollepalli, S.C., Chhablani, J., and Vupparaboina, K.K. (2024, January 26\u201327). Inter-observer variance in labeling quality and pathology of retinal optical coherence tomography scans [abstract]. Proceedings of the 2024 Data Science and AI Symposium, Harvard Ophthalmology and Mass Eye & Ear, Boston, MA, USA."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"He, K., Chen, X., Xie, S., Li, Y., Doll\u00e1r, P., and Girshick, R. (2022, January 18\u201324). Masked autoencoders are scalable vision learners. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1016\/j.cell.2018.02.010","article-title":"Identifying medical diagnoses and treatable diseases by image-based deep learning","volume":"172","author":"Kermany","year":"2018","journal-title":"Cell"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"43537","DOI":"10.1109\/ACCESS.2020.2977355","article-title":"Effect of altered OCT image quality on deep learning boundary segmentation","volume":"8","author":"Kugelman","year":"2020","journal-title":"IEEE Access"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"6057","DOI":"10.1364\/BOE.10.006057","article-title":"Deep learning for quality assessment of retinal OCT images","volume":"10","author":"Wang","year":"2019","journal-title":"Biomed. Opt. Express"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1641","DOI":"10.1007\/s00417-019-04338-7","article-title":"Automated OCT angiography image quality assessment using a deep learning algorithm","volume":"257","author":"Lauermann","year":"2019","journal-title":"Graefes Arch. Clin. Exp. Ophthalmol."}],"container-title":["Bioengineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5354\/11\/12\/1186\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:38:37Z","timestamp":1760114317000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5354\/11\/12\/1186"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,25]]},"references-count":49,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["bioengineering11121186"],"URL":"https:\/\/doi.org\/10.3390\/bioengineering11121186","relation":{},"ISSN":["2306-5354"],"issn-type":[{"value":"2306-5354","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,25]]}}}