{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T19:14:08Z","timestamp":1765826048759,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,2,12]],"date-time":"2025-02-12T00:00:00Z","timestamp":1739318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006107","name":"Gachon University Gil Medical Center","doi-asserted-by":"publisher","award":["FRD2020-18","GRRC-Gachon2023(B01)"],"award-info":[{"award-number":["FRD2020-18","GRRC-Gachon2023(B01)"]}],"id":[{"id":"10.13039\/501100006107","id-type":"DOI","asserted-by":"publisher"}]},{"name":"GRRC program of Gyeonggi province","award":["FRD2020-18","GRRC-Gachon2023(B01)"],"award-info":[{"award-number":["FRD2020-18","GRRC-Gachon2023(B01)"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Objectives: This study proposes a state-of-the-art technology to estimate a set of parameters to automatically display an optimized image on a screen during cataract surgery. Methods: We constructed an architecture comprising two stages to estimate the parameters for realizing the optimized image. The Pix2Pix approach was first introduced to generate fake images that mimic the optimal image. This part can be considered a preliminary step; it uses training datasets comprising both an original microscopy image as the input data and an optimally tuned image by ophthalmologists as the label data. The second part of the architecture was inspired by ensemble learning, in which two ResNet-50 models were trained in parallel using fake images obtained in the previous step and unprocessed images. Each set of features extracted by the ensemble-like scheme was exploited for the regression of the optimal parameters. Results: The fidelity of our method was confirmed through relevant quantitative assessments (NMSE 121.052 \u00b1 181.227, PSNR 29.887 \u00b1 4.682, SSIM 0.965 \u00b1 0.047). Conclusions: Subsequently, surgeons reassured that the objects to be highlighted on the screen for cataract surgery were faithfully visualized by the automatically estimated parameters.<\/jats:p>","DOI":"10.3390\/diagnostics15040445","type":"journal-article","created":{"date-parts":[[2025,2,12]],"date-time":"2025-02-12T08:05:42Z","timestamp":1739347542000},"page":"445","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Automated Imaging of Cataract Surgery Using Artificial Intelligence"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0443-0051","authenticated-orcid":false,"given":"Young Jae","family":"Kim","sequence":"first","affiliation":[{"name":"Gachon Biomedical & Convergence Institute, Gil Medical Center, Gachon University, Incheon 21565, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sung Ha","family":"Hwang","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, Gil Medical Center, College of Medicine, Gachon University, Incheon 21565, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9714-6038","authenticated-orcid":false,"given":"Kwang Gi","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Gil Medical Center, College of Medicine, Gachon University, Incheon 21565, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong Heun","family":"Nam","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, Gil Medical Center, College of Medicine, Gachon University, Incheon 21565, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1111\/ceo.13976","article-title":"How can we improve the quality of cataract services for all? A global scoping review","volume":"49","author":"Yoshizaki","year":"2021","journal-title":"Clin. Exp. Ophthalmol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.1016\/j.jfo.2021.01.006","article-title":"Lux study: Contribution of a three-dimensional, high dynamic range, ultra-high-definition heads-up visualization system to a significant delivered light intensity decrease during different types of ocular surgeries","volume":"44","author":"Arbousoff","year":"2021","journal-title":"J. Fran\u00e7ais Ophtalmol."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Nakajima, K., Inoue, M., Mizuno, M., Koto, T., Ishida, T., Ozawa, H., and Oshika, T. (2023). Effects of image-sharpening algorithm on surgical field visibility during 3D heads-up surgery for vitreoretinal diseases. Sci. Rep., 13.","DOI":"10.1038\/s41598-023-29882-5"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1097\/APO.0000000000000562","article-title":"Three-Dimensional Heads-up Display in Cataract Surgery: A Review","volume":"11","author":"Muecke","year":"2022","journal-title":"Asia-Pac. J. Ophthalmol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"305","DOI":"10.4103\/joco.joco_115_22","article-title":"Impact of Heads-Up Display Use on Ophthalmologist Productivity, Wellness, and Musculoskeletal Symptoms: A Survey Study","volume":"34","author":"Tan","year":"2022","journal-title":"J. Curr. Ophthalmol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"679","DOI":"10.2147\/OPTH.S290396","article-title":"Can the Three-Dimensional Heads-Up Display Improve Ergonomics, Surgical Performance, and Ophthalmology Training Compared to Conventional Microscopy?","volume":"15","author":"AlAkeely","year":"2021","journal-title":"Clin. Ophthalmol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1097\/IAE.0000000000000689","article-title":"Heads-op Surgery for Vitreoretinal Procedures: An Experimental and Clinical Study","volume":"36","author":"Eckardt","year":"2016","journal-title":"Retina"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"927","DOI":"10.4103\/ijo.IJO_1825_20","article-title":"Contrast, visibility, and color balance between the microscope versus intracameral illumination in cataract surgery using a 3D visualization system","volume":"69","author":"Kim","year":"2021","journal-title":"Indian J. Ophthalmol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sandali, O., El, S.M., Tahiri, J.H.R., Armia, B.A., Duliere, C., Ezzouhairi, S.M., Sallam, A.B., and Borderie, V. (2023). Use of Digital Methods to Optimize Visualization during Surgical Gonioscopy. J. Clin. Med., 12.","DOI":"10.3390\/jcm12082794"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1007\/s40305-019-00287-4","article-title":"A Review on Deep Learning in Medical Image Reconstruction","volume":"8","author":"Zhang","year":"2020","journal-title":"J. Oper. Res. Soc. China"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"8750648","DOI":"10.1155\/2022\/8750648","article-title":"Deep Learning-Based Image Reconstruction for Different Medical Imaging Modalities","volume":"2022","author":"Yaqub","year":"2022","journal-title":"Comput. Math. Methods Med."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1167\/tvst.10.13.13","article-title":"An Open-Source Deep Learning Network for Reconstruction of High-Resolution OCT Angiograms of Retinal Intermediate and Deep Capillary Plexuses","volume":"10","author":"Gao","year":"2021","journal-title":"Transl. Vis. Sci. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kim, J., and Chin, H.S. (2023). Deep learning-based prediction of the retinal structural alterations after epiretinal membrane surgery. Sci. Rep., 13.","DOI":"10.1038\/s41598-023-46063-6"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3585","DOI":"10.1364\/BOE.394301","article-title":"Reconstruction of high-resolution 6 \u00d7 6-mm OCT angiograms using deep learning","volume":"11","author":"Gao","year":"2020","journal-title":"Biomed. Opt. Express"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"757","DOI":"10.4103\/IJO.IJO_2723_22","article-title":"Improved visibility of illuminated chopper-assisted cataract surgery involving iris challenges","volume":"71","author":"Kim","year":"2023","journal-title":"Indian J. Ophthalmol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1111\/aos.12428","article-title":"Intracameral dynamic spotlight-assisted cataract surgery in eyes with corneal opacity, small pupil or advanced cataract","volume":"93","author":"Moon","year":"2015","journal-title":"Acta Ophthalmol."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hwang, S.H., Kim, H., Lee, D.Y., and Nam, D.H. (2023). Intraoperative challenges and complications of cataract surgery between cataract surgery alone and phacovitrectomy in eyes with diabetic retinopathy: Efficacy of illuminated chopper-assisted cataract surgery. BMC Ophthalmol., 23.","DOI":"10.1186\/s12886-023-02982-6"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1166\/jmihi.2014.1289","article-title":"A Fast Enhancement\/Thresholding Based Blood Vessel Segmentation for Retinal Image Using Contrast Limited Adaptive Histogram Equalization","volume":"4","author":"Ravichandran","year":"2014","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"e453","DOI":"10.7717\/peerj.453","article-title":"Scikit-image: Image processing in Python","volume":"2","author":"Boulogne","year":"2014","journal-title":"PeerJ"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"105524","DOI":"10.1016\/j.asoc.2019.105524","article-title":"Investigating the impact of data normalization on classification performance","volume":"97","author":"Singh","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","article-title":"A survey on deep learning in medical image analysis","volume":"42","author":"Litjens","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"26731","DOI":"10.1007\/s11042-022-14305-w","article-title":"Machine learning and deep learning approach for medical image analysis: Diagnosis to detection","volume":"82","author":"Rana","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"713","DOI":"10.21037\/atm.2020.02.44","article-title":"A review of the application of deep learning in medical image classification and segmentation","volume":"8","author":"Cai","year":"2020","journal-title":"Ann. Transl. Med."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Aljohani, A., and Alharbe, N. (2022). Generating Synthetic Images for Healthcare with Novel Deep Pix2Pix GAN. Electronics, 11.","DOI":"10.3390\/electronics11213470"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans Image Process"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"99","DOI":"10.25046\/aj020413","article-title":"Precision Statistical Analysis of Images Based on Brightness Distribution","volume":"2","author":"Ali","year":"2017","journal-title":"Adv. Sci. Technol. Eng. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1109\/TCYB.2015.2401732","article-title":"The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement","volume":"46","author":"Gu","year":"2016","journal-title":"IEEE Trans. Cybern."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhu, M., Yu, L., Wang, Z., Ke, Z., and Zhi, C. (2023). Review: A Survey on Objective Evaluation of Image Sharpness. Appl. Sci., 13.","DOI":"10.3390\/app13042652"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1080\/08820538.2022.2054663","article-title":"Continuous Curvilinear Capsulorhexis\u2014A Practical Review","volume":"37","author":"Sela","year":"2022","journal-title":"Semin. Ophthalmol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.preteyeres.2018.01.003","article-title":"Cataract, phacoemulsification and intraocular pressure: Is the anterior segment anatomy the missing piece of the puzzle?","volume":"64","author":"Masis","year":"2018","journal-title":"Prog. Retin. Eye Res."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1420","DOI":"10.1097\/IAE.0b013e3182533d9c","article-title":"Intracameral Illuminator-Guided Advanced Lens Capsule Polishing During Cataract Surgery in Eyes with Diabetic Retinopathy","volume":"32","author":"Lee","year":"2012","journal-title":"Retina"}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/15\/4\/445\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:32:09Z","timestamp":1760027529000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/15\/4\/445"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,12]]},"references-count":33,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["diagnostics15040445"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics15040445","relation":{},"ISSN":["2075-4418"],"issn-type":[{"type":"electronic","value":"2075-4418"}],"subject":[],"published":{"date-parts":[[2025,2,12]]}}}