{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T21:58:50Z","timestamp":1772920730950,"version":"3.50.1"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T00:00:00Z","timestamp":1646179200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T00:00:00Z","timestamp":1646179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007928","name":"Ningbo Municipal Bureau of Science and Technology","doi-asserted-by":"publisher","award":["2021S118"],"award-info":[{"award-number":["2021S118"]}],"id":[{"id":"10.13039\/501100007928","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Malignant eyelid tumors can invade adjacent structures and pose a threat to vision and even life. Early identification of malignant eyelid tumors is crucial to avoiding substantial morbidity and mortality. However, differentiating malignant eyelid tumors from benign ones can be challenging for primary care physicians and even some ophthalmologists. Here, based on 1,417 photographic images from 851 patients across three hospitals, we developed an artificial intelligence system using a faster region-based convolutional neural network and deep learning classification networks to automatically locate eyelid tumors and then distinguish between malignant and benign eyelid tumors. The system performed well in both internal and external test sets (AUCs ranged from 0.899 to 0.955). The performance of the system is comparable to that of a senior ophthalmologist, indicating that this system has the potential to be used at the screening stage for promoting the early detection and treatment of malignant eyelid tumors.<\/jats:p>","DOI":"10.1038\/s41746-022-00571-3","type":"journal-article","created":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T11:02:54Z","timestamp":1646218974000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["Artificial intelligence to detect malignant eyelid tumors from photographic images"],"prefix":"10.1038","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9759-7461","authenticated-orcid":false,"given":"Zhongwen","family":"Li","sequence":"first","affiliation":[]},{"given":"Wei","family":"Qiang","sequence":"additional","affiliation":[]},{"given":"Hongyun","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Mengjie","family":"Pei","sequence":"additional","affiliation":[]},{"given":"Xiaomei","family":"Yu","sequence":"additional","affiliation":[]},{"given":"Layi","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Zhen","family":"Li","sequence":"additional","affiliation":[]},{"given":"Weiwei","family":"Xie","sequence":"additional","affiliation":[]},{"given":"Xuefang","family":"Wu","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4306-793X","authenticated-orcid":false,"given":"Jiewei","family":"Jiang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4184-8708","authenticated-orcid":false,"given":"Guohai","family":"Wu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,3,2]]},"reference":[{"key":"571_CR1","first-page":"1835","volume":"11","author":"SS Yu","year":"2018","unstructured":"Yu, S. S., Zhao, Y., Zhao, H., Lin, J. Y. & Tang, X. A retrospective study of 2228 cases with eyelid tumors. Int J. Ophthalmol. 11, 1835\u20131841 (2018).","journal-title":"Int J. Ophthalmol."},{"key":"571_CR2","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1097\/DAD.0b013e3181961861","volume":"31","author":"M Deprez","year":"2009","unstructured":"Deprez, M. & Uffer, S. Clinicopathological features of eyelid skin tumors. A retrospective study of 5504 cases and review of literature. Am. J. Dermatopathol. 31, 256\u2013262 (2009).","journal-title":"Am. J. Dermatopathol."},{"key":"571_CR3","doi-asserted-by":"publisher","first-page":"177","DOI":"10.4103\/0301-4738.181752","volume":"64","author":"J Pe\u2019Er","year":"2016","unstructured":"Pe\u2019Er, J. Pathology of eyelid tumors. Indian J. Ophthalmol. 64, 177\u2013190 (2016).","journal-title":"Indian J. Ophthalmol."},{"key":"571_CR4","first-page":"453091","volume":"2015","author":"YY Huang","year":"2015","unstructured":"Huang, Y. Y. et al. Comparison of the clinical characteristics and outcome of benign and malignant eyelid tumors: an analysis of 4521 eyelid tumors in a tertiary medical center. Biomed. Res. Int. 2015, 453091 (2015).","journal-title":"Biomed. Res. Int."},{"key":"571_CR5","first-page":"e43","volume":"61","author":"C Leung","year":"2015","unstructured":"Leung, C., Johnson, D., Pang, R. & Kratky, V. Identifying predictive morphologic features of malignancy in eyelid lesions. Can. Fam. Physician 61, e43\u2013e49 (2015).","journal-title":"Can. Fam. Physician"},{"key":"571_CR6","doi-asserted-by":"publisher","first-page":"209","DOI":"10.5455\/medarh.2019.73.209-212","volume":"73","author":"M Burgic","year":"2019","unstructured":"Burgic, M. et al. Clinical characteristics and outcome of malignant eyelid tumors: a five-year retrospective study. Med Arch. 73, 209\u2013212 (2019).","journal-title":"Med Arch."},{"key":"571_CR7","doi-asserted-by":"publisher","first-page":"2011","DOI":"10.1016\/S0161-6420(03)00670-5","volume":"110","author":"R Malhotra","year":"2003","unstructured":"Malhotra, R., Chen, C., Huilgol, S. C., Hill, D. C. & Selva, D. Mapped serial excision for periocular lentigo maligna and lentigo maligna melanoma. Ophthalmology 110, 2011\u20132018 (2003).","journal-title":"Ophthalmology"},{"key":"571_CR8","doi-asserted-by":"publisher","first-page":"2088","DOI":"10.1016\/S0161-6420(01)00796-5","volume":"108","author":"BJ Cook","year":"2001","unstructured":"Cook, B. J. & Bartley, G. B. Treatment options and future prospects for the management of eyelid malignancies: an evidence-based update. Ophthalmology. 108, 2088\u20132098 (2001).","journal-title":"Ophthalmology."},{"key":"571_CR9","doi-asserted-by":"publisher","first-page":"783","DOI":"10.1136\/bjophthalmol-2011-301378","volume":"96","author":"S Resnikoff","year":"2012","unstructured":"Resnikoff, S., Felch, W., Gauthier, T. M. & Spivey, B. The number of ophthalmologists in practice and training worldwide: a growing gap despite more than 200,000 practitioners. Br. J. Ophthalmol. 96, 783\u2013787 (2012).","journal-title":"Br. J. Ophthalmol."},{"key":"571_CR10","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1038\/s41591-020-01174-9","volume":"27","author":"W Lotter","year":"2021","unstructured":"Lotter, W. et al. Robust breast cancer detection in mammography and digital breast tomosynthesis using an annotation-efficient deep learning approach. Nat. Med. 27, 244\u2013249 (2021).","journal-title":"Nat. Med."},{"key":"571_CR11","doi-asserted-by":"publisher","first-page":"618","DOI":"10.21037\/atm.2019.11.28","volume":"7","author":"Z Li","year":"2019","unstructured":"Li, Z. et al. A deep learning system for identifying lattice degeneration and retinal breaks using ultra-widefield fundus images. Ann. Transl. Med. 7, 618 (2019).","journal-title":"Ann. Transl. Med."},{"key":"571_CR12","doi-asserted-by":"publisher","first-page":"1360","DOI":"10.1016\/j.cell.2020.08.029","volume":"182","author":"K Zhang","year":"2020","unstructured":"Zhang, K. et al. Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography. Cell 182, 1360 (2020).","journal-title":"Cell"},{"key":"571_CR13","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-19527-w","volume":"11","author":"Z Shi","year":"2020","unstructured":"Shi, Z. et al. A clinically applicable deep-learning model for detecting intracranial aneurysm in computed tomography angiography images. Nat. Commun. 11, 6090 (2020).","journal-title":"Nat. Commun."},{"key":"571_CR14","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1038\/s41746-020-00350-y","volume":"3","author":"Z Li","year":"2020","unstructured":"Li, Z. et al. Deep learning from \u201cpassive feeding\u201d to \u201cselective eating\u201d of real-world data. NPJ Digit. Med. 3, 143 (2020).","journal-title":"NPJ Digit. Med."},{"key":"571_CR15","doi-asserted-by":"crossref","unstructured":"Li, Z. et al. Automated detection of retinal exudates and drusen in ultra-widefield fundus images based on deep learning. Eye (Lond), (2021). Online ahead of print.","DOI":"10.1038\/s41433-021-01715-7"},{"key":"571_CR16","doi-asserted-by":"publisher","first-page":"1548","DOI":"10.1136\/bjophthalmol-2020-317327","volume":"105","author":"Z Li","year":"2021","unstructured":"Li, Z. et al. Deep learning for automated glaucomatous optic neuropathy detection from ultra-widefield fundus images. Br. J. Ophthalmol. 105, 1548\u20131554 (2021).","journal-title":"Br. J. Ophthalmol."},{"key":"571_CR17","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1038\/s42003-019-0730-x","volume":"3","author":"Z Li","year":"2020","unstructured":"Li, Z. et al. Deep learning for detecting retinal detachment and discerning macular status using ultra-widefield fundus images. Commun. Biol. 3, 15 (2020).","journal-title":"Commun. Biol."},{"key":"571_CR18","doi-asserted-by":"publisher","first-page":"2211","DOI":"10.1001\/jama.2017.18152","volume":"318","author":"D Ting","year":"2017","unstructured":"Ting, D. et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318, 2211\u20132223 (2017).","journal-title":"JAMA"},{"key":"571_CR19","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1167\/tvst.9.2.3","volume":"9","author":"Z Li","year":"2020","unstructured":"Li, Z. et al. Development and evaluation of a deep learning system for screening retinal hemorrhage based on ultra-widefield fundus images. Transl. Vis. Sci. Technol. 9, 3 (2020).","journal-title":"Transl. Vis. Sci. Technol."},{"key":"571_CR20","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-24116-6","volume":"12","author":"Z Li","year":"2021","unstructured":"Li, Z. et al. Preventing corneal blindness caused by keratitis using artificial intelligence. Nat. Commun. 12, 3738 (2021).","journal-title":"Nat. Commun."},{"key":"571_CR21","doi-asserted-by":"publisher","first-page":"103317","DOI":"10.1016\/j.isci.2021.103317","volume":"24","author":"Z Li","year":"2021","unstructured":"Li, Z. et al. Comparison of deep learning systems and cornea specialists in detecting corneal diseases from low-quality images. iScience 24, 103317 (2021).","journal-title":"iScience"},{"key":"571_CR22","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"key":"571_CR23","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1097\/IIO.0b013e3181b7f059","volume":"49","author":"JA Shields","year":"2009","unstructured":"Shields, J. A. & Shields, C. L. Sebaceous adenocarcinoma of the eyelid. Int Ophthalmol. Clin. 49, 45\u201361 (2009).","journal-title":"Int Ophthalmol. Clin."},{"key":"571_CR24","first-page":"143","volume":"6","author":"N Silverman","year":"2017","unstructured":"Silverman, N. & Shinder, R. What\u2019s new in eyelid tumors. Asia Pac. J. Ophthalmol. (Philos.) 6, 143\u2013152 (2017).","journal-title":"Asia Pac. J. Ophthalmol. (Philos.)"},{"key":"571_CR25","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/j.clindermatol.2014.10.008","volume":"33","author":"VT Yin","year":"2015","unstructured":"Yin, V. T., Merritt, H. A., Sniegowski, M. & Esmaeli, B. Eyelid and ocular surface carcinoma: diagnosis and management. Clin. Dermatol. 33, 159\u2013169 (2015).","journal-title":"Clin. Dermatol."},{"key":"571_CR26","doi-asserted-by":"publisher","first-page":"513","DOI":"10.3129\/i09-127","volume":"44","author":"J Noble","year":"2009","unstructured":"Noble, J., Somal, K., Gill, H. S. & Lam, W. C. An analysis of undergraduate ophthalmology training in Canada. Can. J. Ophthalmol. 44, 513\u2013518 (2009).","journal-title":"Can. J. Ophthalmol."},{"key":"571_CR27","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1007\/s12530-021-09383-4","volume":"12","author":"A Adamopoulos","year":"2021","unstructured":"Adamopoulos, A., Chatzopoulos, E. G., Anastassopoulos, G. & Detorakis, E. Eyelid basal cell carcinoma classification using shallow and deep learning artificial neural networks. Evol. Syst. 12, 583\u2013590 (2021).","journal-title":"Evol. Syst."},{"key":"571_CR28","doi-asserted-by":"publisher","first-page":"101915","DOI":"10.1016\/j.media.2020.101915","volume":"68","author":"SM Thomas","year":"2020","unstructured":"Thomas, S. M., Lefevre, J. G., Baxter, G. & Hamilton, N. A. Interpretable deep learning systems for multi-class segmentation and classification of non-melanoma skin cancer. Med. Image Anal. 68, 101915 (2020).","journal-title":"Med. Image Anal."},{"key":"571_CR29","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin, C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat. Mach. Intell. 1, 206\u2013215 (2019).","journal-title":"Nat. Mach. Intell."},{"key":"571_CR30","doi-asserted-by":"publisher","first-page":"1364","DOI":"10.1038\/s41591-020-1034-x","volume":"26","author":"X Liu","year":"2020","unstructured":"Liu, X., Cruz, R. S., Moher, D., Calvert, M. J. & Denniston, A. K. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension. Nat. Med. 26, 1364\u20131374 (2020).","journal-title":"Nat. Med."},{"key":"571_CR31","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","volume":"39","author":"S Ren","year":"2017","unstructured":"Ren, S., He, K., Girshick, R. & Sun, J. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39, 1137\u20131149 (2017).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"571_CR32","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L. & Weinberger, K. Q. Densely Connected Convolutional Networks. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2261\u20132269 (2017).","DOI":"10.1109\/CVPR.2017.243"},{"key":"571_CR33","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1038\/s41746-020-0247-1","volume":"3","author":"M Yip","year":"2020","unstructured":"Yip, M. et al. Technical and imaging factors influencing performance of deep learning systems for diabetic retinopathy. NPJ Digit Med 3, 40 (2020).","journal-title":"NPJ Digit Med"},{"key":"571_CR34","doi-asserted-by":"publisher","DOI":"10.1186\/s40658-021-00424-0","volume":"8","author":"W Whi","year":"2021","unstructured":"Whi, W. et al. Fully automated identification of brain abnormality from whole-body FDG-PET imaging using deep learning-based brain extraction and statistical parametric mapping. EJNMMI Phys. 8, 79 (2021).","journal-title":"EJNMMI Phys."},{"key":"571_CR35","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the Inception Architecture for Computer Vision. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2818\u20132826 (2016).","DOI":"10.1109\/CVPR.2016.308"},{"key":"571_CR36","doi-asserted-by":"publisher","first-page":"1009","DOI":"10.1111\/ceo.13575","volume":"47","author":"S Keel","year":"2019","unstructured":"Keel, S. et al. Development and validation of a deep-learning algorithm for the detection of neovascular age-related macular degeneration from colour fundus photographs. Clin. Exp. Ophthalmol. 47, 1009\u20131018 (2019).","journal-title":"Clin. Exp. Ophthalmol."},{"key":"571_CR37","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1007\/s13755-018-0057-x","volume":"6","author":"E Deniz","year":"2018","unstructured":"Deniz, E. et al. Transfer learning based histopathologic image classification for breast cancer detection. Health Inf. Sci. Syst. 6, 18 (2018).","journal-title":"Health Inf. Sci. Syst."},{"key":"571_CR38","doi-asserted-by":"publisher","first-page":"1122","DOI":"10.1016\/j.cell.2018.02.010","volume":"172","author":"DS Kermany","year":"2018","unstructured":"Kermany, D. S. et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172, 1122\u20131131 (2018).","journal-title":"Cell"},{"key":"571_CR39","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky, O. et al. ImageNet large scale visual recognition challenge. Int. J. Comput. Vision. 115, 211\u2013252 (2015).","journal-title":"Int. J. Comput. Vision."},{"key":"571_CR40","doi-asserted-by":"publisher","first-page":"4522","DOI":"10.1093\/bioinformatics\/btz259","volume":"35","author":"MD Bloice","year":"2019","unstructured":"Bloice, M. D., Roth, P. M. & Holzinger, A. Biomedical image augmentation using Augmentor. Bioinformatics 35, 4522\u20134524 (2019).","journal-title":"Bioinformatics"},{"key":"571_CR41","first-page":"2579","volume":"9","author":"L van der Maaten","year":"2008","unstructured":"van der Maaten, L. & Hinton, G. Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 2579\u20132605 (2008).","journal-title":"J. Mach. Learn. Res."},{"key":"571_CR42","doi-asserted-by":"crossref","unstructured":"Selvaraju, R. R. et al. Grad-CAM: Visual explanations from deep networks via gradient-based localization. 2017 IEEE International Conference on Computer Vision (ICCV). 618\u2013626 (2017).","DOI":"10.1109\/ICCV.2017.74"},{"key":"571_CR43","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh, M. L. Interrater reliability: the kappa statistic. Biochem Med (Zagreb) 22, 276\u2013282 (2012).","journal-title":"Biochem Med (Zagreb)"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00571-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00571-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00571-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,25]],"date-time":"2022-11-25T08:24:15Z","timestamp":1669364655000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00571-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,2]]},"references-count":43,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["571"],"URL":"https:\/\/doi.org\/10.1038\/s41746-022-00571-3","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,2]]},"assertion":[{"value":"14 October 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 February 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 March 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Approval from the institutional review board of Ningbo Eye Hospital (NEH) was obtained (identifier, 2021-qtky-44), and the study protocol was performed following the Declaration of Helsinki principles. Informed consent was waived by the ethics committee of NEH due to the retrospective nature of the data collection and the use of de-identified images.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}],"article-number":"23"}}