{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,30]],"date-time":"2026-10-30T13:53:00Z","timestamp":1793368380959,"version":"4.5.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,8,9]],"date-time":"2021-08-09T00:00:00Z","timestamp":1628467200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,9]],"date-time":"2021-08-09T00:00:00Z","timestamp":1628467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Gachon Program","award":["GCU-202008440010"],"award-info":[{"award-number":["GCU-202008440010"]}]},{"DOI":"10.13039\/501100013129","name":"Ministry of SMEs and Startups","doi-asserted-by":"publisher","award":["S2797147"],"award-info":[{"award-number":["S2797147"]}],"id":[{"id":"10.13039\/501100013129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100013129","name":"Ministry of SMEs and Startups","doi-asserted-by":"publisher","award":["S2797147"],"award-info":[{"award-number":["S2797147"]}],"id":[{"id":"10.13039\/501100013129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100013129","name":"Ministry of SMEs and Startups","doi-asserted-by":"publisher","award":["S2797147"],"award-info":[{"award-number":["S2797147"]}],"id":[{"id":"10.13039\/501100013129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100013173","name":"Gyeonggi-do Regional Research Center","doi-asserted-by":"publisher","award":["GRRC-Gachon2020(B01)"],"award-info":[{"award-number":["GRRC-Gachon2020(B01)"]}],"id":[{"id":"10.13039\/501100013173","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Cervical cancer is the second most common cancer in women worldwide with a mortality rate of 60%. Cervical cancer begins with no overt signs and has a long latent period, making early detection through regular checkups vitally immportant. In this study, we compare the performance of two different models, machine learning and deep learning, for the purpose of identifying signs of cervical cancer using cervicography images. Using the deep learning model ResNet-50 and the machine learning models XGB, SVM, and RF, we classified 4119 Cervicography images as positive or negative for cervical cancer using square images in which the vaginal wall regions were removed. The machine learning models extracted 10 major features from a total of 300 features. All tests were validated by fivefold cross-validation and receiver operating characteristics (ROC) analysis yielded the following AUCs: ResNet-50 0.97(CI 95% 0.949\u20130.976), XGB 0.82(CI 95% 0.797\u20130.851), SVM 0.84(CI 95% 0.801\u20130.854), RF 0.79(CI 95% 0.804\u20130.856). The ResNet-50 model showed a 0.15 point improvement (\n                    <jats:italic>p<\/jats:italic>\n                    \u2009&lt;\u20090.05) over the average (0.82) of the three machine learning methods. Our data suggest that the ResNet-50 deep learning algorithm could offer greater performance than current machine learning models for the purpose of identifying cervical cancer using cervicography images.\n                  <\/jats:p>","DOI":"10.1038\/s41598-021-95748-3","type":"journal-article","created":{"date-parts":[[2021,8,9]],"date-time":"2021-08-09T06:10:36Z","timestamp":1628489436000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":110,"title":["Comparison of machine and deep learning for the classification of cervical cancer based on cervicography images"],"prefix":"10.1038","volume":"11","author":[{"given":"Ye Rang","family":"Park","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Young Jae","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Woong","family":"Ju","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyehyun","family":"Nam","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soonyung","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kwang Gi","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,8,9]]},"reference":[{"key":"95748_CR1","doi-asserted-by":"publisher","first-page":"2217","DOI":"10.1016\/S0140-6736(03)13778-6","volume":"361","author":"EW Steven","year":"2003","unstructured":"Steven, E. W. Cervical cancer. Lancet 361, 2217\u20132225 (2003).","journal-title":"Lancet"},{"key":"95748_CR2","doi-asserted-by":"publisher","first-page":"7","DOI":"10.3322\/caac.21551","volume":"69","author":"LS Rebecca","year":"2019","unstructured":"Rebecca, L. S. et al. Cancer Statistics 2019. Cancer J. Clin. 69, 7\u201334 (2019).","journal-title":"Cancer J. Clin."},{"key":"95748_CR3","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1016\/S0140-6736(20)30157-4","volume":"395","author":"K Canfell","year":"2020","unstructured":"Canfell, K. et al. Mortality impact of achieving WHO cervical cancer elimination targets: A comparative modelling analysis in 78 low-income and lower-middle-income countries. Lancet 395, 591\u2013603 (2020).","journal-title":"Lancet"},{"key":"95748_CR4","doi-asserted-by":"publisher","first-page":"815","DOI":"10.1016\/0002-9378(81)90549-4","volume":"139","author":"S Adolf","year":"1981","unstructured":"Adolf, S. Cervicography: A new method for cervical cancer detection. Am. J. Obstet. Gynecol. 139, 815\u2013821 (1981).","journal-title":"Am. J. Obstet. Gynecol."},{"key":"95748_CR5","doi-asserted-by":"publisher","first-page":"92","DOI":"10.3322\/canjclin.51.2.92","volume":"51","author":"MF Janicek","year":"2008","unstructured":"Janicek, M. F. et al. Cervical cancer: Prevention, diagnosis, and therapeutics. Cancer J. Clin. 51, 92\u2013114 (2008).","journal-title":"Cancer J. Clin."},{"key":"95748_CR6","doi-asserted-by":"publisher","first-page":"1469","DOI":"10.1093\/jnci\/94.19.1469","volume":"94","author":"JS Mandelblatt","year":"2002","unstructured":"Mandelblatt, J. S. et al. Costs and benefits of different strategies to screen for cervical cancer in less-developed countries. J. Natl. Cancer Inst. 94, 1469\u20131483 (2002).","journal-title":"J. Natl. Cancer Inst."},{"key":"95748_CR7","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1097\/GRF.0b013e31804a8285","volume":"50","author":"TCJR Wright","year":"2007","unstructured":"Wright, T. C. J. R. Cervical cancer screening in the 21st century: Is it time to retire the PAP smear?. Clin. Obstet. Gynecol. 50, 313\u2013323 (2007).","journal-title":"Clin. Obstet. Gynecol."},{"key":"95748_CR8","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/0002-9378(82)90642-1","volume":"143","author":"M Ottaviano","year":"1982","unstructured":"Ottaviano, M. et al. Examination of the cervix with the naked eye using acetic acid test. Am. J. Obstet. Gynecol. 143, 139\u2013142 (1982).","journal-title":"Am. J. Obstet. Gynecol."},{"key":"95748_CR9","first-page":"2404","volume":"123","author":"W Small","year":"2017","unstructured":"Small, W. et al. Cervical cancer: A global health crisis. Cancer J. Clin. 123, 2404\u20132412 (2017).","journal-title":"Cancer J. Clin."},{"key":"95748_CR10","doi-asserted-by":"publisher","first-page":"2101","DOI":"10.1056\/NEJMp058171","volume":"353","author":"M Schiffman","year":"2005","unstructured":"Schiffman, M. et al. The promise of global cervical-cancer prevention. N. Engl. J. Med. 353, 2101\u20132104 (2005).","journal-title":"N. Engl. J. Med."},{"key":"95748_CR11","doi-asserted-by":"publisher","first-page":"707","DOI":"10.1136\/bmj.298.6675.707","volume":"298","author":"MI Sezgin","year":"1989","unstructured":"Sezgin, M. I. et al. Observer variation in histopathological diagnosis and grading of cervical intraepithelial neoplasia. Br. Med. J. 298, 707\u2013710 (1989).","journal-title":"Br. Med. J."},{"key":"95748_CR12","first-page":"75","volume":"8","author":"DC Sigler","year":"1985","unstructured":"Sigler, D. C. et al. Inter- and intra-examiner reliability of the upper cervical X-ray marking system. J. Manip. Physiol. Ther. 8, 75\u201380 (1985).","journal-title":"J. Manip. Physiol. Ther."},{"key":"95748_CR13","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1016\/j.ygyno.2006.07.025","volume":"104","author":"L Richard","year":"2007","unstructured":"Richard, L. Comparison of computer-assisted and manual screening of cervical cytology. Gynecol. Oncol. 104, 134\u2013138 (2007).","journal-title":"Gynecol. Oncol."},{"key":"95748_CR14","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1007\/s13534-020-00156-7","volume":"10","author":"HS Afzal","year":"2020","unstructured":"Afzal, H. S. et al. A deep learning approach for prediction of Parkinson\u2019s disease progression. Biomed. Eng. Lett. 10, 227\u2013239 (2020).","journal-title":"Biomed. Eng. Lett."},{"key":"95748_CR15","doi-asserted-by":"publisher","first-page":"4462","DOI":"10.1021\/acs.molpharmaceut.7b00578","volume":"14","author":"K Alexzandru","year":"2017","unstructured":"Alexzandru, K. et al. Comparison of deep learning with multiple machine learning methods and metrics using diverse drug discovery data sets. Mol. Pharm. 14, 4462\u20134475 (2017).","journal-title":"Mol. Pharm."},{"key":"95748_CR16","doi-asserted-by":"publisher","first-page":"351","DOI":"10.4258\/hir.2016.22.4.351","volume":"22","author":"KG Kim","year":"2016","unstructured":"Kim, K. G. Deep learning. Healthc. Inf. Res. 22, 351\u2013354 (2016).","journal-title":"Healthc. Inf. Res."},{"key":"95748_CR17","unstructured":"Xiaoyu, D., et al. Analysis of risk factors for cervical cancer based on machine learning methods. In Proceedings of the IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS), 631\u2013635 (IEEE, 2018)."},{"key":"95748_CR18","doi-asserted-by":"publisher","first-page":"778","DOI":"10.1016\/j.compbiomed.2009.06.006","volume":"39","author":"A H\u00e9ctor-Gabriel","year":"2009","unstructured":"H\u00e9ctor-Gabriel, A. et al. Aceto-white temporal pattern classification using k-NN to identify precancerous cervical lesion in colposcopic images. Comput. Biol. Med. 39, 778\u2013784 (2009).","journal-title":"Comput. Biol. Med."},{"key":"95748_CR19","unstructured":"Muhammad, T., et al. Classification of colposcopy data using GLCM-SVM on cervical cancer. In Proceedings of 2020 International Conference on Artificial Intelligence Information and Communication 373\u2013378 (ICAIIC, 2020)."},{"key":"95748_CR20","doi-asserted-by":"publisher","first-page":"89","DOI":"10.4258\/jksmi.1999.5.1.89","volume":"5","author":"HY Kim","year":"1999","unstructured":"Kim, H. Y. et al. A study on nucleus segmentation of uterine cervical pap-smears using multi stage segmentation technique. J. Korean Soc. Med. Inf. 5, 89\u201397 (1999).","journal-title":"J. Korean Soc. Med. Inf."},{"key":"95748_CR21","doi-asserted-by":"publisher","first-page":"923","DOI":"10.1093\/jnci\/djy225","volume":"111","author":"H Limming","year":"2019","unstructured":"Limming, H. et al. An observational study of deep learning and automated evaluation of cervical images for cancer screening. JNCI 111, 923\u2013932 (2019).","journal-title":"JNCI"},{"key":"95748_CR22","first-page":"3518","volume":"15","author":"S Masakazu","year":"2018","unstructured":"Masakazu, S. et al. Application of deep learning to the classification of images from colposcopy. Oncol. Lett. 15, 3518\u20133523 (2018).","journal-title":"Oncol. Lett."},{"key":"95748_CR23","unstructured":"Kangkana, B., et al. Pap smear image classification using convolutional neural network. In ICVGIP \u201816 Vol. 55, 1\u20138 (2016)."},{"key":"95748_CR24","first-page":"1","volume":"30","author":"F Valeria","year":"2017","unstructured":"Valeria, F. et al. Feature selection using lasso. VU Amsterdam Res. Pap. Bus. Anal. 30, 1\u201325 (2017).","journal-title":"VU Amsterdam Res. Pap. Bus. Anal."},{"key":"95748_CR25","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","volume":"SMC-3","author":"M Robert","year":"1973","unstructured":"Robert, M. et al. Textural Features for Image Classification. IEEE Trans. Syst. Man. Cybern. SMC-3, 610\u2013621 (1973).","journal-title":"IEEE Trans. Syst. Man. Cybern."},{"key":"95748_CR26","unstructured":"Tianqi, C., et al. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 785\u2013794 (KDD, 2016)."},{"key":"95748_CR27","first-page":"18","volume":"2","author":"L Andy","year":"2002","unstructured":"Andy, L. et al. Classification and regression by randomForest. R News 2, 18\u201322 (2002).","journal-title":"R News"},{"key":"95748_CR28","doi-asserted-by":"publisher","first-page":"1565","DOI":"10.1038\/nbt1206-1565","volume":"24","author":"SN William","year":"2006","unstructured":"William, S. N. What is a support vector machine?. Nat. Biotechnol. 24, 1565\u20131567 (2006).","journal-title":"Nat. Biotechnol."},{"key":"95748_CR29","unstructured":"Sasha, T., et al. Resnet in resnet: Generalizing residual architectures. arXiv Prepr. arXiv1603.08029 (2016)."},{"key":"95748_CR30","unstructured":"Raja, R., et al. Self-taught learning: transfer learning from unlabeled data. In Proceedings of the 24th International Conference on Machine Learning 759\u2013766 (ICML, 2017)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-95748-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-95748-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-95748-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,3]],"date-time":"2022-12-03T07:27:03Z","timestamp":1670052423000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-95748-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,9]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["95748"],"URL":"https:\/\/doi.org\/10.1038\/s41598-021-95748-3","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-254234\/v1","asserted-by":"object"}]},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,9]]},"assertion":[{"value":"18 February 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 July 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"16143"}}