{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T21:58:06Z","timestamp":1788559086896,"version":"build-2803163510"},"reference-count":27,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2023,9,30]],"date-time":"2023-09-30T00:00:00Z","timestamp":1696032000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004242","name":"Princess Nourah bint Abdulrahman University","doi-asserted-by":"publisher","award":["PNURSP2023R321"],"award-info":[{"award-number":["PNURSP2023R321"]}],"id":[{"id":"10.13039\/501100004242","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Introduction: Breast cancer is the most common cancer in women; its early detection plays a crucial role in improving patient outcomes. Ki-67 is a biomarker commonly used for evaluating the proliferation of cancer cells in breast cancer patients. The quantification of Ki-67 has traditionally been performed by pathologists through a manual examination of tissue samples, which can be time-consuming and subject to inter- and intra-observer variability. In this study, we used a novel deep learning model to quantify Ki-67 in breast cancer in digital images prepared by a microscope-attached camera. Objective: To compare the automated detection of Ki-67 with the manual eyeball\/hotspot method. Place and duration of study: This descriptive, cross-sectional study was conducted at the Jinnah Sindh Medical University. Glass slides of diagnosed cases of breast cancer were obtained from the Aga Khan University Hospital after receiving ethical approval. The duration of the study was one month. Methodology: We prepared 140 digital images stained with the Ki-67 antibody using a microscope-attached camera at 10\u00d7. An expert pathologist (P1) evaluated the Ki-67 index of the hotspot fields using the eyeball method. The images were uploaded to the DeepLiif software to detect the exact percentage of Ki-67 positive cells. SPSS version 24 was used for data analysis. Diagnostic accuracy was also calculated by other pathologists (P2, P3) and by AI using a Ki-67 cut-off score of 20 and taking P1 as the gold standard. Results: The manual and automated scoring methods showed a strong positive correlation as the kappa coefficient was significant. The p value was &lt;0.001. The highest diagnostic accuracy, i.e., 95%, taking P1 as gold standard, was found for AI, compared to pathologists P2 and P3. Conclusions: Use of quantification-based deep learning models can make the work of pathologists easier and more reproducible. Our study is one of the earliest studies in this field. More studies with larger sample sizes are needed in future to develop a cohort.<\/jats:p>","DOI":"10.3390\/diagnostics13193105","type":"journal-article","created":{"date-parts":[[2023,10,2]],"date-time":"2023-10-02T04:17:19Z","timestamp":1696220239000},"page":"3105","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Use of a Novel Deep Learning Open-Source Model for Quantification of Ki-67 in Breast Cancer Patients in Pakistan: A Comparative Study between the Manual and Automated Methods"],"prefix":"10.3390","volume":"13","author":[{"given":"Talat","family":"Zehra","sequence":"first","affiliation":[{"name":"Department of Pathology, Jinnah Sindh Medical University, Karachi 75001, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nazish","family":"Jaffar","sequence":"additional","affiliation":[{"name":"Department of Pathology, Jinnah Sindh Medical University, Karachi 75001, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mahin","family":"Shams","sequence":"additional","affiliation":[{"name":"Department of Pathology, United Medical and Dental College, Karachi 71500, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qurratulain","family":"Chundriger","sequence":"additional","affiliation":[{"name":"Department of Pathology and Laboratory Medicine, Section of Histopathology, Aga Khan University Hospital, Karachi 3500, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arsalan","family":"Ahmed","sequence":"additional","affiliation":[{"name":"Department of Pathology and Laboratory Medicine, Section of Histopathology, Aga Khan University Hospital, Karachi 3500, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-7329-0522","authenticated-orcid":false,"given":"Fariha","family":"Anum","sequence":"additional","affiliation":[{"name":"Research Department, Ziauddin University, Karachi 75600, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6381-9019","authenticated-orcid":false,"given":"Najah","family":"Alsubaie","sequence":"additional","affiliation":[{"name":"Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University (PNU), P.O. Box 84428, Riyadh 11671, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zubair","family":"Ahmad","sequence":"additional","affiliation":[{"name":"Consultant Histopathologist, Sultan Qaboos Comprehensive Cancer Care and Research Centre, Seeb P.O. Box 556, Oman"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1111\/his.14355","article-title":"A simple digital image analysis system for automated Ki67 assessment in primary breast cancer","volume":"79","author":"Alataki","year":"2021","journal-title":"Histopathology"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Davey, M.G., Hynes, S.O., Kerin, M.J., Miller, N., and Lowery, A.J. (2021). Ki-67 as a prognostic biomarker in invasive breast cancer. Cancers, 13.","DOI":"10.3390\/cancers13174455"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/s10549-020-05752-w","article-title":"Prognostic potential of automated Ki67 evaluation in breast cancer: Different hot spot definitions versus true global score","volume":"183","author":"Robertson","year":"2020","journal-title":"Breast Cancer Res. Treat."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1186\/s13058-016-0765-6","article-title":"Prognostic value of automated KI67 scoring in breast cancer: A centralised evaluation of 8088 patients from 10 study groups","volume":"18","author":"Abubakar","year":"2016","journal-title":"Breast Cancer Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"808","DOI":"10.1093\/jnci\/djaa201","article-title":"Assessment of Ki67 in breast cancer: Updated recommendations from the international Ki67 in breast cancer working group","volume":"113","author":"Nielsen","year":"2021","journal-title":"JNCI J. Natl. Cancer Inst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1111\/his.14140","article-title":"Automated assessment of Ki-67 in breast cancer: The utility of digital image analysis using virtual triple staining and whole slide imaging","volume":"77","author":"Hida","year":"2020","journal-title":"Histopathology"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1038\/s41379-018-0109-4","article-title":"An international multicenter study to evaluate reproducibility of automated scoring for assessment of Ki67 in breast cancer","volume":"32","author":"Rimm","year":"2019","journal-title":"Mod. Pathol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"8","DOI":"10.4103\/jpi.jpi_76_18","article-title":"Ki67 quantitative interpretation: Insights using image analysis","volume":"10","author":"Volynskaya","year":"2019","journal-title":"J. Pathol. Inform."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Boyaci, C., Sun, W., Robertson, S., Acs, B., and Hartman, J. (2021). Independent clinical validation of the automated Ki67 scoring guideline from the International Ki67 in Breast Cancer Working Group. Biomolecules, 11.","DOI":"10.3390\/biom11111612"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhong, F., Bi, R., Yu, B., Yang, F., Yang, W., and Shui, R. (2016). A comparison of visual assessment and automated digital image analysis of Ki67 labeling index in breast cancer. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0150505"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Cho, W.C. (2022). Digital Pathology: New Initiative in Pathology. Biomolecules, 12.","DOI":"10.3390\/biom12091314"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1038\/s42256-022-00471-x","article-title":"Deep learning-inferred multiplex immunofluorescence for immunohistochemical image quantification","volume":"4","author":"Ghahremani","year":"2022","journal-title":"Nat. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ghahremani, P., Marino, J., Dodds, R., and Nadeem, S. (2022, January 18\u201324). DeepLIIF: An Online Platform for Quantification of Clinical Pathology Slides. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition 2022, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.02071"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ghahremani, P., Marino, J., Hernandez-Prera, J., de la Iglesia, J.V., Slebos, R.J., Chung, C.H., and Nadeem, S. (2023, January 25). An AI-Ready Multiplex Staining Dataset for Reproducible and Accurate Characterization of Tumor Immune Microenvironment. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Vancouver, BC, Canada.","DOI":"10.1007\/978-3-031-43987-2_68"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1003","DOI":"10.5858\/arpa.2022-0457-RA","article-title":"Applications of Artificial Intelligence in Breast Pathology","volume":"147","author":"Liu","year":"2023","journal-title":"Arch. Pathol. Lab. Med."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Acs, B., Leung, S.C., and Pelekanou, V. (2018, January 4\u201310). Analytical Validation of an Automated Digital Scoring Protocol for Ki67. Proceedings of the International Multicenter Collaboration Study, San Antonio Breast Cancer Symposium, San Antonio, TX, USA. P4-02-01.","DOI":"10.1158\/1538-7445.SABCS18-P4-02-01"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"974","DOI":"10.1111\/his.13452","article-title":"Digital image analysis of Ki67 in hot spots is superior to both manual Ki67 and mitotic counts in breast cancer","volume":"72","author":"Robertson","year":"2018","journal-title":"Histopathology"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3651","DOI":"10.1158\/1078-0432.CCR-14-1283","article-title":"Standardized Ki67 Diagnostics Using Automated Scoring\u2014Clinical Validation in the GeparTrio Breast Cancer Study Clinically Validated Automated Ki67 Scoring","volume":"21","author":"Klauschen","year":"2015","journal-title":"Clin. Cancer Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1038\/modpathol.2016.34","article-title":"Digital image analysis outperforms manual biomarker assessment in breast cancer","volume":"29","author":"Martinez","year":"2016","journal-title":"Mod. Pathol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1038\/nature13952","article-title":"Dynamics of genomic clones in breast cancer patient xenografts at single-cell resolution","volume":"518","author":"Martinez","year":"2015","journal-title":"Nature"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1056\/NEJMoa1113205","article-title":"Intratumor heterogeneity branched evolution revealed by multi region sequencing","volume":"366","author":"Gerlinger","year":"2012","journal-title":"N. Engl. J. Med."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1111\/his.12392","article-title":"Immunohistochemical assessment of Ki67 with antibodies SP6 and MIB1 in primary breast cancer: A comparison of prognostic value and reproducibility","volume":"65","author":"Ekholm","year":"2014","journal-title":"Histopathology"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1136\/jcp.55.6.467","article-title":"Comparison of Ki-67 equivalent antibodies","volume":"55","author":"Lindboe","year":"2002","journal-title":"J. Clin. Pathol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"R89","DOI":"10.1186\/bcr2187","article-title":"Novel image analysis approach for quantifying expression of nuclear proteins assessed by immunohistochemistry: Application to measurement of oestrogen and progesterone receptor levels in breast cancer","volume":"10","author":"Rexhepaj","year":"2008","journal-title":"Breast Cancer Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.5858\/arpa.2020-0715-SA","article-title":"Digital pathology initiatives and experience of a large academic institution during the coronavirus disease 2019 (COVID-19) pandemic","volume":"145","author":"Lujan","year":"2021","journal-title":"Arch. Pathol. Lab. Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"544","DOI":"10.29271\/jcpsp.2023.05.544","article-title":"Ki 67 Quantification in Breast Cancer by Digital Imaging AI Software and its Concordance with Manual Method","volume":"33","author":"Zehra","year":"2023","journal-title":"J. Coll. Physicians Surg. Pak."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1186\/s13000-023-01352-6","article-title":"A suggested way forward for adoption of AI-Enabled digital pathology in low resource organizations in the developing world","volume":"18","author":"Zehra","year":"2023","journal-title":"Diagn. Pathol."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/13\/19\/3105\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:03:11Z","timestamp":1760130191000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/13\/19\/3105"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,30]]},"references-count":27,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["diagnostics13193105"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics13193105","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,30]]}}}