{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T15:02:26Z","timestamp":1789570946617,"version":"build-2803163510"},"reference-count":34,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T00:00:00Z","timestamp":1789516800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Cancers"],"abstract":"<jats:p>Background: Immunohistochemical assessment of estrogen receptor (ER), progesterone receptor (PR), proliferation marker Ki67, and human epidermal growth factor receptor 2 (HER2) represents a central component of the diagnostic workflow in invasive breast carcinoma, directly influencing therapeutic decision-making, prognosis, and patient management. In this study, we evaluated the use of Indica Labs\u2019 clinical image analysis platform for AI-assisted breast cancer biomarker scoring in a prospective observer study conducted at the University of Bern. The study compared biomarker assessment by novice observers and trained pathologists with and without AI assistance, with a focus on interobserver agreement, scoring consistency, and the potential role of AI-assisted workflows in diagnostic practice and training environments. Methods: Fifty breast cancer cases comprising 250 immunohistochemically stained slides for ER, PR, HER2, and Ki67 were independently assessed by three medical students and two board-certified pathologists in two sequential evaluation rounds. In the first round, biomarkers were scored using conventional digital pathology assessment without AI support (Visual Dx). Following a four-week washout period, the same cases were re-evaluated with assistance from HALO Breast IHC AI (AI-Assisted Dx). Observer agreement and scoring concordance were analyzed to compare performance between novice observers and experienced pathologists under unassisted and AI-assisted conditions. Results: AI-assisted assessment increased interobserver agreement at clinically relevant cutoffs across all four biomarkers in both novice observers and pathologists. Similarly, Fleiss\u2019 kappa values improved for all biomarkers following AI assistance, with an average increase of 0.42 across observer groups. When all participants were analyzed collectively, agreement at clinical decision thresholds also improved, indicating greater concordance between novice observers and experienced pathologists during AI-assisted evaluation. Conclusions: HALO Breast IHC AI supported both novice observers and experienced pathologists by improving scoring concordance and interobserver agreement across clinically relevant breast cancer biomarkers. These findings suggest that AI-assisted workflows may contribute to greater standardization and reproducibility in biomarker assessment and may also provide supportive value in educational and training settings.<\/jats:p>","DOI":"10.3390\/cancers18183003","type":"journal-article","created":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T13:50:27Z","timestamp":1789566627000},"page":"3003","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["AI-Assisted Scoring Improves Interobserver Agreement in Breast Cancer Biomarker Evaluation"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6639-1935","authenticated-orcid":false,"given":"Wiebke","family":"Solass","sequence":"first","affiliation":[{"name":"Institute of Tissue Medicine and Pathology (ITMP), University of Bern, 3008 Bern, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Clara","family":"Desteffani","sequence":"additional","affiliation":[{"name":"Institute of Tissue Medicine and Pathology (ITMP), University of Bern, 3008 Bern, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Florin","family":"Kalberer","sequence":"additional","affiliation":[{"name":"Institute of Tissue Medicine and Pathology (ITMP), University of Bern, 3008 Bern, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-8654-2531","authenticated-orcid":false,"given":"Ben","family":"Scattolo","sequence":"additional","affiliation":[{"name":"Institute of Tissue Medicine and Pathology (ITMP), University of Bern, 3008 Bern, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1964-0580","authenticated-orcid":false,"given":"Branislav","family":"Zagrapan","sequence":"additional","affiliation":[{"name":"Institute of Tissue Medicine and Pathology (ITMP), University of Bern, 3008 Bern, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Donna","family":"Mulkern","sequence":"additional","affiliation":[{"name":"Indica Labs, Albuquerque, NM 87109, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Caie","sequence":"additional","affiliation":[{"name":"Indica Labs, Albuquerque, NM 87109, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5378-3825","authenticated-orcid":false,"given":"Martin","family":"Wartenberg","sequence":"additional","affiliation":[{"name":"Institute of Tissue Medicine and Pathology (ITMP), University of Bern, 3008 Bern, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Inti","family":"Zlobec","sequence":"additional","affiliation":[{"name":"Institute of Tissue Medicine and Pathology (ITMP), University of Bern, 3008 Bern, Switzerland"},{"name":"Department Digital Medicine, University of Bern, 3008 Bern, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5026-9591","authenticated-orcid":false,"given":"Meredith","family":"Lodge","sequence":"additional","affiliation":[{"name":"Indica Labs, Albuquerque, NM 87109, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1656","DOI":"10.1093\/jnci\/djr393","article-title":"Assessment of Ki67 in Breast Cancer: Recommendations from the International Ki67 in Breast Cancer Working Group","volume":"103","author":"Dowsett","year":"2011","journal-title":"JNCI J. Natl. Cancer Inst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2784","DOI":"10.1200\/JCO.2009.25.6529","article-title":"American Society of Clinical Oncology\/College of American Pathologists Guideline Recommendations for Immunohistochemical Testing of Estrogen and Progesterone Receptors in Breast Cancer","volume":"28","author":"Hammond","year":"2010","journal-title":"J. Clin. Oncol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3997","DOI":"10.1200\/JCO.2013.50.9984","article-title":"Recommendations for Human Epidermal Growth Factor Receptor 2 Testing in Breast Cancer: American Society of Clinical Oncology\/College of American Pathologists Clinical Practice Guideline Update","volume":"31","author":"Wolff","year":"2013","journal-title":"J. Clin. Oncol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"129","DOI":"10.4132\/jptm.2015.12.24","article-title":"Interobserver Variability of Ki-67 Measurement in Breast Cancer","volume":"50","author":"Chung","year":"2016","journal-title":"J. Pathol. Transl. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"151451","DOI":"10.1016\/j.anndiagpath.2019.151451","article-title":"HER2 immunohistochemistry inter-observer reproducibility in 205 cases of invasive breast carcinoma additionally tested by ISH","volume":"45","author":"Bernet","year":"2020","journal-title":"Ann. Diagn. Pathol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1080\/02841860300672","article-title":"Estrogen and progesterone receptor assay in paraffin-embedded breast cancer: Reproducibility of assessment","volume":"42","author":"Chebil","year":"2003","journal-title":"Acta Oncol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1007\/s00428-009-0833-8","article-title":"Intra- and interobserver reproducibility of interpretation of immunohistochemical stains of prostate cancer","volume":"455","author":"Jaraj","year":"2009","journal-title":"Virchows Arch."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1007\/s10549-023-07197-3","article-title":"Subspecialized breast pathologists have suboptimal interobserver agreement in Ki-67 evaluation using 20% as the cutoff","volume":"204","author":"Ai","year":"2023","journal-title":"Breast Cancer Res. Treat."},{"key":"ref_9","first-page":"815","article-title":"Low interobserver agreement among subspecialised breast pathologists in evaluating HER2-low breast cancer","volume":"77","author":"Turashvili","year":"2023","journal-title":"J. Clin. Pathol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1038\/s41374-018-0123-7","article-title":"Ki67 reproducibility using digital image analysis: An inter-platform and inter-operator study","volume":"99","author":"Acs","year":"2020","journal-title":"Lab. Investig."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"233","DOI":"10.5858\/135.2.233","article-title":"Observer variability in the interpretation of HER2\/neu immunohistochemical expression with unaided and computer-aided digital microscopy","volume":"135","author":"Gavrielides","year":"2011","journal-title":"Arch. Pathol. Lab. Med."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1007\/s10549-015-3475-3","article-title":"Optimizing HER2 assessment in breast cancer: Application of automated image analysis","volume":"152","author":"Talman","year":"2015","journal-title":"Breast Cancer Res. Treat."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s10549-018-4669-2","article-title":"Digital image analysis of Ki67 proliferation index in breast cancer using virtual dual staining on whole tissue sections: Clinical validation and inter-platform agreement","volume":"169","author":"Koopman","year":"2018","journal-title":"Breast Cancer Res. Treat."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"100122","DOI":"10.1016\/j.jpi.2022.100122","article-title":"Integrating and validating automated digital imaging analysis of estrogen receptor immunohistochemistry in a fully digital workflow for clinical use","volume":"13","author":"Shafi","year":"2022","journal-title":"J. Pathol. Inform."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1093\/ajcp\/aqab206","article-title":"Quantitative Image Analysis as an Adjunct to Manual Scoring of ER, PgR, and HER2 in Invasive Breast Carcinoma","volume":"157","author":"Yousif","year":"2021","journal-title":"Am. J. Clin. Pathol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1186\/s13000-020-00995-z","article-title":"Accuracy and efficiency of an artificial intelligence tool when counting breast mitoses","volume":"15","author":"Pantanowitz","year":"2020","journal-title":"Diagn. Pathol."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xiong, Z., Liu, K., Liu, S., Feng, J., Wang, J., Feng, Z., Lai, B., Zhang, Q., Jiang, Q., and Zhang, W. (2024). Precision HER2: A comprehensive AI system for accurate and consistent evaluation of HER2 expression in invasive breast Cancer. BMC Cancer, 24.","DOI":"10.1186\/s12885-024-12980-6"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hsu, H., Lee, K.-H., Karmakar, R., Mukundan, A., Attar, R.S., Liu, P.-H., and Wang, H.-C. (2025). From Innovation to Application: Can Emerging Imaging Techniques Transform Breast Cancer Diagnosis?. Diagnostics, 15.","DOI":"10.3390\/diagnostics15212718"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Leung, J.-H., Karmakar, R., Mukundan, A., Thongsit, P., Chen, M.-M., Chang, W.-Y., and Wang, H.-C. (2024). Systematic Meta-Analysis of Computer-Aided Detection of Breast Cancer Using Hyperspectral Imaging. Bioengineering, 11.","DOI":"10.3390\/bioengineering11111060"},{"key":"ref_20","unstructured":"World Health Organization (2019). WHO Classification of Breast Tumours, International Agency for Research on Cancer. [5th ed.]."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1736","DOI":"10.1093\/annonc\/mdr304","article-title":"Strategies for subtypes\u2014Dealing with the diversity of breast cancer: Highlights of the St Gallen International Expert Consensus on the Primary Therapy of Early Breast Cancer 2011","volume":"22","author":"Goldhirsch","year":"2011","journal-title":"Ann. Oncol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2206","DOI":"10.1093\/annonc\/mdt303","article-title":"Personalizing the treatment of women with early breast cancer: Highlights of the St Gallen International Expert Consensus on the Primary Therapy of Early Breast Cancer 2013","volume":"24","author":"Goldhirsch","year":"2013","journal-title":"Ann. Oncol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1007\/s10549-017-4270-0","article-title":"Ki67 expression in invasive breast cancer: The use of tissue microarrays compared with whole tissue sections","volume":"164","author":"Muftah","year":"2017","journal-title":"Breast Cancer Res. Treat."},{"key":"ref_24","unstructured":"R Core Team (2021). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_25","unstructured":"Gamer, M., Lemon, J., Fellows, I., and Singh, P. (2026, August 21). irr: Various Coefficients of Interrater Reliability and Agreement; R Package Version 0.85. Available online: https:\/\/CRAN.R-project.org\/package=irr."},{"key":"ref_26","unstructured":"Christensen, R.H.B. (2026, August 21). Ordinal\u2014Regression Models for Ordinal Data; R Package Version 2019.4-25. Available online: https:\/\/CRAN.R-project.org\/package=ordinal."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Varga, Z., Diebold, J., Dommann-Scherrer, C., Frick, H., Kaup, D., Noske, A., Obermann, E., Ohlschlegel, C., Padberg, B., and Rakozy, C. (2012). How Reliable Is Ki-67 Immunohistochemistry in Grade 2 Breast Carcinomas? A QA Study of the Swiss Working Group of Breast- and Gynecopathologists. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0037379"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1080\/0284186X.2017.1404127","article-title":"An inter-observer Ki67 reproducibility study applying two different assessment methods: On behalf of the Danish Scientific Committee of Pathology, Danish breast cancer cooperative group (DBCG)","volume":"57","author":"Laenkholm","year":"2017","journal-title":"Acta Oncol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1186\/s13058-024-01784-y","article-title":"Augmented interpretation of HER2, ER, and PR in breast cancer by artificial intelligence analyzer: Enhancing interobserver agreement through a reader study of 201 cases","volume":"26","author":"Jung","year":"2024","journal-title":"Breast Cancer Res."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e16023","DOI":"10.1200\/JCO.2024.42.16_suppl.e16023","article-title":"Digital versus manual pathology scoring of PD-L1 in patients with esophageal squamous cell carcinoma (ESCC)","volume":"42","author":"Duan","year":"2024","journal-title":"J. Clin. Oncol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1038\/s41379-021-00904-9","article-title":"Artificial intelligence-assisted system for precision diagnosis of PD-L1 expression in non-small cell lung cancer","volume":"35","author":"Wu","year":"2022","journal-title":"Mod. Pathol."},{"key":"ref_32","first-page":"1","article-title":"Artificial intelligence and medical education: A global mixed-methods study of medical students\u2019 perspectives","volume":"8","author":"Ejaz","year":"2022","journal-title":"Digit. Health"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1177\/15533506241248239","article-title":"The Role of Artificial Intelligence in Medical Education: A Systematic Review","volume":"31","author":"Tozsin","year":"2024","journal-title":"Surg. Innov."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"182","DOI":"10.4103\/mj.mj_45_23","article-title":"Role of Artificial Intelligence in Teaching Pathology to Medical Students","volume":"22","author":"Puri","year":"2023","journal-title":"Mustansiriya Med. J."}],"container-title":["Cancers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-6694\/18\/18\/3003\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T14:04:57Z","timestamp":1789567497000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-6694\/18\/18\/3003"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,16]]},"references-count":34,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["cancers18183003"],"URL":"https:\/\/doi.org\/10.3390\/cancers18183003","relation":{},"ISSN":["2072-6694"],"issn-type":[{"value":"2072-6694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,16]]}}}