{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T20:20:31Z","timestamp":1781814031157,"version":"3.54.5"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1013907","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T00:00:00Z","timestamp":1769644800000}}],"reference-count":41,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T00:00:00Z","timestamp":1768953600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100014690","name":"Ministerium f\u00fcr Kultur und Wissenschaft des Landes Nordrhein-Westfalen","doi-asserted-by":"publisher","award":["311-8.03.03.02-147635"],"award-info":[{"award-number":["311-8.03.03.02-147635"]}],"id":[{"id":"10.13039\/501100014690","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005972","name":"Deutsche Krebshilfe","doi-asserted-by":"publisher","award":["70113307"],"award-info":[{"award-number":["70113307"]}],"id":[{"id":"10.13039\/501100005972","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["CRC1399, project ID 413326622"],"award-info":[{"award-number":["CRC1399, project ID 413326622"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["BR 6949"],"award-info":[{"award-number":["BR 6949"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005972","name":"Deutsche Krebshilfe","doi-asserted-by":"publisher","award":["70113307"],"award-info":[{"award-number":["70113307"]}],"id":[{"id":"10.13039\/501100005972","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["CRC1399, project ID 413326622"],"award-info":[{"award-number":["CRC1399, project ID 413326622"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["CRC1310, project ID 325931972"],"award-info":[{"award-number":["CRC1310, project ID 325931972"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005972","name":"Deutsche Krebshilfe","doi-asserted-by":"publisher","award":["70116929"],"award-info":[{"award-number":["70116929"]}],"id":[{"id":"10.13039\/501100005972","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ministry of Culture and Science of the State of Northrhine Westphalia","award":["NW21-062B"],"award-info":[{"award-number":["NW21-062B"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>\n                    Recent advances in digital pathology have enabled comprehensive analyses of Whole-Slide Images (WSIs) from tissue samples, leveraging high-resolution microscopy and computational capabilities. Despite this progress, available tools for automatic cell type identification perform poorly on skin tissue, e.g. in the classification of non-melanoma tumor cells. This is due to a paucity of labeled training data sets and high morphological similarities between tumor and non-tumor epithelial cells in the skin. Here, we propose Histo-Miner, a deep learning-based pipeline designed for the analysis of skin WSIs. To this end we generated two new datasets using WSIs of cutaneous Squamous Cell Carcinoma (cSCC) samples, a frequent non-melanoma skin cancer, by annotating 47,392 cell nuclei across 5 cell types in 21 WSIs and segmenting tumor regions in 144 WSIs. Histo-Miner employs convolutional neural networks and vision transformers for nucleus segmentation and classification, as well as tumor region segmentation. Performance of trained models positively compares to state of the art with multi-class Panoptic Quality (mPQ) of 0.569 for nucleus segmentation, macro-averaged F1 of 0.832 for nucleus classification and mean Intersection over Union (mIoU) of 0.907 for tumor region segmentation. From these output, the pipeline can generate a compact feature vector summarizing tissue morphology and cellular interactions, which can be used for various downstream tasks. As an exemplary use-case, we deploy Histo-Miner to predict cSCC patient response to immunotherapy based on pre-treatment WSIs from 45 patients. Histo-Miner predicts patient response with mean area under ROC curve of 0.755 \u00b1 0.091 over cross-validation, and identifies percentages of lymphocytes, the granulocyte to lymphocyte ratio in tumor vicinity and the distances between granulocytes and plasma cells in tumors as predictive features for therapy response. This highlights the applicability of Histo-Miner to clinically relevant scenarios, providing direct interpretation of the classification and insights into the underlying biology. Importantly, Histo-Miner is designed to allow for its use on other cancer types and on other training datasets. Our tool and datasets are available through our github repository:\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/bozeklab\/histo-miner\" xlink:type=\"simple\">https:\/\/github.com\/bozeklab\/histo-miner<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1371\/journal.pcbi.1013907","type":"journal-article","created":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T18:43:03Z","timestamp":1769020983000},"page":"e1013907","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Histo-Miner: Deep learning based tissue features extraction pipeline from H&amp;E whole slide images of cutaneous squamous cell carcinoma"],"prefix":"10.1371","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-3857-5641","authenticated-orcid":true,"given":"Lucas","family":"Sanc\u00e9r\u00e9","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carina","family":"Lorenz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Doris","family":"Helbig","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oana-Diana","family":"Persa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sonja","family":"Dengler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Kreuter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martim","family":"Laimer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roland","family":"Lang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne","family":"Fr\u00f6hlich","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Landsberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johannes","family":"Br\u00e4gelmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katarzyna","family":"Bozek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,1,21]]},"reference":[{"issue":"5","key":"pcbi.1013907.ref001","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1080\/10520290310001633725","article-title":"Traditional staining for routine diagnostic pathology including the role of tannic acid. 1. Value and limitations of the hematoxylin-eosin stain","volume":"78","author":"D Wittekind","year":"2003","journal-title":"Biotech Histochem."},{"key":"pcbi.1013907.ref002","doi-asserted-by":"crossref","first-page":"101890","DOI":"10.1016\/j.media.2020.101890","article-title":"HookNet: multi-resolution convolutional neural networks for semantic segmentation in histopathology whole-slide images","volume":"68","author":"M van Rijthoven","year":"2021","journal-title":"Med Image Anal."},{"key":"pcbi.1013907.ref003","article-title":"Unleashing the power of prompt-driven nucleus instance segmentation","author":"Z Shui","year":"2023","journal-title":"arXiv preprint"},{"issue":"11","key":"pcbi.1013907.ref004","doi-asserted-by":"crossref","first-page":"3003","DOI":"10.1109\/TMI.2022.3176598","article-title":"A graph-transformer for whole slide image classification","volume":"41","author":"Y Zheng","year":"2022","journal-title":"IEEE Trans Med Imaging."},{"issue":"1","key":"pcbi.1013907.ref005","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1038\/s41467-024-45589-1","article-title":"Regression-based deep-learning predicts molecular biomarkers from pathology slides","volume":"15","author":"OSM El Nahhas","year":"2024","journal-title":"Nat Commun."},{"issue":"8","key":"pcbi.1013907.ref006","article-title":"An artificial intelligence algorithm for prostate cancer diagnosis in whole slide images of core needle biopsies: a blinded clinical validation and deployment study","volume":"2","author":"L Pantanowitz","year":"2020","journal-title":"Lancet Digit Health."},{"issue":"4","key":"pcbi.1013907.ref007","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1002\/path.5966","article-title":"The state of the art for artificial intelligence in lung digital pathology","volume":"257","author":"VS Viswanathan","year":"2022","journal-title":"J Pathol."},{"key":"pcbi.1013907.ref008","article-title":"MONAI: an open-source framework for deep learning in healthcare","author":"MJ Cardoso","year":"2022","journal-title":"arXiv preprint"},{"key":"pcbi.1013907.ref009","doi-asserted-by":"crossref","unstructured":"Lu MY, Chen B, Zhang A, Williamson DFK, Chen RJ, Ding T, et al. Visual language pretrained multiple instance zero-shot transfer for histopathology images. In: 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2023. p. 19764\u201375. https:\/\/doi.org\/10.1109\/cvpr52729.2023.01893","DOI":"10.1109\/CVPR52729.2023.01893"},{"issue":"3","key":"pcbi.1013907.ref010","doi-asserted-by":"crossref","first-page":"850","DOI":"10.1038\/s41591-024-02857-3","article-title":"Towards a general-purpose foundation model for computational pathology","volume":"30","author":"RJ Chen","year":"2024","journal-title":"Nat Med."},{"issue":"1","key":"pcbi.1013907.ref011","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1038\/s41698-023-00365-0","article-title":"Self-supervised attention-based deep learning for pan-cancer mutation prediction from histopathology","volume":"7","author":"OL Saldanha","year":"2023","journal-title":"NPJ Precis Oncol."},{"key":"pcbi.1013907.ref012","unstructured":"H JY, H Y, R ML. Squamous Cell Skin Cancer. Treasure Island (FL): StatPearls Publishing; 2024."},{"issue":"7","key":"pcbi.1013907.ref013","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1038\/s41568-023-00583-5","article-title":"Advances in cutaneous squamous cell carcinoma","volume":"23","author":"MCG Winge","year":"2023","journal-title":"Nat Rev Cancer."},{"key":"pcbi.1013907.ref014","doi-asserted-by":"crossref","first-page":"101563","DOI":"10.1016\/j.media.2019.101563","article-title":"Hover-Net: simultaneous segmentation and classification of nuclei in multi-tissue histology images","volume":"58","author":"S Graham","year":"2019","journal-title":"Med Image Anal."},{"key":"pcbi.1013907.ref015","article-title":"PanNuke dataset extension, insights and baselines","author":"J Gamper","year":"2020","journal-title":"arXiv preprint"},{"key":"pcbi.1013907.ref016","doi-asserted-by":"crossref","unstructured":"Strudel R, Garcia R, Laptev I, Schmid C. Segmenter: transformer for semantic segmentation. In: 2021 IEEE\/CVF International Conference on Computer Vision (ICCV). 2021. p. 7242\u201352. https:\/\/doi.org\/10.1109\/iccv48922.2021.00717","DOI":"10.1109\/ICCV48922.2021.00717"},{"issue":"3","key":"pcbi.1013907.ref017","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1007\/s11263-018-1140-0","article-title":"Semantic understanding of scenes through the ADE20K dataset","volume":"127","author":"B Zhou","year":"2018","journal-title":"Int J Comput Vis."},{"key":"pcbi.1013907.ref018","doi-asserted-by":"crossref","unstructured":"Mottaghi R, Chen X, Liu X, Cho N-G, Lee S-W, Fidler S, et al. The role of context for object detection and semantic segmentation in the wild. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition. 2014. p. 891\u20138. https:\/\/doi.org\/10.1109\/cvpr.2014.119","DOI":"10.1109\/CVPR.2014.119"},{"key":"pcbi.1013907.ref019","article-title":"Adam: a method for stochastic optimization","author":"DP Kingma","year":"2014","journal-title":"CoRR."},{"key":"pcbi.1013907.ref020","article-title":"How to train your ViT? data, augmentation, and regularization in vision transformers","volume":"2022","author":"A Steiner","year":"2021","journal-title":"Trans Mach Learn Res."},{"key":"pcbi.1013907.ref021","unstructured":"Contributors M. MMSegmentation: OpenMMLab semantic segmentation toolbox and benchmark. 2020. https:\/\/github.com\/open-mmlab\/mmsegmentation"},{"issue":"6","key":"pcbi.1013907.ref022","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1097\/PAP.0000000000000161","article-title":"Assessing tumor-infiltrating lymphocytes in solid tumors: a practical review for pathologists and proposal for a standardized method from the international immuno-oncology biomarkers working group: Part 2: TILs in melanoma, gastrointestinal tract carcinomas, non-small cell lung carcinoma and mesothelioma, endometrial and ovarian carcinomas, squamous cell carcinoma of the head and neck, genitourinary carcinomas, and primary brain tumors","volume":"24","author":"S Hendry","year":"2017","journal-title":"Adv Anat Pathol."},{"issue":"8","key":"pcbi.1013907.ref023","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1109\/TPAMI.2005.159","article-title":"Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy","volume":"27","author":"H Peng","year":"2005","journal-title":"IEEE Trans Pattern Anal Mach Intell."},{"key":"pcbi.1013907.ref024","doi-asserted-by":"crossref","unstructured":"Chen T, Guestrin C. XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. vol. 11. ACM; 2016. p. 785\u201394.","DOI":"10.1145\/2939672.2939785"},{"key":"pcbi.1013907.ref025","doi-asserted-by":"crossref","first-page":"53","DOI":"10.3389\/fbioe.2019.00053","article-title":"Methods for segmentation and classification of digital microscopy tissue images","volume":"7","author":"QD Vu","year":"2019","journal-title":"Front Bioeng Biotechnol."},{"issue":"7","key":"pcbi.1013907.ref026","doi-asserted-by":"crossref","first-page":"1550","DOI":"10.1109\/TMI.2017.2677499","article-title":"A dataset and a technique for generalized nuclear segmentation for computational pathology","volume":"36","author":"N Kumar","year":"2017","journal-title":"IEEE Trans Med Imaging."},{"key":"pcbi.1013907.ref027","doi-asserted-by":"crossref","first-page":"103143","DOI":"10.1016\/j.media.2024.103143","article-title":"CellViT: vision transformers for precise cell segmentation and classification","volume":"94","author":"F H\u00f6rst","year":"2024","journal-title":"Med Image Anal."},{"issue":"3","key":"pcbi.1013907.ref028","doi-asserted-by":"crossref","first-page":"393","DOI":"10.3390\/bioengineering10030393","article-title":"GSN-HVNET: a lightweight, multi-task deep learning framework for nuclei segmentation and classification","volume":"10","author":"T Zhao","year":"2023","journal-title":"Bioengineering (Basel)."},{"key":"pcbi.1013907.ref029","doi-asserted-by":"crossref","unstructured":"Xu Y, Mo T, Feng Q, Zhong P, Lai M, Chang EI-C. Deep learning of feature representation with multiple instance learning for medical image analysis. In: 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2014. p. 1626\u201330. https:\/\/doi.org\/10.1109\/icassp.2014.6853873","DOI":"10.1109\/ICASSP.2014.6853873"},{"issue":"12","key":"pcbi.1013907.ref030","doi-asserted-by":"crossref","first-page":"6617","DOI":"10.1109\/TAI.2024.3454591","article-title":"AugDiff: diffusion-based feature augmentation for multiple instance learning in whole slide image","volume":"5","author":"Z Shao","year":"2024","journal-title":"IEEE Trans Artif Intell."},{"key":"pcbi.1013907.ref031","doi-asserted-by":"crossref","unstructured":"Pirovano A, Heuberger H, Berlemont S, Ladjal S, Bloch I. Improving interpretability for computer-aided diagnosis tools on whole slide imaging with multiple instance learning and gradient-based explanations. Interpretable and Annotation-Efficient Learning for Medical Image Computing. Cham: Springer; 2020. p. 43\u201353.","DOI":"10.1007\/978-3-030-61166-8_5"},{"issue":"6","key":"pcbi.1013907.ref032","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1038\/s41551-020-00682-w","article-title":"Data-efficient and weakly supervised computational pathology on whole-slide images","volume":"5","author":"MY Lu","year":"2021","journal-title":"Nat Biomed Eng."},{"key":"pcbi.1013907.ref033","doi-asserted-by":"crossref","unstructured":"Li B, Li Y, Eliceiri KW. Dual-stream multiple instance learning network for whole slide image classification with self-supervised contrastive learning. In: 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE; 2021.","DOI":"10.1109\/CVPR46437.2021.01409"},{"key":"pcbi.1013907.ref034","article-title":"TransMIL: transformer based correlated multiple instance learning for whole slide image classification","author":"Z Shao","year":"2021","journal-title":"arXiv preprint"},{"key":"pcbi.1013907.ref035","article-title":"Fine-tuning a multiple instance learning feature extractor with masked context modelling and knowledge distillation","author":"J Pisula","year":"2024","journal-title":"arXiv preprint"},{"issue":"16","key":"pcbi.1013907.ref036","doi-asserted-by":"crossref","first-page":"4557","DOI":"10.1158\/1078-0432.CCR-21-0585","article-title":"Pilot phase II trial of neoadjuvant immunotherapy in locoregionally advanced, resectable cutaneous squamous cell carcinoma of the head and neck","volume":"27","author":"R Ferrarotto","year":"2021","journal-title":"Clin Cancer Res."},{"issue":"5","key":"pcbi.1013907.ref037","doi-asserted-by":"crossref","first-page":"1044","DOI":"10.3390\/cancers16051044","article-title":"The neutrophil-to-lymphocyte ratio as a biomarker in cutaneous oncology: a systematic review of evidence beyond malignant melanoma","volume":"16","author":"K Seretis","year":"2024","journal-title":"Cancers (Basel)."},{"key":"pcbi.1013907.ref038","doi-asserted-by":"crossref","first-page":"686308","DOI":"10.3389\/fonc.2021.686308","article-title":"Cemiplimab in an elderly frail population of patients with locally advanced or metastatic cutaneous squamous cell carcinoma: a single-center real-life experience from Italy","volume":"11","author":"S Strippoli","year":"2021","journal-title":"Front Oncol."},{"issue":"7980","key":"pcbi.1013907.ref039","doi-asserted-by":"crossref","first-page":"868","DOI":"10.1038\/s41586-023-06498-3","article-title":"Spatial predictors of immunotherapy response in triple-negative breast cancer","volume":"621","author":"XQ Wang","year":"2023","journal-title":"Nature."},{"issue":"4","key":"pcbi.1013907.ref040","doi-asserted-by":"crossref","DOI":"10.1016\/j.immuni.2018.09.020","article-title":"The lineage-defining transcription factors SOX2 and NKX2-1 determine lung cancer cell fate and shape the tumor immune microenvironment","volume":"49","author":"G Mollaoglu","year":"2018","journal-title":"Immunity."},{"issue":"6679","key":"pcbi.1013907.ref041","article-title":"Deterministic reprogramming of neutrophils within tumors","volume":"383","author":"MSF Ng","year":"2024","journal-title":"Science."}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1013907","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T00:00:00Z","timestamp":1769644800000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1013907","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T18:38:20Z","timestamp":1769711900000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1013907"}},"subtitle":[],"editor":[{"given":"Stacey D.","family":"Finley","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,1,21]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1,21]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1013907","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,21]]}}}