{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T19:29:24Z","timestamp":1771702164598,"version":"3.50.1"},"reference-count":33,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,12,20]],"date-time":"2024-12-20T00:00:00Z","timestamp":1734652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:sec><jats:title>Background<\/jats:title><jats:p>Detecting programmed death ligand 1 (PD-L1) expression based on immunohistochemical (IHC) staining is an important guide for the treatment of lung cancer with immune checkpoint inhibitors. However, this method has problems such as high staining costs, tumor heterogeneity, and subjective differences among pathologists. Therefore, the application of deep learning models to segment and quantitatively predict PD-L1 expression in digital sections of Hematoxylin and eosin (H&amp;amp;E) stained lung squamous cell carcinoma is of great significance.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We constructed a dataset comprising H&amp;amp;E-stained digital sections of lung squamous cell carcinoma and used a Transformer Unet (TransUnet) deep learning network with an encoder-decoder design to segment PD-L1 negative and positive regions and quantitatively predict the tumor cell positive score (TPS).<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The results showed that the dice similarity coefficient (DSC) and intersection overunion (IoU) of deep learning for PD-L1 expression segmentation of H&amp;amp;E-stained digital slides of lung squamous cell carcinoma were 80 and 72%, respectively, which were better than the other seven cutting-edge segmentation models. The root mean square error (RMSE) of quantitative prediction TPS was 26.8, and the intra-group correlation coefficients with the gold standard was 0.92 (95% CI: 0.90\u20130.93), which was better than the consistency between the results of five pathologists and the gold standard.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>The deep learning model is capable of segmenting and quantitatively predicting PD-L1 expression in H&amp;amp;E-stained digital sections of lung squamous cell carcinoma, which has significant implications for the application and guidance of immune checkpoint inhibitor treatments. And the link to the code is <jats:uri>https:\/\/github.com\/Baron-Huang\/PD-L1-prediction-via-HE-image<\/jats:uri>.<\/jats:p><\/jats:sec>","DOI":"10.3389\/frai.2024.1452563","type":"journal-article","created":{"date-parts":[[2024,12,20]],"date-time":"2024-12-20T06:30:48Z","timestamp":1734676248000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Prediction of PD-L1 tumor positive score in lung squamous cell carcinoma with H&amp;E staining images and deep learning"],"prefix":"10.3389","volume":"7","author":[{"given":"Qiushi","family":"Wang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xixiang","family":"Deng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pan","family":"Huang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qiang","family":"Ma","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lianhua","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yangyang","family":"Feng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yiying","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuan","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yan","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peng","family":"Zhong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peng","family":"He","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingrui","family":"Ma","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peng","family":"Feng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hualiang","family":"Xiao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,12,20]]},"reference":[{"key":"ref1","article-title":"BiSeNet V2: bilateral network with guided aggregation for real-time semantic segmentation","author":"Changqian","year":"2021"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2102.04306","article-title":"TransUNet: transformers make strong encoders for medical image segmentation","author":"Chen","year":"2021","journal-title":"ArXiv"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1706.05587","article-title":"Rethinking atrous convolution for semantic image segmentation","author":"Chen","year":"2017","journal-title":"ArXiv"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_49","article-title":"Encoder-decoder with Atrous separable convolution for semantic image segmentation","author":"Chen","year":"2018","journal-title":"Eur. Conf. Comput. Vis."},{"key":"ref5","doi-asserted-by":"publisher","first-page":"1559","DOI":"10.1038\/s41591-018-0177-5","article-title":"Classification and mutation prediction from non\u2013small cell lung cancer histopathology images using deep learning","volume":"24","author":"Coudray","year":"2018","journal-title":"Nat. Med."},{"key":"ref6","doi-asserted-by":"publisher","first-page":"9915","DOI":"10.1007\/s00521-019-04516-y","article-title":"FABnet: feature attention-based network for simultaneous segmentation of microvessels and nerves in routine histology images of oral cancer","volume":"32","author":"Fraz","year":"2020","journal-title":"Neural Comput. Applic."},{"key":"ref7","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1016\/j.media.2018.12.001","article-title":"MILD-net: minimal information loss dilated network for gland instance segmentation in colon histology images","volume":"52","author":"Graham","year":"","journal-title":"Med. Image Anal."},{"key":"ref8","doi-asserted-by":"publisher","first-page":"101563","DOI":"10.1016\/j.media.2019.101563","article-title":"Hover-net: simultaneous segmentation and classification of nuclei in multi-tissue histology images","volume":"58","author":"Graham","year":"","journal-title":"Med. Image Anal."},{"key":"ref9","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-46493-0_38","volume-title":"Identity mappings in deep residual networks","author":"He","year":""},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90","article-title":"Deep residual learning for image recognition","author":"He","year":"","journal-title":"Proc. IEEE Conf. Comput. Vis. Pattern Recognit."},{"key":"ref11","doi-asserted-by":"publisher","first-page":"100921","DOI":"10.1016\/j.tranon.2020.100921","article-title":"Using deep learning to predict anti-PD-1 response in melanoma and lung cancer patients from histopathology images","volume":"14","author":"Hu","year":"2021","journal-title":"Transl. Oncol."},{"key":"ref12","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1109\/TMI.2022.3202248","article-title":"A ViT-AMC network with adaptive model fusion and multiobjective optimization for interpretable laryngeal tumor grading from histopathological images","volume":"42","author":"Huang","year":"2023","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"1696","DOI":"10.1109\/JBHI.2021.3108999","article-title":"FABNet: fusion attention block and transfer learning for laryngeal cancer tumor grading in P63 IHC histopathology images","volume":"26","author":"Huang","year":"2022","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"26286","DOI":"10.1038\/srep26286","article-title":"Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis","volume":"6","author":"Litjens","year":"2016","journal-title":"Sci. Rep."},{"key":"ref15","doi-asserted-by":"publisher","first-page":"1882","DOI":"10.1038\/s41379-022-01141-4","article-title":"Direct identification of ALK and ROS1 fusions in non-small cell lung cancer from hematoxylin and eosin-stained slides using deep learning algorithms","volume":"35","author":"Mayer","year":"2022","journal-title":"Mod. Pathol."},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1804.03999","article-title":"Attention U-net: learning where to look for the pancreas","author":"Oktay","year":"2018","journal-title":"ArXiv"},{"key":"ref17","doi-asserted-by":"crossref","DOI":"10.1109\/TITS.2022.3228042","volume-title":"Deep dual-resolution networks for real-time and accurate semantic segmentation of traffic scenes","author":"Pan","year":"2023"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"24","DOI":"10.4103\/jpi.jpi_24_19","article-title":"Multi-field-of-view deep learning model predicts nonsmall cell lung Cancer programmed death-ligand 1 status from whole-slide hematoxylin and eosin images","volume":"10","author":"Sha","year":"2019","journal-title":"J. Pathol. Inform."},{"key":"ref19","doi-asserted-by":"publisher","first-page":"6753","DOI":"10.1038\/s41467-022-34275-9","article-title":"Deep learning-based image analysis predicts PD-L1 status from H&E-stained histopathology images in breast cancer","volume":"13","author":"Shamai","year":"2022","journal-title":"Nat. Commun."},{"key":"ref20","doi-asserted-by":"publisher","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","article-title":"Fully convolutional networks for semantic segmentation","volume":"39","author":"Shelhamer","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2105.05633","article-title":"Segmenter: transformer for semantic segmentation","author":"Strudel","year":"2021","journal-title":"arXiv:2105.05633"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-67558-9_28","article-title":"Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations","author":"Sudre","year":"2017","journal-title":"Deep Learn Med Image Anal Multimodal Learn Clin Decis Support"},{"key":"ref23","article-title":"Attention is all you need","author":"Vaswani","year":"2017"},{"key":"ref24","article-title":"Segmentation transformer: object-contextual representations for semantic segmentation","author":"Wang","year":"2019"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"101549","DOI":"10.1016\/j.media.2019.101549","article-title":"RMDL: recalibrated multi-instance deep learning for whole slide gastric image classification","volume":"58","author":"Wang","year":"2019","journal-title":"Med. Image Anal."},{"key":"ref26","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1038\/s41379-021-00904-9","article-title":"Artificial intelligence-assisted system for precision diagnosis of PD-L1 expression in non-small cell lung cancer","volume":"35","author":"Wu","year":"2022","journal-title":"Mod. Pathol."},{"key":"ref27","article-title":"SegFormer: simple and efficient design for semantic segmentation with transformers","author":"Xie","year":"2021"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00388","article-title":"DenseASPP for semantic segmentation in street scenes","author":"Yang","year":"2018","journal-title":"IEEE Conf. Comp. Vis. Patt. Recogn."},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.3978\/j.issn.2072-1439.2013.07.10","article-title":"Treatment of non-small cell lung cancer (NSCLC)","author":"Zarogoulidis","year":"2013","journal-title":"J. Thorac. Dis."},{"key":"ref30","doi-asserted-by":"publisher","first-page":"21420","DOI":"10.1109\/ACCESS.2019.2896920","article-title":"RIC-Unet: an improved neural network based on Unet for nuclei segmentation in histology images","volume":"7","author":"Zeng","year":"2019","journal-title":"IEEE Access"},{"key":"ref31","article-title":"Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers","author":"Zheng","year":"2020"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"1856","DOI":"10.1109\/TMI.2019.2959609","article-title":"UNet++: redesigning skip connections to exploit multiscale features in image segmentation","volume":"39","author":"Zhou","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"104699","DOI":"10.1016\/j.compbiomed.2021.104699","article-title":"Sharp U-net: depthwise convolutional network for biomedical image segmentation","volume":"136","author":"Zunair","year":"2021","journal-title":"Comput. Biol. Med."}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1452563\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,20]],"date-time":"2024-12-20T06:30:52Z","timestamp":1734676252000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1452563\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,20]]},"references-count":33,"alternative-id":["10.3389\/frai.2024.1452563"],"URL":"https:\/\/doi.org\/10.3389\/frai.2024.1452563","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,20]]},"article-number":"1452563"}}