{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T06:14:34Z","timestamp":1777961674194,"version":"3.51.4"},"reference-count":31,"publisher":"IOP Publishing","issue":"3","license":[{"start":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T00:00:00Z","timestamp":1777939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/publishingsupport.iopscience.iop.org\/iop-standard\/v1"},{"start":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T00:00:00Z","timestamp":1777939200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/501100021171","name":"Guangdong Basic and Applied Basic Research Foundation","doi-asserted-by":"crossref","award":["2023A1515140123"],"award-info":[{"award-number":["2023A1515140123"]}],"id":[{"id":"10.13039\/501100021171","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100018537","name":"National Science and Technology Major Project of the Ministry of Science and Technology of China","doi-asserted-by":"crossref","award":["2024ZD0531200"],"award-info":[{"award-number":["2024ZD0531200"]}],"id":[{"id":"10.13039\/501100018537","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Yunnan Provincial Science and Technology Department Social Development Special","award":["202403AC100018"],"award-info":[{"award-number":["202403AC100018"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["202105AG070010"],"award-info":[{"award-number":["202105AG070010"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Biomed. Phys. Eng. Express"],"published-print":{"date-parts":[[2026,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Nucleus segmentation in immunohistochemistry images plays a critical role in cancer diagnosis and treatment assessment. However, existing methods remain limited in segmentation accuracy and boundary delineation due to staining heterogeneity, densely packed cell distributions, and complex background interference. To address these challenges, this paper proposes a two-stage nucleus segmentation framework, termed SAM2HIPT. In the first stage, the pre-trained Segment Anything Model 2 (SAM2) is employed to generate initial segmentation predictions for input images, wherein the image encoder is kept frozen to preserve the pre-trained visual representation capacity while the mask decoder is fine-tuned to adapt to the characteristics of the pathological image domain; local texture, morphological, and boundary information are extracted through visual feature encoding to produce initial nucleus segmentation masks and spatial prior representations. In the second stage, the Hierarchical Image Pyramid Transformer is introduced to refine the initial segmentation results, performing multi-scale, multi-level feature representation and fusion of morphological, textural, and spatial structural information through a hierarchical vision Transformer architecture, thereby enhancing nuclear structural representation and boundary consistency. To enable collaborative optimization across both stages, a joint loss function is designed to impose unified constraints on segmentation accuracy and feature representation. Evaluated on two public histopathological benchmark datasets, BCData and DeepLIIF, the proposed method achieves Dice coefficients of 0.92 and 0.91, respectively, and HD95 boundary error values of 1.05 pixels and 1.10 pixels, demonstrating superior segmentation performance and robustness over multiple state-of-the-art baseline methods.<\/jats:p>","DOI":"10.1088\/2057-1976\/ae63d6","type":"journal-article","created":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T22:48:26Z","timestamp":1776984506000},"page":"035018","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["SAM2HIPT: a hybrid deep learning framework integrating SAM2 and HIPT with joint loss optimization for immunohistochemical cell nucleus segmentation"],"prefix":"10.1088","volume":"12","author":[{"given":"Yu","family":"Yao","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-9343-3684","authenticated-orcid":true,"given":"Simin","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yangsheng","family":"Hu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuanchao","family":"Xue","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-1137-8685","authenticated-orcid":true,"given":"Jie","family":"Huang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-4766-6718","authenticated-orcid":true,"given":"Jianfeng","family":"He","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-2475-232X","authenticated-orcid":true,"given":"Siming","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"266","published-online":{"date-parts":[[2026,5,5]]},"reference":[{"key":"bpexae63d6bib1","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1016\/S0140-6736(22)01438-6","type":"journal-article","article-title":"The global burden of cancer attributable to risk factors, 2010\u201319: a systematic analysis for the global burden of disease study 2019","volume":"400","author":"Tran","year":"2022","journal-title":"Lancet"},{"key":"bpexae63d6bib2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40425-016-0165-6","type":"journal-article","article-title":"Clinical significance of tumor-infiltrating lymphocytes in breast cancer","volume":"4","author":"Stanton","year":"2016","journal-title":"J. Immunother. Cancer"},{"key":"bpexae63d6bib3","first-page":"1","type":"conference-proceedings","article-title":"CrossCT: CNN and transformer cross\u2013teaching for multimodal image cell segmentation","author":"Joubbi","year":"2023"},{"key":"bpexae63d6bib4","doi-asserted-by":"publisher","first-page":"962","DOI":"10.1038\/s42003-025-08397-x","type":"journal-article","article-title":"SwinCell: a 3D transformer and flow-based framework for improved cell segmentation","volume":"8","author":"Zhang","year":"2025","journal-title":"Commun. Biol."},{"key":"bpexae63d6bib5","doi-asserted-by":"publisher","first-page":"60735","DOI":"10.1007\/s11042-023-17981-4","type":"journal-article","article-title":"MATNet: a multi-attention transformer network for nuclei segmentation in thymoma histopathology images","volume":"83","author":"Qin","year":"2024","journal-title":"Multimed. Tools Appl."},{"key":"bpexae63d6bib6","doi-asserted-by":"publisher","DOI":"10.1016\/j.heliyon.2023.e17647","type":"journal-article","article-title":"Cervical cell nuclei segmentation based on GC-UNet","volume":"9","author":"Zhang","year":"2023","journal-title":"Heliyon"},{"key":"bpexae63d6bib7","doi-asserted-by":"publisher","first-page":"980","DOI":"10.1109\/TIP.2023.3237013","type":"journal-article","article-title":"CPP-net: context-aware polygon proposal network for nucleus segmentation","volume":"32","author":"Chen","year":"2023","journal-title":"IEEE Trans. Image Process."},{"key":"bpexae63d6bib8","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2023.107378","type":"journal-article","article-title":"BAWGNet: boundary aware wavelet guided network for the nuclei segmentation in histopathology images","volume":"165","author":"Imtiaz","year":"2023","journal-title":"Comput. Biol. Med."},{"key":"bpexae63d6bib9","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2024.107938","type":"journal-article","article-title":"TSCA-Net: transformer based spatial-channel attention segmentation network for medical images","volume":"170","author":"Fu","year":"2024","journal-title":"Comput. Biol. Med."},{"key":"bpexae63d6bib10","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2024.110491","type":"journal-article","article-title":"UCTNet: uncertainty-guided CNN-Transformer hybrid networks for medical image segmentation","volume":"152","author":"Guo","year":"2024","journal-title":"Pattern Recognit."},{"key":"bpexae63d6bib11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2352\/EI.2024.36.15.COIMG-119","type":"journal-article","article-title":"Transformers for microscopy slide image segmentation of invasive melanoma","volume":"36","author":"Wang","year":"2024","journal-title":"Electron. Imaging"},{"key":"bpexae63d6bib12","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1007\/s00530-025-01673-0","type":"journal-article","article-title":"UMSSNet: a unified multi-scale segmentation network for heterogeneous medical images","volume":"31","author":"Xu","year":"2025","journal-title":"Multimed. Syst."},{"key":"bpexae63d6bib13","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1117\/12.3047370","type":"journal-article","article-title":"Is SAM 2 better than SAM in medical image segmentation?","volume":"13406","author":"Sengupta","year":"2025","journal-title":"Proc. SPIE"},{"key":"bpexae63d6bib14","doi-asserted-by":"publisher","first-page":"184","DOI":"10.3390\/bioengineering12020184","type":"journal-article","article-title":"IDCC-SAM: a zero-shot approach for cell counting in immunocytochemistry dataset using the segment anything model","volume":"12","author":"Fanijo","year":"2025","journal-title":"Bioengineering"},{"key":"bpexae63d6bib15","author":"Girish Nair","year":"2024","type":"book"},{"key":"bpexae63d6bib16","first-page":"1","type":"conference-proceedings","article-title":"Nuclei segmentation in hepatocytes using YOLO and SAM","author":"Da Silva","year":"2024"},{"key":"bpexae63d6bib17","article-title":"SAM & SAM 2 in 3D slicer: segmentwithsam extension for annotating medical images","author":"Yildiz","year":"2024","type":"preprint"},{"key":"bpexae63d6bib18","first-page":"1","type":"conference-proceedings","article-title":"Self-prompting driven SAM2 for 3D","author":"Wei","year":"2025"},{"key":"bpexae63d6bib19","first-page":"16144","type":"conference-proceedings","article-title":"Scaling vision transformers to gigapixel images via hierarchical self-supervised learning","author":"Chen","year":"2022"},{"key":"bpexae63d6bib20","first-page":"289","type":"conference-proceedings","article-title":"Bcdata: a large-scale dataset and benchmark for cell detection and counting Medical Image Computing and Computer Assisted Intervention\u2013MICCAI","author":"Huang","year":"2020"},{"key":"bpexae63d6bib21","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1038\/s42256-022-00471-x","type":"journal-article","article-title":"Deep learning-inferred multiplex immunofluorescence for immunohistochemical image quantification","volume":"4","author":"Ghahremani","year":"2022","journal-title":"Nat. Mach. Intell."},{"key":"bpexae63d6bib22","article-title":"Decoupled weight decay regularization","author":"Loshchilov","year":"2017","type":"preprint"},{"key":"bpexae63d6bib23","doi-asserted-by":"publisher","first-page":"654","DOI":"10.1038\/s41467-024-44824-z","type":"journal-article","article-title":"Segment anything in medical images","volume":"15","author":"Ma","year":"2024","journal-title":"Nat. Commun."},{"key":"bpexae63d6bib24","first-page":"3367","type":"conference-proceedings","article-title":"Sam-adapter adapting segment anything in underperformed scenes","author":"Chen","year":"2023"},{"key":"bpexae63d6bib25","article-title":"Sam-med2d","author":"Cheng","year":"2023","type":"preprint"},{"key":"bpexae63d6bib26","article-title":"Un-sam: universal prompt-free segmentation for generalized nuclei images","author":"Chen","year":"2024","type":"preprint"},{"key":"bpexae63d6bib27","article-title":"Sam 2: segment anything in images and videos","author":"Ravi","year":"2024","type":"preprint"},{"key":"bpexae63d6bib28","author":"Huang","year":"2020","type":"other"},{"key":"bpexae63d6bib28","author":"Ghahremani","year":"2022","type":"other"},{"key":"bpexae63d6bib28","author":"Ghahremani","year":"2021","type":"other"},{"key":"bpexae63d6bib28","author":"Ghahremani","year":"2021","type":"other"}],"container-title":["Biomedical Physics &amp; Engineering Express"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ae63d6","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ae63d6\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ae63d6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ae63d6\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ae63d6\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ae63d6\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ae63d6\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ae63d6\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T06:09:05Z","timestamp":1777961345000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2057-1976\/ae63d6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,5]]},"references-count":31,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,5,5]]},"published-print":{"date-parts":[[2026,6,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2057-1976\/ae63d6","relation":{},"ISSN":["2057-1976"],"issn-type":[{"value":"2057-1976","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,5]]},"assertion":[{"value":"SAM2HIPT: a hybrid deep learning framework integrating SAM2 and HIPT with joint loss optimization for immunohistochemical cell nucleus segmentation","name":"article_title","label":"Article Title"},{"value":"Biomedical Physics & Engineering Express","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2026 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.","name":"copyright_information","label":"Copyright Information"},{"value":"2025-12-22","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2026-04-23","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2026-05-05","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}