{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T08:29:00Z","timestamp":1765268940746,"version":"3.41.2"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2023,7,28]],"date-time":"2023-07-28T00:00:00Z","timestamp":1690502400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62088102"],"award-info":[{"award-number":["62088102"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Cell membrane segmentation in electron microscopy (EM) images is a crucial step in EM image processing. However, while popular approaches have achieved performance comparable to that of humans on low-resolution EM datasets, they have shown limited success when applied to high-resolution EM datasets. The human visual system, on the other hand, displays consistently excellent performance on both low and high resolutions. To better understand this limitation, we conducted eye movement and perceptual consistency experiments. Our data showed that human observers are more sensitive to the structure of the membrane while tolerating misalignment, contrary to commonly used evaluation criteria. Additionally, our results indicated that the human visual system processes images in both global\u2013local and coarse-to-fine manners.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Based on these observations, we propose a computational framework for membrane segmentation that incorporates these characteristics of human perception. This framework includes a novel evaluation metric, the perceptual Hausdorff distance (PHD), and an end-to-end network called the PHD-guided segmentation network (PS-Net) that is trained using adaptively tuned PHD loss functions and a multiscale architecture. Our subjective experiments showed that the PHD metric is more consistent with human perception than other criteria, and our proposed PS-Net outperformed state-of-the-art methods on both low- and high-resolution EM image datasets as well as other natural image datasets.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>The code and dataset can be found at https:\/\/github.com\/EmmaSRH\/PS-Net.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btad464","type":"journal-article","created":{"date-parts":[[2023,7,28]],"date-time":"2023-07-28T15:11:25Z","timestamp":1690557085000},"source":"Crossref","is-referenced-by-count":2,"title":["PS-Net: human perception-guided segmentation network for EM cell membrane"],"prefix":"10.1093","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2895-1716","authenticated-orcid":false,"given":"Ruohua","family":"Shi","sequence":"first","affiliation":[{"name":"Advanced Institute of Information Technology, Peking University , Hangzhou, Zhejiang 310000, China"},{"name":"National Engineering Research Center of Visual Technology, National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University , Beijing 100871, China"},{"name":"Beijing Academy of Artificial Intelligence , Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keyan","family":"Bi","sequence":"additional","affiliation":[{"name":"School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University , Beijing 100871, China"},{"name":"IDG\/McGovern Institute for Brain Research, School of Psychological and Cognitive Sciences, Peking University , Beijing 100871, China"},{"name":"Key Laboratory of Machine Perception (Ministry of Education), Peking University , Beijing 100871, China"},{"name":"Peking-Tsinghua Center for Life Sciences, Peking University , Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kai","family":"Du","sequence":"additional","affiliation":[{"name":"Institute for Artificial Intelligence, Peking University , Beijing 100871, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lei","family":"Ma","sequence":"additional","affiliation":[{"name":"National Engineering Research Center of Visual Technology, National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University , Beijing 100871, China"},{"name":"Beijing Academy of Artificial Intelligence , Beijing 100084, China"},{"name":"National Biomedical Imaging Center, College of Future Technology, Peking University , Beijing 100871, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fang","family":"Fang","sequence":"additional","affiliation":[{"name":"School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University , Beijing 100871, China"},{"name":"IDG\/McGovern Institute for Brain Research, School of Psychological and Cognitive Sciences, Peking University , Beijing 100871, China"},{"name":"Key Laboratory of Machine Perception (Ministry of Education), Peking University , Beijing 100871, China"},{"name":"Peking-Tsinghua Center for Life Sciences, Peking University , Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lingyu","family":"Duan","sequence":"additional","affiliation":[{"name":"National Engineering Research Center of Visual Technology, National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University , Beijing 100871, China"},{"name":"Peng Cheng Laboratory , Shenzhen 518066, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tingting","family":"Jiang","sequence":"additional","affiliation":[{"name":"Advanced Institute of Information Technology, Peking University , Hangzhou, Zhejiang 310000, China"},{"name":"National Engineering Research Center of Visual Technology, National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University , Beijing 100871, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tiejun","family":"Huang","sequence":"additional","affiliation":[{"name":"National Engineering Research Center of Visual Technology, National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University , Beijing 100871, China"},{"name":"Beijing Academy of Artificial Intelligence , Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,7,28]]},"reference":[{"key":"2023081217032463800_btad464-B1","doi-asserted-by":"crossref","first-page":"142","DOI":"10.3389\/fnana.2015.00142","article-title":"Crowdsourcing the creation of image segmentation algorithms for connectomics","volume":"9","author":"Arganda-Carreras","year":"2015","journal-title":"Front Neuroanat"},{"key":"2023081217032463800_btad464-B2","doi-asserted-by":"crossref","first-page":"539","DOI":"10.3389\/fpsyg.2013.00539","article-title":"Global interference during early visual processing: ERP evidence from a rapid global\/local selective task","volume":"4","author":"Beaucousin","year":"2013","journal-title":"Front Psychol"},{"first-page":"1","year":"2017","author":"Chaurasia","key":"2023081217032463800_btad464-B3"},{"author":"Chen","key":"2023081217032463800_btad464-B4"},{"key":"2023081217032463800_btad464-B5","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.micron.2005.10.001","article-title":"Application of transmission electron microscopy to the clinical study of viral and bacterial infections: present and future","volume":"37","author":"Curry","year":"2006","journal-title":"Micron"},{"key":"2023081217032463800_btad464-B6","doi-asserted-by":"crossref","first-page":"297","DOI":"10.2307\/1932409","article-title":"Measures of the amount of ecologic association between species","volume":"26","author":"Dice","year":"1945","journal-title":"Ecology"},{"author":"Drozdzal","key":"2023081217032463800_btad464-B7"},{"key":"2023081217032463800_btad464-B8","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/B978-1-4160-3966-2.00005-9","article-title":"Role of electron microscopy in modern diagnostic surgical pathology","author":"Erlandson","year":"2009","journal-title":"Mod Surg Pathol"},{"key":"2023081217032463800_btad464-B9","doi-asserted-by":"crossref","first-page":"2352","DOI":"10.1093\/bioinformatics\/btw165","article-title":"Deep models for brain EM image segmentation: novel insights and improved performance","volume":"32","author":"Fakhry","year":"2016","journal-title":"Bioinformatics"},{"key":"2023081217032463800_btad464-B10","doi-asserted-by":"crossref","first-page":"415","DOI":"10.4086\/toc.2012.v008a019","article-title":"Distance transforms of sampled functions","volume":"8","author":"Felzenszwalb","year":"2012","journal-title":"Theory Comput"},{"key":"2023081217032463800_btad464-B11","doi-asserted-by":"crossref","first-page":"277","DOI":"10.3389\/fpsyg.2014.00277","article-title":"Attending to global versus local stimulus features modulates neural processing of low versus high spatial frequencies: an analysis with event-related brain potentials","volume":"5","author":"Flevaris","year":"2014","journal-title":"Front Psychol"},{"key":"2023081217032463800_btad464-B12","doi-asserted-by":"crossref","first-page":"12101","DOI":"10.1523\/JNEUROSCI.3994-06.2006","article-title":"Uniform serial sectioning for transmission electron microscopy","volume":"26","author":"Harris","year":"2006","journal-title":"J Neurosci"},{"key":"2023081217032463800_btad464-B13","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1016\/j.pneurobio.2007.09.001","article-title":"Time course of visual perception: coarse-to-fine processing and beyond","volume":"84","author":"Hegd\u00e9","year":"2008","journal-title":"Prog Neurobiol"},{"author":"Hu","key":"2023081217032463800_btad464-B14"},{"year":"2021","author":"Hu","key":"2023081217032463800_btad464-B15"},{"key":"2023081217032463800_btad464-B16","doi-asserted-by":"crossref","first-page":"850","DOI":"10.1109\/34.232073","article-title":"Comparing images using the Hausdorff distance","volume":"15","author":"Huttenlocher","year":"1993","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"author":"Khadangi","key":"2023081217032463800_btad464-B17"},{"key":"2023081217032463800_btad464-B18","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.patrec.2018.12.007","article-title":"A note on the triangle inequality for the Jaccard distance","volume":"120","author":"Kosub","year":"2019","journal-title":"Pattern Recognit Lett"},{"first-page":"115962T","year":"2021","author":"Lou","key":"2023081217032463800_btad464-B19"},{"year":"2013","author":"Mnih","key":"2023081217032463800_btad464-B20"},{"first-page":"3136","year":"2018","author":"Mosinska","key":"2023081217032463800_btad464-B21"},{"key":"2023081217032463800_btad464-B22","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.jecp.2014.11.001","article-title":"From local to global processing: the development of illusory contour perception","volume":"131","author":"Nayar","year":"2015","journal-title":"J Exp Child Psychol"},{"key":"2023081217032463800_btad464-B23","doi-asserted-by":"crossref","first-page":"e08206","DOI":"10.7554\/eLife.08206","article-title":"Extracellular space preservation aids the connectomic analysis of neural circuits","volume":"4","author":"Pallotto","year":"2015","journal-title":"Elife"},{"year":"2016","author":"Paszke","key":"2023081217032463800_btad464-B24"},{"key":"2023081217032463800_btad464-B25","doi-asserted-by":"crossref","first-page":"6484","DOI":"10.1073\/pnas.0501207102","article-title":"Nanoscale visualization and characterization of Myxococcus xanthus cells with atomic force microscopy","volume":"102","author":"Pelling","year":"2005","journal-title":"Proc Natl Acad Sci USA"},{"author":"Ronneberger","key":"2023081217032463800_btad464-B26"},{"author":"Sasaki","key":"2023081217032463800_btad464-B27","first-page":"1"},{"first-page":"2391","year":"2017","author":"Shen","key":"2023081217032463800_btad464-B28"},{"key":"2023081217032463800_btad464-B29","doi-asserted-by":"crossref","first-page":"842760","DOI":"10.3389\/fncom.2022.842760","article-title":"U-RISC: an annotated ultra-high-resolution electron microscopy dataset challenging the existing deep learning algorithms","volume":"16","author":"Shi","year":"2022","journal-title":"Front Comput Neurosci"},{"first-page":"16560","year":"2021","author":"Shit","key":"2023081217032463800_btad464-B30"},{"key":"2023081217032463800_btad464-B31","doi-asserted-by":"crossref","first-page":"1461","DOI":"10.1068\/p2763","article-title":"From elements to perception: local and global processing in visual neurons","volume":"28","author":"Spillmann","year":"1999","journal-title":"Perception"},{"key":"2023081217032463800_btad464-B32","doi-asserted-by":"crossref","first-page":"115633","DOI":"10.1016\/j.eswa.2021.115633","article-title":"A level set method based on additive bias correction for image segmentation","volume":"185","author":"Weng","year":"2021","journal-title":"Expert Syst Appl"},{"first-page":"153","year":"2021","author":"Yan","key":"2023081217032463800_btad464-B33"},{"key":"2023081217032463800_btad464-B34","first-page":"015006","article-title":"Family of boundary overlap metrics for the evaluation of medical image segmentation","volume":"5","author":"Yeghiazaryan","year":"2018","journal-title":"J Med Imaging (Bellingham)"},{"first-page":"5964","year":"2017","author":"Yu","key":"2023081217032463800_btad464-B35"},{"key":"2023081217032463800_btad464-B36","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1145\/357994.358023","article-title":"A fast parallel algorithm for thinning digital patterns","volume":"27","author":"Zhang","year":"1984","journal-title":"Commun ACM"},{"year":", , 20 ,  2018. 4:3-11.","author":"Zhou","key":"2023081217032463800_btad464-B37"},{"key":"2023081217032463800_btad464-B38","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.patrec.2011.11.004","article-title":"CrackTree: automatic crack detection from pavement images","volume":"33","author":"Zou","year":"2012","journal-title":"Pattern Recognit Lett"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btad464\/50997074\/btad464.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/39\/8\/btad464\/51103031\/btad464.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/39\/8\/btad464\/51103031\/btad464.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,12]],"date-time":"2023-08-12T17:04:45Z","timestamp":1691859885000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/doi\/10.1093\/bioinformatics\/btad464\/7233070"}},"subtitle":[],"editor":[{"given":"Hanchuan","family":"Peng","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2023,7,28]]},"references-count":38,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2023,8,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btad464","relation":{},"ISSN":["1367-4811"],"issn-type":[{"type":"electronic","value":"1367-4811"}],"subject":[],"published-other":{"date-parts":[[2023,8,1]]},"published":{"date-parts":[[2023,7,28]]},"article-number":"btad464"}}