{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,31]],"date-time":"2026-01-31T03:57:40Z","timestamp":1769831860986,"version":"3.49.0"},"reference-count":25,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T00:00:00Z","timestamp":1738108800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Bioinform."],"abstract":"<jats:p>In recent years, the exploitation of three-dimensional (3D) data in deep learning has gained momentum despite its inherent challenges. The necessity of 3D approaches arises from the limitations of two-dimensional (2D) techniques when applied to 3D data due to the lack of global context. A critical task in medical and microscopy 3D image analysis is instance segmentation, which is inherently complex due to the need for accurately identifying and segmenting multiple object instances in an image. Here, we introduce a 3D adaptation of the Mask R-CNN, a powerful end-to-end network designed for instance segmentation. Our implementation adapts a widely used 2D TensorFlow Mask R-CNN by developing custom TensorFlow operations for 3D Non-Max Suppression and 3D Crop And Resize, facilitating efficient training and inference on 3D data. We validate our 3D Mask R-CNN on two experiences. The first experience uses a controlled environment of synthetic data with instances exhibiting a wide range of anisotropy and noise. Our model achieves good results while illustrating the limit of the 3D Mask R-CNN for the noisiest objects. Second, applying it to real-world data involving cell instance segmentation during the morphogenesis of the ascidian embryo <jats:italic>Phallusia mammillata<\/jats:italic>, we show that our 3D Mask R-CNN outperforms the state-of-the-art method, achieving high recall and precision scores. The model preserves cell connectivity, which is crucial for applications in quantitative study. Our implementation is open source, ensuring reproducibility and facilitating further research in 3D deep learning.<\/jats:p>","DOI":"10.3389\/fbinf.2024.1497539","type":"journal-article","created":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T06:59:16Z","timestamp":1738133956000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["End-to-end 3D instance segmentation of synthetic data and embryo microscopy images with a 3D Mask R-CNN"],"prefix":"10.3389","volume":"4","author":[{"given":"Gabriel","family":"David","sequence":"first","affiliation":[]},{"given":"Emmanuel","family":"Faure","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,1,29]]},"reference":[{"key":"B1","article-title":"Mask r-cnn for object detection and instance segmentation on keras and tensorflow","author":"Abdulla","year":"2017","journal-title":"GitHub"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.1808.01462","article-title":"A survey on deep learning advances on different 3d data representations","author":"Ahmed","year":"2018","journal-title":"arxiv"},{"key":"B3","article-title":"3d mask r-cnn","author":"David","year":"2024","journal-title":"GitHub"},{"key":"B4","doi-asserted-by":"crossref","DOI":"10.1109\/ISBI.2019.8759242","article-title":"Cnn-based preprocessing to optimize watershed-based cell segmentation in 3d confocal microscopy images","author":"Eschweiler","year":"2019"},{"key":"B5","doi-asserted-by":"crossref","DOI":"10.1109\/ICCV.2015.169","article-title":"Fast r-cnn","author":"Girshick","year":"2015"},{"key":"B6","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR.2014.81","article-title":"Rich feature hierarchies for accurate object detection and semantic segmentation","author":"Girshick","year":"2014"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.6084\/m9.figshare.c.4529990.v2","article-title":"Contact-area dependent cell communications and the morphological invariance of ascidian embryogenesis","author":"Guignard","year":""},{"key":"B8","doi-asserted-by":"publisher","first-page":"eaar5663","DOI":"10.1126\/science.aar5663","article-title":"Contact area\u2013dependent cell communication and the morphological invariance of ascidian embryogenesis","volume":"369","author":"Guignard","year":"","journal-title":"Science"},{"key":"B9","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/s13735-020-00195-x","article-title":"A survey on instance segmentation: state of the art","volume":"9","author":"Hafiz","year":"2020","journal-title":"Int. J. Multimedia Inf. Retr."},{"key":"B10","doi-asserted-by":"crossref","DOI":"10.1109\/ICCV.2017.322","article-title":"Mask r-cnn","author":"He","year":"2017"},{"key":"B11","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR.2016.90","article-title":"Deep residual learning for image recognition","author":"He","year":"2016"},{"key":"B12","doi-asserted-by":"publisher","first-page":"07626","DOI":"10.48550\/arXiv.2001.07626","article-title":"Patchperpix for instance segmentation","author":"Hirsch","year":"2020","journal-title":"Corr. abs\/2001"},{"key":"B13","doi-asserted-by":"publisher","first-page":"2812","DOI":"10.1038\/s41467-019-10668-1","article-title":"Morphonet: an interactive online morphological browser to explore complex multi-scale data","volume":"10","author":"Leggio","year":"2019","journal-title":"Nat. Commun."},{"key":"B14","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR.2017.106","article-title":"Feature pyramid networks for object detection","author":"Lin","year":"2017"},{"key":"B15","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1007\/978-3-319-10602-1_48","article-title":"Microsoft coco: common objects in context","volume":"2014","author":"Lin","year":"2014","journal-title":"Comput. Vis. \u2013 ECCV"},{"key":"B16","doi-asserted-by":"publisher","first-page":"104523","DOI":"10.1016\/j.compbiomed.2021.104523","article-title":"A survey on applications of deep learning in microscopy image analysis","volume":"134","author":"Liu","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"B17","doi-asserted-by":"publisher","first-page":"1634","DOI":"10.1038\/s41592-022-01663-4","article-title":"Cellpose 2.0: how to train your own model","volume":"19","author":"Pachitariu","year":"2022","journal-title":"Nat. Methods"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/tpami.2016.2577031","article-title":"Faster r-cnn: towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Analysis Mach. Intell."},{"key":"B19","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781107298019","volume-title":"Understanding machine learning: from theory to algorithms","author":"Shalev-Shwartz","year":"2014"},{"key":"B20","doi-asserted-by":"publisher","first-page":"5097","DOI":"10.3390\/s20185097","article-title":"3d deep learning on medical images: a review","volume":"20","author":"Singh","year":"2020","journal-title":"Sensors"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1101\/2024.02.10.579780","article-title":"Cellpose3: one-click image restoration for improved cellular segmentation","author":"Stringer","year":"2024","journal-title":"bioRxiv"},{"key":"B22","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1038\/s41592-020-01018-x","article-title":"Cellpose: a generalist algorithm for cellular segmentation","volume":"18","author":"Stringer","year":"2020","journal-title":"Nat. Chem. Biol."},{"key":"B23","doi-asserted-by":"publisher","first-page":"2276","DOI":"10.1038\/s41467-021-22518-0","article-title":"Democratising deep learning for microscopy with zerocostdl4mic","volume":"12","author":"von Chamier","year":"2021","journal-title":"Nat. Commun."},{"key":"B24","doi-asserted-by":"publisher","first-page":"e57613","DOI":"10.7554\/elife.57613","article-title":"Accurate and versatile 3d segmentation of plant tissues at cellular resolution","volume":"9","author":"Wolny","year":"2020","journal-title":"eLife"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1142\/s2811032324300019","article-title":"Introduction to 3d deep learning","volume":"2","author":"Yang","year":"2024","journal-title":"World Sci. Annu. Rev. Artif. Intell. 02"}],"container-title":["Frontiers in Bioinformatics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbinf.2024.1497539\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T06:59:21Z","timestamp":1738133961000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbinf.2024.1497539\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,29]]},"references-count":25,"alternative-id":["10.3389\/fbinf.2024.1497539"],"URL":"https:\/\/doi.org\/10.3389\/fbinf.2024.1497539","relation":{},"ISSN":["2673-7647"],"issn-type":[{"value":"2673-7647","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,29]]},"article-number":"1497539"}}