{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T04:10:03Z","timestamp":1787026203844,"version":"build-2736575974"},"reference-count":53,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T00:00:00Z","timestamp":1643068800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Bioeng. Biotechnol."],"abstract":"<jats:p>The Foreign body response (FBR) is a major unresolved challenge that compromises medical implant integration and function by inflammation and fibrotic encapsulation. Mice implanted with polymeric scaffolds coupled to intravital non-linear multiphoton microscopy acquisition enable multiparametric, longitudinal investigation of the FBR evolution and interference strategies. However, follow-up analyses based on visual localization and manual segmentation are extremely time-consuming, subject to human error, and do not allow for automated parameter extraction. We developed an integrated computational pipeline based on an innovative and versatile variant of the U-Net neural network to segment and quantify cellular and extracellular structures of interest, which is maintained across different objectives without impairing accuracy. This software for automatically detecting the elements of the FBR shows promise to unravel the complexity of this pathophysiological process.<\/jats:p>","DOI":"10.3389\/fbioe.2021.797555","type":"journal-article","created":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T03:37:20Z","timestamp":1643081840000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Deep Learning for Automated Analysis of Cellular and Extracellular Components of the Foreign Body Response in Multiphoton Microscopy Images"],"prefix":"10.3389","volume":"9","author":[{"given":"Mattia","family":"Sarti","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Parlani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luis","family":"Diaz-Gomez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonios G.","family":"Mikos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pietro","family":"Cerveri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefano","family":"Casarin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eleonora","family":"Dondossola","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,1,25]]},"reference":[{"key":"B1","doi-asserted-by":"crossref","DOI":"10.1109\/ISBI.2019.8759329","article-title":"A Novel Focal Tversky Loss Function with Improved Attention U-Net for Lesion Segmentation","author":"Abraham","year":"2019"},{"key":"B2","doi-asserted-by":"publisher","first-page":"e0130386","DOI":"10.1371\/journal.pone.0130386","article-title":"Quantitative Characterization of Collagen in the Fibrotic Capsule Surrounding Implanted Polymeric Microparticles through Second Harmonic Generation Imaging","volume":"10","author":"Akilbekova","year":"2015","journal-title":"PLoS One"},{"key":"B3","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1186\/s12859-018-2375-z","article-title":"A Deep Learning-Based Algorithm for 2-D Cell Segmentation in Microscopy Images","volume":"19","author":"Al-Kofahi","year":"2018","journal-title":"BMC Bioinformatics"},{"key":"B4","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1016\/j.smim.2007.11.004","article-title":"Foreign Body Reaction to Biomaterials","volume":"20","author":"Anderson","year":"2008","journal-title":"Semin. Immunol."},{"key":"B5","doi-asserted-by":"publisher","first-page":"22561","DOI":"10.1364\/oe.22.022561","article-title":"Determination of Collagen Fiber Orientation in Histological Slides Using Mueller Microscopy and Validation by Second Harmonic Generation Imaging","volume":"22","author":"Bancelin","year":"2014","journal-title":"Opt. Express"},{"key":"B6","doi-asserted-by":"publisher","first-page":"922","DOI":"10.1063\/1.118442","article-title":"Nonlinear Scanning Laser Microscopy by Third Harmonic Generation","volume":"70","author":"Barad","year":"1997","journal-title":"Appl. Phys. Lett."},{"key":"B7","doi-asserted-by":"publisher","first-page":"1275","DOI":"10.21037\/qims-19-1090","article-title":"Dense-UNet: a Novel Multiphoton In Vivo Cellular Image Segmentation Model Based on a Convolutional Neural Network","volume":"10","author":"Cai","year":"2020","journal-title":"Quant Imaging Med. Surg."},{"key":"B8","doi-asserted-by":"publisher","first-page":"690","DOI":"10.1038\/nmeth.2075","article-title":"Icy: an Open Bioimage Informatics Platform for Extended Reproducible Research","volume":"9","author":"de Chaumont","year":"2012","journal-title":"Nat. Methods"},{"key":"B9","doi-asserted-by":"publisher","first-page":"5603","DOI":"10.1016\/j.biomaterials.2006.07.010","article-title":"Alginate-based Microcapsules for Immunoisolation of Pancreatic Islets","volume":"27","author":"de Vos","year":"2006","journal-title":"Biomaterials"},{"key":"B10","doi-asserted-by":"publisher","first-page":"0007","DOI":"10.1038\/s41551-016-0007","article-title":"Examination of the Foreign Body Response to Biomaterials by Nonlinear Intravital Microscopy","volume":"1","author":"Dondossola","year":"2016","journal-title":"Nat. Biomed. Eng."},{"key":"B11","doi-asserted-by":"publisher","first-page":"6-22","DOI":"10.1038\/s41578-021-00369-x","article-title":"Host Responses to Implants Revealed by Intravital Microscopy","volume":"7","author":"Dondossola","year":"2022","journal-title":"Nat. Rev. Mater"},{"key":"B12","doi-asserted-by":"publisher","first-page":"20717","DOI":"10.1073\/pnas.1321139110","article-title":"CD13-positive Bone Marrow-Derived Myeloid Cells Promote Angiogenesis, Tumor Growth, and Metastasis","volume":"110","author":"Dondossola","year":"2013","journal-title":"Proc. Natl. Acad. Sci."},{"key":"B13","volume-title":"A Guide to Convolution Arithmetic for Deep Learning","author":"Dumoulin","year":"2016"},{"key":"B14","doi-asserted-by":"publisher","first-page":"6020","DOI":"10.1038\/s41467-020-19851-1","article-title":"High-speed Volumetric Two-Photon Fluorescence Imaging of Neurovascular Dynamics","volume":"11","author":"Fan","year":"2020","journal-title":"Nat. Commun."},{"key":"B15","doi-asserted-by":"publisher","first-page":"E231","DOI":"10.1208\/aapsj070122","article-title":"Controlled Release of Dexamethasone from PLGA Microspheres Embedded within Polyacid-Containing PVA Hydrogels","volume":"7","author":"Galeska","year":"2005","journal-title":"Aaps J."},{"key":"B16","doi-asserted-by":"publisher","first-page":"jcs236075","DOI":"10.1242\/jcs.236075","article-title":"Live Imaging the Foreign Body Response in Zebrafish Reveals How Dampening Inflammation Reduces Fibrosis","volume":"133","author":"Gurevich","year":"2020","journal-title":"J. Cel Sci"},{"key":"B17","doi-asserted-by":"publisher","first-page":"102039","DOI":"10.1016\/j.media.2021.102039","article-title":"MetricUNet: Synergistic Image- and Voxel-Level Learning for Precise Prostate Segmentation via Online Sampling","volume":"71","author":"He","year":"2021","journal-title":"Med. Image Anal."},{"key":"B18","first-page":"448","article-title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","author":"Ioffe","year":"2015"},{"key":"B19","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1038\/s41592-020-01008-z","article-title":"nnU-Net: a Self-Configuring Method for Deep Learning-Based Biomedical Image Segmentation","volume":"18","author":"Isensee","year":"2021","journal-title":"Nat. Methods"},{"key":"B20","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.jconrel.2015.07.021","article-title":"Multiple Tissue Response Modifiers to Promote Angiogenesis and Prevent the Foreign Body Reaction Around Subcutaneous Implants","volume":"214","author":"Kastellorizios","year":"2015","journal-title":"J. Controlled Release"},{"key":"B21","volume-title":"Adam: A Method for Stochastic Optimization","author":"Kingma","year":"2014"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1155","DOI":"10.1016\/j.biomaterials.2004.04.017","article-title":"Enhancement of Implantable Glucose Sensor Function In Vivo Using Gene Transfer-Induced Neovascularization","volume":"26","author":"Klueh","year":"2005","journal-title":"Biomaterials"},{"key":"B23","doi-asserted-by":"publisher","first-page":"101841","DOI":"10.1016\/j.media.2020.101841","article-title":"Segmentation of Cellular Patterns in Confocal Images of Melanocytic Lesions In Vivo via a Multiscale Encoder-Decoder Network (MED-Net)","volume":"67","author":"Kose","year":"2021","journal-title":"Med. Image Anal."},{"key":"B53","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1038\/nm.2989","article-title":"Identification of human epididymis protein-4 as a fibroblast-derived mediator of fibrosis","volume":"19","author":"LeBleu","year":"2013","journal-title":"Nature Medicine"},{"key":"B24","doi-asserted-by":"publisher","first-page":"198","DOI":"10.3389\/fbioe.2020.00198","article-title":"Fibrillar Collagen Quantification with Curvelet Transform Based Computational Methods","volume":"8","author":"Liu","year":"2020","journal-title":"Front. Bioeng. Biotechnol."},{"key":"B25","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1007\/978-1-4939-7113-8_28","article-title":"Methods for Quantifying Fibrillar Collagen Alignment","volume-title":"Fibrosis: Methods and Protocols","author":"Liu","year":"2017"},{"key":"B26","volume-title":"Revisiting Small Batch Training for Deep Neural Networks","author":"Masters","year":"2018"},{"key":"B27","doi-asserted-by":"publisher","first-page":"e1009451","DOI":"10.1371\/journal.pcbi.1009451","article-title":"Segmentation-Less, Automated, Vascular Vectorization","volume":"17","author":"Mihelic","year":"2021","journal-title":"Plos Comput. Biol."},{"key":"B28","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.biomaterials.2016.02.036","article-title":"Nanoparticle Delivery of miR-223 to Attenuate Macrophage Fusion","volume":"89","author":"Moore","year":"2016","journal-title":"Biomaterials"},{"key":"B29","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1208\/s12248-010-9175-3","article-title":"Biomaterials\/tissue Interactions: Possible Solutions to Overcome Foreign Body Response","volume":"12","author":"Morais","year":"2010","journal-title":"AAPS J."},{"key":"B30","doi-asserted-by":"publisher","first-page":"1700370","DOI":"10.1002\/adhm.201700370","article-title":"Multicompartment Drug Release System for Dynamic Modulation of Tissue Responses","volume":"6","author":"Morris","year":"2017","journal-title":"Adv. Healthc. Mater."},{"key":"B31","doi-asserted-by":"publisher","first-page":"1865","DOI":"10.1109\/tmi.2018.2806086","article-title":"Fully Convolutional Architectures for Multiclass Segmentation in Chest Radiographs","volume":"37","author":"Novikov","year":"2018","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B32","doi-asserted-by":"publisher","first-page":"44-58","DOI":"10.3390\/jfb8040044","article-title":"Biodegradable Materials and Metallic Implants-A Review","volume":"8","author":"Prakasam","year":"2017","journal-title":"J. Funct. Biomater."},{"key":"B33","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1007\/s10237-011-0325-z","article-title":"Experimental Investigation of Collagen Waviness and Orientation in the Arterial Adventitia Using Confocal Laser Scanning Microscopy","volume":"11","author":"Rezakhaniha","year":"2012","journal-title":"Biomech. Model. Mechanobiol"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1109\/cvpr.2019.00075","article-title":"Generalized Intersection over Union: A Metric and a Loss for Bounding Box Regression","author":"Rezatofighi","year":"2019"},{"key":"B35","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1016\/s0146-664x(77)80024-5","article-title":"Edge Detection by Compass Gradient Masks","volume":"6","author":"Robinson","year":"1977","journal-title":"Comput. Graphics Image Process."},{"key":"B36","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-24574-4_28","article-title":"Convolutional Networks for Biomedical Image Segmentation","volume-title":"Medical Image Computing and Computer-Assisted Intervention \u2013 MICCAI 2015","author":"Ronneberger","year":"2015"},{"key":"B37","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1038\/nmeth.2019","article-title":"Fiji: an Open-Source Platform for Biological-Image Analysis","volume":"9","author":"Schindelin","year":"2012","journal-title":"Nat. Methods"},{"key":"B38","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1038\/nmeth.2089","article-title":"NIH Image to ImageJ: 25 Years of Image Analysis","volume":"9","author":"Schneider","year":"2012","journal-title":"Nat. Methods"},{"key":"B39","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1016\/j.actbio.2018.05.051","article-title":"Nanopatterned Bulk Metallic Glass-Based Biomaterials Modulate Macrophage Polarization","volume":"75","author":"Shayan","year":"2018","journal-title":"Acta Biomater."},{"key":"B40","doi-asserted-by":"publisher","first-page":"5671","DOI":"10.3390\/ma8095269","article-title":"Macrophages, Foreign Body Giant Cells and Their Response to Implantable Biomaterials","volume":"8","author":"Sheikh","year":"2015","journal-title":"Materials"},{"key":"B41","volume-title":"On the Influence of Dice Loss Function in Multi-Class Organ Segmentation of Abdominal CT Using 3D Fully Convolutional Networks","author":"Shen","year":"2018"},{"key":"B42","volume-title":"A Survey on Deep Learning-Based Architectures for Semantic Segmentation on 2D Images","author":"Ulku","year":"2019"},{"key":"B43","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1016\/0022-1759(94)90012-4","article-title":"Liposome Mediated Depletion of Macrophages: Mechanism of Action, Preparation of Liposomes and Applications","volume":"174","author":"Van Rooijen","year":"1994","journal-title":"J. Immunol. Methods"},{"key":"B44","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1038\/nbt.3462","article-title":"Combinatorial Hydrogel Library Enables Identification of Materials that Mitigate the Foreign Body Response in Primates","volume":"34","author":"Vegas","year":"2016","journal-title":"Nat. Biotechnol."},{"key":"B45","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1038\/nmat4290","article-title":"Size- and Shape-dependent Foreign Body Immune Response to Materials Implanted in Rodents and Non-human Primates","volume":"14","author":"Veiseh","year":"2015","journal-title":"Nat. Mater"},{"key":"B46","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1016\/j.addr.2019.08.010","article-title":"Domesticating the Foreign Body Response: Recent Advances and Applications","volume":"144","author":"Veiseh","year":"2019","journal-title":"Adv. Drug Deliv. Rev."},{"key":"B47","doi-asserted-by":"publisher","first-page":"1233","DOI":"10.1021\/acsbiomaterials.6b00760","article-title":"Host-Biomaterial Interactions in Zebrafish","volume":"4","author":"Witherel","year":"2018","journal-title":"ACS Biomater. Sci. Eng."},{"key":"B48","doi-asserted-by":"crossref","DOI":"10.1109\/ISCID.2016.1100","article-title":"Convolutional Neural Network for Retinal Blood Vessel Segmentation","author":"Yao","year":"2016"},{"key":"B49","doi-asserted-by":"publisher","first-page":"2170040","DOI":"10.1002\/adfm.202170040","article-title":"Dealing with the Foreign-Body Response to Implanted Biomaterials: Strategies and Applications of New Materials","volume":"31","author":"Zhang","year":"2021","journal-title":"Adv. Funct. Mater."},{"key":"B50","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1038\/nbt.2580","article-title":"Zwitterionic Hydrogels Implanted in Mice Resist the Foreign-Body Reaction","volume":"31","author":"Zhang","year":"2013","journal-title":"Nat. Biotechnol."},{"key":"B51","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1145\/357994.358023","article-title":"A Fast Parallel Algorithm for Thinning Digital Patterns","volume":"27","author":"Zhang","year":"1984","journal-title":"Commun. ACM"},{"key":"B52","doi-asserted-by":"publisher","first-page":"101786","DOI":"10.1016\/j.media.2020.101786","article-title":"Triple U-Net: Hematoxylin-Aware Nuclei Segmentation with Progressive Dense Feature Aggregation","volume":"65","author":"Zhao","year":"2020","journal-title":"Med. Image Anal."}],"container-title":["Frontiers in Bioengineering and Biotechnology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbioe.2021.797555\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T03:37:27Z","timestamp":1643081847000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbioe.2021.797555\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,25]]},"references-count":53,"alternative-id":["10.3389\/fbioe.2021.797555"],"URL":"https:\/\/doi.org\/10.3389\/fbioe.2021.797555","relation":{},"ISSN":["2296-4185"],"issn-type":[{"value":"2296-4185","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,25]]},"article-number":"797555"}}