{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T17:01:46Z","timestamp":1773248506181,"version":"3.50.1"},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"14","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2015,7,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Motivation: Neutrophil extracellular traps (NETs) are believed to be essential in controlling several bacterial pathogens. Quantification of NETs in\u00a0vitro is an important tool in studies aiming to clarify the biological and chemical factors contributing to NET production, stabilization and degradation. This estimation can be performed on the basis of fluorescent microscopy images using appropriate labelings. In this context, it is desirable to automate the analysis to eliminate both the tedious process of manual annotation and possible operator-specific biases.<\/jats:p>\n               <jats:p>Results: We propose a framework for the automated determination of NET content, based on visually annotated images which are used to train a supervised machine-learning method. We derive several methods in this framework. The best results are obtained by combining these into a single prediction. The overall Q2 of the combined method is 93%. By having two experts label part of the image set, we were able to compare the performance of the algorithms to the human interoperator variability. We find that the two operators exhibited a very high correlation on their overall assessment of the NET coverage area in the images (R2 is 97%), although there were consistent differences in labeling at pixel level (Q2, which unlike R2 does not correct for additive and multiplicative biases, was only 89%).<\/jats:p>\n               <jats:p>Availability and implementation: Open source software (under the MIT license) is available at https:\/\/github.com\/luispedro\/Coelho2015_NetsDetermination for both reproducibility and application to new data.<\/jats:p>\n               <jats:p>Contact: \u00a0luis@luispedro.org<\/jats:p>\n               <jats:p>Supplementary information \u00a0: \u00a0Supplementary data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btv156","type":"journal-article","created":{"date-parts":[[2015,3,20]],"date-time":"2015-03-20T17:01:45Z","timestamp":1426870905000},"page":"2364-2370","source":"Crossref","is-referenced-by-count":23,"title":["Automatic determination of NET (neutrophil extracellular traps) coverage in fluorescent microscopy images"],"prefix":"10.1093","volume":"31","author":[{"given":"Luis Pedro","family":"Coelho","sequence":"first","affiliation":[{"name":"1 Unidade de Biof\u00edsica e Express\u00e3o Gen\u00e9tica, Instituto de Medicina Molecular and"}]},{"given":"Catarina","family":"Pato","sequence":"additional","affiliation":[{"name":"1 Unidade de Biof\u00edsica e Express\u00e3o Gen\u00e9tica, Instituto de Medicina Molecular and"}]},{"given":"Ana","family":"Fri\u00e3es","sequence":"additional","affiliation":[{"name":"1 Unidade de Biof\u00edsica e Express\u00e3o Gen\u00e9tica, Instituto de Medicina Molecular and"}]},{"given":"Ariane","family":"Neumann","sequence":"additional","affiliation":[{"name":"1 Unidade de Biof\u00edsica e Express\u00e3o Gen\u00e9tica, Instituto de Medicina Molecular and"}]},{"given":"Maren","family":"von K\u00f6ckritz-Blickwede","sequence":"additional","affiliation":[{"name":"1 Unidade de Biof\u00edsica e Express\u00e3o Gen\u00e9tica, Instituto de Medicina Molecular and"}]},{"given":"M\u00e1rio","family":"Ramirez","sequence":"additional","affiliation":[{"name":"1 Unidade de Biof\u00edsica e Express\u00e3o Gen\u00e9tica, Instituto de Medicina Molecular and"}]},{"given":"Jo\u00e3o Andr\u00e9","family":"Carri\u00e7o","sequence":"additional","affiliation":[{"name":"1 Unidade de Biof\u00edsica e Express\u00e3o Gen\u00e9tica, Instituto de Medicina Molecular and"}]}],"member":"286","published-online":{"date-parts":[[2015,3,19]]},"reference":[{"key":"2023020202154765100_btv156-B1","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1037\/0033-2909.97.1.129","article-title":"A variance explanation paradox: when a little is a lot","volume":"97","author":"Abelson","year":"1985","journal-title":"Psychol. Bull."},{"key":"2023020202154765100_btv156-B2","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Understand."},{"key":"2023020202154765100_btv156-B3","doi-asserted-by":"crossref","first-page":"1213","DOI":"10.1093\/bioinformatics\/17.12.1213","article-title":"A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of hela cells","volume":"17","author":"Boland","year":"2001","journal-title":"Bioinformatics"},{"key":"2023020202154765100_btv156-B4","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1002\/(SICI)1097-0320(19981101)33:3<366::AID-CYTO12>3.0.CO;2-R","article-title":"Automated recognition of patterns characteristic of subcellular structures in fluorescence microscopy images","volume":"33","author":"Boland","year":"1998","journal-title":"Cytometry"},{"key":"2023020202154765100_btv156-B5","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"2023020202154765100_btv156-B6","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.1126\/science.1092385","article-title":"Neutrophil extracellular traps kill bacteria","volume":"303","author":"Brinkmann","year":"2004","journal-title":"Science"},{"key":"2023020202154765100_btv156-B7","doi-asserted-by":"crossref","DOI":"10.3389\/fimmu.2012.00413","article-title":"Automatic quantification of in\u00a0vitro net formation","volume":"3","author":"Brinkmann","year":"2013","journal-title":"Front. Immunol."},{"key":"2023020202154765100_btv156-B8","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1016\/j.cub.2005.12.039","article-title":"DNase expression allows the pathogen group a streptococcus to escape killing in neutrophil extracellular traps","volume":"16","author":"Buchanan","year":"2006","journal-title":"Curr. Biol."},{"key":"2023020202154765100_btv156-B9","first-page":"1649","article-title":"A pixel classification system for segmenting biomedical images using intensity neighborhoods and dimension reduction","author":"Chen","year":"2011","journal-title":"Biomedical Imaging: From Nano to Macro, 2011 IEE International Symposium on"},{"key":"2023020202154765100_btv156-B10","article-title":"Mahotas: Open source software for scriptable computer vision","volume":"1","author":"Coelho","year":"2013","journal-title":"J. Open Res. Softw."},{"key":"2023020202154765100_btv156-B11","first-page":"518","article-title":"Nuclear segmentation in microscope cell images: a hand-segmented dataset and comparison of algorithms","volume-title":"IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 2009. ISBI\u201909","author":"Coelho","year":"2009"},{"key":"2023020202154765100_btv156-B12","doi-asserted-by":"crossref","first-page":"2343","DOI":"10.1093\/bioinformatics\/btt392","article-title":"Determining the subcellular location of new proteins from microscope images using local features","volume":"29","author":"Coelho","year":"2013","journal-title":"Bioinformatics,"},{"key":"2023020202154765100_btv156-B13","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1083\/jcb.200910105","article-title":"Automated microscopy for high-content rnai screening","volume":"188","author":"Conrad","year":"2010","journal-title":"J. Cell Biol."},{"key":"2023020202154765100_btv156-B14","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.devcel.2006.12.007","article-title":"Automated subcellular location determination and high-throughput microscopy","volume":"12","author":"Glory","year":"2007","journal-title":"Dev. Cell"},{"key":"2023020202154765100_btv156-B15","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","article-title":"Textural features for image classification","volume":"3","author":"Haralick","year":"1973","journal-title":"IEEE Trans. Syst. Man Cybernet."},{"key":"2023020202154765100_btv156-B16","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1038\/nm.1959","article-title":"Netting neutrophils in autoimmune small-vessel vasculitis","volume":"15","author":"Kessenbrock","year":"2009","journal-title":"Nat. Med."},{"key":"2023020202154765100_btv156-B17","first-page":"2","article-title":"Learning to count objects in images","volume":"vol. 1","author":"Lempitsky","year":"2010","journal-title":"NIPS"},{"key":"2023020202154765100_btv156-B18","doi-asserted-by":"crossref","first-page":"i36","DOI":"10.1093\/bioinformatics\/btt207","article-title":"FuncISH: learning a functional representation of neural ish images","volume":"29","author":"Liscovitch","year":"2013","journal-title":"Bioinformatics"},{"key":"2023020202154765100_btv156-B19","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1038\/nmeth1032","article-title":"Image-based multivariate profiling of drug responses from single cells","volume":"4","author":"Loo","year":"2007","journal-title":"Nat. Methods"},{"key":"2023020202154765100_btv156-B20","doi-asserted-by":"crossref","first-page":"1561","DOI":"10.4049\/jimmunol.148.5.1561","article-title":"Monoclonal autoantibodies to subnucleosomes from a mrl\/mp (-)+\/+ mouse. oligoclonality of the antibody response and recognition of a determinant composed of histones h2a, h2b, and dna","volume":"148","author":"Losman","year":"1992","journal-title":"J. Immunol."},{"key":"2023020202154765100_btv156-B21","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1038\/467154a","article-title":"Time to automate identification","volume":"467","author":"MacLeod","year":"2010","journal-title":"Nature"},{"key":"2023020202154765100_btv156-B22","doi-asserted-by":"crossref","first-page":"1891","DOI":"10.1128\/IAI.00050-12","article-title":"Afa\/dr diffusely adhering escherichia coli strain c1845 induces neutrophil extracellular traps that kill bacteria and damage human enterocyte-like cells","volume":"80","author":"Marin-Esteban","year":"2012","journal-title":"Infect. Immun."},{"key":"2023020202154765100_btv156-B23","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1146\/annurev-pathol-020712-164023","article-title":"The multifaceted functions of neutrophils","volume":"9","author":"Mayadas","year":"2014","journal-title":"Annu. Rev. Pathol."},{"key":"2023020202154765100_btv156-B24","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.artmed.2010.02.006","article-title":"Local binary patterns variants as texture descriptors for medical image analysis","volume":"49","author":"Nanni","year":"2010","journal-title":"Artif. Intell. Med."},{"key":"2023020202154765100_btv156-B25","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/S0925-2312(01)00642-7","article-title":"A neural network architecture for automatic segmentation of fluorescence micrographs","volume":"48","author":"Nattkemper","year":"2002","journal-title":"Neurocomputing"},{"key":"2023020202154765100_btv156-B26","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/S0010-4825(02)00060-4","article-title":"Human vs. machine: evaluation of fluorescence micrographs","volume":"33","author":"Nattkemper","year":"2003","journal-title":"Comput. Biol. Med."},{"key":"2023020202154765100_btv156-B27","doi-asserted-by":"crossref","DOI":"10.1159\/000363699","article-title":"Novel role of the antimicrobial peptide ll-37 in the protection of neutrophil extracellular traps against degradation by bacterial nucleases","author":"Neumann","year":"2014","journal-title":"J. Innate Immun"},{"key":"2023020202154765100_btv156-B28","first-page":"1023","article-title":"Automated analysis of human protein atlas immunofluorescence images.","volume-title":"Proceedings IEEE International Symposium on Biomedical Imaging: From Nano to Macro","author":"Newberg","year":"2009"},{"key":"2023020202154765100_btv156-B29","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1007\/11744085_38","article-title":"Sampling strategies for bag-of-features image classification","volume-title":"Computer Vision\u2013ECCV 2006","author":"Nowak","year":"2006"},{"key":"2023020202154765100_btv156-B30","first-page":"2825","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"2023020202154765100_btv156-B31","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1038\/nmeth.2089","article-title":"NIH image to ImageJ: 25 years of image analysis","volume":"9","author":"Schneider","year":"2012","journal-title":"Nat. Methods"},{"key":"2023020202154765100_btv156-B32","first-page":"230","article-title":"ilastik: Interactive learning and segmentation toolkit","volume-title":"IEEE International Symposium on Biomedical Imaging: From Nano to Macro","author":"Sommer","year":"2011"},{"key":"2023020202154765100_btv156-B33","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1186\/1471-2105-14-173","article-title":"Region-based progressive localization of cell nuclei in microscopic images with data adaptive modeling","volume":"14","author":"Song","year":"2013","journal-title":"BMC Bioinformatics"},{"key":"2023020202154765100_btv156-B34","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0580-9517(10)37007-3","article-title":"Visualization and functional evaluation of phagocyte extracellular traps","volume":"37","author":"von K\u00f6ckritz-Blickwede","year":"2010","journal-title":"Methods Microbiol."},{"key":"2023020202154765100_btv156-B35","doi-asserted-by":"crossref","first-page":"1162","DOI":"10.1111\/j.1462-5822.2006.00857.x","article-title":"Capsule and d-alanylated lipoteichoic acids protect streptococcus pneumoniae against neutrophil extracellular traps","volume":"9","author":"Wartha","year":"2007","journal-title":"Cell. Microbiol."},{"key":"2023020202154765100_btv156-B36","first-page":"589","article-title":"Soft modeling: the basic design and some extensions","volume":"vol. 2","author":"Wold","year":"1982","journal-title":"Systems Under Indirect Observation"},{"key":"2023020202154765100_btv156-B37","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","article-title":"Stacked generalization","volume":"5","author":"Wolpert","year":"1992","journal-title":"Neural Netw."},{"key":"2023020202154765100_btv156-B38","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1109\/TSMCB.2007.912940","article-title":"Edge enhancement nucleus and cytoplast contour detector of cervical smear images","volume":"38","author":"Yang-Mao","year":"2008","journal-title":"IEEE Trans. Syst. Man Cybernet. Part B"},{"key":"2023020202154765100_btv156-B39","doi-asserted-by":"crossref","first-page":"2784","DOI":"10.1182\/blood-2013-04-457671","article-title":"Netosis: how vital is it?","volume":"122","author":"Yipp","year":"2013","journal-title":"Blood"},{"key":"2023020202154765100_btv156-B40","doi-asserted-by":"crossref","first-page":"6419","DOI":"10.1182\/blood-2008-07-171629","article-title":"Impaired neutrophil extracellular trap (NET) formation: a novel innate immune deficiency of human neonates","volume":"113","author":"Yost","year":"2009","journal-title":"Blood"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/31\/14\/2364\/49034959\/bioinformatics_31_14_2364.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/31\/14\/2364\/49034959\/bioinformatics_31_14_2364.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T03:43:23Z","timestamp":1675309403000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/31\/14\/2364\/255941"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,3,19]]},"references-count":40,"journal-issue":{"issue":"14","published-print":{"date-parts":[[2015,7,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btv156","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2015,7,15]]},"published":{"date-parts":[[2015,3,19]]}}}