{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T18:49:38Z","timestamp":1774982978137,"version":"3.50.1"},"reference-count":43,"publisher":"Oxford University Press (OUP)","issue":"19","license":[{"start":{"date-parts":[[2020,7,6]],"date-time":"2020-07-06T00:00:00Z","timestamp":1593993600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"Netherlands Organisation for Scientific Research [STW OTP","award":["13391"],"award-info":[{"award-number":["13391"]}]},{"name":"NWO Computing Grants","award":["16663"],"award-info":[{"award-number":["16663"]}]},{"name":"NWO Computing Grants","award":["17428"],"award-info":[{"award-number":["17428"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,12,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Biological studies of dynamic processes in living cells often require accurate particle tracking as a first step toward quantitative analysis. Although many particle tracking methods have been developed for this purpose, they are typically based on prior assumptions about the particle dynamics, and\/or they involve careful tuning of various algorithm parameters by the user for each application. This may make existing methods difficult to apply by non-expert users and to a broader range of tracking problems. Recent advances in deep-learning techniques hold great promise in eliminating these disadvantages, as they can learn how to optimally track particles from example data.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Here, we present a deep-learning-based method for the data association stage of particle tracking. The proposed method uses convolutional neural networks and long short-term memory networks to extract relevant dynamics features and predict the motion of a particle and the cost of linking detected particles from one time point to the next. Comprehensive evaluations on datasets from the particle tracking challenge demonstrate the competitiveness of the proposed deep-learning method compared to the state of the art. Additional tests on real-time-lapse fluorescence microscopy images of various types of intracellular particles show the method performs comparably with human experts.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>The software code implementing the proposed method as well as a description of how to obtain the test data used in the presented experiments will be available for non-commercial purposes from https:\/\/github.com\/yoyohoho0221\/pt_linking.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Supplementary information<\/jats:title>\n                  <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btaa597","type":"journal-article","created":{"date-parts":[[2020,6,29]],"date-time":"2020-06-29T19:21:32Z","timestamp":1593458492000},"page":"4935-4941","source":"Crossref","is-referenced-by-count":35,"title":["Deep-learning method for data association in particle tracking"],"prefix":"10.1093","volume":"36","author":[{"given":"Yao","family":"Yao","sequence":"first","affiliation":[{"name":"Biomedical Imaging Group Rotterdam, Departments of Medical Informatics & Radiology, Erasmus University Medical Center , Rotterdam 3015GE, The Netherlands"}]},{"given":"Ihor","family":"Smal","sequence":"additional","affiliation":[{"name":"Biomedical Imaging Group Rotterdam, Departments of Medical Informatics & Radiology, Erasmus University Medical Center , Rotterdam 3015GE, The Netherlands"},{"name":"Department of Geoscience and Remote Sensing, Faculty of Civil Engineering and Geosciences, Delft University of Technology , Delft 2628CN, The Netherlands"}]},{"given":"Ilya","family":"Grigoriev","sequence":"additional","affiliation":[{"name":"Division of Cell Biology, Department of Biology, Faculty of Science, Utrecht University , Utrecht 3584CH, The Netherlands"}]},{"given":"Anna","family":"Akhmanova","sequence":"additional","affiliation":[{"name":"Division of Cell Biology, Department of Biology, Faculty of Science, Utrecht University , Utrecht 3584CH, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8015-8358","authenticated-orcid":false,"given":"Erik","family":"Meijering","sequence":"additional","affiliation":[{"name":"Biomedical Imaging Group Rotterdam, Departments of Medical Informatics & Radiology, Erasmus University Medical Center , Rotterdam 3015GE, The Netherlands"},{"name":"School of Computer Science and Engineering & Graduate School of Biomedical Engineering, Faculty of Engineering, University of New South Wales , Sydney, NSW 2052, Australia"}]}],"member":"286","published-online":{"date-parts":[[2020,7,6]]},"reference":[{"key":"2023062408065285200_btaa597-B1","first-page":"850","author":"Bertinetto","year":"2016"},{"key":"2023062408065285200_btaa597-B2","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1109\/9.1299","article-title":"The interacting multiple model algorithm for systems with Markovian switching coefficients","volume":"33","author":"Blom","year":"1988","journal-title":"IEEE Trans. Autom. Control"},{"key":"2023062408065285200_btaa597-B3","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1038\/nmeth.2808","article-title":"Objective comparison of particle tracking methods","volume":"11","author":"Chenouard","year":"2014","journal-title":"Nat. Methods"},{"key":"2023062408065285200_btaa597-B4","doi-asserted-by":"crossref","first-page":"00003","DOI":"10.1051\/epjconf\/201715000003","article-title":"The HEP.TrkX Project: deep neural networks for HL-LHC online and offline tracking","volume":"150","author":"Farrell","year":"2017","journal-title":"EPJ Web Conf"},{"key":"2023062408065285200_btaa597-B5","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/j.jsb.2010.11.001","article-title":"Multiple dense particle tracking in fluorescence microscopy images based on multidimensional assignment","volume":"173","author":"Feng","year":"2011","journal-title":"J. Struct. Biol"},{"key":"2023062408065285200_btaa597-B6","first-page":"1440","author":"Girshick","year":"2015"},{"key":"2023062408065285200_btaa597-B7","volume-title":"Deep Learning","author":"Goodfellow","year":"2016"},{"key":"2023062408065285200_btaa597-B8","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1109\/TMI.2016.2553401","article-title":"Deep learning in medical imaging: overview and future promise of an exciting new technique","volume":"35","author":"Greenspan","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"2023062408065285200_btaa597-B9","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1002\/cyto.a.23701","article-title":"Deep learning in image cytometry: a review","volume":"95","author":"Gupta","year":"2019","journal-title":"Cytometry A"},{"key":"2023062408065285200_btaa597-B10","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.imavis.2016.11.010","article-title":"Cell tracking using deep neural networks with multi-task learning","volume":"60","author":"He","year":"2017","journal-title":"Image Vis. Comput"},{"key":"2023062408065285200_btaa597-B11","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"key":"2023062408065285200_btaa597-B12","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1214\/aoms\/1177703732","article-title":"Robust estimation of a location parameter","volume":"35","author":"Huber","year":"1964","journal-title":"Ann. Math. Stat"},{"key":"2023062408065285200_btaa597-B13","first-page":"664","author":"Jaiswal","year":"2012"},{"key":"2023062408065285200_btaa597-B14","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1038\/nmeth.1237","article-title":"Robust single-particle tracking in live-cell time-lapse sequences","volume":"5","author":"Jaqaman","year":"2008","journal-title":"Nat. Methods"},{"key":"2023062408065285200_btaa597-B15","author":"Kingma","year":"2014"},{"key":"2023062408065285200_btaa597-B16","doi-asserted-by":"crossref","first-page":"i52","DOI":"10.1093\/bioinformatics\/btw252","article-title":"Classifying and segmenting microscopy images with deep multiple instance learning","volume":"32","author":"Kraus","year":"2016","journal-title":"Bioinformatics"},{"key":"2023062408065285200_btaa597-B17","first-page":"418","author":"Leal-Taix\u00e9","year":"2016"},{"key":"2023062408065285200_btaa597-B18","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","article-title":"A survey on deep learning in medical image analysis","volume":"42","author":"Litjens","year":"2017","journal-title":"Med. Image Anal"},{"key":"2023062408065285200_btaa597-B19","doi-asserted-by":"crossref","first-page":"e33864","DOI":"10.7554\/eLife.33864","article-title":"Control of endothelial cell polarity and sprouting angiogenesis by non-centrosomal microtubules","volume":"7","author":"Martin","year":"2018","journal-title":"eLife"},{"key":"2023062408065285200_btaa597-B20","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/B978-0-12-391857-4.00009-4","article-title":"Methods for cell and particle tracking","volume":"504","author":"Meijering","year":"2012","journal-title":"Methods Enzymol"},{"key":"2023062408065285200_btaa597-B21","first-page":"4225","author":"Milan","year":"2017"},{"key":"2023062408065285200_btaa597-B22","doi-asserted-by":"crossref","first-page":"9026","DOI":"10.1073\/pnas.1804420115","article-title":"Convolutional neural networks automate detection for tracking of submicron-scale particles in 2D and 3D","volume":"115","author":"Newby","year":"2018","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"2023062408065285200_btaa597-B23","first-page":"1","author":"Ning","year":"2017"},{"key":"2023062408065285200_btaa597-B24","doi-asserted-by":"crossref","first-page":"e0221245","DOI":"10.1371\/journal.pone.0221245","article-title":"Predicting the future direction of cell movement with convolutional neural networks","volume":"14","author":"Nishimoto","year":"2019","journal-title":"PLoS One"},{"key":"2023062408065285200_btaa597-B25","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1186\/1471-2105-11-248","article-title":"Evaluation of methods for detection of fluorescence labeled subcellular objects in microscope images","volume":"11","author":"Ruusuvuori","year":"2010","journal-title":"BMC Bioinformatics"},{"key":"2023062408065285200_btaa597-B26","author":"Sadeghian","year":"2017"},{"key":"2023062408065285200_btaa597-B27","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1038\/nmeth0808-671","article-title":"Single-particle tracking: connecting the dots","volume":"5","author":"Saxton","year":"2008","journal-title":"Nat. Methods"},{"key":"2023062408065285200_btaa597-B28","first-page":"2730","author":"Schulter","year":"2017"},{"key":"2023062408065285200_btaa597-B29","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1146\/annurev-bioeng-071516-044442","article-title":"Deep learning in medical image analysis","volume":"19","author":"Shen","year":"2017","journal-title":"Annu. Rev. Biomed. Eng"},{"key":"2023062408065285200_btaa597-B30","doi-asserted-by":"crossref","first-page":"7331","DOI":"10.1021\/acs.chemrev.6b00815","article-title":"Single particle tracking: from theory to biophysical applications","volume":"117","author":"Shen","year":"2017","journal-title":"Chem. Rev"},{"key":"2023062408065285200_btaa597-B31","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1007\/s00418-014-1214-1","article-title":"High-density single-particle tracking: quantifying molecule organization and dynamics at the nanoscale","volume":"141","author":"Sibarita","year":"2014","journal-title":"Histochem. Cell Biol"},{"key":"2023062408065285200_btaa597-B32","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.media.2015.06.006","article-title":"Quantitative comparison of multiframe data association techniques for particle tracking in time-lapse fluorescence microscopy","volume":"24","author":"Smal","year":"2015","journal-title":"Med. Image Anal"},{"key":"2023062408065285200_btaa597-B33","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1109\/TMI.2009.2025127","article-title":"Quantitative comparison of spot detection methods in fluorescence microscopy","volume":"29","author":"Smal","year":"2010","journal-title":"IEEE Trans. Med. Imaging"},{"key":"2023062408065285200_btaa597-B34","first-page":"1929","article-title":"Dropout: a simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res"},{"key":"2023062408065285200_btaa597-B35","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1002\/cyto.a.22692","article-title":"Performance and sensitivity evaluation of 3D spot detection methods in confocal microscopy","volume":"87","author":"St\u011bpka","year":"2015","journal-title":"Cytomerty A"},{"key":"2023062408065285200_btaa597-B36","first-page":"3104","author":"Sutskever","year":"2014"},{"key":"2023062408065285200_btaa597-B37","doi-asserted-by":"crossref","first-page":"e1005177","DOI":"10.1371\/journal.pcbi.1005177","article-title":"Deep learning automates the quantitative analysis of individual cells in live-cell imaging experiments","volume":"12","author":"Van Valen","year":"2016","journal-title":"PLoS Comput. Biol"},{"key":"2023062408065285200_btaa597-B38","first-page":"4705","author":"Xiang","year":"2015"},{"key":"2023062408065285200_btaa597-B39","doi-asserted-by":"crossref","first-page":"3179","DOI":"10.1083\/jcb.201701024","article-title":"EB1 and EB3 regulate microtubule minus end organization and Golgi morphology","volume":"216","author":"Yang","year":"2017","journal-title":"J. Cell Biol"},{"key":"2023062408065285200_btaa597-B40","first-page":"1480","author":"Yang","year":"2016"},{"key":"2023062408065285200_btaa597-B41","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1007\/978-1-4939-6810-7_14","article-title":"Automated analysis of intracellular dynamic processes","volume":"1563","author":"Yao","year":"2017","journal-title":"Methods Mol. Biol"},{"key":"2023062408065285200_btaa597-B42","first-page":"458","author":"Yao","year":"2018"},{"key":"2023062408065285200_btaa597-B43","doi-asserted-by":"crossref","first-page":"10748","DOI":"10.1021\/acs.analchem.8b01334","article-title":"Developing noise-resistant three-dimensional single particle tracking using deep neural networks","volume":"90","author":"Zhong","year":"2018","journal-title":"Anal. Chem"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btaa597\/33709723\/btaa597.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/36\/19\/4935\/50692663\/btaa597.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/36\/19\/4935\/50692663\/btaa597.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,24]],"date-time":"2023-06-24T23:29:33Z","timestamp":1687649373000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/36\/19\/4935\/5867905"}},"subtitle":[],"editor":[{"given":"Jonathan","family":"Wren","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2020,7,6]]},"references-count":43,"journal-issue":{"issue":"19","published-print":{"date-parts":[[2020,12,8]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btaa597","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,10,1]]},"published":{"date-parts":[[2020,7,6]]}}}