{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T18:03:58Z","timestamp":1774029838930,"version":"3.50.1"},"reference-count":29,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,4,18]],"date-time":"2024-04-18T00:00:00Z","timestamp":1713398400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Hong Kong Innovation and Technology Fund","award":["ITF, MRP\/084\/20"],"award-info":[{"award-number":["ITF, MRP\/084\/20"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In diverse realms of research, such as holographic optical tweezer mechanical measurements, colloidal particle motion state examinations, cell tracking, and drug delivery, the localization and analysis of particle motion command paramount significance. Algorithms ranging from conventional numerical methods to advanced deep-learning networks mark substantial strides in the sphere of particle orientation analysis. However, the need for datasets has hindered the application of deep learning in particle tracking. In this work, we elucidated an efficacious methodology pivoted toward generating synthetic datasets conducive to this domain that resonates with robustness and precision when applied to real-world data of tracking 3D particles. We developed a 3D real-time particle positioning network based on the CenterNet network. After conducting experiments, our network has achieved a horizontal positioning error of 0.0478 \u03bcm and a z-axis positioning error of 0.1990 \u03bcm. It shows the capability to handle real-time tracking of particles, diverse in dimensions, near the focal plane with high precision. In addition, we have rendered all datasets cultivated during this investigation accessible.<\/jats:p>","DOI":"10.3390\/s24082583","type":"journal-article","created":{"date-parts":[[2024,4,18]],"date-time":"2024-04-18T06:21:12Z","timestamp":1713421272000},"page":"2583","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Real-Time 3D Tracking of Multi-Particle in the Wide-Field Illumination Based on Deep Learning"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0431-7924","authenticated-orcid":false,"given":"Xiao","family":"Luo","sequence":"first","affiliation":[{"name":"Department of Physics, The Hong Kong University of Science and Technology, Hong Kong 999077, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Zhang","sequence":"additional","affiliation":[{"name":"Advanced Materials Thrust, The Hong Kong University of Science and Technology, Guangzhou 511400, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1737-7106","authenticated-orcid":false,"given":"Handong","family":"Tan","sequence":"additional","affiliation":[{"name":"Department of Individualized Interdisciplinary Program (Advanced Materials), The Hong Kong University of Science and Technology, Hong Kong 999077, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiahao","family":"Jiang","sequence":"additional","affiliation":[{"name":"Advanced Materials Thrust, The Hong Kong University of Science and Technology, Guangzhou 511400, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9037-0122","authenticated-orcid":false,"given":"Junda","family":"Li","sequence":"additional","affiliation":[{"name":"Advanced Materials Thrust, The Hong Kong University of Science and Technology, Guangzhou 511400, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weijia","family":"Wen","sequence":"additional","affiliation":[{"name":"Department of Physics, The Hong Kong University of Science and Technology, Hong Kong 999077, China"},{"name":"Advanced Materials Thrust, The Hong Kong University of Science and Technology, Guangzhou 511400, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,4,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1140\/epjp\/s13360-020-00843-5","article-title":"Optical tweezers: Theory and practice","volume":"135","author":"Pesce","year":"2020","journal-title":"Eur. Phys. J. Plus"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1364\/AOP.394888","article-title":"Optical tweezers\u2014From calibration to applications: A tutorial","volume":"13","author":"Gieseler","year":"2021","journal-title":"Adv. Opt. Photonics"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1016\/j.chempr.2020.02.007","article-title":"Nanorobots: Machines squeezed between molecular motors and micromotors","volume":"6","author":"Wang","year":"2020","journal-title":"Chem"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4445","DOI":"10.1007\/s00216-019-01638-z","article-title":"Recent advances in optical microscopic methods for single-particle tracking in biological samples","volume":"411","author":"Ma","year":"2019","journal-title":"Anal. Bioanal. Chem."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1936","DOI":"10.1021\/acs.chemrev.9b00692","article-title":"Single-virus tracking: From imaging methodologies to virological applications","volume":"120","author":"Liu","year":"2020","journal-title":"Chem. Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1177","DOI":"10.1021\/acs.analchem.7b03762","article-title":"Background-free imaging of a viral capsid proteins coated anisotropic nanoparticle on a living cell membrane with dark-field optical microscopy","volume":"90","author":"Ye","year":"2017","journal-title":"Anal. Chem."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhang, B., Zhou, Z., Cao, W., Qi, X., Xu, C., and Wen, W. (2022). A new few-shot learning method of bacterial colony counting based on the edge computing device. Biology, 11.","DOI":"10.3390\/biology11020156"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.jconrel.2019.02.030","article-title":"Measuring particle size distribution of nanoparticle enabled Medicinal Products, the joint view of EUNCL and NCI-NCL. A step by step approach combining orthogonal measurements with increasing complexity","volume":"299","author":"Caputo","year":"2019","journal-title":"J. Control. Release"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"724","DOI":"10.1038\/nmeth.2071","article-title":"Rapid, accurate particle tracking by calculation of radial symmetry centers","volume":"9","author":"Parthasarathy","year":"2012","journal-title":"Nat. Methods"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"11070","DOI":"10.1364\/OE.420670","article-title":"Precision single-particle localization using radial variance transform","volume":"29","author":"Kashkanova","year":"2021","journal-title":"Opt. Express"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/0262-8856(90)90059-E","article-title":"Comparative study of hough transform methods for circle finding","volume":"8","author":"Yuen","year":"1990","journal-title":"Image Vis. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2538","DOI":"10.1016\/j.bpj.2022.06.001","article-title":"Digital Holography-based 3D particle localisation for single molecule tweezer techniques","volume":"121","author":"Flewellen","year":"2022","journal-title":"Biophys. J."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2018). Mask R-CNN. arXiv.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yasmine, G., Maha, G., and Hicham, M. (2023, January 19\u201323). Overview of single-stage object detection models: From YOLOV1 to Yolov7. Proceedings of the 2023 International Wireless Communications and Mobile Computing (IWCMC), Marrakesh, Morocco.","DOI":"10.1109\/IWCMC58020.2023.10182423"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2023, January 17\u201324). Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00721"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/s00138-022-01349-z","article-title":"Fast re-OBJ: Real-time object re-identification in rigid scenes","volume":"33","author":"Bayraktar","year":"2022","journal-title":"Mach. Vis. Appl."},{"key":"ref_18","unstructured":"Zhou, X., Wang, D., and Kr\u00e4henb\u00fchl, P. (2019). Objects as Points. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"18171","DOI":"10.1007\/s00521-022-07456-2","article-title":"Similarity based person re-identification for multi-object tracking using Deep Siamese network","volume":"34","author":"Suljagic","year":"2022","journal-title":"Neural Comput. Appl."},{"key":"ref_20","first-page":"1602","article-title":"Catch: Characterizing and tracking colloids holographically using deep neural networks","volume":"124","author":"Altman","year":"2020","journal-title":"J. Phys. Chem. B"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3002","DOI":"10.1039\/D2SM01283A","article-title":"Machine learning enables precise holographic characterization of colloidal materials in real time","volume":"19","author":"Altman","year":"2023","journal-title":"Soft Matter"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2987","DOI":"10.1364\/OE.379480","article-title":"Machine learning holography for 3D particle field imaging","volume":"28","author":"Shao","year":"2020","journal-title":"Opt. Express"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2240","DOI":"10.1021\/acsnano.0c06902","article-title":"Fast and accurate nanoparticle characterization using deep-learning-enhanced off-axis holography","volume":"15","author":"Midtvedt","year":"2021","journal-title":"ACS Nano"},{"key":"ref_24","unstructured":"Bohren, C.F., and Huffman, D.R. (1983). Absorption and Scattering of Light by Small Particles, Wiley. [1st ed.]."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017). Feature Pyramid Networks for Object Detection. arXiv.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_26","unstructured":"P\u00e9rez, P., Gangnet, M., and Blake, A. (2003). ACM SIGGRAPH 2003 Papers, Association for Computing Machinery."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). SSD: Single Shot Multibox Detector. arXiv.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"13563","DOI":"10.1364\/OE.18.013563","article-title":"Strategies for three-dimensional particle tracking with holographic video microscopy","volume":"18","author":"Cheong","year":"2010","journal-title":"Opt. Express"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, S., Duan, Y., Ding, H., Tan, Y.-P., Yap, K.-H., and Yuan, J. (2022, January 18\u201324). Learning transferable human-object interaction detector with natural language supervision. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00101"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/8\/2583\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:29:53Z","timestamp":1760106593000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/8\/2583"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,18]]},"references-count":29,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,4]]}},"alternative-id":["s24082583"],"URL":"https:\/\/doi.org\/10.3390\/s24082583","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,18]]}}}