{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T17:15:07Z","timestamp":1768583707319,"version":"3.49.0"},"reference-count":41,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,12,18]],"date-time":"2019-12-18T00:00:00Z","timestamp":1576627200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["91648207"],"award-info":[{"award-number":["91648207"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61673068"],"award-info":[{"award-number":["61673068"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A rodent real-time tracking framework is proposed to automatically detect and track multi-objects in real time and output the coordinates of each object, which combines deep learning (YOLO v3: You Only Look Once, v3), the Kalman Filter, improved Hungarian algorithm, and the nine-point position correction algorithm. A model of a Rat-YOLO is trained in our experiment. The Kalman Filter model is established in an acceleration model to predict the position of the rat in the next frame. The predicted data is used to fill the losing position of rats if the Rat-YOLO doesn\u2019t work in the current frame, and to associate the ID between the last frame and current frame. The Hungarian assigned algorithm is used to show the relationship between the objects of the last frame and the objects of the current frame and match the ID of the objects. The nine-point position correction algorithm is presented to adjust the correctness of the Rat-YOLO result and the predicted results. As the training of deep learning needs more datasets than our experiment, and it is time-consuming to process manual marking, automatic software for generating labeled datasets is proposed under a fixed scene and the labeled datasets are manually verified in term of their correctness. Besides this, in an off-line experiment, a mask is presented to remove the highlight. In this experiment, we select the 500 frames of the data as the training datasets and label these images with the automatic label generating software. A video (of 2892 frames) is tested by the trained Rat model and the accuracy of detecting all the three rats is around 72.545%, however, the Rat-YOLO combining the Kalman Filter and nine-point position correction arithmetic improved the accuracy to 95.194%.<\/jats:p>","DOI":"10.3390\/s20010002","type":"journal-article","created":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T03:15:01Z","timestamp":1577070901000},"page":"2","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["A Robust Real-Time Detecting and Tracking Framework for Multiple Kinds of Unmarked Object"],"prefix":"10.3390","volume":"20","author":[{"given":"Xiaodong","family":"Lv","sequence":"first","affiliation":[{"name":"Beijing Advanced Innovation Center for Intelligent Robot and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chuankai","family":"Dai","sequence":"additional","affiliation":[{"name":"Beijing Advanced Innovation Center for Intelligent Robot and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6048-9985","authenticated-orcid":false,"given":"Luyao","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8134-1162","authenticated-orcid":false,"given":"Yiran","family":"Lang","sequence":"additional","affiliation":[{"name":"Beijing Advanced Innovation Center for Intelligent Robot and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rongyu","family":"Tang","sequence":"additional","affiliation":[{"name":"Beijing Advanced Innovation Center for Intelligent Robot and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qiang","family":"Huang","sequence":"additional","affiliation":[{"name":"Beijing Advanced Innovation Center for Intelligent Robot and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiping","family":"He","sequence":"additional","affiliation":[{"name":"Beijing Advanced Innovation Center for Intelligent Robot and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Foster, J.D., Freifeld, O., Nuyujukian, P., Ryu, S.I., Black, M.J., and Shenoy, K.V. (May, January 27). Combining wireless neural recording and video capture for the analysis of natural gait. Proceedings of the 2011 5th International IEEE\/EMBS Conference on Neural Engineering, Cancun, Mexico.","DOI":"10.1109\/NER.2011.5910623"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1109\/TCDS.2018.2869587","article-title":"Using high frequency local field potentials from multi-cortex to decode reaching and grasping movements in monkey","volume":"11","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Cognit. Dev. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1159\/000118187","article-title":"Pharmacological characterisation of a modified social interaction model of anxiety in the rat","volume":"13","author":"Guy","year":"1985","journal-title":"Neuropsychobiology"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1023\/A:1020593922901","article-title":"Problem Behavior Interventions for Young Children with Autism: A Research Synthesis","volume":"32","author":"Horner","year":"2002","journal-title":"J. Autism Dev. Disord."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.jneumeth.2016.02.020","article-title":"Novel approach to automatically classify rat social behavior using a video tracking system","volume":"268","author":"Peters","year":"2016","journal-title":"J. Neurosci. Methods"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1016\/j.neucom.2018.12.054","article-title":"Annular Sector Model for tracking multiple indistinguishable and deformable objects in occlusions","volume":"333","author":"Guo","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Shi, Q., Miyagishima, S., Fumino, S., Konno, S., Ishii, H., and Takanishi, A. (2010, January 14\u201318). Development of a cognition system for analyzing rat\u2019s behaviors. Proceedings of the 2010 IEEE International Conference on Robotics and Biomimetics, Tianjin, China.","DOI":"10.1109\/ROBIO.2010.5723534"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.jneumeth.2017.05.006","article-title":"Learning to recognize rat social behavior: Novel dataset and cross-dataset application","volume":"300","author":"Lorbach","year":"2018","journal-title":"J. Neurosci. Methods"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1038\/ncomms1064","article-title":"Automated home-cage behavioural phenotyping of mice","volume":"1","author":"Jhuang","year":"2010","journal-title":"Nat. Commun."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1807","DOI":"10.1007\/s11517-018-1816-1","article-title":"An automated behavior analysis system for freely moving rodents using depth image","volume":"56","author":"Wang","year":"2018","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_11","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the NIPS\u201912 Proceedings of the 25th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_12","unstructured":"Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R.R. (2012). Improving neural networks by preventing co-adaptation of feature detectors. arXiv."},{"key":"ref_13","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Dollar, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8\u201316). SSD: Single shot multibox detector. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_17","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, Faster, Stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_19","unstructured":"Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., and Berg, A.C. (2017). DSSD: Deconvolutional Single Shot Detector. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Koirala, A., Walsh, K.B., Wang, Z., and McCarthy, C. (2019). Deep learning for real-time fruit detection and orchard fruit load estimation: Benchmarking of \u201cMangoYOLO\u201d. Precis. Agric.","DOI":"10.1007\/s11119-019-09642-0"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, X., Yang, W., Tang, X., and Liu, J. (2018). A fast learning method for accurate and robust lane detection using two-stage feature extraction with YOLO v3. Sensors, 18.","DOI":"10.3390\/s18124308"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/j.compag.2019.01.012","article-title":"Apple detection during different growth stages in orchards using the improved YOLO-V3 model","volume":"157","author":"Tian","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic Eng."},{"key":"ref_24","unstructured":"Girondel, V., Caplier, A., Bonnaud, L., Girondel, V., Caplier, A., Bonnaud, L., Girondel, V., Caplier, A., Bonnaud, L., and National, I. (2007, January 28\u201330). Real-time tracking of multiple persons by Kalman filtering and face pursuit for multimedia applications. Proceedings of the 6th IEEE Southwest Symposium on Image Analysis and Interpretation, Lake Tahoe, NV, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple online and realtime tracking. Proceedings of the International Conference on Image Processing, Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_26","unstructured":"Tomasi, C., and Manduchi, R. (1998, January 4\u20137). Bilateral filtering for gray and color images. Proceedings of the IEEE International Conference on Computer Vision, Bombay, India."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/S0734-189X(87)80186-X","article-title":"Adaptive Histogram Equalization and Its Variations","volume":"39","author":"Pizer","year":"1987","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1109\/CVPR.1993.341073","article-title":"Temporal-color space analysis of reflection","volume":"11","author":"Sato","year":"1993","journal-title":"IEEE Comput. Vis. Pattern Recognit."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lin, S., Li, Y., Kang, S.B., Tong, X., and Shum, H.Y. (2002, January 28\u201331). Diffuse-specular separation and depth recovery from image sequences. Proceedings of the European Conference on Computer Vision, Copenhagen, Denmark.","DOI":"10.1007\/3-540-47977-5_14"},{"key":"ref_30","unstructured":"Li, Y., Lin, S., Lu, H., Kang, S.B., and Shum, H.Y. (2002, January 11\u201315). Multibaseline stereo in the presence of specular reflections. Proceedings of the Object recognition supported by user interaction for service robots, Quebec City, QC, Canada."},{"key":"ref_31","unstructured":"Tan, R.T., and Ikeuchi, K. (2005, January 20\u201325). Reflection components decomposition of textured surfaces using linear basis functions. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yang, Q., Wang, S., and Ahuja, N. (2010, January 5\u201311). Real-time specular highlight removal using bilateral filtering. Proceedings of the European Conference on Computer Vision, Crete, Greece.","DOI":"10.1007\/978-3-642-15561-1_7"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1145\/882262.882269","article-title":"Poisson image editing","volume":"22","author":"Gangnet","year":"2003","journal-title":"ACM Trans. Graph."},{"key":"ref_34","unstructured":"National Institute of Health (NIH) (1996). Guide for the Care and Use of Laboratory Animals, The National Academies Press."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L., and Doll\u00e1r, P. (2014, January 6\u201312). Microsoft COCO: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Neubeck, A., and Van Gool, L. (2006, January 20\u201324). Efficient non-maximum suppression. Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906), Hong Kong, China.","DOI":"10.1109\/ICPR.2006.479"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1109\/TPAMI.2005.36","article-title":"Separating Reflection Components of Textured Surfaces using a Single Image 1 Introduction 2 Reflection Models","volume":"27","author":"Tan","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","unstructured":"Carlos Dos Santos Souza, A., Cerqueira De Farias Macedo, M., Paixao Do Nascimento, V., and Santos Oliveira, B. (November, January 29). Real-Time High-Quality Specular Highlight Removal Using Efficient Pixel Clustering. Proceedings of the 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images, Parana, Brazil."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/0734-189X(85)90016-7","article-title":"Topological structural analysis of digitized binary images by border following","volume":"30","author":"Suzuki","year":"1985","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1111\/2041-210X.12874","article-title":"ToxTrac: A fast and robust software for tracking organisms","volume":"9","author":"Rodriguez","year":"2017","journal-title":"Methods Ecol. Evol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"14774","DOI":"10.1038\/s41598-017-15104-2","article-title":"ToxId: An efficient algorithm to solve occlusions when tracking multiple animals","volume":"7","author":"Rodriguez","year":"2017","journal-title":"Sci. Rep."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/1\/2\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:43:12Z","timestamp":1760190192000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/1\/2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,18]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["s20010002"],"URL":"https:\/\/doi.org\/10.3390\/s20010002","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,18]]}}}