{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T18:36:34Z","timestamp":1780511794774,"version":"3.54.1"},"reference-count":44,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,3]],"date-time":"2023-01-03T00:00:00Z","timestamp":1672704000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"JST SPRING","award":["WN922001"],"award-info":[{"award-number":["WN922001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Effective livestock management is critical for cattle farms in today\u2019s competitive era of smart modern farming. To ensure farm management solutions are efficient, affordable, and scalable, the manual identification and detection of cattle are not feasible in today\u2019s farming systems. Fortunately, automatic tracking and identification systems have greatly improved in recent years. Moreover, correctly identifying individual cows is an integral part of predicting behavior during estrus. By doing so, we can monitor a cow\u2019s behavior, and pinpoint the right time for artificial insemination. However, most previous techniques have relied on direct observation, increasing the human workload. To overcome this problem, this paper proposes the use of state-of-the-art deep learning-based Multi-Object Tracking (MOT) algorithms for a complete system that can automatically and continuously detect and track cattle using an RGB camera. This study compares state-of-the-art MOTs, such as Deep-SORT, Strong-SORT, and customized light-weight tracking algorithms. To improve the tracking accuracy of these deep learning methods, this paper presents an enhanced re-identification approach for a black cattle dataset in Strong-SORT. For evaluating MOT by detection, the system used the YOLO v5 and v7, as a comparison with the instance segmentation model Detectron-2, to detect and classify the cattle. The high cattle-tracking accuracy with a Multi-Object Tracking Accuracy (MOTA) was 96.88%. Using these methods, the findings demonstrate a highly accurate and robust cattle tracking system, which can be applied to innovative monitoring systems for agricultural applications. The effectiveness and efficiency of the proposed system were demonstrated by analyzing a sample of video footage. The proposed method was developed to balance the trade-off between costs and management, thereby improving the productivity and profitability of dairy farms; however, this method can be adapted to other domestic species.<\/jats:p>","DOI":"10.3390\/s23010532","type":"journal-article","created":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T03:27:44Z","timestamp":1672802864000},"page":"532","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":57,"title":["Comparing State-of-the-Art Deep Learning Algorithms for the Automated Detection and Tracking of Black Cattle"],"prefix":"10.3390","volume":"23","author":[{"given":"Su","family":"Myat Noe","sequence":"first","affiliation":[{"name":"Interdisciplinary Graduate School of Agriculture and Engineering, University of Miyazaki, Miyazaki 889-2192, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3435-2197","authenticated-orcid":false,"given":"Thi Thi","family":"Zin","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, University of Miyazaki, Miyazaki 889-2192, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3623-2984","authenticated-orcid":false,"given":"Pyke","family":"Tin","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, University of Miyazaki, Miyazaki 889-2192, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ikuo","family":"Kobayashi","sequence":"additional","affiliation":[{"name":"Field Science Center, Faculty of Agriculture, University of Miyazaki, Miyazaki 889-2192, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Guo, Y., He, D., and Chai, L. (2020). A machine vision-based method for monitoring scene-interactive behaviors of dairy calf. Animals, 10.","DOI":"10.3390\/ani10020190"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Morrone, S., Dimauro, C., Gambella, F., and Cappai, M.G. (2022). Industry 4.0 and Precision Livestock Farming (PLF): An up-to-Date Overview across Animal Productions. Sensors, 22.","DOI":"10.3390\/s22124319"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2015, January 24\u201327). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_5","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_7","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_8","unstructured":"Couturier, R., Noura, H.N., Salman, O., and Sider, A. (2021). A deep learning object detection method for an efficient cluster\u2019s initialization. arXiv."},{"key":"ref_9","unstructured":"Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., and Nie, W. (2022). YOLOv6: A single-stage object detection framework for industrial applications. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.","DOI":"10.1109\/CVPR52729.2023.00721"},{"key":"ref_11","unstructured":"Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). YOLOX: Exceeding yolo series in 2021. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). SSD: Single Shot Multi Box Detector. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_13","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Advances in Neural Information Processing Systems, 28, MIT Press."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201327). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Yu, C., Liu, H., Chen, X., Lei, Y., Pang, T., and Zhang, J. (2022). An Integrated Goat Head Detection and Automatic Counting Method Based on Deep Learning. Animals, 12.","DOI":"10.3390\/ani12141810"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kim, J., Suh, Y., Lee, J., Chae, H., Ahn, H., Chung, Y., and Park, D. (2022). EmbeddedPigCount: Pig Counting with Video Object Detection and Tracking on an Embedded Board. Sensors, 22.","DOI":"10.3390\/s22072689"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, R., Gao, Z., Li, Q., Zhao, C., Gao, R., Zhang, H., Li, S., and Feng, L. (2022). Detection Method of Cow Estrus Behavior in Natural Scenes Based on Improved YOLOv5. Agriculture, 12.","DOI":"10.3390\/agriculture12091339"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Guo, Q., Sun, Y., Min, L., van Putten, A., Knol, E.F., Visser, B., Rodenburg, T., Bolhuis, L., and Bijma, P. (2022, January 6\u20138). Video-based Detection and Tracking with Improved Re-identification Association for Pigs and Laying Hens in Farms. Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, SciTePress, Online-Streaming.","DOI":"10.5220\/0010788100003124"},{"key":"ref_19","first-page":"211","article-title":"Automatic detection and tracking of mounting behavior in cattle using a deep learning-based instance segmentation model","volume":"18","author":"Noe","year":"2022","journal-title":"Int. J. Innov. Comput. Inf. Control"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Noe, S.M., Zin, T.T., Tin, P., and Hama, H. (2020, January 13\u201316). Detection of Estrus in Cattle by using Image Technology and Machine Learning Methods. Proceedings of the 2020 IEEE 9th Global Conference on Consumer Electronics (GCCE), Kobe, Japan.","DOI":"10.1109\/GCCE50665.2020.9291987"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Noe, S.M., Zin, T.T., Tin, P., and Kobayashi, I. (2021, January 9\u201311). Automatic Detection of Mounting Behavior in Cattle using Semantic Segmentation and Classification. Proceedings of the 2021 IEEE 3rd Global Conference on Life Sciences and Technologies (Life-Tech), Nara, Japan.","DOI":"10.1109\/LifeTech52111.2021.9391980"},{"key":"ref_22","unstructured":"Du, Y., Song, Y., Yang, B., and Zhao, Y. (2022). Strong-SORT: Make Deep-SORT great again. arXiv."},{"key":"ref_23","unstructured":"Abhishek, A.V.S., and Kotni, S. (2021). Detectron2 Object Detection & Manipulating Images using Cartoonization. Int. J. Eng. Res. Technol. (IJERT), 10."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"996","DOI":"10.1109\/TCSVT.2018.2817609","article-title":"Comparative evaluations of selected tracking-by-detection approaches","volume":"29","author":"Mekonnen","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Milan, A., Leal-Taix\u00e9, L., Schindler, K., and Reid, I. (2015, January 7\u201312). Joint Tracking and Segmentation of Multiple Targets. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299178"},{"key":"ref_26","unstructured":"Montella, C. (2011). The Kalman filter and related algorithms: A literature review. Res. Gate."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple online and Realtime tracking. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017, January 17\u201320). Simple Online and Realtime Tracking with a Deep Association Metric. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Li, Z., Tian, X., Liu, Y., and Shi, X. (2022, January 3\u20135). Vehicle Tracking Method Based on Attention-YOLOv5 and Optimized DeepSORT Models. Proceedings of the 2022 IEEE 11th Data Driven Control and Learning Systems Conference (DDCLS), Chengdu, China.","DOI":"10.1109\/DDCLS55054.2022.9858395"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1007\/s11263-020-01393-0","article-title":"MOT challenge: A benchmark for single-camera multiple target tracking","volume":"129","author":"Dendorfer","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","unstructured":"Bernardin, K., Elbs, A., and Stiefelhagen, R. (2006, January 13). Multiple Objects Tracking Performance Metrics and Evaluation in a Smart Room Environment. Proceedings of the Sixth IEEE International Workshop on Visual Surveillance, in Conjunction with ECCV, Graz, Austria."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2872","DOI":"10.1109\/TPAMI.2021.3054775","article-title":"Deep Learning for Person Re-Identification: A Survey and Outlook","volume":"44","author":"Ye","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Gou, M., Karanam, S., Liu, W., Camps, O., and Radke, R.J. (2017, January 21\u201326). DukeMTMC4ReID: A Large-Scale Multi-Camera Person Re-Identification Dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.185"},{"key":"ref_34","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/JPROC.2020.3004555","article-title":"A comprehensive survey on transfer learning","volume":"109","author":"Zhuang","year":"2020","journal-title":"Proc. IEEE"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Henderson, P., and Ferrari, V. (2017). End-to-End Training of Object Class Detectors for Mean Average Precision. Asian Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-54193-8_13"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.patcog.2019.01.006","article-title":"Wider or deeper: Revisiting the ResNet model for visual recognition","volume":"90","author":"Wu","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Chen, S., Wang, S., Zuo, X., and Yang, R. (2021, January 10\u201315). Angus Cattle Recognition using Deep Learning. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9412073"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"106030","DOI":"10.1016\/j.compag.2021.106030","article-title":"A Computer Vision Approach Based on Deep Learning for the Detection of Dairy Cows in Free Stall Barn","volume":"182","author":"Tassinari","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"105300","DOI":"10.1016\/j.compag.2020.105300","article-title":"Automated cattle counting using Mask R-CNN in quadcopter vision system","volume":"171","author":"Xu","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1007\/s41095-019-0132-5","article-title":"Livestock detection in aerial images using a fully convolutional network","volume":"5","author":"Han","year":"2019","journal-title":"Comput. Vis. Media"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Lin, M., Chen, C., and Lai, C. (2019, January 5\u20137). Object Detection Algorithm Based AdaBoost Residual Correction Fast R-CNN on Networks. Proceedings of the 2019 3rd International Conference on Deep Learning Technologies, Xiamen, China.","DOI":"10.1145\/3342999.3343013"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.ifacol.2019.12.558","article-title":"Individual cattle identification using a deep learning-based framework","volume":"52","author":"Qiao","year":"2019","journal-title":"IFAC-Pap. Online"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Nguyen, C., Wang, D., Von Richter, K., Valencia, P., Alvarenga, F.A., and Bishop-Hurley, G. (2021). Video-based cattle identification and action recognition. arXiv.","DOI":"10.1109\/DICTA52665.2021.9647417"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/532\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T17:57:18Z","timestamp":1760119038000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/532"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,3]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23010532"],"URL":"https:\/\/doi.org\/10.3390\/s23010532","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,3]]}}}