{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T15:08:46Z","timestamp":1778339326925,"version":"3.51.4"},"reference-count":28,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T00:00:00Z","timestamp":1762992000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>The accurate recognition of cattle behaviours is crucial for improving animal welfare and production efficiency in precision livestock farming. However, existing methods pay limited attention to recognising behaviours under occlusion or those involving subtle interactions between cattle and environmental objects in group farming scenarios. To address this limitation, we propose a novel spatio-temporal feature extraction network that explicitly models the associative relationships between key body parts of cattle and environmental factors, thereby enabling precise behaviour recognition. Specifically, the proposed approach first employs a spatio-temporal perception network to extract discriminative motion features of key body parts. Subsequently, a spatio-temporal relation integration module with metric learning is introduced to adaptively quantify the association strength between cattle features and environmental elements. Finally, a spatio-temporal enhancement network is utilised to further optimise the learned interaction representations. Experimental results on a public cattle behaviour dataset demonstrate that our method achieves a state-of-the-art mean average precision (mAP) of 87.19%, outperforming the advanced SlowFast model by 6.01 percentage points. Ablation studies further confirm the synergistic effectiveness of each module, particularly in recognising behaviours that rely on environmental interactions, such as drinking and grooming. This study provides a practical and reliable solution for intelligent cattle behaviour monitoring and highlights the significance of relational reasoning in understanding animal behaviours within complex environments.<\/jats:p>","DOI":"10.3390\/computers14110496","type":"journal-article","created":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T12:57:13Z","timestamp":1763038633000},"page":"496","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Recognizing Cattle Behaviours by Spatio-Temporal Reasoning Between Key Body Parts and Environmental Context"],"prefix":"10.3390","volume":"14","author":[{"given":"Fangzheng","family":"Qi","sequence":"first","affiliation":[{"name":"School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou 213000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhenjie","family":"Hou","sequence":"additional","affiliation":[{"name":"School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou 213000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"En","family":"Lin","sequence":"additional","affiliation":[{"name":"Goldcard Smart Group Co., Ltd., Hangzhou 310018, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xing","family":"Li","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, College of Artificial Intelligence, Nanjing Forestry University, Nanjing 210098, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiuzhen","family":"Liang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou 213000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenguang","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Life Sciences, Inner Mongolia Agricultural University, Hohhot 010000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"10130","DOI":"10.1109\/JIOT.2021.3122341","article-title":"SocialCattle: IoT-based mastitis detection and control through social cattle behavior sensing in smart farms","volume":"9","author":"Feng","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Sim, H.S., Kim, T.K., Lee, C.W., Choi, C.S., Kim, J.S., and Cho, H.C. (2024). Optimizing Cattle Behavior Analysis in Precision Livestock Farming: Integrating YOLOv7-E6E with AutoAugment and GridMask to Enhance Detection Accuracy. Appl. Sci., 14.","DOI":"10.3390\/app14093667"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Qiao, Y., Kong, H., Clark, C., Lomax, S., Su, D., Eiffert, S., and Sukkarieh, S. (2021). Intelligent Perception-Based Cattle Lameness Detection and Behaviour Recognition: A Review. Animals, 11.","DOI":"10.3390\/ani11113033"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"105627","DOI":"10.1016\/j.compag.2020.105627","article-title":"Deep learning-based hierarchical cattle behavior recognition with spatio-temporal information","volume":"177","author":"Fuentes","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"100539","DOI":"10.1016\/j.iot.2022.100539","article-title":"A deep learning-based cow behavior recognition scheme for improving cattle behavior modeling in smart farming","volume":"19","author":"Shakeel","year":"2022","journal-title":"Internet Things"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.biosystemseng.2022.03.006","article-title":"Fusion of RGB, optical flow and skeleton features for the detection of lameness in dairy cows","volume":"218","author":"Li","year":"2022","journal-title":"Biosyst. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"043036","DOI":"10.1117\/1.JEI.32.4.043036","article-title":"UD-YOLOv5s: Recognition of cattle regurgitation behavior based on upper and lower jaw skeleton feature extraction","volume":"32","author":"Gao","year":"2023","journal-title":"J. Electron. Imaging"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tong, L., Fang, J., Wang, X., and Zhao, Y. (2024). Research on cattle behavior recognition and multi-object tracking algorithm based on yolo-bot. Animals, 14.","DOI":"10.3390\/ani14202993"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1080\/00480169.2018.1479316","article-title":"Automated oestrus detection using multimetric behaviour recognition in seasonal-calving dairy cattle on pasture","volume":"66","author":"Brassel","year":"2018","journal-title":"New Zealand Vet. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"106255","DOI":"10.1016\/j.compag.2021.106255","article-title":"Behaviour recognition of pigs and cattle: Journey from computer vision to deep learning","volume":"187","author":"Chen","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Fuentes, A., Han, S., Nasir, M.F., Park, J., Yoon, S., and Park, D.S. (2023). Multiview monitoring of individual cattle behavior based on action recognition in closed barns using deep learning. Animals, 13.","DOI":"10.3390\/ani13122020"},{"key":"ref_12","first-page":"505","article-title":"Behavior recognition of group-ranched cattle from video sequences using deep learning","volume":"56","author":"Bello","year":"2022","journal-title":"Indian J. Anim. Res."},{"key":"ref_13","first-page":"141","article-title":"Estrus behavior recognition of dairy cows based on improved YOLO v3 model","volume":"52","author":"Wang","year":"2021","journal-title":"Nongye Jixie Xuebao\/Trans. Chin. Soc. Agric. Mach."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"107607","DOI":"10.1016\/j.compag.2022.107607","article-title":"E3D: An efficient 3D CNN for the recognition of dairy cow\u2019s basic motion behavior","volume":"205","author":"Wang","year":"2023","journal-title":"Comput. Electron. Agric."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Liu, Z., Wang, L., Wu, W., Qian, C., and Lu, T. (2021, January 10\u201317). Tam: Temporal adaptive module for video recognition. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01345"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.biosystemseng.2024.03.006","article-title":"Beef cattle abnormal behaviour recognition based on dual-branch frequency channel temporal excitation and aggregation","volume":"241","author":"Han","year":"2024","journal-title":"Biosyst. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, G., Shi, G., and Zhu, C. (2024). Dynamic serpentine convolution with attention mechanism enhancement for beef cattle behavior recognition. Animals, 14.","DOI":"10.3390\/ani14030466"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chen, G., Li, C., Guo, Y., Shu, H., Cao, Z., and Xu, B. (2022). Recognition of cattle\u2019s feeding behaviors using noseband pressure sensor with machine learning. Front. Vet. Sci., 9.","DOI":"10.3389\/fvets.2022.822621"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"103524","DOI":"10.1016\/j.jvcir.2022.103524","article-title":"Cattle behavior recognition based on feature fusion under a dual attention mechanism","volume":"85","author":"Shang","year":"2022","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_20","unstructured":"Zia, A., Sharma, R., Arablouei, R., Bishop-Hurley, G., McNally, J., Bagnall, N., Rolland, V., Kusy, B., Petersson, L., and Ingham, A. (2023). Cvb: A video dataset of cattle visual behaviors. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"39218","DOI":"10.1109\/ACCESS.2021.3064934","article-title":"Metric-based attention feature learning for video action recognition","volume":"9","author":"Kim","year":"2021","journal-title":"IEEE Access"},{"key":"ref_22","unstructured":"Santoro, A., Raposo, D., Barrett, D.G., Malinowski, M., Pascanu, R., Battaglia, P., and Lillicrap, T. (2017). A simple neural network module for relational reasoning. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Lin, D., Tang, X., and Van Gool, L. (2016). Temporal segment networks: Towards good practices for deep action recognition. European Conference on Computer Vision, Springer International Publishing.","DOI":"10.1007\/978-3-319-46484-8_2"},{"key":"ref_24","unstructured":"TLin, J., Gan, C., and Han, S. (November, January 27). Tsm: Temporal shift module for efficient video understanding. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Carreira, J., and Zisserman, A. (2017, January 21\u201326). Quo vadis, action recognition? A new model and the kinetics dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.502"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, Z., She, Q., and Smolic, A. (2021, January 19\u201325). Action-net: Multipath excitation for action recognition. Proceedings of the IEEE\/CVF conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01301"},{"key":"ref_27","unstructured":"Xiao, F., Lee, Y.J., Grauman, K., Malik, J., and Feichtenhofer, C. (2020). Audiovisual slowfast networks for video recognition. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Li, K., Fan, D., Wu, H., and Zhao, A. (2024). A new dataset for video-based cow behavior recognition. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-65953-x"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/11\/496\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T13:14:15Z","timestamp":1763039655000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/11\/496"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,13]]},"references-count":28,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["computers14110496"],"URL":"https:\/\/doi.org\/10.3390\/computers14110496","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,13]]}}}