{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T16:42:31Z","timestamp":1780764151592,"version":"3.54.1"},"reference-count":51,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T00:00:00Z","timestamp":1643241600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["833507"],"award-info":[{"award-number":["833507"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Search and Rescue (SaR) dogs are important assets in the hands of first responders, as they have the ability to locate the victim even in cases where the vision and or the sound is limited, due to their inherent talents in olfactory and auditory senses. In this work, we propose a deep-learning-assisted implementation incorporating a wearable device, a base station, a mobile application, and a cloud-based infrastructure that can first monitor in real-time the activity, the audio signals, and the location of a SaR dog, and second, recognize and alert the rescuing team whenever the SaR dog spots a victim. For this purpose, we employed deep Convolutional Neural Networks (CNN) both for the activity recognition and the sound classification, which are trained using data from inertial sensors, such as 3-axial accelerometer and gyroscope and from the wearable\u2019s microphone, respectively. The developed deep learning models were deployed on the wearable device, while the overall proposed implementation was validated in two discrete search and rescue scenarios, managing to successfully spot the victim (i.e., obtained F1-score more than 99%) and inform the rescue team in real-time for both scenarios.<\/jats:p>","DOI":"10.3390\/s22030993","type":"journal-article","created":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T22:01:57Z","timestamp":1643320917000},"page":"993","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":38,"title":["Deep Learning Empowered Wearable-Based Behavior Recognition for Search and Rescue Dogs"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3607-8187","authenticated-orcid":false,"given":"Panagiotis","family":"Kasnesis","sequence":"first","affiliation":[{"name":"Department of Electrical and Electronic Engineering, University of West Attica, 12244 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vasileios","family":"Doulgerakis","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, University of West Attica, 12244 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9993-5230","authenticated-orcid":false,"given":"Dimitris","family":"Uzunidis","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, University of West Attica, 12244 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8985-6136","authenticated-orcid":false,"given":"Dimitris G.","family":"Kogias","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, University of West Attica, 12244 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susana I.","family":"Funcia","sequence":"additional","affiliation":[{"name":"Spanish School of Rescue and Detection with Dogs (ESDP), 28524 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marta B.","family":"Gonz\u00e1lez","sequence":"additional","affiliation":[{"name":"Spanish School of Rescue and Detection with Dogs (ESDP), 28524 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christos","family":"Giannousis","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, University of West Attica, 12244 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1921-4466","authenticated-orcid":false,"given":"Charalampos Z.","family":"Patrikakis","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, University of West Attica, 12244 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,27]]},"reference":[{"key":"ref_1","unstructured":"Doulgerakis, V., Giannousis, C., Kalyvas, D., Feidakis, M., Patrikakis, C.Z., Bocaj, E., Laliotis, G.P., and Bizelis, I. (2019, January 13\u201315). An Animal Welfare Platform for Extensive Livestock Production Systems. Proceedings of the AmI, Rome, Italy."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zeagler, C., Byrne, C., Valentin, G., Freil, L., Kidder, E., Crouch, J., Starner, T., and Jackson, M.M. (2016, January 15\u201317). Search and Rescue: Dog and Handler Collaboration through Wearable and Mobile Interfaces. Proceedings of the Third International Conference on Animal-Computer Interaction (ACI \u201916), Milton Keynes, UK.","DOI":"10.1145\/2995257.2995390"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Doull, K.E., Chalmers, C., Fergus, P., Longmore, S.N., Piel, A.K., and Wich, S.A. (2021). An Evaluation of the Factors Affecting \u2018Poacher\u2019 Detection with Drones and the Efficacy of Machine-Learning for Detection. Sensors, 21.","DOI":"10.3390\/s21124074"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.anbehav.2016.12.005","article-title":"Applications of machine learning in animal behavior studies","volume":"124","author":"Valletta","year":"2017","journal-title":"Anim. Behav."},{"key":"ref_5","unstructured":"Kamminga, J.W. (2020). Hiding in the Deep: Online Animal Activity Recognition Using Motion Sensors and Machine Learning. [Ph.D. Thesis, University of Twente]."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"105393","DOI":"10.1016\/j.applanim.2021.105393","article-title":"Dog behavior classification with movement sensors placed on the harness and the collar","volume":"241","author":"Kumpulainen","year":"2021","journal-title":"Appl. Anim. Behav. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Valentin, G., Alcaidinho, J., Howard, A.M., Jackson, M.M., and Starner, T. (2016, January 12\u201316). Creating collar-sensed motion gestures for dog-human communication in service applications. Proceedings of the 2016 ACM International Symposium on Wearable Computers, Heidelberg, Germany.","DOI":"10.1145\/2971763.2971788"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kasnesis, P., Patrikakis, C.Z., and Venieris, I.S. (2018, January 6\u20137). PerceptionNet: A deep convolutional neural network for late sensor fusion. Proceedings of the SAI Intelligent Systems Conference, London, UK.","DOI":"10.1007\/978-3-030-01054-6_7"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kasnesis, P., Chatzigeorgiou, C., Toumanidis, L., and Patrikakis, C.Z. (2019, January 11\u201315). Gesture-based incident reporting through smart watches. Proceedings of the 2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), Kyoto, Japan.","DOI":"10.1109\/PERCOMW.2019.8730586"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bocaj, E., Uzunidis, D., Kasnesis, P., and Patrikakis, C.Z. (2020, January 4\u201316). On the Benefits of Deep Convolutional Neural Networks on Animal Activity Recognition. Proceedings of the 2020 IEEE International Conference on Smart Systems and Technologies (SST), Osijek, Croatia.","DOI":"10.1109\/SST49455.2020.9263702"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"012004","DOI":"10.1088\/1757-899X\/138\/1\/012004","article-title":"Accelerometer based solution for precision livestock farming: Geolocation enhancement and animal activity identification","volume":"Volume 138","author":"Terrasson","year":"2016","journal-title":"IOP Conference Series: Materials Science and Engineering"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Demir, G., and Erman, A.T. (2018, January 2\u20135). Activity recognition and tracking system for domestic animals. Proceedings of the 2018 IEEE 26th Signal Processing and Communications Applications Conference (SIU), Izmir, Turkey.","DOI":"10.1109\/SIU.2018.8404784"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kleanthous, N., Hussain, A., Mason, A., Sneddon, J., Shaw, A., Fergus, P., Chalmers, C., and Al-Jumeily, D. (2018, January 13\u201316). Machine learning techniques for classification of livestock behavior. Proceedings of the International Conference on Neural Information Processing, Siem Reap, Cambodia.","DOI":"10.1007\/978-3-030-04212-7_26"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3191747","article-title":"Robust sensor-orientation-independent feature selection for animal activity recognition on collar tags","volume":"2","author":"Kamminga","year":"2018","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"243","DOI":"10.18280\/ria.350308","article-title":"Farm animals\u2019 behaviors and welfare analysis with AI algorithms: A review","volume":"35","author":"Debauche","year":"2021","journal-title":"Revue d\u2019Intelligence Artificielle"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"255","DOI":"10.3354\/esr00452","article-title":"Accelerometers in collars identify behavioral states in captive African elephants Loxodonta africana","volume":"18","author":"Soltis","year":"2012","journal-title":"Endanger. Spec. Res."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40317-017-0121-3","article-title":"Identification of behaviors from accelerometer data in a wild social primate","volume":"5","author":"Fehlmann","year":"2017","journal-title":"Anim. Biotelem."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"le Roux, S., Wolhuter, R., and Niesler, T. (2017, January 23). An overview of automatic behavior classification for animal-borne sensor applications in South Africa. Proceedings of the ACM Multimedia 2017 Workshop on South African Academic Participation, Mountain View, CA, USA.","DOI":"10.1145\/3132711.3132716"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Junior, R.L. (2020, January 17\u201318). IoT applications for monitoring companion animals: A systematic literature review. Proceedings of the 2020 IEEE 14th International Conference on Innovations in Information Technology (IIT), Al Ain, United Arab Emirates.","DOI":"10.1109\/IIT50501.2020.9299045"},{"key":"ref_20","unstructured":"De Seabra, J., Rybarczyk, Y., Batista, A., Rybarczyk, P., Lebret, M., and Vernay, D. (2021, December 16). Development of a Wearable Monitoring System for Service Dogs. Available online: https:\/\/docentes.fct.unl.pt\/agb\/files\/service_dogs.pdf."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ladha, C., Hammerla, N., Hughes, E., Olivier, P., and Ploetz, T. (2013, January 8\u201312). Dog\u2019s life: Wearable activity recognition for dogs. Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Zurich, Switzerland.","DOI":"10.1145\/2493432.2493519"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"den Uijl, I., \u00c1lvarez, C.B.G., Bartram, D.J., Dror, Y., Holland, R., and Cook, A.J.C. (2017). External validation of a collar-mounted triaxial accelerometer for second-by-second monitoring of eight behavioral states in dogs. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0188481"},{"key":"ref_23","first-page":"46","article-title":"Design and Analysis of smart sensing system for animal emotions recognition","volume":"169","author":"Massawe","year":"2017","journal-title":"ICAJ"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wernimont, S.M., Thompson, R.J., Mickelsen, S.L., Smith, S.C., Alvarenga, I.C., and Gross, K.L. (2018). Use of accelerometer activity monitors to detect changes in pruritic behaviors: Interim clinical data on 6 dogs. Sensors, 18.","DOI":"10.3390\/s18010249"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gerencs\u00e9r, L., V\u00e1s\u00e1rhelyi, G., Nagy, M., Vicsek, T., and Mikl\u00f3si, A. (2013). Identification of behavior in freely moving dogs (Canis familiaris) using inertial sensors. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0077814"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3454","DOI":"10.1109\/JSEN.2015.2485210","article-title":"Wearable Heart Rate Sensor Systems for Wireless Canine Health Monitoring","volume":"16","author":"Brugarolas","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"468","DOI":"10.2460\/ajvr.68.5.468","article-title":"Evaluation of an accelerometer for at-home monitoring of spontaneous activity in dogs","volume":"68","author":"Hansen","year":"2007","journal-title":"Am. J. Vet. Res."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Aich, S., Chakraborty, S., Sim, J.S., Jang, D.J., and Kim, H.C. (2019). The design of an automated system for the analysis of the activity and emotional patterns of dogs with wearable sensors using machine learning. Appl. Sci., 9.","DOI":"10.3390\/app9224938"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chambers, R.D., Yoder, N.C., Carson, A.B., Junge, C., Allen, D.E., Prescott, L.M., Bradley, S., Wymore, G., Lloyd, K., and Lyle, S. (2021). Deep learning classification of canine behavior using a single collar-mounted accelerometer: Real-world validation. Animals, 11.","DOI":"10.3390\/ani11061549"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Piczak, K.J. (2015, January 17\u201320). Environmental sound classification with convolutional neural networks. Proceedings of the 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), Boston, MA, USA.","DOI":"10.1109\/MLSP.2015.7324337"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hershey, S., Chaudhuri, S., Ellis, D.P.W., Gemmeke, J.F., Jansen, A., Moore, R.C., Plakal, M., Platt, D., Saurous, R.A., and Seybold, B. (2017, January 5\u20139). CNN architectures for large-scale audio classification. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.","DOI":"10.1109\/ICASSP.2017.7952132"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2012","journal-title":"Commun. ACM"},{"key":"ref_33","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201313). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Gemmeke, J.F., Ellis, D.P.W., Freedman, D., Jansen, A., Lawrence, W., Moore, R.C., Plakal, M., and Ritter, M. (2017, January 5\u20139). Audio Set: An ontology and human-labeled dataset for audio events. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.","DOI":"10.1109\/ICASSP.2017.7952261"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Salamon, J., and Bello, J.P. (2015, January 19\u201324). Unsupervised feature learning for urban sound classification. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, Australia.","DOI":"10.1109\/ICASSP.2015.7177954"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Coates, A., and Ng, A. (2012). Learning Feature Representations with K-Means. Neural Networks: Tricks of the Trade, Springer.","DOI":"10.1007\/978-3-642-35289-8_30"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Kumar, A., and Raj, B. (2017). Deep CNN Framework for Audio Event Recognition using Weakly Labeled Web Data. arXiv.","DOI":"10.1145\/2964284.2964310"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1109\/LSP.2017.2657381","article-title":"Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification","volume":"24","author":"Salamon","year":"2017","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Piczak, K.J. (2015, January 26\u201330). ESC: Dataset for Environmental Sound Classification. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane Australia.","DOI":"10.1145\/2733373.2806390"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Jackson, M.M., Byrne, C.A., Freil, L., Valentin, G., Zuerndorfer, J., Zeagler, C., Logas, J., Gilliland, S.M., Rapoport, A., and Sun, S. (2018, January 4\u20136). Technology for working dogs. Proceedings of the Fifth International Conference on Animal-Computer Interaction, Atlanta, GA, USA.","DOI":"10.1145\/3295598.3295615"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Valentin, G., Alcaidinho, J., Howard, A.M., Jackson, M.M., and Starner, T. (2015, January 16\u201319). Towards a canine-human communication system based on head gestures. Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology, Iskandar, Malaysia.","DOI":"10.1145\/2832932.2837016"},{"key":"ref_44","unstructured":"Pantazes, T. (2016). Wearable Canine and Feline Collar with Camera and Added Features. (9,615,546), U.S. Patent."},{"key":"ref_45","unstructured":"David Lopez, B.V.C. (2012). Interactive Communication and Tracking Dog Collar. (8,543,134 B2), U.S. Patent."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ferworn, A., Wright, C., Tran, J., Li, C., and Choset, H. (2012, January 5\u20138). Dog and snake marsupial cooperation for urban search and rescue deployment. Proceedings of the 2012 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), College Station, TX, USA.","DOI":"10.1109\/SSRR.2012.6523887"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"6459251","DOI":"10.1155\/2016\/6459251","article-title":"Automatic Training of Rat Cyborgs for Navigation","volume":"2016","author":"Yu","year":"2016","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Kamminga, J.W., Bisby, H.C., Le, D.V., Meratnia, N., and Havinga, P.J. (2017, January 11\u201315). Generic online animal activity recognition on collar tags. Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, Maui, HI, USA.","DOI":"10.1145\/3123024.3124407"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Kumar, A., Khadkevich, M., and F\u00fcgen, C. (2018, January 15\u201320). Knowledge Transfer from Weakly Labeled Audio Using Convolutional Neural Network for Sound Events and Scenes. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8462200"},{"key":"ref_50","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_51","unstructured":"Hestness, J., Narang, S., Ardalani, N., Diamos, G.F., Jun, H., Kianinejad, H., Patwary, M.M.A., Yang, Y., and Zhou, Y. (2017). Deep Learning Scaling is Predictable, Empirically. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/993\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:09:12Z","timestamp":1760134152000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/993"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,27]]},"references-count":51,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22030993"],"URL":"https:\/\/doi.org\/10.3390\/s22030993","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,27]]}}}