{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T20:58:50Z","timestamp":1778619530412,"version":"3.51.4"},"reference-count":29,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2022,9,28]],"date-time":"2022-09-28T00:00:00Z","timestamp":1664323200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"EU H2020 Research and Innovation Programme","doi-asserted-by":"publisher","award":["787021"],"award-info":[{"award-number":["787021"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Wide area surveillance has become of critical importance, particularly for border control between countries where vast forested land border areas are to be monitored. In this paper, we address the problem of the automatic detection of activity in forbidden areas, namely forested land border areas. In order to avoid false detections, often triggered in dense vegetation with single sensors such as radar, we present a multi sensor fusion and tracking system using passive infrared detectors in combination with automatic person detection from thermal and visual video camera images. The approach combines weighted maps with a rule engine that associates data from multiple weighted maps. The proposed approach is tested on real data collected by the EU FOLDOUT project in a location representative of a range of forested EU borders. The results show that the proposed approach can eliminate single sensor false detections and enhance accuracy by up to 50%.<\/jats:p>","DOI":"10.3390\/s22197351","type":"journal-article","created":{"date-parts":[[2022,9,28]],"date-time":"2022-09-28T03:30:37Z","timestamp":1664335837000},"page":"7351","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Fusion of Heterogenous Sensor Data in Border Surveillance"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6716-0629","authenticated-orcid":false,"given":"Luis","family":"Patino","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Reading, Reading RG6 6DH, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1640-5614","authenticated-orcid":false,"given":"Michael","family":"Hubner","sequence":"additional","affiliation":[{"name":"AIT Austrian Institute of Technology, 1210 Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rachel","family":"King","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Reading, Reading RG6 6DH, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Litzenberger","sequence":"additional","affiliation":[{"name":"AIT Austrian Institute of Technology, 1210 Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9988-3071","authenticated-orcid":false,"given":"Laure","family":"Roupioz","sequence":"additional","affiliation":[{"name":"ONERA, D\u00e9partement Optique et Techniques Associ\u00e9es (DOTA), Universit\u00e9 de Toulouse, 31055 Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kacper","family":"Michon","sequence":"additional","affiliation":[{"name":"ITTI, 61-612 Poznan, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"\u0141ukasz","family":"Szklarski","sequence":"additional","affiliation":[{"name":"ITTI, 61-612 Poznan, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julian","family":"Pegoraro","sequence":"additional","affiliation":[{"name":"AIT Austrian Institute of Technology, 1210 Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nikolai","family":"Stoianov","sequence":"additional","affiliation":[{"name":"Bulgarian Defence Institute, 1592 Sofia, Bulgaria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Ferryman","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Reading, Reading RG6 6DH, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"736","DOI":"10.1016\/j.compeleceng.2017.11.011","article-title":"Video Surveillance Systems-Current Status and Future Trends","volume":"70","author":"Tsakanikas","year":"2017","journal-title":"Comput. Electr. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Stachurski, J., Netsch, L., and Cole, R. (2013, January 27\u201330). Sound Source Localization for Video Surveillance Camera. Proceedings of the 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance, Krakow, Poland.","DOI":"10.1109\/AVSS.2013.6636622"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1109\/TASLP.2020.3042705","article-title":"Multi-Source DOA Estimation in Reverberant Environments by Jointing Detection and Modeling of Time-Frequency Points","volume":"29","author":"Jia","year":"2021","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Saranu, P.N., Abirami, G., Sivakumar, S., Ramesh, K.M., Arul, U., and Seetha, J. (2018, January 7\u20139). Theft Detection System using PIR Sensor. Proceedings of the 2018 4th International Conference on Electrical Energy Systems (ICEES), Chennai, India.","DOI":"10.1109\/ICEES.2018.8443215"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Majumder, A.J., and Izaguirre, J.A. (2020, January 13\u201317). A Smart IoT Security System for Smart-Home Using Motion Detection and Facial Recognition. Proceedings of the 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC),  Madrid, Spain.","DOI":"10.1109\/COMPSAC48688.2020.0-132"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bassyouni, A.M. (2019, January 15\u201318). A Mobile 4D Imaging Radar System Network for Home Land Security. Proceedings of the 2019 IEEE International Symposium on Phased Array System & Technology (PAST), Waltham, MA, USA.","DOI":"10.1109\/PAST43306.2019.9021001"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Butler, W., Poitevin, P., and Bjomholt, J. (2007, January 8\u201311). Benefits of Wide Area Intrusion Detection Systems Using FMCW Radar. Proceedings of the 2007 41st Annual IEEE International Carnahan Conference on Security Technology, Ottawa, ON, Canada.","DOI":"10.1109\/CCST.2007.4373486"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Arjun, D., Indukala, P.K., and Menon, K.A.U. (2020, January 8\u201310). Development of a Framework for Effective Surveillance and Human Intrusion Detection in Border regions covered with Dry leaves. Proceedings of the 2020 Fourth International Conference on Inventive Systems and Control (ICISC), Coimbatore, India.","DOI":"10.1109\/ICISC47916.2020.9171198"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mukherjee, M., Banerjee, A., Papadimitriou, A., Mansouri, S.S., and Nikolakopoulos, G. (2021). A Decentralized Sensor Fusion Scheme for Multi Sensorial Fault Resilient Pose Estimation. Sensors, 21.","DOI":"10.3390\/s21248259"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.cviu.2015.06.009","article-title":"Multi-Modal Human Aggression Detection","volume":"144","author":"Kooij","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jaafar, N., and Lachiri, Z. (2019, January 2\u20134). Audio-Visual Fusion for Aggression Detection Using Deep Neural Networks. Proceedings of the 2019 International Conference on Control, Automation and Diagnosis (ICCAD), Grenoble, France.","DOI":"10.1109\/ICCAD46983.2019.9037911"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1007\/s12530-012-9052-7","article-title":"Adaptive Complex Event Processing for Harmful Situation Detection","volume":"3","author":"Coffi","year":"2012","journal-title":"Evol. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Arjun, D., Indukala, P.K., and Unnikrishna Menon, K.A. (2019, January 17\u201319). PANCHENDRIYA: A Multi-sensing framework through Wireless Sensor Networks for Advanced Border Surveillance and Human Intruder Detection. Proceedings of the 2019 International Conference on Communication and Electronics Systems (ICCES), Coimbatore, India.","DOI":"10.1109\/ICCES45898.2019.9002161"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Andersson, M., Ntalampiras, S., Ganchev, T., Rydell, J., Ahlberg, J., and Fakotakis, N. (2010, January 26\u201329). Fusion of Acoustic and Optical Sensor Data for Automatic Fight Detection in Urban Environments. Proceedings of the 2010 13th International Conference on Information Fusion, Edinburgh, UK.","DOI":"10.1109\/ICIF.2010.5712105"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lefter, I., Burghouts, G.J., and Rothkrantz, L.J.M. (2012, January 18\u201321). Automatic Audio-Visual Fusion for Aggression Detection Using Meta-Information. Proceedings of the 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance, Beijing, China.","DOI":"10.1109\/AVSS.2012.13"},{"key":"ref_16","unstructured":"Fern\u00e1ndez, C.G.d.P. (2015). Grid-Based Multi-Sensor Fusion for On-Road Obstacle Detection: Application to Autonomous Driving. [Ph.D. Thesis, KTH]."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hubner, M., Wiesmeyr, C., Dittrich, K., Kohn, B., Garn, H., and Litzenberger, M. (2021, January 23\u201325). Audio-Video Sensor Fusion for the Detection of Security Critical Events in Public Spaces. Proceedings of the 2021 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), Karlsruhe, Germany.","DOI":"10.1109\/MFI52462.2021.9591185"},{"key":"ref_18","unstructured":"Jocher, G., Nishimura, K., Mineeva, T., and Vilari\u00f1o, R. (2021, August 17). YOLOv5. Available online: https:\/\/github.com\/ultralytics\/yolov5."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lin, T., Maire, M., Belongie, S.J., Bourdev, L.D., Girshick, R.B., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft COCO: Common Objects in Context. arXiv.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TSP.2010.2103065","article-title":"Road Intensity Based Mapping Using Radar Measurements with a Probability Hypothesis Density Filter","volume":"59","author":"Lundquist","year":"2011","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bouzouraa, M.E., and Hofmann, U. (2010, January 21\u201324). Fusion of Occupancy Grid Mapping and Model Based Object Tracking for Driver Assistance Systems Using Laser and Radar Sensors. Proceedings of the Intelligent Vehicles Symposium (IV), La Jolla, CA, USA.","DOI":"10.1109\/IVS.2010.5548106"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/2.30720","article-title":"Using Occupancy Grids for Mobile Robot Perception and Navigation","volume":"22","author":"Elfes","year":"1989","journal-title":"Computer"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4232","DOI":"10.1109\/TSP.2009.2025816","article-title":"The Bin-Occupancy Filter and Its Connection to the PHD Filters","volume":"57","author":"Erdinc","year":"2009","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Tong, J., Chen, L., and Cao, Y. (2018, January 28\u201330). Human Positioning Based on Probabilistic Occupancy Map. Proceedings of the 2018 14th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), Huangshan, China.","DOI":"10.1109\/FSKD.2018.8686844"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Oh, S.I., and Kang, H.B. (2015, January 7\u201313). A Modified Sequential Monte Carlo Bayesian Occupancy Filter Using Linear Opinion Pool for Grid Mapping. Proceedings of the 2015 IEEE International Conference on Computer Vision Workshop (ICCVW), Santiago, Chile.","DOI":"10.1109\/ICCVW.2015.34"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"13-es","DOI":"10.1145\/1177352.1177355","article-title":"Object Tracking: A Survey","volume":"38","author":"Yilmaz","year":"2006","journal-title":"ACM Comput. Surv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Patino, L., Boyle, J., Ferryman, J., Auer, J., Pegoraro, J., Pflugfelder, R., Cokbas, M., Konrad, J., Ishwar, P., and Slavic, G. (2021, January 16\u201319). PETS2021: Through-foliage detection and tracking challenge and evaluation. Proceedings of the 2021 17th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Washington, DC, USA.","DOI":"10.1109\/AVSS52988.2021.9663837"},{"key":"ref_28","unstructured":"(2020, July 15). Installation Manual F-Series. Available online: https:\/\/www.flir.com\/globalassets\/imported-assets\/document\/flir-f-series-installation-guide.pdf."},{"key":"ref_29","unstructured":"(2020, July 15). GPS Logger for Android. Available online: https:\/\/gpslogger.app."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7351\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:40:54Z","timestamp":1760143254000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7351"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,28]]},"references-count":29,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22197351"],"URL":"https:\/\/doi.org\/10.3390\/s22197351","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,28]]}}}