{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T17:04:15Z","timestamp":1791911055966,"version":"4.3.4"},"reference-count":34,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,12,19]],"date-time":"2019-12-19T00:00:00Z","timestamp":1576713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Night-time surveillance is important for safety and security purposes. For this reason, several studies have attempted to automatically detect people intruding into restricted areas by using infrared cameras. However, detecting people from infrared CCTV (closed-circuit television) is challenging because they are usually installed in overhead locations and people only occupy small regions in the resulting image. Therefore, this study proposes an accurate and efficient method for detecting people in infrared CCTV images during the night-time. For this purpose, three different infrared image datasets were constructed; two obtained from an infrared CCTV installed on a public beach and another obtained from a forward looking infrared (FLIR) camera installed on a pedestrian bridge. Moreover, a convolution neural network (CNN)-based pixel-wise classifier for fine-grained person detection was implemented. The detection performance of the proposed method was compared against five conventional detection methods. The results demonstrate that the proposed CNN-based human detection approach outperforms conventional detection approaches in all datasets. Especially, the proposed method maintained F1 scores of above 80% in object-level detection for all datasets. By improving the performance of human detection from infrared images, we expect that this research will contribute to the safety and security of public areas during night-time.<\/jats:p>","DOI":"10.3390\/s20010034","type":"journal-article","created":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T03:15:01Z","timestamp":1577070901000},"page":"34","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":84,"title":["CNN-Based Person Detection Using Infrared Images for Night-Time Intrusion Warning Systems"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1643-5194","authenticated-orcid":false,"given":"Jisoo","family":"Park","sequence":"first","affiliation":[{"name":"School of Civil and Environmental Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingdao","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Civil and Environmental Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3677-8899","authenticated-orcid":false,"given":"Yong K.","family":"Cho","sequence":"additional","affiliation":[{"name":"School of Civil and Environmental Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dae Y.","family":"Kang","sequence":"additional","affiliation":[{"name":"College of Sports and Leisure Studies, Yonsei University, Seoul 03722, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Byung J.","family":"Son","sequence":"additional","affiliation":[{"name":"Department of International Civil &amp; Plant Engineering, Konyang University, Nonsan 32992, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,19]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (WHO) (2015). Global Report on Drowning: Preventing a Leading Killer, WHO."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"11","DOI":"10.2112\/SI79-003.1","article-title":"An introduction of AELIS (Aquatic environment life-saving integrated system)","volume":"79","author":"Kang","year":"2017","journal-title":"J. Coast. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/MVT.2017.2753540","article-title":"Smart cameras are making our beaches safer: A 5G-envisioned distributed architecture for safe, connected coastal areas","volume":"12","author":"Alam","year":"2017","journal-title":"IEEE Veh. Technol. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"216","DOI":"10.2112\/SI91-044.1","article-title":"Application of vision-based safety warning system to haeundae beach, Korea","volume":"91","author":"Lee","year":"2019","journal-title":"J. Coast. Res."},{"key":"ref_5","unstructured":"Suard, F., Rakotomamonjy, A., Bensrhair, A., and Broggi, A. (2006, January 13\u201315). Pedestrian detection using infrared images and histograms of oriented gradients. Proceedings of the 2006 IEEE Intelligent Vehicle Symposium, Tokyo, Japan."},{"key":"ref_6","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mikolajczyk, K., Schmid, C., and Zisserman, A. (2004, January 11\u201314). Human detection based on a probabilistic assembly of robust part detectors. Proceedings of the 8th European Conference on Computer Vision, Prague, Czech Republic.","DOI":"10.1007\/978-3-540-24670-1_6"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1679","DOI":"10.1109\/TVT.2004.834875","article-title":"A shape-independent method for pedestrian detection with far-infrared images","volume":"53","author":"Fang","year":"2004","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_9","unstructured":"Ragb, H.K., Asari, V.K., and Aspiras, T.H. (2018, January 16\u201317). Human detection in infrared imagery using intensity distribution, gradient and texture features. Proceedings of the Mobile Multimedia\/Image Processing, Security, and Applications 2018, Orlando, FL, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/TITS.2004.838222","article-title":"Pedestrian detection and tracking with night vision","volume":"6","author":"Xu","year":"2005","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_11","unstructured":"Zhang, L., Wu, B., and Nevatia, R. (2007, January 17\u201322). Pedestrian detection in infrared images based on local shape features. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Setjo, C.H., Achmad, B., and Djoko, F. (2017, January 1\u20132). Thermal image human detection using Haar-cascade classifier. Proceedings of the 7th International Annual Engineering Seminar (InAES), Yogyakarta, Indonesia.","DOI":"10.1109\/INAES.2017.8068554"},{"key":"ref_13","first-page":"499","article-title":"Algorithms for face detection on infrared thermal images","volume":"10","author":"Neves","year":"2018","journal-title":"Int. J. Adv. Softw."},{"key":"ref_14","first-page":"8","article-title":"A comparative study of multiple object detection using haar-like feature selection and local binary patterns in several platforms","volume":"2015","author":"Guennouni","year":"2015","journal-title":"Model. Simul. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Qu, H., Zhang, L., Wu, X., He, X., Hu, X., and Wen, X. (2019). Multiscale object detection in infrared streetscape images based on deep learning and instance level data augmentation. Appl. Sci., 9.","DOI":"10.3390\/app9030565"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yardimci, O., and Ayy\u0131ld\u0131z, B.\u00c7. (2018, January 15\u201319). Comparison of SVM and CNN classification methods for infrared target recognition. Proceedings of the Automatic Target Recognition XXVIII, Orlando, FL, USA.","DOI":"10.1117\/12.2303504"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hasan, M., Ullah, S., Khan, M.J., and Khurshid, K. (2019, January 10\u201314). Comparative analysis of SVM, ANN and CNN for classifying vegetation species using hyperspectral thermal infrared data. Proceedings of the International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences, Enschede, The Netherlands.","DOI":"10.5194\/isprs-archives-XLII-2-W13-1861-2019"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kim, J.H., Hong, H.G., and Park, K.R. (2017). Convolutional neural network-based human detection in nighttime images using visible light camera sensors. Sensors, 17.","DOI":"10.3390\/s17051065"},{"key":"ref_19","unstructured":"Herrmann, C., Ruf, M., and Beyerer, J. (2018, January 15\u201319). CNN-based thermal infrared person detection by domain adaptation. Proceedings of the Autonomous Systems: Sensors, Vehicles, Security and the Internet of Everything, Orlando, FL, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Khalid, B., Khan, A.M., Akram, M.U., and Batool, S. (2019, January 6\u20137). Person detection by fusion of visible and thermal images using convolutional neural network. Proceedings of the 2019 2nd International Conference on Communication, Computing and Digital systems (C-CODE), Islamabad, Pakistan.","DOI":"10.1109\/C-CODE.2019.8680991"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, J., Zhang, S., Wang, S., and Metaxas, D.N. (2016). Multispectral deep neural networks for pedestrian detection. arXiv.","DOI":"10.5244\/C.30.73"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"D\u2019Acremont, A., Fablet, R., Baussard, A., and Quin, G. (2019). CNN-based target recognition and identification for infrared imaging in defense systems. Sensors, 19.","DOI":"10.3390\/s19092040"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hwang, S., Park, J., Kim, N., Choi, Y., and Kweon, I.S. (2015, January 7\u201312). Multispectral pedestrian detection: Benchmark dataset and baseline. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298706"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez, A., Fang, Z., Socarras, Y., Serrat, J., V\u00e1zquez, D., Xu, J., and L\u00f3pez, A.M. (2016). Pedestrian detection at day\/night time with visible and FIR cameras: A comparison. Sensors, 16.","DOI":"10.3390\/s16060820"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Khellal, A., Ma, H., and Fei, Q. (2015, January 24\u201327). Pedestrian classification and detection in far infrared images. Proceedings of the International Conference on Intelligent Robotics and Applications, Portsmouth, UK.","DOI":"10.1007\/978-3-319-22879-2_47"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lin, T., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L., and Dollar, P. (2015, January 6\u201312). Microsoft COCO: Common objects in context. Proceedings of the European conference on computer vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1016\/j.patrec.2005.11.005","article-title":"Efficient adaptive density estimation per image pixel for the task of background subtraction","volume":"27","author":"Zivkovic","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wu, M., Lin, C., and Chang, C. (2007, January 26\u201328). Brain tumor detection using color-based K-means clustering segmentation. Proceedings of the Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP 2007), Kaohsiung, Taiwan.","DOI":"10.1109\/IIHMSP.2007.4457697"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1016\/j.procs.2015.06.090","article-title":"Image segmentation using K-means clustering algorithm and subtractive clustering algorithm","volume":"54","author":"Dhanachandra","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"04017049","DOI":"10.1061\/(ASCE)CP.1943-5487.0000698","article-title":"Real-time 3D crane workspace update using a hybrid visualization approach","volume":"31","author":"Chen","year":"2017","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Feng, C., Liu, M.Y., Kao, C.C., and Lee, T.Y. (2017, January 25\u201327). Deep active learning for civil infrastructure defect detection and classification. Proceedings of the ASCE International Workshop on Computing in Civil Engineering 2017, Washington, DC, USA.","DOI":"10.1061\/9780784480823.036"},{"key":"ref_33","unstructured":"Cao, Q.D., and Choe, Y. (2018). Building damage annotation on post-hurricane satellite imagery based on convolutional neural networks. arXiv."},{"key":"ref_34","unstructured":"Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/1\/34\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:43:45Z","timestamp":1760190225000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/1\/34"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,19]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["s20010034"],"URL":"https:\/\/doi.org\/10.3390\/s20010034","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,19]]}}}