{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T13:50:34Z","timestamp":1760709034784,"version":"build-2065373602"},"reference-count":55,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2016,3,30]],"date-time":"2016-03-30T00:00:00Z","timestamp":1459296000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Recently, human detection has been used in various applications. Although visible light cameras are usually employed for this purpose, human detection based on visible light cameras has limitations due to darkness, shadows, sunlight, etc. An approach using a thermal (far infrared light) camera has been studied as an alternative for human detection, however, the performance of human detection by thermal cameras is degraded in case of low temperature differences between humans and background. To overcome these drawbacks, we propose a new method for human detection by using thermal camera images. The main contribution of our research is that the thresholds for creating the binarized difference image between the input and background (reference) images can be adaptively determined based on fuzzy systems by using the information derived from the background image and difference values between background and input image. By using our method, human area can be correctly detected irrespective of the various conditions of input and background (reference) images. For the performance evaluation of the proposed method, experiments were performed with the 15 datasets captured under different weather and light conditions. In addition, the experiments with an open database were also performed. The experimental results confirm that the proposed method can robustly detect human shapes in various environments.<\/jats:p>","DOI":"10.3390\/s16040453","type":"journal-article","created":{"date-parts":[[2016,3,30]],"date-time":"2016-03-30T16:47:27Z","timestamp":1459356447000},"page":"453","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Human Detection Based on the Generation of a Background Image and Fuzzy System by Using a Thermal Camera"],"prefix":"10.3390","volume":"16","author":[{"given":"Eun","family":"Jeon","sequence":"first","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Jong","family":"Kim","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Hyung","family":"Hong","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Ganbayar","family":"Batchuluun","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Kang","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2016,3,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1109\/TITS.2009.2018961","article-title":"Real-Time Pedestrian Detection and Tracking at Nighttime for Driver-Assistance Systems","volume":"10","author":"Ge","year":"2009","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1346","DOI":"10.1109\/TITS.2013.2262045","article-title":"Part-Based Pedestrian Detection and Feature-Based Tracking for Driver Assistance: Real-Time, Robust Algorithms, and Evaluation","volume":"14","author":"Prioletti","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"K\u00e4llhammer, J.-E. (2006, January 6). Night Vision: Requirements and Possible Roadmap for FIR and NIR Systems. Proceedings of the SPIE\u2014The International Society for Optical Engineering, Strasbourg, France.","DOI":"10.1117\/12.663145"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Mehralian, S., and Palhang, M. (2013, January 10\u201312). Pedestrian Detection Using Principal Components Analysis of Gradient Distribution. Proceedings of the Iranian Conference on Machine Vision and Image Processing, Zanjan, Iran.","DOI":"10.1109\/IranianMVIP.2013.6779950"},{"key":"ref_5","unstructured":"Jiang, Y., and Ma, J. (2015, January 7\u201312). Combination Features and Models for Human Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/978-3-642-17277-9_10","article-title":"Multiple-Object Tracking in Cluttered and Crowded Public Spaces","volume":"6455","author":"Martin","year":"2010","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Khatoon, R., Saqlain, S.M., and Bibi, S. (2012, January 13\u201315). A Robust and Enhanced Approach for Human Detection in Crowd. Proceedings of the International Multitopic Conference, Islamabad, Pakistan.","DOI":"10.1109\/INMIC.2012.6511457"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"11603","DOI":"10.3390\/s130911603","article-title":"Human Detection from a Mobile Robot Using Fusion of Laser and Vision Information","volume":"13","author":"Fotiadis","year":"2013","journal-title":"Sensors"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"8570","DOI":"10.3390\/s150408570","article-title":"Pedestrian Detection in Far-Infrared Daytime Images Using a Hierarchical Codebook of SURF","volume":"15","author":"Besbes","year":"2015","journal-title":"Sensors"},{"key":"ref_10","unstructured":"Zhu, Q., Yeh, M.-C., Cheng, K.-T., and Avidan, S. (2006, January 17\u201322). Fast Human Detection Using a Cascade of Histograms of Oriented Gradients. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, NY, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, Z., Zhang, J., Wu, Q., and Geers, G. (2010, January 1\u20133). Feature Enhancement Using Gradient Salience on Thermal Image. Proceedings of the International Conference on Digital Image Computing: Techniques and Applications, Sydney, Australia.","DOI":"10.1109\/DICTA.2010.99"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chang, S.L., Yang, F.T., Wu, W.P., Cho, Y.A., and Chen, S.W. (2011, January 8\u201310). Nighttime Pedestrian Detection Using Thermal Imaging Based on HOG Feature. Proceedings of the International Conference on System Science and Engineering, Macao, China.","DOI":"10.1109\/ICSSE.2011.5961992"},{"key":"ref_13","unstructured":"Rajaei, A., Shayegh, H., and Charkari, N.M. (November, January 31). Human Detection in Semi-Dense Scenes Using HOG descriptor and Mixture of SVMs. Proceedings of the International Conference on Computer and Knowledge Engineering, Mashhad, Iran."},{"key":"ref_14","unstructured":"Bertozzi, M., Broggi, A., Rose, M.D., Felisa, M., Rakotomamonjy, A., and Suard, F. (October, January 30). A Pedestrian De-Tector Using Histograms of Oriented Gradients and a Support Vector Machine Classifier. Proceedings of the IEEE Conference on Intelligent Transportation Systems, Seattle, WA, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, W., Zheng, D., Zhao, T., and Yang, M. (2012, January 29\u201331). An Effective Approach to Pedestrian Detection in Thermal Imagery. Proceedings of the International Conference on Natural Computation, Chongqing, China.","DOI":"10.1109\/ICNC.2012.6234621"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, W., Wang, Y., Chen, F., and Sowmya, A. (2013, January 15\u201317). A Weakly Supervised Approach for Object Detection Based on Soft-Label Boosting. Proceedings of the IEEE Workshop on Applications of Computer Vision, Tempa, FL, USA.","DOI":"10.1109\/WACV.2013.6475037"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, W., Zhang, J., and Shen, C. (2010, January 26\u201329). Improved Human Detection and Classification in Thermal Images. Proceedings of the IEEE International Conference on Image Processing, Hong Kong, China.","DOI":"10.1109\/ICIP.2010.5649946"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Takeda, T., Kuramoto, K., Kobashi, S., and Haya, Y. (2013, January 22\u201324). A Fuzzy Human Detection for Security System Using Infrared Laser Camera. Prodeedings of the IEEE International Symposium on Multiple-Valued Logic, Toyama, Japan.","DOI":"10.1109\/ISMVL.2013.4"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"215","DOI":"10.3233\/IFS-2012-0548","article-title":"A Fuzzy Model for Human Fall Detection in Infrared Video","volume":"24","author":"Sokolova","year":"2013","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_20","first-page":"43","article-title":"Human Object Extraction Using Nonextensive Fuzzy Entropy and Chaos Differential Evolution","volume":"6","author":"Nie","year":"2013","journal-title":"Int. J. Signal Process. Image Process. Pattern Recognit."},{"key":"ref_21","unstructured":"Davis, J.W., and Sharma, V. (2005, January 25). Fusion-Based Background-Subtraction Using Contour Saliency. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition\u2014Workshops, San Diego, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.cviu.2006.06.010","article-title":"Background-Subtraction Using Contour-Based Fusion of Thermal and Visible Imagery","volume":"106","author":"Davis","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Davis, J.W., and Sharma, V. (2004, January 23\u201326). Robust Detection of People in Thermal Imagery. Proceedings of the International Conference on Pattern Recognition, Cambridge, UK.","DOI":"10.1109\/ICPR.2004.1333872"},{"key":"ref_24","unstructured":"Dai, C., Zheng, Y., and Li, X. (2005, January 25). Layered Representation for Pedestrian Detection and Tracking in Infrared Imagery. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition\u2014Workshops, San Diego, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1016\/j.cviu.2006.08.009","article-title":"Pedestrian Detection and Tracking in Infrared Imagery Using Shape and Appearance","volume":"106","author":"Dai","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_26","unstructured":"Latecki, L.J., Miezianko, R., and Pokrajac, D. (2005, January 15\u201316). Tracking Motion Objects in Infrared Videos. Proceedings of the IEEE International Conference on Advanced Video and Signal Based Surveillance, Como, Italy."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Mahapatra, A., Mishra, T.K., Sa, P.K., and Majhi, B. (2013, January 7\u201310). Background Subtraction and Human Detection in Outdoor Videos Using Fuzzy Logic. Proceedings of the IEEE International Conference on Fuzzy Systems, Hyderabad, India.","DOI":"10.1109\/FUZZ-IEEE.2013.6622397"},{"key":"ref_28","unstructured":"Cucchiara, R., Grana, C., Piccardi, M., and Prati, A. (2000, January 1\u20133). Statistic and Knowledge-Based Moving Object Detection in Traffic Scenes. Proceedings of the IEEE Conference on Intelligent Transportation Systems, Dearborn, MI, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1016\/j.infrared.2013.08.014","article-title":"Background Subtraction Based Level Sets for Human Segmentation in Thermal Infrared Surveillance Systems","volume":"61","author":"Tan","year":"2013","journal-title":"Infrared Phys. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.1109\/TPAMI.2003.1233909","article-title":"Detecting Moving Objects, Ghosts, and Shadows in Video Streams","volume":"25","author":"Cucchiara","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1177\/0361198106194400111","article-title":"Extracting Roadway Background Image: A Mode-Based Approach","volume":"1944","author":"Zheng","year":"2006","journal-title":"J. Transp. Res. Rep."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Davis, J.W., and Keck, M.A. (2005, January 5\u20137). A Two-Stage Template Approach to Person Detection in Thermal Imagery. Proceedings of the IEEE Workshop on Applications of Computer Vision, Breckenridge, CO, USA.","DOI":"10.1109\/ACVMOT.2005.14"},{"key":"ref_33","unstructured":"Dagless, E.L., Ali, A.T., and Cruz, J.B. (1993, January 12\u201315). Visual Road Traffic Monitoring and Data Collection. Proceedings of the IEEE Vehicle Navigation and Information Systems Conference, Ottawa, ON, Canada."},{"key":"ref_34","unstructured":"Baf, F.E., Bouwmans, T., and Vachon, B. (2008, January 23\u201328). Fuzzy Foreground Detection for Infrared Videos. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Anchorage, AK, USA."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Shakeri, M., Deldari, H., Foroughi, H., Saberi, A., and Naseri, A. (2008, January 26\u201329). A Novel Fuzzy Background Subtraction Method Based on Cellular Automata for Urban Traffic Applications. Proceedings of the International Conference on Signal Processing, Beijing, China.","DOI":"10.1109\/ICOSP.2008.4697273"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zheng, Y., and Fan, L. (2010, January 15\u201316). Moving Object Detection Based on Running Average Background and Temporal Difference. Proceedings of the International Conference on Intelligent Systems and Knowledge Engineering, Hangzhou, China.","DOI":"10.1109\/ISKE.2010.5680866"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"6763","DOI":"10.3390\/s150306763","article-title":"Human Detection Based on the Generation of a Background Image by Using a Far-Infrared Light Camera","volume":"15","author":"Jeon","year":"2015","journal-title":"Sensors"},{"key":"ref_38","unstructured":"Infrared. Available online: https:\/\/en.wikipedia.org\/wiki\/Infrared."},{"key":"ref_39","unstructured":"Niblack, W. (1986). An Introduction to Digital Image Processing, Prentice Hall. [1st ed.]."},{"key":"ref_40","unstructured":"Gonzalez, R.C., and Woods, R.E. (1992). Digital Image Processing, Addison-Wesley. [1st ed.]."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Bayu, B.S., and Miura, J. (2013, January 7\u20139). Fuzzy-based Illumination Normalization for Face Recognition. Proceedings of the IEEE Workshop on Advanced Robotics and Its Social Impacts, Tokyo, Japan.","DOI":"10.1109\/ARSO.2013.6705518"},{"key":"ref_42","first-page":"164","article-title":"Why trapezoidal and triangular membership functions work so well: Towards a theoretical explanation","volume":"8","author":"Barua","year":"2014","journal-title":"J. Uncertain Syst."},{"key":"ref_43","unstructured":"Zhao, J., and Bose, B.K. (2002, January 5\u20138). Evaluation of Membership Functions for Fuzzy Logic Controlled Induction Motor Drive. Proceedings of the IEEE Annual Conference of the Industrial Electronics Society, Sevilla, Spain."},{"key":"ref_44","first-page":"261","article-title":"Effect of Different Defuzzification Methods in a Fuzzy Based Load Balancing Application","volume":"8","author":"Naaz","year":"2011","journal-title":"Int. J. Comput. Sci. Issues"},{"key":"ref_45","first-page":"1","article-title":"New Fuzzy-Based Retinex Method for the Illumination Normalization of Face Recognition","volume":"9","author":"Nam","year":"2012","journal-title":"Int. J. Adv. Rob. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/S0165-0114(97)00337-0","article-title":"Defuzzification: Criteria and Classification","volume":"108","author":"Leekwijck","year":"1999","journal-title":"Fuzzy Sets Syst."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"10580","DOI":"10.3390\/s150510580","article-title":"Robust Pedestrian Detection by Combining Visible and Thermal Infrared Cameras","volume":"15","author":"Lee","year":"2015","journal-title":"Sensors"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1007\/978-3-642-17711-8_29","article-title":"HMM Based Action Recognition with Projection Histogram Features","volume":"6388","author":"Vezzani","year":"2010","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_49","unstructured":"Tau 2 Uncooled Cores. Available online: http:\/\/www.flir.com\/cores\/display\/?id=54717."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"347","DOI":"10.3233\/ICA-130441","article-title":"Pedestrian Detection in Far Infrared Images","volume":"20","author":"Olmeda","year":"2013","journal-title":"Integr. Comput. Aided Eng."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1109\/TPAMI.2011.155","article-title":"Pedestrian Detection: An Evaluation of the State of the Art","volume":"34","author":"Dollar","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The Pascal Visual Object Classes (VOC) Challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_53","unstructured":"Sensitivity and Specificity. Available online: http:\/\/en.wikipedia.org\/wiki\/Sensitivity_and_specificity."},{"key":"ref_54","unstructured":"F1-Score. Available online: https:\/\/en.wikipedia.org\/wiki\/Precision_and_recall."},{"key":"ref_55","unstructured":"OTCBVS Benchmark Dataset Collection. Available online: http:\/\/vcipl-okstate.org\/pbvs\/bench\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/4\/453\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:21:30Z","timestamp":1760210490000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/4\/453"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3,30]]},"references-count":55,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2016,4]]}},"alternative-id":["s16040453"],"URL":"https:\/\/doi.org\/10.3390\/s16040453","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2016,3,30]]}}}