{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T16:11:33Z","timestamp":1776442293889,"version":"3.51.2"},"reference-count":67,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2017,5,8]],"date-time":"2017-05-08T00:00:00Z","timestamp":1494201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Because intelligent surveillance systems have recently undergone rapid growth, research on accurately detecting humans in videos captured at a long distance is growing in importance. The existing research using visible light cameras has mainly focused on methods of human detection for daytime hours when there is outside light, but human detection during nighttime hours when there is no outside light is difficult. Thus, methods that employ additional near-infrared (NIR) illuminators and NIR cameras or thermal cameras have been used. However, in the case of NIR illuminators, there are limitations in terms of the illumination angle and distance. There are also difficulties because the illuminator power must be adaptively adjusted depending on whether the object is close or far away. In the case of thermal cameras, their cost is still high, which makes it difficult to install and use them in a variety of places. Because of this, research has been conducted on nighttime human detection using visible light cameras, but this has focused on objects at a short distance in an indoor environment or the use of video-based methods to capture multiple images and process them, which causes problems related to the increase in the processing time. To resolve these problems, this paper presents a method that uses a single image captured at night on a visible light camera to detect humans in a variety of environments based on a convolutional neural network. Experimental results using a self-constructed Dongguk night-time human detection database (DNHD-DB1) and two open databases (Korea advanced institute of science and technology (KAIST) and computer vision center (CVC) databases), as well as high-accuracy human detection in a variety of environments, show that the method has excellent performance compared to existing methods.<\/jats:p>","DOI":"10.3390\/s17051065","type":"journal-article","created":{"date-parts":[[2017,5,8]],"date-time":"2017-05-08T11:45:16Z","timestamp":1494243916000},"page":"1065","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":51,"title":["Convolutional Neural Network-Based Human Detection in Nighttime Images Using Visible Light Camera Sensors"],"prefix":"10.3390","volume":"17","author":[{"given":"Jong","family":"Kim","sequence":"first","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Hyung","family":"Hong","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Kang","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2017,5,8]]},"reference":[{"key":"ref_1","unstructured":"Lipton, A.J., Fujiyoshi, H., and Patil, R.S. (1998, January 19\u201321). Moving target classification and tracking from real-time video. Proceedings of the IEEE Workshop on Applications of Computer Vision, Princeton, NJ, USA."},{"key":"ref_2","unstructured":"Oren, M., Papageorgiou, C., Sinha, P., Osuna, E., and Poggio, T. (1997, January 17\u201319). Pedestrian detection using wavelet templates. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Viola, P., Jones, M.J., and Snow, D. (2003, January 13\u201316). Detecting pedestrians using patterns of motion and appearance. Proceedings of the IEEE International Conference on Computer Vision, Nice, France.","DOI":"10.1109\/ICCV.2003.1238422"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/978-3-540-24670-1_6","article-title":"Human detection based on a probabilistic assembly of robust part detectors","volume":"3021","author":"Mikolajczyk","year":"2004","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Arandjelovi\u0107, O. (2011, January 26\u201328). Contextually learnt detection of unusual motion-based behaviour in crowded public spaces. Proceedings of the 26th Annual International Symposium on Computer and Information Science, London, UK.","DOI":"10.1007\/978-1-4471-2155-8_51"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/978-3-642-17277-9_10","article-title":"Multiple-object tracking in cluttered and crowded public spaces","volume":"6455","author":"Martin","year":"2010","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Khatoon, R., Saqlain, S.M., and Bibi, S. (2012, January 13\u201315). A robust and enhanced approach for human detection in crowd. Proceedings of the International Multitopic Conference, Islamabad, Pakistan.","DOI":"10.1109\/INMIC.2012.6511457"},{"key":"ref_8","unstructured":"Rajaei, A., Shayegh, H., and Charkari, N.M. (November, January 31). Human detection in semi-dense scenes using HOG descriptor and mixture of SVMs. Proceedings of the International Conference on Computer and Knowledge Engineering, Mashhad, Iran."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"10580","DOI":"10.3390\/s150510580","article-title":"Robust pedestrian detection by combining visible and thermal infrared cameras","volume":"15","author":"Lee","year":"2015","journal-title":"Sensors"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Batchuluun, G., Kim, Y.G., Kim, J.H., Hong, H.G., and Park, K.R. (2016). Robust behavior recognition in intelligent surveillance environments. Sensors, 16.","DOI":"10.3390\/s16071010"},{"key":"ref_11","first-page":"331","article-title":"Selection of a visible-light vs. thermal infrared sensor in dynamic environments based on confidence measures","volume":"4","year":"2014","journal-title":"Sensors"},{"key":"ref_12","unstructured":"Fukui, H., Yamashita, T., Yamauchi, Y., Fujiyoshi, H., and Murase, H. (July, January 28). Pedestrian detection based on deep convolutional neural network with ensemble inference network. Proceedings of the IEEE Intelligent Vehicles Symposium, Seoul, Korea."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Angelova, A., Krizhevsky, A., Vanhoucke, V., Ogale, A., and Ferguson, D. (2015, January 7\u201310). Real-time pedestrian detection with deep network cascades. Proceedings of the 26th British Machine Vision Conference, Swansea, UK.","DOI":"10.5244\/C.29.32"},{"key":"ref_14","first-page":"83","article-title":"Human detection in hours of darkness using Gaussian mixture model algorithm","volume":"4","author":"Komagal","year":"2014","journal-title":"Int. J. Inform. Sci. Tech."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/TITS.2004.838222","article-title":"Pedestrian detection and tracking with night vision","volume":"6","author":"Xu","year":"2005","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Paw\u0142owski, P., Piniarski, K., and D\u0105browski, A. (2015, January 23\u201325). Pedestrian detection in low resolution night vision images. Proceedings of the IEEE Signal Processing: Algorithms, Architectures, Arrangements, and Applications, Pozna\u0144, Poland.","DOI":"10.1109\/SPA.2015.7365157"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, W., Zhang, J., and Shen, C. (2010, January 26\u201329). Improved human detection and classification in thermal images. Proceedings of the IEEE International Conference on Image Processing, Hong Kong, China.","DOI":"10.1109\/ICIP.2010.5649946"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, W., Wang, Y., Chen, F., and Sowmya, A. (2013, January 15\u201317). A weakly supervised approach for object detection based on soft-label boosting. Proceedings of the IEEE Workshop on Applications of Computer Vision, Tampa, FL, USA.","DOI":"10.1109\/WACV.2013.6475037"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, W., Zheng, D., Zhao, T., and Yang, M. (2012, January 29\u201331). An effective approach to pedestrian detection in thermal imagery. Proceedings of the International Conference on Natural Computation, Chongqing, China.","DOI":"10.1109\/ICNC.2012.6234621"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Neagoe, V.-E., Ciotec, A.-D., and Barar, A.-P. (2012, January 21\u201323). A concurrent neural network approach to pedestrian detection in thermal imagery. Proceedings of the International Conference on Communications, Bucharest, Romania.","DOI":"10.1109\/ICComm.2012.6262539"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Olmeda, D., Armingol, J.M., and Escalera, A.D.L. (2012, January 7\u201312). Discrete features for rapid pedestrian detection in infrared images. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6385928"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lin, C.-F., Lin, S.-F., Hwang, C.-H., and Chen, Y.-C. (2014, January 12\u201315). Real-time pedestrian detection system with novel thermal features at night. Proceedings of the IEEE International Instrumentation and Measurement Technology Conference, Montevideo, Uruguay.","DOI":"10.1109\/I2MTC.2014.6860962"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"347","DOI":"10.3233\/ICA-130441","article-title":"Pedestrian detection in far infrared images","volume":"20","author":"Olmeda","year":"2013","journal-title":"Integr. Comput. Aided Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"6763","DOI":"10.3390\/s150306763","article-title":"Human detection based on the generation of a background image by using a far-infrared light camera","volume":"15","author":"Jeon","year":"2015","journal-title":"Sensors"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jeon, E.S., Kim, J.H., Hong, H.G., Batchuluun, G., and Park, K.R. (2016). Human detection based on the generation of a background image and fuzzy system by using a thermal camera. Sensors, 16.","DOI":"10.3390\/s16040453"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1606","DOI":"10.4304\/jcp.5.10.1606-1613","article-title":"Real time pedestrian tracking using thermal infrared imagery","volume":"5","author":"Li","year":"2010","journal-title":"J. Comput."},{"key":"ref_27","unstructured":"Chen, Y., and Han, C. (2008, January 25\u201327). Night-time pedestrian detection by visual-infrared video fusion. Proceedings of the 7th World Congress on Intelligent Control and Automation, Chongqing, China."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1016\/j.patcog.2007.05.017","article-title":"A real-time object detecting and tracking system for outdoor night surveillance","volume":"41","author":"Huang","year":"2008","journal-title":"Pattern Recognit."},{"key":"ref_29","unstructured":"Nazib, A., Oh, C.-M., and Lee, C.W. (November, January 31). Object detection and tracking in night time video surveillance. Proceedings of the 10th International Conference on Ubiquitous Robots and Ambient Intelligence, Jeju island, Korea."},{"key":"ref_30","unstructured":"(2016, August 26). Tau 2. Available online: http:\/\/www.flir.com\/cores\/display\/?id=54717."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1109\/TITS.2009.2018961","article-title":"Real-time pedestrian detection and tracking at nighttime for driver-assistance systems","volume":"10","author":"Ge","year":"2009","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_32","unstructured":"Gonzalez, R.C., and Woods, R.E. (2010). Digital Image Processing, Prentice Hall. [3rd ed.]."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.1109\/TIP.2005.864170","article-title":"Exact histogram specification","volume":"15","author":"Coltuc","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","unstructured":"Coltuc, D., and Bolon, P. (1999, January 24\u201328). Strict ordering on discrete images and applications. Proceedings of the IEEE International Conference on Image Processing, Kobe, Japan."},{"key":"ref_35","unstructured":"Jen, T.-C., Hsieh, B., and Wang, S.-J. (2005, January 11\u201314). Image contrast enhancement based on intensity-pair distribution. Proceedings of the IEEE International Conference on Image Processing, Genova, Italy."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3967","DOI":"10.1109\/TIP.2012.2198667","article-title":"Content-aware dark image enhancement through channel division","volume":"21","author":"Rivera","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1109\/TCE.2007.381734","article-title":"A dynamic histogram equalization for image contrast enhancement","volume":"53","author":"Chae","year":"2007","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, L., Wang, R., Wang, W., and Gao, W. (2015, January 27\u201330). A low-light image enhancement method for both denoising and contrast enlarging. Proceedings of the IEEE International Conference on Image Processing, Qu\u00e9bec City, QC, Canada.","DOI":"10.1109\/ICIP.2015.7351501"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Malm, H., Oskarsson, M., Warrant, E., Clarberg, P., Hasselgren, J., and Lejdfors, C. (2007, January 14\u201320). Adaptive enhancement and noise reduction in very low light-level video. Proceedings of the IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4409007"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1504\/IJBM.2016.082597","article-title":"Application of geometry to RGB images for facial landmark localization\u2014A preliminary approach","volume":"8","author":"Vezzetti","year":"2016","journal-title":"Int. J. Biometrics"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Marcolin, F., and Vezzetti, E. (2016). Novel descriptors for geometrical 3D face analysis. Multimedia Tools Appl., 1\u201330.","DOI":"10.1007\/s11042-016-3741-3"},{"key":"ref_42","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hajizadeh, M.A., and Ebrahimnezhad, H. (2011, January 16\u201317). Classification of age groups from facial image using histograms of oriented gradients. Proceedings of the 7th Iranian Conference on Machine Vision and Image Processing, Iran University of Science and Technology (IUST), Tehran, Iran.","DOI":"10.1109\/IranianMVIP.2011.6121582"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Karaaba, M., Surinta, O., Schomaker, L., and Wiering, M.A. (2015, January 7\u201310). Robust face recognition by computing distances from multiple histograms of oriented gradients. Proceedings of the IEEE Symposium Series on Computational Intelligence, Cape Town International Convention Center, Cape Town, South Africa.","DOI":"10.1109\/SSCI.2015.39"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Cao, L., Dikmen, M., Fu, Y., and Huang, T.S. (2008, January 26\u201331). Gender recognition from body. Proceedings of the 16th ACM International Conference on Multimedia, Vancouver, BC, Canada.","DOI":"10.1145\/1459359.1459470"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Nguyen, D.T., and Park, K.R. (2016). Body-based gender recognition using images from visible and thermal cameras. Sensors, 16.","DOI":"10.3390\/s16020156"},{"key":"ref_47","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems 25, Curran Associates, Inc."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Taigman, Y., Yang, M., Ranzato, M.A., and Wolf, L. (2014, January 23\u201328). Deepface: Closing the gap to human-level performance in face verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.220"},{"key":"ref_50","unstructured":"(2017, February 20). Convolutional Neural Networks. Available online: http:\/\/www.mathworks.com\/help\/nnet\/convolutional-neural-networks.html."},{"key":"ref_51","unstructured":"(2017, February 23). CS231n Convolutional Neural Networks for Visual Recognition. Available online: http:\/\/cs231n.github.io\/convolutional-networks\/#overview."},{"key":"ref_52","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very deep convolutional networks for large-scale image recognition. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., and Reed, S. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_54","unstructured":"(2017, February 28). Convolutional Neural Network. Available online: https:\/\/en.wikipedia.org\/wiki\/Convolutional_neural_network."},{"key":"ref_55","unstructured":"Heaton, J. (2015). Artificial Intelligence for Humans. Deep Learning and Neural Networks, Heaton Research, Inc."},{"key":"ref_56","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified linear units improve restricted boltzmann machines. Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel."},{"key":"ref_57","unstructured":"Glorot, X., Bordes, A., and Bengio, Y. (2011, January 11\u201313). Deep sparse rectifier neural networks. Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA."},{"key":"ref_58","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_59","unstructured":"(2017, February 28). Dongguk Night-Time Human Detection Database (DNHD-DB1). Available online: http:\/\/dm.dgu.edu\/link.html."},{"key":"ref_60","unstructured":"(2017, February 28). Webcam C600. Available online: http:\/\/www.logitech.com\/en-us\/support\/5869."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Hwang, S., Park, J., Kim, N., Choi, Y., and Kweon, I.S. (2015, January 7\u201312). Multispectral pedestrian detection: Benchmark dataset and baseline. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298706"},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez, A., Fang, Z., Socarras, Y., Serrat, J., V\u00e1zquez, D., Xu, J., and L\u00f3pez, A.M. (2016). Pedestrian detection at day\/night time with visible and FIR cameras: A comparison. Sensors, 16.","DOI":"10.3390\/s16060820"},{"key":"ref_63","unstructured":"(2017, February 20). Intel\u00ae Core\u2122 i7-6700 Processor. Available online: http:\/\/ark.intel.com\/products\/88196\/Intel-Core-i7-6700-Processor-8M-Cache-up-to-4_00-GHz."},{"key":"ref_64","unstructured":"(2017, February 20). GeForce GTX TITAN X. Available online: http:\/\/www.geforce.com\/hardware\/desktop-gpus\/geforce-gtx-titan-x\/specifications."},{"key":"ref_65","unstructured":"(2017, February 28). Stochastic Gradient Descent. Available online: https:\/\/en.wikipedia.org\/wiki\/Stochastic_gradient_descent."},{"key":"ref_66","unstructured":"(2017, February 28). TrainingOptions. Available online: http:\/\/kr.mathworks.com\/help\/nnet\/ref\/trainingoptions.html."},{"key":"ref_67","unstructured":"(2017, February 28). Precision and Recall. Available online: https:\/\/en.wikipedia.org\/wiki\/Precision_and_recall."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/5\/1065\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:35:02Z","timestamp":1760207702000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/5\/1065"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5,8]]},"references-count":67,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2017,5]]}},"alternative-id":["s17051065"],"URL":"https:\/\/doi.org\/10.3390\/s17051065","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,5,8]]}}}