{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T12:55:26Z","timestamp":1783428926054,"version":"3.54.6"},"reference-count":49,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2020,4,2]],"date-time":"2020-04-02T00:00:00Z","timestamp":1585785600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Thermal cameras are popular in detection for their precision in surveillance in the dark and for privacy preservation. In the era of data driven problem solving approaches, manually finding and annotating a large amount of data is inefficient in terms of cost and effort. With the introduction of transfer learning, rather than having large datasets, a dataset covering all characteristics and aspects of the target place is more important. In this work, we studied a large thermal dataset recorded for 20 weeks and identified nine phenomena in it. Moreover, we investigated the impact of each phenomenon for model adaptation in transfer learning. Each phenomenon was investigated separately and in combination. the performance was analyzed by computing the F1 score, precision, recall, true negative rate, and false negative rate. Furthermore, to underline our investigation, the trained model with our dataset was further tested on publicly available datasets, and encouraging results were obtained. Finally, our dataset was also made publicly available.<\/jats:p>","DOI":"10.3390\/s20071982","type":"journal-article","created":{"date-parts":[[2020,4,2]],"date-time":"2020-04-02T11:57:14Z","timestamp":1585828634000},"page":"1982","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["The Effect of a Diverse Dataset for Transfer Learning in Thermal Person Detection"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2096-6200","authenticated-orcid":false,"given":"Noor Ul","family":"Huda","sequence":"first","affiliation":[{"name":"Visual Analysis of People Lab, Aalborg University, Rendsburggade 14, 9000 Aalborg, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9122-9526","authenticated-orcid":false,"given":"Bolette D.","family":"Hansen","sequence":"additional","affiliation":[{"name":"Visual Analysis of People Lab, Aalborg University, Rendsburggade 14, 9000 Aalborg, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8016-2426","authenticated-orcid":false,"given":"Rikke","family":"Gade","sequence":"additional","affiliation":[{"name":"Visual Analysis of People Lab, Aalborg University, Rendsburggade 14, 9000 Aalborg, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas B.","family":"Moeslund","sequence":"additional","affiliation":[{"name":"Visual Analysis of People Lab, Aalborg University, Rendsburggade 14, 9000 Aalborg, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,4,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Hwang, S., Park, J., Kim, N., Choi, Y., and So Kweon, I. (2015, January 7\u201312). Multispectral pedestrian detection: Benchmark dataset and baseline. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298706"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Li, W., Zheng, D., Zhao, T., and Yang, M. (2012, January 29\u201331). An effective approach to pedestrian detection in thermal imagery. Proceedings of the International Conference on Natural Computation, Chongqing, China.","DOI":"10.1109\/ICNC.2012.6234621"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Teutsch, M., Mueller, T., Huber, M., and Beyerer, J. (2014, January 24\u201327). Low resolution person detection with a moving thermal infrared camera by hot spot classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.40"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhang, H., Zhao, B., Tang, L., and Li, J. (2009, January 17\u201319). Variational based contour tracking in infrared imagery. Proceedings of the International Congress on Image and Signal Processing, Tianjin, China.","DOI":"10.1109\/CISP.2009.5303802"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Herrmann, C., M\u00fcller, T., Willersinn, D., and Beyerer, J. (2016). Real-Time Person Detection in Low-Resolution Thermal Infrared Imagery with MSER and CNNs, SPIE.","DOI":"10.1117\/12.2240940"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tumas, P., Jonkus, A., and Serackis, A. (2018, January 26). Acceleration of HOG based pedestrian detection in FIR camera video stream. Proceedings of the IEEE Open Conference of Electrical, Electronic and Information Sciences (eStream), Vilnius, Lithuania.","DOI":"10.1109\/eStream.2018.8394126"},{"key":"ref_7","first-page":"060403","article-title":"Pedestrian detection at night using deep neural networks and saliency maps","volume":"2018","author":"Heo","year":"2018","journal-title":"Electron. Imaging"},{"key":"ref_8","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8\u201316). SSD: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Cioppa, A., Deli\u00e8ge, A., and Van Droogenbroeck, M. (2018, January 18\u201322). A bottom-up approach based on semantics for the interpretation of the main camera stream in soccer games. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00229"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 24\u201327). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_14","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"the pascal visual object classes (voc) challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Weiss, K., Khoshgoftaar, T.M., and Wang, D. (2016). A survey of transfer learning. J. Big Data.","DOI":"10.1186\/s40537-016-0043-6"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Davis, J.W., and Keck, M.A. (2005, January 5\u20137). A two-stage template approach to person detection in thermal imagery. Proceedings of the IEEE Workshops on Applications of Computer Vision, Breckenridge, CO, USA.","DOI":"10.1109\/ACVMOT.2005.14"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"15861","DOI":"10.1007\/s11042-018-6974-5","article-title":"A new thermal infrared and visible spectrum images based pedestrian detection system","volume":"78","author":"Lahmyed","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.cviu.2006.06.010","article-title":"Background-subtraction using contour based fusion of thermal and visible imagery","volume":"106","author":"Davis","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_21","unstructured":"(2019, June 26). Video Analytics Dataset. Available online: https:\/\/www.ino.ca\/en\/technologies\/video-analytics-dataset\/."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.cviu.2011.10.006","article-title":"An iterative integrated framework for thermal\u2013visible image registration, sensor fusion, and people tracking for video surveillance applications","volume":"116","author":"Torabi","year":"2012","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Fritz, K., K\u00f6nig, D., Klauck, U., and Teutsch, M. (2019). Generalization Ability of Region Proposal Networks for Multispectral Person Detection, SPIE Defense + Commercial Sensing.","DOI":"10.1117\/12.2520705"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1109\/TPAMI.2011.155","article-title":"Pedestrian detection: An evaluation of the state of the art","volume":"34","author":"Dollar","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, S., Benenson, R., and Schiele, B. (2017, January 21\u201326). CityPersons: A diverse dataset for pedestrian detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.474"},{"key":"ref_26","unstructured":"Socarras, Y., Ramos, S., V\u00e1zquez, D., L\u00f3pez, A., and Gevers, T. (2013, January 1\u20138). Adapting pedestrian detection from synthetic to far infrared images. Proceedings of the International Conference on Computer Vision (ICCV) Workshop, Sydney, Australia."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ha, Q., Watanabe, K., Karasawa, T., Ushiku, Y., and Harada, T. (2017, January 24\u201328). MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206396"},{"key":"ref_28","unstructured":"Li, C., Song, D., Tong, R., and Tang, M. (2018, January 3\u20136). Multispectral pedestrian detection via simultaneous detection and segmentation. Proceedings of the British Machine Vision Conference (BMVC), Newcastle, UK."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"331","DOI":"10.3390\/app4030331","article-title":"Selection of a visible-light vs. thermal infrared sensor in dynamic environments based on confidence measures","volume":"4","author":"Cuerda","year":"2014","journal-title":"Appl. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s00138-013-0570-5","article-title":"Thermal cameras and applications: A survey","volume":"25","author":"Gade","year":"2013","journal-title":"Mach. Vis. Appl."},{"key":"ref_31","unstructured":"Dai, C., Zheng, Y., and Li, X. (2005, January 20\u201326). Layered representation for pedestrian detection and tracking in infrared imagery. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Miezianko, R., and Pokrajac, D. (2008, January 23\u201328). People detection in low resolution infrared videos. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Anchorage, AK, USA.","DOI":"10.1109\/CVPRW.2008.4563056"},{"key":"ref_33","unstructured":"Jungling, K., and Arens, M. (2009, January 20\u201325). Feature based person detection beyond the visible spectrum. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Miami, FL, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Teutsch, M., and M\u00fcller, T. (2013). Hot spot detection and classification in LWIR videos for person recognition. Automatic Target Recognition XXIII, SPIE.","DOI":"10.1117\/12.2015754"},{"key":"ref_35","unstructured":"Wang, J., Bebis, G., and Miller, R. (2006, January 17\u201322). Robust video based surveillance by integrating target detection with tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshop, New York, NY, USA."},{"key":"ref_36","unstructured":"Zhang, L., Wu, B., and Nevatia, R. (2007, January 18\u201323). Pedestrian detection in infrared images based on local shape features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, USA."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Gade, R., J\u00f8rgensen, A., and Moeslund, T.B. (2013, January 23\u201328). Long-term occupancy analysis using Graph-Based Optimisation in thermal imagery. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.474"},{"key":"ref_38","unstructured":"Gade, R., J\u00f8rgensen, A., and Moeslund, T.B. (2012, January 24\u201326). Occupancy analysis of sports arenas using thermal imaging. Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP), Rome, Italy."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Huda, N., Jensen, K., Gade, R., and Moeslund, T. (2018, January 18\u201322). Estimating the Number of Soccer Players using Simulation based Occlusion Handling. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00236"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Gade, R., and Moeslund, T.B. (2018). Constrained multi-target tracking for team sports activities. IPSJ Trans. Comput. Vis. Appl.","DOI":"10.1186\/s41074-017-0038-z"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1007\/s11263-016-0901-x","article-title":"Multi-modal rgb\u2013depth\u2013thermal human body segmentation","volume":"118","author":"Palmero","year":"2016","journal-title":"Int. J. Comput. Vis."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez, A., Fang, Z., Socarras, Y., Serrat, J., V\u00e1zquez, D., Xu, J., and L\u00f3pez, A.M. (2016). Pedestrian detection at day\/night time with visible and FIR cameras: A comparison. Sensors, 16.","DOI":"10.3390\/s16060820"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1044","DOI":"10.1007\/s11263-018-01141-5","article-title":"Online mutual foreground segmentation for multispectral stereo videos","volume":"127","author":"Bilodeau","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_44","unstructured":"Portmann, J., Lynen, S., Chli, M., and Siegwart, R. (June, January 31). People detection and tracking from aerial thermal views. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China."},{"key":"ref_45","unstructured":"Olmeda, D., Premebida, C., Nunes, U., Armingol, J.M., and Escalera, A.d.l. (2019). LSI far Infrared Pedestrian Dataset, Universidad Carlos III de Madrid."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Wu, Z., Fuller, N.W., Theriault, D.H., and Betke, M. (2014, January 23\u201328). A thermal infrared video benchmark for visual analysis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.39"},{"key":"ref_47","unstructured":"Felsberg, M., Berg, A., Hager, G., Ahlberg, J., Kristan, M., Matas, J., Leonardis, A., Cehovin, L., Fernandez, G., and Vojir, T. (2015, January 7\u201313). The thermal infrared visual object tracking VOT-TIR2015 challenge results. Proceedings of the IEEE International Conference on Computer Vision Workshops, Santiago, CH, USA."},{"key":"ref_48","unstructured":"(2019, November 03). Image Labeler MATLAB 2019. Available online: http:\/\/web.archive.org\/web\/20080207010024\/http:\/\/www.808multimedia.com\/winnt\/kernel.htmhttps:\/\/www.mathworks.com\/help\/vision\/ug\/get-started-with-the-image-labeler.html."},{"key":"ref_49","unstructured":"Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014). How transferable are features in deep neural networks?. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/7\/1982\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:14:30Z","timestamp":1760174070000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/7\/1982"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,2]]},"references-count":49,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["s20071982"],"URL":"https:\/\/doi.org\/10.3390\/s20071982","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,2]]}}}