{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T11:09:11Z","timestamp":1770548951276,"version":"3.49.0"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T00:00:00Z","timestamp":1600819200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T00:00:00Z","timestamp":1600819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004281","name":"Narodowe Centrum Nauki","doi-asserted-by":"publisher","award":["2014\/15\/B\/ST6\/00609"],"award-info":[{"award-number":["2014\/15\/B\/ST6\/00609"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In recent years many methods have been proposed for eye detection. In some cases however, such as driver drowsiness detection, lighting conditions are so challenging that only the thermal imaging is a robust alternative to the visible light sensors. However, thermal images suffer from poor contrast and high noise, which arise due to the physical properties of the long waves processing. In this paper we propose an efficient method for eyes detection based on thermal image processing which can be successfully used in challenging environments. Image pre-processing with novel virtual high dynamic range procedure is proposed, which greatly enhances thermal image contrast and allows for more reliable computation of sparse image descriptors. The bag-of-visual-words approach with clustering was selected for final detections. We compare our method with the YOLOv3 deep learning model. Our method attains high accuracy and fast response in real conditions without computational complexity and requirement of a big dataset associated with the deep neural networks. For quantitative analysis a series of thermal video sequences were recorded in which eye locations were manually annotated. Created dataset was made publicly available on our website.<\/jats:p>","DOI":"10.1007\/s11042-020-09403-6","type":"journal-article","created":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T07:02:36Z","timestamp":1600844556000},"page":"3601-3621","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Fast eyes detection in thermal images"],"prefix":"10.1007","volume":"80","author":[{"given":"Mateusz","family":"Knapik","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5185-1145","authenticated-orcid":false,"given":"Bogus\u0142aw","family":"Cyganek","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,9,23]]},"reference":[{"key":"9403_CR1","doi-asserted-by":"crossref","unstructured":"Abualigah L, Shehab M, Alshinwan M, Alabool H (2019) Salp swarm algorithm: a comprehensive survey. Neural Comput Applic, pp 1\u201321","DOI":"10.1007\/s00521-019-04629-4"},{"issue":"1","key":"9403_CR2","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3233\/IDT-170318","volume":"12","author":"LM Abualigah","year":"2018","unstructured":"Abualigah LM, Khader AT, Hanandeh ES (2018) A hybrid strategy for krill herd algorithm with harmony search algorithm to improve the data clustering. Intel Decision Technol 12(1):3\u201314","journal-title":"Intel Decision Technol"},{"key":"9403_CR3","doi-asserted-by":"crossref","unstructured":"Alam F, Mehmood R, Katib I, Altowaijri SM, Albeshri A (2019) Taawun: a decision fusion and feature specific road detection approach for connected autonomous vehicles. Mobile Networks and Applications, pp 1\u201317","DOI":"10.1007\/s11036-019-01319-2"},{"key":"9403_CR4","doi-asserted-by":"publisher","unstructured":"Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2d pose estimation using part affinity fields 2017. In: IEEE conference on computer vision and pattern recognition (CVPR). https:\/\/doi.org\/10.1109\/cvpr.2017.143","DOI":"10.1109\/cvpr.2017.143"},{"key":"9403_CR5","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1007\/978-0-387-31439-6_299","volume-title":"Feature Selection","author":"R Chellappa","year":"2014","unstructured":"Chellappa R, Turaga P (2014) Feature Selection. Springer, Boston, pp 291\u2013294. https:\/\/doi.org\/10.1007\/978-0-387-31439-6_299"},{"key":"9403_CR6","doi-asserted-by":"publisher","first-page":"19959","DOI":"10.1109\/ACCESS.2018.2815149","volume":"6","author":"J Chu","year":"2018","unstructured":"Chu J, Guo Z, Leng L (2018) Object detection based on multi-layer convolution feature fusion and online hard example mining. IEEE Access 6:19959\u201319967","journal-title":"IEEE Access"},{"key":"9403_CR7","unstructured":"Csurka G, Dance C, Fan L, Willamowski J, Bray C (2004) Visual categorization with bags of keypoints. In: Workshop on statistical learning in computer vision, ECCV, vol 1, Prague, pp 1\u20132"},{"key":"9403_CR8","doi-asserted-by":"crossref","unstructured":"Cyganek B (2007) Road signs recognition by the scale-space template matching in the log-polar domain. In: Mart\u00ed J, Bened\u00ed JM, Mendon\u00e7a AM, Serrat J. (eds) Pattern recognition and image analysis. Springer, Berlin, pp 330\u2013337","DOI":"10.1007\/978-3-540-72847-4_43"},{"key":"9403_CR9","unstructured":"Cyganek B (2013) Object detection and recognition in digital images: theory and practice. Wiley"},{"key":"9403_CR10","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1016\/j.neucom.2013.01.048","volume":"126","author":"B Cyganek","year":"2014","unstructured":"Cyganek B, Gruszczy\u0144ski S (2014) Hybrid computer vision system for drivers\u2019 eye recognition and fatigue monitoring. Neurocomputing 126:78\u201394","journal-title":"Neurocomputing"},{"key":"9403_CR11","doi-asserted-by":"crossref","unstructured":"Cyganek B, Wo\u017aniak M (2018) Virtual high dynamic range imaging for underwater drone navigation. In: Proceedings of the 6th IIAE international conference on industrial application engineering 2018","DOI":"10.12792\/iciae2018.075"},{"key":"9403_CR12","doi-asserted-by":"crossref","unstructured":"Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: A large-scale hierarchical image database. In: CVPR 09","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"9403_CR13","doi-asserted-by":"crossref","unstructured":"Fan DP, Zhang S, Wu YH, Liu Y, Cheng MM, Ren B, Rosin PL, Ji R (2019) Scoot: A perceptual metric for facial sketches","DOI":"10.1109\/ICCV.2019.00571"},{"key":"9403_CR14","doi-asserted-by":"crossref","unstructured":"Fulkerson B, Vedaldi A, Soatto S (2008) Localizing objects with smart dictionaries. In: Forsyth D, Torr P, Zisserman A (eds) Computer vision \u2013 ECCV 2008. Springer, Berlin, pp 179\u2013192","DOI":"10.1007\/978-3-540-88682-2_15"},{"key":"9403_CR15","doi-asserted-by":"publisher","unstructured":"Ghiass R (2014) Face recognition using infrared vision. Ph.D thesis. https:\/\/doi.org\/10.13140\/2.1.4447.3122","DOI":"10.13140\/2.1.4447.3122"},{"key":"9403_CR16","unstructured":"Ke W, Wang T, Chiu C (2009) Hardware efficient virtual high dynamic range reproduction. 16th IEEE International Conference on Image Processing (ICIP\u201909) pp 2665\u20132668"},{"key":"9403_CR17","doi-asserted-by":"publisher","first-page":"67459","DOI":"10.1109\/ACCESS.2018.2878601","volume":"6","author":"SA Khan","year":"2018","unstructured":"Khan SA, Hussain S, Xiaoming S, Yang S (2018) An effective framework for driver fatigue recognition based on intelligent facial expressions analysis. IEEE Access 6:67459\u201367468","journal-title":"IEEE Access"},{"key":"9403_CR18","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1016\/j.neucom.2019.02.014","volume":"338","author":"M Knapik","year":"2019","unstructured":"Knapik M, Cyganek B (2019) Driver\u2019s fatigue recognition based on yawn detection in thermal images. Neurocomputing 338:274\u2013292","journal-title":"Neurocomputing"},{"key":"9403_CR19","doi-asserted-by":"publisher","unstructured":"Kwa\u015bniewska A, Rumi\u0144ski J, Rad P (2017) Deep features class activation map for thermal face detection and tracking. In: 2017 10Th international conference on human system interactions (HSI), pp 41\u201347. https:\/\/doi.org\/10.1109\/HSI.2017.8004993","DOI":"10.1109\/HSI.2017.8004993"},{"key":"9403_CR20","unstructured":"Lazebnik S, Schmid C, Ponce J (2006)"},{"issue":"1","key":"9403_CR21","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1007\/s11042-015-3058-7","volume":"76","author":"L Leng","year":"2017","unstructured":"Leng L, Li M, Kim C, Bi X (2017) Dual-source discrimination power analysis for multi-instance contactless palmprint recognition. Multimedia Tools and Applications 76(1):333\u2013354","journal-title":"Multimedia Tools and Applications"},{"key":"9403_CR22","unstructured":"Leng L, Zhang J, Khan MK, Chen X, Alghathbar K (2011) Dynamic weighted discrimination power analysis : A novel approach for face and palmprint recognition in dct domain"},{"issue":"4","key":"9403_CR23","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1016\/j.jesp.2013.03.013","volume":"49","author":"C Leys","year":"2013","unstructured":"Leys C, Ley C, Klein O, Bernard P, Licata L (2013) Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. J Exp Soc Psychol 49(4):764\u2013766","journal-title":"J Exp Soc Psychol"},{"issue":"2","key":"9403_CR24","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","volume":"60","author":"DG Lowe","year":"2004","unstructured":"Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vision 60(2):91\u2013110","journal-title":"Int J Comput Vision"},{"key":"9403_CR25","doi-asserted-by":"crossref","unstructured":"Leng L, Zhang J, Jing X, Khan MK, Alghathbar K (2010) Dynamic weighted discrimination power analysis in dct domain for face and palmprint recognition. In: 2010 International conference on information and communication technology convergence (ICTC), pp 467\u2013471","DOI":"10.1109\/ICTC.2010.5674791"},{"key":"9403_CR26","doi-asserted-by":"publisher","first-page":"161584","DOI":"10.1109\/ACCESS.2019.2951468","volume":"7","author":"A Mahmood","year":"2019","unstructured":"Mahmood A, Khan SA, Hussain S, Almaghayreh EM (2019) An adaptive image contrast enhancement technique for low-contrast images. IEEE Access 7:161584\u2013161593","journal-title":"IEEE Access"},{"key":"9403_CR27","doi-asserted-by":"crossref","unstructured":"Malpani SS, Narasimhadhan AC, Thermal AV (2016) Vision human classification and localization using bag of visual word. In: 2016 IEEE Region 10 conference (TENCON), pp 3135\u20133139","DOI":"10.1109\/TENCON.2016.7848627"},{"key":"9403_CR28","doi-asserted-by":"crossref","unstructured":"Marzec M, Lam\u017ca A, Wr\u00f3bel Z, Dziech A (2016) Fast eye localization from thermal images using neural networks. Multimedia Tools and Applications","DOI":"10.1007\/s11042-016-4094-7"},{"issue":"4","key":"9403_CR29","doi-asserted-by":"publisher","first-page":"907","DOI":"10.1080\/14640749108400962","volume":"43","author":"J Miller","year":"1991","unstructured":"Miller J (1991) Short report: Reaction time analysis with outlier exclusion: Bias varies with sample size. The Quarterly Journal of Experimental Psychology Section A 43(4):907\u2013912","journal-title":"The Quarterly Journal of Experimental Psychology Section A"},{"key":"9403_CR30","doi-asserted-by":"publisher","first-page":"1016","DOI":"10.1016\/j.ijleo.2018.01.003","volume":"158","author":"A Munir","year":"2018","unstructured":"Munir A, Hussain A, Khan SA, Nadeem M, Arshid S (2018) Illumination invariant facial expression recognition using selected merged binary patterns for real world images. Optik 158:1016\u20131025. https:\/\/doi.org\/10.1016\/j.ijleo.2018.01.003, http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0030402618300032","journal-title":"Optik"},{"key":"9403_CR31","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","volume":"9","author":"N Otsu","year":"1979","unstructured":"Otsu N (1979) A threshold selection method from gray level histograms. IEEE Trans Systems, Man and Cybernetics 9:62\u201366. Minimize inter class variance","journal-title":"IEEE Trans Systems, Man and Cybernetics"},{"key":"9403_CR32","unstructured":"qqwweee (2018) Keras yolov3. https:\/\/github.com\/qqwweee\/keras-yolo3"},{"key":"9403_CR33","unstructured":"Redmon J, Farhadi A (2018) Yolov3: An incremental improvement"},{"key":"9403_CR34","doi-asserted-by":"crossref","unstructured":"Shehab M, Abualigah L, Al Hamad H, Alabool H, Alshinwan M, Khasawneh AM (2019) Moth\u2013flame optimization algorithm: variants and applications. Neural Comput Applic, pp 1\u201326","DOI":"10.1007\/s00521-019-04570-6"},{"key":"9403_CR35","doi-asserted-by":"crossref","unstructured":"Shehab M, Alshawabkah H, Abualigah L, Nagham AM (2020) Enhanced a hybrid moth-flame optimization algorithm using new selection schemes. Engineering with Computers, pp 1\u201326","DOI":"10.1007\/s00366-020-00971-7"},{"issue":"1","key":"9403_CR36","doi-asserted-by":"publisher","first-page":"4729","DOI":"10.1038\/s41598-019-41172-7","volume":"9","author":"S Sonkusare","year":"2019","unstructured":"Sonkusare S, Ahmedt-Aristizabal D, Aburn MJ, Nguyen VT, Pang T, Frydman S, Denman S, Fookes C, Breakspear M, Guo CC (2019) Detecting changes in facial temperature induced by a sudden auditory stimulus based on deep learning-assisted face tracking. Scientific Reports 9(1):4729","journal-title":"Scientific Reports"},{"issue":"6","key":"9403_CR37","first-page":"199","volume":"61","author":"M Stra\u0327kowska","year":"2015","unstructured":"Stra\u0327kowska M, Stra\u0327kowski R (2015) Automatic eye corners detection and tracking algorithm in sequence of thermal medical images. Measure Autom Monitor 61(6):199\u2013202","journal-title":"Measure Autom Monitor"},{"key":"9403_CR38","doi-asserted-by":"publisher","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision 2016. In: IEEE conference on computer vision and pattern recognition (CVPR). https:\/\/doi.org\/10.1109\/cvpr.2016.308","DOI":"10.1109\/cvpr.2016.308"},{"issue":"10","key":"9403_CR39","doi-asserted-by":"publisher","first-page":"2613","DOI":"10.1016\/j.patcog.2013.03.001","volume":"46","author":"S Wang","year":"2013","unstructured":"Wang S, Liu Z, Shen P, Ji Q (2013) Eye localization from thermal infrared images. Pattern Recogn 46(10):2613\u20132621","journal-title":"Pattern Recogn"},{"key":"9403_CR40","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1007\/978-1-4899-7687-1_101","volume-title":"Feature Selection","author":"S Wang","year":"2017","unstructured":"Wang S, Tang J, Liu H (2017) Feature Selection. Springer, Boston, pp 503\u2013511. https:\/\/doi.org\/10.1007\/978-1-4899-7687-1_101"},{"key":"9403_CR41","doi-asserted-by":"publisher","first-page":"57163","DOI":"10.1109\/ACCESS.2019.2913688","volume":"7","author":"J Zeng","year":"2019","unstructured":"Zeng J, Liu M, Fu X, Gu R, Leng L (2019) Curvature bag of words model for shape recognition. IEEE Access 7:57163\u201357171","journal-title":"IEEE Access"},{"key":"9403_CR42","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1016\/j.knosys.2016.08.018","volume":"111","author":"L Zhang","year":"2016","unstructured":"Zhang L, Mistry K, Neoh SC, Lim CP (2016) Intelligent facial emotion recognition using moth-firefly optimization. Knowledge-Based Systems 111:248\u2013267. https:\/\/doi.org\/10.1016\/j.knosys.2016.08.018, http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0950705116302799","journal-title":"Knowledge-Based Systems"},{"issue":"4","key":"9403_CR43","doi-asserted-by":"publisher","first-page":"1010","DOI":"10.3390\/s20041010","volume":"20","author":"Y Zhang","year":"2020","unstructured":"Zhang Y, Chu J, Leng L, Miao J (2020) Mask-refined r-cnn: a network for refining object details in instance segmentation. Sensors 20(4):1010","journal-title":"Sensors"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-09403-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-020-09403-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-09403-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,22]],"date-time":"2021-09-22T23:45:02Z","timestamp":1632354302000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-020-09403-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,23]]},"references-count":43,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["9403"],"URL":"https:\/\/doi.org\/10.1007\/s11042-020-09403-6","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,23]]},"assertion":[{"value":"27 August 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 June 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 September 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}