{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,9]],"date-time":"2025-05-09T04:06:06Z","timestamp":1746763566821,"version":"3.40.5"},"reference-count":20,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2025,1,26]],"date-time":"2025-01-26T00:00:00Z","timestamp":1737849600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,26]],"date-time":"2025-01-26T00:00:00Z","timestamp":1737849600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Open Access funding provided by Aoyama Gakuin University."}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Life Robotics"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>In this study, facial skin temperature distribution (FSTD) is focused on as a new driver monitoring index. FSTD is an autonomic index that can be measured remotely. Studies have been conducted to estimate drowsiness based on FSTD using modelng methods such as CNN, a type of deep learning, and sparse modeling, which can be trained with a small amount of data. These studies, however, only evaluated front-facing facial thermal images. FaceMesh is a model that extracts 478 3D facial feature landmarks from a 2D face image. In contrast to conventional models that extract only 68 facial feature landmarks, FaceMesh can extract facial feature landmarks for the entire face, including the cheeks, forehead, and other areas of the face that are in the blind spots. This study aims to improve the accuracy of drowsiness estimation by applying FaceMesh to automatically detect tilted faces and not including tilted images in the training data. As a result, the method proposed in this study improved drowsiness estimation accuracy by about 6% compared to the old method, which did not take face orientation into account.<\/jats:p>","DOI":"10.1007\/s10015-024-01001-1","type":"journal-article","created":{"date-parts":[[2025,1,26]],"date-time":"2025-01-26T14:22:20Z","timestamp":1737901340000},"page":"317-324","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Reducing the effect of face orientation using FaceMesh landmarks in drowsiness estimation based on facial thermal images"],"prefix":"10.1007","volume":"30","author":[{"given":"Ayaka","family":"Nomura","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Atsushi","family":"Yoshida","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kent","family":"Nagumo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Akio","family":"Nozawa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,1,26]]},"reference":[{"issue":"4","key":"1001_CR1","first-page":"240","volume":"60","author":"M Kobayashi","year":"2017","unstructured":"Kobayashi M (2017) Legal issues of autonomous vehicles. J Inf Process Manag 60(4):240\u2013250","journal-title":"J Inf Process Manag"},{"key":"1001_CR2","unstructured":"Ministry of Land, Infrastructure, Transport and Tourism. https:\/\/www.forum8.co.jp\/fair\/df\/2020\/movie-ppt\/day1-l04.pdf (Referenced on 2023\/12\/10)"},{"issue":"1\u20132","key":"1001_CR3","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.autneu.2006.04.006","volume":"130","author":"Z Shinar","year":"2006","unstructured":"Shinar Z, Akselrod S, Dagan Y, Baharav A (2006) Autonomic changes during wake-sleep transition: a heart rate variability based approach. Auton Neurosci 130(1\u20132):17\u201327","journal-title":"Auton Neurosci"},{"issue":"12","key":"1001_CR4","doi-asserted-by":"publisher","first-page":"2726","DOI":"10.1109\/TCSI.2005.857555","volume":"52","author":"C-T Lin","year":"2005","unstructured":"Lin C-T, Ruei-Cheng W, Liang S-F, Chao W-H, Chen Y-J, Jung T-P (2005) EEG-based drowsiness estimation for safety driving using independent component analysis. IEEE Trans Circuits Syst I Regul Pap 52(12):2726\u20132738","journal-title":"IEEE Trans Circuits Syst I Regul Pap"},{"issue":"3","key":"1001_CR5","first-page":"409","volume":"140","author":"A Masaki","year":"2020","unstructured":"Masaki A, Nagumo K, Nozawa A (2020) Drowsiness estimation model based on hemodynamics. IEEJ Trans Electron Inf Syst 140(3):409\u2013410","journal-title":"IEEJ Trans Electron Inf Syst"},{"key":"1001_CR6","first-page":"93","volume":"21","author":"O Takuhiro","year":"2016","unstructured":"Takuhiro O (2016) Development of drowsiness state estimation and driver status monitor using image sensors. Denso Tech Rev 21:93\u2013102","journal-title":"Denso Tech Rev"},{"issue":"1","key":"1001_CR7","first-page":"11","volume":"67","author":"M Sunagawa","year":"2021","unstructured":"Sunagawa M, Shikii S, Nakai W, Mochizuki M, Yoshioka M, Kitajima H (2021) Highly accurate driver drowsiness estimation by fusing blink and posture information (distinguishing all stages from weak to strong drowsiness). Panason Tech 67(1):11\u201316","journal-title":"Panason Tech"},{"key":"1001_CR8","doi-asserted-by":"crossref","unstructured":"Grace R, Byrne VE, Bierman DM, Legrand JM, Gricourt D, Davis BK, Staszewski JJ, Carnahan B (1998) A drowsy driver detection system for heavy vehicles. In: 17th DASC. AIAA\/IEEE\/SAE. Digital Avionics Systems Conference. Proceedings, No. 98CH36267, vol 2, pp I36-1\u2013I36\/8, IEEE","DOI":"10.1109\/DASC.1998.739878"},{"key":"1001_CR9","doi-asserted-by":"crossref","unstructured":"Danisman T, Bilasco IM, Djeraba C, Ihaddadene N (2010) Drowsy driver detection system using eye blink patterns. In: 2010 International conference on machine and web intelligence. IEEE, pp 230\u2013233","DOI":"10.1109\/ICMWI.2010.5648121"},{"issue":"S1","key":"1001_CR10","doi-asserted-by":"publisher","first-page":"S104","DOI":"10.1002\/tee.22423","volume":"12","author":"S Bando","year":"2017","unstructured":"Bando S, Oiwa K, Nozawa A (2017) Evaluation of dynamics of forehead skin temperature under induced drowsiness. IEEJ Trans Electr Electron Eng 12(S1):S104\u2013S109","journal-title":"IEEJ Trans Electr Electron Eng"},{"issue":"2","key":"1001_CR11","doi-asserted-by":"publisher","first-page":"64","DOI":"10.4236\/jbbs.2024.142006","volume":"14","author":"B Amin","year":"2024","unstructured":"Amin B, Abdessalem HB, Frasson C (2024) The relation between mental workload and face temperature in flight simulation. J Behav Brain Sci 14(2):64\u201392","journal-title":"J Behav Brain Sci"},{"issue":"6","key":"1001_CR12","doi-asserted-by":"publisher","first-page":"870","DOI":"10.1002\/tee.22876","volume":"14","author":"H Adachi","year":"2019","unstructured":"Adachi H, Oiwa K, Nozawa A (2019) Drowsiness level modeling based on facial skin temperature distribution using a convolutional neural network. IEEJ Trans Electr Electron Eng 14(6):870\u2013876","journal-title":"IEEJ Trans Electr Electron Eng"},{"key":"1001_CR13","unstructured":"Yoshida A, Torii T, Nagumo K, Oiwa K, Nozawa A (2021) An attempt of sparse modeling for facial skin temperature distribution related to drowsiness. IEEJ Measurement\/Perception Information Study Group, IM-21-025, PI-21-063 (2021)"},{"issue":"4","key":"1001_CR14","doi-asserted-by":"publisher","first-page":"771","DOI":"10.1007\/s10015-023-00898-4","volume":"28","author":"Atsushi Yoshida","year":"2023","unstructured":"Yoshida Atsushi, Oiwa Kosuke, Nozawa Akio (2023) The optimization of sparse modeling for drowsiness estimation based on general facial skin temperature distribution. Artif Life Robot 28(4):771\u2013778","journal-title":"Artif Life Robot"},{"key":"1001_CR15","unstructured":"Ito A, Oiwa K, Nozawa A (2022) Robust modeling of blood pressure estimation based on facial thermal images under variable measurement conditions. IEEJ Electronics, Information and Systems, GS9-4 (2022)"},{"key":"1001_CR16","unstructured":"Nakamura R, Nagumo K, Oiwa K, Nozawa A (2021) Estimation of hemodynamics based on facial thermal images using sparse cording. IEEJ Electronics, Information and Systems, GS11-1"},{"key":"1001_CR17","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1007\/s10015-022-00831-1","volume":"28","author":"T Hattori","year":"2022","unstructured":"Hattori T, Nagumo K, Oiwa K, Nozawa A (2022) Attempt to extract features and classify subjective poor physical conditions in facial images using deep metric learning. Artif Life Robot 28:381\u2013387","journal-title":"Artif Life Robot"},{"issue":"4","key":"1001_CR18","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1007\/s10015-021-00703-0","volume":"26","author":"K Nagumo","year":"2021","unstructured":"Nagumo K, Oiwa K, Nozawa A (2021) Spatial normalization of facial thermal images using facial landmarks. Artif Life Robot 26(4):481\u2013487","journal-title":"Artif Life Robot"},{"key":"1001_CR19","unstructured":"Kartynnik Y, Ablavatski A, Grishchenko I, Grundmann M (2019) Real-time facial surface geometry from monocular video on mobile GPUs"},{"issue":"613","key":"1001_CR20","first-page":"93","volume":"63","author":"H Kitajima","year":"1997","unstructured":"Kitajima H, Numata N, Yamamoto K, Goi Y (1997) Prediction of automobile driver sleepiness (1st resort, rating of sleepiness based on facial expression and examination of effective predictor indexes of sleepiness). Trans Jpn Soc Mech Eng (C edition) 63(613):93\u2013100","journal-title":"Trans Jpn Soc Mech Eng (C edition)"}],"container-title":["Artificial Life and Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10015-024-01001-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10015-024-01001-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10015-024-01001-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,8]],"date-time":"2025-05-08T19:38:20Z","timestamp":1746733100000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10015-024-01001-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,26]]},"references-count":20,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["1001"],"URL":"https:\/\/doi.org\/10.1007\/s10015-024-01001-1","relation":{},"ISSN":["1433-5298","1614-7456"],"issn-type":[{"type":"print","value":"1433-5298"},{"type":"electronic","value":"1614-7456"}],"subject":[],"published":{"date-parts":[[2025,1,26]]},"assertion":[{"value":"14 May 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 November 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 January 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 February 2025","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Open access funding information has been updated","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}}]}}