{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T15:38:29Z","timestamp":1782833909846,"version":"3.54.5"},"reference-count":84,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,7,4]],"date-time":"2024-07-04T00:00:00Z","timestamp":1720051200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,4]],"date-time":"2024-07-04T00:00:00Z","timestamp":1720051200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis Comput"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Human factors research in transportation relies on naturalistic driving studies (NDS) which collect real-world data from drivers on actual roads. NDS data offer valuable insights into driving behavior, styles, habits, and safety-critical events. However, these data often contain personally identifiable information (PII), such as driver face videos, which cannot be publicly shared due to privacy concerns. To address this, our paper introduces a comprehensive framework for deidentifying drivers\u2019 face videos, that can facilitate the wide sharing of driver face videos while protecting PII. Leveraging recent advancements in generative adversarial networks (GANs), we explore the efficacy of different face swapping algorithms in preserving essential human factors attributes while anonymizing participants\u2019 identities. Most face swapping algorithms are tested in restricted lighting conditions and indoor settings, there is no known study that tested them in adverse and natural situations. We conducted extensive experiments using large-scale outdoor NDS data, evaluating the quantification of errors associated with head, mouth, and eye movements, along with other attributes important for human factors research. Additionally, we performed qualitative assessments of these methods through human evaluators providing valuable insights into the quality and fidelity of the deidentified videos. We propose the utilization of synthetic faces as substitutes for real faces to enhance generalization. Additionally, we created practical guidelines for video deidentification, emphasizing error threshold creation, spot-checking for abrupt metric changes, and mitigation strategies for reidentification risks. Our findings underscore nuanced challenges in balancing data utility and privacy, offering valuable insights into enhancing face video deidentification techniques in NDS scenarios.\n<\/jats:p>","DOI":"10.1007\/s00371-024-03552-7","type":"journal-article","created":{"date-parts":[[2024,7,4]],"date-time":"2024-07-04T03:58:03Z","timestamp":1720065483000},"page":"2563-2594","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A deep dive into enhancing sharing of naturalistic driving data through face deidentification"],"prefix":"10.1007","volume":"41","author":[{"given":"Surendrabikram","family":"Thapa","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abhijit","family":"Sarkar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,7,4]]},"reference":[{"issue":"6","key":"3552_CR1","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1038\/s42256-020-0181-6","volume":"2","author":"N Peiffer-Smadja","year":"2020","unstructured":"Peiffer-Smadja, N., Maatoug, R., Lescure, F.-X., D\u2019ortenzio, E., Pineau, J., King, J.-R.: Machine learning for covid-19 needs global collaboration and data-sharing. Nat. Mach. Intell. 2(6), 293\u2013294 (2020)","journal-title":"Nat. Mach. Intell."},{"issue":"4","key":"3552_CR2","doi-asserted-by":"publisher","first-page":"799","DOI":"10.1017\/S1049096518000926","volume":"51","author":"D Stockemer","year":"2018","unstructured":"Stockemer, D., Koehler, S., Lentz, T.: Data access, transparency, and replication: new insights from the political behavior literature. Pol. Sci. Pol. 51(4), 799\u2013803 (2018)","journal-title":"Pol. Sci. Pol."},{"issue":"1","key":"3552_CR3","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1002\/aris.2011.1440450113","volume":"45","author":"S Kowalczyk","year":"2011","unstructured":"Kowalczyk, S., Shankar, K.: Data sharing in the sciences. Ann. Rev. Inf. Sci. Technol. 45(1), 247\u2013294 (2011)","journal-title":"Ann. Rev. Inf. Sci. Technol."},{"key":"3552_CR4","doi-asserted-by":"crossref","unstructured":"Victor, T., Dozza, M., B\u00e4rgman, J., Boda, C.-N., Engstr\u00f6m, J., Flannagan, C., Lee, J.D., Markkula, G.: Analysis of naturalistic driving study data: Safer glances, driver inattention, and crash risk. Technical report (2015)","DOI":"10.17226\/22297"},{"key":"3552_CR5","doi-asserted-by":"crossref","unstructured":"Thapa, S., Cook, J., Sarkar, A.: Deidentification of drivers\u2019 face videos: scope and challenges in human factors research. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 66, pp. 1509\u20131513 (2022). SAGE Publications Sage CA: Los Angeles, CA","DOI":"10.1177\/1071181322661302"},{"key":"3552_CR6","unstructured":"Thapa, S., Cook, J., Sarkar, A.: Face de-identification of drivers from NDS data and its effectiveness in human factors (2023)"},{"key":"3552_CR7","doi-asserted-by":"crossref","unstructured":"Gross, R., Sweeney, L., Cohn, J., Torre, F., Baker, S.: Face de-identification. Protecting privacy in video surveillance. pp 129\u2013146 (2009)","DOI":"10.1007\/978-1-84882-301-3_8"},{"key":"3552_CR8","doi-asserted-by":"crossref","unstructured":"Gafni, O., Wolf, L., Taigman, Y.: Live face de-identification in video. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision. pp. 9378\u20139387 (2019)","DOI":"10.1109\/ICCV.2019.00947"},{"key":"3552_CR9","doi-asserted-by":"crossref","unstructured":"Ribaric, S., Pavesic, N.: An overview of face de-identification in still images and videos. In: 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) 4, 1\u20136. IEEE (2015)","DOI":"10.1109\/FG.2015.7285017"},{"issue":"3","key":"3552_CR10","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1109\/TCSVT.2011.2105551","volume":"21","author":"P Agrawal","year":"2011","unstructured":"Agrawal, P., Narayanan, P.: Person de-identification in videos. IEEE Trans. Circuits Syst. Video Technol. 21(3), 299\u2013310 (2011)","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"issue":"Suppl","key":"3552_CR11","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1097\/MLR.0b013e3182585355","volume":"50","author":"CA Kushida","year":"2012","unstructured":"Kushida, C.A., Nichols, D.A., Jadrnicek, R., Miller, R., Walsh, J.K., Griffin, K.: Strategies for de-identification and anonymization of electronic health record data for use in multicenter research studies. Med. Care 50(Suppl), 82 (2012)","journal-title":"Med. Care"},{"issue":"3","key":"3552_CR12","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1017\/S0963180114000589","volume":"24","author":"B Kaplan","year":"2015","unstructured":"Kaplan, B.: Selling health data: de-identification, privacy, and speech. Camb. Q. Healthc. Ethics 24(3), 256\u2013271 (2015)","journal-title":"Camb. Q. Healthc. Ethics"},{"key":"3552_CR13","doi-asserted-by":"publisher","unstructured":"Thapa, S., Sarkar, A.: Gan-based deidentification of drivers\u2019 face videos: an assessment of human factors implications in nds data. In: 2023 IEEE Intelligent Vehicles Symposium (IV). pp. 1\u20136 (2023). https:\/\/doi.org\/10.1109\/IV55152.2023.10186646","DOI":"10.1109\/IV55152.2023.10186646"},{"key":"3552_CR14","doi-asserted-by":"crossref","unstructured":"Yadav, D., Salmani, S.: Deepfake: a survey on facial forgery technique using generative adversarial network. In: 2019 International Conference on Intelligent Computing and Control Systems (ICCS), pp. 852\u2013857 (2019). IEEE","DOI":"10.1109\/ICCS45141.2019.9065881"},{"key":"3552_CR15","doi-asserted-by":"crossref","unstructured":"Remya\u00a0Revi, K., Vidya, K., Wilscy, M.: Detection of deepfake images created using generative adversarial networks: a review. In: Second International Conference on Networks and Advances in Computational Technologies: NetACT 19, pp. 25\u201335 (2021). Springer","DOI":"10.1007\/978-3-030-49500-8_3"},{"key":"3552_CR16","doi-asserted-by":"crossref","unstructured":"Zobaed, S., Rabby, F., Hossain, I., Hossain, E., Hasan, S., Karim, A., Md\u00a0Hasib, K.: Deepfakes: detecting forged and synthetic media content using machine learning. Artificial Intelligence in Cyber Security: Impact and Implications: Security Challenges, Technical and Ethical Issues, Forensic Investigative Challenges, 177\u2013201 (2021)","DOI":"10.1007\/978-3-030-88040-8_7"},{"key":"3552_CR17","doi-asserted-by":"crossref","unstructured":"Zhang, T., Deng, L., Zhang, L., Dang, X.: Deep learning in face synthesis: a survey on deepfakes. In: 2020 IEEE 3rd International Conference on Computer and Communication Engineering Technology (CCET), pp. 67\u201370. IEEE (2020)","DOI":"10.1109\/CCET50901.2020.9213159"},{"issue":"2","key":"3552_CR18","doi-asserted-by":"publisher","first-page":"0118053","DOI":"10.1371\/journal.pone.0118053","volume":"10","author":"B Fecher","year":"2015","unstructured":"Fecher, B., Friesike, S., Hebing, M.: What drives academic data sharing? PLoS ONE 10(2), 0118053 (2015)","journal-title":"PLoS ONE"},{"issue":"6","key":"3552_CR19","doi-asserted-by":"publisher","first-page":"21101","DOI":"10.1371\/journal.pone.0021101","volume":"6","author":"C Tenopir","year":"2011","unstructured":"Tenopir, C., Allard, S., Douglass, K., Aydinoglu, A.U., Wu, L., Read, E., Manoff, M., Frame, M.: Data sharing by scientists: practices and perceptions. PLoS ONE 6(6), 21101 (2011)","journal-title":"PLoS ONE"},{"issue":"1","key":"3552_CR20","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1177\/2515245917747656","volume":"1","author":"MN Meyer","year":"2018","unstructured":"Meyer, M.N.: Practical tips for ethical data sharing. Adv. Methods Pract. Psychol. Sci. 1(1), 131\u2013144 (2018)","journal-title":"Adv. Methods Pract. Psychol. Sci."},{"key":"3552_CR21","first-page":"17","volume":"182","author":"C Medical Sciences","year":"2002","unstructured":"Medical Sciences, C., et al.: International ethical guidelines for biomedical research involving human subjects. Bull. Med. Ethics 182, 17\u201323 (2002)","journal-title":"Bull. Med. Ethics"},{"issue":"4","key":"3552_CR22","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1136\/jcp.2005.030957","volume":"59","author":"MB Kapp","year":"2006","unstructured":"Kapp, M.B.: Ethical and legal issues in research involving human subjects: do you want a piece of me? J. Clin. Pathol. 59(4), 335\u2013339 (2006)","journal-title":"J. Clin. Pathol."},{"key":"3552_CR23","unstructured":"U.S. Department of Health and Human Services: 45 CFR 46. https:\/\/www.hhs.gov\/ohrp\/regulations-and-policy\/regulations\/45-cfr-46\/index.html. Accessed June 12, 2023"},{"key":"3552_CR24","volume-title":"Sharing Clinical Trial Data: Maximizing Benefits, Minimizing Risk","author":"I Medicine","year":"2015","unstructured":"Medicine, I.: Sharing Clinical Trial Data: Maximizing Benefits, Minimizing Risk. The National Academies Press, Washington, DC (2015)"},{"issue":"3","key":"3552_CR25","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1016\/j.ijmedinf.2010.10.016","volume":"80","author":"T Neubauer","year":"2011","unstructured":"Neubauer, T., Heurix, J.: A methodology for the pseudonymization of medical data. Int. J. Med. Inf. 80(3), 190\u2013204 (2011)","journal-title":"Int. J. Med. Inf."},{"issue":"12","key":"3552_CR26","doi-asserted-by":"publisher","first-page":"5222","DOI":"10.1109\/TAC.2019.2910171","volume":"64","author":"J He","year":"2019","unstructured":"He, J., Cai, L., Cheng, P., Pan, J., Shi, L.: Consensus-based data-privacy preserving data aggregation. IEEE Trans. Autom. Control 64(12), 5222\u20135229 (2019)","journal-title":"IEEE Trans. Autom. Control"},{"issue":"3","key":"3552_CR27","doi-asserted-by":"publisher","first-page":"1103","DOI":"10.12785\/amis\/080321","volume":"8","author":"Y Xu","year":"2014","unstructured":"Xu, Y., Ma, T., Tang, M., Tian, W.: A survey of privacy preserving data publishing using generalization and suppression. Appl. Math. Inf. Sci. 8(3), 1103 (2014)","journal-title":"Appl. Math. Inf. Sci."},{"key":"3552_CR28","doi-asserted-by":"crossref","unstructured":"Tomashchuk, O., Van\u00a0Landuyt, D., Pletea, D., Wuyts, K., Joosen, W.: A data utility-driven benchmark for de-identification methods. In: Trust, Privacy and Security in Digital Business: 16th International Conference, TrustBus 2019, Linz, Austria, August 26\u201329, 2019, Proceedings 16, pp. 63\u201377 (2019). Springer","DOI":"10.1007\/978-3-030-27813-7_5"},{"key":"3552_CR29","doi-asserted-by":"publisher","unstructured":"Garfinkel, S., et al.: De-identification of personal information, pp. 1\u201354. US Department of Commerce, National Institute of Standards and Technology, Washington, D.C. (2015). https:\/\/doi.org\/10.6028\/NIST.IR.8053. https:\/\/nvlpubs.nist.gov\/nistpubs\/ir\/2015\/NIST.IR.8053.pdf","DOI":"10.6028\/NIST.IR.8053"},{"issue":"5","key":"3552_CR30","first-page":"3976","volume":"8","author":"R Archana","year":"2018","unstructured":"Archana, R., Hegadi, R.S., Manjunath, T.: A study on big data privacy protection models using data masking methods. Int. J. Electr. Comput. Eng. 8(5), 3976 (2018)","journal-title":"Int. J. Electr. Comput. Eng."},{"key":"3552_CR31","doi-asserted-by":"crossref","unstructured":"Boyle, M., Edwards, C., Greenberg, S.: The effects of filtered video on awareness and privacy. In: Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, pp. 1\u201310 (2000)","DOI":"10.1145\/358916.358935"},{"key":"3552_CR32","doi-asserted-by":"publisher","first-page":"1088","DOI":"10.1109\/TIFS.2020.3029913","volume":"16","author":"J Zhou","year":"2020","unstructured":"Zhou, J., Pun, C.-M.: Personal privacy protection via irrelevant faces tracking and pixelation in video live streaming. IEEE Trans. Inf. Forensics Secur. 16, 1088\u20131103 (2020)","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"issue":"5","key":"3552_CR33","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1109\/MITP.2015.88","volume":"17","author":"DT Meridou","year":"2015","unstructured":"Meridou, D.T., Papadopoulou, M.-E.C., Kasnesis, P., Patrikakis, C.Z., Lamprinakos, G., Kapsalis, A.P., Venieris, I.S., Kaklamani, D.-T.I.: The health avatar: privacy-aware monitoring and management. IT Prof. 17(5), 20\u201327 (2015)","journal-title":"IT Prof."},{"key":"3552_CR34","doi-asserted-by":"crossref","unstructured":"Wang, C.Y., Sriram, S., Won, A.S.: Shared realities: avatar identification and privacy concerns in reconstructed experiences. In: Proceedings of the ACM on Human\u2013Computer Interaction 5(CSCW2), 1\u201325 (2021)","DOI":"10.1145\/3476078"},{"issue":"2","key":"3552_CR35","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1109\/TKDE.2005.32","volume":"17","author":"EM Newton","year":"2005","unstructured":"Newton, E.M., Sweeney, L., Malin, B.: Preserving privacy by de-identifying face images. IEEE Trans. Knowl. Data Eng. 17(2), 232\u2013243 (2005)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"issue":"4","key":"3552_CR36","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1109\/TPAMI.2008.106","volume":"31","author":"E Murphy-Chutorian","year":"2008","unstructured":"Murphy-Chutorian, E., Trivedi, M.M.: Head pose estimation in computer vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 31(4), 607\u2013626 (2008)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"4","key":"3552_CR37","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1007\/s42979-023-01796-z","volume":"4","author":"A Asperti","year":"2023","unstructured":"Asperti, A., Filippini, D.: Deep learning for head pose estimation: a survey. SN Comput. Sci. 4(4), 349 (2023)","journal-title":"SN Comput. Sci."},{"key":"3552_CR38","doi-asserted-by":"crossref","unstructured":"Li, J., Liu, K., Wu, J.: Ego-body pose estimation via ego-head pose estimation. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 17142\u201317151 (2023)","DOI":"10.1109\/CVPR52729.2023.01644"},{"issue":"1","key":"3552_CR39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3425780","volume":"54","author":"Y Mirsky","year":"2021","unstructured":"Mirsky, Y., Lee, W.: The creation and detection of deepfakes: a survey. ACM Comput. Surv. 54(1), 1\u201341 (2021)","journal-title":"ACM Comput. Surv."},{"issue":"11","key":"3552_CR40","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1145\/3422622","volume":"63","author":"I Goodfellow","year":"2020","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial networks. Commun. ACM 63(11), 139\u2013144 (2020)","journal-title":"Commun. ACM"},{"issue":"1","key":"3552_CR41","first-page":"100004","volume":"1","author":"A Aggarwal","year":"2021","unstructured":"Aggarwal, A., Mittal, M., Battineni, G.: Generative adversarial network: an overview of theory and applications. Int. J. Inf. Manag. Data Insights 1(1), 100004 (2021)","journal-title":"Int. J. Inf. Manag. Data Insights"},{"issue":"1","key":"3552_CR42","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1109\/MSP.2017.2765202","volume":"35","author":"A Creswell","year":"2018","unstructured":"Creswell, A., White, T., Dumoulin, V., Arulkumaran, K., Sengupta, B., Bharath, A.A.: Generative adversarial networks: an overview. IEEE Signal Process. Mag. 35(1), 53\u201365 (2018)","journal-title":"IEEE Signal Process. Mag."},{"issue":"2","key":"3552_CR43","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.bushor.2019.11.006","volume":"63","author":"J Kietzmann","year":"2020","unstructured":"Kietzmann, J., Lee, L.W., McCarthy, I.P., Kietzmann, T.C.: Deepfakes: Trick or treat? Bus. Horiz. 63(2), 135\u2013146 (2020)","journal-title":"Bus. Horiz."},{"issue":"1","key":"3552_CR44","doi-asserted-by":"publisher","first-page":"18","DOI":"10.3390\/jimaging9010018","volume":"9","author":"Z Akhtar","year":"2023","unstructured":"Akhtar, Z.: Deepfakes generation and detection: a short survey. J. Imaging 9(1), 18 (2023)","journal-title":"J. Imaging"},{"key":"3552_CR45","doi-asserted-by":"crossref","unstructured":"Huang, B., Wang, Z., Yang, J., Ai, J., Zou, Q., Wang, Q., Ye, D.: Implicit identity driven deepfake face swapping detection. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 4490\u20134499 (2023)","DOI":"10.1109\/CVPR52729.2023.00436"},{"key":"3552_CR46","doi-asserted-by":"crossref","unstructured":"Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., Nie\u00dfner, M.: Face2face: real-time face capture and reenactment of RGB videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2387\u20132395 (2016)","DOI":"10.1109\/CVPR.2016.262"},{"key":"3552_CR47","doi-asserted-by":"crossref","unstructured":"Hsu, G.-S., Tsai, C.-H., Wu, H.-Y.: Dual-generator face reenactment. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 642\u2013650 (2022)","DOI":"10.1109\/CVPR52688.2022.00072"},{"issue":"11","key":"3552_CR48","doi-asserted-by":"publisher","first-page":"5464","DOI":"10.1109\/TIP.2019.2916751","volume":"28","author":"Z He","year":"2019","unstructured":"He, Z., Zuo, W., Kan, M., Shan, S., Chen, X.: Attgan: facial attribute editing by only changing what you want. IEEE Trans. Image Process. 28(11), 5464\u20135478 (2019)","journal-title":"IEEE Trans. Image Process."},{"key":"3552_CR49","doi-asserted-by":"crossref","unstructured":"Chen, Y.-C., Shen, X., Lin, Z., Lu, X., Pao, I., Jia, J., et al.: Semantic component decomposition for face attribute manipulation. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 9859\u20139867 (2019)","DOI":"10.1109\/CVPR.2019.01009"},{"issue":"3","key":"3552_CR50","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1007\/s41095-021-0219-7","volume":"7","author":"R Sun","year":"2021","unstructured":"Sun, R., Huang, C., Zhu, H., Ma, L.: Mask-aware photorealistic facial attribute manipulation. Comput. Vis. Media 7(3), 363\u2013374 (2021)","journal-title":"Comput. Vis. Media"},{"issue":"4","key":"3552_CR51","doi-asserted-by":"publisher","first-page":"3974","DOI":"10.1007\/s10489-022-03766-z","volume":"53","author":"M Masood","year":"2023","unstructured":"Masood, M., Nawaz, M., Malik, K.M., Javed, A., Irtaza, A., Malik, H.: Deepfakes generation and detection: state-of-the-art, open challenges, countermeasures, and way forward. Appl. Intell. 53(4), 3974\u20134026 (2023)","journal-title":"Appl. Intell."},{"key":"3552_CR52","doi-asserted-by":"crossref","unstructured":"Deb, D., Zhang, J., Jain, A.K.: Advfaces: adversarial face synthesis. In: 2020 IEEE International Joint Conference on Biometrics (IJCB), pp. 1\u201310 (2020). IEEE","DOI":"10.1109\/IJCB48548.2020.9304898"},{"key":"3552_CR53","doi-asserted-by":"crossref","unstructured":"Mokhayeri, F., Kamali, K., Granger, E.: Cross-domain face synthesis using a controllable GAN. In: Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, pp. 252\u2013260 (2020)","DOI":"10.1109\/WACV45572.2020.9093275"},{"key":"3552_CR54","doi-asserted-by":"crossref","unstructured":"Ferrell, R., Aykac, D., Karnowski, T., Srinivas, N.: A publicly available, annotated dataset for naturalistic driving study and computer vision algorithm development. Technical report, Oak Ridge National Lab.(ORNL), Oak Ridge, TN (United States) (2021)","DOI":"10.2172\/1760158"},{"key":"3552_CR55","first-page":"1755","volume":"10","author":"DE King","year":"2009","unstructured":"King, D.E.: Dlib-ml: a machine learning toolkit. J. Mach. Learn. Res. 10, 1755\u20131758 (2009)","journal-title":"J. Mach. Learn. Res."},{"key":"3552_CR56","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1016\/j.comnet.2019.01.038","volume":"152","author":"A Tolba","year":"2019","unstructured":"Tolba, A.: Content accessibility preference approach for improving service optimality in internet of vehicles. Comput. Netw. 152, 78\u201386 (2019)","journal-title":"Comput. Netw."},{"issue":"17","key":"3552_CR57","first-page":"372","volume":"6","author":"W Shen","year":"2012","unstructured":"Shen, W., Sun, H., Cheng, E., Zhu, Q., Li, Q., Shen, W.: Effective driver fatigue monitoring through pupil detection and yawing analysis in low light level environments. Int. J. Digit. Content Technol. Appl. 6(17), 372 (2012)","journal-title":"Int. J. Digit. Content Technol. Appl."},{"key":"3552_CR58","doi-asserted-by":"crossref","unstructured":"Varghese, R.R., Jacob, P.M., Jacob, J., Babu, M.N., Ravikanth, R., George, S.M.: An integrated framework for driver drowsiness detection and alcohol intoxication using machine learning. In: 2021 International Conference on Data Analytics for Business and Industry (ICDABI), pp. 531\u2013536 (2021). IEEE","DOI":"10.1109\/ICDABI53623.2021.9655979"},{"key":"3552_CR59","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al.: An image is worth 16x16 words: transformers for image recognition at scale. In: International Conference on Learning Representations (2020)"},{"key":"3552_CR60","doi-asserted-by":"crossref","unstructured":"Goodfellow, I.J., Erhan, D., Carrier, P.L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al.: Challenges in representation learning: a report on three machine learning contests. In: Neural Information Processing: 20th International Conference, ICONIP 2013, Daegu, Korea, November 3\u20137, 2013. Proceedings, Part III 20, pp. 117\u2013124 (2013). Springer","DOI":"10.1007\/978-3-642-42051-1_16"},{"key":"3552_CR61","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.aqpro.2015.02.019","volume":"4","author":"P Jagalingam","year":"2015","unstructured":"Jagalingam, P., Hegde, A.V.: A review of quality metrics for fused image. Aquat. Proc. 4, 133\u2013142 (2015)","journal-title":"Aquat. Proc."},{"issue":"22","key":"3552_CR62","first-page":"6","volume":"181","author":"D Asamoah","year":"2018","unstructured":"Asamoah, D., Ofori, E., Opoku, S., Danso, J.: Measuring the performance of image contrast enhancement technique. Int. J. Comput. Appl. 181(22), 6\u201313 (2018)","journal-title":"Int. J. Comput. Appl."},{"issue":"3","key":"3552_CR63","doi-asserted-by":"publisher","first-page":"8","DOI":"10.4236\/jcc.2019.73002","volume":"7","author":"U Sara","year":"2019","unstructured":"Sara, U., Akter, M., Uddin, M.S.: Image quality assessment through FSIM, SSIM, MSE and PSNR\u2014a comparative study. J. Comput. Commun. 7(3), 8\u201318 (2019)","journal-title":"J. Comput. Commun."},{"issue":"3","key":"3552_CR64","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1109\/97.995823","volume":"9","author":"Z Wang","year":"2002","unstructured":"Wang, Z., Bovik, A.C.: A universal image quality index. IEEE Signal Process. Lett. 9(3), 81\u201384 (2002)","journal-title":"IEEE Signal Process. Lett."},{"issue":"1","key":"3552_CR65","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1109\/LGRS.2012.2193372","volume":"10","author":"D Renza","year":"2012","unstructured":"Renza, D., Martinez, E., Arquero, A.: A new approach to change detection in multispectral images by means of ERGAS index. IEEE Geosci. Remote Sens. Lett. 10(1), 76\u201380 (2012)","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"3552_CR66","doi-asserted-by":"crossref","unstructured":"Nirkin, Y., Keller, Y., Hassner, T.: Fsgan: subject agnostic face swapping and reenactment. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 7184\u20137193 (2019)","DOI":"10.1109\/ICCV.2019.00728"},{"key":"3552_CR67","doi-asserted-by":"crossref","unstructured":"Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: Computer Vision\u2013ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14, pp. 694\u2013711 (2016). Springer","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"3552_CR68","doi-asserted-by":"crossref","unstructured":"Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Tao, A., Kautz, J., Catanzaro, B.: High-resolution image synthesis and semantic manipulation with conditional gans. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8798\u20138807 (2018)","DOI":"10.1109\/CVPR.2018.00917"},{"key":"3552_CR69","doi-asserted-by":"publisher","first-page":"83452","DOI":"10.1109\/ACCESS.2022.3196668","volume":"10","author":"A Groshev","year":"2022","unstructured":"Groshev, A., Maltseva, A., Chesakov, D., Kuznetsov, A., Dimitrov, D.: Ghost-a new face swap approach for image and video domains. IEEE Access 10, 83452\u201383462 (2022)","journal-title":"IEEE Access"},{"key":"3552_CR70","unstructured":"Li, L., Bao, J., Yang, H., Chen, D., Wen, F.: Faceshifter: towards high fidelity and occlusion aware face swapping. arXiv preprint arXiv:1912.13457 (2019)"},{"key":"3552_CR71","doi-asserted-by":"crossref","unstructured":"Chen, R., Chen, X., Ni, B., Ge, Y.: Simswap: an efficient framework for high fidelity face swapping. In: Proceedings of the 28th ACM International Conference on Multimedia, pp. 2003\u20132011 (2020)","DOI":"10.1145\/3394171.3413630"},{"key":"3552_CR72","doi-asserted-by":"crossref","unstructured":"Gao, G., Huang, H., Fu, C., Li, Z., He, R.: Information bottleneck disentanglement for identity swapping. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 3404\u20133413 (2021)","DOI":"10.1109\/CVPR46437.2021.00341"},{"key":"3552_CR73","doi-asserted-by":"crossref","unstructured":"Tishby, N., Zaslavsky, N.: Deep learning and the information bottleneck principle. In: 2015 IEEE Information Theory Workshop (ITW), pp. 1\u20135 (2015). IEEE","DOI":"10.1109\/ITW.2015.7133169"},{"key":"3552_CR74","unstructured":"Schulz, K., Sixt, L., Tombari, F., Landgraf, T.: Restricting the flow: information bottlenecks for attribution. arXiv preprint arXiv:2001.00396 (2020)"},{"key":"3552_CR75","unstructured":"Alemi, A.A., Fischer, I., Dillon, J.V., Murphy, K.: Deep variational information bottleneck. arXiv preprint arXiv:1612.00410 (2016)"},{"key":"3552_CR76","volume-title":"Kernel Smoothing: Principles, Methods and Applications","author":"S Ghosh","year":"2018","unstructured":"Ghosh, S.: Kernel Smoothing: Principles, Methods and Applications. Wiley, Hoboken (2018)"},{"key":"3552_CR77","unstructured":"Arjovsky, M., Chintala, S., Bottou, L.: Wasserstein GAN (2017)"},{"key":"3552_CR78","unstructured":"Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., Courville, A.C.: Improved training of wasserstein gans. Advances in neural information processing systems 30 (2017)"},{"key":"3552_CR79","doi-asserted-by":"crossref","unstructured":"Cai, Z., Gao, Z., Planche, B., Zheng, M., Chen, T., Asif, M..S., Wu, Z.: Disguise without disruption: utility-preserving face de-identification. In: Proceedings of the AAAI Conference on Artificial Intelligence 38, 918\u2013926 (2024)","DOI":"10.1609\/aaai.v38i2.27851"},{"key":"3552_CR80","doi-asserted-by":"crossref","unstructured":"Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., Aila, T.: Analyzing and improving the image quality of stylegan. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 8110\u20138119 (2020)","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"3552_CR81","doi-asserted-by":"publisher","unstructured":"Li, F., Thapa, S., Bhat, S., Sarkar, A., Abbott, A.L.: A temporal encoder-decoder approach to extracting blood volume pulse signal morphology from face videos. In: 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 5965\u20135974 (2023). https:\/\/doi.org\/10.1109\/CVPRW59228.2023.00635","DOI":"10.1109\/CVPRW59228.2023.00635"},{"key":"3552_CR82","doi-asserted-by":"publisher","unstructured":"Deshpande, Y., Thapa, S., Sarkar, A., Abbott, A.L.: Camera-based recovery of cardiovascular signals from unconstrained face videos using an attention network. In: 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 5975\u20135984 (2023). https:\/\/doi.org\/10.1109\/CVPRW59228.2023.00636","DOI":"10.1109\/CVPRW59228.2023.00636"},{"key":"3552_CR83","doi-asserted-by":"crossref","unstructured":"Sarkar, A., Abbott, A.L., Doerzaph, Z.: Biometric authentication using photoplethysmography signals. In: 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS), pp. 1\u20137 (2016). IEEE","DOI":"10.1109\/BTAS.2016.7791193"},{"key":"3552_CR84","doi-asserted-by":"crossref","unstructured":"Sarkar, A., Abbott, A.L., Doerzaph, Z.: ECG biometric authentication using a dynamical model. In: 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS). pp. 1\u20136 (2015). IEEE","DOI":"10.1109\/BTAS.2015.7358757"}],"container-title":["The Visual Computer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-024-03552-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00371-024-03552-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-024-03552-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,3]],"date-time":"2025-03-03T11:29:56Z","timestamp":1741001396000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00371-024-03552-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,4]]},"references-count":84,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["3552"],"URL":"https:\/\/doi.org\/10.1007\/s00371-024-03552-7","relation":{},"ISSN":["0178-2789","1432-2315"],"issn-type":[{"value":"0178-2789","type":"print"},{"value":"1432-2315","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,4]]},"assertion":[{"value":"13 June 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The dataset used in our study is available at . The sample of dataset can be found at . For the full dataset, send a request to karnowskitp@ornl.gov, ferrellrk@ornl.gov, and aykacdb@ornl.gov","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Data availability:"}}]}}