{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,5]],"date-time":"2025-10-05T20:10:11Z","timestamp":1759695011173,"version":"build-2065373602"},"reference-count":90,"publisher":"SAGE Publications","issue":"10","license":[{"start":{"date-parts":[[2025,6,5]],"date-time":"2025-06-05T00:00:00Z","timestamp":1749081600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100002322","name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior","doi-asserted-by":"publisher","award":["001"],"award-info":[{"award-number":["001"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["SIMULATION"],"published-print":{"date-parts":[[2025,10]]},"abstract":"<jats:p>Driver-in-the-loop (DIL) simulation has become crucial in the automotive industry, providing a controlled setting for assessing vehicle performance, driver characteristics, and scenario configurations. However, the incorporation of human factors introduces subjectivity into simulation outcomes. This systematic review examines the interplay between objective metrics (OM) and subjective assessments (SA) in DIL vehicle dynamic simulator research. To achieve this, PubMed and ScienceDirect databases and predefined keywords and boundary conditions are used. Through four eliminatory revision stages, most of the ultimately selected papers are scrutinized to determine if a viable methodology exists for addressing subjectivity in DIL simulations. The results indicate that most studies found a correlation between the OM and the SA. Another positive aspect supporting this conclusion is that most works are associated with the fidelity of virtual tests in vehicle simulators. Despite the initially positive findings, it is noteworthy that most studies utilized a mix of standardized questionnaires and custom surveys, highlighting both the challenge of relating works due to a lack of standardization and the need for caution regarding the implicit subjectivity in questionnaire creation for each research. In addition, some secondary results are discussed based on the metadata gathered.<\/jats:p>","DOI":"10.1177\/00375497251341905","type":"journal-article","created":{"date-parts":[[2025,6,5]],"date-time":"2025-06-05T05:58:36Z","timestamp":1749103116000},"page":"1077-1092","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Have we reached satisfactory methodologies to approach the subjectivity in driver-in-the-loop simulators? A systematic review"],"prefix":"10.1177","volume":"101","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4125-1653","authenticated-orcid":false,"given":"C\u00e1dmo Augusto Rodrigues","family":"Dias","sequence":"first","affiliation":[{"name":"Pontif\u00edcia Universidade Cat\u00f3lica de Minas Gerais (PUC Minas), Brazil"}]},{"given":"J\u00e1nes","family":"Landre J\u00fanior","sequence":"additional","affiliation":[{"name":"Pontif\u00edcia Universidade Cat\u00f3lica de Minas Gerais (PUC Minas), Brazil"}]}],"member":"179","published-online":{"date-parts":[[2025,6,5]]},"reference":[{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.1504\/IJVP.2023.133854"},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2023.3279368"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.4271\/2022-01-0533"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.1177\/09544070221110070"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2019.102014"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2023.3346275"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1108\/JICV-11-2021-0017"},{"key":"e_1_3_4_9_2","first-page":"1","volume-title":"2018 international conference of electrical and electronic technologies for automotive","author":"Lee C-S","unstructured":"Lee C-S, Huang Y-H, Lan I-W. Hardware-in-the-loop test case specification for verification of software safety requirements in the context of ISO 26262. In: 2018 international conference of electrical and electronic technologies for automotive, Milan, Italy, 9\u201311 July 2018, pp. 1\u20136. New York: IEEE."},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.3390\/automation3030017"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnrgo.2021.682119"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.4271\/10-07-04-0034"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1177\/00187208231157935"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1080\/14484846.2023.2259709"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1177\/09544070221080362"},{"key":"e_1_3_4_16_2","doi-asserted-by":"publisher","DOI":"10.1080\/00423114.2020.1814357"},{"key":"e_1_3_4_17_2","first-page":"1717","volume-title":"2022 IEEE 25th international conference on intelligent transportation systems (ITSC)","author":"Zheng ZK","unstructured":"Zheng ZK, Akash K, Misu T. Detection of perceived discomfort in SAE L2 automated vehicles through driver takeovers and physiological spikes. In: 2022 IEEE 25th international conference on intelligent transportation systems (ITSC), Macau, China, 8\u201312 October 2022, pp. 1717\u20131722. New York: IEEE."},{"key":"e_1_3_4_18_2","first-page":"267","volume-title":"2023 6th international conference on contemporary computing and informatics (IC3I)","author":"Das L","unstructured":"Das L, Lohani BP, Vats S, et al. Exploring the mind-bending connection between virtual reality and human perception: review. In: 2023 6th international conference on contemporary computing and informatics (IC3I), Gautam Buddha Nagar, India, 14\u201316 September 2023, pp. 267\u2013275. New York: IEEE."},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/s38314-021-0639-2"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3061732"},{"key":"e_1_3_4_21_2","first-page":"215","volume-title":"2021 5th international conference on electrical, electronics, communication, computer technologies and optimization techniques (ICEECCOT)","author":"Jinila YB","unstructured":"Jinila YB, Jabez J, Shyry SP. Virtual self driving car using improved convolution neural networks. In: 2021 5th international conference on electrical, electronics, communication, computer technologies and optimization techniques (ICEECCOT), Mysuru, India, 10\u201311 December 2021, pp. 215\u2013219. New York: IEEE."},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.3390\/s23125428"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2983609"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/JAS.2020.1003021"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2023.3281474"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2022.824670"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-40971-5_21"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1080\/00423114.2023.2259024"},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2020.12.1401"},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-38077-9_151"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12239-020-0146-0"},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1177\/09544070221084759"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ssci.2019.04.004"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2023.05.014"},{"key":"e_1_3_4_35_2","first-page":"234","volume-title":"2023 international conference on informatics, multimedia, cyber and informations system (ICIMCIS)","author":"Fajar M","unstructured":"Fajar M, Suri PA, Khairunnisa S, et al. Systematic literature review: applications of vehicle simulator. In: 2023 international conference on informatics, multimedia, cyber and informations system (ICIMCIS), Jakarta Selatan, Indonesia, 7\u20138 November 2023, pp. 234\u2013239. New York: IEEE."},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-020-05986-6"},{"key":"e_1_3_4_37_2","article-title":"Subjective awareness of sleepiness while driving in younger and older adults","volume":"33","author":"Cai AWT","year":"2023","unstructured":"Cai AWT, Manousakis JE, Singh B, et al. Subjective awareness of sleepiness while driving in younger and older adults. J Sleep Res 2023; 33: e13933.","journal-title":"J Sleep Res"},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1080\/15389588.2021.1933459"},{"key":"e_1_3_4_39_2","doi-asserted-by":"publisher","DOI":"10.1177\/00368504211036857"},{"key":"e_1_3_4_40_2","first-page":"4026","article-title":"EEG-based evaluation of motion sickness and reducing sensory conflict in a simulated autonomous driving environment","volume":"2022","author":"Li Z","year":"2022","unstructured":"Li Z, Zhao L, Chang J, et al. EEG-based evaluation of motion sickness and reducing sensory conflict in a simulated autonomous driving environment. Annu Int Conf IEEE Eng Med Biol Soc 2022; 2022: 4026\u20134030.","journal-title":"Annu Int Conf IEEE Eng Med Biol Soc"},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21020550"},{"key":"e_1_3_4_42_2","doi-asserted-by":"publisher","DOI":"10.1177\/00187208231200721"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1177\/00187208221113448"},{"key":"e_1_3_4_44_2","doi-asserted-by":"publisher","DOI":"10.1093\/sleep\/zsad136"},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.3390\/s22239093"},{"key":"e_1_3_4_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2022.103889"},{"key":"e_1_3_4_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3067773"},{"key":"e_1_3_4_48_2","doi-asserted-by":"publisher","DOI":"10.2352\/J.ImagingSci.Technol.2020.64.2.020501"},{"key":"e_1_3_4_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2019.12.083"},{"key":"e_1_3_4_50_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-819113-2.00002-6"},{"key":"e_1_3_4_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2019.12.091"},{"key":"e_1_3_4_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2020.12.1681"},{"key":"e_1_3_4_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2019.05.007"},{"key":"e_1_3_4_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trc.2023.104193"},{"key":"e_1_3_4_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2019.07.001"},{"key":"e_1_3_4_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2019.08.001"},{"key":"e_1_3_4_57_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2023.120926"},{"key":"e_1_3_4_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.futures.2020.102646"},{"key":"e_1_3_4_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2023.09.015"},{"key":"e_1_3_4_60_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2019.07.007"},{"key":"e_1_3_4_61_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2019.11.011"},{"key":"e_1_3_4_62_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aap.2023.107068"},{"key":"e_1_3_4_63_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2020.09.002"},{"key":"e_1_3_4_64_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2019.112757"},{"key":"e_1_3_4_65_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trc.2020.102612"},{"key":"e_1_3_4_66_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aap.2023.106972"},{"key":"e_1_3_4_67_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.energy.2018.10.130"},{"key":"e_1_3_4_68_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2017.11.006"},{"key":"e_1_3_4_69_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2020.103343"},{"key":"e_1_3_4_70_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aap.2021.106157"},{"key":"e_1_3_4_71_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2019.06.011"},{"key":"e_1_3_4_72_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.diabres.2022.110204"},{"key":"e_1_3_4_73_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aap.2021.106397"},{"key":"e_1_3_4_74_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.118972"},{"key":"e_1_3_4_75_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.conengprac.2023.105678"},{"key":"e_1_3_4_76_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aap.2020.105499"},{"key":"e_1_3_4_77_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.buildenv.2019.106642"},{"key":"e_1_3_4_78_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2017.08.013"},{"key":"e_1_3_4_79_2","doi-asserted-by":"publisher","DOI":"10.1080\/15472450.2020.1738231"},{"key":"e_1_3_4_80_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsr.2018.12.015"},{"key":"e_1_3_4_81_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.12.009"},{"key":"e_1_3_4_82_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfranklin.2020.08.027"},{"key":"e_1_3_4_83_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2022.06.057"},{"key":"e_1_3_4_84_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-323-90176-5.00008-5"},{"key":"e_1_3_4_85_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2020.103315"},{"key":"e_1_3_4_86_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.mex.2022.101901"},{"key":"e_1_3_4_87_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.forpol.2021.102682"},{"key":"e_1_3_4_88_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2021.103645"},{"key":"e_1_3_4_89_2","first-page":"77","volume-title":"iHorizon-enabled energy management for electrified vehicles","author":"Mart\u00ednez CM","year":"2018","unstructured":"Mart\u00ednez CM, Cao D. 3\u2014the driver in the loop. In: Mart\u00ednez CM, Cao D (eds) iHorizon-enabled energy management for electrified vehicles. Oxford: Butterworth-Heinemann, 2018, pp. 77\u2013131."},{"key":"e_1_3_4_90_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.physa.2023.129059"},{"key":"e_1_3_4_91_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2019.113617"}],"container-title":["SIMULATION"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/00375497251341905","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/00375497251341905","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/00375497251341905","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,5]],"date-time":"2025-10-05T19:38:57Z","timestamp":1759693137000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/00375497251341905"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,5]]},"references-count":90,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2025,10]]}},"alternative-id":["10.1177\/00375497251341905"],"URL":"https:\/\/doi.org\/10.1177\/00375497251341905","relation":{},"ISSN":["0037-5497","1741-3133"],"issn-type":[{"type":"print","value":"0037-5497"},{"type":"electronic","value":"1741-3133"}],"subject":[],"published":{"date-parts":[[2025,6,5]]}}}