{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T04:21:39Z","timestamp":1775103699386,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2020,4,28]],"date-time":"2020-04-28T00:00:00Z","timestamp":1588032000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Research on the role of non-driving related tasks (NDRT) in the area of automated driving is indispensable. At the same time, the construct mode awareness has received considerable interest in regard to human\u2013machine interface (HMI) evaluation. Based on the expectation that HMI design and practice with different levels of driving automation influence NDRT engagement, a driving simulator study was conducted. In a 2 \u00d7 5 (automation level x block) design, N = 49 participants completed several transitions of control. They were told that they could engage in an NDRT if they felt safe and comfortable to do so. The NDRT was the Surrogate Reference Task (SuRT) as a representative of a wide range of visual\u2013manual NDRTs. Engagement (i.e., number of inputs on the NDRT interface) was assessed at the onset of a respective episode of automated driving (i.e., after transition) and during ongoing automation (i.e., before subsequent transition). Results revealed that over time, NDRT engagement increased during both L2 and L3 automation until stable engagement at the third block. This trend was observed for both onset and ongoing NDRT engagement. The overall engagement level and the increase in engagement are significantly stronger for L3 automation compared to L2 automation. These results outline the potential of NDRT engagement as an online non-intrusive measure for mode awareness. Moreover, repeated interaction is necessary until users are familiar with the automated system and its HMI to engage in NDRTs. These results provide researchers and practitioners with indications about users\u2019 minimum degree of familiarity with driving automation and HMIs for mode awareness testing.<\/jats:p>","DOI":"10.3390\/info11050239","type":"journal-article","created":{"date-parts":[[2020,4,28]],"date-time":"2020-04-28T05:05:32Z","timestamp":1588050332000},"page":"239","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Engagement in Non-Driving Related Tasks as a Non-Intrusive Measure for Mode Awareness: A Simulator Study"],"prefix":"10.3390","volume":"11","author":[{"given":"Yannick","family":"Forster","sequence":"first","affiliation":[{"name":"BMW Group, Knorrstr. 147, 80937 Munich, Germany"}]},{"given":"Viktoria","family":"Geisel","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, Technical University Munich, Boltzmannstr. 15, 85748 Garching, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4061-8273","authenticated-orcid":false,"given":"Sebastian","family":"Hergeth","sequence":"additional","affiliation":[{"name":"BMW Group, Knorrstr. 147, 80937 Munich, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1712-6473","authenticated-orcid":false,"given":"Frederik","family":"Naujoks","sequence":"additional","affiliation":[{"name":"BMW Group, Knorrstr. 147, 80937 Munich, Germany"}]},{"given":"Andreas","family":"Keinath","sequence":"additional","affiliation":[{"name":"BMW Group, Knorrstr. 147, 80937 Munich, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2020,4,28]]},"reference":[{"key":"ref_1","unstructured":"SAE (2018). Taxonomy and Definitions for Terms Related to On-Road Motor Vehicle Automated Driving Systems (No. J3016R), SAE."},{"key":"ref_2","unstructured":"AAM (2006). Statement of Principles, Criteria and Verification Procedures on Driver Interactions with Advanced In-Vehicle Information and Communication Systems, Alliance of Automobile Manufactures."},{"key":"ref_3","unstructured":"NHTSA (2012). Visual-Manual NHTSA Driver Distraction Guidelines for In-Vehicle Electronic Devices."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Forster, Y., Naujoks, F., and Neukum, A. (2016, January 24\u201328). Your Turn or My Turn? Design of a Human-Machine Interface for Conditional Automation. Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Ann Arbor, MI, USA.","DOI":"10.1145\/3003715.3005463"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Forster, Y., Naujoks, F., and Neukum, A. (2017, January 11\u201314). Increasing anthropomorphism and trust in automated driving functions by adding speech output. Proceedings of the 2017 IEEE Intelligent Vehicles Symposium (IV), Redondo Beach, CA, USA.","DOI":"10.1109\/IVS.2017.7995746"},{"key":"ref_6","unstructured":"Hergeth, S. (2016). Automation Trust in Conditional Automated Driving Systems: Approaches to Operationalization and Design. [Ph.D. Thesis, Technische Universit\u00e4t Chemnitz]."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1177\/0018720815625744","article-title":"Keep your scanners peeled: Gaze behavior as a measure of automation trust during highly automated driving","volume":"58","author":"Hergeth","year":"2016","journal-title":"Hum. Factors"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1938","DOI":"10.1177\/1541931213571433","article-title":"\u201cTake over!\u201d How long does it take to get the driver back into the loop?","volume":"57","author":"Gold","year":"2013","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1016\/j.aap.2017.04.017","article-title":"Take-over performance in evasive manoeuvres","volume":"106","author":"Happee","year":"2017","journal-title":"Accid. Anal. Prev."},{"key":"ref_10","first-page":"431","article-title":"The effect of urgency take-over requests during highly automated driving under distraction conditions","volume":"7","author":"Naujoks","year":"2014","journal-title":"Adv. Hum. Asp. Trans."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.trf.2012.12.006","article-title":"The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information","volume":"18","author":"Beggiato","year":"2013","journal-title":"Trans. Res. Part F Traffic Psychol. Behav."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.trf.2015.10.005","article-title":"Learning and development of trust, acceptance and the mental model of ACC. A longitudinal on-road study","volume":"35","author":"Beggiato","year":"2015","journal-title":"Trans. Res. Part F Traffic Psychol. Behav."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Forster, Y., Hergeth, S., Naujoks, F., Beggiato, M., Krems, J.F., and Keinath, A. (2019, January 24\u201327). Learning and Development of Mental Models in Interaction with Driving Automation: A Simulator Study. Proceedings of the Driving Assessment Conference, Santa Fe, NM, USA.","DOI":"10.17077\/drivingassessment.1724"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1016\/j.trf.2019.02.013","article-title":"Learning to Use Automation: Behavioral Changes in Interaction with Automated Driving Systems","volume":"62","author":"Forster","year":"2019","journal-title":"Trans. Res. Part F Traffic Psychol. Behav."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"S146","DOI":"10.1080\/15389588.2019.1603374","article-title":"Test procedure for evaluating the human\u2013machine interface of vehicles with automated driving systems","volume":"20","author":"Naujoks","year":"2019","journal-title":"Traffic Inj. Prev."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1518\/001872095779049516","article-title":"How in the world did we ever get into that mode? Mode error and awareness in supervisory control","volume":"37","author":"Sarter","year":"1995","journal-title":"Hum. Factors"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11740-018-0868-2","article-title":"Understanding situational and mode awareness for safe human-robot collaboration: Case studies on assembly applications","volume":"13","author":"Gopinath","year":"2019","journal-title":"Prod. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Reilhac, P., Hottelart, K., Diederichs, F., and Nowakowski, C. (2017). User experience with increasing levels of vehicle automation: Overview of the challenges and opportunities as vehicles progress from partial to high automation. Automotive user interfaces, Springer.","DOI":"10.1007\/978-3-319-49448-7_17"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Feldh\u00fctter, A., Segler, C., and Bengler, K. (2017, January 17\u201321). Does Shifting Between Conditionally and Partially Automated Driving Lead to a Loss of Mode Awareness?. Proceedings of the International Conference on Applied Human Factors and Ergonomics, Los Angeles, CA, USA.","DOI":"10.1007\/978-3-319-60441-1_70"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Seppelt, B., Reimer, B., Russo, L., Mehler, B., Fisher, J., and Friedman, D. (2019, January 27). Consumer confusion with levels of vehicle automation. Proceedings of the 10th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, Santa Fe, NM, USA.","DOI":"10.17077\/drivingassessment.1723"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.trf.2017.11.012","article-title":"The impact of an in-vehicle display on glance distribution in partially automated driving in an on-road experiment","volume":"52","author":"Kraft","year":"2018","journal-title":"Trans. Res. Part F Traffic Psychol. Behav."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Martens, M.H., and Jenssen, G.D. (2012). Behavioural adaptation and acceptance. Handbook Intelligent Vehicles, Springer.","DOI":"10.1007\/978-0-85729-085-4_6"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1518\/hfes.46.1.50.30392","article-title":"Trust in automation: Designing for appropriate reliance","volume":"46","author":"Lee","year":"2004","journal-title":"Hum. Factors"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1007\/978-3-319-96074-6_34","article-title":"Effect on Mode Awareness When Changing from Conditionally to Partially Automated Driving","volume":"Volume 823","author":"Bagnara","year":"2019","journal-title":"Advances in Intelligent Systems and Computing: Vol. 823. Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018)"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sch\u00f6mig, N., Wiedemann, K., Hergeth, S., Forster, Y., Muttart, J., Eriksson, A., and Naujoks, F. (2020). Checklist for expert evaluation of automated vehicles HMIs\u2013discussions on its value and adaptions of the method within an expert workshop. Information, 11.","DOI":"10.3390\/info11040233"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"DeGuzman, C., Hopkins, S., and Donmez, B. (2020). Driver Takeover Performance and Monitoring Behaviour with Driving Automation at System-Limit versus System-Malfunction Failures. Trans. Res. Rec. J. Trans. Res. Board.","DOI":"10.1177\/0361198120912228"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1136\/injuryprev-2016-042155","article-title":"Were they in the loop during automated driving? Links between visual attention and crash potential","volume":"23","author":"Louw","year":"2016","journal-title":"Inj. Prev."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2999","DOI":"10.1109\/TITS.2018.2870909","article-title":"Reference model for driver attention in automation: Glance behavior changes during lateral and longitudinal assistance","volume":"20","author":"Morando","year":"2019","journal-title":"IEEE Trans. Intell. Trans. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Llaneras, R.E., Salinger, J., and Green, C.A. (2013, January 17\u201320). Human factors issues associated with limited ability autonomous driving systems: Drivers\u2019 allocation of visual attention to the forward roadway. Proceedings of the 7th International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, Bolton Landing, New York, NY, USA.","DOI":"10.17077\/drivingassessment.1472"},{"key":"ref_30","unstructured":"ISO (2012). Road Vehicles\u2014Ergonomic Aspects of Transport Information and Control Systems\u2014Calibration Tasks for Methods which Assess Driver Demand due to the Use of In-Vehicle Systems, ISO. (ISO, 14198)."},{"key":"ref_31","unstructured":"ISO (2017). Road Vehicles\u2014Ergonomic Aspects of Transport Information and Control Systems\u2014Specifications and Test Procedures for In-Vehicle Visual Presentation, International Organization for Standardization. (15008)."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2063","DOI":"10.1177\/1541931214581434","article-title":"How Traffic Situations and Non-Driving Related Tasks Affect the Take-Over Quality in Highly Automated Driving","volume":"58","author":"Radlmayr","year":"2014","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Forster, Y., Hergeth, S., Naujoks, F., Krems, J.F., and Keinath, A. (2019). Tell them how they did: Feedback on operator performance helps calibrate perceived ease of use in automated driving. Multimodal Technol. Interact., 3.","DOI":"10.3390\/mti3020029"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Naujoks, F., Hergeth, S., Keinath, A., Wiedemann, K., and Sch\u00f6mig, N. (2018, January 1\u20135). Use Cases for Assessing, Testing, and Validating the Human Machine Interface of Automated Driving Systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Philadelphia, PA, USA.","DOI":"10.1177\/1541931218621426"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.trf.2015.10.022","article-title":"Controllability of Partially Automated Driving functions\u2013Does it matter whether drivers are allowed to take their hands off the steering wheel?","volume":"35","author":"Naujoks","year":"2015","journal-title":"Trans. Res. Part F Traffic Psychol. Behav."},{"key":"ref_36","unstructured":"Manca, L., de Winter, J.C.F., and Happee, R. (2015, January 1\u20133). Visual Displays for Automated Driving: A Survey. Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Nottingham, UK."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Forster, Y., Hergeth, S., Naujoks, F., Krems, J.F., and Keinath, A. (2019, January 24\u201328). Empirical Validation of a Checklist for Heuristic Evaluation of Automated Vehicle HMIs. Proceedings of the 10th International Conference on Applied Human Factors and Ergonomics, Washington, DC, USA.","DOI":"10.1007\/978-3-030-20503-4_1"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Jarosch, O., Kuhnt, M., Paradies, S., and Bengler, K. (2017, January 26\u201329). It\u2019s Out of Our Hands Now! Effects of Non-Driving Related Tasks During Highly Automated Driving on Drivers\u2019 Fatigue. Proceedings of the Driving Assessment Conference, Manchester Village, VT, USA.","DOI":"10.17077\/drivingassessment.1653"},{"key":"ref_39","first-page":"189","article-title":"Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc. Ser. B (Methodol.)"},{"key":"ref_40","unstructured":"Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, Routledge. [2nd ed.]."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Dingus, T.A., Klauer, S.G., Neale, V.L., Petersen, A., Lee, S.E., Sudweeks, J.D., and Gupta, S. (2006). The 100-car Naturalistic Driving Study, Phase II-Results of the 100-Car Field Experiment.","DOI":"10.1037\/e624282011-001"},{"key":"ref_42","unstructured":"P\u00e4tzold, A., Schmidt, C., Rauh, N., Cocron, P., Hergeth, S., Keinath, A., and Krems, J.F. (2017, January 28\u201330). From distraction to controlled engagement: How secondary tasks affect drivers\u2019 supervisory and fall-back performance of the driving task while using SAE level 2 driving automation. Proceedings of the Europe Chapter Human Factors and Ergonomics Society Annual Meeting 2017, Rome, Italy."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.trf.2019.11.014","article-title":"Effects of secondary tasks and display position on glance behavior during partially automated driving","volume":"68","author":"Hensch","year":"2020","journal-title":"Trans. Res. Part F Traffic Psychol. Behav."},{"key":"ref_44","unstructured":"Purucker, C., Naujoks, F., Wiedemann, K., Neukum, A., and Marberger, C. (2018, January 15\u201317). Effects of Secondary Tasks on Conditional Automation State Transitions While Driving on Freeways: Judgements and Observations of Driver Workload. Proceedings of the 6th International Conference on Driver Distraction and Inattention, Gothenburg, Sweden."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/5\/239\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:23:59Z","timestamp":1760361839000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/5\/239"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,28]]},"references-count":44,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["info11050239"],"URL":"https:\/\/doi.org\/10.3390\/info11050239","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,28]]}}}