{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:26:12Z","timestamp":1760239572916,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2020,12,3]],"date-time":"2020-12-03T00:00:00Z","timestamp":1606953600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u00f3n y Universidades","doi-asserted-by":"publisher","award":["PID2019-104793RB-C32"],"award-info":[{"award-number":["PID2019-104793RB-C32"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Understanding naturalistic driving in complex scenarios is an important step towards autonomous driving, and several approaches have been adopted for modeling driver\u2019s behaviors. This paper presents the methodology known as \u201cThink Aloud Protocol\u201d to model driving. This methodology is a data-gathering technique in which drivers are asked to verbalize their thoughts as they are driving which are then recorded, and the ensuing analysis of the audios and videos permits to derive driving rules. The goal of this paper is to show how think aloud methodology is applied in the naturalistic driving area, and to demonstrate the validity of the proposed approach to derive driving rules. The paper presents, firstly, the background of the think aloud methodology and then presents the application of this methodology to driving in roundabouts. The general deployment of this methodology consists of several stages: driver preparation, data collection, audio and video processing, generation of coded transcript files, and the generation of driving rules. The main finding of this study is that think aloud protocol can be applied to naturalistic driving, and even some potential limitations as discussed in the paper, the presented methodology is a relatively easy approach to derive driving rules.<\/jats:p>","DOI":"10.3390\/s20236907","type":"journal-article","created":{"date-parts":[[2020,12,3]],"date-time":"2020-12-03T11:15:43Z","timestamp":1606994143000},"page":"6907","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Think Aloud Protocol Applied in Naturalistic Driving for Driving Rules Generation"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3597-3334","authenticated-orcid":false,"given":"Borja","family":"Monsalve","sequence":"first","affiliation":[{"name":"Science, Computing and Technology Department, Universidad Europea de Madrid, 28670 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7739-881X","authenticated-orcid":false,"given":"Nourdine","family":"Aliane","sequence":"additional","affiliation":[{"name":"Industrial and Aerospace Engineering Department, Universidad Europea de Madrid, 28670 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5115-1226","authenticated-orcid":false,"given":"Enrique","family":"Puertas","sequence":"additional","affiliation":[{"name":"Science, Computing and Technology Department, Universidad Europea de Madrid, 28670 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8230-7011","authenticated-orcid":false,"given":"Javier Fern\u00e1ndez","family":"Andr\u00e9s","sequence":"additional","affiliation":[{"name":"Industrial and Aerospace Engineering Department, Universidad Europea de Madrid, 28670 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,3]]},"reference":[{"key":"ref_1","unstructured":"Ozguner, U., Redmill, K.A., and Broggi, A. (2004, January 14\u201317). Team TerraMax and the DARPA grand challenge: A general overview. Proceedings of the IEEE Intelligent Vehicles Symposium, Parma, Italy."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-540-73429-1_1","article-title":"Stanley: The robot that won the DARPA Grand Challenge","volume":"Volume 36","author":"Thrun","year":"2007","journal-title":"The 2005 DARPA Grand Challenge: The Great Robot Race"},{"key":"ref_3","unstructured":"(2020, December 01). Automated Driving Systems (ADS): A Vision for Safety 2.0. 2017, Available online: https:\/\/www.nhtsa.gov\/sites\/nhtsa.dot.gov\/files\/documents\/13069a-ads2.0_090617_v9a_tag.pdf."},{"key":"ref_4","unstructured":"World Health Organization (2020, December 01). 10 Facts about Road Safety. 2018. Available online: https:\/\/www.who.int\/news-room\/facts-in-pictures\/detail\/road-safety."},{"key":"ref_5","unstructured":"Li, X., Chimba, D., and Masindoki, E. (2018, January 7\u201311). The Economic and Societal Impact of Motor Vehicle Crashes on Freight Intermodal Connectors in Tennessee: A Risk Management Approach. Proceedings of the Transportation Research Board Annual Meeting, Washington, DC, USA."},{"key":"ref_6","unstructured":"Blana, E. (1996). A Survey of Driving Research Simulators around the World, Institute of Transport Studies, University of Leeds."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1177\/0361198196155000105","article-title":"Driving Simulator Validity: Some Considerations","volume":"1550","author":"Kaptein","year":"1996","journal-title":"Transp. Res. Rec. J. Transp. Res. Board"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1080\/15389580902894989","article-title":"Comparison of driving errors between on-the-road and simulated driving assessment: A validation study","volume":"10","author":"Shechtman","year":"2009","journal-title":"Traffic. Inj. Prev."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/0001-4575(76)90013-0","article-title":"An instrumented vehicle for studies of driver behaviour","volume":"8","author":"Helander","year":"1976","journal-title":"Accid. Anal. Prev."},{"key":"ref_10","unstructured":"Boer, E.R. (1996, January 19\u201320). Tangent point oriented curve negotiation. Proceedings of the Conference on Intelligent Vehicles, Tokyo, Japan."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/37.60415","article-title":"A Control Theoretic Model of Driver Steering Behavior","volume":"10","author":"Hess","year":"1990","journal-title":"IEEE Control Syst. Mag."},{"key":"ref_12","unstructured":"Levison, W.H., and Cramer, N.L. (2020, December 01). Description of the Integrated Driver Model; (Tech. Rep. No. FHWA-RD-94-092). Federal Highway Administration, Office of Research and Development, McLean VA Remarks: Performed by BBN Systems and Technologies for the Federal Highway Administration, Office of Safety and Traffic Operations. 1995. Available online: https:\/\/trid.trb.org\/view\/490162."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"9","DOI":"10.3141\/1779-02","article-title":"Toward an integrated model of driver behavior in cognitive architecture","volume":"1779","author":"Salvucci","year":"2001","journal-title":"Transp. Res. Record"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1007\/s12544-016-0202-z","article-title":"The study design of UDRIVE: The naturalistic driving study across Europe for cars, trucks and scooters","volume":"8","author":"Barnard","year":"2016","journal-title":"Eur. Transp. Res. Rev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1139\/cjce-2017-0592","article-title":"A perceptual forward collision warning model using naturalistic driving data","volume":"45","author":"Tawfeek","year":"2018","journal-title":"Can. J. Civ. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.ssci.2019.01.007","article-title":"Detection of critical safety events on freeways in clear and rainy weather using SHRP2 naturalistic driving data: Parametric and non-parametric techniques","volume":"119","author":"Ali","year":"2019","journal-title":"Saf. Sci."},{"key":"ref_17","unstructured":"Chen, R., Kusano, K.D., and Gabler, H.C. (2015, January 9\u201311). Age and Gender Difference in Braking Behavior from the 100-Car Naturalistic Driving Study: The Implication for Autonomous Braking System Design. Proceedings of the FAST-Zero\u201915: 3rd International Symposium on Future Active Safety Technology toward Zero Traffic Accidents, Gothenburg, Sweden."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Monsalve, B., Puertas, E., Fernandez, J., and Aliane, N. (2018, January 12\u201314). Using wearable devices in naturalistic driving to analyze brain activity in roundabout maneuvers. Proceedings of the 2018 IEEE International Conference on Vehicular Electronics and Safety (ICVES), Madrid, Spain.","DOI":"10.1109\/ICVES.2018.8519500"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1016\/j.sbspro.2012.06.1047","article-title":"The Potential Benefits of Naturalistic Driving for Road Safety Research: Theoretical and Empirical Considerations and Challenges for the Future","volume":"48","author":"Sagberg","year":"2012","journal-title":"Procedia-Soc. Behav. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1207\/s15327884mca0503_3","article-title":"How to study thinking in everyday life: Contrasting think-aloud protocols with descriptions and explanations of thinking","volume":"5","author":"Ericsson","year":"1998","journal-title":"Mind Cult. Cult. Act."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1075\/target.13.2.03ber","article-title":"Think-aloud protocols in translation research: Achievements, limits, future prospects","volume":"13","author":"Bernardini","year":"2001","journal-title":"Target"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1016\/j.ijmedinf.2004.08.003","article-title":"The think aloud method: A guide to user interface design","volume":"73","author":"Jaspers","year":"2004","journal-title":"Int. J. Med. Inform."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Neuhuber, N., Lechner, G., Kalayci, T.E., Stocker, A., and Kubicek, B. (2020). Age-Related Differences in the Interaction with Advanced Driver Assistance Systems\u2014A Field Study. International Conference on Human-Computer Interaction, Proceedings of the HCII 2020: HCI in Mobility, Transport, and Automotive Systems. Automated Driving and In-Vehicle Experience Design, Copenhagen, Denmark, 19\u201324 July 2020, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-030-50523-3_26"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"102986","DOI":"10.1016\/j.apergo.2019.102986","article-title":"Driving automation state-of-mind: Using training to instigate rapid mental model development","volume":"83","author":"Krampell","year":"2020","journal-title":"Appl. Ergon."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"105717","DOI":"10.1016\/j.aap.2020.105717","article-title":"Expert Drivers\u2019 Prospective Thinking-Aloud to Enhance Automated Driving Technologies\u2014Investigating Uncertainty and Anticipation in Traffic","volume":"146","author":"Grahn","year":"2020","journal-title":"Accid. Anal. Prev."},{"key":"ref_26","unstructured":"Lewis, C. (1982). Using the \u2018Thinking Aloud\u2019 Method in Cognitive Interface Design, IBM TJ Watson Research Center. Research Report, RC-9265."},{"key":"ref_27","unstructured":"Newell, A., and Simon, H.A. (1972). Human Problem Solving, Prentice-Hall."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1473-4192.2004.00067.x","article-title":"Trustworthiness of think-aloud protocols in the study of translation processes","volume":"14","author":"Li","year":"2004","journal-title":"Int. J. Appl. Linguist."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Olmsted-Hawala, E.L., Murphy, E.D., Hawala, S., and Ashenfelter, K.T. (2010, January 10\u201315). Think-aloud protocols: A comparison of three think-aloud protocols for use in testing data-dissemination web sites for usability. Proceedings of the Conference on Human Factors in Computing Systems, Atlanta, GA, USA.","DOI":"10.1145\/1753326.1753685"},{"key":"ref_30","first-page":"27","article-title":"Los protocolos de pensamiento en voz alta como instrumento para analizar el proceso de escritura","volume":"20","author":"Armengol","year":"2007","journal-title":"Rev. Espa\u00f1ola Ling\u00fc\u00edstica Apl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1080\/0044929031000","article-title":"Retrospective vs. concurrent think-aloud protocols: Testing the usability of an online library catalogue","volume":"22","year":"2003","journal-title":"Behav. Inf. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1080\/00140139008927157","article-title":"Thinking-aloud in user interface design: A method promoting cognitive ergonomics","volume":"33","year":"1990","journal-title":"Ergonomics"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ericsson, K.A., and Simon, H.A. (1993). Protocol Analysis: Verbal Reports as Data, MIT Press.","DOI":"10.7551\/mitpress\/5657.001.0001"},{"key":"ref_34","unstructured":"Van Someren, M.W., Barnard, Y.F., and Sandberg, J.A.C. (1994). The Think aloud Method: A Practical Approach to Modelling Cognitive Processes, Academic Press."},{"key":"ref_35","unstructured":"(2020, December 01). C\u00f3digo de Tr\u00e1fico y Seguridad Vial. Available online: http:\/\/www.dgt.es\/images\/BOE-020_Codigo_de_Trafico_y_Seguridad_Vial.pdf."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.trpro.2020.03.069","article-title":"Gap-acceptance behavior at roundabouts: Validation of a driving simulator environment using field observations","volume":"47","author":"Rossi","year":"2020","journal-title":"Transp. Res. Procedia"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1016\/j.eswa.2016.11.023","article-title":"Parametric-based path generation for automated vehicles at roundabouts","volume":"71","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.trpro.2020.09.008","article-title":"CAVs and roundabouts: Research on traffic impacts and design elements","volume":"49","author":"Anagnostopoulos","year":"2020","journal-title":"Transp. Res. Procedia"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Cuenca, L.G., Sanchez-Soriano, J., Puertas, E., Aliane, N., and Andr\u00e9s, J.F. (2019). Machine learning techniques for undertaking roundabouts in autonomous driving. Sensors, 19.","DOI":"10.3390\/s19102386"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6907\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:41:00Z","timestamp":1760179260000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6907"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,3]]},"references-count":39,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["s20236907"],"URL":"https:\/\/doi.org\/10.3390\/s20236907","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,12,3]]}}}