{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,24]],"date-time":"2025-10-24T13:15:05Z","timestamp":1761311705393,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T00:00:00Z","timestamp":1606435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["723051"],"award-info":[{"award-number":["723051"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>While extracting meaningful information from big data is getting relevance, literature lacks information on how to handle sensitive data by different project partners in order to collectively answer research questions (RQs), especially on impact assessment of new automated driving technologies. This paper presents the application of an established reference piloting methodology and the consequent development of a coherent, robust workflow. Key challenges include ensuring methodological soundness and data validity while protecting partners\u2019 intellectual property. The authors draw on their experiences in a 34-partner project aimed at assessing the impact of advanced automated driving functions, across 10 European countries. In the first step of the workflow, we captured the quantitative requirements of each RQ in terms of the relevant data needed from the tests. Most of the data come from vehicular sensors, but subjective data from questionnaires are processed as well. Next, we set up a data management process involving several partners (vehicle manufacturers, research institutions, suppliers and developers), with different perspectives and requirements. Finally, we deployed the system so that it is fully integrated within the project big data toolchain and usable by all the partners. Based on our experience, we highlight the importance of the reference methodology to theoretically inform and coherently manage all the steps of the project and the need for effective and efficient tools, in order to support the everyday work of all the involved research teams, from vehicle manufacturers to data analysts.<\/jats:p>","DOI":"10.3390\/s20236773","type":"journal-article","created":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T02:13:51Z","timestamp":1606443231000},"page":"6773","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Managing Big Data for Addressing Research Questions in a Collaborative Project on Automated Driving Impact Assessment"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4109-4675","authenticated-orcid":false,"given":"Francesco","family":"Bellotti","sequence":"first","affiliation":[{"name":"Department of Electrical, Electronics and Telecommunication Engineering and Naval Architecture (DITEN), University of Genova, 16145 Genova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4953-1593","authenticated-orcid":false,"given":"Nisrine","family":"Osman","sequence":"additional","affiliation":[{"name":"Department of Electrical, Electronics and Telecommunication Engineering and Naval Architecture (DITEN), University of Genova, 16145 Genova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7896-7252","authenticated-orcid":false,"given":"Eduardo H.","family":"Arnold","sequence":"additional","affiliation":[{"name":"Warwick Manufacturing Group (WMG), University of Warwick, Coventry CV4 7AL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8109-6953","authenticated-orcid":false,"given":"Sajjad","family":"Mozaffari","sequence":"additional","affiliation":[{"name":"Warwick Manufacturing Group (WMG), University of Warwick, Coventry CV4 7AL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Satu","family":"Innamaa","sequence":"additional","affiliation":[{"name":"VTT Technical Research Centre of Finland Ltd., P.O. Box 1000, FI-02044 VTT Espoo, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6577-6369","authenticated-orcid":false,"given":"Tyron","family":"Louw","sequence":"additional","affiliation":[{"name":"Institute for Transport Studies, University Road, University of Leeds, Leeds LS2 9JT, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guilhermina","family":"Torrao","sequence":"additional","affiliation":[{"name":"VTT Technical Research Centre of Finland Ltd., P.O. Box 1000, FI-02044 VTT Espoo, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hendrik","family":"Weber","sequence":"additional","affiliation":[{"name":"Institute for Automotive Engineering, RWTH Aachen University, Steinbachstr 7, 52074 Aachen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1835-6067","authenticated-orcid":false,"given":"Johannes","family":"Hiller","sequence":"additional","affiliation":[{"name":"Institute for Automotive Engineering, RWTH Aachen University, Steinbachstr 7, 52074 Aachen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alessandro","family":"De Gloria","sequence":"additional","affiliation":[{"name":"Department of Electrical, Electronics and Telecommunication Engineering and Naval Architecture (DITEN), University of Genova, 16145 Genova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mehrdad","family":"Dianati","sequence":"additional","affiliation":[{"name":"Warwick Manufacturing Group (WMG), University of Warwick, Coventry CV4 7AL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1937-3969","authenticated-orcid":false,"given":"Riccardo","family":"Berta","sequence":"additional","affiliation":[{"name":"Department of Electrical, Electronics and Telecommunication Engineering and Naval Architecture (DITEN), University of Genova, 16145 Genova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1177\/0306312705055535","article-title":"Collaborative Research across Disciplinary and Organizational Boundaries","volume":"35","author":"Cummings","year":"2005","journal-title":"Soc. Stud. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1022","DOI":"10.1016\/j.ijproman.2015.02.001","article-title":"Managing collaborative research projects: A synthesis of project management literature and directives for future research","volume":"33","author":"Lippe","year":"2015","journal-title":"Int. J. Proj. Manag."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"P\u00e9rez-Padillo, J., Garc\u00eda Morillo, J., Ramirez-Faz, J., Torres Rold\u00e1n, M., and Montesinos, P. (2020). Design and Implementation of a Pressure Monitoring System Based on IoT for Water Supply Networks. Sensors, 20.","DOI":"10.3390\/s20154247"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1016\/j.trf.2018.11.006","article-title":"Automated driving reduces perceived workload, but monitoring causes higher cognitive load than manual driving","volume":"60","author":"Stapel","year":"2019","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2847","DOI":"10.1109\/ACCESS.2019.2962554","article-title":"Multi-Sensor Fusion in Automated Driving: A Survey","volume":"8","author":"Wang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1576","DOI":"10.1109\/TITS.2012.2196273","article-title":"Highly Automated Driving on Freeways in Real Traffic Using a Probabilistic Framework","volume":"13","author":"Ardelt","year":"2012","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_7","unstructured":"Hibberd, D., Louw, T., Aittoniemi, E., Brouwer, R., Dotzauer, M., Fahrenkrog, F., Innamaa, S., Kuisma, A., Merat, N., and Metz, B. (2020, November 25). Deliverable D3.1 from Research Questions to Logging Requirements; Deliverable D3.1 of L3Pilot Project funded under the European Union\u2019s Horizon 2020 research and innovation programme GA No: 723051. Available online: https:\/\/l3pilot.eu\/download\/."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2188","DOI":"10.1016\/j.trpro.2016.05.234","article-title":"Methodology for Field Operational Tests of Automated Vehicles\u2019","volume":"14","author":"Barnard","year":"2016","journal-title":"Transp. Res. Procedia"},{"key":"ref_9","first-page":"211","article-title":"Risk Assessment in Multi-Disciplinary (Software+) Engineering Projects. International Journal of Software Engineering and Knowledge Engineering (IJSEKE)","volume":"21","author":"Biffl","year":"2011","journal-title":"Spec. Session Risk Assess."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bhatia, J., Breaux, T.D., Friedberg, L., Hibshi, H., and Smullen, D. (2016, January 24\u201328). Privacy Risk in Cybersecurity Data Sharing. Proceedings of the 2016 ACM on Workshop on Information Sharing and Collaborative Security (WISCS \u201916), Vienna, Austria.","DOI":"10.1145\/2994539.2994541"},{"key":"ref_11","unstructured":"Fioretto, F., and Van Hentenryck, P. (2019, January 13\u201317). Privacy-Preserving Federated Data Sharing. Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS \u201919), Montreal, QC, Canada."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Mehdizadeh, A., Cai, M., Hu, Q., Alamdar Yazdi, M., Mohabbati-Kalejahi, N., Vinel, A., Rigdon, S., Davis, K., and Megahed, F. (2020). A Review of Data Analytic Applications in Road Traffic Safety. Part 1: Descriptive and Predictive Modeling. Sensors, 20.","DOI":"10.3390\/s20041107"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.ijproman.2008.02.008","article-title":"Integrating diverse knowledge through boundary spanning processes\u2014The case of multidisciplinary project teams","volume":"27","author":"Ratcheva","year":"2009","journal-title":"Int. J. Proj. Manag."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Winkler, D., Ekaputra, F.J., Serral, E., and Biffl, S. (2014, January 16\u201319). Efficient data integration and communication issues in distributed engineering projects and project consortia. Proceedings of the 14th International Conference on Knowledge Technologies and Data-driven Business (i-KNOW \u201914), Graz, Austria.","DOI":"10.1145\/2637748.2638442"},{"key":"ref_15","unstructured":"Benmimoun, M., and Benmimoun, A. (2010, January 25\u201329). Large-Scale FOT for Analyzing the Impacts of Advanced Driver Assistance Systems. Proceedings of the 17th ITS World Congress 2010, Busan, Korea."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Burzio, G., Mussino, G., Tadei, R., Perboli, G., Dell\u2019Amico, M., and Guidotti, L. (2009, January 21\u201323). A subjective field test on lane departure warning function in the framework of the euroFOT project. Proceedings of the 2nd Conference on Human System Interactions, Catania, Italy.","DOI":"10.1109\/HSI.2009.5091047"},{"key":"ref_17","unstructured":"FOT-Net & CARTRE (2020, November 25). FESTA Handbook. Version 7. Available online: https:\/\/connectedautomateddriving.eu\/wp-content\/uploads\/2019\/01\/FESTA-Handbook-Version-7.pdf."},{"key":"ref_18","unstructured":"(2020, July 31). Adaptive Project Final Report. Available online: http:\/\/www.adaptive-ip.eu\/files\/adaptive\/content\/downloads\/AdaptIVe-SP1-v1-0-DL-D1-0-Final_Report.pdf."},{"key":"ref_19","unstructured":"Schulze, M., M\u00e4kinen, T., Kessel, T., Metzner, S., and Stoyanov, H. (2020, July 31). Final Report (D11.6) of DriveC2X. Available online: https:\/\/www.eict.de\/fileadmin\/redakteure\/Projekte\/DriveC2X\/Deliverables\/DRIVE_C2X_D11_6_Final_report__full_version_.pdf."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Boban, M., and d\u2019Orey, P.M. (2014, January 3\u20135). Measurement-based evaluation of cooperative awareness for V2V and V2I communication. Proceedings of the 2014 IEEE Vehicular Networking Conference (VNC), Paderborn, Germany.","DOI":"10.1109\/VNC.2014.7013302"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2227","DOI":"10.1016\/j.trpro.2016.05.238","article-title":"Data Sharing of Transport Research Data","volume":"14","author":"Gellerman","year":"2016","journal-title":"Transp. Res. Procedia"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1109\/TII.2018.2850005","article-title":"TEAM applications for Collaborative Road Mobility","volume":"15","author":"Bellotti","year":"2019","journal-title":"IEEE Trans. Ind. Inf."},{"key":"ref_23","unstructured":"Metz, B., R\u00f6sener, C., Louw, T., Aittoniemi, E., Bjorvatn, A., W\u00f6rle, J., Weber, H., Torrao, G., Silla, A., and Innamaa, S. (2020, November 25). Deliverable D3.3 Evaluation Methods; Deliverable D3.3 of L3PilotS Project funded under the European Union\u2019s Horizon 2020 research and innovation programme GA No: 723051. Available online: https:\/\/l3pilot.eu\/download\/."},{"key":"ref_24","unstructured":"Innamaa, S., Aittoniemi, E., Bjorvatn, A., Borrack, M., Di Lillo, L., Fahrenkrog, F., Gwehenberger, J., Lehtonen, E., Louw, T., and Malin, F. (2020, November 25). Deliverable D3.4 Evaluation Plan; Deliverable D3.4 of L3Pilot Project funded under the European Union\u2019s Horizon 2020 research and innovation programme GA No: 723051. Available online: https:\/\/l3pilot.eu\/download\/."},{"key":"ref_25","unstructured":"Hiller, J., Svanberg, E., Koskinen, S., Bellotti, F., and Osman, N. (2019, January 10\u201313). The L3Pilot Common Data Format\u2014Enabling efficient automated driving data analysis. Proceedings of the 26th International Technical Conference on the Enhanced Safety of Vehicles, Eindhoven, The Netherlands."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hiller, J., Koskinen, S., Berta, R., Osman, N., Nagy, B., Bellotti, F., Rahman, A., Svanberg, E., Weber, H., and Arnold, E.H. (2020). The L3Pilot Data Management Toolchain for a Level 3 Vehicle Automation Pilot. Electronics, 9.","DOI":"10.3390\/electronics9050809"},{"key":"ref_27","unstructured":"Innamaa, S., Merat, N., Louw, T., Metz, B., Streubel, T., and R\u00f6sener, C. (2019, January 21\u201325). Methodological challenges related to real-world automated driving pilots. Proceedings of the ITS World Congress, Singapore."},{"key":"ref_28","unstructured":"(2020, July 31). L3Pilot Common Data Format. Available online: https:\/\/github.com\/l3pilot\/l3pilot-cdf."},{"key":"ref_29","unstructured":"Louw, T., Merat, N., Metz, B., W\u00f6rle, J., Torrao, G., and Satu, I. (2020, January 27\u201330). Assessing user behaviour and acceptance in real-world automated driving: The L3Pilot project approach. Proceedings of the 8th Transport Research Arena TRA 2020, Helsinki, Finland."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1145\/344816.344869","article-title":"A survey of logical models for OLAP databases","volume":"28","author":"Vassiliadis","year":"1999","journal-title":"SIGMOD Rec."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Berta, R., Kobeissi, A., Bellotti, F., and De Gloria, A. (2020). Atmosphere, an Open Source Measurement-Oriented Data Framework for IoT. IEEE Trans. Ind. Inform.","DOI":"10.1109\/TII.2020.2994414"},{"key":"ref_32","unstructured":"(2020, July 31). Measurify. Available online: https:\/\/github.com\/measurify."},{"key":"ref_33","unstructured":"Macrae, C. (2018). Vue. js: Up and Running: Building Accessible and Performant Web Apps, O\u2019Reilly Media, Inc."},{"key":"ref_34","unstructured":"Wohlgethan, E. (2018). Supporting Web Development Decisions by Comparing Three Major JavaScript Frameworks: Angular, React and Vue. Js. [Ph.D. Thesis, Hochschule f\u00fcr Angewandte Wissenschaften Hamburg]."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6773\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:38:06Z","timestamp":1760179086000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6773"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,27]]},"references-count":34,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["s20236773"],"URL":"https:\/\/doi.org\/10.3390\/s20236773","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,11,27]]}}}