{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T11:35:19Z","timestamp":1775561719150,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T00:00:00Z","timestamp":1685059200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The current approach to connected and autonomous driving function development and evaluation uses model-in-the-loop simulation, hardware-in-the-loop simulation and limited proving ground use, followed by public road deployment of the beta version of software and technology. The rest of the road users are involuntarily forced into taking part in the development and evaluation of these connected and autonomous driving functions in this approach. This is an unsafe, costly and inefficient method. Motivated by these shortcomings, this paper introduces the Vehicle-in-Virtual-Environment (VVE) method of safe, efficient and low-cost connected and autonomous driving function development, evaluation and demonstration. The VVE method is compared to the existing state-of-the-art. Its basic implementation for a path-following task is used to explain the method where the actual autonomous vehicle operates in a large empty area with its sensor feeds being replaced by realistic sensor feeds corresponding to its location and pose in the virtual environment. It is possible to easily change the development virtual environment and inject rare and difficult events which can be tested very safely. Vehicle-to-Pedestrian (V2P) communication-based pedestrian safety is chosen as the application use case for the VVE in this paper, and corresponding experimental results are presented and discussed. A no-line-of-sight pedestrian and vehicle moving towards each other on intersecting paths with different speeds are used in the experiments. Their time-to-collision risk zone values are compared for determining severity levels. The severity levels are used to slow down or brake the vehicle. The results show that V2P communication of pedestrian location and heading can be used successfully to avoid possible collisions. It is noted that actual pedestrians and other vulnerable road users can be used very safely in this approach.<\/jats:p>","DOI":"10.3390\/s23115088","type":"journal-article","created":{"date-parts":[[2023,5,27]],"date-time":"2023-05-27T16:17:33Z","timestamp":1685204253000},"page":"5088","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Vehicle-in-Virtual-Environment (VVE) Method for Autonomous Driving System Development, Evaluation and Demonstration"],"prefix":"10.3390","volume":"23","author":[{"given":"Xincheng","family":"Cao","sequence":"first","affiliation":[{"name":"Automated Driving Lab, Ohio State University, 1320 Kinnear Rd, Columbus, OH 43212, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haochong","family":"Chen","sequence":"additional","affiliation":[{"name":"Automated Driving Lab, Ohio State University, 1320 Kinnear Rd, Columbus, OH 43212, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sukru Yaren","family":"Gelbal","sequence":"additional","affiliation":[{"name":"Automated Driving Lab, Ohio State University, 1320 Kinnear Rd, Columbus, OH 43212, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bilin","family":"Aksun-Guvenc","sequence":"additional","affiliation":[{"name":"Automated Driving Lab, Ohio State University, 1320 Kinnear Rd, Columbus, OH 43212, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8823-1820","authenticated-orcid":false,"given":"Levent","family":"Guvenc","sequence":"additional","affiliation":[{"name":"Automated Driving Lab, Ohio State University, 1320 Kinnear Rd, Columbus, OH 43212, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,26]]},"reference":[{"key":"ref_1","unstructured":"Guvenc, B.A., Guvenc, L., Ozturk, E.S., and Yigit, T. (2003, January 25). Model Regulator Based Individual Wheel Braking Control. Proceedings of the 2003 IEEE Conference on Control Applications, CCA 2003, Istanbul, Turkey."},{"key":"ref_2","first-page":"473","article-title":"The Limited Integrator Model Regulator and Its Use in Vehicle Steering Control","volume":"26","author":"Guvenc","year":"2002","journal-title":"Turk. J. Eng. Environ. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Oncu, S., Karaman, S., Guvenc, L., Ersolmaz, S.S., Ozturk, E.S., Cetin, E., and Sinal, M. (2007, January 13\u201315). Robust Yaw Stability Controller Design for a Light Commercial Vehicle Using a Hardware in the Loop Steering Test Rig. Proceedings of the 2007 IEEE Intelligent Vehicles Symposium, Istanbul, Turkey.","DOI":"10.1109\/IVS.2007.4290223"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1109\/TCST.2019.2949539","article-title":"Yaw Rate and Sideslip Angle Control Through Single Input Single Output Direct Yaw Moment Control","volume":"29","author":"Lenzo","year":"2021","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MITS.2014.2336271","article-title":"Three Decades of Driver Assistance Systems: Review and Future Perspectives","volume":"6","author":"Bengler","year":"2014","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Guven\u00e7, L., Guven\u00e7, B.A., Demirel, B., and Emirler, M.T. (2017). Control of Mechatronic Systems, The Institute of Engineering and Technology. IET Control, Robotics and Sensors Series.","DOI":"10.1049\/PBCE104E"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Boyali, A., and Guvenc, L. (2010, January 10\u201313). Real-Time Controller Design for a Parallel Hybrid Electric Vehicle Using Neuro-Dynamic Programming Method. Proceedings of the 2010 IEEE International Conference on Systems, Man and Cybernetics, Istanbul, Turkey.","DOI":"10.1109\/ICSMC.2010.5641785"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1826","DOI":"10.1109\/TITS.2019.2913998","article-title":"A Review of Motion Planning for Highway Autonomous Driving","volume":"21","author":"Claussmann","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.mechatronics.2017.11.009","article-title":"Real Time Implementation of Socially Acceptable Collision Avoidance of a Low Speed Autonomous Shuttle Using the Elastic Band Method","volume":"50","author":"Wang","year":"2018","journal-title":"Mechatronics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3135","DOI":"10.1109\/TITS.2019.2926042","article-title":"Is it Safe to Drive? An Overview of Factors, Metrics, and Datasets for Driveability Assessment in Autonomous Driving","volume":"21","author":"Guo","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1109\/TCST.2008.2012116","article-title":"Real-Time Motion Planning With Applications to Autonomous Urban Driving","volume":"17","author":"Kuwata","year":"2009","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"58443","DOI":"10.1109\/ACCESS.2020.2983149","article-title":"A Survey of Autonomous Driving: Common Practices and Emerging Technologies","volume":"8","author":"Yurtsever","year":"2020","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1109\/JIOT.2018.2812300","article-title":"A Survey of the State-of-the-Art Localization Techniques and Their Potentials for Autonomous Vehicle Applications","volume":"5","author":"Kuutti","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Meneses-Cime, K., Guvenc, L., and Aksun-Guvenc, B. (2022). Optimization of On-Demand Shared Autonomous Vehicle Deployments Utilizing Reinforcement Learning. Sensors, 22.","DOI":"10.3390\/s22218317"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1007\/s12239-021-0066-7","article-title":"Simulating the Effect of Autonomous Vehicles on Roadway Mobility in a Microscopic Traffic Simulator","volume":"22","author":"Lackey","year":"2021","journal-title":"Int. J. Automot. Technol."},{"key":"ref_16","first-page":"258","article-title":"Fuel Economy Benefit Analysis of Pass-at-Green (PaG) V2I Application on Urban Routes with STOP Signs","volume":"83","author":"Cantas","year":"2021","journal-title":"Int. J. Veh. Des."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"123056","DOI":"10.1016\/j.jclepro.2020.123056","article-title":"Cooperative Ecological Cruising Using Hierarchical Control Strategy with Optimal Sustainable Performance for Connected Automated Vehicles on Varying Road Conditions","volume":"275","author":"Yang","year":"2020","journal-title":"J. Clean. Prod."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kavas-Torris, O., and Guvenc, L. (2023, May 06). A Comprehensive Eco-Driving Strategy for Connected and Autonomous Vehicles (CAVs) with Microscopic Traffic Simulation Testing Evaluation. Available online: https:\/\/arxiv.org\/abs\/2206.08306\/.","DOI":"10.3390\/s23208416"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kavas-Torris, O., Cantas, M.R., Cime, K.M., Guvenc, B.A., and Guvenc, L. (2020). The Effects of Varying Penetration Rates of L4\u2013L5 Autonomous Vehicles on Fuel Efficiency and Mobility of Traffic Networks, SAE International.","DOI":"10.4271\/2020-01-0137"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Guvenc, L., Aksun-Guvenc, B., Zhu, S., and Gelbal, S.Y. (2021). Autonomous Road Vehicle Path Planning and Tracking Control, John Wiley & Sons.","DOI":"10.1002\/9781119747970"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gelbal, S.Y., Cantas, M.R., Guvenc, B.A., Guvenc, L., Surnilla, G., and Zhang, H. (2022). Mobile Safety Application for Pedestrians Utilizing P2V Communication over Bluetooth, SAE International.","DOI":"10.4271\/2022-01-0155"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1007\/s12239-020-0087-7","article-title":"Collision Avoidance of Low Speed Autonomous Shuttles with Pedestrians","volume":"21","author":"Gelbal","year":"2020","journal-title":"Int. J. Automot. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1007\/s12239-018-0034-z","article-title":"Design and Evaluation of Robust Cooperative Adaptive Cruise Control Systems in Parameter Space","volume":"19","author":"Emirler","year":"2018","journal-title":"Int. J. Automot. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"9660","DOI":"10.1109\/TVT.2019.2937562","article-title":"Parameter-Space Based Robust Gain-Scheduling Design of Automated Vehicle Lateral Control","volume":"68","author":"Zhu","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_25","unstructured":"Templeton, B. (2023, April 13). Waymo and Cruise Have Both Hit 1M Miles with No Driver, But Waymo Publishes Detailed Safety Data. Available online: https:\/\/www.forbes.com\/sites\/bradtempleton\/2023\/02\/28\/waymo-and-cruise-have-both-hit-1m-miles-with-no-driver-but-waymo-published-detailed-safety-data\/."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Tierno, A., Santos, M., Arruda, B., and Rosa, J. (2016, January 20\u201323). Open Issues for the Automotive Software Testing. Proceedings of the 2016 12th IEEE International Conference on Industry Applications (INDUSCON), Curitiba, Brazil.","DOI":"10.1109\/INDUSCON.2016.7874609"},{"key":"ref_27","unstructured":"Guvenc, L., Guvenc, B.A., and Emirler, M.T. (2017). Internet of Things and Data Analytics Handbook, John Wiley & Sons, Ltd."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1049\/iet-its.2019.0678","article-title":"Integrating Tools for an Effective Testing of Connected and Automated Vehicles Technologies","volume":"14","author":"Pariota","year":"2020","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"151531","DOI":"10.1109\/ACCESS.2021.3125620","article-title":"Autonomous Vehicle Evaluation: A Comprehensive Survey on Modeling and Simulation Approaches","volume":"9","author":"Alghodhaifi","year":"2021","journal-title":"IEEE Access"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1109\/TIV.2019.2919470","article-title":"A Novel Integrated Simulation and Testing Platform for Self-Driving Cars With Hardware in the Loop","volume":"4","author":"Chen","year":"2019","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Gelbal, S.Y., Tamilarasan, S., Cantas, M.R., Guvenc, L., and Aksun-Guvenc, B. (2017, January 5\u20138). A Connected and Autonomous Vehicle Hardware-in-the-Loop Simulator for Developing Automated Driving Algorithms. Proceedings of the 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, AB, Canada.","DOI":"10.1109\/SMC.2017.8123155"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1504\/IJVD.2016.078776","article-title":"2016, Vehicle Dynamics Modelling and Validation for a Hardware-in-the-Loop Vehicle Simulator","volume":"71","author":"Emirler","year":"2016","journal-title":"Int. J. Veh. Des."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3301","DOI":"10.4271\/2020-01-0706","article-title":"Pre-Deployment Testing of Low Speed, Urban Road Autonomous Driving in a Simulated Environment","volume":"2","author":"Li","year":"2020","journal-title":"SAE Int. J. Adv. Curr. Prac. Mobil."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Takeuchi, E., and Tsubouchi, T. (2006, January 9\u201313). A 3-D Scan Matching Using Improved 3-D Normal Distributions Transform for Mobile Robotic Mapping. Proceedings of the 2006 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Beijing, China.","DOI":"10.1109\/IROS.2006.282246"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Magnusson, M., Vaskevicius, N., Stoyanov, T., Pathak, K., and Birk, A. (2015, January 26\u201330). Beyond Points: Evaluating Recent 3D Scan-Matching Algorithms. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139703"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Suzuki, R., Kataoka, R., Ji, Y., Umeda, K., Fujii, H., and Kono, H. (2020, January 9\u201311). SLAM Using ICP and Graph Optimization Considering Physical Properties of Environment. Proceedings of the 2020 21st International Conference on Research and Education in Mechatronics (REM), Cracow, Poland.","DOI":"10.1109\/REM49740.2020.9313074"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"5975","DOI":"10.1109\/TSMC.2021.3131141","article-title":"System and Experiments of Model-Driven Motion Planning and Control for Autonomous Vehicles","volume":"52","author":"Xu","year":"2022","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_38","unstructured":"(2023, April 13). Vehicle-in-Virtual-Environment Method for Autonomous Driving System Development and Evaluation. Available online: https:\/\/oied.osu.edu\/technologies\/vehicle-virtual-environment-method-autonomous-driving-system-development-and-evaluation."},{"key":"ref_39","unstructured":"Cime, K.M., Cantas, M.R., Dowd, G., Guvenc, L., Guvenc, B.A., Mittal, A., Joshi, A., and Fishelson, J. (2020). Hardware-in-the-Loop, Traffic-in-the-Loop and Software-in-the-Loop Autonomous Vehicle Simulation for Mobility Studies, SAE International."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2509","DOI":"10.4271\/2021-01-0163","article-title":"Assessing the Access to Jobs by Shared Autonomous Vehicles in Marysville, Ohio: Modeling, Simulating and Validating","volume":"3","author":"Cime","year":"2021","journal-title":"SAE Int. J. Adv. Curr. Pract. Mobil."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Hussein, A., Garc\u00eda, F., Armingol, J.M., and Olaverri-Monreal, C. (2016, January 1\u20134). P2V and V2P Communication for Pedestrian Warning on the Basis of Autonomous Vehicles. Proceedings of the 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, Brazil.","DOI":"10.1109\/ITSC.2016.7795885"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Li, C.-Y., Salinas, G., Huang, P.-H., Tu, G.-H., Hsu, G.-H., and Hsieh, T.-Y. (2018, January 20\u201324). V2PSense: Enabling Cellular-Based V2P Collision Warning Service through Mobile Sensing. Proceedings of the 2018 IEEE International Conference on Communications (ICC), Kansas City, MO, USA.","DOI":"10.1109\/ICC.2018.8422981"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Tahir, M.N., M\u00e4enp\u00e4\u00e4, K., and Hippi, M. (2020, January 17\u201319). Pedestrian Motion Detection & Pedestrian Communication (P2I & V2P). Proceedings of the 2020 International Conference on Software, Telecommunications and Computer Networks (SoftCOM), Split, Croatia.","DOI":"10.23919\/SoftCOM50211.2020.9238338"},{"key":"ref_44","unstructured":"(2010). IEEE Standard for Information Technology\u2013Local and Metropolitan Area Networks\u2013Specific Requirements\u2013Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications Amendment 6: Wireless Access in Vehicular Environments (Standard No. 802.11p-2010)."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Gr\u00e4fling, S., M\u00e4h\u00f6nen, P., and Riihij\u00e4rvi, J. (2010, January 16\u201318). Performance Evaluation of IEEE 1609 WAVE and IEEE 802.11p for Vehicular Communications. Proceedings of the 2010 Second International Conference on Ubiquitous and Future Networks (ICUFN), Jeju Island, South Korea.","DOI":"10.1109\/ICUFN.2010.5547184"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Gheorghiu, R.A., Cormos, A.C., Stan, V.A., and Iordache, V. (July, January 29). Overview of Network Topologies for V2X Communications. Proceedings of the 2017 9th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), Targoviste, Romania.","DOI":"10.1109\/ECAI.2017.8166427"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1145\/3161587.3161593","article-title":"An Overview of 3GPP Cellular Vehicle-to-Everything Standards","volume":"21","author":"Wang","year":"2017","journal-title":"GetMobile Mob. Comp. Comm."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Janeba, M., Lehoczk\u00fd, P., Galinski, M., Milesich, T., Danko, J., and Kotuliak, I. (2022, January 25\u201326). Evaluation of LTE and 5G Qualitative Parameters for V2X Use Cases. Proceedings of the 2022 IEEE Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, Serbia.","DOI":"10.1109\/ZINC55034.2022.9840619"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Ahmed, M.S., Hoque, M.A., and Khattak, A.J. (2016, January 8\u201310). Demo: Real-Time Vehicle Movement Tracking on Android Devices through Bluetooth Communication with DSRC Devices. Proceedings of the 2016 IEEE Vehicular Networking Conference (VNC), Columbus, OH, USA.","DOI":"10.1109\/VNC.2016.7835956"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Gheorghiu, R.A., Iordache, V., and Cormos, A.C. (2017, January 5\u20137). Analysis of Handshake Time for Bluetooth Communications to Be Implemented in Vehicular Environments. Proceedings of the 2017 40th International Conference on Telecommunications and Signal Processing (TSP), Barcelona, Spain.","DOI":"10.1109\/TSP.2017.8075955"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/5088\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:42:40Z","timestamp":1760125360000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/5088"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,26]]},"references-count":50,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["s23115088"],"URL":"https:\/\/doi.org\/10.3390\/s23115088","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,26]]}}}