{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T23:36:28Z","timestamp":1778196988060,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":69,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,10,27]],"date-time":"2024-10-27T00:00:00Z","timestamp":1729987200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,10,27]]},"DOI":"10.1145\/3691620.3695067","type":"proceedings-article","created":{"date-parts":[[2024,10,18]],"date-time":"2024-10-18T15:39:19Z","timestamp":1729265959000},"page":"732-744","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Bridging the Gap between Real-world and Synthetic Images for Testing Autonomous Driving Systems"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-4312-7561","authenticated-orcid":false,"given":"Mohammad Hossein","family":"Amini","sequence":"first","affiliation":[{"name":"University of Ottawa, Ottawa, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0281-8231","authenticated-orcid":false,"given":"Shiva","family":"Nejati","sequence":"additional","affiliation":[{"name":"University of Ottawa, Ottawa, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,10,27]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","unstructured":"Replication package for the paper. 2024. [Online; accessed Aug 25 2024]. 10.5281\/zenodo.13372277","DOI":"10.5281\/zenodo.13372277"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2962027"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-023-10306-x"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3579642"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-023-10433-5"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-39742-4_12"},{"key":"e_1_3_2_1_7_1","first-page":"176","volume-title":"Proceedings of the 21th ACM\/IEEE International Conference on Model Driven Engineering Languages and Systems, MODELS 2018","author":"Gonz\u00e1lez Carlos A.","year":"2018","unstructured":"Carlos A. Gonz\u00e1lez, Mojtaba Varmazyar, Shiva Nejati, Lionel C. Briand, and Yago Isasi. Enabling model testing of cyber-physical systems. In Andrzej Wasowski, Richard F. Paige, and \u00d8ystein Haugen, editors, Proceedings of the 21th ACM\/IEEE International Conference on Model Driven Engineering Languages and Systems, MODELS 2018, Copenhagen, Denmark, October 14--19, 2018, pages 176--186. ACM, 2018."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2023.107286"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10710-017-9314-z"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.632"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.244"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.265"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.740"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2921336"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3202311"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-024-10458-4"},{"key":"e_1_3_2_1_17_1","volume-title":"17th IEEE International Conference on Software Testing, Verification and Validation (ICST 2024), 2024","author":"Lambertenghi Stefano Carlo","year":"1857","unstructured":"Stefano Carlo Lambertenghi and Andrea Stocco. Assessing quality metrics for neural reality gap input mitigation in autonomous driving testing. In 17th IEEE International Conference on Software Testing, Verification and Validation (ICST 2024), 2024. To appear. Available at https:\/\/arxiv.org\/abs\/2404.18577."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3361566"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3546947"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/2481023"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3643671"},{"key":"e_1_3_2_1_22_1","volume-title":"https:\/\/www.kaggle.com\/datasets\/andy8744\/udacity-self-driving-car-behavioural-cloning","author":"Dataset Udacity Jungle","year":"2023","unstructured":"Udacity Jungle Dataset. https:\/\/www.kaggle.com\/datasets\/andy8744\/udacity-self-driving-car-behavioural-cloning, 2023. [Online; accessed 29-November-2023]."},{"key":"e_1_3_2_1_23_1","volume-title":"https:\/\/www.cvlibs.net\/datasets\/kitti\/","author":"Dataset KITTI","year":"2023","unstructured":"KITTI Dataset. https:\/\/www.cvlibs.net\/datasets\/kitti\/, 2023. [Online; accessed 29-November-2023]."},{"key":"e_1_3_2_1_24_1","volume-title":"https:\/\/europe.naverlabs.com\/research\/computer-vision\/proxy-virtual-worlds-vkitti-1\/","author":"Dataset KITTI","year":"2023","unstructured":"vKITTI Dataset. https:\/\/europe.naverlabs.com\/research\/computer-vision\/proxy-virtual-worlds-vkitti-1\/, 2023. [Online; accessed 29-November-2023]."},{"key":"e_1_3_2_1_25_1","volume-title":"https:\/\/beamng.tech","year":"2023","unstructured":"BeamNG.tech Website. https:\/\/beamng.tech, 2023. [Online; accessed 3-March-2023]."},{"key":"e_1_3_2_1_26_1","volume-title":"https:\/\/github.com\/sbft-cps-tool-competition\/cps-tool-competition","author":"Github","year":"2023","unstructured":"Github repo for cyber-physical systems testing tool competition. https:\/\/github.com\/sbft-cps-tool-competition\/cps-tool-competition, 2023. [Online; accessed 10-April-2023]."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3672457"},{"key":"e_1_3_2_1_28_1","volume-title":"Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016","author":"Salimans Tim","year":"2016","unstructured":"Tim Salimans, Ian J. Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. Improved techniques for training gans. In Daniel D. Lee, Masashi Sugiyama, Ulrike von Luxburg, Isabelle Guyon, and Roman Garnett, editors, Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, December 5--10, 2016, Barcelona, Spain, pages 2226--2234, 2016."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01216-8_14"},{"key":"e_1_3_2_1_30_1","volume-title":"3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings","author":"Simonyan Karen","year":"2015","unstructured":"Karen Simonyan and Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. In Yoshua Bengio and Yann LeCun, editors, 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings, 2015. Available at https:\/\/arxiv.org\/abs\/1409.1556."},{"key":"e_1_3_2_1_31_1","volume-title":"Proceedings of the 29th International Conference on Machine Learning, ICML 2012","author":"Le Quoc V.","year":"2012","unstructured":"Quoc V. Le, Marc'Aurelio Ranzato, Rajat Monga, Matthieu Devin, Greg Corrado, Kai Chen, Jeffrey Dean, and Andrew Y. Ng. Building high-level features using large scale unsupervised learning. In Proceedings of the 29th International Conference on Machine Learning, ICML 2012, Edinburgh, Scotland, UK, June 26 - July 1, 2012, 2012. Available at https:\/\/icml.cc\/2012\/papers\/73.pdf."},{"key":"e_1_3_2_1_32_1","volume-title":"2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14--16, 2014, Conference Track Proceedings","author":"Diederik","year":"2014","unstructured":"Diederik P. Kingma and Max Welling. Auto-encoding variational bayes. In Yoshua Bengio and Yann LeCun, editors, 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14--16, 2014, Conference Track Proceedings, 2014. Available at https:\/\/arxiv.org\/abs\/1312.6114."},{"key":"e_1_3_2_1_33_1","first-page":"226","volume-title":"43rd IEEE\/ACM International Conference on Software Engineering, ICSE 2021","author":"Dola Swaroopa","year":"2021","unstructured":"Swaroopa Dola, Matthew B. Dwyer, and Mary Lou Soffa. Distribution-aware testing of neural networks using generative models. In 43rd IEEE\/ACM International Conference on Software Engineering, ICSE 2021, Madrid, Spain, 22--30 May 2021, pages 226--237. IEEE, 2021."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380353"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/IWSSIP48289.2020.9145130"},{"key":"e_1_3_2_1_36_1","volume-title":"https:\/\/cocodataset.org\/#home","author":"Coco","year":"2023","unstructured":"Coco challenge. https:\/\/cocodataset.org\/#home, 2023. Accessed: 2023-12-05."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/SBFT59156.2023.00010"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/SBFT59156.2023.00008"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409730"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7"},{"key":"e_1_3_2_1_41_1","volume-title":"https:\/\/unity.com","author":"Unity","year":"2023","unstructured":"Unity game engine. https:\/\/unity.com, 2023. Accessed: 2023-12-05."},{"key":"e_1_3_2_1_42_1","volume-title":"https:\/\/developer.nvidia.com\/blog\/deep-learning-self-driving-cars\/","author":"Nvidia","year":"2023","unstructured":"Nvidia dave2. https:\/\/developer.nvidia.com\/blog\/deep-learning-self-driving-cars\/, 2023. Accessed: 2023-12-05."},{"key":"e_1_3_2_1_43_1","volume-title":"https:\/\/github.com\/udacity\/self-driving-car\/tree\/master\/challenges\/challenge-2","author":"Udacity","year":"2023","unstructured":"Udacity self-driving challenge 2. https:\/\/github.com\/udacity\/self-driving-car\/tree\/master\/challenges\/challenge-2, 2023. Accessed: 2023-12-05."},{"key":"e_1_3_2_1_44_1","volume-title":"https:\/\/github.com\/ultralytics\/yolov5","year":"2023","unstructured":"Yolov5. https:\/\/github.com\/ultralytics\/yolov5, 2023. Accessed: 2023-12-05."},{"key":"e_1_3_2_1_45_1","volume-title":"Understanding Deep Learning: Application in Rare Event Prediction","author":"Ranjan Chitta","year":"2020","unstructured":"Chitta Ranjan. Understanding Deep Learning: Application in Rare Event Prediction. Connaissance Publishing, Dec 2020. URL: www.understandingdeeplearning.com."},{"key":"e_1_3_2_1_46_1","series-title":"JMLR Proceedings","first-page":"249","volume-title":"Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, AISTATS","author":"Glorot Xavier","year":"2010","unstructured":"Xavier Glorot and Yoshua Bengio. Understanding the difficulty of training deep feedforward neural networks. In Yee Whye Teh and D. Mike Titterington, editors, Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, AISTATS 2010, Chia Laguna Resort, Sardinia, Italy, May 13--15, 2010, volume 9 of JMLR Proceedings, pages 249--256. JMLR.org, 2010."},{"key":"e_1_3_2_1_47_1","volume-title":"https:\/\/github.com\/sbft-cps-tool-competition\/cps-tool-competition\/tree\/main\/sample_test_generators","author":"Test Generator Naive Random","year":"2023","unstructured":"Naive Random Test Generator. https:\/\/github.com\/sbft-cps-tool-competition\/cps-tool-competition\/tree\/main\/sample_test_generators, 2023. [Online; accessed 09-May-2024]."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2017.12"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-09982-4"},{"key":"e_1_3_2_1_50_1","volume-title":"https:\/\/beamngpy.readthedocs.io\/en\/latest\/beamngpy.html#beamngpy.api.vehicle.AIApi","author":"NG","year":"2023","unstructured":"BeamNG AI. https:\/\/beamngpy.readthedocs.io\/en\/latest\/beamngpy.html#beamngpy.api.vehicle.AIApi, 2023. [Online; accessed 09-May-2024]."},{"key":"e_1_3_2_1_51_1","volume-title":"Modern Control Systems. Pearson","author":"Dorf Richard C.","year":"2016","unstructured":"Richard C. Dorf. Modern Control Systems. Pearson, 13th edition, 2016.","edition":"13"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00104"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST46399.2020.00019"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180220"},{"key":"e_1_3_2_1_55_1","volume-title":"Towards high accuracy real-time object detection on edge gpus. https:\/\/developer.nvidia.com\/embedded\/community\/jetson-projects\/yolo_ret","year":"2023","unstructured":"Yolo-ret: Towards high accuracy real-time object detection on edge gpus. https:\/\/developer.nvidia.com\/embedded\/community\/jetson-projects\/yolo_ret, 2023. Accessed: 2023-12-05."},{"key":"e_1_3_2_1_56_1","volume-title":"https:\/\/developer.nvidia.com\/blog\/deep-learning-object-detection-digits\/","author":"Object Deep Learning","year":"2023","unstructured":"Deep Learning for Object Detection with DIGITS. https:\/\/developer.nvidia.com\/blog\/deep-learning-object-detection-digits\/, 2023. [Online; accessed 09-May-2024]."},{"key":"e_1_3_2_1_57_1","volume-title":"https:\/\/developer.nvidia.com\/blog\/large-scale-object-detection-tensorrt\/","author":"Large-Scale Object Accelerating","year":"2023","unstructured":"Accelerating Large-Scale Object Detection with TensorRT. https:\/\/developer.nvidia.com\/blog\/large-scale-object-detection-tensorrt\/, 2023. [Online; accessed 09-May-2024]."},{"key":"e_1_3_2_1_58_1","volume-title":"https:\/\/developer.nvidia.com\/blog\/deep-learning-self-driving-cars\/","author":"Self-Driving Cars End Deep","year":"2023","unstructured":"End-to-End Deep Learning for Self-Driving Cars. https:\/\/developer.nvidia.com\/blog\/deep-learning-self-driving-cars\/, 2023. [Online; accessed 09-May-2024]."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549111"},{"key":"e_1_3_2_1_60_1","volume-title":"https:\/\/github.com\/ApolloAuto\/apollo","author":"Platform Apollo","year":"2023","unstructured":"Apollo Platform. https:\/\/github.com\/ApolloAuto\/apollo, 2023. [Online; accessed 09-May-2024]."},{"key":"e_1_3_2_1_61_1","volume-title":"Open-source software for urban autonomous driving. https:\/\/github.com\/autowarefoundation\/autoware?tab=readme-ov-file","author":"Autoware","year":"2023","unstructured":"Autoware: Open-source software for urban autonomous driving. https:\/\/github.com\/autowarefoundation\/autoware?tab=readme-ov-file, 2023. [Online; accessed 09-May-2024]."},{"key":"e_1_3_2_1_62_1","first-page":"1","volume-title":"Proceedings of the 1st Annual Conference on Robot Learning","author":"Dosovitskiy Alexey","year":"2017","unstructured":"Alexey Dosovitskiy, German Ros, Felipe Codevilla, Antonio Lopez, and Vladlen Koltun. CARLA: An open urban driving simulator. In Proceedings of the 1st Annual Conference on Robot Learning, pages 1--16, 2017."},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2022.10.314"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST49551.2021.00036"},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST49551.2021.00050"},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW53098.2021.00084"},{"key":"e_1_3_2_1_67_1","first-page":"132","volume-title":"Proceedings of the 33rd ACM\/IEEE International Conference on Automated Software Engineering, ASE 2018","author":"Zhang Mengshi","year":"2018","unstructured":"Mengshi Zhang, Yuqun Zhang, Lingming Zhang, Cong Liu, and Sarfraz Khurshid. Deeproad: Gan-based metamorphic testing and input validation framework for autonomous driving systems. In Marianne Huchard, Christian K\u00e4stner, and Gordon Fraser, editors, Proceedings of the 33rd ACM\/IEEE International Conference on Automated Software Engineering, ASE 2018, Montpellier, France, September 3--7, 2018, pages 132--142. ACM, 2018."},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380422"},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01267-0_15"}],"event":{"name":"ASE '24: 39th IEEE\/ACM International Conference on Automated Software Engineering","location":"Sacramento CA USA","acronym":"ASE '24","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS"]},"container-title":["Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3691620.3695067","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3691620.3695067","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:04:07Z","timestamp":1750291447000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3691620.3695067"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,27]]},"references-count":69,"alternative-id":["10.1145\/3691620.3695067","10.1145\/3691620"],"URL":"https:\/\/doi.org\/10.1145\/3691620.3695067","relation":{},"subject":[],"published":{"date-parts":[[2024,10,27]]},"assertion":[{"value":"2024-10-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}