{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,2]],"date-time":"2025-07-02T11:49:41Z","timestamp":1751456981902,"version":"3.41.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,4,19]],"date-time":"2023-04-19T00:00:00Z","timestamp":1681862400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["CCF-1813567"],"award-info":[{"award-number":["CCF-1813567"]}]},{"name":"National Science Foundation","award":["ACI-1548562"],"award-info":[{"award-number":["ACI-1548562"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Cyber-Phys. Syst."],"published-print":{"date-parts":[[2023,4,30]]},"abstract":"<jats:p>\n            Today's automotive cyber-physical systems for autonomous driving aim to enhance driving safety by replacing the uncertainties posed by human drivers with standard procedures of automated systems. However, the accuracy of in-vehicle perception systems may significantly vary under different operational conditions (e.g., fog density, light condition, etc.) and consequently degrade the reliability of autonomous driving. A perception system for autonomous driving must be carefully validated with an extremely large dataset collected under all possible operational conditions in order to ensure its robustness. The aforementioned dataset required for validation, however, is expensive or even impossible to acquire in practice, since most operational corners rarely occur in a real-world environment. In this paper, we propose to generate synthetic datasets at a variety of operational corners by using a\n            <jats:bold>parameterized cycle-consistent generative adversarial network (PCGAN)<\/jats:bold>\n            . The proposed PCGAN is able to learn from an image dataset recorded at real-world operational conditions with only a few samples at corners and synthesize a large dataset at a given operational corner. By taking STOP sign detection as an example, our numerical experiments demonstrate that the proposed approach is able to generate high-quality synthetic datasets to facilitate accurate validation.\n          <\/jats:p>","DOI":"10.1145\/3571286","type":"journal-article","created":{"date-parts":[[2023,1,20]],"date-time":"2023-01-20T11:06:24Z","timestamp":1674212784000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Data-Driven Parameterized Corner Synthesis for Efficient Validation of Perception Systems for Autonomous Driving"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4904-8991","authenticated-orcid":false,"given":"Handi","family":"Yu","sequence":"first","affiliation":[{"name":"Duke University, Durham, NC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4510-2436","authenticated-orcid":false,"given":"Xin","family":"Li","sequence":"additional","affiliation":[{"name":"Duke University, Durham, NC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,4,19]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3170500"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/MDAT.2016.2573598"},{"key":"e_1_3_1_4_2","unstructured":"Society of Automotive Engineers International. 2018. Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. J3016_201806."},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.5555\/1395073.1395077"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/2502524.2502530"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2018.2841339"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/RTAS.2017.33"},{"key":"e_1_3_1_9_2","first-page":"406","article-title":"Simulation of rain in videos","volume":"2","author":"Starik S.","year":"2003","unstructured":"S. Starik and M. Werman. 2003. Simulation of rain in videos. Texture Workshop, ICCV 2 (2003), 406\u2013409.","journal-title":"Texture Workshop, ICCV"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141985"},{"key":"e_1_3_1_11_2","first-page":"233","article-title":"Simulation of falling rain for robustness testing of video-based surround sensing systems","author":"Hospach D.","year":"2016","unstructured":"D. Hospach et al. 2016. Simulation of falling rain for robustness testing of video-based surround sensing systems. Design, Automation & Test in Europe Conference & Exhibition (2016), 233\u2013236.","journal-title":"Design, Automation & Test in Europe Conference & Exhibition"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2015.2405013"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2014.2331177"},{"key":"e_1_3_1_14_2","unstructured":"M. Zhang et al. 2018. DeepRoad: GAN-based metamorphic autonomous driving system testing. arXiv preprint . arXiv:1802.02295."},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASPDAC.2018.8297275"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD.2017.8203887"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aaw0863"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPS.2018.00038"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/2967503"},{"key":"e_1_3_1_20_2","unstructured":"D. Zhao and H. Peng. 2020. From the lab to the street: Solving the challenge of accelerating automated vehicle testing. arXiv preprint . arXiv:1707.04792."},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2912149"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/IVS.2011.5940567"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICVES.2012.6294288"},{"key":"e_1_3_1_24_2","first-page":"153","article-title":"Demo abstract: Co-simulation framework for autonomous driving systems with MATLAB\/Simulink","author":"Tokunaga S.","year":"2017","unstructured":"S. Tokunaga and T. Azumi. 2017. Demo abstract: Co-simulation framework for autonomous driving systems with MATLAB\/Simulink. IEEE Real-Time and Embedded Technology and Applications Symposium (2017), 153\u2013154.","journal-title":"IEEE Real-Time and Embedded Technology and Applications Symposium"},{"key":"e_1_3_1_25_2","first-page":"2672","volume-title":"International Conference on Neural Information Processing Systems","author":"Goodfellow I.","year":"2014","unstructured":"I. Goodfellow et al. 2014. Generative adversarial nets. International Conference on Neural Information Processing Systems. 2672\u20132680."},{"key":"e_1_3_1_26_2","doi-asserted-by":"crossref","unstructured":"L. Yang et al. 2018. Real-to-virtual domain unification for end-to-end autonomous driving. arXiv preprint . arXiv:1801.03458.","DOI":"10.1007\/978-3-030-01225-0_33"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.244"},{"key":"e_1_3_1_28_2","unstructured":"A. Radford et al. 2015. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint . arXiv:1511.06434."},{"key":"e_1_3_1_29_2","doi-asserted-by":"crossref","unstructured":"W. Qiu and A. Yuille. 2016. UnrealCV: Connecting computer vision to unreal engine. arXiv preprint . arXiv:1609.01326.","DOI":"10.1007\/978-3-319-49409-8_75"},{"key":"e_1_3_1_30_2","unstructured":"A. Dosovitskiy et al. 2017. CARLA: An open urban driving simulator. arXiv preprint . arXiv:1711.03938."},{"key":"e_1_3_1_31_2","doi-asserted-by":"crossref","unstructured":"S. R. Richter et al. 2016. Playing for data: Ground truth from computer games. arXiv preprint . arXiv:1608.02192.","DOI":"10.1007\/978-3-319-46475-6_7"},{"key":"e_1_3_1_32_2","first-page":"1486","article-title":"Deep generative image models using a Laplacian pyramid of adversarial networks","author":"Denton E. L.","year":"2015","unstructured":"E. L. Denton et al. 2015. Deep generative image models using a Laplacian pyramid of adversarial networks. Advances in Neural Information Processing Systems (2015), 1486\u20131494.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_33_2","article-title":"Image-to-image translation with conditional adversarial networks","author":"Isola P.","year":"2017","unstructured":"P. Isola et al. 2017. Image-to-image translation with conditional adversarial networks. IEEE Conference on Computer Vision and Pattern Recognition (2017).","journal-title":"IEEE Conference on Computer Vision and Pattern Recognition"},{"issue":"15","key":"e_1_3_1_34_2","first-page":"48:1\u201348:17","article-title":"Yes, we GAN: Applying adversarial techniques for autonomous driving","author":"Uricar M.","year":"2019","unstructured":"M. Uricar et al. 2019. Yes, we GAN: Applying adversarial techniques for autonomous driving. Electronic Imaging 15, (2019), 48:1\u201348:17.","journal-title":"Electronic Imaging"},{"key":"e_1_3_1_35_2","unstructured":"Vaisala. Visibility sensors PWD10 PWD20 and PWD20W. https:\/\/www.vaisala.com\/en\/products\/instruments-sensors-and-other-measurement-devices\/weather-stations-and-sensors\/pwd10-20w."},{"key":"e_1_3_1_36_2","unstructured":"A. Kendall et al. 2018. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. arXiv preprint . arXiv:1705.07115."},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRev.108.171"},{"key":"e_1_3_1_38_2","volume-title":"Pattern Recognition and Machine Learning","author":"Bishop C.","year":"2007","unstructured":"C. Bishop. 2007. Pattern Recognition and Machine Learning. Prentice Hall."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-3324-9"},{"key":"e_1_3_1_40_2","unstructured":"S. L. Smith et al. 2017. Don't decay the learning rate increase the batch size. arXiv preprint . arXiv: 1711.00498."},{"key":"e_1_3_1_41_2","unstructured":"D. Kingma and J. B. Adam. 2014. A method for stochastic optimization. arXiv preprint . arXiv:1412.6980."},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2014.80"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVLSI.2016.2631428"},{"key":"e_1_3_1_44_2","unstructured":"P. Dollar. 2016. Piotr's computer vision MATLAB toolbox. https:\/\/pdollar.github.io\/toolbox\/."},{"key":"e_1_3_1_45_2","first-page":"1","volume-title":"International Joint Conference on Neural Networks","author":"Timof R.","year":"2013","unstructured":"R. Timof et al. 2013. Traffic sign recognition \u2014 how far are we from the solution? International Joint Conference on Neural Networks. 1\u20138."},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2012.02.016"},{"key":"e_1_3_1_47_2","first-page":"1","volume-title":"International Joint Conference on Neural Networks","author":"Houben S.","year":"2014","unstructured":"S. Houben et al. 2014. Detection of traffic signs in real-world images: The German traffic sign detection benchmark. International Joint Conference on Neural Networks. 1\u20138."},{"key":"e_1_3_1_48_2","first-page":"147","article-title":"OPTIMOL: Automatic object picture collection via incremental model learning","author":"Li L.","year":"2007","unstructured":"L. Li et al. 2007. OPTIMOL: Automatic object picture collection via incremental model learning. Computer Vision and Pattern Recognition (2007), 147\u2013168.","journal-title":"Computer Vision and Pattern Recognition"},{"key":"e_1_3_1_49_2","first-page":"3353","article-title":"Theorie der horizontalen sichtweite. Beitrage zur physik der freien atmosph\u00e4re","volume":"12","author":"Koschmieder H.","year":"1924","unstructured":"H. Koschmieder. 1924. Theorie der horizontalen sichtweite. Beitrage zur physik der freien atmosph\u00e4re. Meteorol. 12 (1924), 3353.","journal-title":"Meteorol."},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11277-017-4067-9"},{"key":"e_1_3_1_51_2","unstructured":"National Centers for Environmental Information of National Oceanic and Atmospheric Administration. Climate data online (CDO). https:\/\/www.ncdc.noaa.gov\/cdo-web\/."},{"key":"e_1_3_1_52_2","volume-title":"CCD Arrays, Cameras, and Displays","author":"Holst G. C.","year":"1998","unstructured":"G. C. Holst. 1998. CCD Arrays, Cameras, and Displays. JCD Pub."},{"key":"e_1_3_1_53_2","unstructured":"International Organization for Standardization. 1974. Photography \u2014 general purpose photographic exposure meters (photoelectric type) \u2014 Guide to product specification. ISO 2720:1974."},{"key":"e_1_3_1_54_2","unstructured":"Lawrence Berkeley National Laboratory in California. Radiance synthetic imaging system. https:\/\/floyd.lbl.gov\/radiance\/HOME.html."},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-26250-1_27"}],"container-title":["ACM Transactions on Cyber-Physical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3571286","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3571286","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:08:22Z","timestamp":1750183702000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3571286"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,19]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4,30]]}},"alternative-id":["10.1145\/3571286"],"URL":"https:\/\/doi.org\/10.1145\/3571286","relation":{},"ISSN":["2378-962X","2378-9638"],"issn-type":[{"type":"print","value":"2378-962X"},{"type":"electronic","value":"2378-9638"}],"subject":[],"published":{"date-parts":[[2023,4,19]]},"assertion":[{"value":"2020-02-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-10-28","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-04-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}