{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T15:39:06Z","timestamp":1785512346136,"version":"3.56.0"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2021,7,5]],"date-time":"2021-07-05T00:00:00Z","timestamp":1625443200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,5]],"date-time":"2021-07-05T00:00:00Z","timestamp":1625443200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001866","name":"Fonds National de la Recherche Luxembourg","doi-asserted-by":"publisher","award":["BRIDGES2020\/IS\/14711346\/FUNTASY"],"award-info":[{"award-number":["BRIDGES2020\/IS\/14711346\/FUNTASY"]}],"id":[{"id":"10.13039\/501100001866","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001804","name":"Canada Research Chairs","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001804","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["694277"],"award-info":[{"award-number":["694277"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001804","name":"Canada Research Chairs","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001804","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002701","name":"Ministry of Education","doi-asserted-by":"publisher","award":["2019R1A6A3A03033444"],"award-info":[{"award-number":["2019R1A6A3A03033444"]}],"id":[{"id":"10.13039\/501100002701","id-type":"DOI","asserted-by":"publisher"}]},{"name":"IEE S.A. Luxembourg"},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We distinguish two general modes of testing for Deep Neural Networks (DNNs): Offline testing where DNNs are tested as individual units based on test datasets obtained without involving the DNNs under test, and online testing where DNNs are embedded into a specific application environment and tested in a closed-loop mode in interaction with the application environment. Typically, DNNs are subjected to both types of testing during their development life cycle where offline testing is applied immediately after DNN training and online testing follows after offline testing and once a DNN is deployed within a specific application environment. In this paper, we study the relationship between offline and online testing. Our goal is to determine <jats:italic>how offline testing and online testing differ or complement one another<\/jats:italic> and <jats:italic>if offline testing results can be used to help reduce the cost of online testing?<\/jats:italic> Though these questions are generally relevant to all autonomous systems, we study them in the context of automated driving systems where, as study subjects, we use DNNs automating end-to-end controls of steering functions of self-driving vehicles. Our results show that offline testing is less effective than online testing as many safety violations identified by online testing could not be identified by offline testing, while large prediction errors generated by offline testing always led to severe safety violations detectable by online testing. Further, we cannot exploit offline testing results to reduce the cost of online testing in practice since we are not able to identify specific situations where offline testing could be as accurate as online testing in identifying safety requirement violations.<\/jats:p>","DOI":"10.1007\/s10664-021-09982-4","type":"journal-article","created":{"date-parts":[[2021,7,5]],"date-time":"2021-07-05T13:02:44Z","timestamp":1625490164000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["Can Offline Testing of Deep Neural Networks Replace Their Online Testing?"],"prefix":"10.1007","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2253-9085","authenticated-orcid":false,"given":"Fitash Ul","family":"Haq","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0840-6449","authenticated-orcid":false,"given":"Donghwan","family":"Shin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0281-8231","authenticated-orcid":false,"given":"Shiva","family":"Nejati","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1393-1010","authenticated-orcid":false,"given":"Lionel","family":"Briand","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,7,5]]},"reference":[{"key":"9982_CR1","doi-asserted-by":"publisher","unstructured":"Archer KJ, Kimes RV (2008) Empirical characterization of random forest variable importance measures, vol 52. https:\/\/doi.org\/10.1016\/j.csda.2007.08.015. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0167947307003076","DOI":"10.1016\/j.csda.2007.08.015"},{"key":"9982_CR2","unstructured":"Autumn T (2016) Autumn model. https:\/\/github.com\/udacity\/self-driving-car\/tree\/master\/steering-models\/community-models\/autumn, Accessed: 2019-10-11"},{"issue":"5","key":"9982_CR3","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1109\/TSE.2014.2372785","volume":"41","author":"ET Barr","year":"2015","unstructured":"Barr ET, Harman M, McMinn P, Shahbaz M, Yoo S (2015) The oracle problem in software testing: A survey. IEEE Trans Softw Eng 41 (5):507\u2013525. https:\/\/doi.org\/10.1109\/TSE.2014.2372785","journal-title":"IEEE Trans Softw Eng"},{"key":"9982_CR4","unstructured":"Chauffeur T (2016) Chauffeur model. https:\/\/github.com\/udacity\/self-driving-car\/tree\/master\/steering-models\/community-models\/chauffeur, Accessed: 2019-10-11"},{"key":"9982_CR5","doi-asserted-by":"crossref","unstructured":"Ciresan DC, Meier U, Schmidhuber J (2012) Multi-column deep neural networks for image classification. arXiv:1202.2745","DOI":"10.1109\/CVPR.2012.6248110"},{"key":"9982_CR6","doi-asserted-by":"crossref","unstructured":"Codevilla F, Lopez AM, Koltun V, Dosovitskiy A (2018) On offline evaluation of vision-based driving models. In: The european conference on computer vision (ECCV)","DOI":"10.1007\/978-3-030-01267-0_15"},{"key":"9982_CR7","doi-asserted-by":"publisher","unstructured":"Cohen WW (1995) Fast effective rule induction. In: Prieditis A, Russell S (eds) Machine Learning Proceedings 1995, Morgan Kaufmann, San Francisco (CA), pp 115\u2013123 https:\/\/doi.org\/10.1016\/B978-1-55860-377-6.50023-2. http:\/\/www.sciencedirect.com\/science\/article\/pii\/B9781558603776500232","DOI":"10.1016\/B978-1-55860-377-6.50023-2"},{"key":"9982_CR8","doi-asserted-by":"publisher","unstructured":"Deng L, Hinton G, Kingsbury B (2013) New types of deep neural network learning for speech recognition and related applications: an overview. In: 2013 IEEE International conference on acoustics, speech and signal processing, pp 8599\u20138603 https:\/\/doi.org\/10.1109\/ICASSP.2013.6639344","DOI":"10.1109\/ICASSP.2013.6639344"},{"key":"9982_CR9","unstructured":"Dosovitskiy A, Ros G, Codevilla F, Lopez A, Koltun V (2017) CARLA: An open urban driving simulator. In: Proceedings of the 1st annual conference on robot learning, pp 1\u201316"},{"key":"9982_CR10","unstructured":"Dreossi T, Ghosh S, Sangiovanni-Vincentelli A, Seshia SA (2017) Systematic testing of convolutional neural networks for autonomous driving. arXiv:1708.03309"},{"key":"9982_CR11","unstructured":"ESI Group (2019) Esi pro-sivic - 3d simulations of environments and sensors. https:\/\/www.esi-group.com\/software-solutions\/virtual-environment\/virtual-systems-controls\/esi-pro-sivictm-3d-simulations-environments-and-sensors, Accessed: 2019-10-11"},{"key":"9982_CR12","doi-asserted-by":"publisher","unstructured":"Gambi A, Mueller M, Fraser G (2019) Automatically testing self-driving cars with search-based procedural content generation. In: Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis, ACM, New York, NY, USA, ISSTA, 2019 pp 318\u2013328. https:\/\/doi.org\/10.1145\/3293882.3330566","DOI":"10.1145\/3293882.3330566"},{"key":"9982_CR13","doi-asserted-by":"crossref","unstructured":"Geiger A, Lenz P, Urtasun R (2012) Are we ready for autonomous driving? the kitti vision benchmark suite","DOI":"10.1109\/CVPR.2012.6248074"},{"issue":"14","key":"9982_CR14","doi-asserted-by":"publisher","first-page":"2225","DOI":"10.1016\/j.patrec.2010.03.014","volume":"31","author":"R Genuer","year":"2010","unstructured":"Genuer R, Poggi JM, Tuleau-Malot C (2010) Variable selection using random forests. Pattern Recognit Lett 31(14):2225\u20132236. https:\/\/doi.org\/10.1016\/j.patrec.2010.03.014. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0167865510000954","journal-title":"Pattern Recognit Lett"},{"key":"9982_CR15","unstructured":"Group OM (2014) Object constraint language specification. https:\/\/www.omg.org\/spec\/OCL\/, Accessed: 2019-10-11"},{"key":"9982_CR16","doi-asserted-by":"crossref","unstructured":"Haq FU, Shin D, Nejati S, Briand L (2020a) Comparing offline and online testing of deep neural networks: An autonomous car case study. In: 2020 IEEE International conference on software testing, verification and validation, p to appear","DOI":"10.1109\/ICST46399.2020.00019"},{"key":"9982_CR17","unstructured":"Haq FU, Shin D, Nejati S, Briand L (2020b) Supporting materials (temporal link for the double-blind review). http:\/\/tiny.cc\/Experiment-data, Accessed: 2020-07-26"},{"key":"9982_CR18","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1016\/j.tra.2016.09.010","volume":"94","author":"N Kalra","year":"2016","unstructured":"Kalra N, Paddock SM (2016) Driving to safety: How many miles of driving would it take to demonstrate autonomous vehicle reliability?. Trans Res Part A Pol Pract 94:182\u2013193. https:\/\/doi.org\/10.1016\/j.tra.2016.09.010. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0965856416302129","journal-title":"Trans Res Part A Pol Pract"},{"key":"9982_CR19","doi-asserted-by":"publisher","unstructured":"Kim J, Feldt R, Yoo S (2019) Guiding deep learning system testing using surprise adequacy. In: Proceedings of the 41st international conference on software engineering, IEEE Press, Piscataway, NJ, USA, ICSE \u201919, pp 1039\u20131049 https:\/\/doi.org\/10.1109\/ICSE.2019.00108","DOI":"10.1109\/ICSE.2019.00108"},{"key":"9982_CR20","unstructured":"Komanda T (2016) Komanda model. https:\/\/github.com\/udacity\/self-driving-car\/tree\/master\/steering-models\/community-models\/komanda, Accessed: 2020-04-14"},{"key":"9982_CR21","doi-asserted-by":"publisher","unstructured":"Ma L, Juefei-Xu F, Zhang F, Sun J, Xue M, Li B, Chen C, Su T, Li L, Liu Y, Zhao J, Wang Y (2018) Deepgauge: Multi-granularity testing criteria for deep learning systems. In: Proceedings of the 33rd ACM\/IEEE International Conference on Automated Software Engineering, ACM, New York, NY, USA, ASE, 2018, pp 120\u2013131. https:\/\/doi.org\/10.1145\/3238147.3238202","DOI":"10.1145\/3238147.3238202"},{"key":"9982_CR22","unstructured":"Majumdar R, Mathur A, Pirron M, Stegner L, Zufferey D (2019) Paracosm: A language and tool for testing autonomous driving systems. arXiv:1902.01084"},{"key":"9982_CR23","doi-asserted-by":"publisher","unstructured":"McGehee DV, Mazzae EN, Baldwin GS (2000) Driver reaction time in crash avoidance research: Validation of a driving simulator study on a test track. In: Proceedings of the human factors and ergonomics society annual meeting 44(20):3\u2013320\u20133\u2013323 https:\/\/doi.org\/10.1177\/154193120004402026","DOI":"10.1177\/154193120004402026"},{"key":"9982_CR24","doi-asserted-by":"publisher","unstructured":"Pei K, Cao Y, Yang J, Jana S (2017) Deepxplore: Automated whitebox testing of deep learning systems. In: Proceedings of the 26th symposium on operating systems principles, ACM, New York, NY, USA, SOSP \u201917, pp 1\u201318 https:\/\/doi.org\/10.1145\/3132747.3132785","DOI":"10.1145\/3132747.3132785"},{"key":"9982_CR25","unstructured":"Pineau J (2019) Icse 2019 keynote: Building reproducible, reusable, and robust machine learning software. https:\/\/2019.icse-conferences.org\/details\/icse-2019-Plenary-Sessions\/20\/Building-Reproducible-Reusable-and-Robust-Machine-Learning-Software, Accessed: 2019-10-11"},{"key":"9982_CR26","unstructured":"Pomerleau DA (1989) Alvinn: An autonomous land vehicle in a neural network. In: Advances in neural information processing systems, pp 305\u2013313"},{"key":"9982_CR27","doi-asserted-by":"publisher","unstructured":"Rong G, Shin BH, Tabatabaee H, Lu Q, Lemke S, Mozeiko\u030c M, Boise E, Uhm G, Gerow M, Mehta S, Agafonov E, Kim TH, Sterner E, Ushiroda K, Reyes M, Zelenkovsky D, Kim S (2020) Lgsvl simulator: A high fidelity simulator for autonomous driving. In: 2020 IEEE 23rd International conference on intelligent transportation systems (ITSC), pp 1\u20136 https:\/\/doi.org\/10.1109\/ITSC45102.2020.9294422","DOI":"10.1109\/ITSC45102.2020.9294422"},{"key":"9982_CR28","doi-asserted-by":"crossref","unstructured":"Shah S, Dey D, Lovett C, Kapoor A (2018) Airsim: High-fidelity visual and physical simulation for autonomous vehicles. In: Hutter M, Siegwart R (eds) Field and service robotics, springer international publishing, Cham, pp 621\u2013635","DOI":"10.1007\/978-3-319-67361-5_40"},{"key":"9982_CR29","doi-asserted-by":"publisher","unstructured":"Sotiropoulos T, Waeselynck H, Guiochet J, Ingrand F (2017) Can robot navigation bugs be found in simulation? an exploratory study. In: 2017 IEEE International conference on software quality, reliability and security (QRS), pp 150\u2013159 https:\/\/doi.org\/10.1109\/QRS.2017.25","DOI":"10.1109\/QRS.2017.25"},{"key":"9982_CR30","unstructured":"Sutskever I, Vinyals O, Le Q V (2014) Sequence to sequence learning with neural networks. In: Ghahramani Z, Welling M, Cortes C, Lawrence N D, Weinberger K Q (eds) Advances in Neural Information Processing Systems. 27 Curran Associates Inc. pp 3104\u20133112"},{"key":"9982_CR31","unstructured":"TASS International - Siemens Group (2019) Prescan: Simulation of adas and active safety. https:\/\/tass.plm.automation.siemens.com, Accessed: 2019-10-11"},{"key":"9982_CR32","doi-asserted-by":"publisher","unstructured":"Tian Y, Pei K, Jana S, Ray B (2018) Deeptest: Automated testing of deep-neural-network-driven autonomous cars. In: Proceedings of the 40th international conference on software engineering, ACM, New York, NY, USA, ICSE \u201918, pp 303\u2013314. https:\/\/doi.org\/10.1145\/3180155.3180220","DOI":"10.1145\/3180155.3180220"},{"key":"9982_CR33","doi-asserted-by":"publisher","unstructured":"Tuncali CE, Fainekos G, Ito H, Kapinski J (2018) Simulation-based adversarial test generation for autonomous vehicles with machine learning components. In: 2018 IEEE intelligent vehicles symposium, IV pp 1555\u20131562. https:\/\/doi.org\/10.1109\/IVS.2018.8500421","DOI":"10.1109\/IVS.2018.8500421"},{"key":"9982_CR34","unstructured":"Udacity (2016a) Udacity self-driving car challenge 2: Using deep learning to predict steering angles. https:\/\/github.com\/udacity\/self-driving-car\/tree\/master\/challenges\/challenge-2, Accessed: 2019-10-11"},{"key":"9982_CR35","unstructured":"Udacity (2016b) Udacity self-driving challenge 2, ch2-001 (testing) and ch2-002 (training). https:\/\/github.com\/udacity\/self-driving-car\/tree\/master\/datasets\/CH2, Accessed: 2019-10-11"},{"key":"9982_CR36","doi-asserted-by":"crossref","unstructured":"Wicker M, Huang X, Kwiatkowska M (2018) Feature-guided black-box safety testing of deep neural networks. In: Beyer D, Huisman M (eds) Tools and Algorithms for the Construction and Analysis of Systems. Springer International Publishing, Cham, pp 408\u2013426","DOI":"10.1007\/978-3-319-89960-2_22"},{"key":"9982_CR37","doi-asserted-by":"crossref","unstructured":"Zhang JM, Harman M, Ma L, Liu Y (2020) Machine learning testing: Survey, landscapes and horizons. IEEE Trans Softw Eng 1\u20131","DOI":"10.1109\/TSE.2019.2962027"},{"key":"9982_CR38","doi-asserted-by":"publisher","unstructured":"Zhang M, Zhang Y, Zhang L, Liu C, Khurshid S (2018) Deeproad: Gan-based metamorphic testing and input validation framework for autonomous driving systems. In: Proceedings of the 33rd ACM\/IEEE international conference on automated software engineering, acm, New York, NY, USA, ASE 2018, pp 132\u2013142. https:\/\/doi.org\/10.1145\/3238147.3238187","DOI":"10.1145\/3238147.3238187"},{"key":"9982_CR39","unstructured":"Zhou H, Li W, Zhu Y, Zhang Y, Yu B, Zhang L, Liu C (2018) Deepbillboard: Systematic physical-world testing of autonomous driving systems. arXiv:1812.10812"},{"issue":"3","key":"9982_CR40","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1145\/3241979","volume":"62","author":"ZQ Zhou","year":"2019","unstructured":"Zhou ZQ, Sun L (2019) Metamorphic testing of driverless cars. Commun ACM 62(3):61\u201367. https:\/\/doi.org\/10.1145\/3241979","journal-title":"Commun ACM"}],"updated-by":[{"DOI":"10.1007\/s10664-022-10172-z","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2022,8,6]],"date-time":"2022-08-06T00:00:00Z","timestamp":1659744000000}}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-09982-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-021-09982-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-09982-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,6]],"date-time":"2022-08-06T07:30:12Z","timestamp":1659771012000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-021-09982-4"}},"subtitle":["A Case Study of Automated Driving Systems"],"short-title":[],"issued":{"date-parts":[[2021,7,5]]},"references-count":40,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["9982"],"URL":"https:\/\/doi.org\/10.1007\/s10664-021-09982-4","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s10664-022-10172-z","asserted-by":"object"}]},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,5]]},"assertion":[{"value":"26 May 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 July 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 August 2022","order":3,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":4,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":5,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s10664-022-10172-z","URL":"https:\/\/doi.org\/10.1007\/s10664-022-10172-z","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"90"}}