{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:30:40Z","timestamp":1750221040732,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":18,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,7,10]],"date-time":"2019-07-10T00:00:00Z","timestamp":1562716800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,7,10]]},"DOI":"10.1145\/3293882.3338991","type":"proceedings-article","created":{"date-parts":[[2019,7,11]],"date-time":"2019-07-11T12:13:31Z","timestamp":1562847211000},"page":"1-3","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Some challenges for software testing research (invited talk paper)"],"prefix":"10.1145","author":[{"given":"Nadia","family":"Alshahwan","sequence":"first","affiliation":[{"name":"Facebook, UK"}]},{"given":"Andrea","family":"Ciancone","sequence":"additional","affiliation":[{"name":"Facebook, UK"}]},{"given":"Mark","family":"Harman","sequence":"additional","affiliation":[{"name":"Facebook, UK \/ University College London, UK"}]},{"given":"Yue","family":"Jia","sequence":"additional","affiliation":[{"name":"Facebook, UK"}]},{"given":"Ke","family":"Mao","sequence":"additional","affiliation":[{"name":"Facebook, UK"}]},{"given":"Alexandru","family":"Marginean","sequence":"additional","affiliation":[{"name":"Facebook, UK \/ University College London, UK"}]},{"given":"Alexander","family":"Mols","sequence":"additional","affiliation":[{"name":"Facebook, UK"}]},{"given":"Hila","family":"Peleg","sequence":"additional","affiliation":[{"name":"Technion, Israel"}]},{"given":"Federica","family":"Sarro","sequence":"additional","affiliation":[{"name":"Facebook, UK \/ University College London, UK"}]},{"given":"Ilya","family":"Zorin","sequence":"additional","affiliation":[{"name":"Facebook, UK"}]}],"member":"320","published-online":{"date-parts":[[2019,7,10]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Deploying Search Based Software Engineering with Sapienz at Facebook. In 10 t h International Symposium on Search Based Software Engineering (SSBSE","author":"Alshahwan Nadia","year":"2018","unstructured":"Nadia Alshahwan , Xinbo Gao , Mark Harman , Yue Jia , Ke Mao , Alexander Mols , Taijin Tei , and Ilya Zorin . 2018. Deploying Search Based Software Engineering with Sapienz at Facebook. In 10 t h International Symposium on Search Based Software Engineering (SSBSE 2018 ). Montpellier, France , 3\u201345. Springer LNCS 11036. Nadia Alshahwan, Xinbo Gao, Mark Harman, Yue Jia, Ke Mao, Alexander Mols, Taijin Tei, and Ilya Zorin. 2018. Deploying Search Based Software Engineering with Sapienz at Facebook. In 10 t h International Symposium on Search Based Software Engineering (SSBSE 2018). Montpellier, France, 3\u201345. Springer LNCS 11036."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3243734.3278524"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771788"},{"key":"e_1_3_2_1_4_1","volume-title":"Making System User Interactive Tests Repeatable: When and What Should We Control?. In 37 t h International Conference on Software Engineering (ICSE","author":"Gao Zebao","year":"2015","unstructured":"Zebao Gao , Yalan Liang , Myra B. Cohen , Atif M. Memon , and Zhen Wang . 2015. Making System User Interactive Tests Repeatable: When and What Should We Control?. In 37 t h International Conference on Software Engineering (ICSE 2015 ), Antonia Bertolino, Gerardo Canfora , and Sebastian G. Elbaum (Eds.). IEEE Computer Society , Florence, Italy, 55\u201365. Zebao Gao, Yalan Liang, Myra B. Cohen, Atif M. Memon, and Zhen Wang. 2015. Making System User Interactive Tests Repeatable: When and What Should We Control?. In 37 t h International Conference on Software Engineering (ICSE 2015), Antonia Bertolino, Gerardo Canfora, and Sebastian G. Elbaum (Eds.). IEEE Computer Society, Florence, Italy, 55\u201365."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2093548.2093564"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12029-9_1"},{"key":"e_1_3_2_1_7_1","volume-title":"We Need a Formal Semantics for Testability Transformation. In 16 t h International Conference on Software Engineering and Formal Methods (SEFM","author":"Harman Mark","year":"2018","unstructured":"Mark Harman . 2018. We Need a Formal Semantics for Testability Transformation. In 16 t h International Conference on Software Engineering and Formal Methods (SEFM 2018 ). Toulouse , France , 3\u201317. Mark Harman. 2018. We Need a Formal Semantics for Testability Transformation. In 16 t h International Conference on Software Engineering and Formal Methods (SEFM 2018). Toulouse, France, 3\u201317."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2004.1265732"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2593929.2600116"},{"key":"e_1_3_2_1_10_1","volume-title":"open problems and challenges for search based software testing. In 8 t h IEEE International Conference on Software Testing, Verification and Validation (ICST","author":"Harman Mark","year":"2015","unstructured":"Mark Harman , Yue Jia , and Yuanyuan Zhang . 2015. Achievements , open problems and challenges for search based software testing. In 8 t h IEEE International Conference on Software Testing, Verification and Validation (ICST 2015 ). Graz , Austria , 1\u201312. Mark Harman, Yue Jia, and Yuanyuan Zhang. 2015. Achievements, open problems and challenges for search based software testing. In 8 t h IEEE International Conference on Software Testing, Verification and Validation (ICST 2015). Graz, Austria, 1\u201312."},{"key":"e_1_3_2_1_11_1","volume-title":"From Start-ups to Scale-ups: Opportunities and Open Problems for Static and Dynamic Program Analysis. In 18 t h IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM","author":"Harman Mark","year":"2018","unstructured":"Mark Harman and Peter O\u2019Hearn . 2018. From Start-ups to Scale-ups: Opportunities and Open Problems for Static and Dynamic Program Analysis. In 18 t h IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM 2018 ). Madrid , Spain , 1\u201323. Mark Harman and Peter O\u2019Hearn. 2018. From Start-ups to Scale-ups: Opportunities and Open Problems for Static and Dynamic Program Analysis. In 18 t h IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM 2018). Madrid, Spain, 1\u201323."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635920"},{"key":"e_1_3_2_1_13_1","volume-title":"Manuel Egele, Edward J. Schwartz, and Maverick Woo.","author":"Man\u00e8s Valentin J. M.","year":"2018","unstructured":"Valentin J. M. Man\u00e8s , HyungSeok Han , Choongwoo Han , Sang Kil Cha , Manuel Egele, Edward J. Schwartz, and Maverick Woo. 2018 . The Art, Science , and Engineering of Fuzzing: A Survey. CoRR abs\/1812.00140 (2018). arXiv: 1812.00140 http:\/\/arxiv.org\/abs\/1812.00140 Valentin J. M. Man\u00e8s, HyungSeok Han, Choongwoo Han, Sang Kil Cha, Manuel Egele, Edward J. Schwartz, and Maverick Woo. 2018. The Art, Science, and Engineering of Fuzzing: A Survey. CoRR abs\/1812.00140 (2018). arXiv: 1812.00140 http:\/\/arxiv.org\/abs\/1812.00140"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2019.00039"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.18"},{"key":"e_1_3_2_1_16_1","volume-title":"Cohen","author":"Memon Atif M.","year":"2013","unstructured":"Atif M. Memon and Myra B . Cohen . 2013 . Automated testing of GUI applications: models, tools, and controlling flakiness. In 35 t h International Conference on Software Engineering (ICSE 2013), David Notkin, Betty H. C. Cheng, and Klaus Pohl (Eds.). IEEE Computer Society , San Francisco, CA, USA, 1479\u20131480. Atif M. Memon and Myra B. Cohen. 2013. Automated testing of GUI applications: models, tools, and controlling flakiness. In 35 t h International Conference on Software Engineering (ICSE 2013), David Notkin, Betty H. C. Cheng, and Klaus Pohl (Eds.). IEEE Computer Society, San Francisco, CA, USA, 1479\u20131480."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/96267.96279"},{"key":"e_1_3_2_1_18_1","volume-title":"VUzzer: Application-aware Evolutionary Fuzzing. In 24th Annual Network and Distributed System Security Symposium (NDSS) 2017","author":"Rawat Sanjay","year":"2017","unstructured":"Sanjay Rawat , Vivek Jain , Ashish Kumar , Lucian Cojocar , Cristiano Giuffrida , and Herbert Bos . 2017 . VUzzer: Application-aware Evolutionary Fuzzing. In 24th Annual Network and Distributed System Security Symposium (NDSS) 2017 , San Diego, California, USA, February 26 - March 1, 2017. The Internet Society. Sanjay Rawat, Vivek Jain, Ashish Kumar, Lucian Cojocar, Cristiano Giuffrida, and Herbert Bos. 2017. VUzzer: Application-aware Evolutionary Fuzzing. In 24th Annual Network and Distributed System Security Symposium (NDSS) 2017, San Diego, California, USA, February 26 - March 1, 2017. The Internet Society."}],"event":{"name":"ISSTA '19: 28th ACM SIGSOFT International Symposium on Software Testing and Analysis","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"],"location":"Beijing China","acronym":"ISSTA '19"},"container-title":["Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3293882.3338991","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3293882.3338991","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:43:51Z","timestamp":1750207431000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3293882.3338991"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,10]]},"references-count":18,"alternative-id":["10.1145\/3293882.3338991","10.1145\/3293882"],"URL":"https:\/\/doi.org\/10.1145\/3293882.3338991","relation":{},"subject":[],"published":{"date-parts":[[2019,7,10]]},"assertion":[{"value":"2019-07-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}