{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T02:15:31Z","timestamp":1775873731735,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":70,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T00:00:00Z","timestamp":1726012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["2319472 and 2349961"],"award-info":[{"award-number":["2319472 and 2349961"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,9,11]]},"DOI":"10.1145\/3650212.3680320","type":"proceedings-article","created":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T11:44:25Z","timestamp":1726055065000},"page":"781-793","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Feedback-Directed Partial Execution"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6610-3422","authenticated-orcid":false,"given":"Ishrak","family":"Hayet","sequence":"first","affiliation":[{"name":"North Carolina State University, Raleigh, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1461-6944","authenticated-orcid":false,"given":"Adam","family":"Scott","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1323-8769","authenticated-orcid":false,"given":"Marcelo","family":"d'Amorim","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,9,11]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"2021. Python integer incrementing with ++ \u2014 stackoverflow.com. https:\/\/stackoverflow.com\/questions\/2632677\/python-integer-incrementing-with. [Accessed 12-01-2023]"},{"key":"e_1_3_2_1_2_1","unstructured":"2022. GitHub REST API documentation - GitHub Docs \u2014 docs.github.com. https:\/\/docs.github.com\/en\/rest?apiVersion=2022-11-28 [Accessed 11-01-2023]"},{"key":"e_1_3_2_1_3_1","unstructured":"2024. Built-in Exceptions \u2014 docs.python.org. https:\/\/docs.python.org\/3\/library\/exceptions.html [Accessed 21-07-2024]"},{"key":"e_1_3_2_1_4_1","unstructured":"2024. Comprehensive Compilation of Programming Problems and Solutions in C Java C++ and Python \u2014 csinfo360.com. https:\/\/www.csinfo360.com\/p\/ccjavapython-practice-questions-with.html [Accessed 03-01-2024]"},{"key":"e_1_3_2_1_5_1","unstructured":"2024. Find nearest value in numpy array \u2014 stackoverflow.com. https:\/\/stackoverflow.com\/questions\/2566412\/find-nearest-value-in-numpy-array. [Accessed 12-01-2023]"},{"key":"e_1_3_2_1_6_1","unstructured":"2024. Incompleter\u2019s GitHub repository. https:\/\/github.com\/ncsu-swat\/incompleter [Accessed 07-03-2024]"},{"key":"e_1_3_2_1_7_1","unstructured":"2024. Python Exercise with Practice Questions and Solutions - GeeksforGeeks \u2014 geeksforgeeks.org. https:\/\/www.geeksforgeeks.org\/python-exercises-practice-questions-and-solutions\/ [Accessed 03-01-2024]"},{"key":"e_1_3_2_1_8_1","unstructured":"2024. Python Exercises Practice Solution - w3resource \u2014 w3resource.com. https:\/\/www.w3resource.com\/python-exercises\/ [Accessed 03-01-2024]"},{"key":"e_1_3_2_1_9_1","unstructured":"2024. Python Programming Examples | Python Programs - Sanfoundry \u2014 sanfoundry.com. https:\/\/www.sanfoundry.com\/python-problems-solutions\/ [Accessed 03-01-2024]"},{"key":"e_1_3_2_1_10_1","unstructured":"2024. Python-programming-exercises\/100+ Python challenging programming exercises.txt at master \u00b7 zhiwehu\/Python-programming-exercises \u2014 github.com. https:\/\/github.com\/zhiwehu\/Python-programming-exercises\/blob\/master\/100+%20Python%20challenging%20programming%20exercises.txt [Accessed 03-01-2024]"},{"key":"e_1_3_2_1_11_1","unstructured":"2024. Stack Overflow - Where Developers Learn Share & Build Careers \u2014 stackoverflow.com. https:\/\/stackoverflow.com\/ [Accessed 01-02-2024]"},{"key":"e_1_3_2_1_12_1","unstructured":"2024. The Python Standard Library \u2014 docs.python.org. https:\/\/docs.python.org\/3\/library\/index.html [Accessed 10-29-2023]"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3385412.3385997"},{"key":"e_1_3_2_1_14_1","volume-title":"Batchelder","author":"Ned","year":"2023","unstructured":"Ned et al. Batchelder. 2023. Coverage.py \u2014 Coverage.py 7.4.0 documentation \u2014 coverage.readthedocs.io. https:\/\/coverage.readthedocs.io\/en\/7.4.0\/ [Accessed 28-03-2024]"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753402"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2017.56"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639184"},{"key":"e_1_3_2_1_18_1","unstructured":"+786 contributors. 2024. Youtube-dl. https:\/\/github.com\/ytdl-org\/youtube-dl [Accessed 04-10-2024]"},{"key":"e_1_3_2_1_19_1","volume-title":"Pyinfer: Deep learning semantic type inference for python variables. arXiv preprint arXiv:2106.14316.","author":"Cui Siwei","year":"2021","unstructured":"Siwei Cui, Gang Zhao, Zeyu Dai, Luochao Wang, Ruihong Huang, and Jeff Huang. 2021. Pyinfer: Deep learning semantic type inference for python variables. arXiv preprint arXiv:2106.14316."},{"key":"e_1_3_2_1_20_1","volume-title":"PYInfer: Deep Learning Semantic Type Inference for Python Variables. CoRR, abs\/2106.14316","author":"Cui Siwei","year":"2021","unstructured":"Siwei Cui, Gang Zhao, Zeyu Dai, Luochao Wang, Ruihong Huang, and Jeff Huang. 2021. PYInfer: Deep Learning Semantic Type Inference for Python Variables. CoRR, abs\/2106.14316 (2021), arXiv:2106.14316. arxiv:2106.14316"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1449955.1449790"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2012.6227207"},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of the 44th International Conference on Software Engineering. 1982\u20131993","author":"Dong Yiwen","year":"2022","unstructured":"Yiwen Dong, Tianxiao Gu, Yongqiang Tian, and Chengnian Sun. 2022. SnR: constraint-based type inference for incomplete Java code snippets. In Proceedings of the 44th International Conference on Software Engineering. 1982\u20131993."},{"key":"e_1_3_2_1_24_1","volume-title":"Proceedings of the 35th IEEE\/ACM International Conference on Automated Software Engineering. 1204\u20131208","author":"Fazzini Mattia","year":"2020","unstructured":"Mattia Fazzini, Alessandra Gorla, and Alessandro Orso. 2020. A framework for automated test mocking of mobile apps. In Proceedings of the 35th IEEE\/ACM International Conference on Automated Software Engineering. 1204\u20131208."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.139"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3382494.3422165"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3524842.3528435"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568273"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Daya Guo Shuai Lu Nan Duan Yanlin Wang Ming Zhou and Jian Yin. 2022. UniXcoder: Unified Cross-Modal Pre-training for Code Representation. arxiv:2203.03850.","DOI":"10.18653\/v1\/2022.acl-long.499"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.10742"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","unstructured":"Ishrak Hayet. 2024. Incompleter (source and dataset). https:\/\/doi.org\/10.5281\/zenodo.13147364 10.5281\/zenodo.13147364","DOI":"10.5281\/zenodo.13147364"},{"key":"e_1_3_2_1_32_1","unstructured":"Md Monir Hossain Nima Mahmoudi Changyuan Lin Hamzeh Khazaei and Abram Hindle. 2019. Executability of python snippets in stack overflow. arXiv preprint arXiv:1907.04908."},{"key":"e_1_3_2_1_33_1","volume-title":"2023 IEEE\/ACM 45th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion). 1\u20135.","author":"Huang Qing","year":"2023","unstructured":"Qing Huang, Jiahui Zhu, Zhilong Li, Zhenchang Xing, Changjing Wang, and Xiwei Xu. 2023. Pcr-chain: Partial code reuse assisted by hierarchical chaining of prompts on frozen copilot. In 2023 IEEE\/ACM 45th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion). 1\u20135."},{"key":"e_1_3_2_1_34_1","volume-title":"Rangeet Pan, and Hridesh Rajan.","author":"Islam Md Johirul","year":"2019","unstructured":"Md Johirul Islam, Hoan Anh Nguyen, Rangeet Pan, and Hridesh Rajan. 2019. What do developers ask about ml libraries? a large-scale study using stack overflow. arXiv preprint arXiv:1906.11940."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","unstructured":"Link An Jarad. 2022. Natural Language to Python Code. https:\/\/doi.org\/10.34740\/KAGGLE\/DSV\/3512475 10.34740\/KAGGLE\/DSV\/3512475","DOI":"10.34740\/KAGGLE"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.104"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","unstructured":"Boyang Li Christopher Vendome Mario Linares-V\u00e1squez Denys Poshyvanyk and Nicholas Kraft. 2016. Automatically Documenting Unit Test Cases. 341\u2013352. https:\/\/doi.org\/10.1109\/ICST.2016.30 10.1109\/ICST.2016.30","DOI":"10.1109\/ICST.2016.30"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2018"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Fang Liu Ge Li Bolin Wei Xin Xia Zhiyi Fu and Zhi Jin. 2020. A Self-Attentional Neural Architecture for Code Completion with Multi-Task Learning. arxiv:1909.06983.","DOI":"10.1145\/3387904.3389261"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416591"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Yu Liu Pengyu Nie Owolabi Legunsen and Milos Gligoric. 2022. Inline Tests. arxiv:2209.06315. arxiv:2209.06315","DOI":"10.1145\/3551349.3556952"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-Companion58688.2023.00046"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510124"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510124"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2384616.2384689"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2010.5463346"},{"key":"e_1_3_2_1_47_1","volume-title":"2020 IEEE International Conference on Software Maintenance and Evolution (ICSME). 453\u2013463","author":"Pereira Gustavo","year":"2020","unstructured":"Gustavo Pereira and Andre Hora. 2020. Assessing mock classes: An empirical study. In 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME). 453\u2013463."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409715"},{"key":"e_1_3_2_1_49_1","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of machine learning research, 21, 140 (2020), 1\u201367.","journal-title":"Journal of machine learning research"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2666356.2594321"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3248113"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3471621.3471865"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"crossref","unstructured":"Ian Rumfitt. 2011. Inference deduction logic. Knowing how: Essays on knowledge mind and action 334\u201360.","DOI":"10.1093\/acprof:oso\/9780195389364.003.0015"},{"key":"e_1_3_2_1_54_1","volume-title":"Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201917)","author":"Saha Ripon K.","unstructured":"Ripon K. Saha, Yingjun Lyu, Hiroaki Yoshida, and Mukul R. Prasad. 2017. ELIXIR: effective object oriented program repair. In Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201917). IEEE Press, 648\u2013659. isbn:9781538626849"},{"key":"e_1_3_2_1_55_1","volume-title":"ICTSS 2020, Naples, Italy, December 9\u201311, 2020, Proceedings 32","author":"Salva S\u00e9bastien","year":"2020","unstructured":"S\u00e9bastien Salva and Elliott Blot. 2020. Using Model Learning for the Generation of Mock Components. In Testing Software and Systems: 32nd IFIP WG 6.1 International Conference, ICTSS 2020, Naples, Italy, December 9\u201311, 2020, Proceedings 32. 3\u201319."},{"key":"e_1_3_2_1_56_1","volume-title":"Clarke","author":"Sapra Samir","year":"2013","unstructured":"Samir Sapra, Marius Minea, Sagar Chaki, Arie Gurfinkel, and Edmund M. Clarke. 2013. Finding Errors in Python Programs Using Dynamic Symbolic Execution. In Testing Software and Systems. Springer Berlin Heidelberg, Berlin, Heidelberg. 283\u2013289. isbn:978-3-642-41707-8"},{"key":"e_1_3_2_1_57_1","unstructured":"SOAR Lab. 2023. BugsInPy: A Database of Existing Bugs in Python Programs to Enable Controlled Testing and Debugging Studies. https:\/\/github.com\/soarsmu\/BugsInPy\/tree\/master"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3616254"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2013.6624012"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568313"},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931058"},{"key":"e_1_3_2_1_62_1","volume-title":"2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 542\u2013554","author":"Terragni Valerio","year":"2021","unstructured":"Valerio Terragni and Pasquale Salza. 2021. APIzation: Generating reusable APIs from StackOverflow code snippets. In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 542\u2013554."},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2006.51"},{"key":"e_1_3_2_1_64_1","unstructured":"Hugo van Kemenade. 2024. Top PyPI Packages \u2014 hugovk.github.io. https:\/\/hugovk.github.io\/top-pypi-packages\/ [Accessed 11-01-2023]"},{"key":"e_1_3_2_1_65_1","first-page":"101","article-title":"A critique and improvement of the CL common language effect size statistics of McGraw and Wong","volume":"25","author":"Vargha Andr\u00e1s","year":"2000","unstructured":"Andr\u00e1s Vargha and Harold D Delaney. 2000. A critique and improvement of the CL common language effect size statistics of McGraw and Wong. Journal of Educational and Behavioral Statistics, 25, 2 (2000), 101\u2013132.","journal-title":"Journal of Educational and Behavioral Statistics"},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"crossref","unstructured":"Yue Wang Weishi Wang Shafiq Joty and Steven CH Hoi. 2021. Codet5: Identifier-aware unified pre-trained encoder-decoder models for code understanding and generation. arXiv preprint arXiv:2109.00859.","DOI":"10.18653\/v1\/2021.emnlp-main.685"},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2950290.2950343"},{"key":"e_1_3_2_1_68_1","volume-title":"Smola","author":"Zhang Aston","year":"2023","unstructured":"Aston Zhang, Zachary C. Lipton, Mu Li, and Alexander J. Smola. 2023. Dive into Deep Learning. arxiv:2106.11342."},{"key":"e_1_3_2_1_69_1","volume-title":"Repocoder: Repository-level code completion through iterative retrieval and generation. arXiv preprint arXiv:2303.12570.","author":"Zhang Fengji","year":"2023","unstructured":"Fengji Zhang, Bei Chen, Yue Zhang, Jacky Keung, Jin Liu, Daoguang Zan, Yi Mao, Jian-Guang Lou, and Weizhu Chen. 2023. Repocoder: Repository-level code completion through iterative retrieval and generation. arXiv preprint arXiv:2303.12570."},{"key":"e_1_3_2_1_70_1","volume-title":"2017 32nd IEEE\/ACM International Conference on Automated Software Engineering (ASE). 671\u2013681","author":"Zhong Hao","year":"2017","unstructured":"Hao Zhong and Xiaoyin Wang. 2017. Boosting complete-code tool for partial program. In 2017 32nd IEEE\/ACM International Conference on Automated Software Engineering (ASE). 671\u2013681."}],"event":{"name":"ISSTA '24: 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis","location":"Vienna Austria","acronym":"ISSTA '24","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","AITO"]},"container-title":["Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3650212.3680320","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3650212.3680320","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:50:07Z","timestamp":1750287007000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3650212.3680320"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,11]]},"references-count":70,"alternative-id":["10.1145\/3650212.3680320","10.1145\/3650212"],"URL":"https:\/\/doi.org\/10.1145\/3650212.3680320","relation":{},"subject":[],"published":{"date-parts":[[2024,9,11]]},"assertion":[{"value":"2024-09-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}