{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T06:54:29Z","timestamp":1781765669264,"version":"3.54.5"},"reference-count":43,"publisher":"Wiley","license":[{"start":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T00:00:00Z","timestamp":1781654400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T00:00:00Z","timestamp":1781654400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/501100002647","name":"Sungkyunkwan University","doi-asserted-by":"publisher","award":["RS\u20102024\u201000438686"],"award-info":[{"award-number":["RS\u20102024\u201000438686"]}],"id":[{"id":"10.13039\/501100002647","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computer Graphics Forum"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Symbolic execution engines such as KLEE automatically generate test cases to maximize branch coverage, but their numerous parameters make it difficult to understand the parameters' impact, leading the user to rely on suboptimal default configurations. While automated tuners have shown promising results, they provide limited insights into why certain configurations work well, motivating the need for Human\u2010in\u2010the\u2010Loop approaches. In this work, we present a visual analytics system, Symetra, designed to support Human\u2010in\u2010the\u2010Loop parameter tuning of symbolic execution engines. To handle a large number of parameters and their configurations, we provide two complementary overviews of their impact on branch coverage values and patterns. Building on these overviews, our system enables collective analysis, allowing the user to contrast groups of configurations and identify differences that may affect branch coverage. We also report on case studies and a Human\u2010in\u2010the\u2010Loop tuning process, demonstrating that experts not only interpreted parameter impacts and identified complementary configurations, but also improved upon fully automated approaches in both branch coverage and tuning efficiency.<\/jats:p>","DOI":"10.1111\/cgf.70461","type":"journal-article","created":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T06:17:48Z","timestamp":1781763468000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["<i>Symetra<\/i>\n                    : Visual Analytics for the Parameter Tuning Process of Symbolic Execution Engines"],"prefix":"10.1111","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-0890-2556","authenticated-orcid":false,"given":"D.","family":"Hong","sequence":"first","affiliation":[{"name":"Sungkyunkwan University  Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-7097-3171","authenticated-orcid":false,"given":"M.","family":"Kim","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University  Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4697-8536","authenticated-orcid":false,"given":"S.","family":"Cha","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University  Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5207-6010","authenticated-orcid":false,"given":"J.","family":"Jo","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University  Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,6,17]]},"reference":[{"key":"e_1_2_9_2_2","doi-asserted-by":"crossref","unstructured":"AngeliniM. BlasilliG. BorzacchielloL. CoppaE. D'EliaD. C. DemetrescuC. LentiS. NicchiS. SantucciG.: Symnav: Visually assisting symbolic execution. In2019 IEEE Symposium on Visualization for Cyber Security (VizSec)(2019) pp.1\u201311. doi:10.1109\/VizSec48167.2019.9161524. 3","DOI":"10.1109\/VizSec48167.2019.9161524"},{"key":"e_1_2_9_3_2","unstructured":"airbnb:visx - a collection of expressive low-level visualization primitives for react.https:\/\/airbnb.io\/visx\/ April2024. Last Accessed 29 November 2024. 7"},{"key":"e_1_2_9_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330701"},{"key":"e_1_2_9_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3182657"},{"key":"e_1_2_9_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/800027.808445"},{"key":"e_1_2_9_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.185"},{"key":"e_1_2_9_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2008.69"},{"key":"e_1_2_9_9_2","first-page":"209","volume-title":"Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation","author":"Cadar C.","year":"2008"},{"key":"e_1_2_9_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_2_9_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985995"},{"key":"e_1_2_9_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/1455518.1455522"},{"key":"e_1_2_9_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2021.3101870"},{"key":"e_1_2_9_14_2","doi-asserted-by":"publisher","DOI":"10.4230\/LIPIcs.ECOOP.2018.6"},{"key":"e_1_2_9_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510185"},{"key":"e_1_2_9_16_2","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.14300"},{"key":"e_1_2_9_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409755"},{"key":"e_1_2_9_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/2408776.2408795"},{"key":"e_1_2_9_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238179"},{"key":"e_1_2_9_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/1065010.1065036"},{"key":"e_1_2_9_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2093548.2093564"},{"key":"e_1_2_9_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098043"},{"key":"e_1_2_9_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3460120.3484813"},{"key":"e_1_2_9_24_2","doi-asserted-by":"crossref","unstructured":"HonfiD. VorosA. MicskeiZ.: Seviz: A tool for visualizing symbolic execution. In2015 IEEE 8th International Conference on Software Testing Verification and Validation (ICST)(2015) pp.1\u20138. doi:10.1109\/ICST.2015.7102631. 3","DOI":"10.1109\/ICST.2015.7102631"},{"key":"e_1_2_9_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416589"},{"key":"e_1_2_9_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/360248.360252"},{"key":"e_1_2_9_27_2","doi-asserted-by":"crossref","unstructured":"LiT. ConvertinoG. WangW. MostH. ZajoncT. TsaiY.-H.: Hypertuner: Visual analytics for hyperparameter tuning by professionals. In2018 IEEE Workshop on Machine Learning from User Interaction for Visualization and Analytics (MLUI)(2018) pp.1\u201311. doi:10.1109\/MLUI52768.2018.10075647. 2","DOI":"10.1109\/MLUI52768.2018.10075647"},{"key":"e_1_2_9_28_2","first-page":"4768","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems","author":"Lundberg S. M.","year":"2017"},{"key":"e_1_2_9_29_2","unstructured":"LiawR. LiangE. NishiharaR. MoritzP. GonzalezJ. E. StoicaI.: Tune: A research platform for distributed model selection and training.CoRR abs\/1807.05118(2018). URL:http:\/\/arxiv.org\/abs\/1807.05118 arXiv:1807.05118. 2"},{"key":"e_1_2_9_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2509136.2509553"},{"key":"e_1_2_9_31_2","doi-asserted-by":"publisher","DOI":"10.21105\/joss.00861"},{"key":"e_1_2_9_32_2","unstructured":"Microsoft:Neural Network Intelligence 12021. URL:https:\/\/github.com\/microsoft\/nni. 2 6"},{"key":"e_1_2_9_33_2","doi-asserted-by":"crossref","unstructured":"NowackM.: Fine-grain memory object representation in symbolic execution. In2019 34th IEEE\/ACM International Conference on Automated Software Engineering (ASE)(2019) pp.912\u2013923. doi:10.1109\/ASE.2019.00089. 2","DOI":"10.1109\/ASE.2019.00089"},{"key":"e_1_2_9_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330554"},{"key":"e_1_2_9_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3092703.3092728"},{"key":"e_1_2_9_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.3030380"},{"key":"e_1_2_9_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3660817"},{"key":"e_1_2_9_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/1081706.1081750"},{"key":"e_1_2_9_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180251"},{"key":"e_1_2_9_40_2","unstructured":"WalkeJ.:React - the library for web and native user interfaces.https:\/\/react.dev\/ April2024. Last Accessed 29 November 2024. 7"},{"key":"e_1_2_9_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300911"},{"key":"e_1_2_9_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.78"},{"key":"e_1_2_9_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2659751"},{"key":"e_1_2_9_44_2","doi-asserted-by":"crossref","unstructured":"ZielaskoJ. TempelS. HerdtV. DrechslerR.: 3d visualization of symbolic execution traces. In2022 Forum on Specification & Design Languages (FDL)(2022) pp.1\u20138. doi:10.1109\/FDL56239.2022.9925664. 3","DOI":"10.1109\/FDL56239.2022.9925664"}],"container-title":["Computer Graphics Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.70461","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/cgf.70461","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.70461","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T06:17:53Z","timestamp":1781763473000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/cgf.70461"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,17]]},"references-count":43,"alternative-id":["10.1111\/cgf.70461"],"URL":"https:\/\/doi.org\/10.1111\/cgf.70461","archive":["Portico"],"relation":{},"ISSN":["0167-7055","1467-8659"],"issn-type":[{"value":"0167-7055","type":"print"},{"value":"1467-8659","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,17]]},"assertion":[{"value":"2026-06-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70461"}}