{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T02:13:26Z","timestamp":1775873606971,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":41,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,5,17]],"date-time":"2022-05-17T00:00:00Z","timestamp":1652745600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"EPSRC Doctoral Training Partnership","award":["EP\/R513313\/1"],"award-info":[{"award-number":["EP\/R513313\/1"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,5,17]]},"DOI":"10.1145\/3524481.3527227","type":"proceedings-article","created":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T16:51:53Z","timestamp":1658249513000},"page":"160-164","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["What do developer-repaired Flaky tests tell us about the effectiveness of automated Flaky test detection?"],"prefix":"10.1145","author":[{"given":"Owain","family":"Parry","sequence":"first","affiliation":[{"name":"University of Sheffield, UK"}]},{"given":"Gregory M.","family":"Kapfhammer","sequence":"additional","affiliation":[{"name":"Allegheny College"}]},{"given":"Michael","family":"Hilton","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University"}]},{"given":"Phil","family":"McMinn","sequence":"additional","affiliation":[{"name":"University of Sheffield, UK"}]}],"member":"320","published-online":{"date-parts":[[2022,7,19]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"2022. Box\/Flaky: Plugin for Nose or Pytest That Automatically Reruns Flaky Tests. https:\/\/github.com\/box\/flaky  2022. Box\/Flaky: Plugin for Nose or Pytest That Automatically Reruns Flaky Tests . https:\/\/github.com\/box\/flaky"},{"key":"e_1_3_2_1_2_1","unstructured":"2022. Cirq Commit Fixing Test Flakiness. https:\/\/github.com\/quantumlib\/Cirq\/commit\/0d1eacc456ada78de0815446905e9c48254cee6b  2022. Cirq Commit Fixing Test Flakiness . https:\/\/github.com\/quantumlib\/Cirq\/commit\/0d1eacc456ada78de0815446905e9c48254cee6b"},{"key":"e_1_3_2_1_3_1","unstructured":"2022. Find Install and Publish Python Packages with the Python Package Index. https:\/\/pypi.org\/  2022. Find Install and Publish Python Packages with the Python Package Index . https:\/\/pypi.org\/"},{"key":"e_1_3_2_1_4_1","unstructured":"2022. Pip Freeze. https:\/\/pip.pypa.io\/en\/stable\/cli\/pip_freeze\/  2022. Pip Freeze . https:\/\/pip.pypa.io\/en\/stable\/cli\/pip_freeze\/"},{"key":"e_1_3_2_1_5_1","unstructured":"2022. Replication Package. https:\/\/github.com\/flake-it\/showflakes-framework  2022. Replication Package . https:\/\/github.com\/flake-it\/showflakes-framework"},{"key":"e_1_3_2_1_6_1","unstructured":"2022. ShowFlakes. https:\/\/github.com\/flake-it\/showflakes  2022. ShowFlakes . https:\/\/github.com\/flake-it\/showflakes"},{"key":"e_1_3_2_1_7_1","unstructured":"2022. Virtual Environments and Packages. https:\/\/docs.python.org\/3\/tutorial\/venv.html  2022. Virtual Environments and Packages . https:\/\/docs.python.org\/3\/tutorial\/venv.html"},{"key":"e_1_3_2_1_8_1","unstructured":"2022. Welcome to the Tox Automation Project. https:\/\/tox.wiki\/en\/stable\/  2022. Welcome to the Tox Automation Project . https:\/\/tox.wiki\/en\/stable\/"},{"key":"e_1_3_2_1_9_1","volume-title":"Proceedings of the International Conference on Software Engineering (ICSE).","author":"Alshammari A.","unstructured":"A. Alshammari , C. Morris , M. Hilton , and J. Bell . 2021. FlakeFlagger: Predicting Flakiness Without Rerunning Tests . In Proceedings of the International Conference on Software Engineering (ICSE). A. Alshammari, C. Morris, M. Hilton, and J. Bell. 2021. FlakeFlagger: Predicting Flakiness Without Rerunning Tests. In Proceedings of the International Conference on Software Engineering (ICSE)."},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on the Foundations of Software Engineering (ESEC\/FSE). 770--781","author":"Bell J.","unstructured":"J. Bell , G. Kaiser , E. Melski , and M. Dattatreya . 2015. Efficient Dependency Detection for Safe Java Test Acceleration . In Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on the Foundations of Software Engineering (ESEC\/FSE). 770--781 . J. Bell, G. Kaiser, E. Melski, and M. Dattatreya. 2015. Efficient Dependency Detection for Safe Java Test Acceleration. In Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on the Foundations of Software Engineering (ESEC\/FSE). 770--781."},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the International Conference on Software Engineering (ICSE). 433--444","author":"Bell J.","unstructured":"J. Bell , O. Legunsen , M. Hilton , L. Eloussi , T. Yung , and D. Marinov . 2018. DeFlaker: Automatically Detecting Flaky Tests . In Proceedings of the International Conference on Software Engineering (ICSE). 433--444 . J. Bell, O. Legunsen, M. Hilton, L. Eloussi, T. Yung, and D. Marinov. 2018. DeFlaker: Automatically Detecting Flaky Tests. In Proceedings of the International Conference on Software Engineering (ICSE). 433--444."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3082424"},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the International Symposium on Software Testing and Analysis (ISSTA). 211--224","author":"Dutta S.","unstructured":"S. Dutta , A. Shi , R. Choudhary , Z. Zhang , A. Jain , and Misailovic S . 2020. Detecting Flaky Tests in Probabilistic and Machine Learning Applications . In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA). 211--224 . S. Dutta, A. Shi, R. Choudhary, Z. Zhang, A. Jain, and Misailovic S. 2020. Detecting Flaky Tests in Probabilistic and Machine Learning Applications. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA). 211--224."},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of the Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE). 211--224","author":"Dutta S.","unstructured":"S. Dutta , A. Shi , and Misailovic S . 2021. FLEX: Fixing Flaky Tests in Machine Learning Projects by Updating Assertion Bounds . In Proceedings of the Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE). 211--224 . S. Dutta, A. Shi, and Misailovic S. 2021. FLEX: Fixing Flaky Tests in Machine Learning Projects by Updating Assertion Bounds. In Proceedings of the Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE). 211--224."},{"key":"e_1_3_2_1_15_1","volume-title":"Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on the Foundations of Software Engineering (ESEC\/FSE). 830--840","author":"Eck M.","unstructured":"M. Eck , F. Palomba , M. Castelluccio , and A. Bacchelli . 2019. Understanding Flaky Tests: The Developer's Perspective . In Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on the Foundations of Software Engineering (ESEC\/FSE). 830--840 . M. Eck, F. Palomba, M. Castelluccio, and A. Bacchelli. 2019. Understanding Flaky Tests: The Developer's Perspective. In Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on the Foundations of Software Engineering (ESEC\/FSE). 830--840."},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the International Conference on Automated Software Engineering (ASE). 1204--1208","author":"Fazzini M.","unstructured":"M. Fazzini , A. Gorla , and A. Orso . 2020. A Framework for Automated Test Mocking of Mobile Apps . In Proceedings of the International Conference on Automated Software Engineering (ASE). 1204--1208 . M. Fazzini, A. Gorla, and A. Orso. 2020. A Framework for Automated Test Mocking of Mobile Apps. In Proceedings of the International Conference on Automated Software Engineering (ASE). 1204--1208."},{"key":"e_1_3_2_1_17_1","unstructured":"M. Fowler. 2011. Eradicating Non-Determinism in Tests https:\/\/martinfowler.com\/articles\/nonDeterminism.html.  M. Fowler. 2011. Eradicating Non-Determinism in Tests https:\/\/martinfowler.com\/articles\/nonDeterminism.html."},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). 1--11","author":"Gambi A.","unstructured":"A. Gambi , J. Bell , and A. Zeller . 2018. Practical Test Dependency Detection . In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). 1--11 . A. Gambi, J. Bell, and A. Zeller. 2018. Practical Test Dependency Detection. In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). 1--11."},{"key":"e_1_3_2_1_19_1","volume-title":"Proceedings of the International Conference on Software Testing, Verification and Validation (ICST).","author":"Gruber M.","unstructured":"M. Gruber , S. Lukasczyk , F. Kroi\u00df , and G. Fraser . 2021. An Empirical Study of Flaky Tests in Python . In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). M. Gruber, S. Lukasczyk, F. Kroi\u00df, and G. Fraser. 2021. An Empirical Study of Flaky Tests in Python. In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST)."},{"key":"e_1_3_2_1_20_1","volume-title":"Proceedings of the Symposium on the Foundations of Software Engineering (FSE). 223--233","author":"Gyori A.","unstructured":"A. Gyori , B. Lambeth , A. Shi , O. Legunsen , and D. Marinov . 2015. NonDex: A Tool for Detecting and Debugging Wrong Assumptions on Java API Specification . In Proceedings of the Symposium on the Foundations of Software Engineering (FSE). 223--233 . A. Gyori, B. Lambeth, A. Shi, O. Legunsen, and D. Marinov. 2015. NonDex: A Tool for Detecting and Debugging Wrong Assumptions on Java API Specification. In Proceedings of the Symposium on the Foundations of Software Engineering (FSE). 223--233."},{"key":"e_1_3_2_1_21_1","volume-title":"Proceedings of the International Conference on Software Testing and Analysis (ISSTA). 223--233","author":"Gyori A.","unstructured":"A. Gyori , A. Shi , F. Hariri , and D. Marinov . 2015. Reliable Testing: Detecting State-Polluting Tests to Prevent Test Dependency . In Proceedings of the International Conference on Software Testing and Analysis (ISSTA). 223--233 . A. Gyori, A. Shi, F. Hariri, and D. Marinov. 2015. Reliable Testing: Detecting State-Polluting Tests to Prevent Test Dependency. In Proceedings of the International Conference on Software Testing and Analysis (ISSTA). 223--233."},{"key":"e_1_3_2_1_22_1","volume-title":"Proceedings of the International Conference on Software Testing, Verification and Validation (ICST).","author":"Habchi S.","unstructured":"S. Habchi , G. Haben , M. Papadakis , M. Cordy , and Y. Le Traon . 2022. A Qualitative Study on the Sources, Impacts, and Mitigation Strategies of Flaky Tests . In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). S. Habchi, G. Haben, M. Papadakis, M. Cordy, and Y. Le Traon. 2022. A Qualitative Study on the Sources, Impacts, and Mitigation Strategies of Flaky Tests. In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST)."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/SCAM.2018.00009"},{"key":"e_1_3_2_1_24_1","unstructured":"K. Herzig. 2016. Let's Assume We Have to Pay for Testing. https:\/\/www.slideshare.net\/kim.herzig\/keynote-ast-2016  K. Herzig. 2016. Let's Assume We Have to Pay for Testing . https:\/\/www.slideshare.net\/kim.herzig\/keynote-ast-2016"},{"key":"e_1_3_2_1_25_1","volume-title":"Proceedings of the International Symposium on Foundations of Software Engineering (FSE). 621--631","author":"Huo C.","unstructured":"C. Huo and J. Clause . 2014. Improving Oracle Quality by Detecting Brittle Assertions and Unused Inputs in Tests . In Proceedings of the International Symposium on Foundations of Software Engineering (FSE). 621--631 . C. Huo and J. Clause. 2014. Improving Oracle Quality by Detecting Brittle Assertions and Unused Inputs in Tests. In Proceedings of the International Symposium on Foundations of Software Engineering (FSE). 621--631."},{"key":"e_1_3_2_1_26_1","volume-title":"Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). 312--322","author":"Lam W.","unstructured":"W. Lam , R. Oei , A. Shi , D. Marinov , and T. Xie . 2019. IDFlakies: A Framework for Detecting and Partially Classifying Flaky Tests . In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). 312--322 . W. Lam, R. Oei, A. Shi, D. Marinov, and T. Xie. 2019. IDFlakies: A Framework for Detecting and Partially Classifying Flaky Tests. In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). 312--322."},{"key":"e_1_3_2_1_27_1","volume-title":"Proceedings of the International Conference on Software Reliability Engineering (ISSRE). 403--413","author":"Lam W.","unstructured":"W. Lam , S. Winter , A. Astorga , V. Stodden , and D. Marinov . 2020. Understanding Reproducibility and Characteristics of Flaky Tests Through Test Reruns in Java Projects . In Proceedings of the International Conference on Software Reliability Engineering (ISSRE). 403--413 . W. Lam, S. Winter, A. Astorga, V. Stodden, and D. Marinov. 2020. Understanding Reproducibility and Characteristics of Flaky Tests Through Test Reruns in Java Projects. In Proceedings of the International Conference on Software Reliability Engineering (ISSRE). 403--413."},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the Symposium on Operating Systems Principles (SOSP). 162--180","author":"Li G.","unstructured":"G. Li , S. Lu , M. Musuvathi , S. Nath , and R. Padhye . 2019. Efficient Scalable Thread-Safety-Violation Detection: Finding Thousands of Concurrency Bugs during Testing . In Proceedings of the Symposium on Operating Systems Principles (SOSP). 162--180 . G. Li, S. Lu, M. Musuvathi, S. Nath, and R. Padhye. 2019. Efficient Scalable Thread-Safety-Violation Detection: Finding Thousands of Concurrency Bugs during Testing. In Proceedings of the Symposium on Operating Systems Principles (SOSP). 162--180."},{"key":"e_1_3_2_1_29_1","volume-title":"Proceedings of the Symposium on the Foundations of Software Engineering (FSE). 643--653","author":"Luo Q.","unstructured":"Q. Luo , F. Hariri , L. Eloussi , and D. Marinov . 2014. An Empirical Analysis of Flaky Tests . In Proceedings of the Symposium on the Foundations of Software Engineering (FSE). 643--653 . Q. Luo, F. Hariri, L. Eloussi, and D. Marinov. 2014. An Empirical Analysis of Flaky Tests. In Proceedings of the Symposium on the Foundations of Software Engineering (FSE). 643--653."},{"key":"e_1_3_2_1_30_1","unstructured":"J. Micco. 2016. Flaky Tests at Google and How We Mitigate Them https:\/\/testing.googleblog.com\/2016\/05\/flaky-tests-at-google-and-how-we.html.  J. Micco. 2016. Flaky Tests at Google and How We Mitigate Them https:\/\/testing.googleblog.com\/2016\/05\/flaky-tests-at-google-and-how-we.html."},{"key":"e_1_3_2_1_31_1","first-page":"1","article-title":"A Survey of Flaky Tests","volume":"31","author":"Parry O.","year":"2021","unstructured":"O. Parry , G. M. Kapfhammer , M. Hilton , and P. McMinn . 2021 . A Survey of Flaky Tests . Transactions on Software Engineering and Methodology 31 , 1 (2021), 1 -- 74 . O. Parry, G. M. Kapfhammer, M. Hilton, and P. McMinn. 2021. A Survey of Flaky Tests. Transactions on Software Engineering and Methodology 31, 1 (2021), 1--74.","journal-title":"Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the International Conference on Software Testing, Verification and Validation (ICST).","author":"Parry O.","unstructured":"O. Parry , G. M. Kapfhammer , M. Hilton , and P. McMinn . 2022. Evaluating Features for Machine Learning Detection of Order- and Non-Order-Dependent Flaky Tests . In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). to appear. O. Parry, G. M. Kapfhammer, M. Hilton, and P. McMinn. 2022. Evaluating Features for Machine Learning Detection of Order- and Non-Order-Dependent Flaky Tests. In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). to appear."},{"key":"e_1_3_2_1_33_1","volume-title":"Proceedings of the International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP).","author":"Parry O.","unstructured":"O. Parry , G. M. Kapfhammer , M. Hilton , and P. McMinn . 2022. Surveying the Developer Experience of Flaky Tests . In Proceedings of the International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). O. Parry, G. M. Kapfhammer, M. Hilton, and P. McMinn. 2022. Surveying the Developer Experience of Flaky Tests. In Proceedings of the International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387482"},{"key":"e_1_3_2_1_35_1","volume-title":"Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). 80--90","author":"Shi A.","unstructured":"A. Shi , A. Gyori , O. Legunsen , and D. Marinov . 2016. Detecting Assumptions on Deterministic Implementations of Non-Deterministic Specifications . In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). 80--90 . A. Shi, A. Gyori, O. Legunsen, and D. Marinov. 2016. Detecting Assumptions on Deterministic Implementations of Non-Deterministic Specifications. In Proceedings of the International Conference on Software Testing, Verification and Validation (ICST). 80--90."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME46990.2020.00037"},{"key":"e_1_3_2_1_37_1","volume-title":"Proceedings of the International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER). 69--72","author":"Terragni V.","unstructured":"V. Terragni , P. Salza , and F. Ferrucci . 2020. A Container-based Infrastructure for Fuzzy-driven Root Causing of Flaky Tests . In Proceedings of the International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER). 69--72 . V. Terragni, P. Salza, and F. Ferrucci. 2020. A Container-based Infrastructure for Fuzzy-driven Root Causing of Flaky Tests. In Proceedings of the International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER). 69--72."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-09973-5"},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on the Foundations of Software Engineering (ESEC\/FSE). 647--658","author":"Widder D. G.","unstructured":"D. G. Widder , M. Hilton , C. K\u00e4stner , and B. Vasilescu . 2019. A Conceptual Replication of Continuous Integration Pain Points in the Context of Travis CI . In Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on the Foundations of Software Engineering (ESEC\/FSE). 647--658 . D. G. Widder, M. Hilton, C. K\u00e4stner, and B. Vasilescu. 2019. A Conceptual Replication of Continuous Integration Pain Points in the Context of Travis CI. In Proceedings of the Joint Meeting of the European Software Engineering Conference and the Symposium on the Foundations of Software Engineering (ESEC\/FSE). 647--658."},{"key":"e_1_3_2_1_40_1","volume-title":"Proceedings of the International Symposium on Software Testing and Analysis (ISSTA). 385--396","author":"Zhang S.","unstructured":"S. Zhang , D. Jalali , J. Wuttke , K. Mu\u015flu , W. Lam , M. D. Ernst , and D. Notkin . 2014. Empirically Revisiting the Test Independence Assumption . In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA). 385--396 . S. Zhang, D. Jalali, J. Wuttke, K. Mu\u015flu, W. Lam, M. D. Ernst, and D. Notkin. 2014. Empirically Revisiting the Test Independence Assumption. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA). 385--396."},{"key":"e_1_3_2_1_41_1","volume-title":"Proceedings of the International Conference on Automated Software Engineering (ASE). 436--447","author":"Zhu H.","unstructured":"H. Zhu , L. Wei , M. Wen , Y. Liu , S. C. Cheung , Q. Sheng , and C. Zhou . 2020. Mock-Sniffer: Characterizing and Recommending Mocking Decisions for Unit Tests . In Proceedings of the International Conference on Automated Software Engineering (ASE). 436--447 . H. Zhu, L. Wei, M. Wen, Y. Liu, S. C. Cheung, Q. Sheng, and C. Zhou. 2020. Mock-Sniffer: Characterizing and Recommending Mocking Decisions for Unit Tests. In Proceedings of the International Conference on Automated Software Engineering (ASE). 436--447."}],"event":{"name":"AST '22: IEEE\/ACM 3rd International Conference on Automation of Software Test","location":"Pittsburgh Pennsylvania","acronym":"AST '22","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE TCSC IEEE Technical Committee on Scalable Computing"]},"container-title":["Proceedings of the 3rd ACM\/IEEE International Conference on Automation of Software Test"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524481.3527227","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3524481.3527227","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:50:59Z","timestamp":1750182659000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524481.3527227"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,17]]},"references-count":41,"alternative-id":["10.1145\/3524481.3527227","10.1145\/3524481"],"URL":"https:\/\/doi.org\/10.1145\/3524481.3527227","relation":{},"subject":[],"published":{"date-parts":[[2022,5,17]]},"assertion":[{"value":"2022-07-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}