{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:11:05Z","timestamp":1776111065597,"version":"3.50.1"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"14s","license":[{"start":{"date-parts":[[2023,7,17]],"date-time":"2023-07-17T00:00:00Z","timestamp":1689552000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2023,12,31]]},"abstract":"<jats:p>Gamification is an established practice in Software Engineering to increase effectiveness and engagement in many practices. This manuscript provides a characterization of the application of gamification to the Software Testing area. Such practice in fact reportedly suffers from low engagement by both personnel in industrial contexts and learners in educational contexts. Our goal is to identify the application areas and utilized gamified techniques and mechanics, the provided benefits and drawbacks, as well as the open challenges in the field. To this purpose, we conducted a Multivocal Literature Review to identify white and grey literature sources addressing gamified software testing.<\/jats:p>\n          <jats:p>We analyzed 73 contributions and summarized the most common gamified mechanics, concepts, tools, and domains where they are mostly applied. We conclude that gamification in software testing is mostly applied to the test creation phase with simple white-box unit or mutation testing tools and is mostly used to foster good behaviors by promoting the testers\u2019 accomplishment. Key research areas and main challenges in the field are: careful design of tailored gamified mechanics for specific testing techniques; the need for technological improvements to enable crowdsourcing, cooperation, and concurrency; the necessity for empirical and large-scale evaluation of the benefits delivered by gamification mechanics.<\/jats:p>","DOI":"10.1145\/3582273","type":"journal-article","created":{"date-parts":[[2023,2,10]],"date-time":"2023-02-10T11:59:35Z","timestamp":1676030375000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":37,"title":["A Review on Tools, Mechanics, Benefits, and Challenges of Gamified Software Testing"],"prefix":"10.1145","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8765-6501","authenticated-orcid":false,"given":"Tommaso","family":"Fulcini","sequence":"first","affiliation":[{"name":"Politecnico di Torino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4601-7425","authenticated-orcid":false,"given":"Riccardo","family":"Coppola","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0501-7886","authenticated-orcid":false,"given":"Luca","family":"Ardito","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5328-368X","authenticated-orcid":false,"given":"Marco","family":"Torchiano","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,7,17]]},"reference":[{"key":"e_1_3_3_2_2","volume-title":"ISO 9001:2005 - Quality Management Systems - Requirements","year":"2005","unstructured":"2005. ISO 9001:2005 - Quality Management Systems - Requirements. Standard. International Organization for Standardization."},{"issue":"2","key":"e_1_3_3_3_2","first-page":"11","article-title":"Software testing: Review on tools, techniques and challenges","volume":"2","author":"Abdullahi Shamsu","year":"2020","unstructured":"Shamsu Abdullahi, Abubakar Zakari, Haruna Abdu, Amina Nura, Musa Ahmed Zayyad, Salisu Suleiman, Alhassan Adamu, and Abdulfatahu Samaila Mashasha. 2020. Software testing: Review on tools, techniques and challenges. Int. J. Adv. Res. Techn. Innov. 2, 2 (2020), 11\u201318.","journal-title":"Int. J. Adv. Res. Techn. Innov."},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1111\/ijmr.12102"},{"key":"e_1_3_3_5_2","first-page":"105","volume-title":"Proceedings of the IEEE\/ACM 13th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE)","author":"Barreto Carlos Futino","year":"2021","unstructured":"Carlos Futino Barreto and C\u00e9sar Fran\u00e7a. 2021. Gamification in software engineering: A literature review. In Proceedings of the IEEE\/ACM 13th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). 105\u2013108. DOI:10.1109\/CHASE52884.2021.00020"},{"key":"e_1_3_3_6_2","volume-title":"Softw. Eng","author":"Belli Fevzi","year":"2005","unstructured":"Fevzi Belli, Nimal Nissanke, Christof J. Budnik, and Aditya Mathur. 2005. Test generation using event sequence graphs. Softw. Eng, 52 (2005)."},{"key":"e_1_3_3_7_2","first-page":"571","volume-title":"Proceedings of the 27th International Conference on Software Engineering","author":"Berner Stefan","year":"2005","unstructured":"Stefan Berner, Roland Weber, and Rudolf K. Keller. 2005. Observations and lessons learned from automated testing. In Proceedings of the 27th International Conference on Software Engineering. 571\u2013579."},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1108\/JCM-04-2014-0945"},{"issue":"5","key":"e_1_3_3_9_2","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1109\/MS.2009.144","article-title":"Web application tests with selenium","volume":"26","author":"Bruns Andreas","year":"2009","unstructured":"Andreas Bruns, Andreas Kornstadt, and Dennis Wichmann. 2009. Web application tests with selenium. IEEE Softw. 26, 5 (2009), 88\u201391.","journal-title":"IEEE Softw."},{"key":"e_1_3_3_10_2","volume-title":"Proceedings of the European Conference on Games Based Learning","author":"Caponetto Ilaria","year":"2014","unstructured":"Ilaria Caponetto, Jeffrey Earp, and Michela Ott. 2014. Gamification and education: A literature review. In Proceedings of the European Conference on Games Based Learning. Academic Conferences International Limited."},{"key":"e_1_3_3_11_2","volume-title":"Actionable Gamification: Beyond Points, Badges, and Leaderboards","author":"Chou Yu-Kai","year":"2015","unstructured":"Yu-Kai Chou. 2015. Actionable Gamification: Beyond Points, Badges, and Leaderboards. Createspace Independent Publishing Platform. Retrieved from https:\/\/books.google.it\/books?id=jFWQrgEACAAJ."},{"key":"e_1_3_3_12_2","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1145\/1869542.1869573","volume-title":"Proceedings of the ACM International Conference Companion on Object Oriented Programming Systems Languages and Applications Companion (OOPSLA\u201910)","author":"Clarke Peter John","year":"2010","unstructured":"Peter John Clarke, Andrew Allen, Tariq King, Edward Jones, and Prathiba Natesan. 2010. Using a web-based repository to integrate testing tools into programming courses. In Proceedings of the ACM International Conference Companion on Object Oriented Programming Systems Languages and Applications Companion (OOPSLA\u201910). Association for Computing Machinery, 193\u2013200. DOI:10.1145\/1869542.1869573"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2648787"},{"key":"e_1_3_3_14_2","first-page":"1","volume-title":"Proceedings of the IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR)","author":"Contan Andrei","year":"2018","unstructured":"Andrei Contan, Catalin Dehelean, and Liviu Miclea. 2018. Test automation pyramid from theory to practice. In Proceedings of the IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR). IEEE, 1\u20135."},{"key":"e_1_3_3_15_2","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1145\/3266003.3266007","volume-title":"Proceedings of the Brazilian Symposium on Systematic and Automated Software Testing (SAST\u201918)","author":"Jesus Gabriela Martins de","year":"2018","unstructured":"Gabriela Martins de Jesus, Fabiano Cutigi Ferrari, Daniel de Paula Porto, and Sandra Camargo Pinto Ferraz Fabbri. 2018. Gamification in software testing: A characterization study. In Proceedings of the Brazilian Symposium on Systematic and Automated Software Testing (SAST\u201918). Association for Computing Machinery, New York, NY, 39\u201348. DOI:10.1145\/3266003.3266007"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2016.01.002"},{"key":"e_1_3_3_17_2","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1145\/2181037.2181040","volume-title":"Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments (MindTrek\u201911)","author":"Deterding Sebastian","year":"2011","unstructured":"Sebastian Deterding, Dan Dixon, Rilla Khaled, and Lennart Nacke. 2011. From game design elements to gamefulness: defining \u201cgamification.\u201d In Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments (MindTrek\u201911). Association for Computing Machinery, New York, NY, 9\u201315. DOI:10.1145\/2181037.2181040"},{"key":"e_1_3_3_18_2","first-page":"31","volume-title":"Proceedings of the 1st ACM International Workshop on Empirical Assessment of Software Engineering Languages and Technologies: Held in Conjunction with the 22nd IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Neto Arilo C. Dias","year":"2007","unstructured":"Arilo C. Dias Neto, Rajesh Subramanyan, Marlon Vieira, and Guilherme H. Travassos. 2007. A survey on model-based testing approaches: A systematic review. In Proceedings of the 1st ACM International Workshop on Empirical Assessment of Software Engineering Languages and Technologies: Held in Conjunction with the 22nd IEEE\/ACM International Conference on Automated Software Engineering (ASE). 31\u201336."},{"issue":"1","key":"e_1_3_3_19_2","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s10664-006-5964-9","article-title":"The economics of unit testing","volume":"11","author":"Ellims Michael","year":"2006","unstructured":"Michael Ellims, James Bridges, and Darrel C. Ince. 2006. The economics of unit testing. Empir. Softw. Eng. 11, 1 (2006), 5\u201331.","journal-title":"Empir. Softw. Eng."},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.intmar.2018.03.002"},{"key":"e_1_3_3_21_2","first-page":"2","volume-title":"Proceedings of the IEEE\/ACM 12th International Workshop on Automation of Software Testing (AST)","author":"Fraser Gordon","year":"2017","unstructured":"Gordon Fraser. 2017. Gamification of software testing. In Proceedings of the IEEE\/ACM 12th International Workshop on Automation of Software Testing (AST). 2\u20137. DOI:10.1109\/AST.2017.20"},{"key":"e_1_3_3_22_2","volume-title":"Proceedings of the 8th International Conference on Software Process Improvement (CIMPS\u201919)","author":"Garc\u00eda-Mireles Gabriel","year":"2020","unstructured":"Gabriel Garc\u00eda-Mireles and Miguel Ehecatl Trujillo. 2020. Trends and Applications in Software Engineering. In Proceedings of the 8th International Conference on Software Process Improvement (CIMPS\u201919). Springer International Publishing."},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2017.01.001"},{"key":"e_1_3_3_24_2","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1145\/3084226.3084264","volume-title":"Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering","author":"Garousi Vahid","year":"2017","unstructured":"Vahid Garousi, Michael Felderer, Marco Kuhrmann, and Kadir Herkilo\u011flu. 2017. What industry wants from academia in software testing? Hearing practitioners\u2019 opinions. In Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering. 65\u201369."},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2018.09.006"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2016.04.015"},{"issue":"6","key":"e_1_3_3_27_2","doi-asserted-by":"crossref","first-page":"836","DOI":"10.1016\/j.cptl.2015.08.001","article-title":"How to analyze Likert and other rating scale data","volume":"7","author":"Harpe Spencer E.","year":"2015","unstructured":"Spencer E. Harpe. 2015. How to analyze Likert and other rating scale data. Curr. Pharm. Teach. Learn. 7, 6 (2015), 836\u2013850.","journal-title":"Curr. Pharm. Teach. Learn."},{"key":"e_1_3_3_28_2","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1145\/336512.336532","volume-title":"Proceedings of the Conference on the Future of Software Engineering (ICSE\u201900)","author":"Harrold Mary Jean","year":"2000","unstructured":"Mary Jean Harrold. 2000. Testing: A roadmap. In Proceedings of the Conference on the Future of Software Engineering (ICSE\u201900). Association for Computing Machinery, New York, NY, 61\u201372. DOI:10.1145\/336512.336532"},{"issue":"13","key":"e_1_3_3_29_2","article-title":"Software test process, testing types and techniques","volume":"111","author":"Hooda Itti","year":"2015","unstructured":"Itti Hooda and Rajender Singh Chhillar. 2015. Software test process, testing types and techniques. Int. J. Comput. Applic. 111, 13 (2015).","journal-title":"Int. J. Comput. Applic."},{"key":"e_1_3_3_30_2","first-page":"494","volume-title":"Proceedings of the 3rd International Symposium on Empirical Software Engineering and Measurement","author":"Itkonen Juha","year":"2009","unstructured":"Juha Itkonen, Mika V. Mantyla, and Casper Lassenius. 2009. How do testers do it? An exploratory study on manual testing practices. In Proceedings of the 3rd International Symposium on Empirical Software Engineering and Measurement. IEEE, 494\u2013497."},{"key":"e_1_3_3_31_2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1145\/2372251.2372257","volume-title":"Proceedings of the ACM-IEEE International Symposium on Empirical Software Engineering and Measurement","author":"Jalali Samireh","year":"2012","unstructured":"Samireh Jalali and Claes Wohlin. 2012. Systematic literature studies: Database searches vs. backward snowballing. In Proceedings of the ACM-IEEE International Symposium on Empirical Software Engineering and Measurement. IEEE, IEEE Computer Society, Los Alamitos, CA, 29\u201338. DOI:10.1145\/2372251.2372257"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-68237-0_16"},{"key":"e_1_3_3_33_2","unstructured":"Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing systematic literature reviews in software engineering. (2007). https:\/\/www.researchgate.net\/profile\/Barbara-Kitchenham\/publication\/302924724_Guidelines_for_performing_Systematic_Literature_Reviews_in_Software_Engineering\/links\/61712932766c4a211c03a6f7\/Guidelines-for-performing-Systematic-Literature-Reviews-in-Software-Engineering.pdf."},{"issue":"3","key":"e_1_3_3_34_2","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1177\/1046878118774385","article-title":"Gamification science, its history and future: Definitions and a research agenda","volume":"49","author":"Landers Richard N.","year":"2018","unstructured":"Richard N. Landers, Elena M. Auer, Andrew B. Collmus, and Michael B. Armstrong. 2018. Gamification science, its history and future: Definitions and a research agenda. Simul. Gaming 49, 3 (2018), 315\u2013337.","journal-title":"Simul. Gaming"},{"key":"e_1_3_3_35_2","first-page":"399","volume-title":"Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME\u201917)","author":"Linares-V\u00e1squez Mario","year":"2017","unstructured":"Mario Linares-V\u00e1squez, Kevin Moran, and Denys Poshyvanyk. 2017. Continuous, evolutionary and large-scale: A new perspective for automated mobile app testing. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME\u201917). 399\u2013410. DOI:10.1109\/ICSME.2017.27"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-49094-6_46"},{"key":"e_1_3_3_37_2","volume-title":"Proceedings of the ASEE Annual Conference & Exposition","author":"Gari Gursimran Singh Walia, Mourya Reddy Narasareddy","year":"2018","unstructured":"Gursimran Singh Walia, Mourya Reddy Narasareddy Gari, and Alex David Radermacher. 2018. Gamification in computer science education: A systematic literature review. In Proceedings of the ASEE Annual Conference & Exposition. Retrieved from https:\/\/peer.asee.org\/30554."},{"key":"e_1_3_3_38_2","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1016\/j.chb.2016.11.062","article-title":"The maturing of gamification research","volume":"71","author":"Nacke Lennart E.","year":"2017","unstructured":"Lennart E. Nacke and Christoph Sebastian Deterding. 2017. The maturing of gamification research. Comput. Hum. Behav. 71 (2017), 450\u2013454.","journal-title":"Comput. Hum. Behav."},{"key":"e_1_3_3_39_2","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1145\/2494444.2494464","volume-title":"Proceedings of the International C* Conference on Computer Science and Software Engineering","author":"Nedyalkova Stanislava","year":"2013","unstructured":"Stanislava Nedyalkova and Jorge Bernardino. 2013. Open source capture and replay tools comparison. In Proceedings of the International C* Conference on Computer Science and Software Engineering. 117\u2013119."},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3130859.3131412"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.3102\/00346543061003265"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2014.08.007"},{"key":"e_1_3_3_43_2","first-page":"68","volume-title":"Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering (EASE\u201908)","author":"Petersen Kai","year":"2008","unstructured":"Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic mapping studies in software engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering (EASE\u201908). BCS Learning & Development Ltd., Swindon, GBR, 68\u201377. DOI:10.14236\/ewic\/EASE2008.8"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bushor.2015.03.006"},{"key":"e_1_3_3_45_2","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1007\/978-3-030-85347-1_34","volume-title":"Proceedings of the International Conference on the Quality of Information and Communications Technology","author":"Rodr\u00edguez-Vald\u00e9s Olivia","year":"2021","unstructured":"Olivia Rodr\u00edguez-Vald\u00e9s, Tanja E. J. Vos, Pekka Aho, and Beatriz Mar\u00edn. 2021. 30 years of automated GUI testing: A bibliometric analysis. In Proceedings of the International Conference on the Quality of Information and Communications Technology. Springer, 473\u2013488."},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.55.1.68"},{"key":"e_1_3_3_47_2","first-page":"2029","article-title":"Grey literature in library and information studies","author":"Sch\u00f6pfel Joachim","year":"2010","unstructured":"Joachim Sch\u00f6pfel and Dominic Farace. 2010. Grey literature in library and information studies. Encycl. Libr. Inf. Sci. (2010), 2029\u20132039.","journal-title":"Encycl. Libr. Inf. Sci."},{"key":"e_1_3_3_48_2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1145\/1984674.1984685","volume-title":"Proceedings of the 1st International Workshop on Games and Software Engineering (GAS\u201911)","author":"Sheth Swapneel","year":"2011","unstructured":"Swapneel Sheth, Jonathan Bell, and Gail Kaiser. 2011. HALO (highly addictive, socially optimized) software engineering. In Proceedings of the 1st International Workshop on Games and Software Engineering (GAS\u201911). Association for Computing Machinery, New York, NY, 29\u201332. DOI:10.1145\/1984674.1984685"},{"key":"e_1_3_3_49_2","first-page":"93","volume-title":"Proceedings of the 9th Annual International Conference on International Computing Education Research","author":"Smith Joanna","year":"2012","unstructured":"Joanna Smith, Joe Tessler, Elliot Kramer, and Calvin Lin. 2012. Using peer review to teach software testing. In Proceedings of the 9th Annual International Conference on International Computing Education Research. 93\u201398."},{"key":"e_1_3_3_50_2","unstructured":"StackSocial. 2014. The most popular coding language at top US universities. (2014). Retrieved from http:\/\/blog.stacksocial.com\/popular-coding-language\/."},{"key":"e_1_3_3_51_2","doi-asserted-by":"crossref","unstructured":"Philipp Straubinger and Gordon Fraser. 2022. Gamekins: Gamifying software testing in Jenkins. DOI:10.1145\/3510454.3516862","DOI":"10.1145\/3510454.3516862"},{"key":"e_1_3_3_52_2","volume-title":"Practical Model-based Testing: A Tools Approach","author":"Utting Mark","year":"2010","unstructured":"Mark Utting and Bruno Legeard. 2010. Practical Model-based Testing: A Tools Approach. Elsevier."},{"key":"e_1_3_3_53_2","volume-title":"Exploratory Software Testing: Tips, Tricks, Tours, and Techniques to Guide Test Design","author":"Whittaker James A.","year":"2009","unstructured":"James A. Whittaker. 2009. Exploratory Software Testing: Tips, Tricks, Tours, and Techniques to Guide Test Design. Pearson Education."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582273","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3582273","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:32Z","timestamp":1750182692000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582273"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,17]]},"references-count":52,"journal-issue":{"issue":"14s","published-print":{"date-parts":[[2023,12,31]]}},"alternative-id":["10.1145\/3582273"],"URL":"https:\/\/doi.org\/10.1145\/3582273","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,17]]},"assertion":[{"value":"2022-06-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-01-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}