{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T12:12:23Z","timestamp":1785240743032,"version":"3.55.0"},"reference-count":62,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2025,3,21]],"date-time":"2025-03-21T00:00:00Z","timestamp":1742515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Scottish Historic Population Platform"},{"DOI":"10.13039\/501100000269","name":"UK Economic and Social Research Council","doi-asserted-by":"crossref","award":["ES\/W010321\/1"],"award-info":[{"award-number":["ES\/W010321\/1"]}],"id":[{"id":"10.13039\/501100000269","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Universities Australia and the German Academic Exchange Service","award":["57701258"],"award-info":[{"award-number":["57701258"]}]},{"name":"Artificial Intelligence Dresden\/Leipzig"},{"name":"German Federal Ministry of Education and Research"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2025,3,31]]},"abstract":"<jats:p>Entity resolution is the problem of identifying records that refer to the same entity from one or multiple databases. Applications of entity resolution range from health and social science research to national security and online commerce. Entity resolution can be viewed as a classification task where pairs of records are classified as matches (referring to the same entity) or non-matches (referring to different entities). Alternatively, clustering-based entity resolution methods generate clusters of records such that each cluster refers to one entity, and each entity is represented by one cluster. If ground truth data in the form of known matches and non-matches are available, then performance measures such as precision, recall, and the F-measure, are commonly used to evaluate the quality of entity resolution methods. In practical applications, however, ground truth data are often not available, or they can be incomplete or biased, making quality evaluation challenging. To overcome this gap, we develop multiple methods to evaluate the quality of an entity resolution result without the need of ground truth data by calculating estimated numbers of true and false matches, as well as missed matches. These allow the calculation of estimates for precision, recall, and the F-measure. Our methods are either based on analysing links (classified record pairs) or the clustering structure provided by an entity resolution method. We validate our methods on multiple data sets from diverse domains, showing they can obtain precision and recall estimates close to their true values.<\/jats:p>","DOI":"10.1145\/3721985","type":"journal-article","created":{"date-parts":[[2025,3,15]],"date-time":"2025-03-15T07:25:22Z","timestamp":1742023522000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Unsupervised Evaluation of Entity Resolution"],"prefix":"10.1145","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7603-1845","authenticated-orcid":false,"given":"Charini","family":"Nanayakkara","sequence":"first","affiliation":[{"name":"School of Computing, Australian National University","place":["Canberra, Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3435-2015","authenticated-orcid":false,"given":"Peter","family":"Christen","sequence":"additional","affiliation":[{"name":"School of Computing, Australian National University","place":["Canberra, Australia"]},{"name":"Scottish Centre for Administrative Data Research, University of Edinburgh","place":["Edinburgh, United Kingdom of Great Britain and Northern Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7175-7359","authenticated-orcid":false,"given":"Victor","family":"Christen","sequence":"additional","affiliation":[{"name":"Computer Science, University Leipzig","place":["Leipzig, Germany"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,3,21]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-008-9066-8"},{"issue":"1","key":"e_1_3_3_3_2","doi-asserted-by":"crossref","first-page":"95","DOI":"10.7155\/jgaa.00084","article-title":"The star clustering algorithm for static and dynamic information organization.","volume":"8","author":"Aslam Javed A.","year":"2004","unstructured":"Javed A. Aslam, Ekaterina Pelekhov, and Daniela Rus. 2004. The star clustering algorithm for static and dynamic information organization. Graph Algorithms Applications 8, 1 (2004), 95\u2013129.","journal-title":"Graph Algorithms Applications"},{"issue":"3","key":"e_1_3_3_4_2","first-page":"52","article-title":"Neural networks for entity matching: A Survey","volume":"15","author":"Barlaug Nils","year":"2021","unstructured":"Nils Barlaug and Jon Atle Gulla. 2021. Neural networks for entity matching: A Survey. ACM Transactions on Knowledge Discovery from Data 15, 3, Article 52 (2021), 37 pages.","journal-title":"ACM Transactions on Knowledge Discovery from Data"},{"key":"e_1_3_3_5_2","first-page":"1425","article-title":"Flexible models for microclustering with application to entity resolution","volume":"29","author":"Betancourt Brenda","year":"2016","unstructured":"Brenda Betancourt, Giacomo Zanella, Jeffrey W. Miller, Hanna Wallach, Abbas Zaidi, and Rebecca C. Steorts. 2016. Flexible models for microclustering with application to entity resolution. Advances in Neural Information Processing Systems 29 (2016), 1425\u20131433.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"1","key":"e_1_3_3_6_2","first-page":"36","article-title":"Collective entity resolution in relational data","volume":"1","author":"Bhattacharya Indrajit","year":"2007","unstructured":"Indrajit Bhattacharya and Lise Getoor. 2007. Collective entity resolution in relational data. ACM Transactions on Knowledge Discovery from Data 1, 1 (2007), 36 pages.","journal-title":"ACM Transactions on Knowledge Discovery from Data"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.abi8021"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2016.11.011"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-5468\/2008\/10\/P10008"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.14778\/2732279.2732284"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31164-2"},{"issue":"3","key":"e_1_3_3_12_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3606367","article-title":"A review of the F-measure: Its history, properties, criticism, and alternatives","volume":"56","author":"Christen Peter","year":"2023","unstructured":"Peter Christen, David J. Hand, and Nishadi Kirielle. 2023. A review of the F-measure: Its history, properties, criticism, and alternatives. ACM Computing Surveys 56, 3 (2023), 1\u201324.","journal-title":"ACM Computing Surveys"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59706-1"},{"issue":"1","key":"e_1_3_3_14_2","first-page":"14","article-title":"Thirty-three myths and misconceptions about population data: From data capture and processing to linkage","volume":"8","author":"Christen Peter","year":"2023","unstructured":"Peter Christen and Rainer Schnell. 2023. Thirty-three myths and misconceptions about population data: From data capture and processing to linkage. International Journal of Population Data Science 8, 1 (2023), 14 pages.","journal-title":"International Journal of Population Data Science"},{"key":"e_1_3_3_15_2","first-page":"727","volume-title":"International Conference on Data Mining","author":"Christen Peter","year":"2015","unstructured":"Peter Christen, Dinusha Vatsalan, and Qing Wang. 2015. Efficient entity resolution with adaptive and interactive training data selection. In International Conference on Data Mining. IEEE, Atlantic City, 727\u2013732."},{"issue":"6","key":"e_1_3_3_16_2","first-page":"2050","article-title":"Reflections on modern methods: Linkage error bias","volume":"48","author":"Doidge James C.","year":"2019","unstructured":"James C. Doidge and Katie L. Harron. 2019. Reflections on modern methods: Linkage error bias. International Journal of Epidemiology 48, 6 (2019), 2050\u20132060.","journal-title":"International Journal of Epidemiology"},{"issue":"13","key":"e_1_3_3_17_2","doi-asserted-by":"crossref","first-page":"2685","DOI":"10.1016\/j.ins.2010.05.029","article-title":"Automatic threshold estimation for data matching applications","volume":"181","author":"Santos Juliana B. dos","year":"2011","unstructured":"Juliana B. dos Santos, Carlos A. Heuser, Viviane P. Moreira, and Leandro K. Wives. 2011. Automatic threshold estimation for data matching applications. Information Sciences 181, 13 (2011), 2685\u20132699.","journal-title":"Information Sciences"},{"issue":"1","key":"e_1_3_3_18_2","first-page":"1","article-title":"Transforming pairwise duplicates to entity clusters for high-quality duplicate detection","volume":"12","author":"Draisbach Uwe","year":"2019","unstructured":"Uwe Draisbach, Peter Christen, and Felix Naumann. 2019. Transforming pairwise duplicates to entity clusters for high-quality duplicate detection. ACM Journal Data and Information Quality 12, 1 (2019), 1\u201330.","journal-title":"ACM Journal Data and Information Quality"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1969.10501049"},{"key":"e_1_3_3_20_2","first-page":"294","volume-title":"Extending Database Technology","author":"Franke Martin","year":"2024","unstructured":"Martin Franke, Victor Christen, Peter Christen, Florens Rohde, and Erhard Rahm. 2024. (Privately) estimating linkage quality for record linkage. In Extending Database Technology. OpenProceedings, Paestum, 294\u2013306."},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11222-017-9746-6"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-021-05964-1"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687771"},{"key":"e_1_3_3_24_2","first-page":"959","volume-title":"International Conference on Information and Knowledge Management","author":"Heise Arvid","year":"2014","unstructured":"Arvid Heise, Gjergji Kasneci, and Felix Naumann. 2014. Estimating the number and sizes of fuzzy-duplicate clusters. In International Conference on Information and Knowledge Management. ACM, Shanghai, 959\u2013968."},{"issue":"2","key":"e_1_3_3_25_2","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1109\/TBDATA.2016.2637378","article-title":"Large-scale data pollution with Apache Spark","volume":"6","author":"Hildebrandt Kai","year":"2017","unstructured":"Kai Hildebrandt, Fabian Panse, Niklas Wilcke, and Norbert Ritter. 2017. Large-scale data pollution with Apache Spark. Transactions on Big Data 6, 2 (2017), 396\u2013411.","journal-title":"Transactions on Big Data"},{"key":"e_1_3_3_26_2","unstructured":"Markelle Kelly Rachel Longjohn and Kolby Nottingham. 2024. The UCI Machine Learning Repository. https:\/\/archive.ics.uci.edu"},{"key":"e_1_3_3_27_2","first-page":"236","volume-title":"UK Workshop on Computational Intelligence","author":"Kirkland Oliver","year":"2013","unstructured":"Oliver Kirkland and Beatriz De La Iglesia. 2013. Experimental evaluation of cluster quality measures. In UK Workshop on Computational Intelligence. IEEE, Guildford, 236\u2013243."},{"issue":"12","key":"e_1_3_3_28_2","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.14778\/2994509.2994535","article-title":"Magellan: Toward building entity matching management systems","volume":"9","author":"Konda Pradap","year":"2016","unstructured":"Pradap Konda, Sanjib Das, Paul Suganthan G. C., AnHai Doan, et\u00a0al. 2016. Magellan: Toward building entity matching management systems. VLDB Endowment 9, 12 (2016), 1197\u20131208.","journal-title":"VLDB Endowment"},{"key":"e_1_3_3_29_2","first-page":"217","article-title":"Extended affinity propagation clustering for multi-source entity resolution","volume":"311","author":"Lerm Stefan","year":"2021","unstructured":"Stefan Lerm, Alieh Saeedi, and Erhard Rahm. 2021. Extended affinity propagation clustering for multi-source entity resolution. Conference on Database Systems for Business, Technology and Web P-311 (2021), 217\u2013236.","journal-title":"Conference on Database Systems for Business, Technology and Web"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009953814988"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920871"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3665601.3669845"},{"key":"e_1_3_3_33_2","first-page":"19","volume-title":"Special Interest Group on Management of Data","author":"Mudgal Sidharth","year":"2018","unstructured":"Sidharth Mudgal, Han Li, Theodoros Rekatsinas, AnHai Doan, et\u00a0al. 2018. Deep learning for entity matching: A design space exploration. In Special Interest Group on Management of Data. ACM, Houston, 19\u201334."},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1002\/widm.53"},{"key":"e_1_3_3_35_2","first-page":"4354","volume-title":"International Conference on Information and Knowledge Management","author":"Nanayakkara Charini","year":"2022","unstructured":"Charini Nanayakkara and Peter Christen. 2022. Locality sensitive hashing with temporal and spatial constraints for efficient population record linkage. In International Conference on Information and Knowledge Management. ACM, Atlanta, 4354\u20134358."},{"key":"e_1_3_3_36_2","first-page":"9","volume-title":"International Workshop on Mining and Learning with Graphs","author":"Nanayakkara Charini","year":"2018","unstructured":"Charini Nanayakkara, Peter Christen, and Thilina Ranbaduge. 2018. Temporal graph-based clustering for historical record linkage. In International Workshop on Mining and Learning with Graphs. ACM, London, 9 pages."},{"key":"e_1_3_3_37_2","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1007\/978-3-030-16145-3_41","volume-title":"Pacific-Asia Conference on Knowledge Discovery and Data Mining","author":"Nanayakkara Charini","year":"2019","unstructured":"Charini Nanayakkara, Peter Christen, and Thilina Ranbaduge. 2019. Robust temporal graph clustering for group record linkage. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, Macau, 526\u2013538."},{"issue":"1","key":"e_1_3_3_38_2","first-page":"12","article-title":"Evaluation measure for group-based record linkage","volume":"4","author":"Nanayakkara Charini","year":"2019","unstructured":"Charini Nanayakkara, Peter Christen, Thilina Ranbaduge, and Eilidh Garrett. 2019. Evaluation measure for group-based record linkage. International Journal of Population Data Science 4, 1 (2019), 12 pages.","journal-title":"International Journal of Population Data Science"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.5555\/1841211"},{"key":"e_1_3_3_40_2","first-page":"371","volume-title":"Confederated International Conferences: CoopIS, C&TC, and ODBASE","author":"Nentwig Markus","year":"2017","unstructured":"Markus Nentwig, Anika Gro\u00df, Maximilian M\u00f6ller, and Erhard Rahm. 2017. Distributed holistic clustering on linked data. In Confederated International Conferences: CoopIS, C&TC, and ODBASE. Springer, Rhodes, 371\u2013382."},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.130.3381.954"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.70.056131"},{"key":"e_1_3_3_43_2","first-page":"12","volume-title":"Ontology Matching Workshop","author":"Ngomo Axel-Cyrille Ngonga","year":"2013","unstructured":"Axel-Cyrille Ngonga Ngomo and Klaus Lyko. 2013. Unsupervised learning of link specifications: Deterministic vs. non-deterministic. In Ontology Matching Workshop. ACM, Sydney, 12 pages."},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1504\/IJBIDM.2008.017973"},{"key":"e_1_3_3_45_2","first-page":"119","volume-title":"Extended Semantic Web Conference","author":"Nikolov Andriy","year":"2012","unstructured":"Andriy Nikolov, Mathieu d\u2019Aquin, and Enrico Motta. 2012. Unsupervised learning of link discovery configuration. In Extended Semantic Web Conference. Springer, Heraklion, 119\u2013133."},{"issue":"6","key":"e_1_3_3_46_2","first-page":"1","article-title":"An analysis of one-to-one matching algorithms for entity resolution","volume":"32","author":"Papadakis George","year":"2023","unstructured":"George Papadakis, Vasilis Efthymiou, Emmanouil Thanos, Oktie Hassanzadeh, and Peter Christen. 2023. An analysis of one-to-one matching algorithms for entity resolution. VLDB Journal 32, 6 (2023), 1\u201332.","journal-title":"VLDB Journal"},{"key":"e_1_3_3_47_2","series-title":"Synthesis Lectures on Data Management","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-031-01878-7","volume-title":"The Four Generations of Entity Resolution","author":"Papadakis George","year":"2021","unstructured":"George Papadakis, Ekaterini Ioannou, Emanouil Thanos, and Themis Palpanas. 2021. The Four Generations of Entity Resolution. Synthesis Lectures on Data Management, Vol. 16. Morgan & Claypool Publishers, San Rafael."},{"key":"e_1_3_3_48_2","first-page":"3435","volume-title":"International Conference on Data Engineering","author":"Papadakis George","year":"2024","unstructured":"George Papadakis, Nishadi Kirielle, Peter Christen, and Themis Palpanas. 2024. A critical re-evaluation of record linkage benchmarks for learning-based matching algorithms. In International Conference on Data Engineering. IEEE, Utrecht, 3435\u20133448."},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377455"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.14778\/3583140.3583163"},{"key":"e_1_3_3_51_2","first-page":"3101","volume-title":"International Conference on Information and Knowledge Management","author":"Primpeli Anna","year":"2020","unstructured":"Anna Primpeli and Christian Bizer. 2020. Profiling entity matching benchmark tasks. In International Conference on Information and Knowledge Management. ACM, Virtual Event, Ireland, 3101\u20133108."},{"key":"e_1_3_3_52_2","first-page":"1379","volume-title":"International Conference on Information and Knowledge Management","author":"Qian Kun","year":"2017","unstructured":"Kun Qian, Lucian Popa, and Prithviraj Sen. 2017. Active learning for large-scale entity resolution. In International Conference on Information and Knowledge Management. ACM, Singapore, 1379\u20131388."},{"issue":"3","key":"e_1_3_3_53_2","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1162\/dint_a_00057","article-title":"Constructing and cleaning identity graphs in the LOD cloud","volume":"2","author":"Raad Joe","year":"2020","unstructured":"Joe Raad, Wouter Beek, Frank van Harmelen, Jan Wielemaker, Nathalie Pernelle, and Fatiha Sa\u00efs. 2020. Constructing and cleaning identity graphs in the LOD cloud. Data Intelligence 2, 3 (2020), 323\u2013352.","journal-title":"Data Intelligence"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2014.03.008"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.3366\/hac.2002.14.1-2.61"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/0377-0427(87)90125-7"},{"key":"e_1_3_3_57_2","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1007\/978-3-319-66917-5_19","volume-title":"European Conference on Advances in Databases and Information Systems","author":"Saeedi Alieh","year":"2017","unstructured":"Alieh Saeedi, Eric Peukert, and Erhard Rahm. 2017. Comparative evaluation of distributed clustering schemes for multi-source entity resolution. In European Conference on Advances in Databases and Information Systems. Springer, Nicosia, 278\u2013293."},{"key":"e_1_3_3_58_2","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1007\/978-3-319-93417-4_37","volume-title":"Extended Semantic Web Conference","author":"Saeedi Alieh","year":"2018","unstructured":"Alieh Saeedi, Eric Peukert, and Erhard Rahm. 2018. Using link features for entity clustering in knowledge graphs. In Extended Semantic Web Conference. Springer, Crete, 576\u2013592."},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1002\/aris.2009.1440430113"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0117898"},{"key":"e_1_3_3_61_2","first-page":"247","volume-title":"Third Biennial Conference on Innovative Data Systems Research","author":"Thor Andreas","year":"2007","unstructured":"Andreas Thor and Erhard Rahm. 2007. MOMA - A mapping-based object matching system. In Third Biennial Conference on Innovative Data Systems Research. CIDR, Asilomar, 247\u2013258."},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-019-03310-w"},{"issue":"7","key":"e_1_3_3_63_2","doi-asserted-by":"crossref","first-page":"1333","DOI":"10.1109\/TKDE.2019.2904682","article-title":"Evaluation of the sample clustering process on graphs","volume":"32","author":"Zhang Jianpeng","year":"2019","unstructured":"Jianpeng Zhang, Yulong Pei, George Fletcher, and Mykola Pechenizkiy. 2019. Evaluation of the sample clustering process on graphs. IEEE Transactions on Knowledge and Data Engineering 32, 7 (2019), 1333\u20131347.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3721985","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3721985","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T05:54:09Z","timestamp":1753336449000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3721985"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,21]]},"references-count":62,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3,31]]}},"alternative-id":["10.1145\/3721985"],"URL":"https:\/\/doi.org\/10.1145\/3721985","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"value":"1936-1955","type":"print"},{"value":"1936-1963","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,21]]},"assertion":[{"value":"2024-07-26","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-13","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}