{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T04:28:04Z","timestamp":1774326484236,"version":"3.50.1"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T00:00:00Z","timestamp":1634256000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"European Union's Horizon 2020","award":["812997"],"award-info":[{"award-number":["812997"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2021,12,31]]},"abstract":"<jats:p>Wikidata is one of the most important sources of structured data on the web, built by a worldwide community of volunteers. As a secondary source, its contents must be backed by credible references; this is particularly important, as Wikidata explicitly encourages editors to add claims for which there is no broad consensus, as long as they are corroborated by references. Nevertheless, despite this essential link between content and references, Wikidata's ability to systematically assess and assure the quality of its references remains limited. To this end, we carry out a mixed-methods study to determine the relevance, ease of access, and authoritativeness of Wikidata references, at scale and in different languages, using online crowdsourcing, descriptive statistics, and machine learning. Building on previous work of ours, we run a series of microtasks experiments to evaluate a large corpus of references, sampled from Wikidata triples with labels in several languages. We use a consolidated, curated version of the crowdsourced assessments to train several machine learning models to scale up the analysis to the whole of Wikidata. The findings help us ascertain the quality of references in Wikidata and identify common challenges in defining and capturing the quality of user-generated multilingual structured data on the web. We also discuss ongoing editorial practices, which could encourage the use of higher-quality references in a more immediate way. All data and code used in the study are available on GitHub for feedback and further improvement and deployment by the research community.<\/jats:p>","DOI":"10.1145\/3484828","type":"journal-article","created":{"date-parts":[[2021,10,16]],"date-time":"2021-10-16T01:04:15Z","timestamp":1634346255000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Assessing the Quality of Sources in Wikidata Across Languages: A Hybrid Approach"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4482-5376","authenticated-orcid":false,"given":"Gabriel","family":"Amaral","sequence":"first","affiliation":[{"name":"King's College London, London, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0362-4826","authenticated-orcid":false,"given":"Alessandro","family":"Piscopo","sequence":"additional","affiliation":[{"name":"BBC, London, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1514-8505","authenticated-orcid":false,"given":"Lucie-aim\u00e9e","family":"Kaffee","sequence":"additional","affiliation":[{"name":"University of Southampton, Southampton, United Kingdom"}]},{"given":"Odinaldo","family":"Rodrigues","sequence":"additional","affiliation":[{"name":"King's College London, London, United Kingdom"}]},{"given":"Elena","family":"Simperl","sequence":"additional","affiliation":[{"name":"King's College London, London, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2021,10,15]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1822258.1822293"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the SIGIR Workshop on the Future of IR Evaluation","volume":"15","author":"Alonso Omar","year":"2009","unstructured":"Omar Alonso and Stefano Mizzaro . 2009 . Can we get rid of TREC assessors? Using mechanical turk for relevance assessment . In Proceedings of the SIGIR Workshop on the Future of IR Evaluation , Vol. 15 . R Publications, Amsterdam, Boston, MA, 16. Omar Alonso and Stefano Mizzaro. 2009. Can we get rid of TREC assessors? Using mechanical turk for relevance assessment. In Proceedings of the SIGIR Workshop on the Future of IR Evaluation, Vol. 15. R Publications, Amsterdam, Boston, MA, 16."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348413"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3184558.3191641"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010039"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622407.1622416"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-1060"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159661"},{"key":"e_1_2_1_9_1","volume-title":"Computational trust in web content quality: A comparative evaluation on the Wikipedia project. Informatica 31 (Jan","author":"Dondio Pierpaolo","year":"2007","unstructured":"Pierpaolo Dondio and Stephen Barrett . 2007. Computational trust in web content quality: A comparative evaluation on the Wikipedia project. Informatica 31 (Jan . 2007 ), 151. Pierpaolo Dondio and Stephen Barrett. 2007. Computational trust in web content quality: A comparative evaluation on the Wikipedia project. Informatica 31 (Jan. 2007), 151."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11964-9_4"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.3233\/SW-170275"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/0895-4356(90)90158-L"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983808"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491055.2491064"},{"key":"e_1_2_1_16_1","volume-title":"Understanding Malicious Behavior in Crowdsourcing Platforms: The Case of Online Surveys","author":"Gadiraju Ujwal","unstructured":"Ujwal Gadiraju , Ricardo Kawase , Stefan Dietze , and Gianluca Demartini . 2015. Understanding Malicious Behavior in Crowdsourcing Platforms: The Case of Online Surveys . ACM , New York, NY , 1631\u20131640. https:\/\/doi.org\/10.1145\/2702123.2702443 10.1145\/2702123.2702443 Ujwal Gadiraju, Ricardo Kawase, Stefan Dietze, and Gianluca Demartini. 2015. Understanding Malicious Behavior in Crowdsourcing Platforms: The Case of Online Surveys. ACM, New York, NY, 1631\u20131640. https:\/\/doi.org\/10.1145\/2702123.2702443"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2015.08.001"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/ijmr.12135"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/646996.711278"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/11538059_91"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1080\/19312450709336664"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence). IEEE","author":"He Haibo","year":"2008","unstructured":"Haibo He , Yang Bai , Edwardo A. Garcia , and Shutao Li . 2008 . ADASYN: Adaptive synthetic sampling approach for imbalanced learning . In Proceedings of the IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence). IEEE , Hong Kong, China, 1322\u20131328. https:\/\/doi.org\/10.1109\/IJCNN. 2008.4633969 10.1109\/IJCNN.2008.4633969 Haibo He, Yang Bai, Edwardo A. Garcia, and Shutao Li. 2008. ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In Proceedings of the IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence). IEEE, Hong Kong, China, 1322\u20131328. https:\/\/doi.org\/10.1109\/IJCNN.2008.4633969"},{"key":"e_1_2_1_23_1","volume-title":"Crowdsourcing: A comprehensive literature review. Strat. Outsourc.: Int. J. 8 (02","author":"Hossain Mokter","year":"2015","unstructured":"Mokter Hossain and Ilkka Kauranen . 2015 . Crowdsourcing: A comprehensive literature review. Strat. Outsourc.: Int. J. 8 (02 2015), 2\u201322. Mokter Hossain and Ilkka Kauranen. 2015. Crowdsourcing: A comprehensive literature review. Strat. Outsourc.: Int. J. 8 (02 2015), 2\u201322."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1321440.1321476"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5220\/0007571508170823"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.3233\/SW-170277"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897368"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460639"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487788.2488133"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/324133.324140"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2645710.2645783"},{"key":"e_1_2_1_33_1","unstructured":"Adam Lerer Ledell Wu Jiajun Shen Timothee Lacroix Luca Wehrstedt Abhijit Bose and Alex Peysakhovich. 2019. PyTorch-BigGraph: A Large-scale Graph Embedding System. Retrieved from https:\/\/arxiv:cs.LG\/1903.12287.  Adam Lerer Ledell Wu Jiajun Shen Timothee Lacroix Luca Wehrstedt Abhijit Bose and Alex Peysakhovich. 2019. PyTorch-BigGraph: A Large-scale Graph Embedding System. Retrieved from https:\/\/arxiv:cs.LG\/1903.12287."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1002\/meet.14504901134"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1458527.1458536"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Stanislav Malyshev Markus Kr\u00f6tzsch Larry Gonz\u00e1lez Julius Gonsior and Adrian Bielefeldt. 2018. Getting the most out of Wikidata: Semantic technology usage in Wikipedia's knowledge graph. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11137 LNCS. 376\u2013394.  Stanislav Malyshev Markus Kr\u00f6tzsch Larry Gonz\u00e1lez Julius Gonsior and Adrian Bielefeldt. 2018. Getting the most out of Wikidata: Semantic technology usage in Wikipedia's knowledge graph. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11137 LNCS. 376\u2013394.","DOI":"10.1007\/978-3-030-00668-6_23"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.6017\/ital.v36i1.9598"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2595188.2595212"},{"key":"e_1_2_1_39_1","unstructured":"Shuyo Nakatani. 2010. Language Detection Library for Java. Retrieved from https:\/\/github.com\/shuyo\/language-detection.  Shuyo Nakatani. 2010. Language Detection Library for Java. Retrieved from https:\/\/github.com\/shuyo\/language-detection."},{"key":"e_1_2_1_40_1","volume-title":"Jung","author":"Nguyen Luong Vuong","year":"2020","unstructured":"Luong Vuong Nguyen and Jason J . Jung . 2020 . Crowdsourcing Platform for Collecting Cognitive Feedbacks from Users : A Case Study on Movie Recommender System. Springer International Publishing , Cham, 139\u2013150. https:\/\/doi.org\/10.1007\/978-3-030-43412-0_9 10.1007\/978-3-030-43412-0_9 Luong Vuong Nguyen and Jason J. Jung. 2020. Crowdsourcing Platform for Collecting Cognitive Feedbacks from Users: A Case Study on Movie Recommender System. Springer International Publishing, Cham, 139\u2013150. https:\/\/doi.org\/10.1007\/978-3-030-43412-0_9"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743384.1743478"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2874809"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1806781116"},{"key":"#cr-split#-e_1_2_1_44_1.1","doi-asserted-by":"crossref","unstructured":"Alessandro Piscopo Lucie-Aim\u00e9e Kaffee Chris Phethean and Elena Simperl. 2017. Provenance information in a collaborative knowledge graph: An evaluation of Wikidata external references. In Proceedings of the International Semantic Web Conference Claudia D'Amato Miriam Fernandez Valentina Tamma Freddy Lecue Philippe Cudr\u00e9-Mauroux Juan Sequeda Christoph Lange and Jeff Heflin (Eds.). Lecture Notes in Computer Science Vol. 10587. Springer International Publishing Cham 542-558. https:\/\/doi.org\/10.1007\/978-3-319-68288-4_32 10.1007\/978-3-319-68288-4_32","DOI":"10.1007\/978-3-319-68288-4_32"},{"key":"#cr-split#-e_1_2_1_44_1.2","doi-asserted-by":"crossref","unstructured":"Alessandro Piscopo Lucie-Aim\u00e9e Kaffee Chris Phethean and Elena Simperl. 2017. Provenance information in a collaborative knowledge graph: An evaluation of Wikidata external references. In Proceedings of the International Semantic Web Conference Claudia D'Amato Miriam Fernandez Valentina Tamma Freddy Lecue Philippe Cudr\u00e9-Mauroux Juan Sequeda Christoph Lange and Jeff Heflin (Eds.). Lecture Notes in Computer Science Vol. 10587. Springer International Publishing Cham 542-558. https:\/\/doi.org\/10.1007\/978-3-319-68288-4_32","DOI":"10.1007\/978-3-319-68288-4_32"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2017.527"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306446.3340822"},{"key":"e_1_2_1_47_1","volume-title":"Joensuu University Learning and Instruction Symposium","author":"Randolph Justus","year":"2010","unstructured":"Justus Randolph . 2010 . Free-Marginal Multirater Kappa (multirater kfree): An Alternative to Fleiss Fixed-Marginal Multirater Kappa . Joensuu University Learning and Instruction Symposium , Oct 14-15, 2005, Joensuu, Finland. Justus Randolph. 2010. Free-Marginal Multirater Kappa (multirater kfree): An Alternative to Fleiss Fixed-Marginal Multirater Kappa. Joensuu University Learning and Instruction Symposium, Oct 14-15, 2005, Joensuu, Finland."},{"key":"e_1_2_1_48_1","unstructured":"Tom Simonite. 2019. Inside the Alexa-Friendly World of Wikidata. Retrieved from https:\/\/www.wired.com\/story\/inside-the-alexa-friendly-world-of-wikidata\/.  Tom Simonite. 2019. Inside the Alexa-Friendly World of Wikidata. Retrieved from https:\/\/www.wired.com\/story\/inside-the-alexa-friendly-world-of-wikidata\/."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2912845.2912857"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1074"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the ACM International Conference on Digital Preservation. ACM","author":"Thornton Katherine","year":"2017","unstructured":"Katherine Thornton , Euan Cochrane , Thomas Ledoux , Bertrand Caron , and Carl Wilson . 2017 . Modeling the domain of digital preservation in Wikidata . In Proceedings of the ACM International Conference on Digital Preservation. ACM , Kyoto, Japan, 10. Katherine Thornton, Euan Cochrane, Thomas Ledoux, Bertrand Caron, and Carl Wilson. 2017. Modeling the domain of digital preservation in Wikidata. In Proceedings of the ACM International Conference on Digital Preservation. ACM, Kyoto, Japan, 10."},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the 7th International Conference on Web Information Systems and Technologies (WEBIST'11)","author":"Tzekou Paraskevi","unstructured":"Paraskevi Tzekou ., Sofia Stamou ., Nikos Kirtsis ., and Nikos Zotos .2011. Quality assessment of Wikipedia external links . In Proceedings of the 7th International Conference on Web Information Systems and Technologies (WEBIST'11) . INSTICC, SciTePress, Noordwijkerhout, Netherlands, 248\u2013254. https:\/\/doi.org\/10.5220\/0003299502480254 10.5220\/0003299502480254 Paraskevi Tzekou., Sofia Stamou., Nikos Kirtsis., and Nikos Zotos.2011. Quality assessment of Wikipedia external links. In Proceedings of the 7th International Conference on Web Information Systems and Technologies (WEBIST'11). INSTICC, SciTePress, Noordwijkerhout, Netherlands, 248\u2013254. https:\/\/doi.org\/10.5220\/0003299502480254"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2013.119"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187980.2188242"},{"key":"e_1_2_1_55_1","unstructured":"Wikidata. 2020. Help:Sources\u2014Wikidata. Retrieved from https:\/\/www.wikidata.org\/wiki\/Help:Sources.  Wikidata. 2020. Help:Sources\u2014Wikidata. Retrieved from https:\/\/www.wikidata.org\/wiki\/Help:Sources."},{"key":"e_1_2_1_56_1","unstructured":"Wikidata. 2020. Statistics\u2014Wikidata. Retrieved from https:\/\/www.wikidata.org\/wiki\/Special:Statistics.  Wikidata. 2020. Statistics\u2014Wikidata. Retrieved from https:\/\/www.wikidata.org\/wiki\/Special:Statistics."},{"key":"e_1_2_1_57_1","unstructured":"Wikidata. 2020. Wikidata:Licensing\u2014Wikidata. Retrieved from https:\/\/www.wikidata.org\/wiki\/Wikidata:Licensing.  Wikidata. 2020. Wikidata:Licensing\u2014Wikidata. Retrieved from https:\/\/www.wikidata.org\/wiki\/Wikidata:Licensing."},{"key":"e_1_2_1_58_1","unstructured":"Wikidata. 2020. Wikidata:List of policies and guidelines\u2014Wikidata. Retrieved from https:\/\/www.wikidata.org\/wiki\/Wikidata:List_of_policies_and_guidelines.  Wikidata. 2020. Wikidata:List of policies and guidelines\u2014Wikidata. Retrieved from https:\/\/www.wikidata.org\/wiki\/Wikidata:List_of_policies_and_guidelines."},{"key":"e_1_2_1_59_1","unstructured":"Wikidata. 2020. Wikidata:Verifiability\u2014Wikidata. Retrieved from https:\/\/www.wikidata.org\/wiki\/Wikidata:Verifiability.  Wikidata. 2020. Wikidata:Verifiability\u2014Wikidata. Retrieved from https:\/\/www.wikidata.org\/wiki\/Wikidata:Verifiability."},{"key":"e_1_2_1_60_1","unstructured":"Wikipedia. 2020. Wikipedia:Edit warring\u2014Wikipedia. Retrieved from https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Edit_warring.  Wikipedia. 2020. Wikipedia:Edit warring\u2014Wikipedia. Retrieved from https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Edit_warring."},{"key":"e_1_2_1_61_1","unstructured":"Wikipedia. 2020. Wikipedia:Verifiability\u2014Wikipedia. Retrieved from https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Verifiability.  Wikipedia. 2020. Wikipedia:Verifiability\u2014Wikipedia. Retrieved from https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Verifiability."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/1641309.1641333"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-007-1951-1"},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of the IEEE Conference on Computer Communications (INFOCOM'15)","author":"Xu Aifang","unstructured":"Aifang Xu , X. Feng , and Y. Tian . 2015. Revealing, characterizing, and detecting crowdsourcing spammers: A case study in community Q&A . In Proceedings of the IEEE Conference on Computer Communications (INFOCOM'15) . 2533\u20132541. Aifang Xu, X. Feng, and Y. Tian. 2015. Revealing, characterizing, and detecting crowdsourcing spammers: A case study in community Q&A. In Proceedings of the IEEE Conference on Computer Communications (INFOCOM'15). 2533\u20132541."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.3233\/SW-150175"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1501434.1501445"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3484828","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3484828","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:15Z","timestamp":1750191435000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3484828"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,15]]},"references-count":67,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,12,31]]}},"alternative-id":["10.1145\/3484828"],"URL":"https:\/\/doi.org\/10.1145\/3484828","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"value":"1936-1955","type":"print"},{"value":"1936-1963","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,15]]},"assertion":[{"value":"2021-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}