{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T21:42:26Z","timestamp":1780609346877,"version":"3.54.1"},"reference-count":100,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,6,9]],"date-time":"2022-06-09T00:00:00Z","timestamp":1654732800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2022,9,30]]},"abstract":"<jats:p>Online learning systems should support students preparedness for professional practice by equipping them with the necessary skills while keeping them engaged and active. In that regard, the development of online learning systems that support students\u2019 development and engagement with programming is a challenging process. Early career computer science professionals are required not only to understand and master numerous programming concepts but also to efficiently learn how to apply them in different contexts. A prerequisite for an effective and engaging learning process is the existence of adaptive and flexible learning environments that are beneficial for both students and teachers. Students can benefit from personalized content adapted to their individual goals, knowledge, and needs; while teachers can be relieved from the pressure to uniformly and promptly evaluate hundreds of student assignments. This study proposes and puts into practice a method for evaluating learning content difficulty and students\u2019 knowledge proficiency utilizing a modified Elo-rating method. The proposed method effectively pairs learning content difficulty with students\u2019 proficiency, and creates personalized recommendations based on the generated ratings. The method was implemented in a programming tutoring system and tested with interactive learning content for object oriented-programming. By collecting quantitative and qualitative data from students who used the system for one semester, the findings reveal that the proposed method can generate recommendations that are relevant to students and has the potential to assist teachers in grading students by providing a more holistic understanding of their progress over time.<\/jats:p>","DOI":"10.1145\/3511886","type":"journal-article","created":{"date-parts":[[2022,2,24]],"date-time":"2022-02-24T17:04:53Z","timestamp":1645722293000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Adaptive Assessment and Content Recommendation in Online Programming Courses: On the Use of Elo-rating"],"prefix":"10.1145","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6490-4311","authenticated-orcid":false,"given":"Boban","family":"Vesin","sequence":"first","affiliation":[{"name":"University of South-Eastern Norway and Norwegian University of Science and Technology, Trondheim, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katerina","family":"Mangaroska","sequence":"additional","affiliation":[{"name":"University of South-Eastern Norway and Norwegian University of Science and Technology, Trondheim, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kamil","family":"Akhuseyinoglu","sequence":"additional","affiliation":[{"name":"University of Pittsburgh, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michail","family":"Giannakos","sequence":"additional","affiliation":[{"name":"Norwegian University of Science and Technology, Trondheim, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,6,9]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3243137"},{"issue":"1","key":"e_1_3_2_3_2","first-page":"29","article-title":"On the use of elo rating for adaptive assessment","volume":"58","author":"Antal Margit","year":"2013","unstructured":"Margit Antal. 2013. On the use of elo rating for adaptive assessment. Stud. Univ. Babes-Bolyai Inf. 58, 1 (2013), 29\u201341.","journal-title":"Stud. Univ. Babes-Bolyai Inf."},{"issue":"4","key":"e_1_3_2_4_2","first-page":"59","article-title":"The new challenges for e-learning: The educational semantic web","volume":"7","author":"Aroyo Lora","year":"2004","unstructured":"Lora Aroyo and Darina Dicheva. 2004. The new challenges for e-learning: The educational semantic web. J. Educ. Technol. Soc. 7, 4 (2004), 59\u201369.","journal-title":"J. Educ. Technol. Soc."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.17083\/ijsg.v2i1.38"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/961290.961519"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2017.2682084"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13369-016-2292-2"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734348"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_3_2_11_2","article-title":"Dynamic parameter estimation in student monitoring systems","author":"Brinkhuis Matthieu J. S.","year":"2009","unstructured":"Matthieu J. S. Brinkhuis and G. Maris. 2009. Dynamic parameter estimation in student monitoring systems. Measurement and Research Department Reports (Rep. No. 2009-1). Cito, Arnhem.","journal-title":"Measurement and Research Department Reports (Rep. No. 2009-1). Cito, Arnhem"},{"key":"e_1_3_2_12_2","first-page":"132","article-title":"Applications of learning analytics in high schools: A systematic literature review","author":"Bruno Erveson","year":"2021","unstructured":"Erveson Bruno, Bruno Alexandre, Rafael Ferreira Mello, Taciana Pontual Falc\u00e3o, Boban Vesin, and Dragan Ga\u0161evi\u0107. 2021. Applications of learning analytics in high schools: A systematic literature review. Front. Artif. Intell. 4 (2021), 132.","journal-title":"Front. Artif. Intell."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2713609.2713611"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TETC.2015.2501243"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.5555\/1239784.1239789"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2729.2010.00363.x"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11280-012-0187-z"},{"key":"e_1_3_2_18_2","article-title":"Towards blended learning of computer programming supported by an automated system","volume":"9","author":"Choy M.","year":"2007","unstructured":"M. Choy, S. Lam, C. K. Poon, F. L. Wang, Y. T. Yu, and L. Yuen. 2007. Towards blended learning of computer programming supported by an automated system. Blend. Learn. 9 (2007).","journal-title":"Blend. Learn."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2015.10.016"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEET.2019.00021"},{"key":"e_1_3_2_21_2","article-title":"Automated assessment of complex programming tasks using SIETTE","author":"Conejo Ricardo","year":"2018","unstructured":"Ricardo Conejo, Beatriz Barros, and Manuel F. Bertoa. 2018. Automated assessment of complex programming tasks using SIETTE. IEEE Trans. Learn. Technol. (2018).","journal-title":"IEEE Trans. Learn. Technol."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF01099821"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2005.11.018"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-017-9088-8_15"},{"key":"e_1_3_2_25_2","volume-title":"Combining Elo Rating and Collaborative Filtering to Improve Learner Ability Estimation in an E-learning Context","author":"Dahl Ole Halvor","year":"2018","unstructured":"Ole Halvor Dahl and Olav Fykse. 2018. Combining Elo Rating and Collaborative Filtering to Improve Learner Ability Estimation in an E-learning Context. Master\u2019s thesis. NTNU."},{"key":"e_1_3_2_26_2","volume-title":"The Theory and Practice of Item Response Theory","author":"Ayala Rafael Jaime De","year":"2013","unstructured":"Rafael Jaime De Ayala. 2013. The Theory and Practice of Item Response Theory. Guilford."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/s41237-018-0070-z"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOMW.2005.60"},{"key":"e_1_3_2_29_2","first-page":"1","article-title":"The future of assessment in technology rich environments: Psychometric considerations","author":"DiCerbo K.","year":"2017","unstructured":"K. DiCerbo, V. J. Shute, and Yoon Jeon Kim. 2017. The future of assessment in technology rich environments: Psychometric considerations. Learn. Des. Technol.: Int. Compend. Theory Res. Pract. Policy (2017), 1\u201321.","journal-title":"Learn. Des. Technol.: Int. Compend. Theory Res. Pract. Policy"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.2307\/1129842"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1504\/IJLT.2008.019376"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1111\/exsy.12061"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/1384271.1384371"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3330430.3333641"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287487"},{"key":"e_1_3_2_36_2","volume-title":"The Rating of Chessplayers, Past and Present","author":"Elo Arpad E.","year":"1978","unstructured":"Arpad E. Elo. 1978. The Rating of Chessplayers, Past and Present. Arco Pub."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEET.2019.00026"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538896"},{"key":"e_1_3_2_39_2","first-page":"3","article-title":"Using item response theory to rate (not only) programmers","volume":"3","author":"Fori\u0161ek Michal","year":"2009","unstructured":"Michal Fori\u0161ek. 2009. Using item response theory to rate (not only) programmers. Olymp. Inf. 3 (2009), 3\u201316.","journal-title":"Olymp. Inf."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.iheduc.2015.10.002"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.3390\/su11205568"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.5555\/1577069.1755883"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/963770.963772"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/1163405.1163410"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2015.10.013"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3279720.3279726"},{"key":"e_1_3_2_47_2","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/978-3-319-24258-3_12","volume-title":"Design for Teaching and Learning in a Networked World","author":"Hosseini Roya","year":"2015","unstructured":"Roya Hosseini, I.-Han Hsiao, Julio Guerra, and Peter Brusilovsky. 2015. What should i do next? Adaptive sequencing in the context of open social student modeling. In Design for Teaching and Learning in a Networked World. Springer, 155\u2013168."},{"key":"e_1_3_2_48_2","first-page":"1","article-title":"Paired t test","author":"Hsu Henry","year":"2007","unstructured":"Henry Hsu and Peter A. Lachenbruch. 2007. Paired t test. Wiley Encycl. Clin. Trials (2007), 1\u20133.","journal-title":"Wiley Encycl. Clin. Trials"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3105759"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1080\/10494820.2019.1610458"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02298109"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3231711"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2011.02.003"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3330430.3333620"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2010.07.019"},{"issue":"2","key":"e_1_3_2_56_2","first-page":"67","article-title":"Estimating student ability and problem difficulty using item response theory (IRT) and trueskill","volume":"47","author":"Lee Youngjin","year":"2019","unstructured":"Youngjin Lee. 2019. Estimating student ability and problem difficulty using item response theory (IRT) and trueskill. Inf. Discov. Deliv. 47, 2 (2019), 67\u201375.","journal-title":"Inf. Discov. Deliv."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-Companion.2019.00108"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEET.2019.00022"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2015.03.008"},{"issue":"3","key":"e_1_3_2_60_2","article-title":"Doing a thematic analysis: A practical, step-by-step guide for learning and teaching scholars.","volume":"9","author":"Maguire Moira","year":"2017","unstructured":"Moira Maguire and Brid Delahunt. 2017. Doing a thematic analysis: A practical, step-by-step guide for learning and teaching scholars. All Ireland J. High. Educ. 9, 3 (2017).","journal-title":"All Ireland J. High. Educ."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2018.1435113"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1111\/jcal.12542"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3303772.3303825"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2019.00116"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2021.3072159"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-85820-3_12"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/2747008"},{"key":"e_1_3_2_68_2","article-title":"Adaptive model for computer-assisted assessment in programming skills","author":"Molins-Ruano Pablo","year":"2014","unstructured":"Pablo Molins-Ruano, Carlos Gonz\u00e1lez-Sacrist\u00e1n, F. D\u00edez, P. Rodriguez, and G. M. Sacha. 2014. Adaptive model for computer-assisted assessment in programming skills. arXiv:1403.1465. Retrieved from https:\/\/arxiv.org\/abs\/1403.1465.","journal-title":"arXiv:1403.1465"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66610-5_12"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/2659532.2659628"},{"key":"e_1_3_2_71_2","first-page":"64","article-title":"Enhanced collaborative e-learning for programming using open learner model","author":"Othman Mahfudzah","year":"2016","unstructured":"Mahfudzah Othman, Siti Hana Quzaima Alias, and Nur Fajrina Mohd Rashidi. 2016. Enhanced collaborative e-learning for programming using open learner model. Comput. Res. Innov. 1 (November 2016), 64.","journal-title":"Comput. Res. Innov."},{"key":"e_1_3_2_72_2","unstructured":"Steven Oxman and William Wong. 2014. White paper: Adaptive learning systems. Integr. Educ. Sol. (2014) 6\u20137."},{"key":"e_1_3_2_73_2","volume-title":"Proceedings of the Annual Conference on Educational Data Mining (EDM\u201920)","author":"Pankiewicz Maciej","year":"2020","unstructured":"Maciej Pankiewicz. 2020. Measuring task difficulty for online learning environments where multiple attempts are allowed-the Elo rating algorithm approach. In Proceedings of the Annual Conference on Educational Data Mining (EDM\u201920). 648\u2013652."},{"key":"e_1_3_2_74_2","unstructured":"Philip Pavlik Jr Hao Cen and Kenneth Koedinger. 2009. Performance factors analysis \u2014 A new alternative to knowledge tracing. In Proceedings of the International Conference on Artificial Intelligence in Education ."},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72079-9_10"},{"key":"e_1_3_2_76_2","volume-title":"Proceedings of the Annual Conference on Educational Data Mining (EDM\u201914)","author":"Pel\u00e1nek Radek","year":"2014","unstructured":"Radek Pel\u00e1nek. 2014. Application of time decay functions and the elo system in student modeling. In Proceedings of the Annual Conference on Educational Data Mining (EDM\u201914). Citeseer."},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2016.03.017"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-016-9185-7"},{"key":"e_1_3_2_79_2","unstructured":"Andrew Petersen. 2018. Programming Course Resource System (PCRS). Retrieved from https:\/\/mcs.utm.utoronto.ca\/pcrs\/pcrs\/."},{"key":"e_1_3_2_80_2","first-page":"1","volume-title":"Proceedings of the New Security Paradigms Workshop","author":"Pieters Wolter","year":"2012","unstructured":"Wolter Pieters, Sanne H. G. van der Ven, and Christian W. Probst. 2012. A move in the security measurement stalemate: Elo-style ratings to quantify vulnerability. In Proceedings of the New Security Paradigms Workshop. ACM, 1\u201314."},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-011-9115-7"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3051457.3053993"},{"key":"e_1_3_2_83_2","first-page":"133","volume-title":"ACM Sigcse Bulletin","author":"Saikkonen Riku","year":"2001","unstructured":"Riku Saikkonen, Lauri Malmi, and Ari Korhonen. 2001. Fully automatic assessment of programming exercises. In ACM Sigcse Bulletin, Vol. 33. ACM, 133\u2013136."},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2019.07.002"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/3300115.3309506"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2018.8506510"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-017-0539-8"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/3293881.3295779"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1109\/TALE.2015.7386010"},{"issue":"1","key":"e_1_3_2_90_2","first-page":"105","article-title":"Smart recommendation for an evolving e-learning system: Architecture and experiment","volume":"4","author":"Tang Tiffany Ya","year":"2005","unstructured":"Tiffany Ya Tang and Gordon McCalla. 2005. Smart recommendation for an evolving e-learning system: Architecture and experiment. Int. J. Elearn. 4, 1 (2005), 105.","journal-title":"Int. J. Elearn."},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02295293"},{"key":"e_1_3_2_92_2","doi-asserted-by":"publisher","DOI":"10.5555\/1435351.1435353"},{"key":"e_1_3_2_93_2","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2012.6462377"},{"key":"e_1_3_2_94_2","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2012.11"},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40561-018-0071-0"},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2013.12.002"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2011.11.020"},{"key":"e_1_3_2_98_2","volume-title":"Proceedings of the Annual Conference on Educational Data Mining","author":"Wauters Kelly","year":"2010","unstructured":"Kelly Wauters, Piet Desmet, and Wim Van Noortgate. 2010. Monitoring learners\u2019 proficiency: Weight adaptation in the elo rating system. In Proceedings of the Annual Conference on Educational Data Mining."},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.1109\/TFUZZ.2015.2426201"},{"key":"e_1_3_2_100_2","doi-asserted-by":"publisher","DOI":"10.1145\/2507157.2507230"},{"key":"e_1_3_2_101_2","doi-asserted-by":"publisher","DOI":"10.1145\/2445196.2445369"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511886","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3511886","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:50Z","timestamp":1750182530000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511886"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,9]]},"references-count":100,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9,30]]}},"alternative-id":["10.1145\/3511886"],"URL":"https:\/\/doi.org\/10.1145\/3511886","relation":{},"ISSN":["1946-6226","1946-6226"],"issn-type":[{"value":"1946-6226","type":"print"},{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,9]]},"assertion":[{"value":"2020-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-06-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}