{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T05:02:24Z","timestamp":1750309344771,"version":"3.41.0"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T00:00:00Z","timestamp":1727654400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2024,9,30]]},"abstract":"<jats:p>Data quality is crucial in modern software systems, like data-driven decision support systems. However, data quality is affected by data anomalies, which represent instances that deviate from most of the data. These anomalies affect the reliability and trustworthiness of software systems, and may propagate and cause more issues. Although many anomaly detection approaches have been proposed, they mainly focus on numerical data. Moreover, the few approaches targeting anomaly detection for categorical data do not yield consistent results across datasets.<\/jats:p>\n          <jats:p>In this article, we propose a novel anomaly detection approach for categorical data named LAFF-AD (LAFF-based Anomaly Detection), which takes advantage of the learning ability of a state-of-the-art form filling tool (LAFF) to perform value inference on suspicious data. LAFF-AD runs a variant of LAFF that predicts the possible values of a suspicious categorical field in the suspicious instance. LAFF-AD then compares the output of LAFF to the recorded values in the suspicious instance, and uses a heuristic-based strategy to detect categorical data anomalies.<\/jats:p>\n          <jats:p>We evaluated LAFF-AD by assessing its effectiveness and efficiency on six datasets. Our experimental results show that LAFF-AD can accurately determine a high range of data anomalies, with recall values between 0.6 and 1 and a precision value of at least 0.808. Furthermore, LAFF-AD is efficient, taking at most 7000s and 735ms to perform training and prediction, respectively.<\/jats:p>","DOI":"10.1145\/3696110","type":"journal-article","created":{"date-parts":[[2024,9,16]],"date-time":"2024-09-16T11:15:52Z","timestamp":1726485352000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Automated anomaly detection for categorical data by repurposing a form filling recommender system"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0521-2905","authenticated-orcid":false,"given":"Hichem","family":"Belgacem","sequence":"first","affiliation":[{"name":"Luxembourg Institute of Science and Technology, Esch-sur-Alzette, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5068-1938","authenticated-orcid":false,"given":"Xiaochen","family":"Li","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4854-685X","authenticated-orcid":false,"given":"Domenico","family":"Bianculli","sequence":"additional","affiliation":[{"name":"University of Luxembourg, Esch-sur-Alzette, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1393-1010","authenticated-orcid":false,"given":"Lionel","family":"Briand","sequence":"additional","affiliation":[{"name":"Lero SFI Centre for Software Research and University of Limerick, Limerick, Ireland and University of Ottawa, Ottawa, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,10,4]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47578-3_1"},{"key":"e_1_3_3_3_2","doi-asserted-by":"crossref","DOI":"10.1007\/s10489-022-03271-3","article-title":"A density estimation approach for detecting and explaining exceptional values in categorical data","author":"Angiulli Fabrizio","year":"2022","unstructured":"Fabrizio Angiulli, Fabio Fassetti, Luigi Palopoli, and Cristina Serrao. 2022. A density estimation approach for detecting and explaining exceptional values in categorical data. Applied Intelligence 52, 15 (2022), 17534\u201317556.","journal-title":"Applied Intelligence"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","unstructured":"Oluseun Omotola Aremu David Hyland-Wood and Peter Ross McAree. 2020. A machine learning approach to circumventing the curse of dimensionality in discontinuous time series machine data. Reliability Engineering & System Safety 195 (2020) 106706. DOI:10.1016\/j.ress.2019.106706","DOI":"10.1016\/j.ress.2019.106706"},{"key":"e_1_3_3_5_2","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/978-3-642-45135-5_10","volume-title":"Proceedings of the Recommendation Systems in Software Engineering","author":"Avazpour Iman","year":"2014","unstructured":"Iman Avazpour, Teerat Pitakrat, Lars Grunske, and John Grundy. 2014. Dimensions and metrics for evaluating recommendation systems. In Proceedings of the Recommendation Systems in Software Engineering. Springer, Berlin, Germany, 245\u2013273."},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkr1163"},{"key":"e_1_3_3_7_2","first-page":"29","volume-title":"Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Bay Stephen D.","year":"2003","unstructured":"Stephen D. Bay and Mark Schwabacher. 2003. Mining distance-based outliers in near linear time with randomization and a simple pruning rule. In Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Association for Computing Machinery, New York, NY, USA, 29\u201338."},{"issue":"2","key":"e_1_3_3_8_2","first-page":"47:1\u201347:40","article-title":"A machine learning approach for automated filling of categorical fields in data entry forms","volume":"32","author":"Belgacem Hichem","year":"2023","unstructured":"Hichem Belgacem, Xiaochen Li, Domenico Bianculli, and Lionel Briand. 2023. A machine learning approach for automated filling of categorical fields in data entry forms. ACM Transactions on Software Engineering and Methodology 32, 2(2023), 47:1\u201347:40.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"issue":"3","key":"e_1_3_3_9_2","first-page":"77:1\u201377:32","article-title":"Learning-based relaxation of completeness requirements for data entry forms","volume":"33","author":"Belgacem Hichem","year":"2024","unstructured":"Hichem Belgacem, Xiaochen Li, Domenico Bianculli, and Lionel Briand. 2024. Learning-based relaxation of completeness requirements for data entry forms. ACM Transactions on Software Engineering and Methodology 33, 3 (2024), 77:1\u201377:32.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(96)00142-2"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335388"},{"key":"e_1_3_3_12_2","first-page":"1","volume-title":"Proceedings of the NIPS Workshop on Statistical methods for Computational Experiments in Visual Processing and Computer Vision","author":"Caputo Barbara","year":"2002","unstructured":"Barbara Caputo, K. Sim, Fredrik Furesjo, and Alex Smola. 2002. Appearance-based object recognition using SVMs: Which kernel should I use?. In Proceedings of the NIPS Workshop on Statistical methods for Computational Experiments in Visual Processing and Computer Vision. N\/A, N\/A, 1 pages."},{"issue":"5","key":"e_1_3_3_13_2","doi-asserted-by":"crossref","first-page":"e27172","DOI":"10.2196\/27172","article-title":"Anomaly detection algorithm for real-world data and evidence in clinical research: Implementation, evaluation, and validation study","volume":"9","year":"2021","unstructured":"Vendula Churov\u00e1, Roman Vy\u0161ovsk\u00fd Kate\u0159ina Mar\u0161\u00e1lov\u00e1, David Kudl\u00e1\u010dek, and Daniel Schwarz. 2021. Anomaly detection algorithm for real-world data and evidence in clinical research: Implementation, evaluation, and validation study. JMIR Medical Informatics 9, 5 (2021), e27172.","journal-title":"JMIR Medical Informatics"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/1281192.1281219"},{"issue":"1","key":"e_1_3_3_15_2","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1111\/j.2517-6161.1979.tb01057.x","article-title":"The use of chi-squared statistics for categorical data problems","volume":"41","author":"Fienberg Stephen E.","year":"1979","unstructured":"Stephen E. Fienberg. 1979. The use of chi-squared statistics for categorical data problems. Journal of the Royal Statistical Society: Series B (Methodological) 41, 1 (1979), 54\u201364.","journal-title":"Journal of the Royal Statistical Society: Series B (Methodological)"},{"key":"e_1_3_3_16_2","unstructured":"Jim Gee and Mark Button. 2019. The Financial Cost of Fraud 2019: The latest data from around the world. Crowe UK United Kingdom. https:\/\/researchportal.port.ac.uk\/en\/publications\/the-financial-cost-of-fraud-2019-thelatest-data-from-around-the-"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-015-3994-4"},{"key":"e_1_3_3_19_2","first-page":"400","volume-title":"Proceedings of the International Conference on Intelligent Computing","author":"He Zengyou","year":"2005","unstructured":"Zengyou He, Shengchun Deng, and Xiaofei Xu. 2005. An optimization model for outlier detection in categorical data. In Proceedings of the International Conference on Intelligent Computing. Springer, Springer, Berlin, 400\u2013409."},{"key":"e_1_3_3_20_2","first-page":"567","volume-title":"Advances in Knowledge Discovery and Data Mining: 10th Pacific-Asia Conference, PAKDD 2006, Singapore, April 9-12, 2006. Proceedings 10","author":"He Zengyou","year":"2006","unstructured":"Zengyou He, Shengchun Deng, Xiaofei Xu, and Joshua Zhexue Huang. 2006. A fast greedy algorithm for outlier mining. In Advances in Knowledge Discovery and Data Mining: 10th Pacific-Asia Conference, PAKDD 2006, Singapore, April 9-12, 2006. Proceedings 10. Springer, Springer, Berlin, 567\u2013576."},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1080\/15252019.2000.10722040"},{"key":"e_1_3_3_22_2","unstructured":"Zhe Hui Hoo Jane Candlish and Dawn Teare. 2017. What is an ROC curve? BMJ Publishing Group Ltd."},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2016.2526063"},{"issue":"18","key":"e_1_3_3_24_2","doi-asserted-by":"crossref","first-page":"10057","DOI":"10.3390\/su131810057","article-title":"An ensemble of prediction and learning mechanism for improving accuracy of anomaly detection in network intrusion environments","volume":"13","author":"Jamil Faisal","year":"2021","unstructured":"Faisal Jamil and Dohyeun Kim. 2021. An ensemble of prediction and learning mechanism for improving accuracy of anomaly detection in network intrusion environments. Sustainability 13, 18 (2021), 10057.","journal-title":"Sustainability"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","unstructured":"C. Fraser. 2019. Association between two categorical variables: Contingency analysis with Chi square. In Business Statistics for Competitive Advantage with Excel 2019 and JMP. Springer Cham 341\u2013377. 10.1007\/978-3-030-20374-0_13","DOI":"10.1007\/978-3-030-20374-0_13"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","unstructured":"Jalayer Khalilzadeh and Asli D. A. Tasci. 2017. Large sample size significance level and the effect size: Solutions to perils of using big data for academic research. Tourism Management 62 (2017) 89\u201396. DOI:10.1016\/j.tourman.2017.03.026","DOI":"10.1016\/j.tourman.2017.03.026"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401946"},{"key":"e_1_3_3_28_2","first-page":"1","volume-title":"Proceedings of the 2019 Systems and Information Engineering Design Symposium","author":"Kromkowski Peter","year":"2019","unstructured":"Peter Kromkowski, Shaoran Li, Wenxi Zhao, Brendan Abraham, Austin Osborne, and Donald E. Brown. 2019. Evaluating statistical models for network traffic anomaly detection. In Proceedings of the 2019 Systems and Information Engineering Design Symposium. IEEE, IEEE, Charlottesville, VA, USA, 1\u20136."},{"issue":"11","key":"e_1_3_3_29_2","first-page":"4295","article-title":"Weighted outlier detection of high-dimensional categorical data using feature grouping","volume":"50","author":"Li Junli","year":"2018","unstructured":"Junli Li, Jifu Zhang, Ning Pang, and Xiao Qin. 2018. Weighted outlier detection of high-dimensional categorical data using feature grouping. IEEE Transactions on Systems, Man, and Cybernetics: Systems 50, 11 (2018), 4295\u20134308.","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics: Systems"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2133360.2133363"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","unstructured":"Marcos Mart\u00ednez-Romero Martin J. O\u2019Connor Attila L. Egyedi Debra Willrett Josef Hardi John Graybeal and Mark A. Musen. 2019. Using association rule mining and ontologies to generate metadata recommendations from multiple biomedical databases. Database 2019 (June 2019) baz059. DOI:10.1093\/database\/baz059","DOI":"10.1093\/database\/baz059"},{"key":"e_1_3_3_32_2","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/978-3-319-07221-0_3","volume-title":"Intelligent Tutoring Systems: 12th International Conference, ITS 2014, Honolulu, HI, USA, June 5-9, 2014. Proceedings 12","author":"Mills Caitlin","year":"2014","unstructured":"Caitlin Mills, Nigel Bosch, Art Graesser, and Sidney D\u2019Mello. 2014. To quit or not to quit: Predicting future behavioral disengagement from reading patterns. In Intelligent Tutoring Systems: 12th International Conference, ITS 2014, Honolulu, HI, USA, June 5-9, 2014. Proceedings 12. Springer, Springer, Cham, 19\u201328."},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771792"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","unstructured":"Kazuyo Narita and Hiroyuki Kitagawa. 2008. Detecting outliers in categorical record databases based on attribute associations. In Progress in WWW Research and Development 10th Asia-Pacific Web Conference APWeb 2008 Shenyang China April 26-28 2008. Proceedings (Lecture Notes in Computer Science) Springer 111\u2013123. DOI:10.1007\/978-3-540-78849-2_13","DOI":"10.1007\/978-3-540-78849-2_13"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","unstructured":"K. Noto C. Brodley and D. Slonim. 2012. FRaC: a feature-modeling approach for semi-supervised and unsupervised anomaly detection. Data Min Knowl Disc 25 (2012) 109\u2013133. 10.1007\/s10618-011-0234-x","DOI":"10.1007\/s10618-011-0234-x"},{"key":"e_1_3_3_36_2","unstructured":"Guansong Pang Longbing Cao and Ling Chen. 2016. Outlier detection in complex categorical data by modelling the feature value couplings. In (IJCAI\u201916) AAAI Press New York New York USA 1902\u20131908."},{"issue":"4","key":"e_1_3_3_37_2","first-page":"1","article-title":"Homophily outlier detection in non-IID categorical data","volume":"35","author":"Pang Guansong","year":"2021","unstructured":"Guansong Pang, Longbing Cao, and Ling Chen. 2021. Homophily outlier detection in non-IID categorical data. Data Mining and Knowledge Discovery 35, 4 (2021), 1\u201362.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.5228"},{"key":"e_1_3_3_39_2","unstructured":"Fabian Pedregosa Ga\u00ebl Varoquaux Alexandre Gramfort Vincent Michel Bertrand Thirion Olivier Grisel Mathieu Blondel Peter Prettenhofer Ron Weiss Vincent Dubourg Jake Vanderplas Alexandre Passos David Cournapeau Matthieu Brucher Matthieu Perrot and \u00c9douard Duchesnay. 2011. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 12 null (November 2011) 2825\u20132830."},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","unstructured":"Tahereh Pourhabibi Kok-Leong Ong Booi H. Kam and Yee Ling Boo. 2020. Fraud detection: A systematic literature review of graph-based anomaly detection approaches. Decision Support Systems 133 (2020) 113303. DOI:10.1016\/j.dss.2020.113303","DOI":"10.1016\/j.dss.2020.113303"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","unstructured":"Siyu Qian Esther Munyisia David Reid David Hailey Jade Pados and Ping Yu. 2020. Trend in data errors after the implementation of an electronic medical record system: A longitudinal study in an Australian regional Drug and Alcohol Service. International Journal of Medical Informatics 144 (2020) 104292. DOI:10.1016\/j.ijmedinf.2020.104292","DOI":"10.1016\/j.ijmedinf.2020.104292"},{"key":"e_1_3_3_42_2","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/978-3-030-05127-3_5","article-title":"Outlier detection in categorical data","author":"Suri NNR Ranga","year":"2019","unstructured":"NNR Ranga Suri, Narasimha Murty M, G. Athithan, NNR Ranga Suri, Narasimha Murty M, and G. Athithan. 2019. Outlier detection in categorical data. Outlier Detection: Techniques and Applications: A Data Mining Perspective N\/A, N\/A (2019), 69\u201393.","journal-title":"Outlier Detection: Techniques and Applications: A Data Mining Perspective"},{"key":"e_1_3_3_43_2","doi-asserted-by":"crossref","unstructured":"L. Rashidi S. Hashemi and A. Hamzeh. 2011. Anomaly detection in categorical datasets using bayesian networks. In Artificial Intelligence and Computational Intelligence: Third International Conference AICI 2011 Taiyuan China September 24-25 2011 Proceedings Part II 3. 610\u2013619.","DOI":"10.1007\/978-3-642-23887-1_78"},{"key":"e_1_3_3_44_2","volume-title":"Artificial Intelligence a Modern Approach","author":"Russell Stuart J.","year":"2010","unstructured":"Stuart J. Russell. 2010. Artificial Intelligence a Modern Approach. Pearson Education, Inc., N\/A."},{"key":"e_1_3_3_45_2","first-page":"281","volume-title":"Proceedings of the 14th International Symposium on Software Reliability Engineering.","author":"Saff David","year":"2003","unstructured":"David Saff and Michael D. Ernst. 2003. Reducing wasted development time via continuous testing. In Proceedings of the 14th International Symposium on Software Reliability Engineering. IEEE, IEEE, Denver, CO, USA, 281\u2013292."},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1207\/S15327590IJHC1602_03"},{"key":"e_1_3_3_47_2","first-page":"247","volume-title":"Proceedings of the 2012 12th International Conference on Hybrid Intelligent Systems","author":"Suri N. N. R. Ranga","year":"2012","unstructured":"N. N. R. Ranga Suri, M. Narasimha Murty, and Gopalasamy Athithan. 2012. An algorithm for mining outliers in categorical data through ranking. In Proceedings of the 2012 12th International Conference on Hybrid Intelligent Systems. IEEE, IEEE, Pune, India, 247\u2013252."},{"key":"e_1_3_3_48_2","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1007\/978-3-642-45062-4_23","volume-title":"Pattern Recognition and Machine Intelligence: 5th International Conference, PReMI 2013, Kolkata, India, December 10-14, 2013. Proceedings 5","author":"Suri N. N. R. Ranga","year":"2013","unstructured":"N. N. R. Ranga Suri, Musti Narasimha Murty, and Gopalasamy Athithan. 2013. A rough clustering algorithm for mining outliers in categorical data. In Pattern Recognition and Machine Intelligence: 5th International Conference, PReMI 2013, Kolkata, India, December 10-14, 2013. Proceedings 5. Springer, Springer, Berlin, 170\u2013175."},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3312739"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10515-022-00337-x"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271721"},{"key":"e_1_3_3_52_2","doi-asserted-by":"crossref","unstructured":"H. Xu Y. Wang Z. Wu and Y. Wang. 2019. Embedding-based complex feature value coupling learning for detecting outliers in Non-IID categorical data. Proceedings of the AAAI Conference on Artificial Intelligence 33 1 (2019) 5541\u20135548.","DOI":"10.1609\/aaai.v33i01.33015541"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","unstructured":"Li Yang and Abdallah Shami. 2020. On hyperparameter optimization of machine learning algorithms: Theory and practice. Neurocomputing 415 (2020) 295\u2013316. DOI:10.1016\/j.neucom.2020.07.061","DOI":"10.1016\/j.neucom.2020.07.061"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3696110","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3696110","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:05:32Z","timestamp":1750291532000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3696110"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,30]]},"references-count":52,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,9,30]]}},"alternative-id":["10.1145\/3696110"],"URL":"https:\/\/doi.org\/10.1145\/3696110","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"type":"print","value":"1936-1955"},{"type":"electronic","value":"1936-1963"}],"subject":[],"published":{"date-parts":[[2024,9,30]]},"assertion":[{"value":"2024-01-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-03","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}