{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T05:18:55Z","timestamp":1784179135966,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":57,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,17]]},"DOI":"10.1145\/3511808.3557286","type":"proceedings-article","created":{"date-parts":[[2022,10,16]],"date-time":"2022-10-16T01:29:57Z","timestamp":1665883797000},"page":"446-456","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Detecting Significant Differences Between Information Retrieval Systems via Generalized Linear Models"],"prefix":"10.1145","author":[{"given":"Guglielmo","family":"Faggioli","sequence":"first","affiliation":[{"name":"University of Padova, Padova, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicola","family":"Ferro","sequence":"additional","affiliation":[{"name":"University of Padova, Padova, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Norbert","family":"Fuhr","sequence":"additional","affiliation":[{"name":"University of Duisburg-Essen, Duisburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"TREC 2018 Common Core Track Overview. In The Twenty-Seventh Text REtrieval Conference Proceedings (TREC 2018)","author":"Allan J.","year":"2019","unstructured":"J. Allan , D. K. Harman , E. Kanoulas , and E. M. Voorhees . TREC 2018 Common Core Track Overview. In The Twenty-Seventh Text REtrieval Conference Proceedings (TREC 2018) , 2019 . J. Allan, D. K. Harman, E. Kanoulas, and E. M. Voorhees. TREC 2018 Common Core Track Overview. In The Twenty-Seventh Text REtrieval Conference Proceedings (TREC 2018), 2019."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767728"},{"key":"e_1_3_2_1_3_1","volume-title":"Blind Men and Elephants: Six Approaches to TREC Data. Information Retrieval Journal (IRJ), 1(1):7--34","author":"Banks D.","year":"1999","unstructured":"D. Banks , P. Over , and N.-F. Zhang . Blind Men and Elephants: Six Approaches to TREC Data. Information Retrieval Journal (IRJ), 1(1):7--34 , 1999 . D. Banks, P. Over, and N.-F. Zhang. Blind Men and Elephants: Six Approaches to TREC Data. Information Retrieval Journal (IRJ), 1(1):7--34, 1999."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2499178.2499184"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277805"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/2040317.2040333"},{"key":"e_1_3_2_1_7_1","volume-title":"Multiple Testing in Statistical Analysis of Systems-based Informa- tion Retrieval Experiments. ACM Transactions on Information Systems (TOIS), 30 :1--34","author":"Carterette B.","year":"2012","unstructured":"B. Carterette . Multiple Testing in Statistical Analysis of Systems-based Informa- tion Retrieval Experiments. ACM Transactions on Information Systems (TOIS), 30 :1--34 , 2012 . B. Carterette. Multiple Testing in Statistical Analysis of Systems-based Informa- tion Retrieval Experiments. ACM Transactions on Information Systems (TOIS), 30 :1--34, 2012."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2808194.2809469"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080738"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148262"},{"issue":"1","key":"e_1_3_2_1_11_1","first-page":"1","volume":"40","author":"Culpepper J. S.","year":"2021","unstructured":"J. S. Culpepper , G. Faggioli , N. Ferro , and O. Kurland . Topic difficulty: Collection and Query Formulation Effects. ACM Transactions on Information Systems (TOIS) , 40 ( 1 ): 1 -- 36 , 2021 . J. S. Culpepper, G. Faggioli, N. Ferro, and O. Kurland. Topic difficulty: Collection and Query Formulation Effects. ACM Transactions on Information Systems (TOIS), 40(1):1--36, 2021.","journal-title":"Topic difficulty: Collection and Query Formulation Effects. ACM Transactions on Information Systems (TOIS)"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-72240-1_3"},{"key":"e_1_3_2_1_13_1","first-page":"901","volume-title":"Proc. 40th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2017","author":"Ferro N.","year":"2017","unstructured":"N. Ferro and M. Sanderson . Sub-corpora Impact on System Effectiveness. In N. Kando, T. Sakai, H. Joho, H. Li, A. P. de Vries, and R. W. White, editors , Proc. 40th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2017 ), pages 901 -- 904 . ACM Press, New York, USA , 2017 . N. Ferro and M. Sanderson. Sub-corpora Impact on System Effectiveness. In N. Kando, T. Sakai, H. Joho, H. Li, A. P. de Vries, and R. W. White, editors, Proc. 40th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2017), pages 901--904. ACM Press, New York, USA, 2017."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3338062"},{"key":"e_1_3_2_1_15_1","first-page":"280","volume-title":"Proc. 15th ACM International Conference on Web Searching and Data Mining (WSDM 2022","author":"Ferro N.","year":"2022","unstructured":"N. Ferro and M. Sanderson . How do you Test a Test? A Multifaceted Examination of Significance Tests. In K. S. Candan, H. Liu, L. Akoglu, X. L. Dong, and J. Tang, editors , Proc. 15th ACM International Conference on Web Searching and Data Mining (WSDM 2022 ), pages 280 -- 288 . ACM Press, New York, USA , 2022 . N. Ferro and M. Sanderson. How do you Test a Test? A Multifaceted Examination of Significance Tests. In K. S. Candan, H. Liu, L. Akoglu, X. L. Dong, and J. Tang, editors, Proc. 15th ACM International Conference on Web Searching and Data Mining (WSDM 2022), pages 280--288. ACM Press, New York, USA, 2022."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911530"},{"key":"e_1_3_2_1_17_1","volume-title":"Toward an anatomy of IR system component performances. jasist, 69(2):187--200","author":"Ferro N.","year":"2018","unstructured":"N. Ferro and G. Silvello . Toward an anatomy of IR system component performances. jasist, 69(2):187--200 , 2018 . N. Ferro and G. Silvello. Toward an anatomy of IR system component performances. jasist, 69(2):187--200, 2018."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3310364"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3190580.3190586"},{"key":"e_1_3_2_1_20_1","volume-title":"theory and methods","author":"Hsu J.","year":"1996","unstructured":"J. Hsu . Multiple comparisons : theory and methods . CRC Press , 1996 . J. Hsu. Multiple comparisons: theory and methods. CRC Press, 1996."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/160688.160758"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7161(80)01009-7"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582418"},{"key":"e_1_3_2_1_24_1","first-page":"20","volume-title":"Informal Identification of Outliers in Medical Data. In Fifth International Workshop on Intelligent Data Analysis in Medicine and Pharmacology","volume":"1","author":"Laurikkala J.","year":"2000","unstructured":"J. Laurikkala , M. Juhola , E. Kentala , N. Lavrac , S Miksch , and B. Kavsek . Informal Identification of Outliers in Medical Data. In Fifth International Workshop on Intelligent Data Analysis in Medicine and Pharmacology , volume 1 , pages 20 -- 24 , 2000 . J. Laurikkala, M. Juhola, E. Kentala, N. Lavrac, S Miksch, and B. Kavsek. Informal Identification of Outliers in Medical Data. In Fifth International Workshop on Intelligent Data Analysis in Medicine and Pharmacology, volume 1, pages 20--24, 2000."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1201\/9781439891148"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-3242-6"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1416950.1416952"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2407085.2407092"},{"key":"e_1_3_2_1_29_1","volume-title":"Generalized Linear Models: with Applications in Engineering and the Sciences","author":"Myers R. H.","year":"2012","unstructured":"R. H. Myers , D. C. Montgomery , G. G. Vining , and T. J. Robinson . Generalized Linear Models: with Applications in Engineering and the Sciences , volume 791 . John Wiley & Sons , 2012 . R. H. Myers, D. C. Montgomery, G. G. Vining, and T. J. Robinson. Generalized Linear Models: with Applications in Engineering and the Sciences, volume 791. John Wiley & Sons, 2012."},{"key":"e_1_3_2_1_30_1","series-title":"Series A (General), 135(3):370--384","volume-title":"Generalized Linear Models. Journal of the Royal Statistical Society","author":"Nelder J. A.","year":"1972","unstructured":"J. A. Nelder and R. W. M. Wedderburn . Generalized Linear Models. Journal of the Royal Statistical Society . Series A (General), 135(3):370--384 , 1972 . ISSN 00359238. J. A. Nelder and R. W. M. Wedderburn. Generalized Linear Models. Journal of the Royal Statistical Society. Series A (General), 135(3):370--384, 1972. ISSN 00359238."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24203"},{"key":"e_1_3_2_1_32_1","first-page":"655","volume-title":"Proc. 36th ACM\/SIGAPP Symposium On Applied Computing (SAC 2021","author":"Parapar J.","year":"2021","unstructured":"J. Parapar , D. E Losada , and \u00c1. Barreiro. Testing the tests: simulation of rankings to compare statistical significance tests in information retrieval evaluation. In C.-H. Hung, J. Hong, A. Bechini, and E. Song, editors , Proc. 36th ACM\/SIGAPP Symposium On Applied Computing (SAC 2021 ), pages 655 -- 664 . ACM Press, New York, USA , 2021 . J. Parapar, D. E Losada, and \u00c1. Barreiro. Testing the tests: simulation of rankings to compare statistical significance tests in information retrieval evaluation. In C.-H. Hung, J. Hong, A. Bechini, and E. Song, editors, Proc. 36th ACM\/SIGAPP Symposium On Applied Computing (SAC 2021), pages 655--664. ACM Press, New York, USA, 2021."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1183614.1183630"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-28997-2_14"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348402"},{"key":"e_1_3_2_1_36_1","volume-title":"Introducing ANOVA and ANCOVA: a GLM approach","author":"Rutherford A.","year":"2001","unstructured":"A. Rutherford . Introducing ANOVA and ANCOVA: a GLM approach . Sage , 2001 . A. Rutherford. Introducing ANOVA and ANCOVA: a GLM approach. Sage, 2001."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148261"},{"key":"e_1_3_2_1_38_1","first-page":"5","volume-title":"Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '16","author":"Sakai T.","year":"2016","unstructured":"T. Sakai . Statistical Significance , Power, and Sample Sizes : A Systematic Review of SIGIR and TOIS, 2006--2015 . In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '16 , page 5 -- 14 , 2016 . T. Sakai. Statistical Significance, Power, and Sample Sizes: A Systematic Review of SIGIR and TOIS, 2006--2015. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '16, page 5--14, 2016."},{"key":"e_1_3_2_1_39_1","first-page":"95","volume-title":"Score Standardisation. In Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval, ICTIR '16","author":"Sakai T.","year":"2016","unstructured":"T. Sakai . A Simple and Effective Approach to Score Standardisation. In Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval, ICTIR '16 , page 95 -- 104 , 2016 . T. Sakai. A Simple and Effective Approach to Score Standardisation. In Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval, ICTIR '16, page 95--104, 2016."},{"key":"e_1_3_2_1_40_1","volume-title":"June","author":"Sakai T.","year":"2020","unstructured":"T. Sakai . On Fuhr's Guideline for IR Evaluation . SIGIR Forum , 54(1):p14 : 1--p14:8 , June 2020 . T. Sakai. On Fuhr's Guideline for IR Evaluation. SIGIR Forum, 54(1):p14:1--p14:8, June 2020."},{"key":"e_1_3_2_1_41_1","first-page":"162","volume-title":"Proc. 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2005","author":"Sanderson M.","year":"2005","unstructured":"M. Sanderson and J. Zobel . Information Retrieval System Evaluation: Effort, Sensitivity, and Reliability. In R. Baeza-Yates, N. Ziviani, G. Marchionini, A. Moffat, and J. Tait, editors , Proc. 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2005 ), pages 162 -- 169 . ACM Press, New York, USA , 2005 . M. Sanderson and J. Zobel. Information Retrieval System Evaluation: Effort, Sensitivity, and Reliability. In R. Baeza-Yates, N. Ziviani, G. Marchionini, A. Moffat, and J. Tait, editors, Proc. 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2005), pages 162--169. ACM Press, New York, USA, 2005."},{"key":"e_1_3_2_1_42_1","volume-title":"An Inquiry into Testing of Information Retrieval Systems Part II: Analysis of Results. Technical report","author":"Saracevic T.","year":"1968","unstructured":"T. Saracevic . Comparative Systems Laboratory Final Technical Report , An Inquiry into Testing of Information Retrieval Systems Part II: Analysis of Results. Technical report , Case Western Reserve University , USA , 1968 . T. Saracevic. Comparative Systems Laboratory Final Technical Report, An Inquiry into Testing of Information Retrieval Systems Part II: Analysis of Results. Technical report, Case Western Reserve University, USA, 1968."},{"key":"e_1_3_2_1_43_1","volume-title":"The Effects of Violations of Independence Assumptions in the One-Way ANOVA. The American Statistician, 41(2):123--129","author":"Scariano S. M.","year":"1987","unstructured":"S. M. Scariano and J. M. Davenport . The Effects of Violations of Independence Assumptions in the One-Way ANOVA. The American Statistician, 41(2):123--129 , 1987 . S. M. Scariano and J. M. Davenport. The Effects of Violations of Independence Assumptions in the One-Way ANOVA. The American Statistician, 41(2):123--129, 1987."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1321440.1321528"},{"key":"e_1_3_2_1_45_1","first-page":"385","volume-title":"Proceedings of The 3rd Text REtrieval Conference, TREC '94","author":"Tague-Sutcliffe J. M.","year":"1994","unstructured":"J. M. Tague-Sutcliffe and J. Blustein . A Statistical Analysis of the TREC-3 Data . In Proceedings of The 3rd Text REtrieval Conference, TREC '94 , pages 385 -- 398 , 1994 . J. M. Tague-Sutcliffe and J. Blustein. A Statistical Analysis of the TREC-3 Data. In Proceedings of The 3rd Text REtrieval Conference, TREC '94, pages 385--398, 1994."},{"key":"e_1_3_2_1_46_1","first-page":"99","volume-title":"Biometrics","author":"Tukey J. W.","year":"1949","unstructured":"J. W. Tukey . Comparing Individual Means in the Analysis of Variance . Biometrics , pages 99 -- 114 , 1949 . J. W. Tukey. Comparing Individual Means in the Analysis of Variance. Biometrics, pages 99--114, 1949."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210043"},{"key":"e_1_3_2_1_48_1","first-page":"925","volume-title":"Proc. SIGIR","author":"Urbano J.","year":"2013","unstructured":"J. Urbano , M. Marrero , and D. Mart\u00edn . A comparison of the optimality of statisti- cal significance tests for information retrieval evaluation . In Proc. SIGIR , page 925 -- 928 , 2013 . J. Urbano, M. Marrero, and D. Mart\u00edn. A comparison of the optimality of statisti- cal significance tests for information retrieval evaluation. In Proc. SIGIR, page 925--928, 2013."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331315"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331259"},{"key":"e_1_3_2_1_51_1","volume-title":"England","author":"van Rijsbergen C. J.","year":"1979","unstructured":"C. J. van Rijsbergen . Information Retrieval . Butterworths, London , England , 2 nd edition, 1979 . C. J. van Rijsbergen. Information Retrieval. Butterworths, London, England, 2nd edition, 1979.","edition":"2"},{"key":"e_1_3_2_1_52_1","volume-title":"Overview of the TREC 2004 Robust Retrieval Track. In Proceedings of The 13th Text REtrieval Conference, TREC '13","author":"Voorhees E. M.","year":"2004","unstructured":"E. M. Voorhees . Overview of the TREC 2004 Robust Retrieval Track. In Proceedings of The 13th Text REtrieval Conference, TREC '13 , 2004 . E. M. Voorhees. Overview of the TREC 2004 Robust Retrieval Track. In Proceedings of The 13th Text REtrieval Conference, TREC '13, 2004."},{"key":"e_1_3_2_1_53_1","first-page":"316","volume-title":"Proc. 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2002","author":"Voorhees E. M.","year":"2002","unstructured":"E. M. Voorhees and C. Buckley . The Effect of Topic Set Size on Retrieval Exper- iment Error. In K. J\u00e4rvelin, M. Beaulieu, R. Baeza-Yates, and S. Hyon Myaeng, editors , Proc. 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2002 ), pages 316 -- 323 . ACM Press, New York, USA , 2002 . E. M. Voorhees and C. Buckley. The Effect of Topic Set Size on Retrieval Exper- iment Error. In K. J\u00e4rvelin, M. Beaulieu, R. Baeza-Yates, and S. Hyon Myaeng, editors, Proc. 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2002), pages 316--323. ACM Press, New York, USA, 2002."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3086701"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390346"},{"key":"e_1_3_2_1_56_1","volume-title":"Non-parametric Significance Tests of Retrieval Performance Comparisons. Journal of Information Science, 20(4):270--284","author":"Wilbur W. John","year":"1994","unstructured":"W. John Wilbur . Non-parametric Significance Tests of Retrieval Performance Comparisons. Journal of Information Science, 20(4):270--284 , 1994 . W. John Wilbur. Non-parametric Significance Tests of Retrieval Performance Comparisons. Journal of Information Science, 20(4):270--284, 1994."},{"key":"e_1_3_2_1_57_1","first-page":"307","volume-title":"Proc. 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 1998","author":"Zobel J.","year":"1998","unstructured":"J. Zobel . How Reliable are the Results of Large-Scale Information Retrieval Experiments. In W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, and J. Zobel, editors , Proc. 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 1998 ), pages 307 -- 314 . ACM Press, New York, USA , 1998 . J. Zobel. How Reliable are the Results of Large-Scale Information Retrieval Experiments. In W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, and J. Zobel, editors, Proc. 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 1998), pages 307--314. ACM Press, New York, USA, 1998."}],"event":{"name":"CIKM '22: The 31st ACM International Conference on Information and Knowledge Management","location":"Atlanta GA USA","acronym":"CIKM '22","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 31st ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557286","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3511808.3557286","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:28Z","timestamp":1750182568000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557286"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":57,"alternative-id":["10.1145\/3511808.3557286","10.1145\/3511808"],"URL":"https:\/\/doi.org\/10.1145\/3511808.3557286","relation":{},"subject":[],"published":{"date-parts":[[2022,10,17]]},"assertion":[{"value":"2022-10-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}