{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,2]],"date-time":"2026-11-02T20:25:49Z","timestamp":1793651149880,"version":"4.5.1"},"publisher-location":"Cham","reference-count":49,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031440632","type":"print"},{"value":"9783031440649","type":"electronic"}],"license":[{"start":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T00:00:00Z","timestamp":1672531200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T00:00:00Z","timestamp":1698624000000},"content-version":"vor","delay-in-days":302,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Scientists and practitioners increasingly rely on machine learning to model data and draw conclusions. Compared to statistical modeling approaches, machine learning makes fewer explicit assumptions about data structures, such as linearity. Consequently, the parameters of machine learning models usually cannot be easily related to the data generating process. To learn about the modeled relationships, partial dependence (PD) plots and permutation feature importance (PFI) are often used as interpretation methods. However, PD and PFI lack a theory that relates them to the data generating process. We formalize PD and PFI as statistical estimators of ground truth estimands rooted in the data generating process. We show that PD and PFI estimates deviate from this ground truth not only due to statistical biases, but also due to learner variance and Monte Carlo approximation errors. To account for these uncertainties in PD and PFI estimation, we propose the learner-PD and the learner-PFI based on model refits and propose corrected variance and confidence interval estimators.<\/jats:p>","DOI":"10.1007\/978-3-031-44064-9_24","type":"book-chapter","created":{"date-parts":[[2023,10,29]],"date-time":"2023-10-29T00:19:19Z","timestamp":1698538759000},"page":"456-479","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":102,"title":["Relating the\u00a0Partial Dependence Plot and\u00a0Permutation Feature Importance to\u00a0the\u00a0Data Generating Process"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2331-868X","authenticated-orcid":false,"given":"Christoph","family":"Molnar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1338-3293","authenticated-orcid":false,"given":"Timo","family":"Freiesleben","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6141-4942","authenticated-orcid":false,"given":"Gunnar","family":"K\u00f6nig","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julia","family":"Herbinger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tim","family":"Reisinger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5324-5966","authenticated-orcid":false,"given":"Giuseppe","family":"Casalicchio","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8542-6291","authenticated-orcid":false,"given":"Marvin N.","family":"Wright","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6002-6980","authenticated-orcid":false,"given":"Bernd","family":"Bischl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,10,30]]},"reference":[{"issue":"10","key":"24_CR1","doi-asserted-by":"publisher","first-page":"1340","DOI":"10.1093\/bioinformatics\/btq134","volume":"26","author":"A Altmann","year":"2010","unstructured":"Altmann, A., Tolo\u015fi, L., Sander, O., Lengauer, T.: Permutation importance: a corrected feature importance measure. Bioinformatics 26(10), 1340\u20131347 (2010)","journal-title":"Bioinformatics"},{"issue":"4","key":"24_CR2","doi-asserted-by":"publisher","first-page":"1059","DOI":"10.1111\/rssb.12377","volume":"82","author":"DW Apley","year":"2020","unstructured":"Apley, D.W., Zhu, J.: Visualizing the effects of predictor variables in black box supervised learning models. J. R. Stat. Soc.: Ser. B (Stat. Methodol.) 82(4), 1059\u20131086 (2020)","journal-title":"J. R. Stat. Soc.: Ser. B (Stat. Methodol.)"},{"issue":"4","key":"24_CR3","doi-asserted-by":"publisher","first-page":"2249","DOI":"10.1016\/j.csda.2007.08.015","volume":"52","author":"KJ Archer","year":"2008","unstructured":"Archer, K.J., Kimes, R.V.: Empirical characterization of random forest variable importance measures. Comput. Stat. Data Anal. 52(4), 2249\u20132260 (2008)","journal-title":"Comput. Stat. Data Anal."},{"issue":"12","key":"24_CR4","doi-asserted-by":"publisher","first-page":"T102","DOI":"10.1016\/j.jpain.2013.09.003","volume":"14","author":"E Bair","year":"2013","unstructured":"Bair, E., et al.: Multivariable modeling of phenotypic risk factors for first-onset TMD: the OPPERA prospective cohort study. J. Pain 14(12), T102\u2013T115 (2013)","journal-title":"J. Pain"},{"issue":"535","key":"24_CR5","doi-asserted-by":"publisher","first-page":"1413","DOI":"10.1080\/01621459.2020.1729163","volume":"116","author":"S Bates","year":"2021","unstructured":"Bates, S., Cand\u00e8s, E., Janson, L., Wang, W.: Metropolized knockoff sampling. J. Am. Stat. Assoc. 116(535), 1413\u20131427 (2021)","journal-title":"J. Am. Stat. Assoc."},{"key":"24_CR6","doi-asserted-by":"crossref","unstructured":"Bates, S., Hastie, T., Tibshirani, R.: Cross-validation: what does it estimate and how well does it do it? J. Am. Stat. Assoc. 1\u201312 (2023)","DOI":"10.1080\/01621459.2023.2197686"},{"key":"24_CR7","doi-asserted-by":"crossref","unstructured":"Blesch, K., Watson, D.S., Wright, M.N.: Conditional feature importance for mixed data. AStA Adv. Stat. Anal. 1\u201320 (2023)","DOI":"10.1007\/s10182-023-00477-9"},{"issue":"1","key":"24_CR8","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/s00439-019-01996-9","volume":"139","author":"AL Boulesteix","year":"2020","unstructured":"Boulesteix, A.L., Wright, M.N., Hoffmann, S., K\u00f6nig, I.R.: Statistical learning approaches in the genetic epidemiology of complex diseases. Hum. Genet. 139(1), 73\u201384 (2020)","journal-title":"Hum. Genet."},{"issue":"1","key":"24_CR9","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman, L.: Random forests. Mach. Learn. 45(1), 5\u201332 (2001)","journal-title":"Mach. Learn."},{"key":"24_CR10","volume-title":"Classification and Regression Trees","author":"L Breiman","year":"1984","unstructured":"Breiman, L., Friedman, J., Stone, C.J., Olshen, R.: Classification and Regression Trees. CRC Press, Cambridge (1984)"},{"issue":"1","key":"24_CR11","doi-asserted-by":"publisher","first-page":"67","DOI":"10.6339\/JDS.201601_14(1).0005","volume":"14","author":"G Cafri","year":"2016","unstructured":"Cafri, G., Bailey, B.A.: Understanding variable effects from black box prediction: quantifying effects in tree ensembles using partial dependence. J. Data Sci. 14(1), 67\u201395 (2016)","journal-title":"J. Data Sci."},{"issue":"3","key":"24_CR12","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1111\/rssb.12265","volume":"80","author":"E Candes","year":"2018","unstructured":"Candes, E., Fan, Y., Janson, L., Lv, J.: Panning for gold: \u2018model-X\u2019knockoffs for high dimensional controlled variable selection. J. R. Stat. Soc.: Ser. B (Stat. Methodol.) 80(3), 551\u2013577 (2018)","journal-title":"J. R. Stat. Soc.: Ser. B (Stat. Methodol.)"},{"key":"24_CR13","unstructured":"Chen, H., Janizek, J.D., Lundberg, S., Lee, S.I.: True to the model or true to the data? arXiv preprint arXiv:2006.16234 (2020)"},{"issue":"1","key":"24_CR14","doi-asserted-by":"publisher","first-page":"C1","DOI":"10.1111\/ectj.12097","volume":"21","author":"V Chernozhukov","year":"2018","unstructured":"Chernozhukov, V., et al.: Double\/debiased machine learning for treatment and structural parameters. Economet. J. 21(1), C1\u2013C68 (2018)","journal-title":"Economet. J."},{"key":"24_CR15","unstructured":"Dua, D., Graff, C.: UCI machine learning repository (2017). http:\/\/archive.ics.uci.edu\/ml"},{"key":"24_CR16","doi-asserted-by":"crossref","unstructured":"Emrich, E., Pierdzioch, C.: Public goods, private consumption, and human capital: using boosted regression trees to model volunteer labour supply. Rev. Econ.\/Jahrbuch f\u00fcr Wirtschaftswissenschaften 67(3) (2016)","DOI":"10.1515\/roe-2016-0004"},{"issue":"2","key":"24_CR17","doi-asserted-by":"publisher","first-page":"302","DOI":"10.1080\/02755947.2014.987887","volume":"35","author":"PC Esselman","year":"2015","unstructured":"Esselman, P.C., Stevenson, R.J., Lupi, F., Riseng, C.M., Wiley, M.J.: Landscape prediction and mapping of game fish biomass, an ecosystem service of Michigan rivers. North Am. J. Fish. Manag. 35(2), 302\u2013320 (2015)","journal-title":"North Am. J. Fish. Manag."},{"issue":"177","key":"24_CR18","first-page":"1","volume":"20","author":"A Fisher","year":"2019","unstructured":"Fisher, A., Rudin, C., Dominici, F.: All models are wrong, but many are useful: learning a variable\u2019s importance by studying an entire class of prediction models simultaneously. J. Mach. Learn. Res. 20(177), 1\u201381 (2019)","journal-title":"J. Mach. Learn. Res."},{"key":"24_CR19","unstructured":"Freiesleben, T., K\u00f6nig, G., Molnar, C., Tejero-Cantero, A.: Scientific inference with interpretable machine learning: analyzing models to learn about real-world phenomena. arXiv preprint arXiv:2206.05487 (2022)"},{"key":"24_CR20","doi-asserted-by":"crossref","unstructured":"Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 1189\u20131232 (2001)","DOI":"10.1214\/aos\/1013203451"},{"issue":"1","key":"24_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/neco.1992.4.1.1","volume":"4","author":"S Geman","year":"1992","unstructured":"Geman, S., Bienenstock, E., Doursat, R.: Neural networks and the bias\/variance dilemma. Neural Comput. 4(1), 1\u201358 (1992)","journal-title":"Neural Comput."},{"key":"24_CR22","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1016\/j.scitotenv.2018.10.344","volume":"653","author":"SK Grange","year":"2019","unstructured":"Grange, S.K., Carslaw, D.C.: Using meteorological normalisation to detect interventions in air quality time series. Sci. Total Environ. 653, 578\u2013588 (2019)","journal-title":"Sci. Total Environ."},{"key":"24_CR23","unstructured":"Groemping, U.: Model-agnostic effects plots for interpreting machine learning models. Reports in Mathematics, Physics and Chemistry, Department II, Beuth University of Applied Sciences Berlin. Report 1\/2020 (2020)"},{"key":"24_CR24","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction","author":"T Hastie","year":"2009","unstructured":"Hastie, T., Tibshirani, R., Friedman, J.H., Friedman, J.H.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, vol. 2. Springer, Heidelberg (2009)"},{"key":"24_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11222-021-10057-z","volume":"31","author":"G Hooker","year":"2021","unstructured":"Hooker, G., Mentch, L., Zhou, S.: Unrestricted permutation forces extrapolation: variable importance requires at least one more model, or there is no free variable importance. Stat. Comput. 31, 1\u201316 (2021)","journal-title":"Stat. Comput."},{"issue":"4","key":"24_CR26","doi-asserted-by":"publisher","first-page":"558","DOI":"10.1002\/sim.7803","volume":"38","author":"H Ishwaran","year":"2019","unstructured":"Ishwaran, H., Lu, M.: Standard errors and confidence intervals for variable importance in random forest regression, classification, and survival. Stat. Med. 38(4), 558\u2013582 (2019)","journal-title":"Stat. Med."},{"issue":"4","key":"24_CR27","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1007\/s11634-016-0276-4","volume":"12","author":"S Janitza","year":"2018","unstructured":"Janitza, S., Celik, E., Boulesteix, A.L.: A computationally fast variable importance test for random forests for high-dimensional data. Adv. Data Anal. Classif. 12(4), 885\u2013915 (2018)","journal-title":"Adv. Data Anal. Classif."},{"key":"24_CR28","doi-asserted-by":"crossref","unstructured":"K\u00f6nig, G., Molnar, C., Bischl, B., Grosse-Wentrup, M.: Relative feature importance. In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 9318\u20139325. IEEE (2021)","DOI":"10.1109\/ICPR48806.2021.9413090"},{"key":"24_CR29","series-title":"Springer Series in Statistics","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1007\/978-1-4419-9782-1_27","volume-title":"Targeted Learning","author":"W Zheng","year":"2011","unstructured":"Zheng, W., van der Laan, M.J.: Cross-validated targeted minimum-loss-based estimation. In: Zheng, W., van der Laan, M.J. (eds.) Targeted Learning. SSS, pp. 459\u2013474. Springer, New York (2011). https:\/\/doi.org\/10.1007\/978-1-4419-9782-1_27"},{"key":"24_CR30","unstructured":"Mitchell, T.M.: The need for biases in learning generalizations. Citeseer (1980)"},{"key":"24_CR31","doi-asserted-by":"publisher","unstructured":"Molnar, C., et al.: Online appendix for \u201cRelating the Partial Dependence Plot and Permutation Feature Importance to the Data Generating Process\u201d (2023). https:\/\/doi.org\/10.6084\/m9.figshare.23294945.v1","DOI":"10.6084\/m9.figshare.23294945.v1"},{"key":"24_CR32","doi-asserted-by":"crossref","unstructured":"Molnar, C., K\u00f6nig, G., Bischl, B., Casalicchio, G.: Model-agnostic feature importance and effects with dependent features: a conditional subgroup approach. Data Min. Knowl. Discov. 1\u201339 (2023)","DOI":"10.1007\/s10618-022-00901-9"},{"key":"24_CR33","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1007\/978-3-031-04083-2_4","volume-title":"xxAI - Beyond Explainable AI","author":"C Molnar","year":"2022","unstructured":"Molnar, C., et al.: General pitfalls of model-agnostic interpretation methods for machine learning models. In: Holzinger, A., Goebel, R., Fong, R., Moon, T., M\u00fcller, K.R., Samek, W. (eds.) xxAI 2020. LNCS, vol. 13200, pp. 39\u201368. Springer, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-031-04083-2_4"},{"key":"24_CR34","unstructured":"Moosbauer, J., Herbinger, J., Casalicchio, G., Lindauer, M., Bischl, B.: Explaining hyperparameter optimization via partial dependence plots. In: Advances in Neural Information Processing Systems, vol. 34, pp. 2280\u20132291 (2021)"},{"issue":"3","key":"24_CR35","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1023\/A:1024068626366","volume":"52","author":"C Nadeau","year":"2003","unstructured":"Nadeau, C., Bengio, Y.: Inference for the generalization error. Mach. Learn. 52(3), 239\u2013281 (2003)","journal-title":"Mach. Learn."},{"issue":"1","key":"24_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-018-23509-w","volume":"8","author":"R Obringer","year":"2018","unstructured":"Obringer, R., Nateghi, R.: Predicting urban reservoir levels using statistical learning techniques. Sci. Rep. 8(1), 1\u20139 (2018)","journal-title":"Sci. Rep."},{"issue":"1","key":"24_CR37","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1175\/WAF-D-17-0121.1","volume":"33","author":"WG Page","year":"2018","unstructured":"Page, W.G., Wagenbrenner, N.S., Butler, B.W., Forthofer, J.M., Gibson, C.: An evaluation of NDFD weather forecasts for wildland fire behavior prediction. Weather Forecast. 33(1), 301\u2013315 (2018)","journal-title":"Weather Forecast."},{"key":"24_CR38","unstructured":"Parr, T., Wilson, J.D.: A stratification approach to partial dependence for codependent variables. arXiv preprint arXiv:1907.06698 (2019)"},{"key":"24_CR39","unstructured":"Parr, T., Wilson, J.D., Hamrick, J.: Nonparametric feature impact and importance. arXiv preprint arXiv:2006.04750 (2020)"},{"key":"24_CR40","unstructured":"R Core Team: R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria (2018). https:\/\/www.R-project.org\/"},{"key":"24_CR41","unstructured":"Ribeiro, M.T., Singh, S., Guestrin, C.: Model-agnostic interpretability of machine learning. ICML WHI 2016 (2016). arXiv preprint arXiv:1606.05386"},{"issue":"1","key":"24_CR42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v051.i01","volume":"51","author":"O Roustant","year":"2012","unstructured":"Roustant, O., Ginsbourger, D., Deville, Y.: DiceKriging, DiceOptim: two R packages for the analysis of computer experiments by kriging-based metamodeling and optimization. J. Stat. Softw. 51(1), 1\u201355 (2012)","journal-title":"J. Stat. Softw."},{"issue":"30","key":"24_CR43","doi-asserted-by":"publisher","first-page":"17680","DOI":"10.1073\/pnas.1920484117","volume":"117","author":"C Stachl","year":"2020","unstructured":"Stachl, C., et al.: Predicting personality from patterns of behavior collected with smartphones. Proc. Natl. Acad. Sci. 117(30), 17680\u201317687 (2020)","journal-title":"Proc. Natl. Acad. Sci."},{"issue":"1","key":"24_CR44","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"R Tibshirani","year":"1996","unstructured":"Tibshirani, R.: Regression shrinkage and selection via the lasso. J. Roy. Stat. Soc.: Ser. B (Methodol.) 58(1), 267\u2013288 (1996)","journal-title":"J. Roy. Stat. Soc.: Ser. B (Methodol.)"},{"key":"24_CR45","doi-asserted-by":"publisher","first-page":"2107","DOI":"10.1007\/s10994-021-06030-6","volume":"110","author":"DS Watson","year":"2021","unstructured":"Watson, D.S., Wright, M.N.: Testing conditional independence in supervised learning algorithms. Mach. Learn. 110, 2107\u20132129 (2021)","journal-title":"Mach. Learn."},{"key":"24_CR46","doi-asserted-by":"crossref","unstructured":"Williamson, B.D., Gilbert, P.B., Carone, M., Simon, N.: Nonparametric variable importance assessment using machine learning techniques. Biometrics (2019)","DOI":"10.1111\/biom.13392"},{"key":"24_CR47","unstructured":"Williamson, B.D., Gilbert, P.B., Simon, N.R., Carone, M.: A general framework for inference on algorithm-agnostic variable importance. J. Am. Stat. Assoc. 1\u201314 (2021)"},{"key":"24_CR48","unstructured":"Zhang, L., Janson, L.: Floodgate: inference for model-free variable importance. arXiv preprint arXiv:2007.01283 (2020)"},{"issue":"1","key":"24_CR49","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1080\/07350015.2019.1624293","volume":"39","author":"Q Zhao","year":"2021","unstructured":"Zhao, Q., Hastie, T.: Causal interpretations of black-box models. J. Bus. Econ. Stat. 39(1), 272\u2013281 (2021)","journal-title":"J. Bus. Econ. Stat."}],"container-title":["Communications in Computer and Information Science","Explainable Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-44064-9_24","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,31]],"date-time":"2024-10-31T20:28:41Z","timestamp":1730406521000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-44064-9_24"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"ISBN":["9783031440632","9783031440649"],"references-count":49,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-44064-9_24","relation":{},"ISSN":["1865-0929","1865-0937"],"issn-type":[{"value":"1865-0929","type":"print"},{"value":"1865-0937","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023]]},"assertion":[{"value":"30 October 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"xAI","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"World Conference on Explainable Artificial Intelligence","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Lisbon","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Portugal","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2023","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"26 July 2023","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"28 July 2023","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"1","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"xai2023","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"http:\/\/xaiworldconference.com\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Single-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"220","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"94","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"43% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"No","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}