{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T21:02:47Z","timestamp":1780088567238,"version":"3.54.0"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,5,26]],"date-time":"2021-05-26T00:00:00Z","timestamp":1621987200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,5,26]],"date-time":"2021-05-26T00:00:00Z","timestamp":1621987200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1521743"],"award-info":[{"award-number":["DMS-1521743"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1521743"],"award-info":[{"award-number":["DMS-1521743"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1821240"],"award-info":[{"award-number":["DMS-1821240"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1821240"],"award-info":[{"award-number":["DMS-1821240"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1521702"],"award-info":[{"award-number":["DMS-1521702"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006192","name":"Advanced Scientific Computing Research","doi-asserted-by":"publisher","award":["DE-AC02-06CH11357"],"award-info":[{"award-number":["DE-AC02-06CH11357"]}],"id":[{"id":"10.13039\/100006192","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2021,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We consider the problem of learning the level set for which a noisy black-box function exceeds a given threshold. To efficiently reconstruct the level set, we investigate Gaussian process (GP) metamodels. Our focus is on strongly stochastic simulators, in particular with heavy-tailed simulation noise and low signal-to-noise ratio. To guard against noise misspecification, we assess the performance of three variants: (i) GPs with Student-<jats:italic>t<\/jats:italic>observations; (ii) Student-<jats:italic>t<\/jats:italic>processes (TPs); and (iii) classification GPs modeling the sign of the response. In conjunction with these metamodels, we analyze several acquisition functions for guiding the sequential experimental designs, extending existing stepwise uncertainty reduction criteria to the stochastic contour-finding context. This also motivates our development of (approximate) updating formulas to efficiently compute such acquisition functions. Our schemes are benchmarked by using a variety of synthetic experiments in 1\u20136 dimensions. We also consider an application of level set estimation for determining the optimal exercise policy of Bermudan options in finance.<\/jats:p>","DOI":"10.1007\/s11222-021-10014-w","type":"journal-article","created":{"date-parts":[[2021,5,26]],"date-time":"2021-05-26T06:02:33Z","timestamp":1622008953000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Evaluating Gaussian process metamodels and sequential designs for noisy level set estimation"],"prefix":"10.1007","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9855-7709","authenticated-orcid":false,"given":"Xiong","family":"Lyu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Micka\u00ebl","family":"Binois","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Ludkovski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,5,26]]},"reference":[{"key":"10014_CR1","doi-asserted-by":"crossref","unstructured":"Ankenman, B., Nelson, B.L., Staum, J.: Stochastic kriging for simulation metamodeling. In: 2008 Winter Simulation Conference, pp. 362\u2013370. IEEE (2008)","DOI":"10.1109\/WSC.2008.4736089"},{"issue":"1","key":"10014_CR2","doi-asserted-by":"publisher","first-page":"850","DOI":"10.1137\/141000749","volume":"4","author":"D Azzimonti","year":"2016","unstructured":"Azzimonti, D., Bect, J., Chevalier, C., Ginsbourger, D.: Quantifying uncertainties on excursion sets under a Gaussian random field prior. SIAM\/ASA J. Uncertain. Quantif. 4(1), 850\u2013874 (2016)","journal-title":"SIAM\/ASA J. Uncertain. Quantif."},{"key":"10014_CR3","unstructured":"Baker, E., Barbillon, P., Fadikar, A., Gramacy, R.B., Herbei, R., Higdon, D., Huang, J., Johnson, L.R., Mondal, A., Pires, B., et\u00a0al.: Analyzing stochastic computer models: an overview with opportunities. Technical report (2020). arXiv preprint arXiv:2002.01321"},{"issue":"3","key":"10014_CR4","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1007\/s11222-011-9241-4","volume":"22","author":"J Bect","year":"2012","unstructured":"Bect, J., Ginsbourger, D., Li, L., Picheny, V., Vazquez, E.: Sequential design of computer experiments for the estimation of a probability of failure. Stat. Comput. 22(3), 773\u2013793 (2012)","journal-title":"Stat. Comput."},{"issue":"1","key":"10014_CR5","doi-asserted-by":"publisher","first-page":"762","DOI":"10.1137\/16M1078276","volume":"5","author":"J Bect","year":"2017","unstructured":"Bect, J., Li, L., Vazquez, E.: Bayesian subset simulation. SIAM\/ASA J. Uncertain. Quantif. 5(1), 762\u2013786 (2017)","journal-title":"SIAM\/ASA J. Uncertain. Quantif."},{"issue":"10","key":"10014_CR6","doi-asserted-by":"publisher","first-page":"2459","DOI":"10.2514\/1.34321","volume":"46","author":"BJ Bichon","year":"2008","unstructured":"Bichon, B.J., Eldred, M.S., Swiler, L.P., Mahadevan, S., McFarland, J.M.: Efficient global reliability analysis for nonlinear implicit performance functions. AIAA J. 46(10), 2459\u20132468 (2008)","journal-title":"AIAA J."},{"issue":"4","key":"10014_CR7","doi-asserted-by":"publisher","first-page":"808","DOI":"10.1080\/10618600.2018.1458625","volume":"27","author":"M Binois","year":"2018","unstructured":"Binois, M., Gramacy, R.B., Ludkovski, M.: Practical heteroskedastic Gaussian process modeling for large simulation experiments. J. Comput. Graph. Stat. 27(4), 808\u2013821 (2018)","journal-title":"J. Comput. Graph. Stat."},{"issue":"1","key":"10014_CR8","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1080\/00401706.2018.1469433","volume":"61","author":"M Binois","year":"2019","unstructured":"Binois, M., Huang, J., Gramacy, R.B., Ludkovski, M.: Replication or exploration? Sequential design for stochastic simulation experiments. Technometrics 61(1), 7\u201323 (2019)","journal-title":"Technometrics"},{"key":"10014_CR9","unstructured":"Bogunovic, I., Scarlett, J., Krause, A., Cevher, V.: Truncated variance reduction: a unified approach to Bayesian optimization and level-set estimation. In: Advances in Neural Information Processing Systems, pp. 1507\u20131515 (2016)"},{"key":"10014_CR10","doi-asserted-by":"crossref","unstructured":"Bryan, B., Schneider, J.: Actively learning level-sets of composite functions. In: Proceedings of the 25th International Conference on Machine Learning, pp. 80\u201387. ACM (2008)","DOI":"10.1145\/1390156.1390167"},{"key":"10014_CR11","unstructured":"Bryan, B., Nichol, R.C., Genovese, C.R., Schneider, J., Miller, C.J., Wasserman L.: Active learning for identifying function threshold boundaries. In: Advances in Neural Information Processing Systems, pp. 163\u2013170 (2006)"},{"key":"10014_CR12","unstructured":"Chevalier, C.: Fast uncertainty reduction strategies relying on Gaussian process models. Ph.D. thesis, Universitat Bern (2013)"},{"key":"10014_CR13","doi-asserted-by":"crossref","unstructured":"Chevalier, C., Ginsbourger, D., Bect, J., Molchanov, I.: Estimating and quantifying uncertainties on level sets using the Vorob\u2019ev expectation and deviation with Gaussian process models. In: mODa 10\u2014Advances in Model-Oriented Design and Analysis, pp. 35\u201343. Springer (2013)","DOI":"10.1007\/978-3-319-00218-7_5"},{"issue":"4","key":"10014_CR14","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1080\/00401706.2013.860918","volume":"56","author":"C Chevalier","year":"2014","unstructured":"Chevalier, C., Bect, J., Ginsbourger, D., Vazquez, E., Picheny, V., Richet, Y.: Fast parallel kriging-based stepwise uncertainty reduction with application to the identification of an excursion set. Technometrics 56(4), 455\u2013465 (2014)","journal-title":"Technometrics"},{"key":"10014_CR15","unstructured":"Echard, B., Gayton, N., Lemaire, M.: Kriging based Monte Carlo simulation to compute the probability of failure efficiently: AK-MCS method. 6emes Journ\u00e9es Nationales de Fiabilit\u00e9, 24\u201326 mars, Toulouse, France (2010)"},{"issue":"5","key":"10014_CR16","doi-asserted-by":"publisher","first-page":"2410","DOI":"10.1137\/070693424","volume":"47","author":"PI Frazier","year":"2008","unstructured":"Frazier, P.I., Powell, W.B., Dayanik, S.: A knowledge-gradient policy for sequential information collection. SIAM J. Control. Optim. 47(5), 2410\u20132439 (2008)","journal-title":"SIAM J. Control. Optim."},{"key":"10014_CR17","unstructured":"Gotovos, A., Casati, N., Hitz, G., Krause, A.: Active learning for level set estimation. In: Twenty-Third International Joint Conference on Artificial Intelligence (2013)"},{"issue":"2","key":"10014_CR18","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1198\/TECH.2009.0015","volume":"51","author":"RB Gramacy","year":"2009","unstructured":"Gramacy, R.B., Lee, H.K.: Adaptive design and analysis of supercomputer experiments. Technometrics 51(2), 130\u2013145 (2009)","journal-title":"Technometrics"},{"issue":"1","key":"10014_CR19","doi-asserted-by":"publisher","first-page":"748","DOI":"10.1137\/140980089","volume":"6","author":"RB Gramacy","year":"2015","unstructured":"Gramacy, R.B., Ludkovski, M.: Sequential design for optimal stopping problems. SIAM J. Financ. Math. 6(1), 748\u2013775 (2015)","journal-title":"SIAM J. Financ. Math."},{"issue":"1","key":"10014_CR20","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1137\/15M1045168","volume":"5","author":"R Hu","year":"2017","unstructured":"Hu, R., Ludkovski, M.: Sequential design for ranking response surfaces. SIAM\/ASA J. Uncertain. Quantif. 5(1), 212\u2013239 (2017)","journal-title":"SIAM\/ASA J. Uncertain. Quantif."},{"issue":"1","key":"10014_CR21","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.ejor.2017.01.035","volume":"261","author":"H Jalali","year":"2017","unstructured":"Jalali, H., Van Nieuwenhuyse, I., Picheny, V.: Comparison of kriging-based algorithms for simulation optimization with heterogeneous noise. Eur. J. Oper. Res. 261(1), 279\u2013301 (2017)","journal-title":"Eur. J. Oper. Res."},{"issue":"4","key":"10014_CR22","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1023\/A:1008306431147","volume":"13","author":"DR Jones","year":"1998","unstructured":"Jones, D.R., Schonlau, M., Welch, W.J.: Efficient global optimization of expensive black-box functions. J. Global Optim. 13(4), 455\u2013492 (1998)","journal-title":"J. Global Optim."},{"issue":"Nov","key":"10014_CR23","first-page":"3227","volume":"12","author":"P Jyl\u00e4nki","year":"2011","unstructured":"Jyl\u00e4nki, P., Vanhatalo, J., Vehtari, A.: Robust Gaussian process regression with a Student-t likelihood. J. Mach. Learn. Res. 12(Nov), 3227\u20133257 (2011)","journal-title":"J. Mach. Learn. Res."},{"issue":"1","key":"10014_CR24","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1093\/rfs\/14.1.113","volume":"14","author":"FA Longstaff","year":"2001","unstructured":"Longstaff, F.A., Schwartz, E.S.: Valuing American options by simulation: a simple least-squares approach. Rev. Financ. Stud. 14(1), 113\u2013147 (2001)","journal-title":"Rev. Financ. Stud."},{"issue":"1","key":"10014_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.21314\/JCF.2018.347","volume":"22","author":"M Ludkovski","year":"2018","unstructured":"Ludkovski, M.: Kriging metamodels for Bermudan option pricing. J. Comput. Finance 22(1), 1\u201342 (2018)","journal-title":"J. Comput. Finance"},{"issue":"12","key":"10014_CR26","doi-asserted-by":"publisher","first-page":"1859","DOI":"10.1109\/TCAD.2005.852295","volume":"24","author":"S Mukhopadhyay","year":"2005","unstructured":"Mukhopadhyay, S., Mahmoodi, H., Roy, K.: Modeling of failure probability and statistical design of SRAM array for yield enhancement in nanoscaled CMOS. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 24(12), 1859\u20131880 (2005)","journal-title":"IEEE Trans. Comput. Aided Des. Integr. Circuits Syst."},{"key":"10014_CR27","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1111\/j.2517-6161.1979.tb01090.x","volume":"41","author":"A O\u2019Hagan","year":"1979","unstructured":"O\u2019Hagan, A.: On outlier rejection phenomena in Bayes inference. J. R. Stat. Soc. Ser. B (Methodol.) 41, 358\u2013367 (1979)","journal-title":"J. R. Stat. Soc. Ser. B (Methodol.)"},{"issue":"7","key":"10014_CR28","doi-asserted-by":"publisher","first-page":"071008","DOI":"10.1115\/1.4001873","volume":"132","author":"V Picheny","year":"2010","unstructured":"Picheny, V., Ginsbourger, D., Roustant, O., Haftka, R.T., Kim, N.H.: Adaptive designs of experiments for accurate approximation of a target region. J. Mech. Des. 132(7), 071008 (2010)","journal-title":"J. Mech. Des."},{"issue":"1","key":"10014_CR29","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1080\/00401706.2012.707580","volume":"55","author":"V Picheny","year":"2013","unstructured":"Picheny, V., Ginsbourger, D., Richet, Y., Caplin, G.: Quantile-based optimization of noisy computer experiments with tunable precision. Technometrics 55(1), 2\u201313 (2013a)","journal-title":"Technometrics"},{"issue":"3","key":"10014_CR30","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1007\/s00158-013-0919-4","volume":"48","author":"V Picheny","year":"2013","unstructured":"Picheny, V., Wagner, T., Ginsbourger, D.: A benchmark of kriging-based infill criteria for noisy optimization. Struct. Multidiscip. Optim. 48(3), 607\u2013626 (2013b)","journal-title":"Struct. Multidiscip. Optim."},{"issue":"4","key":"10014_CR31","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1198\/004017008000000541","volume":"50","author":"P Ranjan","year":"2008","unstructured":"Ranjan, P., Bingham, D., Michailidis, G.: Sequential experiment design for contour estimation from complex computer codes. Technometrics 50(4), 527\u2013541 (2008)","journal-title":"Technometrics"},{"issue":"Nov","key":"10014_CR32","first-page":"3011","volume":"11","author":"CE Rasmussen","year":"2010","unstructured":"Rasmussen, C.E., Nickisch, H.: Gaussian processes for machine learning (GPML) toolbox. J. Mach. Learn. Res. 11(Nov), 3011\u20133015 (2010)","journal-title":"J. Mach. Learn. Res."},{"key":"10014_CR33","volume-title":"Gaussian Processes for Machine Learning","author":"CE Rasmussen","year":"2006","unstructured":"Rasmussen, C.E., Williams, C.K.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)"},{"key":"10014_CR34","first-page":"645","volume":"9","author":"J Riihim\u00e4ki","year":"2010","unstructured":"Riihim\u00e4ki, J., Vehtari, A.: Gaussian processes with monotonicity information. AISTATS 9, 645\u2013652 (2010)","journal-title":"AISTATS"},{"key":"10014_CR35","volume-title":"The Design and Analysis of Computer Experiments","author":"TJ Santner","year":"2013","unstructured":"Santner, T.J., Williams, B.J., Notz, W.I.: The Design and Analysis of Computer Experiments. Springer, Berlin (2013)"},{"issue":"6","key":"10014_CR36","doi-asserted-by":"publisher","first-page":"2752","DOI":"10.1109\/TSP.2007.893758","volume":"55","author":"C Scott","year":"2007","unstructured":"Scott, C., Davenport, M.: Regression level set estimation via cost-sensitive classification. IEEE Trans. Signal Process. 55(6), 2752\u20132757 (2007)","journal-title":"IEEE Trans. Signal Process."},{"key":"10014_CR37","unstructured":"Shah, A., Wilson, A., Ghahramani, Z.: Student-t processes as alternatives to Gaussian processes. In: Artificial Intelligence and Statistics, pp. 877\u2013885 (2014)"},{"issue":"5","key":"10014_CR38","doi-asserted-by":"publisher","first-page":"3250","DOI":"10.1109\/TIT.2011.2182033","volume":"58","author":"N Srinivas","year":"2012","unstructured":"Srinivas, N., Krause, A., Kakade, S.M., Seeger, M.W.: Information-theoretic regret bounds for Gaussian process optimization in the bandit setting. IEEE Trans. Inf. Theory 58(5), 3250\u20133265 (2012)","journal-title":"IEEE Trans. Inf. Theory"},{"issue":"4","key":"10014_CR39","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1109\/72.935083","volume":"12","author":"JN Tsitsiklis","year":"2001","unstructured":"Tsitsiklis, J.N., Van Roy, B.: Regression methods for pricing complex American-style options. IEEE Trans. Neural Netw. 12(4), 694\u2013703 (2001)","journal-title":"IEEE Trans. Neural Netw."},{"key":"10014_CR40","unstructured":"Vanhatalo, J., Jyl\u00e4nki, P., Vehtari, A.: Gaussian process regression with Student-t likelihood. In: Advances in Neural Information Processing Systems, pp. 1910\u20131918 (2009)"},{"issue":"1","key":"10014_CR41","first-page":"1175","volume":"14","author":"J Vanhatalo","year":"2013","unstructured":"Vanhatalo, J., Riihim\u00e4ki, J., Hartikainen, J., Jyl\u00e4nki, P., Tolvanen, V., Vehtari, A.: Bayesian modeling with Gaussian processes using the GPstuff toolbox. J. Mach. Learn. Res. 14(1), 1175\u20131179 (2013)","journal-title":"J. Mach. Learn. Res."},{"issue":"10","key":"10014_CR42","doi-asserted-by":"publisher","first-page":"546","DOI":"10.3182\/20090706-3-FR-2004.00090","volume":"42","author":"E Vazquez","year":"2009","unstructured":"Vazquez, E., Bect, J.: A sequential Bayesian algorithm to estimate a probability of failure. IFAC Proc. Vol. 42(10), 546\u2013550 (2009)","journal-title":"IFAC Proc. Vol."},{"key":"10014_CR43","unstructured":"Vazquez, E., Martinez, M.P.: Estimation of the volume of an excursion set of a Gaussian process using intrinsic kriging (2006). arXiv preprint, arXiv:math\/0611273"},{"key":"10014_CR44","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.jspi.2017.05.006","volume":"189","author":"Z Wang","year":"2017","unstructured":"Wang, Z., Shi, J.Q., Lee, Y.: Extended t-process regression models. J. Stat. Plan. Inference 189, 38\u201360 (2017)","journal-title":"J. Stat. Plan. Inference"},{"issue":"12","key":"10014_CR45","doi-asserted-by":"publisher","first-page":"2965","DOI":"10.1109\/TIP.2007.910175","volume":"16","author":"RM Willett","year":"2007","unstructured":"Willett, R.M., Nowak, R.D.: Minimax optimal level-set estimation. IEEE Trans. Image Process. 16(12), 2965\u20132979 (2007)","journal-title":"IEEE Trans. Image Process."},{"issue":"12","key":"10014_CR46","doi-asserted-by":"publisher","first-page":"1342","DOI":"10.1109\/34.735807","volume":"20","author":"CK Williams","year":"1998","unstructured":"Williams, C.K., Barber, D.: Bayesian classification with Gaussian processes. IEEE Trans. Pattern Anal. Mach. Intell. 20(12), 1342\u20131351 (1998)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"10014_CR47","doi-asserted-by":"crossref","unstructured":"Yang, J., Wang, Z., Wu, J.: Level set estimation with dynamic sparse sensing. In: 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP), pp. 487\u2013491. IEEE (2014)","DOI":"10.1109\/GlobalSIP.2014.7032165"}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-021-10014-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11222-021-10014-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-021-10014-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,31]],"date-time":"2024-08-31T15:22:00Z","timestamp":1725117720000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11222-021-10014-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,26]]},"references-count":47,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,7]]}},"alternative-id":["10014"],"URL":"https:\/\/doi.org\/10.1007\/s11222-021-10014-w","relation":{},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"value":"0960-3174","type":"print"},{"value":"1573-1375","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,26]]},"assertion":[{"value":"27 February 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 April 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 May 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"43"}}