{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T03:35:10Z","timestamp":1764646510341,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T00:00:00Z","timestamp":1710288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Generative models have recently received a lot of attention. However, a challenge with such models is that it is usually not possible to compute the likelihood function, which makes parameter estimation or training of the models challenging. The most commonly used alternative strategy is called likelihood-free estimation, based on finding values of the model parameters such that a set of selected statistics have similar values in the dataset and in samples generated from the model. However, a challenge is how to select statistics that are efficient in estimating unknown parameters. The most commonly used statistics are the mean vector, variances, and correlations between variables, but they may be less relevant in estimating the unknown parameters. We suggest utilizing Tukey depth contours (TDCs) as statistics in likelihood-free estimation. TDCs are highly flexible and can capture almost any property of multivariate data, in addition, they seem to be as of yet unexplored for likelihood-free estimation. We demonstrate that TDC statistics are able to estimate the unknown parameters more efficiently than mean, variance, and correlation in likelihood-free estimation. We further apply the TDC statistics to estimate the properties of requests to a computer system, demonstrating their real-life applicability. The suggested method is able to efficiently find the unknown parameters of the request distribution and quantify the estimation uncertainty.<\/jats:p>","DOI":"10.3390\/a17030120","type":"journal-article","created":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T13:08:43Z","timestamp":1710335323000},"page":"120","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Efficient Estimation of Generative Models Using Tukey Depth"],"prefix":"10.3390","volume":"17","author":[{"given":"Minh-Quan","family":"Vo","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, VNUHCM\u2014University of Science, District 5, Ho Chi Minh City 70000, Vietnam"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thu","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Simula Metropolitan Center for Digital Engineering, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael A.","family":"Riegler","sequence":"additional","affiliation":[{"name":"Simula Metropolitan Center for Digital Engineering, 0167 Oslo, Norway"},{"name":"Department of Computer Science, Faculty of Technology, Art and Design, Oslo Metropolitan University, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9429-7148","authenticated-orcid":false,"given":"Hugo L.","family":"Hammer","sequence":"additional","affiliation":[{"name":"Simula Metropolitan Center for Digital Engineering, 0167 Oslo, Norway"},{"name":"Department of Computer Science, Faculty of Technology, Art and Design, Oslo Metropolitan University, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,3,13]]},"reference":[{"key":"ref_1","unstructured":"Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., Altman, S., and Anadkat, S. (2023). GPT-4 Technical Report. arXiv."},{"key":"ref_2","first-page":"6840","article-title":"Denoising diffusion probabilistic models","volume":"33","author":"Ho","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_3","first-page":"100004","article-title":"Generative adversarial network: An overview of theory and applications","volume":"1","author":"Aggarwal","year":"2021","journal-title":"Int. J. Inf. Manag. Data Insights"},{"key":"ref_4","unstructured":"Casella, G., and Berger, R.L. (2021). Statistical Inference, Cengage Learning."},{"key":"ref_5","first-page":"1","article-title":"Elfi: Engine for likelihood-free inference","volume":"19","author":"Lintusaari","year":"2018","journal-title":"J. Mach. Learn. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative adversarial networks","volume":"63","author":"Goodfellow","year":"2020","journal-title":"Commun. ACM"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1146\/annurev-statistics-030718-105212","article-title":"Approximate bayesian computation","volume":"6","author":"Beaumont","year":"2019","journal-title":"Annu. Rev. Stat. Its Appl."},{"key":"ref_8","first-page":"1589","article-title":"Quantile tomography: Using quantiles with multivariate data","volume":"22","author":"Kong","year":"2012","journal-title":"Stat. Sin."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"108339","DOI":"10.1016\/j.patcog.2021.108339","article-title":"Estimating Tukey depth using incremental quantile estimators","volume":"122","author":"Hammer","year":"2022","journal-title":"Pattern Recognit."},{"key":"ref_10","unstructured":"Tukey, J.W. (1975, January 21\u201329). Mathematics and the Picturing of Data. Proceedings of the International Congress of Mathematicians, Vancouver, BC, Canada."},{"key":"ref_11","unstructured":"Mahalanobis, P.C. (1936). Proceedings of the National Institute of Sciences of India, National Institute of Sciences of India."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"318","DOI":"10.2307\/2344839","article-title":"The ordering of multivariate data","volume":"139","author":"Barnett","year":"1976","journal-title":"J. R. Stat. Soc. Ser. A"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1016\/0167-7152(83)90054-8","article-title":"Descriptive statistics for multivariate distributions","volume":"1","author":"Oja","year":"1983","journal-title":"Stat. Probab. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1214\/aos\/1176347507","article-title":"On a Notion of Data Depth Based on Random Simplices","volume":"18","author":"Liu","year":"1990","journal-title":"Ann. Stat."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1998","DOI":"10.1214\/aos\/1069362382","article-title":"Zonoid trimming for multivariate distributions","volume":"25","author":"Koshevoy","year":"1997","journal-title":"Ann. Stat."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1423","DOI":"10.1073\/pnas.97.4.1423","article-title":"The multivariate L1-median and associated data depth","volume":"97","author":"Vardi","year":"2000","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_17","first-page":"516","article-title":"Algorithm AS 307: Bivariate Location Depth","volume":"45","author":"Rousseeuw","year":"1996","journal-title":"J. R. Stat. Soc. Ser. C"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1080\/00031305.1999.10474494","article-title":"The Bagplot: A Bivariate Boxplot","volume":"53","author":"Peter","year":"1999","journal-title":"Am. Stat."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1214\/aos\/1018031260","article-title":"Multivariate analysis by data depth: Descriptive statistics, graphics and inference, (with discussion and a rejoinder by Liu and Singh)","volume":"27","author":"Liu","year":"1999","journal-title":"Ann. Stat."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1492","DOI":"10.1111\/biom.12889","article-title":"A boxplot for circular data","volume":"74","author":"Buttarazzi","year":"2018","journal-title":"Biometrics"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1080\/01621459.1993.10594317","article-title":"A quality index based on data depth and multivariate rank tests","volume":"88","author":"Liu","year":"1993","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"947","DOI":"10.1080\/01621459.1999.10474199","article-title":"The masking breakdown point of multivariate outlier identification rules","volume":"94","author":"Becker","year":"1999","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_23","unstructured":"Serfling, R. (2006). DIMACS Series in Discrete Mathematics and Theoretical Computer Science, American Mathematical Society."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1006\/jmva.2001.2011","article-title":"Some extensions of tukey\u2019s depth function","volume":"82","author":"Zhang","year":"2002","journal-title":"J. Multivar. Anal."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1111\/1467-9868.00088","article-title":"Balanced confidence regions based on Tukey\u2019s depth and the bootstrap","volume":"59","author":"Yeh","year":"1997","journal-title":"J. R. Stat. Soc. Ser. B (Methodol.)"},{"key":"ref_26","unstructured":"Fraiman, R., Liu, R.Y., and Meloche, J. (1997). Institute of Mathematical Statistics Lecture Notes\u2014Monograph Series, Institute of Mathematical Statistics."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1111\/j.2517-6161.1989.tb01753.x","article-title":"An affine invariant bivariate version of the sign test","volume":"51","author":"Brown","year":"1989","journal-title":"J. R. Stat. Soc."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1111\/j.2517-6161.1994.tb01974.x","article-title":"Affine invariant multivariate multisample sign tests","volume":"56","author":"Hettmansperger","year":"1994","journal-title":"J. R. Stat. Soc. Ser. B (Methodol.)"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1214\/088342304000000594","article-title":"New Nonparametric Tests of Multivariate Locations and Scales Using Data Depth","volume":"19","author":"Li","year":"2004","journal-title":"Stat. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1080\/01621459.2012.688462","article-title":"DD-classifier: Nonparametric classification procedure based on DD-plot","volume":"107","author":"Li","year":"2012","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1007\/s10489-017-1011-3","article-title":"Data depth based support vector machines for predicting corporate bankruptcy","volume":"48","author":"Kim","year":"2018","journal-title":"Appl. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1007\/s11634-016-0269-3","article-title":"Multivariate and functional classification using depth and distance","volume":"11","author":"Hubert","year":"2017","journal-title":"Adv. Data Anal. Classif."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.jmva.2004.02.013","article-title":"Clustering and classification based on the L1 data depth","volume":"90","year":"2004","journal-title":"J. Multivar. Anal."},{"key":"ref_34","unstructured":"Kosiorowski, D., and Zawadzki, Z. (2014). DepthProc an R package for robust exploration of multidimensional economic phenomena. arXiv."},{"key":"ref_35","unstructured":"Williams, B., Toussaint, M., and Storkey, A.J. (2008, January 8\u201310). Modelling motion primitives and their timing in biologically executed movements. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/s10260-015-0297-8","article-title":"Multivariate functional outlier detection","volume":"24","author":"Hubert","year":"2015","journal-title":"Stat. Methods Appl."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2349","DOI":"10.1111\/2041-210X.13074","article-title":"Revisiting niche fundamentals with Tukey depth","volume":"9","author":"Cerdeira","year":"2018","journal-title":"Methods Ecol. Evol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"D10","DOI":"10.1029\/2010JD015338","article-title":"Depth-based multivariate descriptive statistics with hydrological applications","volume":"116","author":"Chebana","year":"2011","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"15324","DOI":"10.1073\/pnas.0306899100","article-title":"Markov chain Monte Carlo without likelihoods","volume":"100","author":"Marjoram","year":"2003","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"983","DOI":"10.1093\/biomet\/asp052","article-title":"Adaptive approximate Bayesian computation","volume":"96","author":"Beaumont","year":"2009","journal-title":"Biometrika"},{"key":"ref_41","unstructured":"Mosler, K. (2013). Robustness and Complex Data Structures, Springer."},{"key":"ref_42","first-page":"3523","article-title":"Image segmentation using deep learning: A survey","volume":"44","author":"Minaee","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"684","DOI":"10.1111\/2041-210X.12050","article-title":"EasyABC: Performing efficient approximate Bayesian computation sampling schemes using R","volume":"4","author":"Jabot","year":"2013","journal-title":"Methods Ecol. Evol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"840","DOI":"10.1007\/s11036-017-0880-3","article-title":"A Queue Model for Reliable Forecasting of Future CPU Consumption","volume":"23","author":"Hammer","year":"2017","journal-title":"Mob. Netw. Appl."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Hofert, M., Kojadinovic, I., M\u00e4chler, M., and Yan, J. (2018). Elements of Copula Modeling with R, Springer International Publishing.","DOI":"10.1007\/978-3-319-89635-9"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Joe, H. (2014). Dependence Modeling with Copulas, Chapman and Hall\/CRC.","DOI":"10.1201\/b17116"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/3\/120\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:13:08Z","timestamp":1760105588000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/3\/120"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,13]]},"references-count":46,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["a17030120"],"URL":"https:\/\/doi.org\/10.3390\/a17030120","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2024,3,13]]}}}