{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:59:30Z","timestamp":1750309170373,"version":"3.41.0"},"reference-count":114,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,6,24]],"date-time":"2024-06-24T00:00:00Z","timestamp":1719187200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2024,6,30]]},"abstract":"<jats:p>Time series data are widely used and provide a wealth of information for countless applications. However, some applications are faced with a limited amount of data, or the data cannot be used due to confidentiality concerns. To overcome these obstacles, time series can be generated synthetically. For example, electrocardiograms can be synthesized to make them available for building models to predict conditions such as cardiac arrhythmia without leaking patient information. Although many different approaches to time series synthesis have been proposed, evaluating the quality of synthetic time series data poses unique challenges and remains an open problem, as there is a lack of a clear definition of what constitutes a \u201cgood\u201d synthesis. To this end, we present a comprehensive literature survey to identify different aspects of synthesis quality and their relationships. Based on this, we propose a definition of synthesis quality and a systematic evaluation procedure for assessing it. With this work, we aim to provide a common language and criteria for evaluating synthetic time series data. Our goal is to promote more rigorous and reproducible research in time series synthesis by enabling researchers and practitioners to generate high-quality synthetic time series data.<\/jats:p>","DOI":"10.1145\/3666006","type":"journal-article","created":{"date-parts":[[2024,5,25]],"date-time":"2024-05-25T07:57:44Z","timestamp":1716623864000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Thinking in Categories: A Survey on Assessing the Quality for Time Series Synthesis"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-5850-2445","authenticated-orcid":false,"given":"Michael","family":"Stenger","sequence":"first","affiliation":[{"name":"Mathematics and Computer Science, University of W\u00fcrzburg, W\u00fcrzburg, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5582-8812","authenticated-orcid":false,"given":"Andr\u00e9","family":"Bauer","sequence":"additional","affiliation":[{"name":"Computer Science, University of Chicago Division of the Physical Sciences, Chicago, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4044-8494","authenticated-orcid":false,"given":"Thomas","family":"Prantl","sequence":"additional","affiliation":[{"name":"Mathematics and Computer Science, University of W\u00fcrzburg, W\u00fcrzburg, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4711-7743","authenticated-orcid":false,"given":"Robert","family":"Leppich","sequence":"additional","affiliation":[{"name":"Mathematics and Computer Science, University of W\u00fcrzburg, W\u00fcrzburg, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7474-2689","authenticated-orcid":false,"given":"Nathaniel","family":"Hudson","sequence":"additional","affiliation":[{"name":"Computer Science, University of Chicago Division of the Physical Sciences, Chicago, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7370-4805","authenticated-orcid":false,"given":"Kyle","family":"Chard","sequence":"additional","affiliation":[{"name":"Computer Science, University of Chicago Division of the Physical Sciences, Chicago, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2129-5269","authenticated-orcid":false,"given":"Ian","family":"Foster","sequence":"additional","affiliation":[{"name":"Computer Science, University of Chicago Division of the Physical Sciences, Chicago, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9742-2063","authenticated-orcid":false,"given":"Samuel","family":"Kounev","sequence":"additional","affiliation":[{"name":"Mathematics and Computer Science, University of W\u00fcrzburg, W\u00fcrzburg, Germany"}]}],"member":"320","published-online":{"date-parts":[[2024,6,24]]},"reference":[{"key":"e_1_3_2_2_2","volume-title":"11th International Conference on Learning Representations","author":"Aboussalah Amine Mohamed","year":"2023","unstructured":"Amine Mohamed Aboussalah, Minjae Kwon, Raj G. Patel, Cheng Chi, and Chi-Guhn Lee. 2023. Recursive time series data augmentation. In 11th International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=5lgD4vU-l24s"},{"key":"e_1_3_2_3_2","volume-title":"International Conference on Learning Representations","author":"Alaa Ahmed","year":"2021","unstructured":"Ahmed Alaa, Alex James Chan, and Mihaela van der Schaar. 2021. Generative time-series modeling with Fourier flows. In International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=PpshD0AXfA"},{"key":"e_1_3_2_4_2","first-page":"290","volume-title":"Proceedings of the 39th International Conference on Machine Learning (Proceedings of Machine Learning Research)","volume":"162","author":"Alaa Ahmed","year":"2022","unstructured":"Ahmed Alaa, Boris Van Breugel, Evgeny S. Saveliev, and Mihaela van der Schaar. 2022. How faithful is your synthetic data? Sample-level metrics for evaluating and auditing generative models. In Proceedings of the 39th International Conference on Machine Learning (Proceedings of Machine Learning Research), Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvari, Gang Niu, and Sivan Sabato (Eds.), Vol. 162. PMLR, 290\u2013306. Retrieved from https:\/\/proceedings.mlr.press\/v162\/alaa22a.html"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2001.00062"},{"key":"e_1_3_2_6_2","first-page":"1","volume-title":"1st ACM International Conference on AI in Finance","author":"Assefa Samuel A.","year":"2020","unstructured":"Samuel A. Assefa, Danial Dervovic, Mahmoud Mahfouz, Robert E. Tillman, Prashant Reddy, and Manuela Veloso. 2020. Generating synthetic data in finance: Opportunities, challenges and pitfalls. In 1st ACM International Conference on AI in Finance. 1\u20138."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467198"},{"key":"e_1_3_2_8_2","first-page":"7294","volume-title":"Advances in Neural Information Processing Systems","author":"Barannikov Serguei","year":"2021","unstructured":"Serguei Barannikov, Ilya Trofimov, Grigorii Sotnikov, Ekaterina Trimbach, Alexander Korotin, Alexander Filippov, and Evgeny Burnaev. 2021. Manifold topology divergence: A framework for comparing data manifolds. In Advances in Neural Information Processing Systems, M. Ranzato, A. Beygelzimer, Y. Dauphin, P. S. Liang, and J. Wortman Vaughan (Eds.), Vol. 34. Curran Associates, Inc., 7294\u20137305. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2021\/file\/3bc31a430954d8326605fc690ed22f4d-Paper.pdf"},{"issue":"7","key":"e_1_3_2_9_2","article-title":"Privacy-preserving generative deep neural networks support clinical data sharing","volume":"12","author":"Beaulieu-Jones Brett K.","year":"2019","unstructured":"Brett K. Beaulieu-Jones, Zhiwei Steven Wu, Chris Williams, Ran Lee, Sanjeev P. Bhavnani, James Brian Byrd, and Casey S. Greene. 2019. Privacy-preserving generative deep neural networks support clinical data sharing. Circul.: Cardiovasc. Qual. Outc. 12, 7 (2019).","journal-title":"Circul.: Cardiovasc. Qual. Outc."},{"key":"e_1_3_2_10_2","first-page":"359","volume-title":"AAAI-94 Workshop on Knowledge Discovery in Databases","author":"Berndt Donald J.","year":"1994","unstructured":"Donald J. Berndt and James Clifford. 1994. Using dynamic time warping to find patterns in time series. In AAAI-94 Workshop on Knowledge Discovery in Databases, Vol. 10. The AAAI Press, Menlo Park, CA, 359\u2013370."},{"issue":"5","key":"e_1_3_2_11_2","article-title":"Plausible deniability for privacy-preserving data synthesis","volume":"10","author":"Bindschaedler Vincent","year":"2017","unstructured":"Vincent Bindschaedler, Reza Shokri, and Carl A. Gunter. 2017. Plausible deniability for privacy-preserving data synthesis. Proc. VLDB Endow. 10, 5 (2017).","journal-title":"Proc. VLDB Endow."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3444690"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2018.10.009"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2021.103329"},{"key":"e_1_3_2_15_2","volume-title":"International Conference on Learning Representations","author":"Bounliphone Wacha","year":"2016","unstructured":"Wacha Bounliphone, Eugene Belilovsky, Matthew B. Blaschko, Ioannis Antonoglou, and Arthur Gretton. 2016. A test of relative similarity for model selection in generative models. In International Conference on Learning Representations. Retrieved from https:\/\/arxiv.org\/pdf\/1511.04581.pdf"},{"issue":"1","key":"e_1_3_2_16_2","doi-asserted-by":"crossref","first-page":"7","DOI":"10.3390\/risks11010007","article-title":"Deep generators on commodity markets application to deep hedging","volume":"11","author":"Boursin Nicolas","year":"2022","unstructured":"Nicolas Boursin, Carl Remlinger, and Joseph Mikael. 2022. Deep generators on commodity markets application to deep hedging. Risks 11, 1 (2022), 7.","journal-title":"Risks"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3418509"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3559540"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1902.05624"},{"issue":"3","key":"e_1_3_2_20_2","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1007\/s00477-016-1239-1","article-title":"Evaluation of a spatial rainfall generator for generating high resolution precipitation projections over orographically complex terrain","volume":"31","author":"Camera Corrado","year":"2017","unstructured":"Corrado Camera, Adriana Bruggeman, Panos Hadjinicolaou, Silas Michaelides, and Manfred A. Lange. 2017. Evaluation of a spatial rainfall generator for generating high resolution precipitation projections over orographically complex terrain. Stochast. Environ. Res. Risk Assess. 31, 3 (2017), 757\u2013773.","journal-title":"Stochast. Environ. Res. Risk Assess."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.24432\/C5VC8G"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPWRS.2009.2033277"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA52953.2021.00111"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAI.2022.3229289"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3144765"},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1007\/978-3-030-59137-3_34","volume-title":"Artificial Intelligence in Medicine","author":"Dash Saloni","year":"2020","unstructured":"Saloni Dash, Andrew Yale, Isabelle Guyon, and Kristin P. Bennett. 2020. Medical time-series data generation using generative adversarial networks. In Artificial Intelligence in Medicine, Martin Michalowski and Robert Moskovitch (Eds.). Springer International Publishing, Cham, 382\u2013391."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2111.08095"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3501305"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1561\/0400000042"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3275134"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0028071"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1706.02633"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3174108"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2208.05836"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2017.106"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1161\/01.CIR.101.23.e215"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-020-00977-1"},{"key":"e_1_3_2_38_2","volume-title":"Advances in Neural Information Processing Systems","author":"Grnarova Paulina","year":"2019","unstructured":"Paulina Grnarova, Kfir Y. Levy, Aurelien Lucchi, Nathanael Perraudin, Ian Goodfellow, Thomas Hofmann, and Andreas Krause. 2019. A domain agnostic measure for monitoring and evaluating GANs. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d\u2019 Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32. Curran Associates, Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/692baebec3bb4b53d7ebc3b9fabac31b-Paper.pdf"},{"key":"e_1_3_2_39_2","volume-title":"International Conference on Learning Representations","author":"Gulrajani Ishaan","year":"2019","unstructured":"Ishaan Gulrajani, Colin Raffel, and Luke Metz. 2019. Towards GAN benchmarks which require generalization. In International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=HkxKH2AcFm"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1806.01875"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.3390\/biology9120441"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-022-03742-7"},{"key":"e_1_3_2_43_2","article-title":"Policy gradient stock GAN for realistic discrete order data generation in financial markets","author":"Hirano Masanori","year":"2022","unstructured":"Masanori Hirano, Hiroki Sakaji, and Kiyoshi Izumi. 2022. Policy gradient stock GAN for realistic discrete order data generation in financial markets. arXiv preprint arXiv:2204.13338 (2022).","journal-title":"arXiv preprint arXiv:2204.13338"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3339252.3339281"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1912.02461"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIPR.2019.00086"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/s42979-021-00667-9"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2020.04.001"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-019-00619-1"},{"key":"e_1_3_2_50_2","first-page":"28968","volume-title":"Advances in Neural Information Processing Systems","author":"Jarrett Daniel","year":"2021","unstructured":"Daniel Jarrett, Ioana Bica, and Mihaela van der Schaar. 2021. Time-series generation by contrastive imitation. In Advances in Neural Information Processing Systems, M. Ranzato, A. Beygelzimer, Y. Dauphin, P.S. Liang, and J. Wortman Vaughan (Eds.), Vol. 34. Curran Associates, Inc., 28968\u201328982. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2021\/file\/f2b4053221961416d47d497814a8064f-Paper.pdf"},{"key":"e_1_3_2_51_2","volume-title":"International Conference on Learning Representations","author":"Jeha Paul","year":"2022","unstructured":"Paul Jeha, Michael Bohlke-Schneider, Pedro Mercado, Shubham Kapoor, Rajbir Singh Nirwan, Valentin Flunkert, Jan Gasthaus, and Tim Januschowski. 2022. PSA-GAN: Progressive self attention GANs for synthetic time series. In International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=Ix_mh42xq5w"},{"key":"e_1_3_2_52_2","first-page":"36999","volume-title":"Advances in Neural Information Processing Systems","volume":"35","author":"Jeon Jinsung","year":"2022","unstructured":"Jinsung Jeon, Jeonghak Kim, Haryong Song, Seunghyeon Cho, and Noseong Park. 2022. GT-GAN: General purpose time series synthesis with generative adversarial networks. In Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Eds.), Vol. 35. Curran Associates, Inc., 36999\u201337010. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/file\/f03ce573aa8bce26f77b76f1cb9ee979-Paper-Conference.pdf"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2011.06801"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3221269.3221293"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/NIR52917.2021.9666131"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1811.12801"},{"key":"e_1_3_2_57_2","volume-title":"Advances in Neural Information Processing Systems","author":"Kynk\u00e4\u00e4nniemi Tuomas","year":"2019","unstructured":"Tuomas Kynk\u00e4\u00e4nniemi, Tero Karras, Samuli Laine, Jaakko Lehtinen, and Timo Aila. 2019. Improved precision and recall metric for assessing generative models. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d\u2019 Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32. Curran Associates, Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/0234c510bc6d908b28c70ff313743079-Paper.pdf"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2005.02494"},{"issue":"1","key":"e_1_3_2_59_2","article-title":"SoK The great GAN bake off, an extensive systematic evaluation of generative adversarial network architectures for time series synthesis","volume":"2","author":"Leznik Mark","year":"2022","unstructured":"Mark Leznik, Arne Lochner, Stefan Wesner, and J\u00f6rg Domaschka. 2022. SoK The great GAN bake off, an extensive systematic evaluation of generative adversarial network architectures for time series synthesis. J. Syst. Res. 2, 1 (2022).","journal-title":"J. Syst. Res."},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3427921.3450257"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i01.5415"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-09342-5_13"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2206.13676"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2020.0209"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1909.13403"},{"key":"e_1_3_2_66_2","volume-title":"International Conference on Learning Representations","author":"Lopez-Paz David","year":"2017","unstructured":"David Lopez-Paz and Maxime Oquab. 2017. Revisiting classifier two-sample tests. In International Conference on Learning Representations. Retrieved from https:\/\/hal.inria.fr\/hal-01862834"},{"key":"e_1_3_2_67_2","volume-title":"Advances in Neural Information Processing Systems","author":"Lucic Mario","year":"2018","unstructured":"Mario Lucic, Karol Kurach, Marcin Michalski, Sylvain Gelly, and Olivier Bousquet. 2018. Are GANs created equal? A large-scale study. In Advances in Neural Information Processing Systems, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.), Vol. 31. Curran Associates, Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2018\/file\/e46de7e1bcaaced9a54f1e9d0d2f800d-Paper.pdf"},{"key":"e_1_3_2_68_2","first-page":"3546","volume-title":"23rd International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research)","volume":"108","author":"Meehan Casey","year":"2020","unstructured":"Casey Meehan, Kamalika Chaudhuri, and Sanjoy Dasgupta. 2020. A non-parametric test to detect data-copying in generative models. In 23rd International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research), Silvia Chiappa and Roberto Calandra (Eds.), Vol. 108. PMLR, 3546\u20133556. Retrieved from https:\/\/proceedings.mlr.press\/v108\/meehan20a.html"},{"issue":"10","key":"e_1_3_2_69_2","article-title":"UniMiB SHAR: A dataset for human activity recognition using acceleration data from smartphones","volume":"7","author":"Micucci Daniela","year":"2017","unstructured":"Daniela Micucci, Marco Mobilio, and Paolo Napoletano. 2017. UniMiB SHAR: A dataset for human activity recognition using acceleration data from smartphones. Appl. Sci. 7, 10 (2017).","journal-title":"Appl. Sci."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1611.09904"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2023.100546"},{"key":"e_1_3_2_72_2","first-page":"7176","volume-title":"37th International Conference on Machine Learning (Proceedings of Machine Learning Research)","volume":"119","author":"Naeem Muhammad Ferjad","year":"2020","unstructured":"Muhammad Ferjad Naeem, Seong Joon Oh, Youngjung Uh, Yunjey Choi, and Jaejun Yoo. 2020. Reliable fidelity and diversity metrics for generative models. In 37th International Conference on Machine Learning (Proceedings of Machine Learning Research), Hal Daum\u00e9 III and Aarti Singh (Eds.), Vol. 119. PMLR, 7176\u20137185."},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2006.05421"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2018.8512470"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.5555\/3304222.3304299"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.3390\/en12050849"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1109\/AITEST49225.2020.00013"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/AITEST52744.2021.00022"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2020.3042574"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2021.106312"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA.2016.49"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM51629.2021.00058"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2016.2613124"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404193"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.3389\/fdata.2021.679939"},{"key":"e_1_3_2_86_2","volume-title":"37th Conference on Neural Information Processing Systems Datasets and Benchmarks Track","author":"Qian Zhaozhi","year":"2023","unstructured":"Zhaozhi Qian, Rob Davis, and Mihaela van der Schaar. 2023. Synthcity: A benchmark framework for diverse use cases of tabular synthetic data. In 37th Conference on Neural Information Processing Systems Datasets and Benchmarks Track. Retrieved from https:\/\/openreview.net\/forum?id=uIppiU2JKP"},{"key":"e_1_3_2_87_2","volume-title":"Advances in Neural Information Processing Systems","author":"Ravuri Suman","year":"2019","unstructured":"Suman Ravuri and Oriol Vinyals. 2019. Classification accuracy score for conditional generative models. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d\u2019 Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32. Curran Associates, Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/fcf55a303b71b84d326fb1d06e332a26-Paper.pdf"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i7.20782"},{"key":"e_1_3_2_89_2","volume-title":"Advances in Neural Information Processing Systems","author":"Richardson Eitan","year":"2018","unstructured":"Eitan Richardson and Yair Weiss. 2018. On GANs and GMMs. In Advances in Neural Information Processing Systems, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.), Vol. 31. Curran Associates, Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2018\/file\/0172d289da48c48de8c5ebf3de9f7ee1-Paper.pdf"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-10933-3"},{"key":"e_1_3_2_91_2","volume-title":"Advances in Neural Information Processing Systems","author":"Sajjadi Mehdi S. M.","year":"2018","unstructured":"Mehdi S. M. Sajjadi, Olivier Bachem, Mario Lucic, Olivier Bousquet, and Sylvain Gelly. 2018. Assessing generative models via precision and recall. In Advances in Neural Information Processing Systems, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.), Vol. 31. Curran Associates, Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2018\/file\/f7696a9b362ac5a51c3dc8f098b73923-Paper.pdf"},{"key":"e_1_3_2_92_2","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2945519"},{"key":"e_1_3_2_93_2","first-page":"32777","article-title":"Generating multivariate time series with COmmon Source CoordInated GAN (COSCI-GAN)","volume":"35","author":"Seyfi Ali","year":"2022","unstructured":"Ali Seyfi, Jean-Francois Rajotte, and Raymond Ng. 2022. Generating multivariate time series with COmmon Source CoordInated GAN (COSCI-GAN). Advan. Neural Inf. Process. Syst. 35 (2022), 32777\u201332788.","journal-title":"Advan. Neural Inf. Process. Syst."},{"key":"e_1_3_2_94_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2102.10231"},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2307.12667"},{"key":"e_1_3_2_96_2","first-page":"5799","volume-title":"Proceedings of the 36th International Conference on Machine Learning (Proceedings of Machine Learning Research)","volume":"97","author":"Simon Loic","year":"2019","unstructured":"Loic Simon, Ryan Webster, and Julien Rabin. 2019. Revisiting precision recall definition for generative modeling. In Proceedings of the 36th International Conference on Machine Learning (Proceedings of Machine Learning Research), Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.), Vol. 97. PMLR, 5799\u20135808. Retrieved from https:\/\/proceedings.mlr.press\/v97\/simon19a.html"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.1111\/rssa.12358"},{"key":"e_1_3_2_98_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2205.11164"},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2009.12682"},{"key":"e_1_3_2_100_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.physa.2019.121261"},{"issue":"28","key":"e_1_3_2_101_2","first-page":"1025","article-title":"Two distributed-state models for generating high-dimensional time series","volume":"12","author":"Taylor Graham W.","year":"2011","unstructured":"Graham W. Taylor, Geoffrey E. Hinton, and Sam T. Roweis. 2011. Two distributed-state models for generating high-dimensional time series. J. Mach. Learn. Res. 12, 28 (2011), 1025\u20131068. Retrieved from http:\/\/jmlr.org\/papers\/v12\/taylor11a.html","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_102_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-01295-2"},{"key":"e_1_3_2_103_2","volume-title":"International Conference on Learning Representations (ICLR\u201916)","author":"Theis L.","year":"2016","unstructured":"L. Theis, A. van den Oord, and M. Bethge. 2016. A note on the evaluation of generative models. In International Conference on Learning Representations (ICLR\u201916). 10."},{"key":"e_1_3_2_104_2","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2014.2313407"},{"issue":"11","key":"e_1_3_2_105_2","article-title":"Visualizing data using t-SNE.","volume":"9","author":"Maaten Laurens Van der","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 11 (2008).","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_106_2","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1007\/978-3-030-18579-4_3","volume-title":"Database Systems for Advanced Applications","author":"Wang Lu","year":"2019","unstructured":"Lu Wang, Wei Zhang, and Xiaofeng He. 2019. Continuous patient-centric sequence generation via sequentially coupled adversarial learning. In Database Systems for Advanced Applications, Guoliang Li, Jun Yang, Joao Gama, Juggapong Natwichai, and Yongxin Tong (Eds.). Springer International Publishing, Cham, 36\u201352."},{"key":"e_1_3_2_107_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00872"},{"key":"e_1_3_2_108_2","first-page":"xiii\u2013xxiii","article-title":"Analyzing the past to prepare for the future: Writing a literature review","author":"Webster Jane","year":"2002","unstructured":"Jane Webster and Richard T. Watson. 2002. Analyzing the past to prepare for the future: Writing a literature review. MIS Quart. (2002), xiii\u2013xxiii.","journal-title":"MIS Quart."},{"key":"e_1_3_2_109_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1911.01700"},{"key":"e_1_3_2_110_2","doi-asserted-by":"publisher","DOI":"10.1080\/14697688.2020.1730426"},{"key":"e_1_3_2_111_2","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1806.07755"},{"key":"e_1_3_2_112_2","first-page":"8798","volume-title":"Advances in Neural Information Processing Systems","author":"Xu Tianlin","year":"2020","unstructured":"Tianlin Xu, Li Kevin Wenliang, Michael Munn, and Beatrice Acciaio. 2020. COT-GAN: Generating sequential data via causal optimal transport. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin (Eds.), Vol. 33. Curran Associates, Inc., 8798\u20138809. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2020\/file\/641d77dd5271fca28764612a028d9c8e-Paper.pdf"},{"key":"e_1_3_2_113_2","volume-title":"European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN\u201919)","author":"Yale Andrew","year":"2019","unstructured":"Andrew Yale, Saloni Dash, Ritik Dutta, Isabelle Guyon, Adrien Pavao, and Kristin P. Bennett. 2019. Privacy preserving synthetic health data. In European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN\u201919)."},{"key":"e_1_3_2_114_2","volume-title":"Advances in Neural Information Processing Systems","author":"Yoon Jinsung","year":"2019","unstructured":"Jinsung Yoon, Daniel Jarrett, and Mihaela van der Schaar. 2019. Time-series generative adversarial networks. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d\u2019 Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32. Curran Associates, Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/c9efe5f26cd17ba6216bbe2a7d26d490-Paper.pdf"},{"key":"e_1_3_2_115_2","doi-asserted-by":"publisher","DOI":"10.1109\/SmartGridComm.2018.8587464"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3666006","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3666006","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:53:46Z","timestamp":1750287226000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3666006"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,24]]},"references-count":114,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,6,30]]}},"alternative-id":["10.1145\/3666006"],"URL":"https:\/\/doi.org\/10.1145\/3666006","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"type":"print","value":"1936-1955"},{"type":"electronic","value":"1936-1963"}],"subject":[],"published":{"date-parts":[[2024,6,24]]},"assertion":[{"value":"2023-11-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-19","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}