{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T01:24:05Z","timestamp":1781918645043,"version":"3.54.5"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"8","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:p>Any system at play in a data-driven project has a fundamental requirement: the ability to load data. The de-facto standard format to distribute and consume raw data is csv. Yet, the plain text and flexible nature of this format make such files often difficult to parse and correctly load their content, requiring cumbersome data preparation steps. We propose a benchmark to assess the robustness of systems in loading data from non-standard csv formats and with structural inconsistencies. First, we formalize a model to describe the issues that affect real-world files and use it to derive a systematic \"pollution\" process to generate dialects for any given grammar. Our benchmark leverages the pollution framework for the csv format. To guide pollution, we have surveyed thousands of real-world, publicly available csv files, recording the problems we encountered. We demonstrate the applicability of our benchmark by testing and scoring 16 different systems: popular csv parsing frameworks, relational database tools, spreadsheet systems, and a data visualization tool.<\/jats:p>","DOI":"10.14778\/3594512.3594518","type":"journal-article","created":{"date-parts":[[2023,6,23]],"date-time":"2023-06-23T00:28:36Z","timestamp":1687480116000},"page":"1870-1882","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Pollock: A Data Loading Benchmark"],"prefix":"10.14778","volume":"16","author":[{"given":"Gerardo","family":"Vitagliano","sequence":"first","affiliation":[{"name":"Hasso Plattner Institute, University of Potsdam, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mazhar","family":"Hameed","sequence":"additional","affiliation":[{"name":"Hasso Plattner Institute, University of Potsdam, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lan","family":"Jiang","sequence":"additional","affiliation":[{"name":"Hasso Plattner Institute, University of Potsdam, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucas","family":"Reisener","sequence":"additional","affiliation":[{"name":"Hasso Plattner Institute, University of Potsdam, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eugene","family":"Wu","sequence":"additional","affiliation":[{"name":"Columbia University, New York, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Felix","family":"Naumann","sequence":"additional","affiliation":[{"name":"Hasso Plattner Institute, University of Potsdam, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,6,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.14778\/2983200.2983204"},{"key":"e_1_2_1_2_1","volume-title":"Univocity CSV Parser. www.univocity.com (last accessed Apr 14th","author":"Backes Jeronimo","year":"2022","unstructured":"Jeronimo Backes . 2022. Univocity CSV Parser. www.univocity.com (last accessed Apr 14th , 2022 ). Jeronimo Backes. 2022. Univocity CSV Parser. www.univocity.com (last accessed Apr 14th, 2022)."},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","unstructured":"T. Bray. 2017. The JavaScript Object Notation (JSON) Data Interchange Format. RFC 8259. RFC Editor. https:\/\/www.rfc-editor.org\/rfc\/rfc8259.txt  T. Bray. 2017. The JavaScript Object Notation (JSON) Data Interchange Format. RFC 8259. RFC Editor. https:\/\/www.rfc-editor.org\/rfc\/rfc8259.txt","DOI":"10.17487\/RFC8259"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1956.1056813"},{"key":"e_1_2_1_5_1","volume-title":"Studies in Logic and the Foundations of Mathematics.","author":"Chomsky Noam","unstructured":"Noam Chomsky and Marcel P Sch\u00fctzenberger . 1959. The algebraic theory of context-free languages . In Studies in Logic and the Foundations of Mathematics. Vol. 26 . Elsevier , 118--161. Noam Chomsky and Marcel P Sch\u00fctzenberger. 1959. The algebraic theory of context-free languages. In Studies in Logic and the Foundations of Mathematics. Vol. 26. Elsevier, 118--161."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.14778\/3407790.3407810"},{"key":"e_1_2_1_7_1","volume-title":"www.mysql.com (last accessed July 12th","author":"Oracle Corporation","year":"2022","unstructured":"Oracle Corporation . 2022. My SQL. www.mysql.com (last accessed July 12th , 2022 ). Oracle Corporation. 2022. MySQL. www.mysql.com (last accessed July 12th, 2022)."},{"key":"e_1_2_1_8_1","volume-title":"UK Open Data portal. data.gov.uk (last accessed July 30th","author":"Crown UK","year":"2021","unstructured":"UK Crown . 2021. UK Open Data portal. data.gov.uk (last accessed July 30th , 2021 ). UK Crown. 2021. UK Open Data portal. data.gov.uk (last accessed July 30th, 2021)."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the International Conference on Scientific and Statistical Database Management (SSDBM). ACM, 1--12","author":"D\u00f6hmen Till","year":"2017","unstructured":"Till D\u00f6hmen , Hannes M\u00fchleisen , and Peter Boncz . 2017 . Multi-Hypothesis CSV Parsing . In Proceedings of the International Conference on Scientific and Statistical Database Management (SSDBM). ACM, 1--12 . Till D\u00f6hmen, Hannes M\u00fchleisen, and Peter Boncz. 2017. Multi-Hypothesis CSV Parsing. In Proceedings of the International Conference on Scientific and Statistical Database Management (SSDBM). ACM, 1--12."},{"key":"e_1_2_1_10_1","volume-title":"Apache Commons CSV. https:\/\/commons.apache.org\/proper\/commons-csv\/ (last accessed Jul 12th","author":"Foundation Apache Software","year":"2022","unstructured":"Apache Software Foundation . 2022. Apache Commons CSV. https:\/\/commons.apache.org\/proper\/commons-csv\/ (last accessed Jul 12th , 2022 ). Apache Software Foundation. 2022. Apache Commons CSV. https:\/\/commons.apache.org\/proper\/commons-csv\/ (last accessed Jul 12th, 2022)."},{"key":"e_1_2_1_11_1","volume-title":"www.mariadb.org (last accessed July 12th","author":"Foundation DB","year":"2022","unstructured":"Maria DB Foundation . 2022. Maria DB. www.mariadb.org (last accessed July 12th , 2022 ). MariaDB Foundation. 2022. MariaDB. www.mariadb.org (last accessed July 12th, 2022)."},{"key":"e_1_2_1_12_1","volume-title":"https:\/\/www.libreoffice.org\/discover\/calc\/ (last accessed July 12th","author":"Foundation The Document","year":"2022","unstructured":"The Document Foundation . 2022. LibreOffice Calc 7.3.4. https:\/\/www.libreoffice.org\/discover\/calc\/ (last accessed July 12th , 2022 ). The Document Foundation. 2022. LibreOffice Calc 7.3.4. https:\/\/www.libreoffice.org\/discover\/calc\/ (last accessed July 12th, 2022)."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the International Conference on Management of Data (SIGMOD). 883--899","author":"Ge Chang","year":"2019","unstructured":"Chang Ge , Yinan Li , Eric Eilebrecht , Badrish Chandramouli , and Donald Kossmann . 2019 . Speculative Distributed CSV Data Parsing for Big Data Analytics . In Proceedings of the International Conference on Management of Data (SIGMOD). 883--899 . Chang Ge, Yinan Li, Eric Eilebrecht, Badrish Chandramouli, and Donald Kossmann. 2019. Speculative Distributed CSV Data Parsing for Big Data Analytics. In Proceedings of the International Conference on Management of Data (SIGMOD). 883--899."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the International Conference on Data Mining (ICDM). IEEE, 230--239","author":"Gol Majid Ghasemi","year":"2019","unstructured":"Majid Ghasemi Gol , Jay Pujara , and Pedro Szekely . 2019 . Tabular cell classification using pre-trained cell embeddings . In Proceedings of the International Conference on Data Mining (ICDM). IEEE, 230--239 . Majid Ghasemi Gol, Jay Pujara, and Pedro Szekely. 2019. Tabular cell classification using pre-trained cell embeddings. In Proceedings of the International Conference on Data Mining (ICDM). IEEE, 230--239."},{"key":"e_1_2_1_15_1","volume-title":"https:\/\/www.postgresql.org (last accessed July 12th","author":"The PostgreSQL Global Development Group","year":"2022","unstructured":"The PostgreSQL Global Development Group . 2022. Postgre SQL. https:\/\/www.postgresql.org (last accessed July 12th , 2022 ). The PostgreSQL Global Development Group. 2022. PostgreSQL. https:\/\/www.postgresql.org (last accessed July 12th, 2022)."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3444831.3444835"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the International Conference on Extending Database Technology (EDBT). OpenProceedings.org.","author":"Hameed Mazhar","year":"2022","unstructured":"Mazhar Hameed , Gerardo Vitagliano , Lan Jiang , and Felix Naumann . 2022 . SURAGH: Syntactic Pattern Matching to Identify Ill-Formed Records . In Proceedings of the International Conference on Extending Database Technology (EDBT). OpenProceedings.org. Mazhar Hameed, Gerardo Vitagliano, Lan Jiang, and Felix Naumann. 2022. SURAGH: Syntactic Pattern Matching to Identify Ill-Formed Records. In Proceedings of the International Conference on Extending Database Technology (EDBT). OpenProceedings.org."},{"key":"e_1_2_1_18_1","unstructured":"Richard D Hipp. 2022. SQLite. https:\/\/www.sqlite.org\/index.html  Richard D Hipp. 2022. SQLite. https:\/\/www.sqlite.org\/index.html"},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Ren\u00e1ta Hodov\u00e1n \u00c1kos Kiss and Tibor Gyim\u00f3thy. 2018. Grammarinator: a grammar-based open source fuzzer. In A-TEST@ESEC\/SIGSOFT FSE. ACM 45--48.  Ren\u00e1ta Hodov\u00e1n \u00c1kos Kiss and Tibor Gyim\u00f3thy. 2018. Grammarinator: a grammar-based open source fuzzer. In A-TEST@ESEC\/SIGSOFT FSE. ACM 45--48.","DOI":"10.1145\/3278186.3278193"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the International Conference on Extending Database Technology (EDBT). OpenProceedings.org, 193--204","author":"Jiang Lan","year":"2021","unstructured":"Lan Jiang , Gerardo Vitagliano , and Felix Naumann . 2021 . Structure Detection in Verbose CSV Files . In Proceedings of the International Conference on Extending Database Technology (EDBT). OpenProceedings.org, 193--204 . Lan Jiang, Gerardo Vitagliano, and Felix Naumann. 2021. Structure Detection in Verbose CSV Files. In Proceedings of the International Conference on Extending Database Technology (EDBT). OpenProceedings.org, 193--204."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the International Conference on Management of Data (SIGMOD). ACM, 2878--2880","author":"Kumar Arun","year":"2021","unstructured":"Arun Kumar . 2021 . Automation of Data Prep, ML, and Data Science: New Cure or Snake Oil? . In Proceedings of the International Conference on Management of Data (SIGMOD). ACM, 2878--2880 . Arun Kumar. 2021. Automation of Data Prep, ML, and Data Science: New Cure or Snake Oil?. In Proceedings of the International Conference on Management of Data (SIGMOD). ACM, 2878--2880."},{"key":"e_1_2_1_22_1","volume-title":"Mendeley Data. data.mendeley.com (last accessed July 30th","author":"Ltd Mendeley","year":"2021","unstructured":"Mendeley Ltd . 2021. Mendeley Data. data.mendeley.com (last accessed July 30th , 2021 ). Mendeley Ltd. 2021. Mendeley Data. data.mendeley.com (last accessed July 30th, 2021)."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 24th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, Florence Italy, 702--720","author":"Martens Wim","year":"2015","unstructured":"Wim Martens , Frank Neven , and Stijn Vansummeren . 2015 . SCULPT: A Schema Language for Tabular Data on the Web . In Proceedings of the 24th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, Florence Italy, 702--720 . Wim Martens, Frank Neven, and Stijn Vansummeren. 2015. SCULPT: A Schema Language for Tabular Data on the Web. In Proceedings of the 24th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, Florence Italy, 702--720."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/OBD.2016.18"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0022-0000(68)80037-6"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733009"},{"key":"e_1_2_1_27_1","volume-title":"R: A Language and Environment for Statistical Computing","author":"Team R Core","year":"2022","unstructured":"R Core Team . 2022 . R: A Language and Environment for Statistical Computing . R Foundation for Statistical Computing , Vienna, Austria . https:\/\/www.R-project.org\/(lastaccessedJuly2022) R Core Team. 2022. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. https:\/\/www.R-project.org\/(lastaccessedJuly2022)"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.6702671"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Y. Shafranovich. 2005. Common Format and MIME Type for Comma-Separated Values (CSV) Files. RFC 4180. RFC Editor. 1--8 pages. http:\/\/www.rfc-editor.org\/rfc\/rfc4180.txt  Y. Shafranovich. 2005. Common Format and MIME Type for Comma-Separated Values (CSV) Files. RFC 4180. RFC Editor. 1--8 pages. http:\/\/www.rfc-editor.org\/rfc\/rfc4180.txt","DOI":"10.17487\/rfc4180"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the International Conference on Management of Data (SIGMOD). ACM, 1584--1596","author":"Shah Vraj","year":"2021","unstructured":"Vraj Shah , Jonathan Lacanlale , Premanand Kumar , Kevin Yang , and Arun Kumar . 2021 . Towards Benchmarking Feature Type Inference for AutoML Platforms . In Proceedings of the International Conference on Management of Data (SIGMOD). ACM, 1584--1596 . Vraj Shah, Jonathan Lacanlale, Premanand Kumar, Kevin Yang, and Arun Kumar. 2021. Towards Benchmarking Feature Type Inference for AutoML Platforms. In Proceedings of the International Conference on Management of Data (SIGMOD). ACM, 1584--1596."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3316416.3316425"},{"key":"e_1_2_1_32_1","volume-title":"Sean Sullivan, Kyle Miller, Tom Squires, Kyle Miller, Maciek Opala, and J.C. Romanda.","author":"Smith Glen","year":"2022","unstructured":"Glen Smith , Scott Conway , Andrew Rucker Jones , Sean Sullivan, Kyle Miller, Tom Squires, Kyle Miller, Maciek Opala, and J.C. Romanda. 2022 . OpenCSV - Project page. http:\/\/opencsv.sourceforge.net (last accessed Jul 12th, 2022). Glen Smith, Scott Conway, Andrew Rucker Jones, Sean Sullivan, Kyle Miller, Tom Squires, Kyle Miller, Maciek Opala, and J.C. Romanda. 2022. OpenCSV - Project page. http:\/\/opencsv.sourceforge.net (last accessed Jul 12th, 2022)."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3013716"},{"key":"e_1_2_1_34_1","unstructured":"Jeni Tennison Gregg Kellogg and Ivan Herman. 2015. Model for Tabular Data and Metadata on the Web. W3C Recommendation. W3C. https:\/\/www.w3.org\/TR\/2015\/REC-tabular-data-model-20151217\/.  Jeni Tennison Gregg Kellogg and Ivan Herman. 2015. Model for Tabular Data and Metadata on the Web. W3C Recommendation. W3C. https:\/\/www.w3.org\/TR\/2015\/REC-tabular-data-model-20151217\/."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-019-00646-y"},{"key":"e_1_2_1_36_1","volume-title":"Drake","author":"Rossum Guido Van","year":"2009","unstructured":"Guido Van Rossum and Fred L . Drake . 2009 . Python 3 Reference Manual. CreateSpace, Scotts Valley, CA. Guido Van Rossum and Fred L. Drake. 2009. Python 3 Reference Manual. CreateSpace, Scotts Valley, CA."},{"key":"e_1_2_1_37_1","first-page":"646","article-title":"Detecting Layout Templates in Complex Multiregion Files","volume":"15","author":"Vitagliano Gerardo","year":"2022","unstructured":"Gerardo Vitagliano , Lan Jiang , and Felix Naumann . 2022 . Detecting Layout Templates in Complex Multiregion Files . PVLDB 15 , 3 (2022), 646 -- 658 . Gerardo Vitagliano, Lan Jiang, and Felix Naumann. 2022. Detecting Layout Templates in Complex Multiregion Files. PVLDB 15, 3 (2022), 646--658.","journal-title":"PVLDB"},{"key":"e_1_2_1_38_1","unstructured":"Andreas Zeller Rahul Gopinath Marcel B\u00f6hme Gordon Fraser and Christian Holler. 2019. The Fuzzing Book. CISPA + Saarland University Saarbr\u00fccken. https:\/\/publications.cispa.saarland\/3120\/  Andreas Zeller Rahul Gopinath Marcel B\u00f6hme Gordon Fraser and Christian Holler. 2019. The Fuzzing Book. CISPA + Saarland University Saarbr\u00fccken. https:\/\/publications.cispa.saarland\/3120\/"},{"key":"e_1_2_1_39_1","volume-title":"Rohan Padhye, and Miryung Kim.","author":"Zhang Qian","year":"2020","unstructured":"Qian Zhang , Jiyuan Wang , Muhammad Ali Gulzar , Rohan Padhye, and Miryung Kim. 2020 . BigFuzz: Efficient Fuzz Testing for Data Analytics Using Framework Abstraction. In ASE. IEEE , 722--733. Qian Zhang, Jiyuan Wang, Muhammad Ali Gulzar, Rohan Padhye, and Miryung Kim. 2020. BigFuzz: Efficient Fuzz Testing for Data Analytics Using Framework Abstraction. In ASE. IEEE, 722--733."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3594512.3594518","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,23]],"date-time":"2023-06-23T00:37:14Z","timestamp":1687480634000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3594512.3594518"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4]]},"references-count":39,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["10.14778\/3594512.3594518"],"URL":"https:\/\/doi.org\/10.14778\/3594512.3594518","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2023,4]]},"assertion":[{"value":"2023-06-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}