{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:25:15Z","timestamp":1776093915005,"version":"3.50.1"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:p>\"Bad\" data has a direct impact on 88% of companies, with the average company losing 12% of its revenue due to it. Duplicates - multiple but different representations of the same real-world entities - are among the main reasons for poor data quality, so finding and configuring the right deduplication solution is essential. Existing data matching benchmarks focus on the quality of matching results and neglect other important factors, such as business requirements. Additionally, they often do not support the exploration of data matching results.<\/jats:p>\n          <jats:p>To address this gap between the mere counting of record pairs vs. a comprehensive means to evaluate data matching solutions, we present the Frost platform. It combines existing benchmarks, established quality metrics, cost and effort metrics, and exploration techniques, making it the first platform to allow systematic exploration to understand matching results. Frost is implemented and published in the open-source application Snowman, which includes the visual exploration of matching results, as shown in Figure 1.<\/jats:p>","DOI":"10.14778\/3554821.3554823","type":"journal-article","created":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T22:28:39Z","timestamp":1664490519000},"page":"3292-3305","source":"Crossref","is-referenced-by-count":3,"title":["Frost"],"prefix":"10.14778","volume":"15","author":[{"given":"Martin","family":"Graf","sequence":"first","affiliation":[{"name":"University of Potsdam, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lukas","family":"Laskowski","sequence":"additional","affiliation":[{"name":"University of Potsdam, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Florian","family":"Papsdorf","sequence":"additional","affiliation":[{"name":"University of Potsdam, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Florian","family":"Sold","sequence":"additional","affiliation":[{"name":"University of Potsdam, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roland","family":"Gremmelspacher","sequence":"additional","affiliation":[{"name":"SAP SE, Walldorf, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Felix","family":"Naumann","sequence":"additional","affiliation":[{"name":"University of Potsdam, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabian","family":"Panse","sequence":"additional","affiliation":[{"name":"University of Hamburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,9,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.14778\/2850578.2850579"},{"key":"e_1_2_1_3_1","volume-title":"A Practioner's Guide to Evaluating Entity Resolution Results. Computing Research Repository (CoRR)","author":"Barnes Matt","year":"2015","unstructured":"Matt Barnes . 2015. A Practioner's Guide to Evaluating Entity Resolution Results. Computing Research Repository (CoRR) ( 2015 ). http:\/\/arxiv.org\/abs\/1509.04238 Matt Barnes. 2015. A Practioner's Guide to Evaluating Entity Resolution Results. Computing Research Repository (CoRR) (2015). http:\/\/arxiv.org\/abs\/1509.04238"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-008-0098-x"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1456650.1456651"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0263-7863(96)00038-5"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2005.125"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13040-021-00244-z"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31164-2"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2011.127"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2507815"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3418896"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488411"},{"key":"e_1_2_1_14_1","volume-title":"Donatella Firmani, Maurizio Mazzei, Paolo Merialdo, Federico Piai, and Divesh Srivastava.","author":"Crescenzi Valter","year":"2021","unstructured":"Valter Crescenzi , Andrea De Angelis , Donatella Firmani, Maurizio Mazzei, Paolo Merialdo, Federico Piai, and Divesh Srivastava. 2021 . Alaska : A Flexible Benchmark for Data Integration Tasks. Computing Research Repository (CoRR) ( 2021). https:\/\/arxiv.org\/abs\/2101.11259 Valter Crescenzi, Andrea De Angelis, Donatella Firmani, Maurizio Mazzei, Paolo Merialdo, Federico Piai, and Divesh Srivastava. 2021. Alaska: A Flexible Benchmark for Data Integration Tasks. Computing Research Repository (CoRR) (2021). https:\/\/arxiv.org\/abs\/2101.11259"},{"key":"e_1_2_1_15_1","unstructured":"Sanjib Das AnHai Doan Paul Suganthan G. C. Chaitanya Gokhale Pradap Konda Yash Govind and Derek Paulsen. 2016. The Magellan Data Repository. https:\/\/sites.google.com\/site\/anhaidgroup\/useful-stuff\/data.  Sanjib Das AnHai Doan Paul Suganthan G. C. Chaitanya Gokhale Pradap Konda Yash Govind and Derek Paulsen. 2016. The Magellan Data Repository. https:\/\/sites.google.com\/site\/anhaidgroup\/useful-stuff\/data."},{"key":"e_1_2_1_16_1","unstructured":"Ben Davis. 2014. The cost of bad data: stats. https:\/\/econsultancy.com\/the-cost-of-bad-data-stats.  Ben Davis. 2014. The cost of bad data: stats. https:\/\/econsultancy.com\/the-cost-of-bad-data-stats."},{"key":"e_1_2_1_17_1","volume-title":"Unsupervised String Transformation Learning for Entity Consolidation. Computing Research Repository (CoRR)","author":"Deng Dong","year":"2018","unstructured":"Dong Deng , Wenbo Tao , Ziawasch Abedjan , Ahmed K. Elmagarmid , Ihab F. Ilyas , Samuel Madden , Mourad Ouzzani , Michael Stonebraker , and Nan Tang . 2018. Unsupervised String Transformation Learning for Entity Consolidation. Computing Research Repository (CoRR) ( 2018 ). http:\/\/arxiv.org\/abs\/1709.10436 Dong Deng, Wenbo Tao, Ziawasch Abedjan, Ahmed K. Elmagarmid, Ihab F. Ilyas, Samuel Madden, Mourad Ouzzani, Michael Stonebraker, and Nan Tang. 2018. Unsupervised String Transformation Learning for Entity Consolidation. Computing Research Repository (CoRR) (2018). http:\/\/arxiv.org\/abs\/1709.10436"},{"key":"e_1_2_1_18_1","volume-title":"Ives","author":"Doan AnHai","year":"2012","unstructured":"AnHai Doan , Alon Y. Halevy , and Zachary G . Ives . 2012 . Principles of Data Integration. Morgan Kaufmann . http:\/\/research.cs.wisc.edu\/dibook\/ AnHai Doan, Alon Y. Halevy, and Zachary G. Ives. 2012. Principles of Data Integration. Morgan Kaufmann. http:\/\/research.cs.wisc.edu\/dibook\/"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3405476"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3352591"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the International Workshop on Quality in Databases (QDB)","author":"Draisbach Uwe","year":"2010","unstructured":"Uwe Draisbach and Felix Naumann . 2010 . DuDe: The duplicate detection toolkit . In Proceedings of the International Workshop on Quality in Databases (QDB) . Singapore. Uwe Draisbach and Felix Naumann. 2010. DuDe: The duplicate detection toolkit. In Proceedings of the International Workshop on Quality in Databases (QDB). Singapore."},{"key":"e_1_2_1_22_1","volume-title":"The International Conference on Information Quality (ICIQ).","author":"Draisbach Uwe","year":"2013","unstructured":"Uwe Draisbach and Felix Naumann . 2013 . On choosing thresholds for duplicate detection . In The International Conference on Information Quality (ICIQ). Uwe Draisbach and Felix Naumann. 2013. On choosing thresholds for duplicate detection. In The International Conference on Information Quality (ICIQ)."},{"key":"e_1_2_1_23_1","volume-title":"International Conference of Maintenance Societies. Maintenance Engineering Society of Australia, 1--8.","author":"Ellis Byron A","year":"2007","unstructured":"Byron A Ellis . 2007 . Life cycle cost . In International Conference of Maintenance Societies. Maintenance Engineering Society of Australia, 1--8. Byron A Ellis. 2007. Life cycle cost. In International Conference of Maintenance Societies. Maintenance Engineering Society of Australia, 1--8."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2594511"},{"key":"e_1_2_1_25_1","volume-title":"ACM SIGMOD 2021 Programming Contest. https:\/\/dbgroup.ing.unimore.it\/sigmod21contest\/Last accessed on 2022-06-10","author":"Firmani Donatella","year":"2021","unstructured":"Donatella Firmani , Giovanni Simonini , Andrea De Angelis , and Luca Zecchini . 2021 . ACM SIGMOD 2021 Programming Contest. https:\/\/dbgroup.ing.unimore.it\/sigmod21contest\/Last accessed on 2022-06-10 . Donatella Firmani, Giovanni Simonini, Andrea De Angelis, and Luca Zecchini. 2021. ACM SIGMOD 2021 Programming Contest. https:\/\/dbgroup.ing.unimore.it\/sigmod21contest\/Last accessed on 2022-06-10."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.2307\/2288117"},{"key":"e_1_2_1_27_1","unstructured":"Brent Fulgham and Isaac Gouy. 2022. The Computer Language 22.05 Benchmarks Game. https:\/\/benchmarksgame-team.pages.debian.net\/benchmarksgame\/fastest\/javascript.html Last accessed on 2022-06-10.  Brent Fulgham and Isaac Gouy. 2022. The Computer Language 22.05 Benchmarks Game. https:\/\/benchmarksgame-team.pages.debian.net\/benchmarksgame\/fastest\/javascript.html Last accessed on 2022-06-10."},{"key":"e_1_2_1_28_1","first-page":"1","article-title":"ROC curve estimation: An overview","volume":"12","author":"Gon\u00e7alves Luzia","year":"2014","unstructured":"Luzia Gon\u00e7alves , Ana Subtil , and M Ros\u00e1rio Oliveira P d Bermudez . 2014 . ROC curve estimation: An overview . REVSTAT 12 , 1 (2014), 1 -- 20 . Luzia Gon\u00e7alves, Ana Subtil, and M Ros\u00e1rio Oliveira P d Bermudez. 2014. ROC curve estimation: An overview. REVSTAT 12, 1 (2014), 1--20.","journal-title":"REVSTAT"},{"key":"e_1_2_1_29_1","volume-title":"Frost: A Platform for Benchmarking and Exploring Data Matching Results.","author":"Graf Martin","year":"2022","unstructured":"Martin Graf , Lukas Laskowski , Florian Papsdorf , Florian Sold , Roland Gremmelspacher , Felix Naumann , and Fabian Panse . 2022 . Frost: A Platform for Benchmarking and Exploring Data Matching Results. (2022). arXiv:2107.10590 [cs.DB] Martin Graf, Lukas Laskowski, Florian Papsdorf, Florian Sold, Roland Gremmelspacher, Felix Naumann, and Fabian Panse. 2022. Frost: A Platform for Benchmarking and Exploring Data Matching Results. (2022). arXiv:2107.10590 [cs.DB]"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-021-05964-1"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687771"},{"key":"e_1_2_1_32_1","volume-title":"Record fusion: A learning approach. Computing Research Repository (CoRR)","author":"Heidari Alireza","year":"2020","unstructured":"Alireza Heidari , George Michalopoulos , Shrinu Kushagra , Ihab F. Ilyas , and Theodoros Rekatsinas . 2020. Record fusion: A learning approach. Computing Research Repository (CoRR) ( 2020 ). https:\/\/arxiv.org\/abs\/2006.10208 Alireza Heidari, George Michalopoulos, Shrinu Kushagra, Ihab F. Ilyas, and Theodoros Rekatsinas. 2020. Record fusion: A learning approach. Computing Research Repository (CoRR) (2020). https:\/\/arxiv.org\/abs\/2006.10208"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661829.2661885"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-03667-6_10"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.3233\/SW-180331"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.14778\/2994509.2994535"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2009.10.003"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687595"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920904"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377878"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45167-9_14"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920871"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.23889\/ijpds.v4i1.1127"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE51399.2021.00269"},{"key":"e_1_2_1_45_1","volume-title":"The Four Generations of Entity Resolution","author":"Papadakis George","unstructured":"George Papadakis , Ekaterini Ioannou , Emanouil Thanos , and Themis Palpanas . 2021. The Four Generations of Entity Resolution . Morgan & Claypool Publishers . George Papadakis, Ekaterini Ioannou, Emanouil Thanos, and Themis Palpanas. 2021. The Four Generations of Entity Resolution. Morgan & Claypool Publishers."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2020.101565"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377455"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.3233\/SW-190356"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412781"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.14778\/3352063.3352068"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.3233\/SW-170286"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5441\/002\/edbt.2018.86"},{"key":"e_1_2_1_53_1","first-page":"1304","article-title":"The search for simple symmetric Venn diagrams","volume":"53","author":"Ruskey Frank","year":"2006","unstructured":"Frank Ruskey , Carla D Savage , and Stan Wagon . 2006 . The search for simple symmetric Venn diagrams . Notices of the AMS 53 , 11 (2006), 1304 -- 1311 . Frank Ruskey, Carla D Savage, and Stan Wagon. 2006. The search for simple symmetric Venn diagrams. Notices of the AMS 53, 11 (2006), 1304--1311.","journal-title":"Notices of the AMS"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775087"},{"key":"e_1_2_1_55_1","volume-title":"Schema-Aware Instance Matching Benchmark for the Semantic Publishing Domain. Master's thesis","author":"Saveta Tzanina","unstructured":"Tzanina Saveta . 2014. SPIMBench : A Scalable , Schema-Aware Instance Matching Benchmark for the Semantic Publishing Domain. Master's thesis . University of Crete . Tzanina Saveta. 2014. SPIMBench: A Scalable, Schema-Aware Instance Matching Benchmark for the Semantic Publishing Domain. Master's thesis. University of Crete."},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the International Semantic Web Conference (ISWC). http:\/\/ceur-ws.org\/Vol-1486\/paper_43","author":"Saveta Tzanina","year":"2015","unstructured":"Tzanina Saveta , Evangelia Daskalaki , Giorgos Flouris , Irini Fundulaki , and AxelCyrille Ngonga Ngomo . 2015 . LANCE: A Generic Benchmark Generator for Linked Data . In Proceedings of the International Semantic Web Conference (ISWC). http:\/\/ceur-ws.org\/Vol-1486\/paper_43 .pdf Tzanina Saveta, Evangelia Daskalaki, Giorgos Flouris, Irini Fundulaki, and AxelCyrille Ngonga Ngomo. 2015. LANCE: A Generic Benchmark Generator for Linked Data. In Proceedings of the International Semantic Web Conference (ISWC). http:\/\/ceur-ws.org\/Vol-1486\/paper_43.pdf"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1948.tb01338.x"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629687"},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the International Workshop on Information Quality for Information Systems (IQIS). Association for Computing Machinery.","author":"Weis Melanie","year":"2006","unstructured":"Melanie Weis , Felix Naumann , and Franziska Brosy . 2006 . A duplicate detection benchmark for XML (and relational) data . In Proceedings of the International Workshop on Information Quality for Information Systems (IQIS). Association for Computing Machinery. Melanie Weis, Felix Naumann, and Franziska Brosy. 2006. A duplicate detection benchmark for XML (and relational) data. In Proceedings of the International Workshop on Information Quality for Information Systems (IQIS). Association for Computing Machinery."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.14778\/3476311.3476332"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3554821.3554823","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T11:21:22Z","timestamp":1672226482000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3554821.3554823"}},"subtitle":["a platform for benchmarking and exploring data matching results"],"short-title":[],"issued":{"date-parts":[[2022,8]]},"references-count":59,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["10.14778\/3554821.3554823"],"URL":"https:\/\/doi.org\/10.14778\/3554821.3554823","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2022,8]]}}}