{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T19:28:34Z","timestamp":1780082914901,"version":"3.54.0"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,9,10]],"date-time":"2018-09-10T00:00:00Z","timestamp":1536537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMOD Rec."],"published-print":{"date-parts":[[2018,9,10]]},"abstract":"<jats:p>Entity matching (EM) has been a long-standing challenge in data management. Most current EM works focus only on developing matching algorithms. We argue that far more efforts should be devoted to building EM systems. We discuss the limitations of current EM systems, then describe Magellan, a new kind of EM system. Magellan is novel in four important aspects. (1) It provides how-to guides that tell users what to do in each EM scenario, step by step. (2) It provides tools to help users execute these steps; the tools seek to cover the entire EM pipeline, not just blocking and matching as current EM systems do. (3) Tools are built into the Python open-source data science ecosystem, allowing Magellan to borrow a rich set of capabilities in data cleaning, IE, visualization, learning, etc. (4) Magellan provides a powerful scripting environment to facilitate interactive experimentation and quick \"patching\" of the system. We describe research challenges and present extensive experiments that show the promise of the Magellan approach.<\/jats:p>","DOI":"10.1145\/3277006.3277015","type":"journal-article","created":{"date-parts":[[2018,9,13]],"date-time":"2018-09-13T12:07:33Z","timestamp":1536840453000},"page":"33-40","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Technical Perspective:"],"prefix":"10.1145","volume":"47","author":[{"given":"Pradap","family":"Konda","sequence":"first","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sanjib","family":"Das","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Suganthan G.C.","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philip","family":"Martinkus","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adel","family":"Ardalan","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeffrey R.","family":"Ballard","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yash","family":"Govind","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Han","family":"Li","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fatemah","family":"Panahi","sequence":"additional","affiliation":[{"name":"Google"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haojun","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeff","family":"Naughton","sequence":"additional","affiliation":[{"name":"Google"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shishir","family":"Prasad","sequence":"additional","affiliation":[{"name":"@WalmartLabs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ganesh","family":"Krishnan","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rohit","family":"Deep","sequence":"additional","affiliation":[{"name":"@WalmartLabs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vijay","family":"Raghavendra","sequence":"additional","affiliation":[{"name":"@WalmartLabs"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,9,10]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"BigGorilla: An Open-source Data Integration and Data Preparation Ecosystem: https:\/\/recruit-holdings.com\/news_ data\/release\/2017\/0630_7890.html.  BigGorilla: An Open-source Data Integration and Data Preparation Ecosystem: https:\/\/recruit-holdings.com\/news_ data\/release\/2017\/0630_7890.html."},{"key":"e_1_2_1_2_1","unstructured":"CS 838: Data Science: Principles Algorithms and Applications https:\/\/sites.google.com\/site\/anhaidgroup\/courses\/ cs-838-spring-2017\/project-description\/stage-3.  CS 838: Data Science: Principles Algorithms and Applications https:\/\/sites.google.com\/site\/anhaidgroup\/courses\/ cs-838-spring-2017\/project-description\/stage-3."},{"key":"e_1_2_1_3_1","unstructured":"Magellan home page https:\/\/sites.google.com\/site\/anhaidgroup\/projects\/magellan.  Magellan home page https:\/\/sites.google.com\/site\/anhaidgroup\/projects\/magellan."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702509"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/312129.312298"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807252"},{"key":"e_1_2_1_7_1","volume-title":"Information Visualization in Data Mining and Knowledge Discovery","author":"Becker B.","year":"2002","unstructured":"B. Becker , R. Kohavi , and D. Sommerfield . Visualizing the simple Bayesian classifier . In Information Visualization in Data Mining and Knowledge Discovery , 2002 . B. Becker, R. Kohavi, and D. Sommerfield. Visualizing the simple Bayesian classifier. In Information Visualization in Data Mining and Knowledge Discovery, 2002."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339707"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btx334"},{"key":"e_1_2_1_10_1","volume-title":"API design for machine learning software: experiences from the scikit-learn project. arXiv preprint arXiv:1309.0238","author":"Buitinck L.","year":"2013","unstructured":"L. Buitinck API design for machine learning software: experiences from the scikit-learn project. arXiv preprint arXiv:1309.0238 , 2013 . L. Buitinck et al. API design for machine learning software: experiences from the scikit-learn project. arXiv preprint arXiv:1309.0238, 2013."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/502512.502547"},{"key":"e_1_2_1_12_1","volume-title":"HDKM","author":"Christen P.","year":"2008","unstructured":"P. Christen . Febrl : A freely available record linkage system with a graphical user interface . HDKM , 2008 . P. Christen. Febrl: A freely available record linkage system with a graphical user interface. HDKM, 2008."},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-31164-2","volume-title":"Data Matching","author":"Christen P.","year":"2012","unstructured":"P. Christen . Data Matching . Springer , 2012 . P. Christen. Data Matching. Springer, 2012."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2011.127"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465327"},{"key":"e_1_2_1_16_1","unstructured":"S. Das etal The Magellan data repository. https:\/\/sites.google.com\/site\/anhaidgroup\/projects\/data  S. Das et al. The Magellan data repository. https:\/\/sites.google.com\/site\/anhaidgroup\/projects\/data"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3035918.3035960"},{"key":"e_1_2_1_18_1","volume-title":"CIDR","author":"Doan A.","year":"2017","unstructured":"A. Doan . What is our agenda for data science ? In CIDR , 2017 . A. Doan. What is our agenda for data science? In CIDR, 2017."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077257.3077268"},{"key":"e_1_2_1_20_1","volume-title":"Toward a system building agenda for data integration and cleaning","author":"Doan A.","unstructured":"A. Doan Toward a system building agenda for data integration and cleaning . In IEEE Data Engineering Bulletin, Special Issue on Data Integration ( to appear), 2018. A. Doan et al. Toward a system building agenda for data integration and cleaning. In IEEE Data Engineering Bulletin, Special Issue on Data Integration (to appear), 2018."},{"key":"e_1_2_1_21_1","volume-title":"DeepER-deep entity resolution. arXiv preprint arXiv:1710.00597","author":"Ebraheem M.","year":"2017","unstructured":"M. Ebraheem DeepER-deep entity resolution. arXiv preprint arXiv:1710.00597 , 2017 . M. Ebraheem et al. DeepER-deep entity resolution. arXiv preprint arXiv:1710.00597, 2017."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/1191547.1191739"},{"key":"e_1_2_1_23_1","volume-title":"In SIGMOD Workshop on Information Quality in Information Systems","author":"Fortini M.","year":"2006","unstructured":"M. Fortini Towards an open source toolkit for building record linkage workflows . In In SIGMOD Workshop on Information Quality in Information Systems , 2006 . M. Fortini et al. Towards an open source toolkit for building record linkage workflows. In In SIGMOD Workshop on Information Quality in Information Systems, 2006."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989331"},{"key":"e_1_2_1_25_1","volume-title":"Private exploration primitives for data cleaning. arXiv preprint arXiv:1712.10266","author":"Ge C.","year":"2017","unstructured":"C. Ge Private exploration primitives for data cleaning. arXiv preprint arXiv:1712.10266 , 2017 . C. Ge et al. Private exploration primitives for data cleaning. arXiv preprint arXiv:1712.10266, 2017."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2588576"},{"key":"e_1_2_1_27_1","volume-title":"BIGDAS","author":"Govind Y.","year":"2017","unstructured":"Y. Govind : A cloud\/crowd service for entity matching . In BIGDAS , 2017 . Y. Govind et al. Cloudmatcher: A cloud\/crowd service for entity matching. In BIGDAS, 2017."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2452376.2452440"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.14778\/2994509.2994535"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007314"},{"key":"e_1_2_1_33_1","volume-title":"AIMA Joint Summit","author":"LaRose E.","year":"2017","unstructured":"E. LaRose Entity matching using Magellan: Mapping drug reference tables . In AIMA Joint Summit , 2017 . E. LaRose et al. Entity matching using Magellan: Mapping drug reference tables. In AIMA Joint Summit, 2017."},{"key":"e_1_2_1_34_1","volume-title":"EDBT","author":"Li H.","year":"2018","unstructured":"H. Li : A debugger for blocking in entity matching . In EDBT , 2018 . H. Li et al. Matchcatcher: A debugger for blocking in entity matching. In EDBT, 2018."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3196926"},{"key":"e_1_2_1_36_1","volume-title":"EDBT","author":"Panahi F.","year":"2017","unstructured":"F. Panahi Towards interactive debugging of rule-based entity matching . In EDBT , 2017 . F. Panahi et al. Towards interactive debugging of rule-based entity matching. In EDBT, 2017."},{"key":"e_1_2_1_37_1","volume-title":"CPCP Retreat","author":"Pessig P.","year":"2017","unstructured":"P. Pessig . Entity matching using Magellan - Matching drug reference tables . In CPCP Retreat 2017 . http:\/\/cpcp.wisc.edu\/ resources\/cpcp-2017-retreat-entity-matching. P. Pessig. Entity matching using Magellan - Matching drug reference tables. In CPCP Retreat 2017. http:\/\/cpcp.wisc.edu\/ resources\/cpcp-2017-retreat-entity-matching."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3132949"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775087"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518895"},{"key":"e_1_2_1_41_1","volume-title":"Big gorilla: an open-source ecosystem for data preparation and integration","author":"Tan W.-C.","unstructured":"W.-C. Tan Big gorilla: an open-source ecosystem for data preparation and integration . In IEEE Data Engineering Bulletin, Special Issue on Data Integration ( to appear), 2018. W.-C. Tan et al. Big gorilla: an open-source ecosystem for data preparation and integration. In IEEE Data Engineering Bulletin, Special Issue on Data Integration (to appear), 2018."}],"container-title":["ACM SIGMOD Record"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3277006.3277015","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3277006.3277015","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:57:41Z","timestamp":1750208261000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3277006.3277015"}},"subtitle":["Toward Building Entity Matching Management Systems"],"short-title":[],"issued":{"date-parts":[[2018,9,10]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,9,10]]}},"alternative-id":["10.1145\/3277006.3277015"],"URL":"https:\/\/doi.org\/10.1145\/3277006.3277015","relation":{},"ISSN":["0163-5808"],"issn-type":[{"value":"0163-5808","type":"print"}],"subject":[],"published":{"date-parts":[[2018,9,10]]},"assertion":[{"value":"2018-09-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}