{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T09:34:21Z","timestamp":1774949661192,"version":"3.50.1"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2018,12]]},"abstract":"<jats:p>\n            Incentivized by the enormous economic profits, the data marketplace platform has been proliferated recently. In this paper, we consider the data marketplace setting where a data shopper would like to buy data instances from the data marketplace for correlation analysis of certain attributes. We assume that the data in the marketplace is dirty and not free. The goal is to find the data instances from a large number of datasets in the marketplace whose join result not only is of high-quality and rich join informativeness, but also delivers the best correlation between the requested attributes. To achieve this goal, we design DANCE, a middleware that provides the desired data acquisition service. DANCE consists of two phases: (1) In the\n            <jats:italic>off-line<\/jats:italic>\n            phase, it constructs a two-layer join graph from samples. The join graph includes the information of the datasets in the marketplace at both schema and instance levels; (2) In the\n            <jats:italic>online<\/jats:italic>\n            phase, it searches for the data instances that satisfy the constraints of data quality, budget, and join informativeness, while maximizing the correlation of source and target attribute sets. We prove that the complexity of the search problem is NP-hard, and design a heuristic algorithm based on Markov chain Monte Carlo (MCMC). Experiment results on two benchmark and one real datasets demonstrate the efficiency and effectiveness of our heuristic data acquisition algorithm.\n          <\/jats:p>","DOI":"10.14778\/3297753.3297757","type":"journal-article","created":{"date-parts":[[2019,2,27]],"date-time":"2019-02-27T14:57:56Z","timestamp":1551279476000},"page":"362-375","source":"Crossref","is-referenced-by-count":12,"title":["Cost-efficient data acquisition on online data marketplaces for correlation analysis"],"prefix":"10.14778","volume":"12","author":[{"given":"Yanying","family":"Li","sequence":"first","affiliation":[{"name":"Stevens Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haipei","family":"Sun","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Boxiang","family":"Dong","sequence":"additional","affiliation":[{"name":"Montclair State University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui (Wendy)","family":"Wang","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,12]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Bdex. http:\/\/www.bigdataexchange.com\/.  Bdex. http:\/\/www.bigdataexchange.com\/."},{"key":"e_1_2_1_2_1","unstructured":"Google bigquery data warehouse. https:\/\/cloud.google.com\/bigquery\/.  Google bigquery data warehouse. https:\/\/cloud.google.com\/bigquery\/."},{"key":"e_1_2_1_3_1","unstructured":"Microsoft azure data marketplace. https:\/\/azuremarketplace.microsoft.com.  Microsoft azure data marketplace. https:\/\/azuremarketplace.microsoft.com."},{"key":"e_1_2_1_4_1","volume-title":"http:\/\/www.informationweek.com\/big-data\/","year":"2016","unstructured":"Idc's worldwide semiannual big data and analytics spending guide taxonomy. http:\/\/www.informationweek.com\/big-data\/ , 2016 . Idc's worldwide semiannual big data and analytics spending guide taxonomy. http:\/\/www.informationweek.com\/big-data\/, 2016."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/303976.303983"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.14778\/3402755.3402801"},{"issue":"11","key":"e_1_2_1_7_1","first-page":"243","article-title":"Extending dependencies with conditions","volume":"4","author":"Bravo L.","year":"2007","unstructured":"L. Bravo , W. Fan , and S. Ma . Extending dependencies with conditions . PVLDB , 4 ( 11 ): 243 -- 254 , 2007 . L. Bravo, W. Fan, and S. Ma. Extending dependencies with conditions. PVLDB, 4(11):243--254, 2007.","journal-title":"PVLDB"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.14778\/1453856.1453980"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767833"},{"key":"e_1_2_1_10_1","first-page":"1","volume-title":"International Conference on Database Theory","author":"Deep S.","year":"2017","unstructured":"S. Deep and P. Koutris . The design of arbitrage-free data pricing schemes . In International Conference on Database Theory , pages 1 -- 18 , 2017 . S. Deep and P. Koutris. The design of arbitrage-free data pricing schemes. In International Conference on Database Theory, pages 1--18, 2017."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1366102.1366103"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1002\/wics.100"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871503"},{"key":"e_1_2_1_14_1","volume-title":"Kogan Page Publishers","author":"Hague P. N.","year":"2013","unstructured":"P. N. Hague , N. Hague , and C.-A. Morgan . Market research in practice: How to get greater insight from your market . Kogan Page Publishers , 2013 . P. N. Hague, N. Hague, and C.-A. Morgan. Market research in practice: How to get greater insight from your market. Kogan Page Publishers, 2013."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/42.2.100"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2820783.2820881"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646196"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367548"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2770870"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84816-7_5"},{"key":"e_1_2_1_21_1","volume-title":"Submodular function maximization","author":"Krause A.","year":"2014","unstructured":"A. Krause and D. Golovin . Submodular function maximization ., 2014 . A. Krause and D. Golovin. Submodular function maximization., 2014."},{"key":"e_1_2_1_22_1","first-page":"19","volume-title":"WebDB","author":"Li C.","year":"2012","unstructured":"C. Li and G. Miklau . Pricing aggregate queries in a data marketplace . In WebDB , pages 19 -- 24 , 2012 . C. Li and G. Miklau. Pricing aggregate queries in a data marketplace. In WebDB, pages 19--24, 2012."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.14778\/3297753.3297757"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.14778\/3021924.3021942"},{"key":"e_1_2_1_25_1","volume-title":"Digital signal processing: a computer-based approach","author":"Mitra S. K.","year":"2006","unstructured":"S. K. Mitra and Y. Kuo . Digital signal processing: a computer-based approach , volume 2 . McGraw-Hill New York , 2006 . S. K. Mitra and Y. Kuo. Digital signal processing: a computer-based approach, volume 2. McGraw-Hill New York, 2006."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2618243.2618251"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2008.4497546"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2213836.2213846"},{"issue":"4","key":"e_1_2_1_29_1","first-page":"3","article-title":"Problems and current approaches","volume":"23","author":"Rahm E.","year":"2000","unstructured":"E. Rahm and H. H. Do . Data cleaning : Problems and current approaches . IEEE Data Engineering Bulletin , 23 ( 4 ): 3 -- 13 , 2000 . E. Rahm and H. H. Do. Data cleaning: Problems and current approaches. IEEE Data Engineering Bulletin, 23(4):3--13, 2000.","journal-title":"IEEE Data Engineering Bulletin"},{"key":"e_1_2_1_30_1","volume-title":"Joint data purchasing and data placement in a geo-distributed data market. arXiv preprint arXiv:1604.02533","author":"Ren X.","year":"2016","unstructured":"X. Ren Joint data purchasing and data placement in a geo-distributed data market. arXiv preprint arXiv:1604.02533 , 2016 . X. Ren et al. Joint data purchasing and data placement in a geo-distributed data market. arXiv preprint arXiv:1604.02533, 2016."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871459"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1150402.1150448"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281192.1281272"},{"key":"e_1_2_1_34_1","volume-title":"Springer Science & Business Media","author":"Vazirani V. V.","year":"2013","unstructured":"V. V. Vazirani . Approximation algorithms . Springer Science & Business Media , 2013 . V. V. Vazirani. Approximation algorithms. Springer Science & Business Media, 2013."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824051"},{"key":"e_1_2_1_36_1","volume-title":"Submodularity in combinatorial optimization","author":"Vondr\u00e1k J.","year":"2007","unstructured":"J. Vondr\u00e1k . Submodularity in combinatorial optimization . 2007 . J. Vondr\u00e1k. Submodularity in combinatorial optimization. 2007."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.14778\/3402707.3402728"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143980"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465320"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3297753.3297757","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T09:33:34Z","timestamp":1672220014000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3297753.3297757"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,12]]},"references-count":39,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,12]]}},"alternative-id":["10.14778\/3297753.3297757"],"URL":"https:\/\/doi.org\/10.14778\/3297753.3297757","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2018,12]]}}}