{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T16:04:06Z","timestamp":1791648246455,"version":"4.3.4"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2024,12,18]],"date-time":"2024-12-18T00:00:00Z","timestamp":1734480000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2024,12,18]]},"abstract":"<jats:p>Machine learning models are only as good as their training data. Simple models trained on well-chosen features extracted from the raw data often outperform complex models trained directly on the raw data. Data preparation pipelines, which clean and derive features from the data, are therefore important for machine learning applications. However, constructing such pipelines is a resource-intensive process that involves deep human expertise.<\/jats:p>\n                  <jats:p>Our goal is to design an efficient framework for automatically finding high-quality data preparation pipelines. The main challenge is how to explore a large search space of pipeline components with the objective of computing features that maximize the performance of the downstream models. Existing solutions are limited in terms of feature quality, which results in low accuracies of the downstream models, while incurring significant runtime overhead. We present CtxPipe, a novel framework that addresses the limitations of previous works by leveraging contextual information to improve the pipeline construction process. Specifically, it uses pre-trained embedding models to capture the data semantics, which are then used to guide the selection of pipeline components. We implement CtxPipe with deep reinforcement learning and evaluate it against state-of-the-art automated pipeline construction solutions. Our comprehensive experiments demonstrate that CtxPipe outperforms all of the baselines in both model performance and runtime cost.<\/jats:p>","DOI":"10.1145\/3698831","type":"journal-article","created":{"date-parts":[[2024,12,20]],"date-time":"2024-12-20T16:40:35Z","timestamp":1734712835000},"page":"1-27","source":"Crossref","is-referenced-by-count":9,"title":["CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-5386-6629","authenticated-orcid":false,"given":"Haotian","family":"Gao","sequence":"first","affiliation":[{"name":"National University of Singapore &amp; NUSRI Chongqing, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8605-076X","authenticated-orcid":false,"given":"Shaofeng","family":"Cai","sequence":"additional","affiliation":[{"name":"National University of Singapore, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8158-3636","authenticated-orcid":false,"given":"Tien Tuan Anh","family":"Dinh","sequence":"additional","affiliation":[{"name":"Deakin University, Melbourne, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1931-7775","authenticated-orcid":false,"given":"Zhiyong","family":"Huang","sequence":"additional","affiliation":[{"name":"National University of Singapore &amp; NUSRI Chongqing, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4446-1100","authenticated-orcid":false,"given":"Beng Chin","family":"Ooi","sequence":"additional","affiliation":[{"name":"National University of Singapore, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,12,20]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.14778\/2994509.2994518"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-015-0389-y"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3035918.3054772"},{"key":"e_1_2_1_4_1","volume-title":"TabNet: Attentive Interpretable Tabular Learning. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI","author":"Sercan","year":"2021","unstructured":"Sercan \u00d6. Arik and Tomas Pfister. 2021. TabNet: Attentive Interpretable Tabular Learning. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021. AAAI Press, Virtual Event, 6679--6687."},{"key":"e_1_2_1_5_1","first-page":"397","article-title":"Using Confidence Bounds for Exploitation-Exploration Trade-offs","volume":"3","author":"Auer Peter","year":"2002","unstructured":"Peter Auer. 2002. Using Confidence Bounds for Exploitation-Exploration Trade-offs. J. Mach. Learn. Res., Vol. 3 (2002), 397--422.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_1_6_1","volume-title":"Efficient Exploration through Bayesian Deep Q-Networks. CoRR","author":"Azizzadenesheli Kamyar","year":"2018","unstructured":"Kamyar Azizzadenesheli, Emma Brunskill, and Animashree Anandkumar. 2018. Efficient Exploration through Bayesian Deep Q-Networks. CoRR, Vol. abs\/1802.04412 (2018), 40 pages."},{"key":"e_1_2_1_7_1","unstructured":"Microsoft Azure. 2024. Azure Automated Machine Learning - AutoML. Microsoft. https:\/\/azure.microsoft.com\/en-us\/products\/machine-learning\/automatedml\/ Retrieved 2024-03--19 from"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313602"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/3157794.3157800"},{"key":"e_1_2_1_10_1","volume-title":"SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle. In 10th Conference on Innovative Data Systems Research, CIDR","author":"Boehm Matthias","year":"2020","unstructured":"Matthias Boehm, Iulian Antonov, Sebastian Baunsgaard, Mark Dokter, Robert Ginth\u00f6r, Kevin Innerebner, Florijan Klezin, Stefanie N. Lindstaedt, Arnab Phani, Benjamin Rath, Berthold Reinwald, Shafaq Siddiqui, and Sebastian Benjamin Wrede. 2020. SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle. In 10th Conference on Innovative Data Systems Research, CIDR 2020. www.cidrdb.org, Amsterdam, The Netherlands, 8 pages."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588945"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2912574"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.14778\/3430915.3430921"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3542700.3542709"},{"key":"e_1_2_1_15_1","volume-title":"Conformance Constraint Discovery: Measuring Trust in Data-Driven Systems. In SIGMOD '21: International Conference on Management of Data. ACM, Virtual Event, 499--512","author":"Fariha Anna","year":"2021","unstructured":"Anna Fariha, Ashish Tiwari, Arjun Radhakrishna, Sumit Gulwani, and Alexandra Meliou. 2021. Conformance Constraint Discovery: Measuring Trust in Data-Driven Systems. In SIGMOD '21: International Conference on Management of Data. ACM, Virtual Event, 499--512."},{"key":"e_1_2_1_16_1","volume-title":"Efficient and Robust Automated Machine Learning. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems","author":"Feurer Matthias","year":"2015","unstructured":"Matthias Feurer, Aaron Klein, Katharina Eggensperger, Jost Tobias Springenberg, Manuel Blum, and Frank Hutter. 2015. Efficient and Robust Automated Machine Learning. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015. Curran Associates Inc., Montreal, Quebec, Canada, 2962--2970."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3517864"},{"key":"e_1_2_1_18_1","unstructured":"Joseph Giovanelli Besim Bilalli and Alberto Abell\u00f3. 2021. Effective data pre-processing for AutoML. In Proceedings of the 23rd International Workshop on Design Optimization Languages and Analytical Processing of Big Data (DOLAP) co-located with the 24th International Conference on Extending Database Technology and the 24th International Conference on Database Theory (EDBT\/ICDT 2021) (CEUR Workshop Proceedings Vol. 2840). CEUR-WS.org Nicosia Cyprus 1--10."},{"key":"e_1_2_1_19_1","volume-title":"Revisiting Deep Learning Models for Tabular Data. In Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021","author":"Gorishniy Yury","year":"2021","unstructured":"Yury Gorishniy, Ivan Rubachev, Valentin Khrulkov, and Artem Babenko. 2021. Revisiting Deep Learning Models for Tabular Data. In Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021. Curran Associates, virtual, 18932--18943."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.52202\/068431-0037"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403261"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732240.2732248"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.398"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3595360.3595857"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.270"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.14778\/3430915.3430917"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2009.219"},{"key":"e_1_2_1_28_1","volume-title":"BoostClean: Automated Error Detection and Repair for Machine Learning. CoRR","author":"Krishnan Sanjay","year":"2017","unstructured":"Sanjay Krishnan, Michael J. Franklin, Ken Goldberg, and Eugene Wu. 2017. BoostClean: Automated Error Detection and Repair for Machine Learning. CoRR, Vol. abs\/1711.01299 (2017), 15 pages."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.14778\/2994509.2994514"},{"key":"e_1_2_1_30_1","volume-title":"AlphaClean: Automatic Generation of Data Cleaning Pipelines. CoRR","author":"Krishnan Sanjay","year":"1827","unstructured":"Sanjay Krishnan and Eugene Wu. 2019. AlphaClean: Automatic Generation of Data Cleaning Pipelines. CoRR, Vol. abs\/1904.11827 (2019), 15 pages."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the AutoML Workshop at ICML","volume":"2020","author":"LeDell Erin","year":"2020","unstructured":"Erin LeDell and Sebastien Poirier. 2020. H2o automl: Scalable automatic machine learning. In Proceedings of the AutoML Workshop at ICML, Vol. 2020. ICML, PMLR, San Diego, CA, USA, 16 pages."},{"key":"e_1_2_1_32_1","volume-title":"Meihui Zhang, Kaiping Zheng, Gang Chen, Beng Chin Ooi, and James Wei Luen Yip.","author":"Lee Chonho","year":"2017","unstructured":"Chonho Lee, Zhaojing Luo, Kee Yuan Ngiam, Meihui Zhang, Kaiping Zheng, Gang Chen, Beng Chin Ooi, and James Wei Luen Yip. 2017. Big Healthcare Data Analytics: Challenges and Applications. In Handbook of Large-Scale Distributed Computing in Smart Healthcare. Springer, Cham, Switzerland, 11--41."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3589328"},{"key":"e_1_2_1_34_1","volume-title":"CleanML: A Study for Evaluating the Impact of Data Cleaning on ML Classification Tasks. In 37th IEEE International Conference on Data Engineering, ICDE","author":"Li Peng","year":"2021","unstructured":"Peng Li, Xi Rao, Jennifer Blase, Yue Zhang, Xu Chu, and Ce Zhang. 2021. CleanML: A Study for Evaluating the Impact of Data Cleaning on ML Classification Tasks. In 37th IEEE International Conference on Data Engineering, ICDE 2021. IEEE, Chania, Greece, 13--24."},{"key":"e_1_2_1_35_1","volume-title":"Towards General Text Embeddings with Multi-stage Contrastive Learning. CoRR","author":"Li Zehan","year":"2023","unstructured":"Zehan Li, Xin Zhang, Yanzhao Zhang, Dingkun Long, Pengjun Xie, and Meishan Zhang. 2023. Towards General Text Embeddings with Multi-stage Contrastive Learning. CoRR, Vol. abs\/2308.03281 (2023), 18 pages."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.14778\/3401960.3401966"},{"key":"e_1_2_1_37_1","volume-title":"International Conference on Automated Machine Learning (Proceedings of Machine Learning Research","volume":"22","author":"Lopez Roque","year":"2023","unstructured":"Roque Lopez, Raoni Lourencco, R\u00e9mi Rampin, Sonia Castelo, A\u00e9cio S. R. Santos, Jorge Henrique Piazentin Ono, Cl\u00e1udio T. Silva, and Juliana Freire. 2023. AlphaD3M: An Open-Source AutoML Library for Multiple ML Tasks. In International Conference on Automated Machine Learning (Proceedings of Machine Learning Research, Vol. 224). PMLR, Hasso Plattner Institute, Potsdam, Germany, 22\/1--22."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 2020 International Conference on Management of Data, SIGMOD Conference","author":"Lourencco Raoni","year":"2020","unstructured":"Raoni Lourencco, Juliana Freire, and Dennis E. Shasha. 2020. BugDoc: Algorithms to Debug Computational Processes. In Proceedings of the 2020 International Conference on Management of Data, SIGMOD Conference 2020. ACM, Portland, OR, USA, 463--478."},{"key":"e_1_2_1_39_1","volume-title":"MLCask: Efficient Management of Component Evolution in Collaborative Data Analytics Pipelines. In 37th IEEE International Conference on Data Engineering, ICDE","author":"Luo Zhaojing","year":"2021","unstructured":"Zhaojing Luo, Sai Ho Yeung, Meihui Zhang, Kaiping Zheng, Lei Zhu, Gang Chen, Feiyi Fan, Qian Lin, Kee Yuan Ngiam, and Beng Chin Ooi. 2021. MLCask: Efficient Management of Component Evolution in Collaborative Data Analytics Pipelines. In 37th IEEE International Conference on Data Engineering, ICDE 2021. IEEE, Chania, Greece, 1655--1666."},{"key":"e_1_2_1_40_1","volume-title":"Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023","author":"McElfresh Duncan C.","year":"2023","unstructured":"Duncan C. McElfresh, Sujay Khandagale, Jonathan Valverde, Vishak Prasad C., Ganesh Ramakrishnan, Micah Goldblum, and Colin White. 2023. When Do Neural Nets Outperform Boosted Trees on Tabular Data?. In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023. Curran Associates, New Orleans, LA, USA, 34 pages."},{"key":"e_1_2_1_41_1","volume-title":"Riedmiller","author":"Mnih Volodymyr","year":"2013","unstructured":"Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin A. Riedmiller. 2013. Playing Atari with Deep Reinforcement Learning. CoRR, Vol. abs\/1312.5602 (2013), 9 pages."},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 2016 on Genetic and Evolutionary Computation Conference. ACM","author":"Olson Randal S.","unstructured":"Randal S. Olson, Nathan Bartley, Ryan J. Urbanowicz, and Jason H. Moore. 2016. Evaluation of a Tree-based Pipeline Optimization Tool for Automating Data Science. In Proceedings of the 2016 on Genetic and Evolutionary Computation Conference. ACM, Denver, CO, USA, 485--492."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.14778\/2794367.2794377"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.14778\/3377369.3377377"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2019.101483"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3319863"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3653697"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2021.11.011"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3617338"},{"key":"e_1_2_1_50_1","volume-title":"Barto","author":"Sutton Richard S.","year":"2018","unstructured":"Richard S. Sutton and Andrew G. Barto. 2018. Reinforcement learning - an introduction. MIT Press, Massachusetts, USA."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.14778\/2350229.2350241"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.14778\/3457390.3457391"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/25.3-4.285"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487629"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2641190.2641198"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2750549"},{"key":"e_1_2_1_58_1","volume-title":"Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities. In SIGMOD '21: International Conference on Management of Data. ACM","author":"Xin Doris","year":"2021","unstructured":"Doris Xin, Hui Miao, Aditya G. Parameswaran, and Neoklis Polyzotis. 2021. Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities. In SIGMOD '21: International Conference on Management of Data. ACM, Virtual Event, China, 2639--2652."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.745"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.14778\/3485450.3485452"}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3698831","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3698831","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T17:44:53Z","timestamp":1774979093000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3698831"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,18]]},"references-count":60,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,12,18]]}},"alternative-id":["10.1145\/3698831"],"URL":"https:\/\/doi.org\/10.1145\/3698831","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,18]]}}}