{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T09:19:29Z","timestamp":1773825569173,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":38,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,1,4]],"date-time":"2020-01-04T00:00:00Z","timestamp":1578096000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,1,4]]},"DOI":"10.1145\/3369740.3372778","type":"proceedings-article","created":{"date-parts":[[2020,2,19]],"date-time":"2020-02-19T19:24:25Z","timestamp":1582140265000},"page":"1-6","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Role of Machine Learning in ETL Automation"],"prefix":"10.1145","author":[{"given":"Kartick Chandra","family":"Mondal","sequence":"first","affiliation":[{"name":"Jadavpur University, Department of Information Technology, Kolkata, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Neepa","family":"Biswas","sequence":"additional","affiliation":[{"name":"Jadavpur University, Department of Information Technology, Kolkata, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Swati","family":"Saha","sequence":"additional","affiliation":[{"name":"Tata Consultancy Services Limited, Kolkata, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,2,19]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"(accessed August 25 2019). What is Database Release Automation? https:\/\/www.datical.com\/database-automation\/what-is-database-release-automation\/.  (accessed August 25 2019). What is Database Release Automation? https:\/\/www.datical.com\/database-automation\/what-is-database-release-automation\/."},{"key":"e_1_3_2_1_2_1","unstructured":"(accessed August 26 2019). Data Quality in Data Warehouses. https:\/\/www.theseus.fi\/bitstream\/handle\/10024\/146311\/Aunola_Jere.pdf?sequence=2&isAllowed=y.  (accessed August 26 2019). Data Quality in Data Warehouses. https:\/\/www.theseus.fi\/bitstream\/handle\/10024\/146311\/Aunola_Jere.pdf?sequence=2&isAllowed=y."},{"key":"e_1_3_2_1_3_1","unstructured":"(accessed August 26 2019). Informatica\u00c2\u0151 PowerCenter Data Validation Option (Version 10.0). https:\/\/kb.informatica.com\/proddocs\/Product.  (accessed August 26 2019). Informatica\u00c2\u0151 PowerCenter Data Validation Option (Version 10.0). https:\/\/kb.informatica.com\/proddocs\/Product."},{"key":"e_1_3_2_1_4_1","unstructured":"(accessed August 26 2019). What is DevOps? https:\/\/docs.microsoft.com\/en-us\/azure\/devops\/learn\/what-is-devops.  (accessed August 26 2019). What is DevOps? https:\/\/docs.microsoft.com\/en-us\/azure\/devops\/learn\/what-is-devops."},{"key":"e_1_3_2_1_5_1","unstructured":"(accessed August 27 2019). Continuous Integration-Delivery-Deployment in Next Generation Data Integration. https:\/\/kb.informatica.com\/whitepapers\/4\/Documents.  (accessed August 27 2019). Continuous Integration-Delivery-Deployment in Next Generation Data Integration. https:\/\/kb.informatica.com\/whitepapers\/4\/Documents."},{"key":"e_1_3_2_1_6_1","unstructured":"(accessed August 27 2019). Liquibase by Datical. https:\/\/www.liquibase.org\/.  (accessed August 27 2019). Liquibase by Datical. https:\/\/www.liquibase.org\/."},{"key":"e_1_3_2_1_7_1","unstructured":"Last accessed on September 07 2019. Benefits of Automating Data Warehousing. http:\/\/hosteddocs.ittoolbox.com\/aa_data_warehouse_wp_us.pdf.  Last accessed on September 07 2019. Benefits of Automating Data Warehousing. http:\/\/hosteddocs.ittoolbox.com\/aa_data_warehouse_wp_us.pdf."},{"key":"e_1_3_2_1_8_1","volume-title":"Data classification: algorithms and applications","author":"Aggarwal C. C.","unstructured":"C. C. Aggarwal . 2014. Data classification: algorithms and applications . CRC press . C. C. Aggarwal. 2014. Data classification: algorithms and applications. CRC press."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Z. El Akkaoui E. Zim\u00e1nyi J. N. Maz\u00f3n L\u00f3pez J. C. Trujillo Mond\u00e9jar etal 2013. A BPMN-based design and maintenance framework for ETL processes. (2013).  Z. El Akkaoui E. Zim\u00e1nyi J. N. Maz\u00f3n L\u00f3pez J. C. Trujillo Mond\u00e9jar et al. 2013. A BPMN-based design and maintenance framework for ETL processes. (2013).","DOI":"10.4018\/jdwm.2013070103"},{"key":"e_1_3_2_1_10_1","first-page":"36","article-title":"Change Data Capture Efficient ETL for Real-Time BI","volume":"15","author":"Ankorion I.","year":"2005","unstructured":"I. Ankorion . 2005 . Change Data Capture Efficient ETL for Real-Time BI . Information Management 15 , 1 (2005), 36 . I. Ankorion. 2005. Change Data Capture Efficient ETL for Real-Time BI. Information Management 15, 1 (2005), 36.","journal-title":"Information Management"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/291469.291471"},{"key":"e_1_3_2_1_12_1","volume-title":"Communications in Computer and Information Science. International Conference on COMPUTATIONAL INTELLIGENCE, COMMUNICATIONS, AND BUSINESS ANALYTICS","author":"Biswas N.","unstructured":"N. Biswas , S. Chattapadhyay , G. Mahapatra , S. Chatterjee , and K. C. Mondal . 2017. SysML based Conceptual ETL Process Modeling .. In Communications in Computer and Information Science. International Conference on COMPUTATIONAL INTELLIGENCE, COMMUNICATIONS, AND BUSINESS ANALYTICS , Springer, Singapore, 242--255. N. Biswas, S. Chattapadhyay, G. Mahapatra, S. Chatterjee, and K. C. Mondal. 2017. SysML based Conceptual ETL Process Modeling.. In Communications in Computer and Information Science. International Conference on COMPUTATIONAL INTELLIGENCE, COMMUNICATIONS, AND BUSINESS ANALYTICS, Springer, Singapore, 242--255."},{"key":"e_1_3_2_1_13_1","first-page":"30","article-title":"A New Approach for Conceptual ETL Process Modeling. International Journal of Ambient Computing and Intelligence (IJACI)","volume":"10","author":"Biswas N.","year":"2019","unstructured":"N. Biswas , S. Chattapadhyay , G. Mahapatra , S. Chatterjee , and K. C. Mondal . 2019 . A New Approach for Conceptual ETL Process Modeling. International Journal of Ambient Computing and Intelligence (IJACI) , IGI Global 10 , 1 (2019), 30 -- 45 . N. Biswas, S. Chattapadhyay, G. Mahapatra, S. Chatterjee, and K. C. Mondal. 2019. A New Approach for Conceptual ETL Process Modeling. International Journal of Ambient Computing and Intelligence (IJACI), IGI Global 10, 1 (2019), 30--45.","journal-title":"IGI Global"},{"key":"e_1_3_2_1_14_1","volume-title":"Empirical Analysis of Programmable ETL Tools. In Communications in Computer and Information Science. International Conference on COMPUTATIONAL INTELLIGENCE, COMMUNICATIONS, AND BUSINESS ANALYTICS","author":"Biswas N.","unstructured":"N. Biswas , A. Sarkar , and K. C. Mondal . 2018 . Empirical Analysis of Programmable ETL Tools. In Communications in Computer and Information Science. International Conference on COMPUTATIONAL INTELLIGENCE, COMMUNICATIONS, AND BUSINESS ANALYTICS , Springer, Singapore, 267--277. N. Biswas, A. Sarkar, and K. C. Mondal. 2018. Empirical Analysis of Programmable ETL Tools. In Communications in Computer and Information Science. International Conference on COMPUTATIONAL INTELLIGENCE, COMMUNICATIONS, AND BUSINESS ANALYTICS, Springer, Singapore, 267--277."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"N. Biswas A. Sarkar and K. C. Mondal. 2019. Efficient incremental loading in ETL processing for real-time data integration. Innovations in Systems and Software Engineering (2019) 1--9.  N. Biswas A. Sarkar and K. C. Mondal. 2019. Efficient incremental loading in ETL processing for real-time data integration. Innovations in Systems and Software Engineering (2019) 1--9.","DOI":"10.1007\/s11334-019-00344-4"},{"key":"e_1_3_2_1_16_1","volume-title":"Framework Of Change Data Capture And Real Time Data Warehouse. In International Journal of Engineering Research and Technology","volume":"2","author":"Bokade M. B.","unstructured":"M. B. Bokade , S. S. Dhande , and H. R. Vyavahare . 2013 . Framework Of Change Data Capture And Real Time Data Warehouse. In International Journal of Engineering Research and Technology , Vol. 2 . ESRSA Publications. M. B. Bokade, S. S. Dhande, and H. R. Vyavahare. 2013. Framework Of Change Data Capture And Real Time Data Warehouse. In International Journal of Engineering Research and Technology, Vol. 2. ESRSA Publications."},{"key":"e_1_3_2_1_17_1","volume-title":"Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology. ACM, 612--623","author":"Castellanos M.","unstructured":"M. Castellanos , A. Simitsis , K. Wilkinson , and U. Dayal . 2009. Automating the loading of business process data warehouses . In Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology. ACM, 612--623 . M. Castellanos, A. Simitsis, K. Wilkinson, and U. Dayal. 2009. Automating the loading of business process data warehouses. In Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology. ACM, 612--623."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-023X(99)00027-0"},{"key":"e_1_3_2_1_19_1","volume-title":"International Conference on Software Maintenance, 2003. ICSM 2003. Proceedings. IEEE, 23--32","author":"Fischer M.","unstructured":"M. Fischer , M. Pinzger , and H. Gall . 2003. Populating a release history database from version control and bug tracking systems . In International Conference on Software Maintenance, 2003. ICSM 2003. Proceedings. IEEE, 23--32 . M. Fischer, M. Pinzger, and H. Gall. 2003. Populating a release history database from version control and bug tracking systems. In International Conference on Software Maintenance, 2003. ICSM 2003. Proceedings. IEEE, 23--32."},{"key":"e_1_3_2_1_20_1","unstructured":"Keen Hahn. 2019. Industry Case Study: Modernizing the Data Warehouse for Finance IT.  Keen Hahn. 2019. Industry Case Study: Modernizing the Data Warehouse for Finance IT."},{"key":"e_1_3_2_1_21_1","unstructured":"W. Inmon. 2005. Building the data warehouse. John wiley & sons.  W. Inmon. 2005. Building the data warehouse. John wiley & sons."},{"key":"e_1_3_2_1_22_1","first-page":"111","article-title":"Data preprocessing for supervised leaning","volume":"1","author":"Kotsiantis SB","year":"2006","unstructured":"SB Kotsiantis , D. Kanellopoulos , and PE Pintelas . 2006 . Data preprocessing for supervised leaning . International Journal of Computer Science 1 , 2 (2006), 111 -- 117 . SB Kotsiantis, D. Kanellopoulos, and PE Pintelas. 2006. Data preprocessing for supervised leaning. International Journal of Computer Science 1, 2 (2006), 111--117.","journal-title":"International Journal of Computer Science"},{"key":"e_1_3_2_1_23_1","unstructured":"S. B. Kotsiantis I. Zaharakis and P. Pintelas. 2007. Supervised machine learning: A review of classification techniques. Emerging artificial intelligence applications in computer engineering 160 (2007) 3--24.  S. B. Kotsiantis I. Zaharakis and P. Pintelas. 2007. Supervised machine learning: A review of classification techniques. Emerging artificial intelligence applications in computer engineering 160 (2007) 3--24."},{"key":"e_1_3_2_1_24_1","volume-title":"Proceedings of the ACM twelfth international workshop on Data warehousing and OLAP. ACM, 33--40","author":"Mu\u00f1oz L.","unstructured":"L. Mu\u00f1oz , J. N. Maz\u00f3n , and J. Trujillo . 2009. Automatic generation of ETL processes from conceptual models . In Proceedings of the ACM twelfth international workshop on Data warehousing and OLAP. ACM, 33--40 . L. Mu\u00f1oz, J. N. Maz\u00f3n, and J. Trujillo. 2009. Automatic generation of ETL processes from conceptual models. In Proceedings of the ACM twelfth international workshop on Data warehousing and OLAP. ACM, 33--40."},{"key":"e_1_3_2_1_25_1","volume-title":"12th Enterprise Distributed Object Computing Conference Workshops. IEEE, 401--404","author":"Naeem M. A.","unstructured":"M. A. Naeem , G. Dobbie , and G. Webber . 2008. An event-based near real-time data integration architecture . In 12th Enterprise Distributed Object Computing Conference Workshops. IEEE, 401--404 . M. A. Naeem, G. Dobbie, and G. Webber. 2008. An event-based near real-time data integration architecture. In 12th Enterprise Distributed Object Computing Conference Workshops. IEEE, 401--404."},{"key":"e_1_3_2_1_26_1","volume-title":"IEEE 23rd International Conference on Data Engineering (ICDE'07)","author":"Polyzotis N.","unstructured":"N. Polyzotis , S. Skiadopoulos , P. Vassiliadis , A. Simitsis , and N. Frantzell . 2007. Supporting streaming updates in an active data warehouse . In IEEE 23rd International Conference on Data Engineering (ICDE'07) . IEEE, 476--485. N. Polyzotis, S. Skiadopoulos, P. Vassiliadis, A. Simitsis, and N. Frantzell. 2007. Supporting streaming updates in an active data warehouse. In IEEE 23rd International Conference on Data Engineering (ICDE'07). IEEE, 476--485."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"W. Qu V. Basavaraj S. Shankar and S. Dessloch. 2015. Real-Time Snapshot Maintenance with Incremental ETL Pipelines in Data Warehouses. In Big Data Analytics and Knowledge Discovery. Springer 217--228.  W. Qu V. Basavaraj S. Shankar and S. Dessloch. 2015. Real-Time Snapshot Maintenance with Incremental ETL Pipelines in Data Warehouses. In Big Data Analytics and Knowledge Discovery. Springer 217--228.","DOI":"10.1007\/978-3-319-22729-0_17"},{"key":"e_1_3_2_1_28_1","volume-title":"Nirma University International Conference on Engineering (NUiCONE). IEEE, 1--4.","author":"Radhakrishna V.","unstructured":"V. Radhakrishna and K. SravanKiran , V. and Ravikiran. 2012. Automating ETL process with scripting technology . In Nirma University International Conference on Engineering (NUiCONE). IEEE, 1--4. V. Radhakrishna and K. SravanKiran, V.and Ravikiran. 2012. Automating ETL process with scripting technology. In Nirma University International Conference on Engineering (NUiCONE). IEEE, 1--4."},{"key":"e_1_3_2_1_29_1","volume-title":"Machine learning in automated text categorization. ACM computing surveys (CSUR) 34, 1","author":"Sebastiani F.","year":"2002","unstructured":"F. Sebastiani . 2002. Machine learning in automated text categorization. ACM computing surveys (CSUR) 34, 1 ( 2002 ), 1--47. F. Sebastiani. 2002. Machine learning in automated text categorization. ACM computing surveys (CSUR) 34, 1 (2002), 1--47."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1183512.1183526"},{"key":"e_1_3_2_1_31_1","first-page":"208","article-title":"Method and architecture for automated optimization of ETL throughput in data warehousing applications","volume":"6","author":"Suresh S.","year":"2001","unstructured":"S. Suresh , J. P. Gautam , G. Pancha , Frank J. DeRose , and M. Sankaran . 2001 . Method and architecture for automated optimization of ETL throughput in data warehousing applications . US Patent 6 , 208 ,990. S. Suresh, J. P. Gautam, G. Pancha, Frank J. DeRose, and M. Sankaran. 2001. Method and architecture for automated optimization of ETL throughput in data warehousing applications. US Patent 6,208,990.","journal-title":"US Patent"},{"key":"e_1_3_2_1_32_1","volume-title":"5th International Conference on Information Integrationand Web-based Applications Services. 55--64","author":"Tho M. N.","unstructured":"M. N. Tho and A. M. Tjoa . 2003. Zero-latency data warehousing for heterogeneous data sources and continuous data streams . In 5th International Conference on Information Integrationand Web-based Applications Services. 55--64 . M. N. Tho and A. M. Tjoa. 2003. Zero-latency data warehousing for heterogeneous data sources and continuous data streams. In 5th International Conference on Information Integrationand Web-based Applications Services. 55--64."},{"key":"e_1_3_2_1_33_1","volume-title":"Proceedings of the ACM tenth international workshop on Data warehousing and OLAP. ACM, 49--56","author":"Tziovara V.","unstructured":"V. Tziovara , P. Vassiliadis , and A. Simitsis . 2007. Deciding the physical implementation of ETL workflows . In Proceedings of the ACM tenth international workshop on Data warehousing and OLAP. ACM, 49--56 . V. Tziovara, P. Vassiliadis, and A. Simitsis. 2007. Deciding the physical implementation of ETL workflows. In Proceedings of the ACM tenth international workshop on Data warehousing and OLAP. ACM, 49--56."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.4018\/jdwm.2009070101"},{"key":"e_1_3_2_1_35_1","first-page":"978","article-title":"Near Real Time ETL","volume":"3","author":"Vassiliadis P.","year":"2008","unstructured":"P. Vassiliadis and A. Simitsis . 2008 . Near Real Time ETL . Springer Annals of Information Systems 3 , 978 - 970 -387-87430-2 (2008). Special issue on New Trends in Data Warehousing and Data Analysis. P. Vassiliadis and A. Simitsis. 2008. Near Real Time ETL. Springer Annals of Information Systems 3, 978-0-387-87430-2 (2008). Special issue on New Trends in Data Warehousing and Data Analysis.","journal-title":"Springer Annals of Information Systems"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"P. Vassiliadis and A. Simitsis. 2009. Extraction transformation and loading. In Encyclopedia of Database Systems. Springer 1095--1101.  P. Vassiliadis and A. Simitsis. 2009. Extraction transformation and loading. In Encyclopedia of Database Systems. Springer 1095--1101.","DOI":"10.1007\/978-0-387-39940-9_158"},{"key":"e_1_3_2_1_37_1","volume-title":"On the Logical Modeling of ETL Processes. Proc. International Conference on Advanced Information Systems Engineering","author":"Vassiliadis P.","year":"2002","unstructured":"P. Vassiliadis , A. Simitsis , and S. Skiadopoulos . 2002 . On the Logical Modeling of ETL Processes. Proc. International Conference on Advanced Information Systems Engineering ( 2002 ), 782--786. P. Vassiliadis, A. Simitsis, and S. Skiadopoulos. 2002. On the Logical Modeling of ETL Processes. Proc. International Conference on Advanced Information Systems Engineering (2002), 782--786."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"crossref","unstructured":"H. Zhou D. Yang and Y. Xu. 2011. An ETL strategy for real-time data warehouse. In Practical applications of intelligent systems. Springer 329--336.  H. Zhou D. Yang and Y. Xu. 2011. An ETL strategy for real-time data warehouse. In Practical applications of intelligent systems. Springer 329--336.","DOI":"10.1007\/978-3-642-25658-5_41"}],"event":{"name":"ICDCN 2020: 21st International Conference on Distributed Computing and Networking","location":"Kolkata India","acronym":"ICDCN 2020","sponsor":["ACM Association for Computing Machinery","Jadavpur University Jadavpur University"]},"container-title":["Proceedings of the 21st International Conference on Distributed Computing and Networking"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3369740.3372778","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3369740.3372778","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:08Z","timestamp":1750200068000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3369740.3372778"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,4]]},"references-count":38,"alternative-id":["10.1145\/3369740.3372778","10.1145\/3369740"],"URL":"https:\/\/doi.org\/10.1145\/3369740.3372778","relation":{},"subject":[],"published":{"date-parts":[[2020,1,4]]},"assertion":[{"value":"2020-02-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}