{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T12:28:07Z","timestamp":1753360087550},"reference-count":33,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2021,7]]},"abstract":"<jats:p>\n            Teradata Vantage is a platform for integrating a broad range of analytical functions and capabilities with the Teradata's SQL engine. One of the main challenges in optimizing the execution of these analytical functions is that many of them are not only black boxes, but also have polymorphic nature, i.e., their behavior and properties may change depending on the invocation context. In this paper, we first demonstrate the inherent complexity in optimizing polymorphic functions, and then present the Vantage's\n            <jats:italic>Collaborative Optimizer<\/jats:italic>\n            , which is a cross-platform optimizer designed for optimizing the analytical functions invoked from within the SQL engine. The Collaborative Optimizer is the industry-first effort towards enabling analytics-aware optimizations over polymorphic analytical functions. We present a novel markup language-based approach for expressing the functions' polymorphic properties via a set of well-defined instructions. The Collaborative Optimizer uses these instructions at query time to infer the corresponding properties, and then decide on the applicable optimizations. From several possible optimizations, we showcase two core optimizations, namely\n            <jats:italic>\"projection push\"<\/jats:italic>\n            and\n            <jats:italic>\"predicate push\"<\/jats:italic>\n            , which aim at optimizing the data movement to and from the analytical functions. The experiments using the Teradata-MLE analytical system demonstrate the expressiveness power and flexibility of the proposed markup language. Moreover, benchmark and real-world customer queries show the significant performance gain that the Collaborative Optimizer brings to the Vantage system.\n          <\/jats:p>","DOI":"10.14778\/3476311.3476375","type":"journal-article","created":{"date-parts":[[2021,10,28]],"date-time":"2021-10-28T22:48:56Z","timestamp":1635461336000},"page":"2959-2971","source":"Crossref","is-referenced-by-count":3,"title":["Not black-box anymore!"],"prefix":"10.14778","volume":"14","author":[{"given":"Mohamed","family":"Eltabakh","sequence":"first","affiliation":[{"name":"Teradata Labs"}]},{"given":"Anantha","family":"Subramanian","sequence":"additional","affiliation":[{"name":"Teradata Labs"}]},{"given":"Awny","family":"Al-Omari","sequence":"additional","affiliation":[{"name":"Teradata Labs"}]},{"given":"Mohammed","family":"Al-Kateb","sequence":"additional","affiliation":[{"name":"Teradata Labs"}]},{"given":"Sanjay","family":"Nair","sequence":"additional","affiliation":[{"name":"Teradata Labs"}]},{"given":"Mahbub","family":"Hasan","sequence":"additional","affiliation":[{"name":"Teradata Labs"}]},{"given":"Wellington","family":"Cabrera","sequence":"additional","affiliation":[{"name":"Teradata Labs"}]},{"given":"Charles","family":"Zhang","sequence":"additional","affiliation":[{"name":"Teradata Labs"}]},{"given":"Amit","family":"Kishore","sequence":"additional","affiliation":[{"name":"Teradata Labs"}]},{"given":"Snigdha","family":"Prasad","sequence":"additional","affiliation":[{"name":"Teradata Labs"}]}],"member":"320","published-online":{"date-parts":[[2021,10,28]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"B035","article-title":"SQL Data Definition Language","volume":"16","year":"2017","journal-title":"Release"},{"key":"e_1_2_1_2_1","unstructured":"2017. Teradata Aster Analytics Foundation User Guide Release 7.00.0. https:\/\/manualzz.com\/doc\/46991277\/teradata-aster-analytics-\/foundation-user-guide-update-2.  2017. Teradata Aster Analytics Foundation User Guide Release 7.00.0. https:\/\/manualzz.com\/doc\/46991277\/teradata-aster-analytics-\/foundation-user-guide-update-2."},{"key":"e_1_2_1_3_1","unstructured":"Apache Spark. [n.d.]. https:\/\/spark.apache.org.  Apache Spark. [n.d.]. https:\/\/spark.apache.org."},{"key":"e_1_2_1_4_1","unstructured":"Aster Data. [n.d.]. http:\/\/www.asterdata.com ([n. d.]).  Aster Data. [n.d.]. http:\/\/www.asterdata.com ([n. d.])."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687576"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2903741"},{"key":"e_1_2_1_7_1","unstructured":"Database PL\/SQL Language Reference Oracle Database Documentation Release 18 Chapter 12. [n.d.].  Database PL\/SQL Language Reference Oracle Database Documentation Release 18 Chapter 12. [n.d.]."},{"key":"e_1_2_1_8_1","unstructured":"Mohamed Eltabakh Awny AlOmari Sanjay Nair Mohammed Al-Kateb Hasan Mahbub Anantha Subramanian Robert Wehrmeister and Kashif Siddiqui. 2018. Enabling Cross-Platform Query Optimization via Expressive Markup Language 12\/10\/18 No. 62\/777 304. US Provisional Patent.  Mohamed Eltabakh Awny AlOmari Sanjay Nair Mohammed Al-Kateb Hasan Mahbub Anantha Subramanian Robert Wehrmeister and Kashif Siddiqui. 2018. Enabling Cross-Platform Query Optimization via Expressive Markup Language 12\/10\/18 No. 62\/777 304. US Provisional Patent."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687567"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2618243.2618274"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367510"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.14778\/2350229.2350244"},{"key":"e_1_2_1_13_1","unstructured":"Introduction to Greenplum In-Database Analytics. [n.d.]. https:\/\/greenplum.org\/gpdb-sandbox-tutorials\/introduction-greenplum-database-analytics\/.  Introduction to Greenplum In-Database Analytics. [n.d.]. https:\/\/greenplum.org\/gpdb-sandbox-tutorials\/introduction-greenplum-database-analytics\/."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610512"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/2794367.2794375"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.14778\/2735479.2735488"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137765.3137812"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732286.2732292"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299887.3299897"},{"key":"e_1_2_1_20_1","unstructured":"Microsoft Analytics Platform System. [n.d.]. www.microsoft.com\/en-us\/server-cloud\/products\/analytics-platform-system.  Microsoft Analytics Platform System. [n.d.]. www.microsoft.com\/en-us\/server-cloud\/products\/analytics-platform-system."},{"key":"e_1_2_1_21_1","unstructured":"MySQL 5.7 Reference Manual. [n.d.]. https:\/\/dev.mysql.com\/doc\/refman\/5.7\/en\/optimizer-hints.html.  MySQL 5.7 Reference Manual. [n.d.]. https:\/\/dev.mysql.com\/doc\/refman\/5.7\/en\/optimizer-hints.html."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/2011911"},{"key":"e_1_2_1_23_1","unstructured":"Oracle Analytics Cloud. [n.d.]. https:\/\/www.oracle.com\/solutions\/business-analytics\/analytics-cloud.html.  Oracle Analytics Cloud. [n.d.]. https:\/\/www.oracle.com\/solutions\/business-analytics\/analytics-cloud.html."},{"key":"e_1_2_1_24_1","volume-title":"2015 IEEE 31st International Conference on Data Engineering. 1304--1315","author":"Pandit A."},{"key":"e_1_2_1_25_1","unstructured":"Linnea Passing Manuel Then Nina Hubig Harald Lang Michael Schreier Stephan G\u00fcnnemann Alfons Kemper and Thomas Neumann. 2017. SQL- and Operator-centric Data Analytics in Relational Main-Memory Databases. In EDBT.  Linnea Passing Manuel Then Nina Hubig Harald Lang Michael Schreier Stephan G\u00fcnnemann Alfons Kemper and Thomas Neumann. 2017. SQL- and Operator-centric Data Analytics in Relational Main-Memory Databases. In EDBT ."},{"key":"e_1_2_1_26_1","volume-title":"Teradata Aster Discovery Portfolio","author":"Raghavan Srl"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3186728.3164140"},{"key":"e_1_2_1_28_1","unstructured":"SAP IQ Administration: User-Defined Functions 16.1 SP04 PL02-PL06 Polymorphic Table Functions (PTFs). [n.d.].  SAP IQ Administration: User-Defined Functions 16.1 SP04 PL02-PL06 Polymorphic Table Functions (PTFs). [n.d.]."},{"key":"e_1_2_1_29_1","unstructured":"SQL Plan Directives in Oracle Database 12c Release 1 (12.1). [n.d.]. https:\/\/oracle-base.com\/articles\/12c\/sql-plan-directives-12cr1.  SQL Plan Directives in Oracle Database 12c Release 1 (12.1). [n.d.]. https:\/\/oracle-base.com\/articles\/12c\/sql-plan-directives-12cr1."},{"key":"e_1_2_1_30_1","volume-title":"32nd IEEE International Conference on Data Engineering, ICDE","author":"Tang Xin","year":"2016"},{"key":"e_1_2_1_31_1","unstructured":"TensorFlow. [n.d.]. https:\/\/www.tensorflow.org.  TensorFlow. [n.d.]. https:\/\/www.tensorflow.org."},{"key":"e_1_2_1_32_1","unstructured":"The Apache Software Foundation. [n.d.]. Hadoop. http:\/\/hadoop.apache.org.  The Apache Software Foundation. [n.d.]. Hadoop. http:\/\/hadoop.apache.org."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-012-0280-z"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3476311.3476375","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T11:35:41Z","timestamp":1672227341000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3476311.3476375"}},"subtitle":["enabling analytics-aware optimizations in teradata vantage"],"short-title":[],"issued":{"date-parts":[[2021,7]]},"references-count":33,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2021,7]]}},"alternative-id":["10.14778\/3476311.3476375"],"URL":"https:\/\/doi.org\/10.14778\/3476311.3476375","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2021,7]]}}}