{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T17:46:38Z","timestamp":1776879998855,"version":"3.51.2"},"reference-count":29,"publisher":"Association for Computing Machinery (ACM)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2011,12]]},"abstract":"<jats:p>\n            Workflow provenance typically assumes that each module is a \"black-box\", so that each output depends on all inputs (\n            <jats:italic>coarse-grained<\/jats:italic>\n            dependencies). Furthermore, it does not model the\n            <jats:italic>internal state<\/jats:italic>\n            of a module, which can change between repeated executions. In practice, however, an output may depend on only a small subset of the inputs (\n            <jats:italic>fine-grained<\/jats:italic>\n            dependencies) as well as on the internal state of the module. We present a novel provenance framework that marries database-style and workflow-style provenance, by using Pig Latin to expose the functionality of modules, thus capturing internal state and fine-grained dependencies. A critical ingredient in our solution is the use of a novel form of\n            <jats:italic>provenance graph<\/jats:italic>\n            that models module invocations and yields a compact representation of fine-grained workflow provenance. It also enables a number of novel graph transformation operations, allowing to choose the desired level of granularity in provenance querying (ZoomIn and ZoomOut), and supporting \"what-if\" workflow analytic queries. We implemented our approach in the\n            <jats:italic>Lipstick<\/jats:italic>\n            system and developed a benchmark in support of a systematic performance evaluation. Our results demonstrate the feasibility of tracking and querying fine-grained workflow provenance.\n          <\/jats:p>","DOI":"10.14778\/2095686.2095693","type":"journal-article","created":{"date-parts":[[2014,6,24]],"date-time":"2014-06-24T12:17:57Z","timestamp":1403612277000},"page":"346-357","source":"Crossref","is-referenced-by-count":86,"title":["Putting lipstick on pig"],"prefix":"10.14778","volume":"5","author":[{"given":"Yael","family":"Amsterdamer","sequence":"first","affiliation":[{"name":"Tel Aviv University, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Susan B.","family":"Davidson","sequence":"additional","affiliation":[{"name":"University of Pennsylvania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Deutch","sequence":"additional","affiliation":[{"name":"Ben Gurion University, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tova","family":"Milo","sequence":"additional","affiliation":[{"name":"Tel Aviv University, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julia","family":"Stoyanovich","sequence":"additional","affiliation":[{"name":"University of Pennsylvania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Val","family":"Tannen","sequence":"additional","affiliation":[{"name":"University of Pennsylvania"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2011,12]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"TaPP","author":"Acar U.","year":"2010","unstructured":"U. Acar A graph model of data and workflow provenance . In TaPP , 2010 . U. Acar et al. A graph model of data and workflow provenance. In TaPP, 2010."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989284.1989302"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-007-0080-z"},{"key":"e_1_2_1_4_1","volume-title":"VLDB","author":"Biton O.","year":"2007","unstructured":"O. Biton , S. C. Boulakia , and S. B. Davidson . Zoom*UserViews: Querying relevant provenance in workflow systems . In VLDB , 2007 . O. Biton, S. C. Boulakia, and S. B. Davidson. Zoom*UserViews: Querying relevant provenance in workflow systems. In VLDB, 2007."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.v20:5"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1412331.1412340"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/0304-3975(95)00024-Q"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/645504.656274"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1561\/1900000006"},{"key":"e_1_2_1_10_1","volume-title":"Provenance in scientific workflow systems","author":"Davidson S. B.","year":"2007","unstructured":"S. B. Davidson Provenance in scientific workflow systems . IEEE Data Eng. Bull ., 30(4), 2007 . S. B. Davidson et al. Provenance in scientific workflow systems. IEEE Data Eng. Bull., 30(4), 2007."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376772"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcss.2006.10.006"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/SSDM.2002.1029704"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376916.1376954"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1514894.1514930"},{"key":"e_1_2_1_16_1","volume-title":"VLDB","author":"Green T. J.","year":"2007","unstructured":"T. J. Green Update exchange with mappings and provenance . In VLDB , 2007 . T. J. Green et al. Update exchange with mappings and provenance. In VLDB, 2007."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1265530.1265535"},{"key":"e_1_2_1_18_1","first-page":"34","author":"Hull D.","year":"2006","unstructured":"D. Hull A tool for building and running workflows of services. Nucleic Acids Res. , 34 , 2006 . D. Hull et al. Taverna: A tool for building and running workflows of services. Nucleic Acids Res., 34, 2006.","journal-title":"Nucleic Acids Res."},{"key":"e_1_2_1_19_1","volume-title":"CIDR","author":"Ikeda R.","year":"2011","unstructured":"R. Ikeda , H. Park , and J. Widom . Provenance for generalized Map and Reduce workflows . In CIDR , 2011 . R. Ikeda, H. Park, and J. Widom. Provenance for generalized Map and Reduce workflows. In CIDR, 2011."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807269"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89965-5_3"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1739041.1739079"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89965-5_31"},{"key":"e_1_2_1_24_1","volume-title":"USENIX","author":"K.","year":"2009","unstructured":"K. Muniswamy-Reddy et al. Layering in provenance systems . In USENIX , 2009 . K. Muniswamy-Reddy et al. Layering in provenance systems. In USENIX, 2009."},{"key":"e_1_2_1_25_1","volume-title":"CIDR","author":"Olston C.","year":"2011","unstructured":"C. Olston and A. Das Sarma . Ibis: A provenance manager for multi-layer systems . In CIDR , 2011 . C. Olston and A. Das Sarma. Ibis: A provenance manager for multi-layer systems. In CIDR, 2011."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376726"},{"key":"e_1_2_1_27_1","volume-title":"Meteorological data from the Russian Arctic","author":"Radionov V.","year":"1961","unstructured":"V. Radionov and F. Fetterer , editors . Meteorological data from the Russian Arctic , 1961 --2000. National Snow and Ice Data Center , 2003. V. Radionov and F. Fetterer, editors. Meteorological data from the Russian Arctic, 1961--2000. National Snow and Ice Data Center, 2003."},{"issue":"2","key":"e_1_2_1_28_1","volume":"5","author":"Simhan Y. L.","year":"2008","unstructured":"Y. L. Simhan , B. Plale , and D. Gammon . Karma2: Provenance management for data-driven workflows. Int. J. Web Service Res. , 5 ( 2 ), 2008 . Y. L. Simhan, B. Plale, and D. Gammon. Karma2: Provenance management for data-driven workflows. Int. J. Web Service Res., 5(2), 2008.","journal-title":"Karma2: Provenance management for data-driven workflows. Int. J. Web Service Res."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcss.2009.11.009"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2095686.2095693","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T09:46:38Z","timestamp":1672220798000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2095686.2095693"}},"subtitle":["enabling database-style workflow provenance"],"short-title":[],"issued":{"date-parts":[[2011,12]]},"references-count":29,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2011,12]]}},"alternative-id":["10.14778\/2095686.2095693"],"URL":"https:\/\/doi.org\/10.14778\/2095686.2095693","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2011,12]]}}}