{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T16:28:06Z","timestamp":1778603286047,"version":"3.51.4"},"reference-count":22,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2005,9,1]],"date-time":"2005-09-01T00:00:00Z","timestamp":1125532800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMOD Rec."],"published-print":{"date-parts":[[2005,9]]},"abstract":"<jats:p>We describe an approach for pipelining nested data collections in scientific workflows. Our approach logically delimits arbitrarily nested collections of data tokens using special, paired control tokens inserted into token streams, and provides workflow components with high-level operations for managing these collections. Our framework provides new capabilities for: (1) concurrent operation on collections; (2) on-the-fly customization of workflow component behavior; (3) improved handling of exceptions and faults; and (4) transparent passing of provenance and metadata within token streams. We demonstrate our approach using a workflow for inferring phylogenetic trees. We also describe future extensions to support richer typing mechanisms for facilitating sharing and reuse of workflow components between disciplines. This work represents a step towards our larger goal of exploiting collection-oriented dataflow programming as a new paradigm for scientific workflow systems, an approach we believe will significantly reduce the complexity of creating and reusing workflows and workflow components.<\/jats:p>","DOI":"10.1145\/1084805.1084809","type":"journal-article","created":{"date-parts":[[2005,11,9]],"date-time":"2005-11-09T22:23:27Z","timestamp":1131575007000},"page":"12-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":33,"title":["An approach for pipelining nested collections in scientific workflows"],"prefix":"10.1145","volume":"34","author":[{"given":"Timothy M.","family":"McPhillips","sequence":"first","affiliation":[{"name":"Natural Diversity Discovery Project"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shawn","family":"Bowers","sequence":"additional","affiliation":[{"name":"UC Davis Genome Center"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2005,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/646497.695618"},{"key":"e_1_2_1_2_1","volume-title":"SSDBM.","author":"Berkley C.","year":"2005"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/11568322_24"},{"key":"e_1_2_1_4_1","volume-title":"Conf. on Innovative Data Systems Research (CIDR)","author":"Bright L.","year":"2005"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/0304-3975(95)00024-Q"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/1148437.1148455"},{"key":"e_1_2_1_7_1","unstructured":"The office of science data-management challenge. Report from the DOE Office of Science Data-Management Workshops March-May 2004.  The office of science data-management challenge. Report from the DOE Office of Science Data-Management Workshops March-May 2004."},{"key":"e_1_2_1_8_1","unstructured":"J. Felsenstein. Inferring Phylogenies. Sinauer Associates Inc. 2004.  J. Felsenstein. Inferring Phylogenies. Sinauer Associates Inc. 2004."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/776985.776986"},{"key":"e_1_2_1_10_1","unstructured":"P. Gordon. XML for molecular biology. http:\/\/www.visualgenomics.ca\/gordonp\/xml\/.  P. Gordon. XML for molecular biology. http:\/\/www.visualgenomics.ca\/gordonp\/xml\/."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0956796802004410"},{"key":"e_1_2_1_12_1","unstructured":"The Kepler Project. http:\/\/www.kepler-project.org.  The Kepler Project. http:\/\/www.kepler-project.org."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1137958.1137961"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.381846"},{"key":"e_1_2_1_15_1","unstructured":"B. Lud\u00e4scher and I. Altintas. On providing declarative design and programming constructs for scientific workflows based on process networks. Technical report SciDAC-SPA-TN-2003-01 2003.  B. Lud\u00e4scher and I. Altintas. On providing declarative design and programming constructs for scientific workflows based on process networks. Technical report SciDAC-SPA-TN-2003-01 2003."},{"key":"e_1_2_1_16_1","volume-title":"Special Issue on Scientific Workflows","author":"Lud\u00e4scher B.","year":"2005"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"D. Maddison D. Swofford and W. Maddison. NEXUS: An extensible file format for systematic information. Systematic Biology 46(4) 1997.  D. Maddison D. Swofford and W. Maddison. NEXUS: An extensible file format for systematic information. Systematic Biology 46(4) 1997.","DOI":"10.1093\/sysbio\/46.4.590"},{"key":"e_1_2_1_18_1","unstructured":"J. Morrison. Flow-Based Programming. Van Nostrand Reinhold 1994.  J. Morrison. Flow-Based Programming. Van Nostrand Reinhold 1994."},{"key":"e_1_2_1_19_1","unstructured":"Natural Diversity Discovery Project. http:\/\/www.nddp.org.  Natural Diversity Discovery Project. http:\/\/www.nddp.org."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bth361"},{"key":"e_1_2_1_21_1","unstructured":"SciTegic. http:\/\/www.scitegic.com\/.  SciTegic. http:\/\/www.scitegic.com\/."},{"key":"e_1_2_1_22_1","volume-title":"Elsevier","author":"Weinstein D.","year":"2005"}],"container-title":["ACM SIGMOD Record"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1084805.1084809","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1084805.1084809","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:08:24Z","timestamp":1750262904000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1084805.1084809"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,9]]},"references-count":22,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2005,9]]}},"alternative-id":["10.1145\/1084805.1084809"],"URL":"https:\/\/doi.org\/10.1145\/1084805.1084809","relation":{},"ISSN":["0163-5808"],"issn-type":[{"value":"0163-5808","type":"print"}],"subject":[],"published":{"date-parts":[[2005,9]]},"assertion":[{"value":"2005-09-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}