{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T08:55:39Z","timestamp":1775638539144,"version":"3.50.1"},"reference-count":103,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2017,4,26]],"date-time":"2017-04-26T00:00:00Z","timestamp":1493164800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy","doi-asserted-by":"publisher","award":["DE-AC02-06CH11357"],"award-info":[{"award-number":["DE-AC02-06CH11357"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy","doi-asserted-by":"publisher","award":["DE-AC04-94AL85000"],"award-info":[{"award-number":["DE-AC04-94AL85000"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2018,1]]},"abstract":"<jats:p> Today\u2019s computational, experimental, and observational sciences rely on computations that involve many related tasks. The success of a scientific mission often hinges on the computer automation of these workflows. In April 2015, the US Department of Energy (DOE) invited a diverse group of domain and computer scientists from national laboratories supported by the Office of Science, the National Nuclear Security Administration, from industry, and from academia to review the workflow requirements of DOE\u2019s science and national security missions, to assess the current state of the art in science workflows, to understand the impact of emerging extreme-scale computing systems on those workflows, and to develop requirements for automated workflow management in future and existing environments. This article is a summary of the opinions of over 50 leading researchers attending this workshop. We highlight use cases, computing systems, workflow needs and conclude by summarizing the remaining challenges this community sees that inhibit large-scale scientific workflows from becoming a mainstream tool for extreme-scale science. <\/jats:p>","DOI":"10.1177\/1094342017704893","type":"journal-article","created":{"date-parts":[[2017,4,26]],"date-time":"2017-04-26T11:25:33Z","timestamp":1493205933000},"page":"159-175","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":138,"title":["The future of scientific workflows"],"prefix":"10.1177","volume":"32","author":[{"given":"Ewa","family":"Deelman","sequence":"first","affiliation":[{"name":"University of Southern California, Information Sciences Institute, Marina del Rey, CA, USA"}]},{"given":"Tom","family":"Peterka","sequence":"additional","affiliation":[{"name":"Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL, USA"}]},{"given":"Ilkay","family":"Altintas","sequence":"additional","affiliation":[{"name":"UCSD, San Diego Supercomputing Center, San Diego, CA, USA"}]},{"given":"Christopher D","family":"Carothers","sequence":"additional","affiliation":[{"name":"Computer Science Department, Rensselaer Polytechnic Institute, New York, NY, USA"}]},{"given":"Kerstin Kleese","family":"van Dam","sequence":"additional","affiliation":[{"name":"Brookhaven National Laboratory, New York, NY, USA"}]},{"given":"Kenneth","family":"Moreland","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, USA"}]},{"given":"Manish","family":"Parashar","sequence":"additional","affiliation":[{"name":"Computer Science Department, Rutgers University, New Brunswick, NJ, USA"}]},{"given":"Lavanya","family":"Ramakrishnan","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, CA, USA"}]},{"given":"Michela","family":"Taufer","sequence":"additional","affiliation":[{"name":"Computer Science Department, University of Delaware, Newark, DE, USA"}]},{"given":"Jeffrey","family":"Vetter","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, USA"}]}],"member":"179","published-online":{"date-parts":[[2017,4,26]]},"reference":[{"key":"bibr1-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/1551609.1551618"},{"key":"bibr2-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/SSDM.2004.1311241"},{"key":"bibr3-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/NDM.2014.9"},{"key":"bibr4-1094342017704893","unstructured":"Apache Drill \u2013 Schema-free SQL for Hadoop, NoSQL and Cloud Storage [Online]. Available at: https:\/\/drill.apache.org\/ (accessed November 2016)."},{"key":"bibr5-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2014.127"},{"key":"bibr6-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/VISUAL.2005.1532788"},{"key":"bibr7-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2012.07.005"},{"key":"bibr8-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/WORKS.2014.14"},{"key":"bibr9-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70600"},{"key":"bibr10-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003882"},{"key":"bibr11-1094342017704893","unstructured":"BDEC Committee (2016) The BDEC \u2018Pathways to Convergence\u2019 Report. Available at: http:\/\/www.exascale.org\/bdec\/sites\/www.exascale.org.bdec\/files\/whitepapers\/bdec2017pathways_v2.pdf."},{"key":"bibr12-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"bibr13-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/HPCC.and.EUC.2013.65"},{"key":"bibr14-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2008.126"},{"key":"bibr15-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/1851476.1851570"},{"key":"bibr16-1094342017704893","unstructured":"Bhat VN (2008) Autonomic Management of Data Streaming and In-Transit Processing for Data Intensive Scientific Workflows. PhD thesis, The State University of New Jersey, Rutgers."},{"key":"bibr17-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2012.31"},{"key":"bibr18-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2005.52"},{"key":"bibr19-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2010.41"},{"key":"bibr20-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1177\/1094342009106189"},{"key":"bibr21-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTER.2015.34"},{"key":"bibr22-1094342017704893","volume-title":"Workshop determinism correctness parallel programming (WoDet","author":"Chiang WF","year":"2013"},{"key":"bibr23-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.992"},{"key":"bibr24-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/1978915.1978919"},{"key":"bibr25-1094342017704893","first-page":"119","author":"Cuevas-Vicentt\u00edn V","year":"2012","journal-title":"High performance computing, networking storage and analysis"},{"key":"bibr26-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/HPCMP-UGC.2007.30"},{"key":"bibr27-1094342017704893","volume-title":"Van Nostrand\u2019s Scientific Encyclopedia","author":"Considine DM","year":"1999","edition":"5"},{"key":"bibr28-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2014.10.008"},{"key":"bibr29-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2014.2345391"},{"key":"bibr30-1094342017704893","first-page":"10","volume-title":"Proceedings of the 6th conference on symposium on operating systems design & implementation \u2013 Volume 6","author":"Dean J","year":"2004"},{"key":"bibr31-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-012-9227-2"},{"key":"bibr32-1094342017704893","first-page":"758","volume-title":"IEEE international parallel & distributed processing symposium","author":"Docan C","year":"2011"},{"key":"bibr33-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/2828612.2828622"},{"key":"bibr35-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/1851476.1851481"},{"key":"bibr36-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2014.104"},{"key":"bibr37-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-28642-4_2"},{"key":"bibr38-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1155\/2005\/128026"},{"key":"bibr39-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTER.2016.30"},{"key":"bibr40-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPSW.2013.198"},{"key":"bibr41-1094342017704893","unstructured":"Eaton B, Gregory J, Drach B, (2011) NetCDF Climate and Forecast (CF) Metadata Conventions, Version 1.6, 5 December. Available at: http:\/\/cfconventions.org"},{"key":"bibr42-1094342017704893","unstructured":"Ewa Deelman, (2016) The Future of Scientific Workflows Report of the DOE NGNS\/CS Scientific Workflows Workshop. U.S. Department of Energy, Office of Science, 20\u201321 April 2015."},{"key":"bibr43-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2008.59"},{"key":"bibr44-1094342017704893","unstructured":"Fox G, Qiu J, Jha S (2014) High Performance High Functionality Big Data Software Stack. Available at: http:\/\/www.exascale.org\/bdec\/sites\/www.exascale.org.bdec\/files\/whitepapers\/fox.pdf"},{"key":"bibr45-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2014.78"},{"key":"bibr46-1094342017704893","volume-title":"Towards Open Publication of Reusable Scientific Workflows: Abstractions, Standards, and Linked Data","author":"Garijo D","year":"2012"},{"key":"bibr47-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1101\/gr.4086505"},{"key":"bibr48-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2010-11-8-r86"},{"key":"bibr49-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1007\/s00024-010-0161-6"},{"key":"bibr50-1094342017704893","volume-title":"The End of Error: Unum Computing","author":"Gustafson JL","year":"2015"},{"key":"bibr51-1094342017704893","doi-asserted-by":"crossref","unstructured":"Habib S, Pope A, Finkel H, (2016, 1) HACC: Simulating sky surveys on state-of-the-art supercomputing architectures, New Astronomy 42: 49\u201365. Available at: http:\/\/dx.doi.org\/10.1016\/j.newast.2015.06.003","DOI":"10.1016\/j.newast.2015.06.003"},{"key":"bibr52-1094342017704893","author":"Jacob JC","year":"2010","journal-title":"Computing Research Repository"},{"key":"bibr53-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2012.08.015"},{"key":"bibr54-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.Congress.2014.137"},{"key":"bibr55-1094342017704893","unstructured":"Khan F, Hammonds J, Narayanan S, (2013) Effective end-to-end management of data acquisition and analysis for X-ray photon correlation spectroscopy. In: Marshall C, Fisher J, Schaa VRW (eds) Presented at the ICALEPCS. Available at: http:\/\/accelconf.web.cern.ch\/AccelConf\/ICALEPCS2013\/"},{"key":"bibr56-1094342017704893","volume-title":"No. PNNL-SA-120941","author":"Kleese van Dam K","year":"2015"},{"key":"bibr57-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/363707.363723"},{"key":"bibr58-1094342017704893","unstructured":"LANL, NERSC and SNL (2016, July) APEX workflows. Available at: http:\/\/www.nersc.gov\/assets\/apex-workflows-v2.pdf, SAND2016-2371 O, LA-UR-15-29113"},{"key":"bibr59-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/1383529.1383533"},{"key":"bibr60-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32820-6_10"},{"key":"bibr61-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2010.10.013"},{"key":"bibr62-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/1383529.1383533"},{"key":"bibr63-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1007\/s10822-006-9060-4"},{"key":"bibr64-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2010.07.005"},{"key":"bibr65-1094342017704893","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920886"},{"key":"bibr66-1094342017704893","first-page":"10","volume-title":"Proceedings of the 2009 conference onUSENIX annual technical conference","author":"Muniswamy-Reddy KK","year":"2009"},{"key":"bibr67-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807184"},{"key":"bibr68-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btg250"},{"key":"bibr69-1094342017704893","first-page":"143","volume-title":"Workflows for e-Science","author":"Maechling P","year":"2006"},{"key":"bibr70-1094342017704893","volume-title":"WGL: A Workflow Generator Language and Utility","author":"Meyer L","year":"2013"},{"key":"bibr71-1094342017704893","unstructured":"Maheshwari K, Kelly D, Krieder SJ, (2013) Reusability in science: from initial user engagement to dissemination of results. In: 3rd workshop on sustainable software for science:Practice and experiences (WSSSPE3), 28\u201329 September 2015, Boulder, CO."},{"key":"bibr72-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.993"},{"key":"bibr73-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/224170.224354"},{"key":"bibr74-1094342017704893","doi-asserted-by":"crossref","unstructured":"Prabhat, Koziol Q. (2014) High Performance Parallel I\/O. Chapman & Hall\/CRC Computational Science. CRC Press. Available at: http:\/\/dl.acm.org\/citation.cfm?id=2700549","DOI":"10.1201\/b17572"},{"key":"bibr75-1094342017704893","volume-title":"the Building Robust Big Data Ecosystem ISO\/IEC JTC 1 Study Group on Big Data","author":"Qui J","year":"2014"},{"key":"bibr76-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2014.56"},{"key":"bibr77-1094342017704893","volume-title":"Presented at the Challenges in 21st Century Experimental Mathematical Computation","author":"Revol N","year":"2014"},{"key":"bibr78-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2007.106"},{"key":"bibr79-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/2110497.2110510"},{"key":"bibr80-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376747"},{"key":"bibr81-1094342017704893","first-page":"TUPEC069","volume-title":"1st international particle accelerator conference (IPAC 2010)","author":"Shasharina S","year":"2010"},{"key":"bibr82-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1126\/science.aah6168"},{"key":"bibr83-1094342017704893","volume-title":"Kalman Filter: Theory and Applications","volume":"38","author":"Sorenson H","year":"1985"},{"key":"bibr84-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-22351-8_1"},{"key":"bibr85-1094342017704893","first-page":"27","volume-title":"IEEE 9th international conference on e-Science","author":"Tchoua R","year":"2010"},{"key":"bibr86-1094342017704893","unstructured":"Thakur R. Parallel I\/O Benchmarks, Applications, Traces. May 2015. [Online]. Available at: http:\/\/www.mcs.anl.gov\/\u223cthakur\/pio-benchmarks.html (accessed July 2016)"},{"key":"bibr87-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.1417"},{"key":"bibr88-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2007.01.003"},{"key":"bibr89-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/2642769.2642774"},{"key":"bibr90-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/1179622.1179682"},{"key":"bibr91-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2010.5470481"},{"key":"bibr92-1094342017704893","unstructured":"Top Ten Exascale Research Challenges (2014) DOE ASCAC Subcommittee Report, Feb. Available at: https:\/\/science.energy.gov\/\u223c\/media\/ascr\/ascac\/pdf\/meetings\/20140210\/Top10reportFEB14.pdf"},{"key":"bibr93-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/38.31462"},{"key":"bibr94-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2011.05.005"},{"key":"bibr95-1094342017704893","volume-title":"Web Services Platform Architecture: SOAP, WSDL, WS-Policy, WS-Addressing, WS-BPEL, WS-Reliable Messaging and More","author":"Weerawarana S","year":"2005"},{"key":"bibr96-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/DSN.2014.105"},{"key":"bibr97-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkt328"},{"key":"bibr98-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.365"},{"key":"bibr99-1094342017704893","unstructured":"Workshop on the Future of Scientific Workflows (2015). [Online]. Available at: http:\/\/extremescaleresearch.labworks.org\/events\/workshop-future-scientific-workflows. (accessed September 2016)."},{"key":"bibr100-1094342017704893","volume-title":"Presented at the Synchronization-reducing and Communication-reducing Algorithms and Programming Models for Large-scale Simulations Workshop","author":"Yelick K","year":"2012"},{"key":"bibr101-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1145\/2159352.2159362"},{"key":"bibr102-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/SERVICES.2007.63"},{"key":"bibr103-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2010.5470454"},{"key":"bibr104-1094342017704893","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2014.9"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342017704893","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1094342017704893","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342017704893","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,28]],"date-time":"2025-02-28T21:19:24Z","timestamp":1740777564000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1094342017704893"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,4,26]]},"references-count":103,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,1]]}},"alternative-id":["10.1177\/1094342017704893"],"URL":"https:\/\/doi.org\/10.1177\/1094342017704893","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,4,26]]}}}