{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T00:46:08Z","timestamp":1780361168811,"version":"3.54.1"},"reference-count":68,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2016,7,27]],"date-time":"2016-07-27T00:00:00Z","timestamp":1469577600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2017,1]]},"abstract":"<jats:p>Computational science is well established as the third pillar of scientific discovery and is on par with experimentation and theory. However, as we move closer toward the ability to execute exascale calculations and process the ensuing extreme-scale amounts of data produced by both experiments and computations alike, the complexity of managing the compute and data analysis tasks has grown beyond the capabilities of domain scientists. Thus, workflow management systems are absolutely necessary to ensure current and future scientific discoveries. A key research question for these workflow management systems concerns the performance optimization of complex calculation and data analysis tasks. The central contribution of this article is a description of the PANORAMA approach for modeling and diagnosing the run-time performance of complex scientific workflows. This approach integrates extreme-scale systems testbed experimentation, structured analytical modeling, and parallel systems simulation into a comprehensive workflow framework called Pegasus for understanding and improving the overall performance of complex scientific workflows.<\/jats:p>","DOI":"10.1177\/1094342015594515","type":"journal-article","created":{"date-parts":[[2015,7,14]],"date-time":"2015-07-14T21:02:27Z","timestamp":1436907747000},"page":"4-18","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":23,"title":["PANORAMA: An approach to performance modeling and diagnosis of extreme-scale workflows"],"prefix":"10.1177","volume":"31","author":[{"given":"Ewa","family":"Deelman","sequence":"first","affiliation":[{"name":"Information Sciences Institute, University of Southern California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher","family":"Carothers","sequence":"additional","affiliation":[{"name":"Rensselaer Polytechnic Institute"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anirban","family":"Mandal","sequence":"additional","affiliation":[{"name":"RENCI\/UNC Chapel Hill"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Tierney","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeffrey S","family":"Vetter","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ilya","family":"Baldin","sequence":"additional","affiliation":[{"name":"RENCI\/UNC Chapel Hill"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claris","family":"Castillo","sequence":"additional","affiliation":[{"name":"RENCI\/UNC Chapel Hill"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gideon","family":"Juve","sequence":"additional","affiliation":[{"name":"Information Sciences Institute, University of Southern California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dariusz","family":"Kr\u00f3l","sequence":"additional","affiliation":[{"name":"Information Sciences Institute, University of Southern California"},{"name":"AGH University of Science and Technology, Krakow, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vickie","family":"Lynch","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ben","family":"Mayer","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeremy","family":"Meredith","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"Proffen","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Ruth","sequence":"additional","affiliation":[{"name":"RENCI\/UNC Chapel Hill"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rafael","family":"Ferreira da Silva","sequence":"additional","affiliation":[{"name":"Information Sciences Institute, University of Southern California"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2016,7,27]]},"reference":[{"key":"bibr1-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/215399.215427"},{"key":"bibr2-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1016\/j.nima.2014.07.029"},{"key":"bibr3-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35576-9_12"},{"key":"bibr4-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/2486092.2486134"},{"key":"bibr5-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/PADS.2009.21"},{"key":"bibr6-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/WORKS.2008.4723958"},{"key":"bibr7-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2010.5679119"},{"key":"bibr8-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/347823.347828"},{"key":"bibr9-1094342015594515","unstructured":"Case D, Berryman JT, Betz RM, (2015) AMBER 15. San Francisco, CA: University of California."},{"key":"bibr10-1094342015594515","author":"Chen W","year":"2014","journal-title":"Future Generation Computer Systems"},{"key":"bibr11-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/173284.155333"},{"key":"bibr12-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/2304576.2304604"},{"key":"bibr13-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/CCGRID.2008.89"},{"key":"bibr14-1094342015594515","first-page":"1","volume":"20","author":"Deelman E","year":"2002","journal-title":"GriPhyN technical report"},{"key":"bibr15-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/E-SCIENCE.2006.261098"},{"key":"bibr16-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/CCGRID.2008.24"},{"key":"bibr17-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2008.06.012"},{"key":"bibr18-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1155\/2005\/128026"},{"key":"bibr19-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2014.10.008"},{"key":"bibr20-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2014.44"},{"key":"bibr21-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36949-0_10"},{"key":"bibr22-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2013.06.012"},{"key":"bibr23-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.3303"},{"key":"bibr24-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/2534248.2534254"},{"key":"bibr25-1094342015594515","volume-title":"2015 international conference on computational science (ICCS 2015)","author":"Ferreira da Silva R","year":"2015"},{"key":"bibr26-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2010.5470417"},{"key":"bibr27-1094342015594515","first-page":"114","author":"Germain-Renaud C","year":"2011","journal-title":"IEEE international symposium on cluster computing and the grid"},{"key":"bibr28-1094342015594515","first-page":"1","volume-title":"7th international conference on network and service management","author":"Gunter D","year":"2011"},{"key":"bibr29-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1177\/1094342010394382"},{"key":"bibr30-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2010.130"},{"key":"bibr31-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2008.02.003"},{"key":"bibr32-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/1964218.1964220"},{"key":"bibr33-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2012.08.015"},{"key":"bibr34-1094342015594515","doi-asserted-by":"crossref","unstructured":"Juve G, Tovar B, (2014) Practical resource monitoring for robust high throughput computing. Technical report, University of Southern California.","DOI":"10.1109\/CLUSTER.2015.115"},{"key":"bibr35-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2003.1160055"},{"key":"bibr36-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/CCGRID.2010.71"},{"key":"bibr37-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/2751205.2751220"},{"key":"bibr38-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpc.2012.02.010"},{"key":"bibr39-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/MSST.2012.6232369"},{"key":"bibr40-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2013.04.019"},{"key":"bibr41-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/CCEM.2012.6354624"},{"key":"bibr42-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2014.6815907"},{"key":"bibr43-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/2534695.2534698"},{"key":"bibr44-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/2063384.2063449"},{"key":"bibr45-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1016\/j.physb.2006.05.281"},{"key":"bibr46-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/263932.264023"},{"key":"bibr47-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/SC.Companion.2012.56"},{"key":"bibr48-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-85966-8_6"},{"key":"bibr49-1094342015594515","first-page":"1","volume-title":"CoreGRID Symposium - Euro-Par 2008","author":"Ostermann S","year":"2008"},{"key":"bibr50-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-09455-7_14"},{"key":"bibr51-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/GRID.2010.5697953"},{"key":"bibr52-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1002\/jcc.20289"},{"key":"bibr53-1094342015594515","unstructured":"Ramakrishnan L, Gannon D (2008) A survey of distributed workflow characteristics and resource requirements. Technical Report, Indiana University. Available at: http:\/\/www.cs.indiana.edu\/pub\/techreports\/TR671.pdf."},{"key":"bibr54-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/IISWC.2012.6402895"},{"key":"bibr55-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/1964218.1964225"},{"key":"bibr56-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1007\/11767138_20"},{"key":"bibr57-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/HPCC.2011.55"},{"key":"bibr58-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/2110497.2110510"},{"key":"bibr59-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/E-SCIENCE.2006.261167"},{"key":"bibr60-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2012.20"},{"key":"bibr61-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1177\/1094342013488262"},{"key":"bibr62-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/WORKS.2014.8"},{"key":"bibr63-1094342015594515","doi-asserted-by":"crossref","unstructured":"Tierney B, Boote J, Boyd E, (2009) Instantiating a Global Network Measurement Framework. Technical Report LBNL-1452E, Lawrence Berkeley National Lab.","DOI":"10.2172\/946807"},{"key":"bibr64-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-28642-4_24"},{"key":"bibr65-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-013-9265-4"},{"key":"bibr66-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2013.6691724"},{"key":"bibr67-1094342015594515","doi-asserted-by":"publisher","DOI":"10.1145\/79173.79181"},{"key":"bibr68-1094342015594515","first-page":"1","volume-title":"2nd international workshop on grid computing environments","author":"V\u00f6eckler JS","year":"2006"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342015594515","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1094342015594515","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342015594515","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:19:39Z","timestamp":1777450779000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1094342015594515"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,7,27]]},"references-count":68,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2017,1]]}},"alternative-id":["10.1177\/1094342015594515"],"URL":"https:\/\/doi.org\/10.1177\/1094342015594515","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,27]]}}}