{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T07:01:17Z","timestamp":1763017277829,"version":"3.41.0"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2013,4,1]],"date-time":"2013-04-01T00:00:00Z","timestamp":1364774400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Auton. Adapt. Syst."],"published-print":{"date-parts":[[2013,4]]},"abstract":"<jats:p>Scientific workflows have become the primary mechanism for conducting analyses on distributed computing infrastructures such as grids and clouds. In recent years, the focus of optimization within scientific workflows has primarily been on computational tasks and workflow makespan. However, as workflow-based analysis becomes ever more data intensive, data optimization is becoming a prime concern. Moreover, scientific workflows can scale along several dimensions: (i) number of computational tasks, (ii) heterogeneity of computational resources, and the (iii) size and type (static versus streamed) of data involved. Adapting workflow structure in response to these scalability challenges remains an important research objective. Understanding how a workflow graph can be restructured in an automated manner (through task merge, for instance), to address constraints of a particular execution environment is explored in this work, using a multi-objective evolutionary approach. Our approach attempts to adapt the workflow structure to achieve both compute and data optimization. The question of when to terminate the evolutionary search in order to conserve computations is tackled with a novel termination criterion. The results presented in this article demonstrate the feasibility of the termination criterion and demonstrate that significant optimization can be achieved with a multi-objective approach.<\/jats:p>","DOI":"10.1145\/2451248.2451252","type":"journal-article","created":{"date-parts":[[2013,4,23]],"date-time":"2013-04-23T13:04:26Z","timestamp":1366722266000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Adapting scientific workflow structures using multi-objective optimization strategies"],"prefix":"10.1145","volume":"8","author":[{"given":"Irfan","family":"Habib","sequence":"first","affiliation":[{"name":"FET, University of the West of England, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ashiq","family":"Anjum","sequence":"additional","affiliation":[{"name":"University of Derby, Derby, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard","family":"Mcclatchey","sequence":"additional","affiliation":[{"name":"FET, University of the West of England, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Omer","family":"Rana","sequence":"additional","affiliation":[{"name":"Cardiff University, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2013,4,19]]},"reference":[{"unstructured":"Abramowitz M. and Stegun I. 1972. Stirling numbers of the second kind. In Handbook of Mathematical Functions with Formulas Graphs and Mathematical Tables. Dover Publications 824--825.  Abramowitz M. and Stegun I. 1972. Stirling numbers of the second kind. In Handbook of Mathematical Functions with Formulas Graphs and Mathematical Tables. Dover Publications 824--825.","key":"e_1_2_1_1_1"},{"volume-title":"Proceedings of the 12th Annual Meeting of the Organization for Human Brain Mapping (OHBM).","author":"Ad-Dabbagh Y.","unstructured":"Ad-Dabbagh , Y. , Einarson , D. , Lyttelton , O. , Muehlboeck , J.-S. , Mok , K. , Ivanov , O. , Vincent , R. D. , Lepage , C. , Lerch , J. , Fombonne , E. , and Evans , A. C . 2006. The civet image-processing environment: A fully automated comprehensive pipeline for anatomical neuroimaging research . In Proceedings of the 12th Annual Meeting of the Organization for Human Brain Mapping (OHBM). Ad-Dabbagh, Y., Einarson, D., Lyttelton, O., Muehlboeck, J.-S., Mok, K., Ivanov, O., Vincent, R. D., Lepage, C., Lerch, J., Fombonne, E., and Evans, A. C. 2006. The civet image-processing environment: A fully automated comprehensive pipeline for anatomical neuroimaging research. In Proceedings of the 12th Annual Meeting of the Organization for Human Brain Mapping (OHBM).","key":"e_1_2_1_2_1"},{"volume-title":"Hypervolume-Based Search for Multiobjective Optimization: Theory and Methods","author":"Bader J. M.","unstructured":"Bader , J. M. 2010. Hypervolume-Based Search for Multiobjective Optimization: Theory and Methods . CreateSpace Independent Publishing Platform , Paramount, CA . Bader, J. M. 2010. Hypervolume-Based Search for Multiobjective Optimization: Theory and Methods. CreateSpace Independent Publishing Platform, Paramount, CA.","key":"e_1_2_1_3_1"},{"doi-asserted-by":"crossref","unstructured":"Barga R. and Gannon D. 2007. Scientific versus business workflows. In Workflows for e-Science I. J. Taylor E. Deelman D. B. Gannon and M. Shields Eds. Springer 9--16.  Barga R. and Gannon D. 2007. Scientific versus business workflows. In Workflows for e-Science I. J. Taylor E. Deelman D. B. Gannon and M. Shields Eds. Springer 9--16.","key":"e_1_2_1_4_1","DOI":"10.1007\/978-1-84628-757-2_2"},{"doi-asserted-by":"publisher","key":"e_1_2_1_5_1","DOI":"10.1016\/j.ejor.2006.08.008"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation (CEC'07)","author":"Brockhoff D.","year":"2086","unstructured":"Brockhoff , D. and Zitzler , E . 2007. Improving hypervolume-based multiobjective evolutionary algorithms by using objective reduction methods . In Proceedings of the IEEE Congress on Evolutionary Computation (CEC'07) . IEEE, 2086 --2093. Brockhoff, D. and Zitzler, E. 2007. Improving hypervolume-based multiobjective evolutionary algorithms by using objective reduction methods. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC'07). IEEE, 2086--2093."},{"doi-asserted-by":"publisher","key":"e_1_2_1_7_1","DOI":"10.1109\/UKSIM.2008.28"},{"doi-asserted-by":"publisher","key":"e_1_2_1_8_1","DOI":"10.1145\/1374596.1374611"},{"doi-asserted-by":"crossref","unstructured":"Deb K. Agrawal S. Pratap A. and Meyarivan T. 2000. A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II. In Parallel Problem Solving from Nature PPSN VI M. Schoenauer K. Deb G. Rudolph X. Yao E. Lutton J. Merelo and H.-P. Schwefel Eds. Lecture Notes in Computer Science Series vol. 1917 Springer 849--858.   Deb K. Agrawal S. Pratap A. and Meyarivan T. 2000. A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II. In Parallel Problem Solving from Nature PPSN VI M. Schoenauer K. Deb G. Rudolph X. Yao E. Lutton J. Merelo and H.-P. Schwefel Eds. Lecture Notes in Computer Science Series vol. 1917 Springer 849--858.","key":"e_1_2_1_9_1","DOI":"10.1007\/3-540-45356-3_83"},{"volume-title":"Workflows for e-Science, I. J. Taylor, E. Deelman, D. B. Gannon, and M. Shields, Eds","author":"Deelman E.","unstructured":"Deelman , E. 2007. Looking into the future of workflows: The challenges ahead . In Workflows for e-Science, I. J. Taylor, E. Deelman, D. B. Gannon, and M. Shields, Eds , Springer , 475--481. Deelman, E. 2007. Looking into the future of workflows: The challenges ahead. In Workflows for e-Science, I. J. Taylor, E. Deelman, D. B. Gannon, and M. Shields, Eds, Springer, 475--481.","key":"e_1_2_1_10_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_11_1","DOI":"10.1023\/A:1024000426962"},{"doi-asserted-by":"publisher","key":"e_1_2_1_12_1","DOI":"10.1016\/j.future.2008.06.012"},{"doi-asserted-by":"publisher","key":"e_1_2_1_13_1","DOI":"10.1155\/2005\/128026"},{"key":"e_1_2_1_14_1","first-page":"4138","article-title":"The jmetal framework for multi-objective optimization: Design and architecture. In Proceedings of the Congress on Evolutionary Computation (CEC'10)","volume":"5467","author":"Durillo J. J.","year":"2010","unstructured":"Durillo , J. J. , Nebro , A. J. , and Alba , E. 2010 . The jmetal framework for multi-objective optimization: Design and architecture. In Proceedings of the Congress on Evolutionary Computation (CEC'10) . Lecture Notes in Computer Science Series , vol. 5467 , Spring er, 4138 -- 4325 . Durillo, J. J., Nebro, A. J., and Alba, E. 2010. The jmetal framework for multi-objective optimization: Design and architecture. In Proceedings of the Congress on Evolutionary Computation (CEC'10). Lecture Notes in Computer Science Series, vol. 5467, Springer, 4138--4325.","journal-title":"Lecture Notes in Computer Science Series"},{"doi-asserted-by":"publisher","key":"e_1_2_1_15_1","DOI":"10.1109\/TSMCB.2011.2160625"},{"doi-asserted-by":"publisher","key":"e_1_2_1_16_1","DOI":"10.1109\/MC.2007.421"},{"key":"e_1_2_1_17_1","first-page":"333","article-title":"Genetic algorithms, noise, and the sizing of populations","volume":"6","author":"Goldberg D. E.","year":"1991","unstructured":"Goldberg , D. E. , Deb , K. , and Clark , J. H. 1991 . Genetic algorithms, noise, and the sizing of populations . Complex Syst. 6 , 333 -- 362 . Goldberg, D. E., Deb, K., and Clark, J. H. 1991. Genetic algorithms, noise, and the sizing of populations. Complex Syst. 6, 333--362.","journal-title":"Complex Syst."},{"unstructured":"Graphviz. 2010. DOT language. http:\/\/www.graphviz.org\/doc\/info\/lang.html.  Graphviz. 2010. DOT language. http:\/\/www.graphviz.org\/doc\/info\/lang.html.","key":"e_1_2_1_18_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_19_1","DOI":"10.1109\/TSMC.1986.289288"},{"doi-asserted-by":"publisher","key":"e_1_2_1_20_1","DOI":"10.1145\/1569901.1569983"},{"volume-title":"Proceedings of the 5th IEEE International Conference on E-Science Workshops. IEEE Computer Society, 102--109","author":"Habib I.","unstructured":"Habib , I. , Anjum , A. , Bloodsworth , P. , and Mcclatchey , R . 2009. Neuroimaging analysis using grid aware planning and optimisation techniques . In Proceedings of the 5th IEEE International Conference on E-Science Workshops. IEEE Computer Society, 102--109 . Habib, I., Anjum, A., Bloodsworth, P., and Mcclatchey, R. 2009. Neuroimaging analysis using grid aware planning and optimisation techniques. In Proceedings of the 5th IEEE International Conference on E-Science Workshops. IEEE Computer Society, 102--109.","key":"e_1_2_1_21_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_22_1","DOI":"10.1109\/WGEC.2009.211"},{"doi-asserted-by":"publisher","key":"e_1_2_1_23_1","DOI":"10.1109\/TEVC.2005.861417"},{"doi-asserted-by":"publisher","key":"e_1_2_1_24_1","DOI":"10.1002\/jmri.21049"},{"volume-title":"Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS'04)","author":"Kosar T.","unstructured":"Kosar , T. and Livny , M . 2004. Stork: Making data placement a first class citizen in the grid . In Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS'04) . IEEE Computer Society, Los Alamitos, CA, 342--349. Kosar, T. and Livny, M. 2004. Stork: Making data placement a first class citizen in the grid. In Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS'04). IEEE Computer Society, Los Alamitos, CA, 342--349.","key":"e_1_2_1_25_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_26_1","DOI":"10.1002\/spe.432"},{"doi-asserted-by":"publisher","key":"e_1_2_1_27_1","DOI":"10.1109\/CCGRID.2008.43"},{"doi-asserted-by":"publisher","key":"e_1_2_1_28_1","DOI":"10.1145\/1276958.1277141"},{"doi-asserted-by":"publisher","key":"e_1_2_1_29_1","DOI":"10.1109\/ICGRID.2006.310993"},{"volume-title":"Proceedings of the 22nd IEEE International Symposium on Parallel and Distributed Processing (IPDPS). IEEE Computer Society.","author":"Park S.-M.","unstructured":"Park , S.-M. and Humphrey , M . Data throttling for data-intensive workflows . In Proceedings of the 22nd IEEE International Symposium on Parallel and Distributed Processing (IPDPS). IEEE Computer Society. Park, S.-M. and Humphrey, M. Data throttling for data-intensive workflows. In Proceedings of the 22nd IEEE International Symposium on Parallel and Distributed Processing (IPDPS). IEEE Computer Society.","key":"e_1_2_1_30_1"},{"key":"e_1_2_1_31_1","first-page":"193","article-title":"Specification and runtime workflow support in the askalon grid environment. Sci","volume":"15","author":"Prodan R.","year":"2007","unstructured":"Prodan , R. 2007 . Specification and runtime workflow support in the askalon grid environment. Sci . Program. 15 , 4, 193 -- 211 . Prodan, R. 2007. Specification and runtime workflow support in the askalon grid environment. Sci. Program. 15, 4, 193--211.","journal-title":"Program."},{"doi-asserted-by":"publisher","key":"e_1_2_1_33_1","DOI":"10.1145\/1362622.1362680"},{"doi-asserted-by":"publisher","key":"e_1_2_1_34_1","DOI":"10.1145\/1383519.1383521"},{"doi-asserted-by":"publisher","key":"e_1_2_1_35_1","DOI":"10.1145\/1833398.1833402"},{"doi-asserted-by":"publisher","key":"e_1_2_1_36_1","DOI":"10.2217\/fnl.09.53"},{"doi-asserted-by":"publisher","key":"e_1_2_1_37_1","DOI":"10.5555\/645513.657608"},{"volume-title":"Proceedings of the 6th International Multi-Objective Programming and Goal Programming Conference.","author":"Rudenko O.","unstructured":"Rudenko , O. and Schoenauer , M . 2004. A steady performance stopping criterion for pareto-based evolutionary algorithm . In Proceedings of the 6th International Multi-Objective Programming and Goal Programming Conference. Rudenko, O. and Schoenauer, M. 2004. A steady performance stopping criterion for pareto-based evolutionary algorithm. In Proceedings of the 6th International Multi-Objective Programming and Goal Programming Conference.","key":"e_1_2_1_38_1"},{"volume-title":"Proceedings of the 3rd International Conference on Genetic Algorithms. Morgan Kaufmann","author":"Schaffer J. D.","unstructured":"Schaffer , J. D. , Caruana , R. A. , Eshelman , L. J. , and Das , R . 1989. A study of control parameters affecting online performance of genetic algorithms for function optimization . In Proceedings of the 3rd International Conference on Genetic Algorithms. Morgan Kaufmann , San Francisco, CA, 51--60. Schaffer, J. D., Caruana, R. A., Eshelman, L. J., and Das, R. 1989. A study of control parameters affecting online performance of genetic algorithms for function optimization. In Proceedings of the 3rd International Conference on Genetic Algorithms. Morgan Kaufmann, San Francisco, CA, 51--60.","key":"e_1_2_1_39_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_40_1","DOI":"10.1145\/1341811.1341822"},{"doi-asserted-by":"publisher","key":"e_1_2_1_41_1","DOI":"10.1002\/9780470496916"},{"doi-asserted-by":"publisher","key":"e_1_2_1_42_1","DOI":"10.5555\/2951659.2951745"},{"unstructured":"Veldhuizen D. A. V. and Lamont G. B. 1998. Multiobjective evolutionary algorithm research: A history and analysis. Tech. rep. TR-98-03. Department of Electrical and Computer Engineering Air Force Institute of Technology Ohio.  Veldhuizen D. A. V. and Lamont G. B. 1998. Multiobjective evolutionary algorithm research: A history and analysis. Tech. rep. TR-98-03. Department of Electrical and Computer Engineering Air Force Institute of Technology Ohio.","key":"e_1_2_1_43_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_44_1","DOI":"10.1007\/s10723-005-9013-5"},{"volume-title":"Proceedings of the Congress on Evolutionary Computation (CEC'03)","author":"Xue F.","unstructured":"Xue , F. , Sanderson , A. , and Graves , R . 2003. Pareto-Based multi-objective differential evolution . In Proceedings of the Congress on Evolutionary Computation (CEC'03) .Vol. 2. IEEE Press, 862--869. Xue, F., Sanderson, A., and Graves, R. 2003. Pareto-Based multi-objective differential evolution. In Proceedings of the Congress on Evolutionary Computation (CEC'03).Vol. 2. IEEE Press, 862--869.","key":"e_1_2_1_45_1"},{"volume-title":"Proceedings of the Congress on Services. IEEE Computer Society, 199--206","author":"Zhao Y.","unstructured":"Zhao , Y. , Hategan , M. , Clifford , B. , Foster , I. , Von Laszewski , G. , Nefedova , V. , Raicu , I. , Stefpraun , T. , and Wilde , M . 2007. Swift: Fast, reliable, loosely coupled parallel computation . In Proceedings of the Congress on Services. IEEE Computer Society, 199--206 . Zhao, Y., Hategan, M., Clifford, B., Foster, I., Von Laszewski, G., Nefedova, V., Raicu, I., Stefpraun, T., and Wilde, M. 2007. Swift: Fast, reliable, loosely coupled parallel computation. In Proceedings of the Congress on Services. IEEE Computer Society, 199--206.","key":"e_1_2_1_46_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_47_1","DOI":"10.1162\/106365600568202"},{"volume-title":"Proceedings of the 8th International Conference on Parallel Problem Solving from Nature (PPSN'04)","author":"Zitzler E.","unstructured":"Zitzler , E. and Kunzli , S . 2004. Indicator-Based selection in multiobjective search . In Proceedings of the 8th International Conference on Parallel Problem Solving from Nature (PPSN'04) . Springer, 832--842. Zitzler, E. and Kunzli, S. 2004. Indicator-Based selection in multiobjective search. In Proceedings of the 8th International Conference on Parallel Problem Solving from Nature (PPSN'04). Springer, 832--842.","key":"e_1_2_1_48_1"},{"unstructured":"Zitzler E. Laumanns M. and Thiele L. 2001. SPEA2: Improving the strength pareto evolutionary algorithm. Tech. rep. ETH Zurich.  Zitzler E. Laumanns M. and Thiele L. 2001. SPEA2: Improving the strength pareto evolutionary algorithm. Tech. rep. ETH Zurich.","key":"e_1_2_1_49_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_50_1","DOI":"10.1109\/TEVC.2003.810758"}],"container-title":["ACM Transactions on Autonomous and Adaptive Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2451248.2451252","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2451248.2451252","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:36:41Z","timestamp":1750282601000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2451248.2451252"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,4]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,4]]}},"alternative-id":["10.1145\/2451248.2451252"],"URL":"https:\/\/doi.org\/10.1145\/2451248.2451252","relation":{},"ISSN":["1556-4665","1556-4703"],"issn-type":[{"type":"print","value":"1556-4665"},{"type":"electronic","value":"1556-4703"}],"subject":[],"published":{"date-parts":[[2013,4]]},"assertion":[{"value":"2011-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-04-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}