{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T17:12:43Z","timestamp":1787937163464,"version":"build-2784847793"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2025,4,15]],"date-time":"2025-04-15T00:00:00Z","timestamp":1744675200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,4,15]],"date-time":"2025-04-15T00:00:00Z","timestamp":1744675200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"University of Thessaly Central Library"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Computing"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Efficient resource selection and scheduling in large-scale computing systems like the Cloud pose significant challenges, especially for workflows with unreliable or preemptible resources. These workflows depict a set of (sequential or parallel) processing activities that should be executed upon the available resources. In this paper, we focus on the efficient management of resources paying attention to unreliable executions and propose a novel checkpointing mechanism integrated into an uncertainty-aware Heterogeneous Earliest Finish Time (uHEFT) online algorithm. This algorithm determines the optimal time instances to store the observed progress of the execution by adopting the principles of the Optimal Stopping Theory and the continuous monitoring of the execution parameters. Hence, we are able to monitor the execution of tasks on unreliable resources and determine the optimal points to store progress, thereby mitigating the risk of unexpected revocations which frequently occur in preemptive strategies. The proposed model leverages the heterogeneity of available Cloud services, providing a proactive mitigation approach for revocation risks. The pros and cons of our approach are evaluated through a set of extensive simulations and performance metrics against an optimal strategy in which every checkpoint is applied just before a revocation event is observed. Notably, uHEFT minimizes the deviation from the theoretical optimal strategy (regret) without increasing the overall number of checkpoints. This cost-efficient solution enhances the execution of workflows in environments with volatile resources.<\/jats:p>","DOI":"10.1007\/s00607-025-01468-1","type":"journal-article","created":{"date-parts":[[2025,4,15]],"date-time":"2025-04-15T08:50:25Z","timestamp":1744707025000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A proactive and uncertainty driven management mechanism for workflows of processing tasks"],"prefix":"10.1007","volume":"107","author":[{"given":"Panagiotis","family":"Oikonomou","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kostas","family":"Kolomvatsos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christos","family":"Anagnostopoulos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,4,15]]},"reference":[{"issue":"3","key":"1468_CR1","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1109\/71.993206","volume":"13","author":"H Topcuoglu","year":"2002","unstructured":"Topcuoglu H, Hariri S, Wu M (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 13(3):260\u2013274","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"1468_CR2","doi-asserted-by":"crossref","unstructured":"Yi S, Kondo D, Andrzejak A (2010) Reducing costs of spot instances via checkpointing in the amazon elastic compute cloud. In: 2010 IEEE 3rd international conference on cloud computing. IEEE, pp 236\u2013243","DOI":"10.1109\/CLOUD.2010.35"},{"issue":"4","key":"1468_CR3","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1109\/TSC.2011.44","volume":"5","author":"S Yi","year":"2011","unstructured":"Yi S, Andrzejak A, Kondo D (2011) Monetary cost-aware checkpointing and migration on amazon cloud spot instances. IEEE Trans Serv Comput 5(4):512\u2013524","journal-title":"IEEE Trans Serv Comput"},{"key":"1468_CR4","doi-asserted-by":"crossref","unstructured":"Voorsluys W, Buyya R (2012) Reliable provisioning of spot instances for compute-intensive applications. In: 2012 IEEE 26th international conference on advanced information networking and applications. IEEE, pp 542\u2013549","DOI":"10.1109\/AINA.2012.106"},{"key":"1468_CR5","doi-asserted-by":"crossref","unstructured":"Kadupitige J, Jadhao V, Sharma P (2020) Modeling the temporally constrained preemptions of transient cloud vms. In: Proceedings of the 29th international symposium on high-performance parallel and distributed computing, pp 41\u201352","DOI":"10.1145\/3369583.3392671"},{"key":"1468_CR6","doi-asserted-by":"crossref","unstructured":"Di S, Robert Y, Vivien F, Kondo D, Wang C-L, Cappello F (2013) Optimization of cloud task processing with checkpoint-restart mechanism. In: Proceedings of the international conference on high performance computing, networking, storage and analysis, pp 1\u201312","DOI":"10.1145\/2503210.2503217"},{"issue":"9","key":"1468_CR7","doi-asserted-by":"publisher","first-page":"530","DOI":"10.1145\/361147.361115","volume":"17","author":"JW Young","year":"1974","unstructured":"Young JW (1974) A first order approximation to the optimum checkpoint interval. Commun ACM 17(9):530\u2013531","journal-title":"Commun ACM"},{"issue":"3","key":"1468_CR8","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1016\/j.future.2004.11.016","volume":"22","author":"JT Daly","year":"2006","unstructured":"Daly JT (2006) A higher order estimate of the optimum checkpoint interval for restart dumps. Futur Gener Comput Syst 22(3):303\u2013312","journal-title":"Futur Gener Comput Syst"},{"key":"1468_CR9","doi-asserted-by":"crossref","unstructured":"Jung D, Lim J, Yu H, Suh T (2014) Estimated interval-based checkpointing (eic) on spot instances in cloud computing. Journal of applied mathematics, 2014","DOI":"10.1155\/2014\/217547"},{"issue":"4","key":"1468_CR10","doi-asserted-by":"publisher","first-page":"2149","DOI":"10.1007\/s11227-018-2717-7","volume":"75","author":"AK Mishra","year":"2019","unstructured":"Mishra AK, Yadav DK, Kumar Y, Jain N (2019) Improving reliability and reducing cost of task execution on preemptible vm instances using machine learning approach. J Supercomput 75(4):2149\u20132180","journal-title":"J Supercomput"},{"key":"1468_CR11","doi-asserted-by":"crossref","unstructured":"Poola D, Ramamohanarao K, Buyya R (2014) Fault-tolerant workflow scheduling using spot instances on clouds. In: Procedia computer science, 29:523\u2013533","DOI":"10.1016\/j.procs.2014.05.047"},{"issue":"4","key":"1468_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2815624","volume":"10","author":"D Poola","year":"2016","unstructured":"Poola D, Ramamohanarao K, Buyya R (2016) Enhancing reliability of workflow execution using task replication and spot instances. ACM Trans Autonomous Adapt Syst (TAAS) 10(4):1\u201321","journal-title":"ACM Trans Autonomous Adapt Syst (TAAS)"},{"issue":"8","key":"1468_CR13","doi-asserted-by":"publisher","first-page":"2640","DOI":"10.1166\/jctn.2018.7513","volume":"15","author":"M Suguna","year":"2018","unstructured":"Suguna M, Prakash D, Thangam DY, Shobana G (2018) Heuristic task workflow scheduling in cloud using spot and on-demand instances. J Comput Theor Nanosci 15(8):2640\u20132644","journal-title":"J Comput Theor Nanosci"},{"key":"1468_CR14","doi-asserted-by":"crossref","unstructured":"Chen L, Li X, Ruiz R (2017) Cloud workflow scheduling with on-demand and spot block instances. In: 2017 IEEE 21st international conference on computer supported cooperative work in design (CSCWD). IEEE, pp 451\u2013456","DOI":"10.1109\/CSCWD.2017.8066736"},{"key":"1468_CR15","doi-asserted-by":"crossref","unstructured":"Sharma P, Lee S, Guo T, Irwin D, Shenoy P (2015) Spotcheck: designing a derivative iaas cloud on the spot market. In: Proceedings of the tenth European conference on computer systems, pp 1\u201315","DOI":"10.1145\/2741948.2741953"},{"key":"1468_CR16","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.future.2018.02.003","volume":"84","author":"SG Domanal","year":"2018","unstructured":"Domanal SG, Reddy GRM (2018) An efficient cost optimized scheduling for spot instances in heterogeneous cloud environment. Futur Gener Comput Syst 84:11\u201321","journal-title":"Futur Gener Comput Syst"},{"issue":"7","key":"1468_CR17","doi-asserted-by":"publisher","first-page":"1512","DOI":"10.1109\/TPDS.2018.2889851","volume":"30","author":"P Varshney","year":"2018","unstructured":"Varshney P, Simmhan Y (2018) Autobot: resilient and cost-effective scheduling of a bag of tasks on spot vms. IEEE Trans Parallel Distrib Syst 30(7):1512\u20131527","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"1468_CR18","doi-asserted-by":"crossref","unstructured":"Subramanya S, Guo T, Sharma P, Irwin D, Shenoy P (2015) Spoton: a batch computing service for the spot market. In: Proceedings of the sixth ACM symposium on cloud computing, pp 329\u2013341","DOI":"10.1145\/2806777.2806851"},{"key":"1468_CR19","doi-asserted-by":"crossref","unstructured":"Hargrove PH, Duell JC (2006) Berkeley lab checkpoint\/restart (blcr) for linux clusters. In: Journal of physics: conference series. IOP Publishing, 46, p 494.","DOI":"10.1088\/1742-6596\/46\/1\/067"},{"key":"1468_CR20","doi-asserted-by":"crossref","unstructured":"Munhoz V, Castro M, Mendizabal O (2022) Strategies for fault-tolerant tightly-coupled hpc workloads running on low-budget spot cloud infrastructures. In: 2022 IEEE 34th international symposium on computer architecture and high performance computing (SBAC-PAD), pp 263\u2013272. IEEE","DOI":"10.1109\/SBAC-PAD55451.2022.00037"},{"key":"1468_CR21","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/j.future.2022.07.007","volume":"137","author":"B Zolfaghari","year":"2022","unstructured":"Zolfaghari B, Abrishami S (2022) A multi-class workflow ensemble management system using on-demand and spot instances in cloud. Futur Gener Comput Syst 137:97\u2013110","journal-title":"Futur Gener Comput Syst"},{"key":"1468_CR22","doi-asserted-by":"crossref","unstructured":"Walters JP, Chaudhary V (2006) Application-level checkpointing techniques for parallel programs. In: International conference on distributed computing and internet technology. Springer, pp 221\u2013234","DOI":"10.1007\/11951957_21"},{"key":"1468_CR23","doi-asserted-by":"crossref","unstructured":"Karablieh F, Bazzi RA, Hicks M (2001) Compiler-assisted heterogeneous checkpointing. In: Proceedings 20th IEEE symposium on reliable distributed systems. IEEE, pp 56\u201365","DOI":"10.1109\/RELDIS.2001.969743"},{"key":"1468_CR24","doi-asserted-by":"crossref","unstructured":"Ramkumar B, Strumpen V (1997) Portable checkpointing for heterogeneous architectures. In: Proceedings of IEEE 27th international symposium on fault tolerant computing. IEEE, pp 58\u201367","DOI":"10.1109\/FTCS.1997.614078"},{"key":"1468_CR25","doi-asserted-by":"crossref","unstructured":"Jiang H, Chaudhary V (2002) Compile\/run-time support for thread migration. In: Proceedings 16th international parallel and distributed processing symposium. IEEE, p 9","DOI":"10.1109\/IPDPS.2002.1015547"},{"issue":"11","key":"1468_CR26","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1145\/1037187.1024421","volume":"39","author":"G Bronevetsky","year":"2004","unstructured":"Bronevetsky G, Marques D, Pingali K, Szwed P, Schulz M (2004) Application-level checkpointing for shared memory programs. ACM SIGPLAN Notices 39(11):235\u2013247","journal-title":"ACM SIGPLAN Notices"},{"key":"1468_CR27","doi-asserted-by":"crossref","unstructured":"Bronevetsky G, Marques D, Pingali K, Stodghill P (2003) Automated application-level checkpointing of mpi programs. In: Proceedings of the ninth ACM SIGPLAN symposium on principles and practice of parallel programming, pp 84\u201394","DOI":"10.1145\/781498.781513"},{"issue":"7","key":"1468_CR28","doi-asserted-by":"publisher","first-page":"1012","DOI":"10.1016\/j.future.2010.04.016","volume":"26","author":"G Rodr\u00edguez","year":"2010","unstructured":"Rodr\u00edguez G, Pardo XC, Mart\u00edn MJ, Gonz\u00e1lez P (2010) Performance evaluation of an application-level checkpointing solution on grids. Futur Gener Comput Syst 26(7):1012\u20131023","journal-title":"Futur Gener Comput Syst"},{"key":"1468_CR29","doi-asserted-by":"crossref","unstructured":"Karanika A, Oikonomou P, Kolomvatsos K, Loukopoulos T (2020) A demand-driven, proactive tasks management model at the edge. In: 2020 IEEE international conference on fuzzy systems (FUZZ-IEEE). IEEE, pp 1\u20138","DOI":"10.1109\/FUZZ48607.2020.9177653"},{"key":"1468_CR30","doi-asserted-by":"crossref","unstructured":"Wand MP, Jones MC (1995) Kernel smoothing. Chapman and Hall","DOI":"10.1007\/978-1-4899-4493-1"},{"key":"1468_CR31","unstructured":"R, Y, K, BN (2015) Approximations to standard normal distribution function. International journal of scientific and engineering research, 6(4)"},{"key":"1468_CR32","unstructured":"M, AK, T, AM (1995) A note on approximating the normal distribution function. Applied mathematical sciences, 2(9), 425\u2013429"},{"key":"1468_CR33","doi-asserted-by":"crossref","unstructured":"V\u2019yugin VV (2009) The follow perturbed leader algorithm protected from unbounded one-step losses. In: Algorithmic learning theory: 20th international conference, ALT 2009, Porto, Portugal, October 3-5, 2009. Proceedings 20. Springer, pp 38\u201352","DOI":"10.1007\/978-3-642-04414-4_8"},{"issue":"3","key":"1468_CR34","doi-asserted-by":"publisher","first-page":"682","DOI":"10.1016\/j.future.2012.08.015","volume":"29","author":"G Juve","year":"2013","unstructured":"Juve G, Chervenak A, Deelman E, Bharathi S, Mehta G, Vahi K (2013) Characterizing and profiling scientific workflows. Futur Gener Comput Syst 29(3):682\u2013692","journal-title":"Futur Gener Comput Syst"},{"key":"1468_CR35","doi-asserted-by":"crossref","unstructured":"Bharathi S, Chervenak A, Deelman E, Mehta G, Su M-H, Vahi K (2008) Characterization of scientific workflows. In: 3rd workshop on workflows in support of large-scale science. IEEE, pp 1\u201310","DOI":"10.1145\/1645164.1645167"},{"key":"1468_CR36","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1016\/j.future.2019.01.015","volume":"95","author":"RF Silva","year":"2019","unstructured":"Silva RF, Filgueira R, Deelman E, Pairo-Castineira E, Overton IM, Atkinson MP (2019) Using simple pid-inspired controllers for online resilient resource management of distributed scientific workflows. Futur Gener Comput Syst 95:615\u2013628","journal-title":"Futur Gener Comput Syst"},{"issue":"12","key":"1468_CR37","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1109\/MC.2007.421","volume":"40","author":"Y Gil","year":"2007","unstructured":"Gil Y, Deelman E, Ellisman M, Fahringer T, Fox G, Gannon D, Goble C, Livny M, Moreau L, Myers J (2007) Examining the challenges of scientific workflows. Computer 40(12):24\u201332","journal-title":"Computer"},{"issue":"9","key":"1468_CR38","doi-asserted-by":"publisher","first-page":"3197","DOI":"10.1371\/journal.pone.0003197","volume":"3","author":"J Livny","year":"2008","unstructured":"Livny J, Teonadi H, Livny M, Waldor MK (2008) High-throughput, kingdom-wide prediction and annotation of bacterial non-coding rnas. PLoS ONE 3(9):3197","journal-title":"PLoS ONE"},{"key":"1468_CR39","unstructured":"Rynge G, Mats andkeahey2020lessons\u00a0Juve, Kinney J, Good J, Berriman B, Merrihew A, Deelman E (2013) Producing an infrared multiwavelength galactic plane atlas using montage, pegasus and amazon web services. In: 23rd annual astronomical data analysis software and systems, ADASS, conference. Citeseer"},{"issue":"6","key":"1468_CR40","doi-asserted-by":"publisher","first-page":"428","DOI":"10.1016\/j.jcss.2009.11.005","volume":"76","author":"S Callaghan","year":"2010","unstructured":"Callaghan S, Deelman E, Gunter D, Juve G, Maechling P, Brooks C, Vahi K, Milner K, Graves R, Field E et al (2010) Scaling up workflow-based applications. J Comput Syst Sci 76(6):428\u2013446","journal-title":"J Comput Syst Sci"},{"issue":"10","key":"1468_CR41","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1063\/1.882861","volume":"52","author":"BC Barish","year":"1999","unstructured":"Barish BC, Weiss R (1999) Ligo and the detection of gravitational waves. Phys Today 52(10):44\u201350","journal-title":"Phys Today"},{"key":"1468_CR42","doi-asserted-by":"crossref","unstructured":"Palankar MR, Iamnitchi A, Ripeanu M, Garfinkel S (2008) Amazon s3 for science grids: a viable solution? In: International workshop on data-aware distributed computing, pp 55\u201364","DOI":"10.1145\/1383519.1383526"},{"key":"1468_CR43","doi-asserted-by":"crossref","unstructured":"Schad J, Dittrich J, Quian\u00e9-Ruiz J-A (2010) Runtime measurements in the cloud: observing, analyzing, and reducing variance. In: Proceedings of the VLDB endowment, 3(1\u20132):460\u2013471","DOI":"10.14778\/1920841.1920902"},{"issue":"1","key":"1468_CR44","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1109\/TCC.2015.2451649","volume":"6","author":"J Sahni","year":"2015","unstructured":"Sahni J, Vidyarthi DP (2015) A cost-effective deadline-constrained dynamic scheduling algorithm for scientific workflows in a cloud environment. IEEE Trans Cloud Comput 6(1):2\u201318","journal-title":"IEEE Trans Cloud Comput"},{"key":"1468_CR45","doi-asserted-by":"crossref","unstructured":"Mao M, Humphrey M (2012) A performance study on the vm startup time in the cloud. In: IEEE 5th international conference on cloud computing, pp 423\u2013430. IEEE","DOI":"10.1109\/CLOUD.2012.103"}],"container-title":["Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00607-025-01468-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00607-025-01468-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00607-025-01468-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,26]],"date-time":"2025-05-26T04:14:50Z","timestamp":1748232890000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00607-025-01468-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,15]]},"references-count":45,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["1468"],"URL":"https:\/\/doi.org\/10.1007\/s00607-025-01468-1","relation":{},"ISSN":["0010-485X","1436-5057"],"issn-type":[{"value":"0010-485X","type":"print"},{"value":"1436-5057","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,15]]},"assertion":[{"value":"28 August 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 March 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 April 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"This article does not contain any studies with human participants or animals performed by any of the authors.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}],"article-number":"112"}}