{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,1,6]],"date-time":"2023-01-06T10:52:03Z","timestamp":1673002323807},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2010,7,28]],"date-time":"2010-07-28T00:00:00Z","timestamp":1280275200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/2.0"},{"start":{"date-parts":[[2010,7,28]],"date-time":"2010-07-28T00:00:00Z","timestamp":1280275200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/2.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Braz Comput Soc"],"published-print":{"date-parts":[[2010,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Opportunistic computational grids use idle processor cycles from shared machines to enable the execution of long-running parallel applications. Besides computational power, these applications may also consume and generate large amounts of data, requiring an efficient data storage and management infrastructure. In this article, we present an integrated middleware infrastructure that enables the use of not only idle processor cycles, but also unused disk space of shared machines. Our middleware enables the reliable distributed storage of application data in the shared machines in a redundant and fault-tolerant way. A\u00a0checkpointing-based mechanism monitors the execution of parallel applications, saves periodical checkpoints in the shared machines, and in case of node failures, supports the application migration across heterogeneous grid nodes. We evaluate the feasibility of our middleware using experiments and simulations. Our evaluation shows that the proposed middleware promotes important improvements in grid data management reliability while imposing a low performance overhead.<\/jats:p>","DOI":"10.1007\/s13173-010-0016-0","type":"journal-article","created":{"date-parts":[[2010,7,27]],"date-time":"2010-07-27T10:04:08Z","timestamp":1280225048000},"page":"177-190","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Reliable management of checkpointing and application data in\u00a0opportunistic grids"],"prefix":"10.1007","volume":"16","author":[{"given":"Raphael Y.","family":"de Camargo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fernando","family":"Castor","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabio","family":"Kon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2010,7,28]]},"reference":[{"issue":"3","key":"16_CR1","first-page":"45","volume":"6","author":"G Antoniu","year":"2005","unstructured":"Antoniu G, Boug\u00e9 L, Jan M (2005) Juxmem: An adaptive supportive platform for data sharing on the grid. Scalable Comput Pract Exp 6(3):45\u201355","journal-title":"Scalable Comput Pract Exp"},{"key":"16_CR2","unstructured":"Batten C, Barr K, Saraf A, Trepetin S (2002) pStore: A secure peer-to-peer backup system. Tech Rep MIT-LCS-TM-632, MIT LCS"},{"key":"16_CR3","unstructured":"Blackham B (2009) Cryopid page. http:\/\/cryopid.berlios.de\/"},{"key":"16_CR4","unstructured":"Blake C, Rodrigues R (2003) High availability, scalable storage, dynamic peer networks: pick two. In: HotOS\u201903: Proc of the 9th workshop on hot topics in operating systems, USENIX"},{"issue":"7","key":"16_CR5","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1145\/362686.362692","volume":"13","author":"BH Bloom","year":"1970","unstructured":"Bloom BH (1970) Space\/time trade-offs in hash coding with allowable errors. Commun ACM 13(7):422\u2013426. doi:10.1145\/362686.362692","journal-title":"Commun ACM"},{"issue":"1","key":"16_CR6","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1145\/345063.339345","volume":"28","author":"WJ Bolosky","year":"2000","unstructured":"Bolosky WJ, Douceur JR, Ely D, Theimer M (2000) Feasibility of a serverless distributed file system deployed on an existing set of desktop pcs. SIGMETRICS Perform Eval Rev 28(1):34\u201343. doi:10.1145\/345063.339345","journal-title":"SIGMETRICS Perform Eval Rev"},{"key":"16_CR7","doi-asserted-by":"crossref","unstructured":"Bronevetsky G, Marques D, Pingali K, Stodghill P (2003) Automated application-level checkpointing of MPI programs. In: PPoPP \u201903: Proceedings of the 9th ACM, SIGPLAN symposium on principles and practice of parallel programming, pp 84\u201389","DOI":"10.1145\/781498.781513"},{"key":"16_CR8","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/SC.2004.7","volume-title":"SC \u201904: Proceedings of the 2004 ACM\/IEEE conference on supercomputing","author":"M Cai","year":"2004","unstructured":"Cai M, Chervenak A, Frank M (2004) A peer-to-peer replica location service based on a distributed hash table. In: SC \u201904: Proceedings of the 2004 ACM\/IEEE conference on supercomputing. IEEE Computer Society, Washington, p 56. doi:10.1109\/SC.2004.7"},{"key":"16_CR9","doi-asserted-by":"crossref","unstructured":"de Camargo RY, Kon F (2006) Distributed data storage for opportunistic grids. In: ACM\/IFIP\/USENIX middleware doctoral symp, Melbourne, Australia","DOI":"10.1145\/1169100.1169103"},{"key":"16_CR10","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1109\/CCGRID.2007.37","volume-title":"Proceedings of the 7th IEEE international symposium on cluster computing and the grid (CCGRID 2007)","author":"RY de Camargo","year":"2007","unstructured":"de Camargo RY, Kon F (2007) Design and implementation of a middleware for data storage in opportunistic grids. In: Proceedings of the 7th IEEE international symposium on cluster computing and the grid (CCGRID 2007), Rio de Janeiro, Brazil. IEEE Computer Society, Washington, pp 23\u201330"},{"key":"16_CR11","unstructured":"de Camargo RY, Kon F, Goldman A (2005) Portable checkpointing and communication for BSP applications on dynamic heterogeneous Grid environments. In: SBAC-PAD\u201905: The 17th international symposium on computer architecture and high performance computing, Rio de Janeiro, Brazil"},{"key":"16_CR12","doi-asserted-by":"crossref","unstructured":"de Camargo RY, Castor Filho F, Kon F (2009) Efficient maintenance of distributed data in highly dynamic opportunistic grids. In: Proceedings of the 24th ACM symposium on applied computing (SAC 2009), Track on dependable and adaptive distributed systems (DADS), Honolulu, HI, USA. ACM, New York","DOI":"10.1145\/1529282.1529515"},{"key":"16_CR13","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1109\/HPDC.2004.1323525","volume-title":"HPDC \u201904: Proceedings of the 13th IEEE international symposium on high performance distributed computing (HPDC\u201904)","author":"AL Chervenak","year":"2004","unstructured":"Chervenak AL, Palavalli N, Bharathi S, Kesselman C, Schwartzkopf R (2004) Performance and scalability of a replica location service. In: HPDC \u201904: Proceedings of the 13th IEEE international symposium on high performance distributed computing (HPDC\u201904). IEEE Computer Society, Washington, pp\u00a0182\u2013191. doi:10.1109\/HPDC.2004.27"},{"key":"16_CR14","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1145\/217838.217868","volume-title":"In: OOPSLA \u201995: Proceedings of the 10th ACM conference on object-oriented programming systems, languages, and applications","author":"S Chiba","year":"1995","unstructured":"Chiba S (1995) A metaobject protocol for C++. In: OOPSLA \u201995: Proceedings of the 10th ACM conference on object-oriented programming systems, languages, and applications, pp 285\u2013299"},{"issue":"5","key":"16_CR15","doi-asserted-by":"publisher","first-page":"597","DOI":"10.1016\/S0743-7315(03)00006-6","volume":"63","author":"A Chien","year":"2003","unstructured":"Chien A, Calder B, Elbert S, Bhatia K (2003) Entropia: architecture and performance of an enterprise desktop grid system. J Parallel Distrib Comput 63(5):597\u2013610. doi:10.1016\/S0743-7315(03)00006-6","journal-title":"J Parallel Distrib Comput"},{"issue":"3","key":"16_CR16","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1007\/s10723-006-9040-x","volume":"4","author":"W Cirne","year":"2006","unstructured":"Cirne W, Brasileiro F, Andrade N, Costa L, Andrade A, Novaes\u00a0R, Mowbray M (2006) Labs of the world, unite!!! J Grid Comput 4(3):225\u2013246","journal-title":"J Grid Comput"},{"key":"16_CR17","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1145\/502034.502054","volume-title":"SOSP \u201901: Proceedings of the eighteenth ACM symposium on operating systems principles","author":"F Dabek","year":"2001","unstructured":"Dabek F, Kaashoek MF, Karger D, Stoica I Morris R (2001) Wide-area cooperative storage with cfs. In: SOSP \u201901: Proceedings of the eighteenth ACM symposium on operating systems principles. ACM, New York, pp 202\u2013215. doi:10.1145\/502034.502054"},{"key":"16_CR18","doi-asserted-by":"crossref","unstructured":"Domingues P, Marques P, Silva L (2005) Resource usage of windows computer laboratories. In: Proc of the int conf on parallel processing (ICCP\u201905): workshops, pp 469\u2013476","DOI":"10.1109\/ICPPW.2005.77"},{"issue":"3","key":"16_CR19","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1145\/568522.568525","volume":"34","author":"M Elnozahy","year":"2002","unstructured":"Elnozahy M, Alvisi L, Wang YM, Johnson DB (2002) A survey of rollback-recovery protocols in message-passing systems. ACM Comput Surv 34(3):375\u2013408","journal-title":"ACM Comput Surv"},{"key":"16_CR20","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1002\/cpe.824","volume":"16","author":"A Goldchleger","year":"2004","unstructured":"Goldchleger A, Kon F, Goldman A, Finger M, Bezerra GC (2004) InteGrade: Object-oriented grid middleware leveraging idle computing power of desktop machines. Concurr Comput Pract Exp 16:449\u2013459","journal-title":"Concurr Comput Pract Exp"},{"key":"16_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1101499.1101504","volume-title":"MGC \u201905: Proceedings of the 3rd international workshop on middleware for grid computing","author":"A Goldchleger","year":"2005","unstructured":"Goldchleger A, Goldman A, Hayashida U, Kon F (2005) The implementation of the bsp parallel computing model on the integrade grid middleware. In: MGC \u201905: Proceedings of the 3rd international workshop on middleware for grid computing. ACM, New York, pp 1\u20136. doi:10.1145\/1101499.1101504"},{"key":"16_CR22","first-page":"509","volume-title":"ICCSA \u201905: The 2005 international conference on computational science and its applications","author":"UK Hayashida","year":"2005","unstructured":"Hayashida UK, Okuda K, Panetta J, Song SW (2005) Generating parallel algorithms for cluster and grid computing. In: ICCSA \u201905: The 2005 international conference on computational science and its applications. Springer, Berlin, pp 509\u2013516"},{"key":"16_CR23","doi-asserted-by":"crossref","unstructured":"Karablieh F, Bazzi RA, Hicks M (2001) Compiler-assisted heterogeneous checkpointing. In: SRDS \u201901: Proceedings of the 20th IEEE symposium on reliable distributed systems, New Orleans, USA, pp 56\u201365","DOI":"10.1109\/RELDIS.2001.969743"},{"key":"16_CR24","volume-title":"Pattern-oriented software architecture, Volume 3: patterns for resource management","author":"M Kircher","year":"2004","unstructured":"Kircher M, Jain P (2004) Pattern-oriented software architecture, Volume 3: patterns for resource management. Wiley, New York"},{"issue":"7","key":"16_CR25","doi-asserted-by":"publisher","first-page":"558","DOI":"10.1145\/359545.359563","volume":"21","author":"L Lamport","year":"1978","unstructured":"Lamport L (1978) Time, clocks, and the ordering of events in a distributed system. Commun ACM 21(7):558\u2013565","journal-title":"Commun ACM"},{"key":"16_CR26","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1109\/P2P.2004.38","volume-title":"P2P \u201904: Proc of the 4th int conf on peer-to-peer computing","author":"M Landers","year":"2004","unstructured":"Landers M, Zhang H, Tan KL (2004) Peerstore: Better performance by relaxing in peer-to-peer backup. In: P2P \u201904: Proc of the 4th int conf on peer-to-peer computing. IEEE Computer Society, Washington, pp\u00a072\u201379. doi:10.1109\/P2P.2004.38"},{"key":"16_CR27","doi-asserted-by":"crossref","unstructured":"Litzkow M, Livny M, Mutka M (1988) Condor\u2014a hunter of idle workstations. In: ICDCS \u201988: Proceedings of the 8th int conference of distributed computing systems, pp 104\u2013111","DOI":"10.1109\/DCS.1988.12507"},{"key":"16_CR28","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1109\/NCA.2008.38","volume-title":"Proceedings of the 2008 seventh IEEE international symposium on network computing and applications","author":"A Luckow","year":"2008","unstructured":"Luckow A, Schnor B (2008) Adaptive checkpoint replication for supporting the fault tolerance of applications in the grid. In: Proceedings of the 2008 seventh IEEE international symposium on network computing and applications. IEEE Computer Society, Washington, pp 299\u2013306. doi:10.1109\/NCA.2008.38"},{"issue":"12","key":"16_CR29","doi-asserted-by":"publisher","first-page":"1237","DOI":"10.1109\/71.737699","volume":"9","author":"QM Malluhi","year":"1998","unstructured":"Malluhi QM, Johnston WE (1998) Coding for high availability of a distributed-parallel storage system. IEEE Trans Parallel Distrib Syst 9(12):1237\u20131252. doi:10.1109\/71.737699","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"4","key":"16_CR30","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1016\/0166-5316(91)90005-N","volume":"12","author":"MW Mutka","year":"1991","unstructured":"Mutka MW, Livny M (1991) The available capacity of a privately owned workstation environment. Perform Eval 12(4):269\u2013284. doi:10.1016\/0166-5316(91)90005-N","journal-title":"Perform Eval"},{"key":"16_CR31","unstructured":"Plank JS, Kingsley MBG, Li K (1995) Libckpt: Transparent checkpointing under unix. In: Proceedings of the USENIX winter 1995 technical conference, pp 213\u2013323"},{"issue":"10","key":"16_CR32","doi-asserted-by":"publisher","first-page":"972","DOI":"10.1109\/71.730527","volume":"9","author":"JS Plank","year":"1998","unstructured":"Plank JS, Li K, Puening MA (1998) Diskless checkpointing. IEEE Trans Parallel Distrib Syst 9(10):972\u2013986. doi:10.1109\/71.730527","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"16_CR33","doi-asserted-by":"crossref","unstructured":"Pruyne J, Livny M (1996) Managing checkpoints for parallel programs. In: IPPS \u201996: Proceedings of the workshop on job scheduling strategies for parallel processing. Springer, London, pp\u00a0140\u2013154","DOI":"10.1007\/BFb0022292"},{"issue":"2","key":"16_CR34","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1145\/62044.62050","volume":"36","author":"MO Rabin","year":"1989","unstructured":"Rabin MO (1989) Efficient dispersal of information for security, load balancing, and fault tolerance. J ACM 36(2):335\u2013348. doi:10.1145\/62044.62050","journal-title":"J ACM"},{"key":"16_CR35","volume-title":"HPDC \u201902: Proceedings of the 11th IEEE international symposium on high performance distributed computing","author":"M Ripeanu","year":"2002","unstructured":"Ripeanu M, Foster I (2002) A decentralized, adaptive replica location mechanism. In: HPDC \u201902: Proceedings of the 11th IEEE international symposium on high performance distributed computing. IEEE Computer Society, Washington"},{"key":"16_CR36","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1145\/502034.502053","volume-title":"SOSP \u201901: Proceedings of the eighteenth ACM symposium on operating systems principles","author":"A Rowstron","year":"2001","unstructured":"Rowstron A, Druschel P (2001) Storage management and caching in past, a large-scale, persistent peer-to-peer storage utility. In: SOSP \u201901: Proceedings of the eighteenth ACM symposium on operating systems principles. ACM, New York, pp 188\u2013201. doi:10.1145\/502034.502053"},{"key":"16_CR37","doi-asserted-by":"crossref","unstructured":"Rowstron AIT, Druschel P (2001) Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems. In: Middleware 2001: IFIP\/ACM international conference on distributed systems platforms, Heidelberg, Germany, pp 329\u2013350","DOI":"10.1007\/3-540-45518-3_18"},{"key":"16_CR38","first-page":"214.2","volume-title":"IPDPS \u201903: Proceedings of the 17th international symposium on parallel and distributed processing","author":"P Sobe","year":"2003","unstructured":"Sobe P (2003) Stable checkpointing in distributed systems without shared disks. In: IPDPS \u201903: Proceedings of the 17th international symposium on parallel and distributed processing. IEEE Computer Society, Washington, p\u00a0214.2"},{"issue":"1","key":"16_CR39","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1109\/TNET.2002.808407","volume":"11","author":"I Stoica","year":"2003","unstructured":"Stoica I, Morris R, Karger D, Kaashock M, Balakrishman H (2003) Chord: a scalable peer-to-peer lookup protocol for internet applications. IEEE\/ACM Trans Netw 11(1):17\u201332","journal-title":"IEEE\/ACM Trans Netw"},{"key":"16_CR40","unstructured":"Strumpen V, Ramkumar B (1996) Portable checkpointing and recovery in heterogeneous environments. Tech Rep UI-ECE TR-96.6.1, University of Iowa"},{"issue":"8","key":"16_CR41","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1145\/79173.79181","volume":"33","author":"L Valiant","year":"1990","unstructured":"Valiant L (1990) A bridging model for parallel computation. Commun ACM 33(8):103\u2013111","journal-title":"Commun ACM"},{"key":"16_CR42","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/SC.2005.27","volume-title":"SC \u201905: Proceedings of the 2005 ACM\/IEEE conference on supercomputing","author":"SS Vazhkudai","year":"2005","unstructured":"Vazhkudai SS, Ma X, Freeh VW, Strickland JW, Tammineedi N, Scott SL (2005) Freeloader: Scavenging desktop storage resources for scientific data. In: SC \u201905: Proceedings of the 2005 ACM\/IEEE conference on supercomputing. IEEE Computer Society, Washington, p 56. doi:10.1007\/s13173-010-0016-0"},{"key":"16_CR43","first-page":"328","volume-title":"IPTPS \u201901: Revised papers from the first international workshop on peer-to-peer systems","author":"H Weatherspoon","year":"2002","unstructured":"Weatherspoon H, Kubiatowicz J (2002) Erasure coding vs. replication: a quantitative comparison. In: IPTPS \u201901: Revised papers from the first international workshop on peer-to-peer systems. Springer, London, pp 328\u2013338"}],"container-title":["Journal of the Brazilian Computer Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13173-010-0016-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13173-010-0016-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s13173-010-0016-0","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13173-010-0016-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,31]],"date-time":"2021-08-31T21:00:44Z","timestamp":1630443644000},"score":1,"resource":{"primary":{"URL":"https:\/\/journal-bcs.springeropen.com\/articles\/10.1007\/s13173-010-0016-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,7,28]]},"references-count":43,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2010,9]]}},"alternative-id":["16"],"URL":"https:\/\/doi.org\/10.1007\/s13173-010-0016-0","relation":{},"ISSN":["0104-6500","1678-4804"],"issn-type":[{"value":"0104-6500","type":"print"},{"value":"1678-4804","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,7,28]]},"assertion":[{"value":"22 January 2010","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 June 2010","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 July 2010","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}