{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T18:01:37Z","timestamp":1775671297505,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T00:00:00Z","timestamp":1635724800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,11]]},"DOI":"10.1145\/3472883.3487011","type":"proceedings-article","created":{"date-parts":[[2021,10,27]],"date-time":"2021-10-27T10:48:16Z","timestamp":1635331696000},"page":"373-387","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Falkirk Wheel"],"prefix":"10.1145","author":[{"given":"Ionel","family":"Gog","sequence":"first","affiliation":[{"name":"UC Berkeley"}]},{"given":"Michael","family":"Isard","sequence":"additional","affiliation":[{"name":"Google Research"}]},{"given":"Mart\u00edn","family":"Abadi","sequence":"additional","affiliation":[{"name":"Google Research"}]}],"member":"320","published-online":{"date-parts":[[2021,11]]},"reference":[{"key":"e_1_3_2_2_1_1","first-page":"120","article-title":"Aurora: A New Model and Architecture for Data Stream Management","volume":"12","author":"Abadi Daniel J","year":"2003","unstructured":"Daniel J Abadi , Don Carney , Ugur Cetintemel , Mitch Cherniack , Christian Convey , Sangdon Lee , Michael Stonebraker , Nesime Tatbul , and Stan Zdonik . 2003 . Aurora: A New Model and Architecture for Data Stream Management . Proceedings of the VLDB Endowment 12 , 2 (2003), 120 -- 139 . Daniel J Abadi, Don Carney, Ugur Cetintemel, Mitch Cherniack, Christian Convey, Sangdon Lee, Michael Stonebraker, Nesime Tatbul, and Stan Zdonik. 2003. Aurora: A New Model and Architecture for Data Stream Management. Proceedings of the VLDB Endowment 12, 2 (2003), 120--139.","journal-title":"Proceedings of the VLDB Endowment"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-17524-9_3"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536229"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824076"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465272"},{"key":"e_1_3_2_2_6_1","unstructured":"Apache Software Foundation. Apache Flink. http:\/\/flink.apache.org.  Apache Software Foundation. Apache Flink. http:\/\/flink.apache.org."},{"key":"e_1_3_2_2_7_1","unstructured":"Apache Software Foundation. Apache Hudi. https:\/\/hudi.apache.org.  Apache Software Foundation. Apache Hudi. https:\/\/hudi.apache.org."},{"key":"e_1_3_2_2_8_1","unstructured":"Apache Software Foundation. Apache Kafka. http:\/\/kafka.apache.org.  Apache Software Foundation. Apache Kafka. http:\/\/kafka.apache.org."},{"key":"e_1_3_2_2_9_1","unstructured":"Apache Software Foundation. Apache Samza: A Distributed Stream Processing Framework. https:\/\/samza.apache.org.  Apache Software Foundation. Apache Samza: A Distributed Stream Processing Framework. https:\/\/samza.apache.org."},{"key":"e_1_3_2_2_10_1","unstructured":"Apache Software Foundation. Storm: Distributed and Fault-Tolerant Realtime Computation. https:\/\/storm.apache.org.  Apache Software Foundation. Storm: Distributed and Fault-Tolerant Realtime Computation. https:\/\/storm.apache.org."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1331904.1331907"},{"key":"e_1_3_2_2_12_1","unstructured":"Scottish Canals. The Falkirk Wheel. http:\/\/www.thefalkirkwheel.co.uk\/.  Scottish Canals. The Falkirk Wheel. http:\/\/www.thefalkirkwheel.co.uk\/."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137765.3137777"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465282"},{"key":"e_1_3_2_2_15_1","first-page":"1","article-title":"Distributed Snapshots: Determining Global States of Distributed Systems","volume":"3","author":"Mani Chandy K.","year":"1985","unstructured":"K. Mani Chandy and Leslie Lamport . 1985 . Distributed Snapshots: Determining Global States of Distributed Systems . ACM Transactions on Computer Systems 3 , 1 (Feb. 1985), 63--75. K. Mani Chandy and Leslie Lamport. 1985. Distributed Snapshots: Determining Global States of Distributed Systems. ACM Transactions on Computer Systems 3, 1 (Feb. 1985), 63--75.","journal-title":"ACM Transactions on Computer Systems"},{"key":"e_1_3_2_2_16_1","unstructured":"Sanket Chintapalli Derek Dagit Bobby Evans Reza Farivar Tom Graves Mark Holderbaugh Zhuo Liu Kyle Nusbaum Kishorkumar Patil Boyang Jerry Peng and Paul Poulosky. Benchmarking Streaming Computation Engines at Yahoo! https:\/\/yahooeng.tumblr.com\/post\/135321837876.  Sanket Chintapalli Derek Dagit Bobby Evans Reza Farivar Tom Graves Mark Holderbaugh Zhuo Liu Kyle Nusbaum Kishorkumar Patil Boyang Jerry Peng and Paul Poulosky. Benchmarking Streaming Computation Engines at Yahoo! https:\/\/yahooeng.tumblr.com\/post\/135321837876."},{"key":"e_1_3_2_2_17_1","volume-title":"MapReduce Online. In Proceedings of the 7th USENIX Symposium on Networked Systems Design and Implementation","author":"Condie Tyson","year":"2010","unstructured":"Tyson Condie , Neil Conway , Peter Alvaro , Joseph M. Hellerstein , Khaled Elmeleegy , and Russell Sears . 2010 . MapReduce Online. In Proceedings of the 7th USENIX Symposium on Networked Systems Design and Implementation ( San Jose, California) (NSDI'10). Tyson Condie, Neil Conway, Peter Alvaro, Joseph M. Hellerstein, Khaled Elmeleegy, and Russell Sears. 2010. MapReduce Online. In Proceedings of the 7th USENIX Symposium on Networked Systems Design and Implementation (San Jose, California) (NSDI'10)."},{"key":"e_1_3_2_2_18_1","volume-title":"Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI) (OSDI).","author":"Dean Jeffrey","year":"2004","unstructured":"Jeffrey Dean and Sanjay Ghemawat . 2004 . MapReduce: Simplified Data Processing on Large Clusters . In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI) (OSDI). Jeffrey Dean and Sanjay Ghemawat. 2004. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI) (OSDI)."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/568522.568525"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/2643634.2643640"},{"key":"e_1_3_2_2_21_1","unstructured":"Jamie Grier. Extending the Yahoo! Streaming Benchmark. https:\/\/data-artisans.com\/blog\/extending-the-yahoo-streaming-benchmark.  Jamie Grier. Extending the Yahoo! Streaming Benchmark. https:\/\/data-artisans.com\/blog\/extending-the-yahoo-streaming-benchmark."},{"key":"e_1_3_2_2_22_1","volume-title":"Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference (USENIX ATC","author":"Hunt Patrick","year":"2010","unstructured":"Patrick Hunt , Mahadev Konar , Flavio Paiva Junqueira , and Benjamin Reed . 2010 . ZooKeeper: Wait-free Coordination for Internet-scale Systems . In Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference (USENIX ATC , Vol. 8). Patrick Hunt, Mahadev Konar, Flavio Paiva Junqueira, and Benjamin Reed. 2010. ZooKeeper: Wait-free Coordination for Internet-scale Systems. In Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference (USENIX ATC, Vol. 8)."},{"key":"e_1_3_2_2_23_1","volume-title":"Proceedings of the 21st International Conference on Data Engineering (ICDE). IEEE Computer Society","author":"Hwang Jeong-Hyon","year":"2005","unstructured":"Jeong-Hyon Hwang , Magdalena Balazinska , Alexander Rasin , Ugur Cetintemel , Michael Stonebraker , and Stan Zdonik . 2005 . High-Availability Algorithms for Distributed Stream Processing . In Proceedings of the 21st International Conference on Data Engineering (ICDE). IEEE Computer Society , Washington, DC, USA, 779--790. Jeong-Hyon Hwang, Magdalena Balazinska, Alexander Rasin, Ugur Cetintemel, Michael Stonebraker, and Stan Zdonik. 2005. High-Availability Algorithms for Distributed Stream Processing. In Proceedings of the 21st International Conference on Data Engineering (ICDE). IEEE Computer Society, Washington, DC, USA, 779--790."},{"key":"e_1_3_2_2_24_1","volume-title":"Proceedings of the 21st IEEE International Conference on Data Engineering (ICDE). 779--790","author":"Hwang Jeong-Hyon","year":"2005","unstructured":"Jeong-Hyon Hwang , Magdalena Balazinska , Alex Rasin , Ugur Cetintemel , Michael Stonebraker , and Stan Zdonik . 2005 . High-Availability Algorithms for Distributed Stream Processing . In Proceedings of the 21st IEEE International Conference on Data Engineering (ICDE). 779--790 . Jeong-Hyon Hwang, Magdalena Balazinska, Alex Rasin, Ugur Cetintemel, Michael Stonebraker, and Stan Zdonik. 2005. High-Availability Algorithms for Distributed Stream Processing. In Proceedings of the 21st IEEE International Conference on Data Engineering (ICDE). 779--790."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1272996.1273005"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/324493.325074"},{"key":"e_1_3_2_2_27_1","volume-title":"Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation","author":"Lin Wei","year":"2016","unstructured":"Wei Lin , Zhengping Qian , Junwei Xu , Sen Yang , Jingren Zhou , and Lidong Zhou . 2016 . StreamScope: Continuous Reliable Distributed Processing of Big Data Streams . In Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation ( Santa Clara, California) (NSDI). USENIX Association, 439--453. Wei Lin, Zhengping Qian, Junwei Xu, Sen Yang, Jingren Zhou, and Lidong Zhou. 2016. StreamScope: Continuous Reliable Distributed Processing of Big Data Streams. In Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (Santa Clara, California) (NSDI). USENIX Association, 439--453."},{"key":"e_1_3_2_2_28_1","unstructured":"Frank McSherry. The Yahoo Streaming Benchmark. https:\/\/github.com\/frankmcsherry\/blog\/blob\/master\/posts\/2018-02-11.md.  Frank McSherry. The Yahoo Streaming Benchmark. https:\/\/github.com\/frankmcsherry\/blog\/blob\/master\/posts\/2018-02-11.md."},{"key":"e_1_3_2_2_29_1","volume-title":"Differential Dataflow. In Proceedings of the 6th Conference on Innovative Data Systems Research (CIDR).","author":"McSherry Frank","year":"2013","unstructured":"Frank McSherry , Derek G. Murray , Rebecca Isaacs , and Michael Isard . 2013 . Differential Dataflow. In Proceedings of the 6th Conference on Innovative Data Systems Research (CIDR). Frank McSherry, Derek G. Murray, Rebecca Isaacs, and Michael Isard. 2013. Differential Dataflow. In Proceedings of the 6th Conference on Innovative Data Systems Research (CIDR)."},{"key":"e_1_3_2_2_30_1","unstructured":"Microsoft. Azure Event Hubs. http:\/\/azure.microsoft.com\/en-us\/services\/event-hubs\/.  Microsoft. Azure Event Hubs. http:\/\/azure.microsoft.com\/en-us\/services\/event-hubs\/."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522738"},{"key":"e_1_3_2_2_32_1","volume-title":"Proceedings of the 8th USENIX Symposium on Networked Systems Design and Implementation (NSDI).","author":"Murray Derek G.","year":"2011","unstructured":"Derek G. Murray , Malte Schwarzkopf , Christopher Smowton , Steven Smith , Anil Madhavapeddy , and Steven Hand . 2011 . CIEL: a Universal Execution Engine for Distributed Data-Flow Computing . In Proceedings of the 8th USENIX Symposium on Networked Systems Design and Implementation (NSDI). Derek G. Murray, Malte Schwarzkopf, Christopher Smowton, Steven Smith, Anil Madhavapeddy, and Steven Hand. 2011. CIEL: a Universal Execution Engine for Distributed Data-Flow Computing. In Proceedings of the 8th USENIX Symposium on Networked Systems Design and Implementation (NSDI)."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465351.2465353"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007568.1007662"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595641"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132750"},{"key":"e_1_3_2_2_37_1","volume-title":"Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI).","author":"Zaharia Matei","year":"2012","unstructured":"Matei Zaharia , Mosharaf Chowdhury , Tathagata Das , Ankur Dave , Justin Ma , Murphy McCauley , Michael Franklin , Scott Shenker , and Ion Stoica . 2012 . Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing . In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI). Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauley, Michael Franklin, Scott Shenker, and Ion Stoica. 2012. Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI)."}],"event":{"name":"SoCC '21: ACM Symposium on Cloud Computing","location":"Seattle WA USA","acronym":"SoCC '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGOPS ACM Special Interest Group on Operating Systems"]},"container-title":["Proceedings of the ACM Symposium on Cloud Computing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472883.3487011","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3472883.3487011","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:57Z","timestamp":1750191117000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472883.3487011"}},"subtitle":["Rollback Recovery for Dataflow Systems"],"short-title":[],"issued":{"date-parts":[[2021,11]]},"references-count":37,"alternative-id":["10.1145\/3472883.3487011","10.1145\/3472883"],"URL":"https:\/\/doi.org\/10.1145\/3472883.3487011","relation":{},"subject":[],"published":{"date-parts":[[2021,11]]},"assertion":[{"value":"2021-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}