{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T21:12:36Z","timestamp":1768079556456,"version":"3.49.0"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2016,11]]},"abstract":"<jats:p>\n            Fault tolerance is critical for distributed stream processing systems, yet achieving error-free fault tolerance often incurs substantial performance overhead. We present\n            <jats:italic>AF-Stream<\/jats:italic>\n            , a distributed stream processing system that addresses the trade-off between performance and accuracy in fault tolerance. AF-Stream builds on a notion called\n            <jats:italic>approximate fault tolerance<\/jats:italic>\n            , whose idea is to mitigate backup overhead by adaptively issuing backups, while ensuring that the errors upon failures are bounded with theoretical guarantees. Our AF-Stream design provides an extensible programming model for incorporating general streaming algorithms, and also exports only few threshold parameters for configuring approximation fault tolerance. Experiments on Amazon EC2 show that AF-Stream maintains high performance (compared to no fault tolerance) and high accuracy after multiple failures (compared to no failures) under various streaming algorithms.\n          <\/jats:p>","DOI":"10.14778\/3021924.3021925","type":"journal-article","created":{"date-parts":[[2017,1,24]],"date-time":"2017-01-24T15:29:41Z","timestamp":1485271781000},"page":"73-84","source":"Crossref","is-referenced-by-count":23,"title":["Toward high-performance distributed stream processing via approximate fault tolerance"],"prefix":"10.14778","volume":"10","author":[{"given":"Qun","family":"Huang","sequence":"first","affiliation":[{"name":"The Chinese University of Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patrick P. C.","family":"Lee","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2016,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-003-0095-z"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465351.2465355"},{"key":"e_1_2_1_3_1","volume-title":"Spark Summit","author":"Agarwal S.","year":"2015"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536229"},{"key":"e_1_2_1_5_1","unstructured":"Apache Flume. http:\/\/flume.apache.org.  Apache Flume. http:\/\/flume.apache.org."},{"key":"e_1_2_1_6_1","unstructured":"Apache Kafka. http:\/\/kafka.apache.org.  Apache Kafka. http:\/\/kafka.apache.org."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1066157.1066160"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038916.2038923"},{"key":"e_1_2_1_9_1","unstructured":"CAIDA Anonymized Internet Traces 2014. http:\/\/www.caida.org\/data\/passive\/passive_2014_dataset.xml.  CAIDA Anonymized Internet Traces 2014. http:\/\/www.caida.org\/data\/passive\/passive_2014_dataset.xml."},{"key":"e_1_2_1_10_1","volume-title":"CIDR","author":"Cherniack M.","year":"2003"},{"key":"e_1_2_1_11_1","first-page":"21","volume-title":"MapReduce Online. In Proc. of NSDI","author":"Condie T.","year":"2010"},{"key":"e_1_2_1_12_1","volume-title":"Sketches. Now Publishers Inc.","author":"Cormode G.","year":"2012"},{"key":"e_1_2_1_13_1","first-page":"1545","volume":"1534","author":"Cormode G.","year":"2004","journal-title":"In Proc. of INFOCOM, pages"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jalgor.2003.12.001"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2670979.2670995"},{"key":"e_1_2_1_16_1","first-page":"107","volume-title":"Proc. of OSDI","author":"Dean J.","year":"2004"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/633025.633056"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465282"},{"key":"e_1_2_1_19_1","first-page":"49","volume-title":"Proc. of USENIX ATC","author":"Fernandez R. C.","year":"2014"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2010.72"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/304182.304208"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807128.1807139"},{"key":"e_1_2_1_23_1","first-page":"1223","volume-title":"Proc. of NIPS","author":"Ho Q.","year":"2013"},{"key":"e_1_2_1_24_1","first-page":"856","volume-title":"Proc. of NIPS","author":"Hoffman M.","year":"2010"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/2567709.2502622"},{"key":"e_1_2_1_26_1","first-page":"25","volume-title":"Proc. of USENIX ATC","author":"Hu L.","year":"2014"},{"key":"e_1_2_1_27_1","volume-title":"CUHK","author":"Huang Q.","year":"2016"},{"key":"e_1_2_1_28_1","first-page":"11","volume-title":"Proc. of USENIX ATC","author":"Hunt P.","year":"2010"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2005.72"},{"key":"e_1_2_1_30_1","first-page":"185","volume":"176","author":"Hwang J.-h.","year":"2007","journal-title":"A Cooperative, Self-Configuring High-Availability Solution for Stream Processing. In Proc. of ICDE, pages"},{"key":"e_1_2_1_31_1","first-page":"87","volume-title":"Proc. of OSDI","author":"Jain N.","year":"2008"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807290"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742788"},{"key":"e_1_2_1_34_1","first-page":"2331","volume-title":"Proc. of NIPS","author":"Langford J.","year":"2009"},{"key":"e_1_2_1_35_1","first-page":"583","volume-title":"Su. Scaling Distributed Machine Learning with the Parameter Server. In Proc. of OSDI","author":"Li M.","year":"2014"},{"key":"e_1_2_1_36_1","first-page":"439","volume-title":"Proc. of NSDI","author":"Lin W.","year":"2016"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSN.2014.91"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807128.1807138"},{"key":"e_1_2_1_39_1","first-page":"9","volume-title":"Proc. of USENIX ATC","author":"Logothetis D.","year":"2011"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/564691.564721"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2011.29"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522738"},{"key":"e_1_2_1_43_1","unstructured":"NatSys Lab. http:\/\/natsys-lab.com.  NatSys Lab. http:\/\/natsys-lab.com."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2010.172"},{"key":"e_1_2_1_45_1","volume-title":"KDD-Cup Workshop","author":"Niu Y.","year":"2012"},{"key":"e_1_2_1_46_1","unstructured":"Project Gutenberg. http:\/\/www.gutenberg.org.  Project Gutenberg. http:\/\/www.gutenberg.org."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806777.2806934"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465351.2465353"},{"key":"e_1_2_1_49_1","first-page":"275","volume-title":"Proc. of NSDI","author":"Rabkin A.","year":"2014"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007568.1007662"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSST.2010.5496972"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920931"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1644893.1644932"},{"key":"e_1_2_1_54_1","unstructured":"Spark Kafka Integration Guide. http:\/\/spark.apache.org\/docs\/latest\/streaming-kafka-integration.html.  Spark Kafka Integration Guide. http:\/\/spark.apache.org\/docs\/latest\/streaming-kafka-integration.html."},{"key":"e_1_2_1_55_1","unstructured":"Storm. http:\/\/storm.apache.org.  Storm. http:\/\/storm.apache.org."},{"key":"e_1_2_1_56_1","unstructured":"Storm Kafka Integration Guide. http:\/\/storm.apache.org\/releases\/2.0.0-SNAPSHOT\/storm-kafka.html.  Storm Kafka Integration Guide. http:\/\/storm.apache.org\/releases\/2.0.0-SNAPSHOT\/storm-kafka.html."},{"key":"e_1_2_1_57_1","unstructured":"Trident. http:\/\/storm.apache.org\/documentation\/Trident-tutorial.html.  Trident. http:\/\/storm.apache.org\/documentation\/Trident-tutorial.html."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2012.108"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806777.2806778"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783323"},{"key":"e_1_2_1_61_1","first-page":"29","volume-title":"Proc. of NSDI","author":"Yu M.","year":"2013"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522737"},{"key":"e_1_2_1_63_1","unstructured":"Zero Data Loss in Spark Streaming. http:\/\/databricks.com\/blog\/2015\/01\/15\/improved-driver-fault-tolerance-and-zero-data-loss-in-spark-streaming.html.  Zero Data Loss in Spark Streaming. http:\/\/databricks.com\/blog\/2015\/01\/15\/improved-driver-fault-tolerance-and-zero-data-loss-in-spark-streaming.html."},{"key":"e_1_2_1_64_1","unstructured":"ZeroMQ. http:\/\/zeromq.org.  ZeroMQ. http:\/\/zeromq.org."},{"key":"e_1_2_1_65_1","first-page":"928","volume-title":"Online Convex Programming and Generalized Infinitesimal Gradient Ascent. In Proc. of ICML","author":"Zinkevich M.","year":"2003"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3021924.3021925","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T09:27:17Z","timestamp":1672219637000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3021924.3021925"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11]]},"references-count":65,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2016,11]]}},"alternative-id":["10.14778\/3021924.3021925"],"URL":"https:\/\/doi.org\/10.14778\/3021924.3021925","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2016,11]]}}}