{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T14:47:33Z","timestamp":1773154053694,"version":"3.50.1"},"reference-count":38,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2017,8]]},"abstract":"<jats:p>As the Internet-of-Vehicles (IoV) technology becomes an increasingly important trend for future transportation, designing large-scale IoV systems has become a critical task that aims to process big data uploaded by fleet vehicles and to provide data-driven services. The IoV data, especially high-frequency vehicle statuses (e.g., location, engine parameters), are characterized as large volume with a low density of value and low data quality. Such characteristics pose challenges for developing real-time applications based on such data. In this paper, we address the challenges in designing a scalable IoV system by describing CarStream, an industrial system of big data processing for chauffeured car services. Connected with over 30,000 vehicles, CarStream collects and processes multiple types of driving data including vehicle status, driver activity, and passenger-trip information. Multiple services are provided based on the collected data. CarStream has been deployed and maintained for three years in industrial usage, collecting over 40 terabytes of driving data. This paper shares our experiences on designing CarStream based on large-scale driving-data streams, and the lessons learned from the process of addressing the challenges in designing and maintaining CarStream.<\/jats:p>","DOI":"10.14778\/3137765.3137781","type":"journal-article","created":{"date-parts":[[2017,9,7]],"date-time":"2017-09-07T13:35:53Z","timestamp":1504791353000},"page":"1766-1777","source":"Crossref","is-referenced-by-count":28,"title":["CarStream"],"prefix":"10.14778","volume":"10","author":[{"given":"Mingming","family":"Zhang","sequence":"first","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tianyu","family":"Wo","sequence":"additional","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tao","family":"Xie","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuelian","family":"Lin","sequence":"additional","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaxiao","family":"Liu","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Apache Flink project. http:\/\/flink.apache.org\/. Accessed: 2017-02-28.  Apache Flink project. http:\/\/flink.apache.org\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_2_1","unstructured":"Apache Flume project. http:\/\/flume.apache.org\/. Accessed: 2017-02-28.  Apache Flume project. http:\/\/flume.apache.org\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_3_1","unstructured":"Apache Samza project. http:\/\/samza.apache.org\/. Accessed: 2017-02-28.  Apache Samza project. http:\/\/samza.apache.org\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_4_1","unstructured":"Apache Spark project. http:\/\/spark.apache.org\/. Accessed: 2017-02-28.  Apache Spark project. http:\/\/spark.apache.org\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_5_1","unstructured":"Apache Storm project. http:\/\/storm.apache.org\/. Accessed: 2017-02-28.  Apache Storm project. http:\/\/storm.apache.org\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_6_1","unstructured":"Ganglia monitor system. http:\/\/ganglia.info\/. Accessed: 2017-02-28.  Ganglia monitor system. http:\/\/ganglia.info\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_7_1","unstructured":"Google Internet of Things (IoT) solutions. https:\/\/cloud.google.com\/solutions\/iot\/. Accessed: 2017-02-28.  Google Internet of Things (IoT) solutions. https:\/\/cloud.google.com\/solutions\/iot\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_8_1","unstructured":"Lyft engineering blog. https:\/\/eng.lyft.com\/. Accessed: 2017-02-28.  Lyft engineering blog. https:\/\/eng.lyft.com\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_9_1","unstructured":"Uber engineering blog. https:\/\/eng.uber.com\/. Accessed: 2017-02-28.  Uber engineering blog. https:\/\/eng.uber.com\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_10_1","unstructured":"Zabbix monitoring solution. http:\/\/www.zabbix.com\/. Accessed: 2017-02-28.  Zabbix monitoring solution. http:\/\/www.zabbix.com\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-003-0095-z"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536227"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824076"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465272"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-28608-0_16"},{"key":"e_1_2_1_16_1","unstructured":"J. Barr. Amazon Kinesis Analytics: Process streaming data in real-time with SQL. https:\/\/aws.amazon.com\/cn\/blogs\/aws\/amazon-kinesis-analytics-process-streaming-data-in-real-time-with-sql\/. Accessed: 2017-02-28.  J. Barr. Amazon Kinesis Analytics: Process streaming data in real-time with SQL. https:\/\/aws.amazon.com\/cn\/blogs\/aws\/amazon-kinesis-analytics-process-streaming-data-in-real-time-with-sql\/. Accessed: 2017-02-28."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989438"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733016"},{"key":"e_1_2_1_19_1","volume-title":"Manning Publications Co.","author":"Carlson J. L.","year":"2013","unstructured":"J. L. Carlson . Redis in Action . Manning Publications Co. , 2013 . J. L. Carlson. Redis in Action. Manning Publications Co., 2013."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2904441"},{"key":"e_1_2_1_21_1","first-page":"257","volume-title":"Proc. CIDR","volume":"3","author":"Cherniack M.","year":"2003","unstructured":"M. Cherniack , H. Balakrishnan , M. Balazinska , D. Carney , U. Cetintemel , Y. Xing , and S. B. Zdonik . Scalable distributed stream processing . In Proc. CIDR , volume 3 , pages 257 -- 268 , 2003 . M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Cetintemel, Y. Xing, and S. B. Zdonik. Scalable distributed stream processing. In Proc. CIDR, volume 3, pages 257--268, 2003."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2010.5447829"},{"key":"e_1_2_1_23_1","volume-title":"Proc. HotCloud","author":"Dean D. J.","year":"2014","unstructured":"D. J. Dean , H. Nguyen , P. Wang , and X. Gu . Perfcompass: Toward runtime performance anomaly fault localization for infrastructure-as-a-service clouds . In Proc. HotCloud , 2014 . D. J. Dean, H. Nguyen, P. Wang, and X. Gu. Perfcompass: Toward runtime performance anomaly fault localization for infrastructure-as-a-service clouds. In Proc. HotCloud, 2014."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007274"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/1012889.1012894"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/SRDS.2012.49"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/1325851.1325895"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MedHocNet.2012.6257116"},{"key":"e_1_2_1_29_1","volume-title":"Prentice Hall PTR","author":"Josephsen D.","year":"2007","unstructured":"D. Josephsen . Building a monitoring infrastructure with Nagios . Prentice Hall PTR , 2007 . D. Josephsen. Building a monitoring infrastructure with Nagios. Prentice Hall PTR, 2007."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742788"},{"issue":"8","key":"e_1_2_1_31_1","first-page":"48","article-title":"On big data stream processing","volume":"3","author":"Namiot D.","year":"2015","unstructured":"D. Namiot . On big data stream processing . International Journal of Open Information Technologies , 3 ( 8 ): 48 -- 51 , 2015 . D. Namiot. On big data stream processing. International Journal of Open Information Technologies, 3(8):48--51, 2015.","journal-title":"International Journal of Open Information Technologies"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2010.172"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCC.2014.22"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1107499.1107504"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007310"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/2773807.2774052"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-47534-9_10"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522737"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3137765.3137781","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:10:48Z","timestamp":1672222248000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3137765.3137781"}},"subtitle":["an industrial system of big data processing for internet-of-vehicles"],"short-title":[],"issued":{"date-parts":[[2017,8]]},"references-count":38,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2017,8]]}},"alternative-id":["10.14778\/3137765.3137781"],"URL":"https:\/\/doi.org\/10.14778\/3137765.3137781","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2017,8]]}}}