{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T08:13:25Z","timestamp":1793088805798,"version":"4.5.0"},"reference-count":23,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:p>With the trend of cloud computing, the cloud log service is becoming increasingly important, as it plays a critical role in tasks such as root cause analysis, service monitoring and security audition. To meet these needs, we provide Tencent Cloud Log Service (TencentCLS), a one-stop solution for log collection, storage, analysis and dumping. It currently hosts more than a million tenants, of which the largest ones can generate up to PB-level logs per day.<\/jats:p>\n          <jats:p>The most important challenge that TencentCLS faces is to support both low-latency and resource-efficient queries on such large quantities of log data. To address that challenge, we propose a novel search engine based upon Lucene. The system features a novel procedure for querying logs within a time range, an indexing technique for the time field, as well as optimized query algorithms dedicated to multiple critical and common query types.<\/jats:p>\n          <jats:p>As a result, the search engine at TencentCLS gains significant performance improvements against Lucene. It achieves 20x performance increase with standard queries, and 10x performance increase with histogram queries in massive log query scenarios. In addition, TencentCLS also supports storing and querying with microsecond-level time precision, as well as the microsecond-level time order preservation capability.<\/jats:p>","DOI":"10.14778\/3554821.3554837","type":"journal-article","created":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T22:28:39Z","timestamp":1664490519000},"page":"3472-3482","source":"Crossref","is-referenced-by-count":7,"title":["TencentCLS"],"prefix":"10.14778","volume":"15","author":[{"given":"Muzhi","family":"Yu","sequence":"first","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaoxiang","family":"Lin","sequence":"additional","affiliation":[{"name":"Tencent Cloud Computing (Beijing) Co., Ltd., Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinan","family":"Sun","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Runyun","family":"Zhou","sequence":"additional","affiliation":[{"name":"Tencent Cloud Computing (Beijing) Co., Ltd., Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guoqiang","family":"Jiang","sequence":"additional","affiliation":[{"name":"Tencent Cloud Computing (Beijing) Co., Ltd., Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hua","family":"Huang","sequence":"additional","affiliation":[{"name":"Tencent Cloud Computing (Beijing) Co., Ltd., Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shikun","family":"Zhang","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,9,29]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2022. Amazon CloudWatch - Application and Infrastructure Monitoring. https:\/\/aws.amazon.com\/cloudwatch\/.  2022. Amazon CloudWatch - Application and Infrastructure Monitoring. https:\/\/aws.amazon.com\/cloudwatch\/."},{"key":"e_1_2_1_2_1","unstructured":"2022. Apache Lucene. https:\/\/lucene.apache.org\/.  2022. Apache Lucene. https:\/\/lucene.apache.org\/."},{"key":"e_1_2_1_3_1","unstructured":"2022. Apache Solr. https:\/\/solr.apache.org\/.  2022. Apache Solr. https:\/\/solr.apache.org\/."},{"key":"e_1_2_1_4_1","unstructured":"2022. Azure Monitor | Microsoft Azure. https:\/\/azure.microsoft.com\/en-us\/services\/monitor\/.  2022. Azure Monitor | Microsoft Azure. https:\/\/azure.microsoft.com\/en-us\/services\/monitor\/."},{"key":"e_1_2_1_5_1","unstructured":"2022. Cloud Logging | Google Cloud. https:\/\/cloud.google.com\/logging.  2022. Cloud Logging | Google Cloud. https:\/\/cloud.google.com\/logging."},{"key":"e_1_2_1_6_1","unstructured":"2022. Elastic. https:\/\/www.elastic.co\/.  2022. Elastic. https:\/\/www.elastic.co\/."},{"key":"e_1_2_1_7_1","unstructured":"2022. MG4J: High-Performance Text Indexing for Java\u2122. https:\/\/mg4j.di.unimi.it\/.  2022. MG4J: High-Performance Text Indexing for Java\u2122. https:\/\/mg4j.di.unimi.it\/."},{"key":"e_1_2_1_8_1","unstructured":"2022. Sphinx: Open Source Search Engine. http:\/\/sphinxsearch.com\/.  2022. Sphinx: Open Source Search Engine. http:\/\/sphinxsearch.com\/."},{"key":"e_1_2_1_9_1","unstructured":"2022. Splunk. https:\/\/www.splunk.com.  2022. Splunk. https:\/\/www.splunk.com."},{"key":"e_1_2_1_10_1","unstructured":"2022. Tencent Cloud Log Service. https:\/\/intl.cloud.tencent.com\/products\/cls.  2022. Tencent Cloud Log Service. https:\/\/intl.cloud.tencent.com\/products\/cls."},{"key":"e_1_2_1_11_1","unstructured":"2022. The Xapian Project. https:\/\/xapian.org\/.  2022. The Xapian Project. https:\/\/xapian.org\/."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376736"},{"key":"e_1_2_1_13_1","unstructured":"Andrzej Bia\u0142ecki Robert Muir and Grant Ingersoll. 2012. Apache Lucene 4. 24 pages.  Andrzej Bia\u0142ecki Robert Muir and Grant Ingersoll. 2012. Apache Lucene 4. 24 pages."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-06028-6_30"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/96749.98245"},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Marcus Fontoura Ronny Lempel Runping Qi and Jason Zien. 2005. Inverted Index Support for Numeric Search.  Marcus Fontoura Ronny Lempel Runping Qi and Jason Zien. 2005. Inverted Index Support for Numeric Search.","DOI":"10.1080\/15427951.2006.10129119"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2125636.2125646"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72951-8_11"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415148"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45072-6_4"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526764"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080721"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1132956.1132959"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3554821.3554837","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T11:26:42Z","timestamp":1672226802000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3554821.3554837"}},"subtitle":["the cloud log service with high query performances"],"short-title":[],"issued":{"date-parts":[[2022,8]]},"references-count":23,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["10.14778\/3554821.3554837"],"URL":"https:\/\/doi.org\/10.14778\/3554821.3554837","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2022,8]]}}}