{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,5,2]],"date-time":"2023-05-02T23:29:30Z","timestamp":1683070170094},"reference-count":10,"publisher":"Association for Computing Machinery (ACM)","issue":"13","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2014,8]]},"abstract":"<jats:p>As we come to terms with various big data challenges, one vital issue remains largely untouched. That is the optimal multiplexing and prioritization of different big data applications sharing the same underlying infrastructure, for example, a public cloud platform. Given these demanding applications and the necessary practice to avoid over-provisioning, resource contention between applications is inevitable. Priority must be given to important applications (or sub workloads in an application) in these circumstances.<\/jats:p>\n          <jats:p>\n            This demo highlights the compelling impact prioritization could make, using an example application that recommends promising combinations of stocks to purchase based on relevant Twitter sentiment. The application consists of a batch job and an interactive query, ran simultaneously. Our underlying solution provides a unique capability to identify and differentiate application workloads throughout a complex big data platform. Its current implementation is based on Apache Hadoop and the IBM GPFS distributed storage system. The demo showcases the superior interactive query performance achievable by prioritizing its workloads and thereby avoiding I\/O bandwidth contention. The query time is 3.6 \u00d7 better compared to no prioritization. Such a performance is within 0.3% of that of an idealistic system where the query runs without contention. The demo is conducted on around 3 months of Twitter data, pertinent to the S &amp; P 100 index, with about 4 \u00d7 10\n            <jats:sup>12<\/jats:sup>\n            potential stock combinations considered.\n          <\/jats:p>","DOI":"10.14778\/2733004.2733056","type":"journal-article","created":{"date-parts":[[2015,5,12]],"date-time":"2015-05-12T15:37:52Z","timestamp":1431445072000},"page":"1665-1668","source":"Crossref","is-referenced-by-count":6,"title":["Getting your big data priorities straight"],"prefix":"10.14778","volume":"7","author":[{"given":"Rui","family":"Zhang","sequence":"first","affiliation":[{"name":"IBM Research, Almaden"}]},{"given":"Reshu","family":"Jain","sequence":"additional","affiliation":[{"name":"IBM Research, Almaden"}]},{"given":"Prasenjit","family":"Sarkar","sequence":"additional","affiliation":[{"name":"IBM Research, Almaden"}]},{"given":"Lukas","family":"Rupprecht","sequence":"additional","affiliation":[{"name":"Imperial College, London"}]}],"member":"320","published-online":{"date-parts":[[2014,8]]},"reference":[{"key":"e_1_2_1_2_1","volume-title":"NSDI","author":"Hindman B.","year":"2011","unstructured":"B. Hindman , A. Konwinski , M. Zaharia , A. Ghodsi , A. D. Joseph , R. H. Katz , S. Shenker , and I. Stoica . Mesos: A platform for fine-grained resource sharing in the data center . In NSDI , 2011 . B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. H. Katz, S. Shenker, and I. Stoica. Mesos: A platform for fine-grained resource sharing in the data center. In NSDI, 2011."},{"key":"e_1_2_1_3_1","first-page":"116","volume":"201","author":"Lu J.","year":"2011","unstructured":"J. Lu , J. Wu , C. Wu , Y. Li , X. Xu , and S. Deng . Qos control method of cloud storage system based on differentiated service, Aug. 31 2011 . CN Patent App. CN 201 ,110, 116 ,396. J. Lu, J. Wu, C. Wu, Y. Li, X. Xu, and S. Deng. Qos control method of cloud storage system based on differentiated service, Aug. 31 2011. CN Patent App. CN 201,110,116,396.","journal-title":"CN Patent App. CN"},{"key":"e_1_2_1_4_1","volume-title":"ICIS","author":"Oh C.","year":"2011","unstructured":"C. Oh and O. Sheng . Investigating predictive power of stock micro blog sentiment in forecasting future stock price directional movement . In ICIS , 2011 . C. Oh and O. Sheng. Investigating predictive power of stock micro blog sentiment in forecasting future stock price directional movement. In ICIS, 2011."},{"key":"e_1_2_1_5_1","volume-title":"FAST","author":"Schmuck F. B.","year":"2002","unstructured":"F. B. Schmuck and R. L. Haskin . Gpfs: A shared-disk file system for large computing clusters . In FAST , 2002 . F. B. Schmuck and R. L. Haskin. Gpfs: A shared-disk file system for large computing clusters. In FAST, 2002."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687609"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-39068-5_67"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465288"},{"key":"e_1_2_1_9_1","unstructured":"Apache Hadoop. http:\/\/hadoop.apache.org\/.  Apache Hadoop. http:\/\/hadoop.apache.org\/."},{"key":"e_1_2_1_10_1","unstructured":"Apache Mahout. http:\/\/mahout.apache.org\/.  Apache Mahout. http:\/\/mahout.apache.org\/."},{"key":"e_1_2_1_11_1","unstructured":"RPC Support for QoS. https:\/\/issues.apache.org\/jira\/browse\/HADOOP-9194.  RPC Support for QoS. https:\/\/issues.apache.org\/jira\/browse\/HADOOP-9194."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2733004.2733056","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T09:43:39Z","timestamp":1672220619000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2733004.2733056"}},"subtitle":["a demonstration of priority-based QoS using social-network-driven stock recommendation"],"short-title":[],"issued":{"date-parts":[[2014,8]]},"references-count":10,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2014,8]]}},"alternative-id":["10.14778\/2733004.2733056"],"URL":"https:\/\/doi.org\/10.14778\/2733004.2733056","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2014,8]]}}}