{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T17:00:56Z","timestamp":1791478856468,"version":"4.3.4"},"reference-count":166,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T00:00:00Z","timestamp":1619049600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Rakuten Mobile, Japan"},{"name":"Korea government","award":["NRF-2019R1C1C1011068"],"award-info":[{"award-number":["NRF-2019R1C1C1011068"]}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Royal Society Short Industry Fellowship"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2022,4,30]]},"abstract":"<jats:p>\n            Edge computing is the next Internet frontier that will leverage computing resources located near users, sensors, and data stores to provide more responsive services. Therefore, it is envisioned that a large-scale, geographically dispersed, and resource-rich distributed system will emerge and play a key role in the future Internet. However, given the loosely coupled nature of such complex systems, their operational conditions are expected to change significantly over time. In this context, the performance characteristics of such systems will need to be captured rapidly, which is referred to as performance benchmarking, for application deployment, resource orchestration, and adaptive decision-making.\n            <jats:italic>Edge performance benchmarking<\/jats:italic>\n            is a nascent research avenue that has started gaining momentum over the past five years. This article first reviews articles published over the past three decades to trace the history of performance benchmarking from tightly coupled to loosely coupled systems. It then systematically classifies previous research to identify the system under test, techniques analyzed, and benchmark runtime in edge performance benchmarking.\n          <\/jats:p>","DOI":"10.1145\/3444692","type":"journal-article","created":{"date-parts":[[2021,4,23]],"date-time":"2021-04-23T04:08:21Z","timestamp":1619150901000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":73,"title":["A Survey on Edge Performance Benchmarking"],"prefix":"10.1145","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8392-832X","authenticated-orcid":false,"given":"Blesson","family":"Varghese","sequence":"first","affiliation":[{"name":"Queen\u2019s University Belfast, Belfast, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nan","family":"Wang","sequence":"additional","affiliation":[{"name":"Durham University, Durham, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Bermbach","sequence":"additional","affiliation":[{"name":"TU Berlin and ECDF, Berlin, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4730-950X","authenticated-orcid":false,"given":"Cheol-Ho","family":"Hong","sequence":"additional","affiliation":[{"name":"Chung-Ang University, Seoul, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eyal De","family":"Lara","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weisong","family":"Shi","sequence":"additional","affiliation":[{"name":"Wayne State University, MI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher","family":"Stewart","sequence":"additional","affiliation":[{"name":"Ohio State University, Columbus, OH, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,4,22]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the International Conference on Telecommunications. 1--5.","author":"Aazam M.","unstructured":"M. Aazam , M. St-Hilaire , C. Lung , and I. Lambadaris . 2016. MeFoRE: QoE based resource estimation at fog to enhance QoS in IoT . In Proceedings of the International Conference on Telecommunications. 1--5. M. Aazam, M. St-Hilaire, C. Lung, and I. Lambadaris. 2016. MeFoRE: QoE based resource estimation at fog to enhance QoS in IoT. In Proceedings of the International Conference on Telecommunications. 1--5."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the IEEE\/ACM 1st Annual Workshop on Large-scale Experiment-in-the-Loop Computing. 8--13","author":"Abeykoon V.","unstructured":"V. Abeykoon , Z. Liu , R. Kettimuthu , G. Fox , and I. Foster . 2019. Scientific image restoration anywhere . In Proceedings of the IEEE\/ACM 1st Annual Workshop on Large-scale Experiment-in-the-Loop Computing. 8--13 . V. Abeykoon, Z. Liu, R. Kettimuthu, G. Fox, and I. Foster. 2019. Scientific image restoration anywhere. In Proceedings of the IEEE\/ACM 1st Annual Workshop on Large-scale Experiment-in-the-Loop Computing. 8--13."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the IEEE\/ACM Symposium on Edge Computing. 179--191","author":"Amento B.","unstructured":"B. Amento , B. Balasubramanian , R. Hall , K. Joshi , G. Jung , and K. Purdy . 2016. FocusStack: Orchestrating edge clouds using location-based focus of attention . In Proceedings of the IEEE\/ACM Symposium on Edge Computing. 179--191 . B. Amento, B. Balasubramanian, R. Hall, K. Joshi, G. Jung, and K. Purdy. 2016. FocusStack: Orchestrating edge clouds using location-based focus of attention. In Proceedings of the IEEE\/ACM Symposium on Edge Computing. 179--191."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 6th Workshop on Hot Topics in System Dependability. 1--16","author":"Anderson E.","unstructured":"E. Anderson , X. Li , M. A. Shah , J. Tucek , and J. J. Wylie . 2010. What consistency does your key-value store actually provide? In Proceedings of the 6th Workshop on Hot Topics in System Dependability. 1--16 . E. Anderson, X. Li, M. A. Shah, J. Tucek, and J. J. Wylie. 2010. What consistency does your key-value store actually provide? In Proceedings of the 6th Workshop on Hot Topics in System Dependability. 1--16."},{"key":"e_1_2_1_5_1","volume-title":"Technical University of Delft","author":"Andreica M. I.","year":"2006","unstructured":"M. I. Andreica , N. Tapus , C. Dumitrescu , A. Iosup , D. Epema , I. Raicu , I. Foster , and M. Ripeanu . 2006. Towards ServMark, an architecture for testing grid services. Technical Report ServMark-2006-002 , Technical University of Delft , July 2006 . M. I. Andreica, N. Tapus, C. Dumitrescu, A. Iosup, D. Epema, I. Raicu, I. Foster, and M. Ripeanu. 2006. Towards ServMark, an architecture for testing grid services. Technical Report ServMark-2006-002, Technical University of Delft, July 2006."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the 1st International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things. 49--55","author":"Antonini M.","unstructured":"M. Antonini , T. H. Vu , C. Min , A. Montanari , A. Mathur , and F. Kawsar . 2019. Resource characterisation of personal-scale sensing models on edge accelerators . In Proceedings of the 1st International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things. 49--55 . M. Antonini, T. H. Vu, C. Min, A. Montanari, A. Mathur, and F. Kawsar. 2019. Resource characterisation of personal-scale sensing models on edge accelerators. In Proceedings of the 1st International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things. 49--55."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 18th Annual Joint Conference of the IEEE Computer and Communications Societies","volume":"2","author":"Apostolopoulos G.","unstructured":"G. Apostolopoulos , V. Peris , and D. Saha . 1999. Transport layer security: How much does it really cost ? In Proceedings of the 18th Annual Joint Conference of the IEEE Computer and Communications Societies , Vol. 2 . 717--725. G. Apostolopoulos, V. Peris, and D. Saha. 1999. Transport layer security: How much does it really cost? In Proceedings of the 18th Annual Joint Conference of the IEEE Computer and Communications Societies, Vol. 2. 717--725."},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the ACM\/IEEE Conference on Supercomputing. 158--165","author":"Bailey D. H.","unstructured":"D. H. Bailey , E. Barszcz , J. T. Barton , D. S. Browning , R. L. Carter , L. Dagum , R. A. Fatoohi , P. O. Frederickson , T. A. Lasinski , R. S. Schreiber, and et al. 1991. The NAS parallel benchmarks\u2014Summary and preliminary results . In Proceedings of the ACM\/IEEE Conference on Supercomputing. 158--165 . D. H. Bailey, E. Barszcz, J. T. Barton, D. S. Browning, R. L. Carter, L. Dagum, R. A. Fatoohi, P. O. Frederickson, T. A. Lasinski, R. S. Schreiber, and et al. 1991. The NAS parallel benchmarks\u2014Summary and preliminary results. In Proceedings of the ACM\/IEEE Conference on Supercomputing. 158--165."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 2018 IFIP\/IEEE International Conference on Very Large Scale Integration. 267--272","author":"Benelli G.","unstructured":"G. Benelli , G. Meoni , and L. Fanucci . 2018. A low power keyword spotting algorithm for memory constrained embedded systems . In Proceedings of the 2018 IFIP\/IEEE International Conference on Very Large Scale Integration. 267--272 . G. Benelli, G. Meoni, and L. Fanucci. 2018. A low power keyword spotting algorithm for memory constrained embedded systems. In Proceedings of the 2018 IFIP\/IEEE International Conference on Very Large Scale Integration. 267--272."},{"key":"e_1_2_1_11_1","volume-title":"Lecture Notes in Computer Science","volume":"7853","author":"Bermbach D.","unstructured":"D. Bermbach and J. Kuhlenkamp . 2013. Consistency in distributed storage systems: An overview of models, metrics and measurement approaches. In Networked Systems, V. Gramoli and R. Guerraoui (Eds.) . Lecture Notes in Computer Science , Vol. 7853 . Springer, Berlin, 175--189. D. Bermbach and J. Kuhlenkamp. 2013. Consistency in distributed storage systems: An overview of models, metrics and measurement approaches. In Networked Systems, V. Gramoli and R. Guerraoui (Eds.). Lecture Notes in Computer Science, Vol. 7853. Springer, Berlin, 175--189."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 15th International Conference on Service Oriented Computing.","author":"Bermbach D.","unstructured":"D. Bermbach , J. Kuhlenkamp , A. Dey , A. Ramachandran , A. Fekete , and S. Tai . 2017. BenchFoundry: A benchmarking framework for cloud storage services . In Proceedings of the 15th International Conference on Service Oriented Computing. D. Bermbach, J. Kuhlenkamp, A. Dey, A. Ramachandran, A. Fekete, and S. Tai. 2017. BenchFoundry: A benchmarking framework for cloud storage services. In Proceedings of the 15th International Conference on Service Oriented Computing."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 2nd Workshop on IoT Systems Provisioning and Management for Context-Aware Smart Cities.","author":"Bermbach D.","unstructured":"D. Bermbach , F. Pallas , David Garc\u00eda P\u00e9rez , P. Plebani , M. Anderson , R. Kat , and S. Tai . 2017. A research perspective on fog computing . In Proceedings of the 2nd Workshop on IoT Systems Provisioning and Management for Context-Aware Smart Cities. D. Bermbach, F. Pallas, David Garc\u00eda P\u00e9rez, P. Plebani, M. Anderson, R. Kat, and S. Tai. 2017. A research perspective on fog computing. In Proceedings of the 2nd Workshop on IoT Systems Provisioning and Management for Context-Aware Smart Cities."},{"key":"e_1_2_1_14_1","first-page":"1","article-title":"Eventual consistency: How soon is eventual? An evaluation of Amazon S3\u2019s consistency behavior. In Proceedings of the 6th Workshop on Middleware for Service Oriented Computing","volume":"1","author":"Bermbach D.","year":"2011","unstructured":"D. Bermbach and S. Tai . 2011 . Eventual consistency: How soon is eventual? An evaluation of Amazon S3\u2019s consistency behavior. In Proceedings of the 6th Workshop on Middleware for Service Oriented Computing . Article 1 , 1: 1 -- 1 :6 pages. D. Bermbach and S. Tai. 2011. Eventual consistency: How soon is eventual? An evaluation of Amazon S3\u2019s consistency behavior. In Proceedings of the 6th Workshop on Middleware for Service Oriented Computing. Article 1, 1:1--1:6 pages.","journal-title":"Article"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 2nd International Conference on Cloud Engineering. 47--56","author":"Bermbach D.","unstructured":"D. Bermbach and S. Tai . 2014. Benchmarking eventual consistency: Lessons learned from long-term experimental studies . In Proceedings of the 2nd International Conference on Cloud Engineering. 47--56 . D. Bermbach and S. Tai. 2014. Benchmarking eventual consistency: Lessons learned from long-term experimental studies. In Proceedings of the 2nd International Conference on Cloud Engineering. 47--56."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 16th International Conference on Web Engineering. 188--206","author":"Bermbach D.","unstructured":"D. Bermbach and E. Wittern . 2016. Benchmarking web API quality . In Proceedings of the 16th International Conference on Web Engineering. 188--206 . D. Bermbach and E. Wittern. 2016. Benchmarking web API quality. In Proceedings of the 16th International Conference on Web Engineering. 188--206."},{"key":"e_1_2_1_17_1","unstructured":"D. Bermbach and E. Wittern. 2019. Benchmarking web API quality-revisited. arXiv:1903.07712. Retrieved from https:\/\/arxiv.org\/abs\/1903.07712.  D. Bermbach and E. Wittern. 2019. Benchmarking web API quality-revisited. arXiv:1903.07712. Retrieved from https:\/\/arxiv.org\/abs\/1903.07712."},{"key":"e_1_2_1_18_1","first-page":"5","article-title":"Benchmarking web API quality\u2014Revisited","volume":"19","author":"Bermbach David","year":"2020","unstructured":"David Bermbach and Erik Wittern . 2020 . Benchmarking web API quality\u2014Revisited . J. Web Eng. 19 , 5 -- 6 (2020), 603--646. David Bermbach and Erik Wittern. 2020. Benchmarking web API quality\u2014Revisited. J. Web Eng. 19, 5--6 (2020), 603--646.","journal-title":"J. Web Eng."},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","unstructured":"D. Bermbach E. Wittern and S. Tai. 2017. Cloud Service Benchmarking: Measuring Quality of Cloud Services from a Client Perspective. Springer.  D. Bermbach E. Wittern and S. Tai. 2017. Cloud Service Benchmarking: Measuring Quality of Cloud Services from a Client Perspective. Springer.","DOI":"10.1007\/978-3-319-55483-9"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 2nd International Workshop on Testing Database Systems. 1--6.","author":"Binnig C.","unstructured":"C. Binnig , D. Kossmann , T. Kraska , and S. Loesing . 2009. How is the weather tomorrow? Towards a benchmark for the cloud . In Proceedings of the 2nd International Workshop on Testing Database Systems. 1--6. C. Binnig, D. Kossmann, T. Kraska, and S. Loesing. 2009. How is the weather tomorrow? Towards a benchmark for the cloud. In Proceedings of the 2nd International Workshop on Testing Database Systems. 1--6."},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"A. Bond D. Johnson G. Kopczynski and H. R. Taheri. 2016. Profiling the performance of virtualized databases with the TPCx-V benchmark. In Performance Evaluation and Benchmarking: Traditional to Big Data to Internet of Things R. Nambiar and M. Poess (Eds.). Springer International Publishing 156--172.  A. Bond D. Johnson G. Kopczynski and H. R. Taheri. 2016. Profiling the performance of virtualized databases with the TPCx-V benchmark. In Performance Evaluation and Benchmarking: Traditional to Big Data to Internet of Things R. Nambiar and M. Poess (Eds.). Springer International Publishing 156--172.","DOI":"10.1007\/978-3-319-31409-9_10"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the IEEE 18th International Enterprise Distributed Object Computing Conference. 101--109","author":"Borhani A. H.","unstructured":"A. H. Borhani , P. Leitner , B. S. Lee , X. Li , and T. Hung . 2014. WPress: An application-driven performance benchmark for cloud-based virtual machines . In Proceedings of the IEEE 18th International Enterprise Distributed Object Computing Conference. 101--109 . A. H. Borhani, P. Leitner, B. S. Lee, X. Li, and T. Hung. 2014. WPress: An application-driven performance benchmark for cloud-based virtual machines. In Proceedings of the IEEE 18th International Enterprise Distributed Object Computing Conference. 101--109."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 51st Annual IEEE\/ACM International Symposium on Microarchitecture. 894--907","author":"Boroujerdian B.","unstructured":"B. Boroujerdian , H. Genc , S. Krishnan , W. Cui , A. Faust , and V. J. Reddi . 2018. MAVBench: Micro aerial vehicle benchmarking . In Proceedings of the 51st Annual IEEE\/ACM International Symposium on Microarchitecture. 894--907 . B. Boroujerdian, H. Genc, S. Krishnan, W. Cui, A. Faust, and V. J. Reddi. 2018. MAVBench: Micro aerial vehicle benchmarking. In Proceedings of the 51st Annual IEEE\/ACM International Symposium on Microarchitecture. 894--907."},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the ACM Symposium on Edge Computing.","author":"Boubin J.","unstructured":"J. Boubin , N. Babu , C. Stewart , J. Chumley , and S. Zhang . 2019. Managing edge resources for fully autonomous aerial systems . In Proceedings of the ACM Symposium on Edge Computing. J. Boubin, N. Babu, C. Stewart, J. Chumley, and S. Zhang. 2019. Managing edge resources for fully autonomous aerial systems. In Proceedings of the ACM Symposium on Edge Computing."},{"key":"e_1_2_1_25_1","unstructured":"A. Burns and A. J. Wellings. 2001. Real-time Systems and Programming Languages: Ada 95 Real-time Java and Real-time POSIX. Pearson Education.  A. Burns and A. J. Wellings. 2001. Real-time Systems and Programming Languages: Ada 95 Real-time Java and Real-time POSIX. Pearson Education."},{"key":"e_1_2_1_26_1","volume-title":"J.b Konecn\u00fd, H. B. McMahan, V. Smith, and A. Talwalkar.","author":"Caldas S.","year":"2018","unstructured":"S. Caldas , P. Wu andd T. Li , J.b Konecn\u00fd, H. B. McMahan, V. Smith, and A. Talwalkar. 2018 . LEAF : A benchmark for federated settings. arxiv:1812.01097. Retrieved from http:\/\/arxiv.org\/abs\/1812.01097. S. Caldas, P. Wu andd T. Li, J.b Konecn\u00fd, H. B. McMahan, V. Smith, and A. Talwalkar. 2018. LEAF: A benchmark for federated settings. arxiv:1812.01097. Retrieved from http:\/\/arxiv.org\/abs\/1812.01097."},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/MSPEC.2019.8701189","article-title":"Taking AI to the edge: Google\u2019s TPU now comes in a maker-friendly package","volume":"56","author":"Cass S.","year":"2019","unstructured":"S. Cass . 2019 . Taking AI to the edge: Google\u2019s TPU now comes in a maker-friendly package . IEEE Spectr. 56 , 5 (2019), 16 -- 17 . S. Cass. 2019. Taking AI to the edge: Google\u2019s TPU now comes in a maker-friendly package. IEEE Spectr. 56, 5 (2019), 16--17.","journal-title":"IEEE Spectr."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the IEEE International Symposium on Workload Characterization. 44--54","author":"Che S.","unstructured":"S. Che , M. Boyer , J. Meng , D. Tarjan , J. W. Sheaffer , S. Lee , and K. Skadron . 2009. Rodinia: A benchmark suite for heterogeneous computing . In Proceedings of the IEEE International Symposium on Workload Characterization. 44--54 . S. Che, M. Boyer, J. Meng, D. Tarjan, J. W. Sheaffer, S. Lee, and K. Skadron. 2009. Rodinia: A benchmark suite for heterogeneous computing. In Proceedings of the IEEE International Symposium on Workload Characterization. 44--54."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3239565"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2015.2487344"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.2018.1700145"},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Y. Chen N. Zhang Y. Zhang X. Chen W. Wu and X. S. Shen. 2019. Energy efficient dynamic offloading in mobile edge computing for Internet of Things. IEEE Trans. Cloud Comput. (2019).  Y. Chen N. Zhang Y. Zhang X. Chen W. Wu and X. S. Shen. 2019. Energy efficient dynamic offloading in mobile edge computing for Internet of Things. IEEE Trans. Cloud Comput. (2019).","DOI":"10.1109\/JIOT.2018.2875715"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the Workshop on Wearable Systems and Applications. ACM, 33--38","author":"Chen Z.","unstructured":"Z. Chen , L. Jiang , W. Hu , K. Ha , B. Amos , P. Pillai , A. Hauptmann , and M. Satyanarayanan . 2015. Early implementation experience with wearable cognitive assistance applications . In Proceedings of the Workshop on Wearable Systems and Applications. ACM, 33--38 . Z. Chen, L. Jiang, W. Hu, K. Ha, B. Amos, P. Pillai, A. Hauptmann, and M. Satyanarayanan. 2015. Early implementation experience with wearable cognitive assistance applications. In Proceedings of the Workshop on Wearable Systems and Applications. ACM, 33--38."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124153.1124155"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 1st ACM Symposium on Cloud Computing. 143--154","author":"Cooper B. F.","unstructured":"B. F. Cooper , A. Silberstein , E. Tam , R. Ramakrishnan , and R. Sears . 2010. Benchmarking cloud serving systems with YCSB . In Proceedings of the 1st ACM Symposium on Cloud Computing. 143--154 . B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. 2010. Benchmarking cloud serving systems with YCSB. In Proceedings of the 1st ACM Symposium on Cloud Computing. 143--154."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/19.1.43"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 3rd Workshop on General-Purpose Computation on Graphics Processing Units. 63--74","author":"Danalis A.","unstructured":"A. Danalis , G. Marin , C. McCurdy , J. S. Meredith , P. C. Roth , K. Spafford , V. Tipparaju , and J. S. Vetter . 2010. The scalable heterogeneous computing (SHOC) benchmark suite . In Proceedings of the 3rd Workshop on General-Purpose Computation on Graphics Processing Units. 63--74 . A. Danalis, G. Marin, C. McCurdy, J. S. Meredith, P. C. Roth, K. Spafford, V. Tipparaju, and J. S. Vetter. 2010. The scalable heterogeneous computing (SHOC) benchmark suite. In Proceedings of the 3rd Workshop on General-Purpose Computation on Graphics Processing Units. 63--74."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 4th International Workshop on Serverless Computing.","author":"Das A.","unstructured":"A. Das , S. Patterson , and M. P. Wittie . 2018. EdgeBench: Benchmarking edge computing platforms . In Proceedings of the 4th International Workshop on Serverless Computing. A. Das, S. Patterson, and M. P. Wittie. 2018. EdgeBench: Benchmarking edge computing platforms. In Proceedings of the 4th International Workshop on Serverless Computing."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the International Conference on Supercomputing. 162--171","author":"Davies T.","unstructured":"T. Davies , C. Karlsson , H. Liu , C. Ding , and Z. Chen . 2011. High performance LINPACK benchmark: A fault tolerant implementation without checkpointing . In Proceedings of the International Conference on Supercomputing. 162--171 . T. Davies, C. Karlsson, H. Liu, C. Ding, and Z. Chen. 2011. High performance LINPACK benchmark: A fault tolerant implementation without checkpointing. In Proceedings of the International Conference on Supercomputing. 162--171."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732240.2732246"},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","unstructured":"G. Dinelli G. Meoni E. Rapuano G. Benelli and L. Fanucci. 2019. An FPGA-based hardware accelerator for CNNs using on-chip memories only: Design and benchmarking with Intel movidius neural compute stick. Int. J. Reconfig. Comput. 2019 Article 7218758 (2019).  G. Dinelli G. Meoni E. Rapuano G. Benelli and L. Fanucci. 2019. An FPGA-based hardware accelerator for CNNs using on-chip memories only: Design and benchmarking with Intel movidius neural compute stick. Int. J. Reconfig. Comput. 2019 Article 7218758 (2019).","DOI":"10.1155\/2019\/7218758"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.728"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the Internet Measurement Conference. 205--212","author":"Drago I.","unstructured":"I. Drago , E. Bocchi , M. Mellia , H. Slatman , and A. Pras . 2013. Benchmarking personal cloud storage . In Proceedings of the Internet Measurement Conference. 205--212 . I. Drago, E. Bocchi, M. Mellia, H. Slatman, and A. Pras. 2013. Benchmarking personal cloud storage. In Proceedings of the Internet Measurement Conference. 205--212."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the IEEE\/ACM International Workshop on Grid Computing. 289--296","author":"Dumitrescu C.","unstructured":"C. Dumitrescu , I. Raicu , M. Ripeanu , and I. Foster . 2004. DiPerF: An automated distributed performance testing framework . In Proceedings of the IEEE\/ACM International Workshop on Grid Computing. 289--296 . C. Dumitrescu, I. Raicu, M. Ripeanu, and I. Foster. 2004. DiPerF: An automated distributed performance testing framework. In Proceedings of the IEEE\/ACM International Workshop on Grid Computing. 289--296."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/99.486757"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"A. Elhabbash F. Samreen J. Hadley and Y. Elkhatib. 2019. Cloud brokerage: A systematic survey. Comput. Surv. 51 6 Article 119 (2019).  A. Elhabbash F. Samreen J. Hadley and Y. Elkhatib. 2019. Cloud brokerage: A systematic survey. Comput. Surv. 51 6 Article 119 (2019).","DOI":"10.1145\/3274657"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software. 171--172","author":"Felter W.","unstructured":"W. Felter , A. Ferreira , R. Rajamony , and J. Rubio . 2015. An updated performance comparison of virtual machines and Linux containers . In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software. 171--172 . W. Felter, A. Ferreira, R. Rajamony, and J. Rubio. 2015. An updated performance comparison of virtual machines and Linux containers. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software. 171--172."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2248487.2150982"},{"key":"e_1_2_1_49_1","volume-title":"The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann.","author":"Foster I.","year":"1998","unstructured":"I. Foster and C. Kesselman (Eds.). 1998 . The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann. I. Foster and C. Kesselman (Eds.). 1998. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann."},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 7th Workshop on Hot Topics in Operating Systems. 174--178","author":"Fox A.","unstructured":"A. Fox and E. A. Brewer . 1999. Harvest, yield, and scalable tolerant systems . In Proceedings of the 7th Workshop on Hot Topics in Operating Systems. 174--178 . A. Fox and E. A. Brewer. 1999. Harvest, yield, and scalable tolerant systems. In Proceedings of the 7th Workshop on Hot Topics in Operating Systems. 174--178."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing. 315--322","author":"Frumkin M.","unstructured":"M. Frumkin and R. F. Van der Wijngaart. 2001. NAS grid benchmarks: A tool for grid space exploration . In Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing. 315--322 . M. Frumkin and R. F. Van der Wijngaart. 2001. NAS grid benchmarks: A tool for grid space exploration. In Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing. 315--322."},{"key":"e_1_2_1_52_1","doi-asserted-by":"crossref","unstructured":"A. Gaikwad V. Doan M. Bossy F. Baude and F. Abergel. 2012. SuperQuant financial benchmark suite for performance analysis of grid middlewares. In Modeling Simulation and Optimization of Complex Processes H. G. Bock X. P. Hoang R. Rannacher and J. P. Schl\u00f6der (Eds.). Springer Berlin 103--113.  A. Gaikwad V. Doan M. Bossy F. Baude and F. Abergel. 2012. SuperQuant financial benchmark suite for performance analysis of grid middlewares. In Modeling Simulation and Optimization of Complex Processes H. G. Bock X. P. Hoang R. Rannacher and J. P. Schl\u00f6der (Eds.). Springer Berlin 103--113.","DOI":"10.1007\/978-3-642-25707-0_9"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the 24th International Conference on Architectural Support for Programming Languages and Operating Systems. 3--18","author":"Gan Y.","unstructured":"Y. Gan , Y. Zhang , D. Cheng , A. Shetty , P. Rathi , N. Katarki , A. Bruno , J. Hu , B. Ritchken , B. Jackson , K. Hu , M. Pancholi , Y. He , B. Clancy , C. Colen , F. Wen , C. Leung , S. Wang , L. Zaruvinsky , M. Espinosa , R. Lin , Z. Liu , J. Padilla , and C. Delimitrou . 2019. An open-source benchmark suite for microservices and their hardware-software implications for cloud and edge systems . In Proceedings of the 24th International Conference on Architectural Support for Programming Languages and Operating Systems. 3--18 . Y. Gan, Y. Zhang, D. Cheng, A. Shetty, P. Rathi, N. Katarki, A. Bruno, J. Hu, B. Ritchken, B. Jackson, K. Hu, M. Pancholi, Y. He, B. Clancy, C. Colen, F. Wen, C. Leung, S. Wang, L. Zaruvinsky, M. Espinosa, R. Lin, Z. Liu, J. Padilla, and C. Delimitrou. 2019. An open-source benchmark suite for microservices and their hardware-software implications for cloud and edge systems. In Proceedings of the 24th International Conference on Architectural Support for Programming Languages and Operating Systems. 3--18."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1186\/2192-113X-2-6"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the 30th Symposium on Principles of Distributed Computing. 197--206","author":"Golab W.","unstructured":"W. Golab , X. Li , and M. A. Shah . 2011. Analyzing consistency properties for fun and profit . In Proceedings of the 30th Symposium on Principles of Distributed Computing. 197--206 . W. Golab, X. Li, and M. A. Shah. 2011. Analyzing consistency properties for fun and profit. In Proceedings of the 30th Symposium on Principles of Distributed Computing. 197--206."},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the 1st Workshop on Service Quality and Quantitative Evaluation in New Emerging Technologies.","author":"Grambow M.","unstructured":"M. Grambow , F. Lehmann , and D. Bermbach . 2019. Continuous benchmarking: Using system benchmarking in build pipelines . In Proceedings of the 1st Workshop on Service Quality and Quantitative Evaluation in New Emerging Technologies. M. Grambow, F. Lehmann, and D. Bermbach. 2019. Continuous benchmarking: Using system benchmarking in build pipelines. In Proceedings of the 1st Workshop on Service Quality and Quantitative Evaluation in New Emerging Technologies."},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the 35th ACM Symposium on Applied Computing.","author":"Grambow M.","unstructured":"M. Grambow , L. Meusel , E. Wittern , and D. Bermbach . 2020. Benchmarking microservice performance: A pattern-based approach . In Proceedings of the 35th ACM Symposium on Applied Computing. M. Grambow, L. Meusel, E. Wittern, and D. Bermbach. 2020. Benchmarking microservice performance: A pattern-based approach. In Proceedings of the 35th ACM Symposium on Applied Computing."},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the IEEE Global Communications Conference. 1--7.","author":"Guo J.","unstructured":"J. Guo , Z. Song , Y. Cui , Z. Liu , and Y. Ji . 2017. Energy-efficient resource allocation for multi-user mobile edge computing . In Proceedings of the IEEE Global Communications Conference. 1--7. J. Guo, Z. Song, Y. Cui, Z. Liu, and Y. Ji. 2017. Energy-efficient resource allocation for multi-user mobile edge computing. In Proceedings of the IEEE Global Communications Conference. 1--7."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2509"},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of the IEEE 8th International Conference on Cloud Computing. 9--16","author":"Habak K.","unstructured":"K. Habak , M. Ammar , K. A. Harras , and E. Zegura . 2015. Femto clouds: Leveraging mobile devices to provide cloud service at the edge . In Proceedings of the IEEE 8th International Conference on Cloud Computing. 9--16 . K. Habak, M. Ammar, K. A. Harras, and E. Zegura. 2015. Femto clouds: Leveraging mobile devices to provide cloud service at the edge. In Proceedings of the IEEE 8th International Conference on Cloud Computing. 9--16."},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the 1st BenchCouncil International Symposium on Benchmarking, Measuring, and Optimizing. 23--30","author":"Hao T.","unstructured":"T. Hao , Y. Huang , X. Wen , W. Gao , F. Zhang , C. Zheng , L. Wang , H. Ye , K. Hwang , Z. Ren , and J. Zhan . 2018. Edge AIBench: Towards comprehensive end-to-end edge computing benchmarking . In Proceedings of the 1st BenchCouncil International Symposium on Benchmarking, Measuring, and Optimizing. 23--30 . T. Hao, Y. Huang, X. Wen, W. Gao, F. Zhang, C. Zheng, L. Wang, H. Ye, K. Hwang, Z. Ren, and J. Zhan. 2018. Edge AIBench: Towards comprehensive end-to-end edge computing benchmarking. In Proceedings of the 1st BenchCouncil International Symposium on Benchmarking, Measuring, and Optimizing. 23--30."},{"key":"e_1_2_1_62_1","volume-title":"Proceedings of the 1st IEEE International Conference on Fog Computing.","author":"Hasenburg J.","unstructured":"J. Hasenburg , M. Grambow , E. Grunewald , S. Huk , and D. Bermbach . 2019. MockFog: Emulating fog computing infrastructure in the cloud . In Proceedings of the 1st IEEE International Conference on Fog Computing. J. Hasenburg, M. Grambow, E. Grunewald, S. Huk, and D. Bermbach. 2019. MockFog: Emulating fog computing infrastructure in the cloud. In Proceedings of the 1st IEEE International Conference on Fog Computing."},{"key":"e_1_2_1_63_1","volume-title":"FogExplorer. In Proceedings of the 19th International Middleware Conference, Demos, and Posters (MIDDLEWARE\u201918)","author":"Hasenburg Jonathan","year":"2018","unstructured":"Jonathan Hasenburg , Sebastian Werner , and David Bermbach . 2018 . FogExplorer. In Proceedings of the 19th International Middleware Conference, Demos, and Posters (MIDDLEWARE\u201918) . ACM. Jonathan Hasenburg, Sebastian Werner, and David Bermbach. 2018. FogExplorer. In Proceedings of the 19th International Middleware Conference, Demos, and Posters (MIDDLEWARE\u201918). ACM."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3286719.3286720"},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation. 545--557","author":"Hauer T.","unstructured":"T. Hauer , P. Hoffmann , J. Lunney , D. Ardelean , and A. Diwan . 2020. Meaningful availability . In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation. 545--557 . T. Hauer, P. Hoffmann, J. Lunney, D. Ardelean, and A. Diwan. 2020. Meaningful availability. In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation. 545--557."},{"key":"e_1_2_1_66_1","volume-title":"Technical Report SAND2013-4744. Sandia National Lab.","author":"Heroux M. A.","year":"2013","unstructured":"M. A. Heroux and J. J. Dongarra . 2013 . Toward a New Metric for Ranking High Performance Computing Systems . Technical Report SAND2013-4744. Sandia National Lab. M. A. Heroux and J. J. Dongarra. 2013. Toward a New Metric for Ranking High Performance Computing Systems. Technical Report SAND2013-4744. Sandia National Lab."},{"key":"e_1_2_1_67_1","doi-asserted-by":"crossref","unstructured":"C.-H. Hong and B. Varghese. 2019. Resource management in fog\/edge computing: A survey on architectures infrastructure and algorithms. Comput. Surv. 52 5 (2019).  C.-H. Hong and B. Varghese. 2019. Resource management in fog\/edge computing: A survey on architectures infrastructure and algorithms. Comput. Surv. 52 5 (2019).","DOI":"10.1145\/3326066"},{"key":"e_1_2_1_68_1","volume-title":"Proceedings of the 3rd ACM\/SPEC International Conference on Performance Engineering. 247--248","author":"Hoorn A. Van","unstructured":"A. Van Hoorn , J. Waller , and W. Hasselbring . 2012. Kieker: A framework for application performance monitoring and dynamic software analysis . In Proceedings of the 3rd ACM\/SPEC International Conference on Performance Engineering. 247--248 . A. Van Hoorn, J. Waller, and W. Hasselbring. 2012. Kieker: A framework for application performance monitoring and dynamic software analysis. In Proceedings of the 3rd ACM\/SPEC International Conference on Performance Engineering. 247--248."},{"key":"e_1_2_1_69_1","volume-title":"Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861.","author":"Howard A. G.","year":"2017","unstructured":"A. G. Howard , M. Zhu , B. Chen , D. Kalenichenko , W. Wang , T. Weyand , M. Andreetto , and H. Adam . 2017 . Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861. Retrieved from https:\/\/arxiv.org\/abs\/1704.04861. A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861. Retrieved from https:\/\/arxiv.org\/abs\/1704.04861."},{"key":"e_1_2_1_70_1","volume-title":"Mirovia: A benchmarking suite for modern heterogeneous computing. arXiv:1906.10347.","author":"Hu B.","year":"2019","unstructured":"B. Hu and C. J. Rossbach . 2019 . Mirovia: A benchmarking suite for modern heterogeneous computing. arXiv:1906.10347. Retrieved from http:\/\/arxiv.org\/abs\/1906.10347. B. Hu and C. J. Rossbach. 2019. Mirovia: A benchmarking suite for modern heterogeneous computing. arXiv:1906.10347. Retrieved from http:\/\/arxiv.org\/abs\/1906.10347."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2015.4"},{"key":"e_1_2_1_72_1","volume-title":"Proceedings of the IEEE International Symposium on Cluster Computing and the Grid. 313--320","author":"Iosup A.","unstructured":"A. Iosup and D. Epema . 2006. GRENCHMARK: A framework for analyzing, testing, and comparing grids . In Proceedings of the IEEE International Symposium on Cluster Computing and the Grid. 313--320 . A. Iosup and D. Epema. 2006. GRENCHMARK: A framework for analyzing, testing, and comparing grids. In Proceedings of the IEEE International Symposium on Cluster Computing and the Grid. 313--320."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2011.66"},{"key":"e_1_2_1_74_1","volume-title":"Proceedings of the 3rd ACM\/SPEC International Conference on Performance Engineering. 85--96","author":"Islam S.","unstructured":"S. Islam , K. Lee , A. Fekete , and A. Liu . 2012. How a consumer can measure elasticity for cloud platforms . In Proceedings of the 3rd ACM\/SPEC International Conference on Performance Engineering. 85--96 . S. Islam, K. Lee, A. Fekete, and A. Liu. 2012. How a consumer can measure elasticity for cloud platforms. In Proceedings of the 3rd ACM\/SPEC International Conference on Performance Engineering. 85--96."},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the IEEE Conference on Open Systems. IEEE, 130--135","author":"Ismail B.","unstructured":"B. Ismail , E. Goortani , M. Ab Karim , W. Tat , S. Setapa , J. Luke , and O. Hoe . 2015. Evaluation of Docker as edge computing platform . In Proceedings of the IEEE Conference on Open Systems. IEEE, 130--135 . B. Ismail, E. Goortani, M. Ab Karim, W. Tat, S. Setapa, J. Luke, and O. Hoe. 2015. Evaluation of Docker as edge computing platform. In Proceedings of the IEEE Conference on Open Systems. IEEE, 130--135."},{"key":"e_1_2_1_76_1","volume-title":"Proceedings of the 22nd International Conference on Architectural Support for Programming Languages and Operating Systems. 615--629","author":"Kang Y.","unstructured":"Y. Kang , J. Hauswald , C. Gao , A. Rovinski , T. Mudge , J. Mars , and L. Tang . 2017. Neurosurgeon: Collaborative intelligence between the cloud and mobile edge . In Proceedings of the 22nd International Conference on Architectural Support for Programming Languages and Operating Systems. 615--629 . Y. Kang, J. Hauswald, C. Gao, A. Rovinski, T. Mudge, J. Mars, and L. Tang. 2017. Neurosurgeon: Collaborative intelligence between the cloud and mobile edge. In Proceedings of the 22nd International Conference on Architectural Support for Programming Languages and Operating Systems. 615--629."},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the International Conference on Computer Design. 7--14","author":"Kant K.","unstructured":"K. Kant , R. Iyer , and P. Mohapatra . 2000. Architectural impact of secure socket layer on Internet servers . In Proceedings of the International Conference on Computer Design. 7--14 . K. Kant, R. Iyer, and P. Mohapatra. 2000. Architectural impact of secure socket layer on Internet servers. In Proceedings of the International Conference on Computer Design. 7--14."},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the IEEE International Conference on Cloud Computing. 750--757","author":"Katsalis K.","unstructured":"K. Katsalis , T. Papaioannou , N. Nikaein , and L. Tassiulas . 2016. SLA-driven VM scheduling in mobile edge computing . In Proceedings of the IEEE International Conference on Cloud Computing. 750--757 . K. Katsalis, T. Papaioannou, N. Nikaein, and L. Tassiulas. 2016. SLA-driven VM scheduling in mobile edge computing. In Proceedings of the IEEE International Conference on Cloud Computing. 750--757."},{"key":"e_1_2_1_79_1","volume-title":"Lecture Notes in Computer Science","volume":"6470","author":"Klems M.","unstructured":"M. Klems , M. Menzel , and R. Fischer . 2010. Consistency benchmarking: Evaluating the consistency behavior of middleware services in the cloud. In Service-Oriented Computing, P. Maglio, M. Weske, J. Yang, and M. Fantinato (Eds.) . Lecture Notes in Computer Science , Vol. 6470 . Springer, Berlin, 627--634. M. Klems, M. Menzel, and R. Fischer. 2010. Consistency benchmarking: Evaluating the consistency behavior of middleware services in the cloud. In Service-Oriented Computing, P. Maglio, M. Weske, J. Yang, and M. Fantinato (Eds.). Lecture Notes in Computer Science, Vol. 6470. Springer, Berlin, 627--634."},{"key":"e_1_2_1_80_1","volume-title":"Proceedings of the 3rd USENIX Workshop on Hot Topics in Edge Computing.","author":"Kolosov O.","unstructured":"O. Kolosov , G. Yadgar , S. Maheshwari , and E. Soljanin . 2020. Benchmarking in the dark: On the absence of comprehensive edge datasets . In Proceedings of the 3rd USENIX Workshop on Hot Topics in Edge Computing. O. Kolosov, G. Yadgar, S. Maheshwari, and E. Soljanin. 2020. Benchmarking in the dark: On the absence of comprehensive edge datasets. In Proceedings of the 3rd USENIX Workshop on Hot Topics in Edge Computing."},{"key":"e_1_2_1_81_1","volume-title":"Proceedings of the 38th International Conference on Telecommunications and Signal Processing. 642--646","author":"Komosny D.","unstructured":"D. Komosny , J. Pruzinsky , P. Ilko , J. Polasek , P. Masek , and O. Kocatepe . 2015. On geographic coordinates of PlanetLab europe . In Proceedings of the 38th International Conference on Telecommunications and Signal Processing. 642--646 . D. Komosny, J. Pruzinsky, P. Ilko, J. Polasek, P. Masek, and O. Kocatepe. 2015. On geographic coordinates of PlanetLab europe. In Proceedings of the 38th International Conference on Telecommunications and Signal Processing. 642--646."},{"key":"e_1_2_1_82_1","volume-title":"Proceedings of the 30th International Conference on Management of Data. 579--590","author":"Kossmann D.","unstructured":"D. Kossmann , T. Kraska , and S. Loesing . 2010. An evaluation of alternative architectures for transaction processing in the cloud . In Proceedings of the 30th International Conference on Management of Data. 579--590 . D. Kossmann, T. Kraska, and S. Loesing. 2010. An evaluation of alternative architectures for transaction processing in the cloud. In Proceedings of the 30th International Conference on Management of Data. 579--590."},{"key":"e_1_2_1_83_1","volume-title":"Proceedings of the 12th IEEE International Conference on Industrial Informatics. 611--616","author":"Kruger C. P.","unstructured":"C. P. Kruger and G. P. Hancke . 2014. Benchmarking Internet of Things devices . In Proceedings of the 12th IEEE International Conference on Industrial Informatics. 611--616 . C. P. Kruger and G. P. Hancke. 2014. Benchmarking Internet of Things devices. In Proceedings of the 12th IEEE International Conference on Industrial Informatics. 611--616."},{"key":"e_1_2_1_84_1","volume-title":"Proceedings of the International Conference on Very Large Databases. 1219--1230","author":"Kuhlenkamp J.","unstructured":"J. Kuhlenkamp , M. Klems , and O. R\u00f6ss . 2014. Benchmarking scalability and elasticity of distributed database systems . In Proceedings of the International Conference on Very Large Databases. 1219--1230 . J. Kuhlenkamp, M. Klems, and O. R\u00f6ss. 2014. Benchmarking scalability and elasticity of distributed database systems. In Proceedings of the International Conference on Very Large Databases. 1219--1230."},{"key":"e_1_2_1_85_1","volume-title":"Proceedings of the 13th International Conference on Service-Oriented Computing. 154--168","author":"Kuhlenkamp J.","unstructured":"J. Kuhlenkamp , K. Rudolph , and D. Bermbach . 2015. AISLE: Assessment of provisioned service levels in public IaaS-based database systems . In Proceedings of the 13th International Conference on Service-Oriented Computing. 154--168 . J. Kuhlenkamp, K. Rudolph, and D. Bermbach. 2015. AISLE: Assessment of provisioned service levels in public IaaS-based database systems. In Proceedings of the 13th International Conference on Service-Oriented Computing. 154--168."},{"key":"e_1_2_1_86_1","volume-title":"Proceedings of the 35th ACM\/SIGAPP Symposium on Applied Computing.","author":"Kuhlenkamp J.","unstructured":"J. Kuhlenkamp , S. Werner , M. C. Borges , D. Ernst , and D. Wenzel . 2020. Benchmarking elasticity of faas platforms as a foundation for objective-driven design of serverless applications . In Proceedings of the 35th ACM\/SIGAPP Symposium on Applied Computing. J. Kuhlenkamp, S. Werner, M. C. Borges, D. Ernst, and D. Wenzel. 2020. Benchmarking elasticity of faas platforms as a foundation for objective-driven design of serverless applications. In Proceedings of the 35th ACM\/SIGAPP Symposium on Applied Computing."},{"key":"e_1_2_1_87_1","volume-title":"Proceedings of the IEEE International Conference on Image Processing. 170--174","author":"Lee C.","unstructured":"C. Lee , M. Lin , C. Yang , and Y. Chen . 2019. IoTBench: A benchmark suite for intelligent Internet of Things edge devices . In Proceedings of the IEEE International Conference on Image Processing. 170--174 . C. Lee, M. Lin, C. Yang, and Y. Chen. 2019. IoTBench: A benchmark suite for intelligent Internet of Things edge devices. In Proceedings of the IEEE International Conference on Image Processing. 170--174."},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2019.2899679"},{"key":"e_1_2_1_89_1","volume-title":"Proceedings of the 2nd Workshop on Accelerated Machine Learning.","author":"Libutti L. A.","unstructured":"L. A. Libutti , F. D. Igual , L. Pinuel , L. De Giusti , and M. Naiouf . 2020. Benchmarking performance and power of USB accelerators for inference with MLPerf . In Proceedings of the 2nd Workshop on Accelerated Machine Learning. L. A. Libutti, F. D. Igual, L. Pinuel, L. De Giusti, and M. Naiouf. 2020. Benchmarking performance and power of USB accelerators for inference with MLPerf. In Proceedings of the 2nd Workshop on Accelerated Machine Learning."},{"key":"e_1_2_1_90_1","first-page":"4212","article-title":"HERMIT: A benchmark suite for the Internet of Medical Things","volume":"5","author":"Limaye A.","year":"2018","unstructured":"A. Limaye and T. Adegbija . 2018 . HERMIT: A benchmark suite for the Internet of Medical Things . IEEE IoT J. 5 , 5 (2018), 4212 -- 4222 . A. Limaye and T. Adegbija. 2018. HERMIT: A benchmark suite for the Internet of Medical Things. IEEE IoT J. 5, 5 (2018), 4212--4222.","journal-title":"IEEE IoT J."},{"key":"e_1_2_1_91_1","volume-title":"Proceedings of the IEEE International Symposium on Reliable Distributed Systems. IEEE, 45--54","author":"Lin Y.","unstructured":"Y. Lin , B. Kemme , M. Patino-Martinez , and R. Jimenez-Peris . 2007. Enhancing edge computing with database replication . In Proceedings of the IEEE International Symposium on Reliable Distributed Systems. IEEE, 45--54 . Y. Lin, B. Kemme, M. Patino-Martinez, and R. Jimenez-Peris. 2007. Enhancing edge computing with database replication. In Proceedings of the IEEE International Symposium on Reliable Distributed Systems. IEEE, 45--54."},{"key":"e_1_2_1_92_1","volume-title":"Proceedings of the IEEE\/ACM 3rd Workshop on Deep Learning on Supercomputers. 20--28","author":"Liu Z.","unstructured":"Z. Liu , T. Bicer , R. Kettimuthu , and I. Foster . 2019. Deep learning accelerated light source experiments . In Proceedings of the IEEE\/ACM 3rd Workshop on Deep Learning on Supercomputers. 20--28 . Z. Liu, T. Bicer, R. Kettimuthu, and I. Foster. 2019. Deep learning accelerated light source experiments. In Proceedings of the IEEE\/ACM 3rd Workshop on Deep Learning on Supercomputers. 20--28."},{"key":"e_1_2_1_93_1","volume-title":"De Carlo, and I. Foster","author":"Liu Z.","year":"2019","unstructured":"Z. Liu , T. Bicer , R. Kettimuthu , D. Gursoy , F. De Carlo, and I. Foster . 2019 . Tomogan : Low-dose X-ray tomography with generative adversarial networks. arXiv:1902.07582. Retrieved from https:\/\/arxiv.org\/abs\/1902.07582. Z. Liu, T. Bicer, R. Kettimuthu, D. Gursoy, F. De Carlo, and I. Foster. 2019. Tomogan: Low-dose X-ray tomography with generative adversarial networks. arXiv:1902.07582. Retrieved from https:\/\/arxiv.org\/abs\/1902.07582."},{"key":"e_1_2_1_94_1","volume-title":"Companion Proceedings of the 10th International Conference on Utility and Cloud Computing. 47--52","author":"Lopes M. M.","unstructured":"M. M. Lopes , W. A. Higashino , M. A. M. Capretz , and L. F. Bittencourt . 2017. MyiFogSim: A simulator for virtual machine migration in fog computing . In Companion Proceedings of the 10th International Conference on Utility and Cloud Computing. 47--52 . M. M. Lopes, W. A. Higashino, M. A. M. Capretz, and L. F. Bittencourt. 2017. MyiFogSim: A simulator for virtual machine migration in fog computing. In Companion Proceedings of the 10th International Conference on Utility and Cloud Computing. 47--52."},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11704-012-2118-7"},{"key":"e_1_2_1_96_1","doi-asserted-by":"crossref","unstructured":"C. Luo F. Zhang C. Huang X. Xiong J. Chen L. Wang W. Gao H. Ye T. Wu R. Zhou and J. Zhan. 2019. AIoT bench: Towards comprehensive benchmarking mobile and embedded device intelligence. In Benchmarking Measuring and Optimizing C. Zheng and J. Zhan (Eds.). Springer International Publishing 31--35.  C. Luo F. Zhang C. Huang X. Xiong J. Chen L. Wang W. Gao H. Ye T. Wu R. Zhou and J. Zhan. 2019. AIoT bench: Towards comprehensive benchmarking mobile and embedded device intelligence. In Benchmarking Measuring and Optimizing C. Zheng and J. Zhan (Eds.). Springer International Publishing 31--35.","DOI":"10.1007\/978-3-030-32813-9_4"},{"key":"e_1_2_1_97_1","volume-title":"Proceedings of the ACM\/IEEE Conference on Supercomputing.","author":"Luszczek P. R.","unstructured":"P. R. Luszczek , D. H. Bailey , J. J. Dongarra , J. Kepner , R. F. Lucas , R. Rabenseifner , and D. Takahashi . 2006. The HPC challenge (HPCC) benchmark suite . In Proceedings of the ACM\/IEEE Conference on Supercomputing. P. R. Luszczek, D. H. Bailey, J. J. Dongarra, J. Kepner, R. F. Lucas, R. Rabenseifner, and D. Takahashi. 2006. The HPC challenge (HPCC) benchmark suite. In Proceedings of the ACM\/IEEE Conference on Supercomputing."},{"key":"e_1_2_1_98_1","volume-title":"Proceedings of the ACM\/IEEE Symposium on Edge Computing. 1--13","author":"Ma L.","unstructured":"L. Ma , S. Yi , and Q. Li . 2017. Efficient service handoff across edge servers via Docker container migration . In Proceedings of the ACM\/IEEE Symposium on Edge Computing. 1--13 . L. Ma, S. Yi, and Q. Li. 2017. Efficient service handoff across edge servers via Docker container migration. In Proceedings of the ACM\/IEEE Symposium on Edge Computing. 1--13."},{"key":"e_1_2_1_99_1","volume-title":"Proceedings of the International Conference on Fog and Edge Computing.","author":"Madej A.","unstructured":"A. Madej , N. Wang , N. Athanasopoulos , R. Ranjan , and B. Varghese . 2020. Priority-based fair scheduling in edge computing . In Proceedings of the International Conference on Fog and Edge Computing. A. Madej, N. Wang, N. Athanasopoulos, R. Ranjan, and B. Varghese. 2020. Priority-based fair scheduling in edge computing. In Proceedings of the International Conference on Fog and Edge Computing."},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1145\/2490301.2451167"},{"key":"e_1_2_1_101_1","volume-title":"Memory bandwidth and machine balance in current high performance computers","author":"McCalpin J. D.","year":"1995","unstructured":"J. D. McCalpin . 1995. Memory bandwidth and machine balance in current high performance computers . IEEE Techn. Commit. Comput. Arch. Newslett . 2 ( 1995 ). J. D. McCalpin. 1995. Memory bandwidth and machine balance in current high performance computers. IEEE Techn. Commit. Comput. Arch. Newslett. 2 (1995)."},{"key":"e_1_2_1_102_1","volume-title":"Proceedings of the 4th ACM\/IEEE Symposium on Edge Computing. 47--58","author":"McChesney J.","unstructured":"J. McChesney , N. Wang , A. Tanwer , E. de Lara , and B. Varghese . 2019. DeFog: Fog computing benchmarks . In Proceedings of the 4th ACM\/IEEE Symposium on Edge Computing. 47--58 . J. McChesney, N. Wang, A. Tanwer, E. de Lara, and B. Varghese. 2019. DeFog: Fog computing benchmarks. In Proceedings of the 4th ACM\/IEEE Symposium on Edge Computing. 47--58."},{"key":"e_1_2_1_103_1","first-page":"1","article-title":"Survey of FPGA-based accelerators for convolutional neural networks","volume":"32","author":"Mittal S.","year":"2018","unstructured":"S. Mittal . 2018 . Survey of FPGA-based accelerators for convolutional neural networks . Neural Comput. Appl. 32 , 4 (2018), 1 -- 31 . S. Mittal. 2018. Survey of FPGA-based accelerators for convolutional neural networks. Neural Comput. Appl. 32, 4 (2018), 1--31.","journal-title":"Neural Comput. Appl."},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2704444"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.2018.1700175"},{"key":"e_1_2_1_106_1","volume-title":"Proceedings of the 2nd International Conference on Cloud Engineering. IEEE.","author":"M\u00fcller S.","unstructured":"S. M\u00fcller , D. Bermbach , S. Tai , and F. Pallas . 2014. Benchmarking the performance impact of transport layer security in cloud database systems . In Proceedings of the 2nd International Conference on Cloud Engineering. IEEE. S. M\u00fcller, D. Bermbach, S. Tai, and F. Pallas. 2014. Benchmarking the performance impact of transport layer security in cloud database systems. In Proceedings of the 2nd International Conference on Cloud Engineering. IEEE."},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1109\/EuCNC.2017.7980775"},{"key":"e_1_2_1_108_1","doi-asserted-by":"crossref","unstructured":"F. Nadeem R. Prodan T. Fahringer and A. Iosup. 2008. Benchmarking Grid Applications. Springer US Boston MA 19--37.  F. Nadeem R. Prodan T. Fahringer and A. Iosup. 2008. Benchmarking Grid Applications. Springer US Boston MA 19--37.","DOI":"10.1007\/978-0-387-78446-5_2"},{"key":"e_1_2_1_109_1","doi-asserted-by":"crossref","unstructured":"R. Nambiar M. Poess A. Dey P. Cao T. Magdon-Ismail D. Q. Ren and A. Bond. 2015. Introducing TPCx-HS: The first industry standard for benchmarking big data systems. In Performance Characterization and Benchmarking. Traditional to Big Data R. Nambiar and M. Poess (Eds.). Springer International Publishing 1--12.  R. Nambiar M. Poess A. Dey P. Cao T. Magdon-Ismail D. Q. Ren and A. Bond. 2015. Introducing TPCx-HS: The first industry standard for benchmarking big data systems. In Performance Characterization and Benchmarking. Traditional to Big Data R. Nambiar and M. Poess (Eds.). Springer International Publishing 1--12.","DOI":"10.1007\/978-3-319-15350-6_1"},{"key":"e_1_2_1_110_1","volume-title":"Proceedings of the 20th International Workshop on Mobile Computing Systems and Applications. 93--98","author":"Olgu\u00edn Mu\u00f1oz M. O. J.","unstructured":"M. O. J. Olgu\u00edn Mu\u00f1oz , J. Wang , M. Satyanarayanan , and J. Gross . 2019. EdgeDroid: An experimental approach to benchmarking human-in-the-loop applications . In Proceedings of the 20th International Workshop on Mobile Computing Systems and Applications. 93--98 . M. O. J. Olgu\u00edn Mu\u00f1oz, J. Wang, M. Satyanarayanan, and J. Gross. 2019. EdgeDroid: An experimental approach to benchmarking human-in-the-loop applications. In Proceedings of the 20th International Workshop on Mobile Computing Systems and Applications. 93--98."},{"key":"e_1_2_1_111_1","volume-title":"Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software. 122--132","author":"Palit T.","unstructured":"T. Palit , Yongming Shen , and M. Ferdman . 2016. Demystifying cloud benchmarking . In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software. 122--132 . T. Palit, Yongming Shen, and M. Ferdman. 2016. Demystifying cloud benchmarking. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software. 122--132."},{"key":"e_1_2_1_112_1","volume-title":"Proceedings of the the 32nd ACM Symposium on Applied Computing.","author":"Pallas F.","unstructured":"F. Pallas , D. Bermbach , S. M\u00fcller , and S. Tai . 2017. Evidence-based security configurations for cloud datastores . In Proceedings of the the 32nd ACM Symposium on Applied Computing. F. Pallas, D. Bermbach, S. M\u00fcller, and S. Tai. 2017. Evidence-based security configurations for cloud datastores. In Proceedings of the the 32nd ACM Symposium on Applied Computing."},{"key":"e_1_2_1_113_1","volume-title":"Proceedings of the IEEE International Conference on Big Data.","author":"Pallas F.","unstructured":"F. Pallas , J. G\u00fcnther , and D. Bermbach . 2017. Pick your choice in HBase: Security or performance . In Proceedings of the IEEE International Conference on Big Data. F. Pallas, J. G\u00fcnther, and D. Bermbach. 2017. Pick your choice in HBase: Security or performance. In Proceedings of the IEEE International Conference on Big Data."},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2020.2979161"},{"key":"e_1_2_1_115_1","first-page":"1","article-title":"YCSB++: Benchmarking and performance debugging advanced features in scalable table stores. In Proceedings of the 2nd Symposium on Cloud Computing","volume":"9","author":"Patil S.","year":"2011","unstructured":"S. Patil , M. Polte , K. Ren , W. Tantisiriroj , L. Xiao , J. L\u00f3pez , G. Gibson , A. Fuchs , and B. Rinaldi . 2011 . YCSB++: Benchmarking and performance debugging advanced features in scalable table stores. In Proceedings of the 2nd Symposium on Cloud Computing . Article 9 , 9: 1 -- 9 :14 pages. S. Patil, M. Polte, K. Ren, W. Tantisiriroj, L. Xiao, J. L\u00f3pez, G. Gibson, A. Fuchs, and B. Rinaldi. 2011. YCSB++: Benchmarking and performance debugging advanced features in scalable table stores. In Proceedings of the 2nd Symposium on Cloud Computing. Article 9, 9:1--9:14 pages.","journal-title":"Article"},{"key":"e_1_2_1_116_1","first-page":"12","volume-title":"Proc. VLDB Endow. 5","author":"Rabl T.","year":"2012","unstructured":"T. Rabl , M. Sadoghi , H.-A. Jacobsen , S. G\u00f3mez-Villamor , V. Munt\u00e9s-Mulero , and S. Mankovskii . 2012. Solving big data challenges for enterprise application performance management . Proc. VLDB Endow. 5 , 12 ( 2012 ). T. Rabl, M. Sadoghi, H.-A. Jacobsen, S. G\u00f3mez-Villamor, V. Munt\u00e9s-Mulero, and S. Mankovskii. 2012. Solving big data challenges for enterprise application performance management. Proc. VLDB Endow. 5, 12 (2012)."},{"key":"e_1_2_1_117_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2013.07.013"},{"key":"e_1_2_1_118_1","volume-title":"Proceedings of the IEEE 17th International Symposium on A World of Wireless, Mobile and Multimedia Networks. 1--6.","author":"Ramalho F.","unstructured":"F. Ramalho and A. Neto . 2016. Virtualization at the network edge: A performance comparison . In Proceedings of the IEEE 17th International Symposium on A World of Wireless, Mobile and Multimedia Networks. 1--6. F. Ramalho and A. Neto. 2016. Virtualization at the network edge: A performance comparison. In Proceedings of the IEEE 17th International Symposium on A World of Wireless, Mobile and Multimedia Networks. 1--6."},{"key":"e_1_2_1_119_1","volume-title":"Chou et al","author":"Reddi V. J.","year":"2019","unstructured":"V. J. Reddi , C. Cheng , D. Kanter , P. Mattson , G. Schmuelling , C.-J. Wu , B. Anderson , M. Breughe , M. Charlebois , and W. Chou et al . 2019 . MLPerf inference benchmark. arXiv:1911.02549. Retrieved from https:\/\/arxiv.org\/abs\/1911.02549. V. J. Reddi, C. Cheng, D. Kanter, P. Mattson, G. Schmuelling, C.-J. Wu, B. Anderson, M. Breughe, M. Charlebois, and W. Chou et al. 2019. MLPerf inference benchmark. arXiv:1911.02549. Retrieved from https:\/\/arxiv.org\/abs\/1911.02549."},{"key":"e_1_2_1_120_1","volume-title":"Proceedings of the 24th Annual IEEE High Performance Extreme Computing Conference.","author":"Reuther A.","unstructured":"A. Reuther , P. Michaleas , M. Jones , V. Gadepally , S. Samsi , and J. Kepner . 2019. Survey and benchmarking of machine learning accelerators . In Proceedings of the 24th Annual IEEE High Performance Extreme Computing Conference. A. Reuther, P. Michaleas, M. Jones, V. Gadepally, S. Samsi, and J. Kepner. 2019. Survey and benchmarking of machine learning accelerators. In Proceedings of the 24th Annual IEEE High Performance Extreme Computing Conference."},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2018.1700793"},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-016-1872-y"},{"key":"e_1_2_1_123_1","volume-title":"Proceedings of the IEEE International Conference on Cloud Engineering. 57--66","author":"Ryden M.","unstructured":"M. Ryden , K. Oh , A. Chandra , and J. Weissman . 2014. Nebula: Distributed edge cloud for data intensive computing . In Proceedings of the IEEE International Conference on Cloud Engineering. 57--66 . M. Ryden, K. Oh, A. Chandra, and J. Weissman. 2014. Nebula: Distributed edge cloud for data intensive computing. In Proceedings of the IEEE International Conference on Cloud Engineering. 57--66."},{"key":"e_1_2_1_124_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSIPN.2015.2448520"},{"key":"e_1_2_1_125_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2017.9"},{"key":"e_1_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2009.82"},{"key":"e_1_2_1_127_1","volume-title":"Proceedings of the 3rd Conference on Networked Systems Design & Implementation.","author":"Schroeder B.","unstructured":"B. Schroeder , A. Wierman , and M. Harchol-Balter . 2006. Open versus closed: A cautionary tale . In Proceedings of the 3rd Conference on Networked Systems Design & Implementation. B. Schroeder, A. Wierman, and M. Harchol-Balter. 2006. Open versus closed: A cautionary tale. In Proceedings of the 3rd Conference on Networked Systems Design & Implementation."},{"key":"e_1_2_1_128_1","volume-title":"Proceedings of the International Conference on Embedded Wireless Systems and Networks. 54--65","author":"Schuundefined M.","unstructured":"M. Schuundefined , C. A. Boano , M. Weber , and K. R\u00f6mer . 2017. A competition to push the dependability of low-power wireless protocols to the edge . In Proceedings of the International Conference on Embedded Wireless Systems and Networks. 54--65 . M. Schuundefined, C. A. Boano, M. Weber, and K. R\u00f6mer. 2017. A competition to push the dependability of low-power wireless protocols to the edge. In Proceedings of the International Conference on Embedded Wireless Systems and Networks. 54--65."},{"key":"e_1_2_1_129_1","volume-title":"Proceedings of the IEEE International Conference on Web Services. 647--654","author":"Shao L.","unstructured":"L. Shao , J. Zhao , T. Xie , L. Zhang , B. Xie , and H. Mei . 2009. User-perceived service availability: A metric and an estimation approach . In Proceedings of the IEEE International Conference on Web Services. 647--654 . L. Shao, J. Zhao, T. Xie, L. Zhang, B. Xie, and H. Mei. 2009. User-perceived service availability: A metric and an estimation approach. In Proceedings of the IEEE International Conference on Web Services. 647--654."},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2006.1639600"},{"key":"e_1_2_1_131_1","unstructured":"S. Shastri V. Banakar M. Wasserman A. Kumar and V. Chidambaram. 2019. Understanding and benchmarking the impact of GDPR on database systems. arXiv:1910.00728. Retrieved from https:\/\/arxiv.org\/abs\/1910.00728.  S. Shastri V. Banakar M. Wasserman A. Kumar and V. Chidambaram. 2019. Understanding and benchmarking the impact of GDPR on database systems. arXiv:1910.00728. Retrieved from https:\/\/arxiv.org\/abs\/1910.00728."},{"key":"e_1_2_1_132_1","first-page":"637","article-title":"Edge computing: Vision and challenges","volume":"3","author":"Shi W.","year":"2016","unstructured":"W. Shi , J. Cao , Q. Zhang , Y. Li , and L. Xu . 2016 . Edge computing: Vision and challenges . IEEE IoT J. 3 , 5 (2016), 637 -- 646 . W. Shi, J. Cao, Q. Zhang, Y. Li, and L. Xu. 2016. Edge computing: Vision and challenges. IEEE IoT J. 3, 5 (2016), 637--646.","journal-title":"IEEE IoT J."},{"key":"e_1_2_1_133_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.4257"},{"key":"e_1_2_1_134_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11761-017-0219-8"},{"key":"e_1_2_1_135_1","volume-title":"Proceedings of the IEEE International Conference on Fog and Edge Computing. IEEE. 89--96","author":"Skarlat O.","unstructured":"O. Skarlat , M. Nardelli , S. Schulte , and S. Dustdar . 2017. Towards QoS-aware fog service placement . In Proceedings of the IEEE International Conference on Fog and Edge Computing. IEEE. 89--96 . O. Skarlat, M. Nardelli, S. Schulte, and S. Dustdar. 2017. Towards QoS-aware fog service placement. In Proceedings of the IEEE International Conference on Fog and Edge Computing. IEEE. 89--96."},{"key":"e_1_2_1_136_1","doi-asserted-by":"publisher","DOI":"10.1145\/773056.773062"},{"key":"e_1_2_1_137_1","volume-title":"Proceedings of the International Conference on Fog and Mobile Edge Computing. 39--44","author":"Sonmez C.","unstructured":"C. Sonmez , A. Ozgovde , and C. Ersoy . 2017. EdgeCloudSim: An environment for performance evaluation of edge computing systems . In Proceedings of the International Conference on Fog and Mobile Edge Computing. 39--44 . C. Sonmez, A. Ozgovde, and C. Ersoy. 2017. EdgeCloudSim: An environment for performance evaluation of edge computing systems. In Proceedings of the International Conference on Fog and Mobile Edge Computing. 39--44."},{"key":"e_1_2_1_138_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSM.2019.2901346"},{"key":"e_1_2_1_139_1","volume-title":"Proceedings of the IEEE International Conference on Edge Computing. 248--251","author":"Sridhar S.","unstructured":"S. Sridhar and M. E. Tolentino . 2017. Evaluating voice interaction pipelines at the edge . In Proceedings of the IEEE International Conference on Edge Computing. 248--251 . S. Sridhar and M. E. Tolentino. 2017. Evaluating voice interaction pipelines at the edge. In Proceedings of the IEEE International Conference on Edge Computing. 248--251."},{"key":"e_1_2_1_140_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1--9.","author":"Szegedy C.","unstructured":"C. Szegedy , W. Liu , Y. Jia , P. Sermanet , S. Reed , D. Anguelov , D. Erhan , V. Vanhoucke , and A. Rabinovich . 2015. Going deeper with convolutions . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1--9. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1--9."},{"key":"e_1_2_1_141_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781119941378"},{"key":"e_1_2_1_142_1","volume-title":"Proceedings of the 1st International Workshop on Resource Management of Cloud Computing. 108--112","author":"Tso F. P.","unstructured":"F. P. Tso , D. R. White , S. Jouet , J. Singer , and D. P. Pezaros . 2013. The Glasgow Raspberry Pi Cloud: A scale model for cloud computing infrastructures . In Proceedings of the 1st International Workshop on Resource Management of Cloud Computing. 108--112 . F. P. Tso, D. R. White, S. Jouet, J. Singer, and D. P. Pezaros. 2013. The Glasgow Raspberry Pi Cloud: A scale model for cloud computing infrastructures. In Proceedings of the 1st International Workshop on Resource Management of Cloud Computing. 108--112."},{"key":"e_1_2_1_143_1","volume-title":"Proceedings of the 4th International Workshop on Grid Computing.","author":"Tsouloupas G.","unstructured":"G. Tsouloupas and M. D. Dikaiakos . 2003. GridBench: A tool for benchmarking grids . In Proceedings of the 4th International Workshop on Grid Computing. G. Tsouloupas and M. D. Dikaiakos. 2003. GridBench: A tool for benchmarking grids. In Proceedings of the 4th International Workshop on Grid Computing."},{"key":"e_1_2_1_144_1","volume-title":"Proceedings of the IEEE International Conference on Cloud Computing Technology and Science. 535--540","author":"Varghese B.","unstructured":"B. Varghese , O. Akgun , I. Miguel , L. Thai , and A. Barker . 2014. Cloud benchmarking for performance . In Proceedings of the IEEE International Conference on Cloud Computing Technology and Science. 535--540 . B. Varghese, O. Akgun, I. Miguel, L. Thai, and A. Barker. 2014. Cloud benchmarking for performance. In Proceedings of the IEEE International Conference on Cloud Computing Technology and Science. 535--540."},{"key":"e_1_2_1_145_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCC.2016.2603476"},{"key":"e_1_2_1_146_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2017.09.020"},{"key":"e_1_2_1_147_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2019.2895307"},{"key":"e_1_2_1_148_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCC.2018.064181118"},{"key":"e_1_2_1_149_1","volume-title":"Proceedings of the IEEE International Conference on Cloud Engineering. 192--201","author":"Varghese B.","unstructured":"B. Varghese , L. T. Subba , L. Thai , and A. Barker . 2016. Container-based cloud virtual machine benchmarking . In Proceedings of the IEEE International Conference on Cloud Engineering. 192--201 . B. Varghese, L. T. Subba, L. Thai, and A. Barker. 2016. Container-based cloud virtual machine benchmarking. In Proceedings of the IEEE International Conference on Cloud Engineering. 192--201."},{"key":"e_1_2_1_150_1","volume-title":"Proceedings of the IEEE International Conference on Smart Cloud. 20--26","author":"Varghese B.","unstructured":"B. Varghese , N. Wang , S. Barbhuiya , P. Kilpatrick , and D. S. Nikolopoulos . 2016. Challenges and opportunities in edge computing . In Proceedings of the IEEE International Conference on Smart Cloud. 20--26 . B. Varghese, N. Wang, S. Barbhuiya, P. Kilpatrick, and D. S. Nikolopoulos. 2016. Challenges and opportunities in edge computing. In Proceedings of the IEEE International Conference on Smart Cloud. 20--26."},{"key":"e_1_2_1_151_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2011.08.005"},{"key":"e_1_2_1_152_1","volume-title":"Proceedings of the 5th Conference on Innovative Data Systems Research. 134--143","author":"Wada H.","unstructured":"H. Wada , A. Fekete , L. Zhao , K. Lee , and A. Liu . 2011. Data consistency properties and the trade-offs in commercial cloud storages: The consumers\u2019 perspective . In Proceedings of the 5th Conference on Innovative Data Systems Research. 134--143 . H. Wada, A. Fekete, L. Zhao, K. Lee, and A. Liu. 2011. Data consistency properties and the trade-offs in commercial cloud storages: The consumers\u2019 perspective. In Proceedings of the 5th Conference on Innovative Data Systems Research. 134--143."},{"key":"e_1_2_1_153_1","volume-title":"Proceedings of the 4th ACM\/IEEE Symposium on Edge Computing. 152--165","author":"Wang J.","unstructured":"J. Wang , Z. Feng , S. George , R. Iyengar , P. Pillai , and M. Satyanarayanan . 2019. Towards scalable edge-native applications . In Proceedings of the 4th ACM\/IEEE Symposium on Edge Computing. 152--165 . J. Wang, Z. Feng, S. George, R. Iyengar, P. Pillai, and M. Satyanarayanan. 2019. Towards scalable edge-native applications. In Proceedings of the 4th ACM\/IEEE Symposium on Edge Computing. 152--165."},{"key":"e_1_2_1_154_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2020.02.043"},{"key":"e_1_2_1_155_1","first-page":"1086","article-title":"ENORM: A framework for edge node resource management","volume":"13","author":"Wang N.","year":"2020","unstructured":"N. Wang , B. Varghese , M. Matthaiou , and D. S. Nikolopoulos . 2020 . ENORM: A framework for edge node resource management . IEEE Trans. Serv. Comput. 13 , 6 (2020), 1086 -- 1099 . N. Wang, B. Varghese, M. Matthaiou, and D. S. Nikolopoulos. 2020. ENORM: A framework for edge node resource management. IEEE Trans. Serv. Comput. 13, 6 (2020), 1086--1099.","journal-title":"IEEE Trans. Serv. Comput."},{"key":"e_1_2_1_156_1","volume-title":"Proceedings of the IEEE\/ACM Symposium on Edge Computing. 30--42","author":"Wang Y.","unstructured":"Y. Wang , S. Liu , X. Wu , and W. Shi . 2018. CAVBench: A benchmark suite for connected and autonomous vehicles . In Proceedings of the IEEE\/ACM Symposium on Edge Computing. 30--42 . Y. Wang, S. Liu, X. Wu, and W. Shi. 2018. CAVBench: A benchmark suite for connected and autonomous vehicles. In Proceedings of the IEEE\/ACM Symposium on Edge Computing. 30--42."},{"key":"e_1_2_1_157_1","doi-asserted-by":"publisher","DOI":"10.1145\/358274.358283"},{"key":"e_1_2_1_158_1","doi-asserted-by":"crossref","unstructured":"H. Wu F. Liu and R. B. Lee. 2016. Cloud server benchmark suite for evaluating new hardware architectures. IEEE Comput. Arch. Lett. (2016).  H. Wu F. Liu and R. B. Lee. 2016. Cloud server benchmark suite for evaluating new hardware architectures. IEEE Comput. Arch. Lett. (2016).","DOI":"10.1109\/LCA.2016.2597818"},{"key":"e_1_2_1_159_1","volume-title":"Proceedings of the IEEE Conference on Computer Communications. IEEE, 1--9.","author":"Xiao Y.","unstructured":"Y. Xiao and M. Krunz . 2017. QoE and power efficiency tradeoff for fog computing networks with fog node cooperation . In Proceedings of the IEEE Conference on Computer Communications. IEEE, 1--9. Y. Xiao and M. Krunz. 2017. QoE and power efficiency tradeoff for fog computing networks with fog node cooperation. In Proceedings of the IEEE Conference on Computer Communications. IEEE, 1--9."},{"key":"e_1_2_1_160_1","doi-asserted-by":"crossref","unstructured":"X. Yang X. Li Y. Ji and M. Sha. 2008. CROWNBench: A grid performance testing system using customizable synthetic workload. In Progress in WWW Research and Development Y. Zhang G. Yu E. Bertino and G. Xu (Eds.). Springer Berlin 190--201.  X. Yang X. Li Y. Ji and M. Sha. 2008. CROWNBench: A grid performance testing system using customizable synthetic workload. In Progress in WWW Research and Development Y. Zhang G. Yu E. Bertino and G. Xu (Eds.). Springer Berlin 190--201.","DOI":"10.1007\/978-3-540-78849-2_21"},{"key":"e_1_2_1_161_1","volume-title":"Proceedings of the IEEE International Conference on Mobile Ad-Hoc and Sensor Systems. 182--190","author":"Yao Y.","unstructured":"Y. Yao , Q. Cao , and A. Vasilakos . 2013. EDAL: An energy-efficient, delay-aware, and lifetime-balancing data collection protocol for wireless sensor networks . In Proceedings of the IEEE International Conference on Mobile Ad-Hoc and Sensor Systems. 182--190 . Y. Yao, Q. Cao, and A. Vasilakos. 2013. EDAL: An energy-efficient, delay-aware, and lifetime-balancing data collection protocol for wireless sensor networks. In Proceedings of the IEEE International Conference on Mobile Ad-Hoc and Sensor Systems. 182--190."},{"key":"e_1_2_1_162_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2016.2633522"},{"key":"e_1_2_1_163_1","first-page":"1","article-title":"How consistent is your cloud application? In Proceedings of the 3rd Symposium on Cloud Computing","volume":"6","author":"Zellag K.","year":"2012","unstructured":"K. Zellag and B. Kemme . 2012 . How consistent is your cloud application? In Proceedings of the 3rd Symposium on Cloud Computing . Article 6 , 6: 1 -- 6 :14 pages. K. Zellag and B. Kemme. 2012. How consistent is your cloud application? In Proceedings of the 3rd Symposium on Cloud Computing. Article 6, 6:1--6:14 pages.","journal-title":"Article"},{"key":"e_1_2_1_164_1","volume-title":"Proceedings of the IEEE International Conference on Communications. IEEE, 1--6.","author":"Zhang K.","unstructured":"K. Zhang , Y. Mao , S. Leng , S. Maharjan , and Y. Zhang . 2017. Optimal delay constrained offloading for vehicular edge computing networks . In Proceedings of the IEEE International Conference on Communications. IEEE, 1--6. K. Zhang, Y. Mao, S. Leng, S. Maharjan, and Y. Zhang. 2017. Optimal delay constrained offloading for vehicular edge computing networks. In Proceedings of the IEEE International Conference on Communications. IEEE, 1--6."},{"key":"e_1_2_1_165_1","volume-title":"Proceedings of the USENIX Workshop on Hot Topics in Edge Computing.","author":"Zhang X.","unstructured":"X. Zhang , Y. Wang , and W. Shi . 2018. pCAMP: Performance comparison of machine learning packages on the edges . In Proceedings of the USENIX Workshop on Hot Topics in Edge Computing. X. Zhang, Y. Wang, and W. Shi. 2018. pCAMP: Performance comparison of machine learning packages on the edges. In Proceedings of the USENIX Workshop on Hot Topics in Edge Computing."},{"key":"e_1_2_1_166_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2019.2917890"},{"key":"e_1_2_1_167_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2710056"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3444692","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3444692","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:20Z","timestamp":1750197800000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3444692"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,22]]},"references-count":166,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,4,30]]}},"alternative-id":["10.1145\/3444692"],"URL":"https:\/\/doi.org\/10.1145\/3444692","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,22]]},"assertion":[{"value":"2020-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}