{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T17:01:02Z","timestamp":1761238862500,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":22,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T00:00:00Z","timestamp":1618790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,19]]},"DOI":"10.1145\/3447545.3451180","type":"proceedings-article","created":{"date-parts":[[2021,4,11]],"date-time":"2021-04-11T16:51:45Z","timestamp":1618159905000},"page":"21-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Towards Independent Run-Time Cloud Monitoring"],"prefix":"10.1145","author":[{"given":"Luuk","family":"Klaver","sequence":"first","affiliation":[{"name":"TNO, The Hague, Netherlands"}]},{"given":"Thijs","family":"van der Knaap","sequence":"additional","affiliation":[{"name":"TNO, Groningen, Netherlands"}]},{"given":"Johan","family":"van der Geest","sequence":"additional","affiliation":[{"name":"TNO, Groningen, Netherlands"}]},{"given":"Edwin","family":"Harmsma","sequence":"additional","affiliation":[{"name":"TNO, Groningen, Netherlands"}]},{"given":"Bram","family":"van der Waaij","sequence":"additional","affiliation":[{"name":"TNO, Groningen, Netherlands"}]},{"given":"Paolo","family":"Pileggi","sequence":"additional","affiliation":[{"name":"TNO, The Hague, Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2021,4,19]]},"reference":[{"doi-asserted-by":"crossref","unstructured":"Philipp Leitner and Jurgen Cito. 2016. Patterns in the Chaos -- A Study of Performance Variation and Predictability in Public IaaS Clouds. ACM Transactions on Internet Technology 16(3).  Philipp Leitner and Jurgen Cito. 2016. Patterns in the Chaos -- A Study of Performance Variation and Predictability in Public IaaS Clouds. ACM Transactions on Internet Technology 16(3).","key":"e_1_3_2_1_1_1","DOI":"10.1145\/2885497"},{"volume-title":"Sharing storage behavior via cloud computing","author":"Alsmadi Duha","unstructured":"Duha Alsmadi and Victor Prybutok . 2018. Sharing storage behavior via cloud computing ; Security and privacy in research and practice. Computers in Human Behavior 85. 218--226. Duha Alsmadi and Victor Prybutok. 2018. Sharing storage behavior via cloud computing; Security and privacy in research and practice. Computers in Human Behavior 85. 218--226.","key":"e_1_3_2_1_2_1"},{"key":"e_1_3_2_1_3_1","volume-title":"Annie Sokol and Jin Tong","author":"Hogan Michael","year":"2011","unstructured":"Michael Hogan , Fang Liu , Annie Sokol and Jin Tong . 2011 . NIST Cloud Computing Standards Roadmap. Cloud Computing Standards Roadmap Working Group . Special Publication 500--291. NIST. Michael Hogan, Fang Liu, Annie Sokol and Jin Tong. 2011. NIST Cloud Computing Standards Roadmap. Cloud Computing Standards Roadmap Working Group. Special Publication 500--291. NIST."},{"key":"e_1_3_2_1_4_1","volume-title":"Franz Lehner and Sebastian Schweikl","author":"Floerecke Sebastian","year":"2020","unstructured":"Sebastian Floerecke , Franz Lehner and Sebastian Schweikl . 2020 . Cloud computing ecosystem model: evaluation and role clusters. Electronic Markets, Springer . Sebastian Floerecke, Franz Lehner and Sebastian Schweikl. 2020. Cloud computing ecosystem model: evaluation and role clusters. Electronic Markets, Springer."},{"unstructured":"Public Relations. 2020. GAIA-X: A Pitch Towards Europe. Status Report on User Ecosystems and Requirements. Federal ministry for Economic Affairs and Energy. Germany.  Public Relations. 2020. GAIA-X: A Pitch Towards Europe. Status Report on User Ecosystems and Requirements. Federal ministry for Economic Affairs and Energy. Germany.","key":"e_1_3_2_1_5_1"},{"key":"e_1_3_2_1_6_1","volume-title":"Worldwide","author":"Graham Colleen","year":"2020","unstructured":"Colleen Graham , Fabrizio Biscotti , Bindi Bhullar , Terilyn Palanca , Craig Roth , Neha Gupta , Julian Poulter , Alys Woodward and Jim Hare . 2020 . Market Share: Enterprise Public Cloud Services , Worldwide , 2019. Gartner Research. Gartner ID G00717082. Colleen Graham, Fabrizio Biscotti, Bindi Bhullar, Terilyn Palanca, Craig Roth, Neha Gupta, Julian Poulter, Alys Woodward and Jim Hare. 2020. Market Share: Enterprise Public Cloud Services, Worldwide, 2019. Gartner Research. Gartner ID G00717082."},{"key":"e_1_3_2_1_7_1","volume-title":"Christoph Riedl and Helmut Krcmar","author":"B\u00f6hm Markus","year":"2010","unstructured":"Markus B\u00f6hm , Galina Koleva , Stefanie Leimeister , Christoph Riedl and Helmut Krcmar . 2010 . Towards a Generic Value Network for Cloud Computing. Economics of Grids, Clouds, Systems, and Services. Grid Economics and Business Models. LNCS 6296. Springer . 129--140. Markus B\u00f6hm, Galina Koleva, Stefanie Leimeister, Christoph Riedl and Helmut Krcmar. 2010. Towards a Generic Value Network for Cloud Computing. Economics of Grids, Clouds, Systems, and Services. Grid Economics and Business Models. LNCS 6296. Springer. 129--140."},{"key":"e_1_3_2_1_8_1","volume-title":"J\u00f6rn Altmann and Junseok Hwang","author":"Mohammed Ashraf","year":"2009","unstructured":"Ashraf Mohammed , J\u00f6rn Altmann and Junseok Hwang . 2009 . Cloud Computing Value Chains: Understanding Businesses and Value Creation in the Cloud. In : Economic Models and Algorithms for Distributed Systems. Autonomic Systems. Basel . 187--208. Ashraf Mohammed, J\u00f6rn Altmann and Junseok Hwang. 2009. Cloud Computing Value Chains: Understanding Businesses and Value Creation in the Cloud. In: Economic Models and Algorithms for Distributed Systems. Autonomic Systems. Basel. 187--208."},{"key":"e_1_3_2_1_9_1","volume-title":"Erik Wittern and Stefan Tai","author":"Bermbach David","year":"2017","unstructured":"David Bermbach , Erik Wittern and Stefan Tai . 2017 . Cloud Service Benchmarking: Measuring Quality of Cloud Services from a Client Perspective. Springer International Publishing . David Bermbach, Erik Wittern and Stefan Tai. 2017. Cloud Service Benchmarking: Measuring Quality of Cloud Services from a Client Perspective. Springer International Publishing."},{"key":"e_1_3_2_1_10_1","volume-title":"Systems Performance: Enterprise and the Cloud","author":"Gregg Brendan","year":"2021","unstructured":"Brendan Gregg . 2021 . Systems Performance: Enterprise and the Cloud . 2 nd Edition. Addison-Wesley . ISBN: 0--13--682015--8 Brendan Gregg. 2021. Systems Performance: Enterprise and the Cloud. 2nd Edition. Addison-Wesley. ISBN: 0--13--682015--8","edition":"2"},{"key":"e_1_3_2_1_11_1","volume-title":"Joel Scheuner and Philipp Leitner","author":"Laaber Christoph","year":"2019","unstructured":"Christoph Laaber , Joel Scheuner and Philipp Leitner . 2019 . Software microbenchmarking in the cloud. How bad is it really? In : Empirical Software Engineering 24 (4). Springer . 2469--2508. Christoph Laaber, Joel Scheuner and Philipp Leitner. 2019. Software microbenchmarking in the cloud. How bad is it really? In: Empirical Software Engineering 24 (4). Springer. 2469--2508."},{"key":"e_1_3_2_1_12_1","volume-title":"SPEC Cloud\u00ae IaaS","author":"Standard Performance Evaluation Corporation","year":"2018","unstructured":"Standard Performance Evaluation Corporation . 2018. SPEC Cloud\u00ae IaaS 2018 . Standard. Version 1.1. URL : https:\/\/www.spec.org\/cloud_iaas2018, accessed: 11\/2\/2021. Standard Performance Evaluation Corporation. 2018. SPEC Cloud\u00ae IaaS 2018. Standard. Version 1.1. URL: https:\/\/www.spec.org\/cloud_iaas2018, accessed: 11\/2\/2021."},{"unstructured":"Cisco Systems Inc. 2019. Cloud Performance Benchmark: 2019--2020 Edition. Research Report. Thousand Eyes.  Cisco Systems Inc. 2019. Cloud Performance Benchmark: 2019--2020 Edition. Research Report. Thousand Eyes.","key":"e_1_3_2_1_13_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_14_1","DOI":"10.1016\/j.future.2017.09.020"},{"key":"e_1_3_2_1_15_1","volume-title":"Sukhpal Gill and Adel Toosi","author":"Aslanpour Mohammad","year":"2020","unstructured":"Mohammad Aslanpour , Sukhpal Gill and Adel Toosi . 2020 . Performance evaluation metrics for cloud, fog and edge computing: A review, taxonomy, benchmarks and standards for future research. Internet of Things 12. Elsevier . Mohammad Aslanpour, Sukhpal Gill and Adel Toosi. 2020. Performance evaluation metrics for cloud, fog and edge computing: A review, taxonomy, benchmarks and standards for future research. Internet of Things 12. Elsevier."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_16_1","DOI":"10.1016\/j.jnca.2018.07.016"},{"key":"e_1_3_2_1_17_1","first-page":"1787","article-title":"SOCCER","volume":"19","author":"Singh Sukhpal","year":"2016","unstructured":"Sukhpal Singh , Inderveer Chana , Maninder Singh and Rajkumar Buyya . 2016 . SOCCER : Self-Optimization of Energy-efficient Cloud Resources. Cluster Computing 19. 1787 -- 1800 . Sukhpal Singh, Inderveer Chana, Maninder Singh and Rajkumar Buyya. 2016. SOCCER: Self-Optimization of Energy-efficient Cloud Resources. Cluster Computing 19. 1787--1800.","journal-title":"Self-Optimization of Energy-efficient Cloud Resources. Cluster Computing"},{"key":"e_1_3_2_1_18_1","volume-title":"Schahram Dustdar and Rajiv Ranjan","author":"Jha Devki","year":"2020","unstructured":"Devki Jha , Khaled Alwasel , Areeb Alshoshan , Xianhua Huang , Ranesh Naha , Sudheer Battula , Saurabh Garg , Deepak Puthal , Philip James , Albert Zomaya , Schahram Dustdar and Rajiv Ranjan . 2020 . IoTSim-Edge: A simulation framework for modeling the behavior of Internet of Things and edge computing environments. Software. Wiley . Devki Jha, Khaled Alwasel, Areeb Alshoshan, Xianhua Huang, Ranesh Naha, Sudheer Battula, Saurabh Garg, Deepak Puthal, Philip James, Albert Zomaya, Schahram Dustdar and Rajiv Ranjan. 2020. IoTSim-Edge: A simulation framework for modeling the behavior of Internet of Things and edge computing environments. Software. Wiley."},{"key":"e_1_3_2_1_19_1","volume-title":"Nathan VanBenschoten and Andy Woods","author":"Bardea Paul","year":"2019","unstructured":"Paul Bardea , Charlotte Dillon , Nathan VanBenschoten and Andy Woods . 2019 . 2020 Cloud Report. Report. Cockroach Labs . Paul Bardea, Charlotte Dillon, Nathan VanBenschoten and Andy Woods. 2019. 2020 Cloud Report. Report. Cockroach Labs."},{"key":"e_1_3_2_1_20_1","volume-title":"Manasa Chalasani and Mike Truty","author":"Phanekham Derek","year":"2020","unstructured":"Derek Phanekham , Matthew Zaber , Suku Nair , Steve Deitz , Rick Jones , Manasa Chalasani and Mike Truty . 2020 . Measuring Cloud Network Performance with PerfKit Benchmarker. Technical White Paper. Google Cloud . Derek Phanekham, Matthew Zaber, Suku Nair, Steve Deitz, Rick Jones, Manasa Chalasani and Mike Truty. 2020. Measuring Cloud Network Performance with PerfKit Benchmarker. Technical White Paper. Google Cloud."},{"key":"e_1_3_2_1_21_1","volume-title":"proceedings: Service-Oriented System Engineering, International Conference on. IEEE.","author":"Li Wubin","year":"2019","unstructured":"Wubin Li , Yves Lemieux , Jing Gao , Zhuofeng Zhao and Yanbo Han . 2019 . Service Mesh: Challenges, State of the Art, and Future Research Opportunities . In proceedings: Service-Oriented System Engineering, International Conference on. IEEE. Wubin Li, Yves Lemieux, Jing Gao, Zhuofeng Zhao and Yanbo Han. 2019. Service Mesh: Challenges, State of the Art, and Future Research Opportunities. In proceedings: Service-Oriented System Engineering, International Conference on. IEEE."},{"key":"e_1_3_2_1_22_1","volume-title":"The Oxford Dictionary of Statistical Terms","author":"Dodge Yadolah","year":"2061","unstructured":"Yadolah Dodge and Daniel Commenges . 2003. The Oxford Dictionary of Statistical Terms . Oxford University Press . ISBN 0--19--9 2061 3--9 (entry for normalization of scores) Yadolah Dodge and Daniel Commenges. 2003. The Oxford Dictionary of Statistical Terms. Oxford University Press. ISBN 0--19--920613--9 (entry for normalization of scores)"}],"event":{"sponsor":["SIGMETRICS ACM Special Interest Group on Measurement and Evaluation","SIGSOFT ACM Special Interest Group on Software Engineering"],"acronym":"ICPE '21","name":"ICPE '21: ACM\/SPEC International Conference on Performance Engineering","location":"Virtual Event France"},"container-title":["Companion of the ACM\/SPEC International Conference on Performance Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447545.3451180","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447545.3451180","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:25:10Z","timestamp":1750195510000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447545.3451180"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,19]]},"references-count":22,"alternative-id":["10.1145\/3447545.3451180","10.1145\/3447545"],"URL":"https:\/\/doi.org\/10.1145\/3447545.3451180","relation":{},"subject":[],"published":{"date-parts":[[2021,4,19]]},"assertion":[{"value":"2021-04-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}