{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T03:47:03Z","timestamp":1782877623419,"version":"3.54.5"},"reference-count":125,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,3,4]],"date-time":"2020-03-04T00:00:00Z","timestamp":1583280000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100009925","name":"U.S. Air Force","doi-asserted-by":"publisher","award":["FA8750-12-2-0107 and FA8750-15-C-0010"],"award-info":[{"award-number":["FA8750-12-2-0107 and FA8750-15-C-0010"]}],"id":[{"id":"10.13039\/100009925","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002790","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["2014-04870 and 2019-05090"],"award-info":[{"award-number":["2014-04870 and 2019-05090"]}],"id":[{"id":"10.13039\/501100002790","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CCF-1453474 and CCF-1763423"],"award-info":[{"award-number":["CCF-1453474 and CCF-1763423"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2020,4,30]]},"abstract":"<jats:p>\n            Distributed systems pose unique challenges for software developers. Understanding the system\u2019s communication topology and reasoning about concurrent activities of system hosts can be difficult. The standard approach, analyzing system logs, can be a tedious and complex process that involves reconstructing a system log from multiple hosts\u2019 logs, reconciling timestamps among hosts with non-synchronized clocks, and understanding what took place during the execution encoded by the log. This article presents a novel approach for tackling three tasks frequently performed during analysis of distributed system executions: (1)\u00a0understanding the relative ordering of events, (2)\u00a0searching for specific patterns of interaction between hosts, and (3)\u00a0identifying structural similarities and differences between pairs of executions. Our approach consists of\n            <jats:italic>XVector<\/jats:italic>\n            , which instruments distributed systems to capture partial ordering information that encodes the happens-before relation between events, and\n            <jats:italic>ShiViz<\/jats:italic>\n            , which processes the resulting logs and presents distributed system executions as interactive time-space diagrams. Two user studies with a total of 109 students and a case study with 2 developers showed that our method was effective, helping participants answer statistically significantly more system-comprehension questions correctly, with a very large effect size.\n          <\/jats:p>","DOI":"10.1145\/3375633","type":"journal-article","created":{"date-parts":[[2020,3,4]],"date-time":"2020-03-04T12:33:55Z","timestamp":1583325235000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":37,"title":["Visualizing Distributed System Executions"],"prefix":"10.1145","volume":"29","author":[{"given":"Ivan","family":"Beschastnikh","sequence":"first","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Perry","family":"Liu","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albert","family":"Xing","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patty","family":"Wang","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuriy","family":"Brun","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael D.","family":"Ernst","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,3,4]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the International Conference on Software Engineering (ICSE Poster track) (4--6). 598--599","author":"Abrahamson Jenny","unstructured":"Jenny Abrahamson , Ivan Beschastnikh , Yuriy Brun , and Michael D. Ernst . 2014. Shedding light on distributed system executions . In Proceedings of the International Conference on Software Engineering (ICSE Poster track) (4--6). 598--599 . DOI:https:\/\/doi.org\/10.1145\/2591062.2591134 10.1145\/2591062.2591134 Jenny Abrahamson, Ivan Beschastnikh, Yuriy Brun, and Michael D. Ernst. 2014. Shedding light on distributed system executions. In Proceedings of the International Conference on Software Engineering (ICSE Poster track) (4--6). 598--599. DOI:https:\/\/doi.org\/10.1145\/2591062.2591134"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1287624.1287630"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1165389.945454"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-92221-6_18"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the Symposium on Operating Systems Design 8 Implementation (OSDI\u201904)","author":"Barham Paul","year":"2004","unstructured":"Paul Barham , Austin Donnelly , Rebecca Isaacs , and Richard Mortier . 2004 . Using Magpie for request extraction and workload modelling . In Proceedings of the Symposium on Operating Systems Design 8 Implementation (OSDI\u201904) . 259--272. Paul Barham, Austin Donnelly, Rebecca Isaacs, and Richard Mortier. 2004. Using Magpie for request extraction and workload modelling. In Proceedings of the Symposium on Operating Systems Design 8 Implementation (OSDI\u201904). 259--272."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2008.12.012"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/VISSOFT.2013.6650524"},{"key":"e_1_2_1_8_1","series-title":"Chapter 7","volume-title":"Concurrency Control and Recovery in Database Systems","author":"Bernstein Philip A.","unstructured":"Philip A. Bernstein , Vassos Hadzilacos , and Nathan Goodman . 1986. Concurrency Control and Recovery in Database Systems ( Chapter 7 ) . Addison-Wesley Longman Publishing Co., Inc. , Boston, MA . Philip A. Bernstein, Vassos Hadzilacos, and Nathan Goodman. 1986. Concurrency Control and Recovery in Database Systems (Chapter 7). Addison-Wesley Longman Publishing Co., Inc., Boston, MA."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2369047"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568246"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2094091.2094101"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the ACM SIGSOFT Conference on the Foundations of Software Engineering (FSE\u201911)","author":"Beschastnikh Ivan","unstructured":"Ivan Beschastnikh , Yuriy Brun , Sigurd Schneider , Michael Sloan , and Michael D. Ernst . 2011. Leveraging existing instrumentation to automatically infer invariant-constrained models . In Proceedings of the ACM SIGSOFT Conference on the Foundations of Software Engineering (FSE\u201911) . 267--277. Ivan Beschastnikh, Yuriy Brun, Sigurd Schneider, Michael Sloan, and Michael D. Ernst. 2011. Leveraging existing instrumentation to automatically infer invariant-constrained models. In Proceedings of the ACM SIGSOFT Conference on the Foundations of Software Engineering (FSE\u201911). 267--277."},{"key":"e_1_2_1_13_1","volume-title":"Ernst","author":"Beschastnikh Ivan","year":"2017","unstructured":"Ivan Beschastnikh , Perry Liu , Albert Xing , Patty Wang , Yuriy Brun , and Michael D . Ernst . 2017 . ShiViz evaluation details. Retrieved from http:\/\/bestchai.bitbucket.io\/shiviz-evaluation\/. Ivan Beschastnikh, Perry Liu, Albert Xing, Patty Wang, Yuriy Brun, and Michael D. Ernst. 2017. ShiViz evaluation details. Retrieved from http:\/\/bestchai.bitbucket.io\/shiviz-evaluation\/."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909480"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.1972.5009015"},{"key":"e_1_2_1_16_1","unstructured":"Bully algorithm 2015. Retrieved from http:\/\/en.wikipedia.org\/wiki\/Bully_algorithm.  Bully algorithm 2015. Retrieved from http:\/\/en.wikipedia.org\/wiki\/Bully_algorithm."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2970276.2970352"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-739X(02)00181-4"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8191(00)00010-7"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-016-9429-5"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the Conference on Applications of Databases","volume":"819","author":"Consens Mariano C.","unstructured":"Mariano C. Consens , Masum Z. Hasan , and Alberto O. Mendelzon . 1993. Debugging distributed programs by visualizing and querying event traces . In Proceedings of the Conference on Applications of Databases , Vol. 819 . 181--183. Mariano C. Consens, Masum Z. Hasan, and Alberto O. Mendelzon. 1993. Debugging distributed programs by visualizing and querying event traces. In Proceedings of the Conference on Applications of Databases, Vol. 819. 181--183."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/287000.287001"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the Symposium on Operating Systems Principles (SOSP\u201915)","author":"Curtsinger Charlie","unstructured":"Charlie Curtsinger and Emery D. Berger . 2015. Coz: Finding code that counts with causal profiling . In Proceedings of the Symposium on Operating Systems Principles (SOSP\u201915) . 184--197. DOI:https:\/\/doi.org\/10.1145\/2815400.2815409 10.1145\/2815400.2815409 Charlie Curtsinger and Emery D. Berger. 2015. Coz: Finding code that counts with causal profiling. In Proceedings of the Symposium on Operating Systems Principles (SOSP\u201915). 184--197. DOI:https:\/\/doi.org\/10.1145\/2815400.2815409"},{"key":"e_1_2_1_24_1","first-page":"2","article-title":"Visualizing large-scale streaming applications","volume":"8","author":"Pauw Wim De","year":"2009","unstructured":"Wim De Pauw and Henrique Andrade . 2009 . Visualizing large-scale streaming applications . Inf. Vis. 8 , 2 (Apr. 2009), 87--106. DOI:https:\/\/doi.org\/10.1057\/ivs.2009.5 10.1057\/ivs.2009.5 Wim De Pauw and Henrique Andrade. 2009. Visualizing large-scale streaming applications. Inf. Vis. 8, 2 (Apr. 2009), 87--106. DOI:https:\/\/doi.org\/10.1057\/ivs.2009.5","journal-title":"Inf. Vis."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409720.1409741"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1740390.1740412"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1879211.1879233"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the International Symposium on Software Visualization (SoftVis\u201906)","author":"Pauw Wim De","unstructured":"Wim De Pauw , Sophia Krasikov , and John F. Morar . 2006. Execution patterns for visualizing web services . In Proceedings of the International Symposium on Software Visualization (SoftVis\u201906) . 37--45. Wim De Pauw, Sophia Krasikov, and John F. Morar. 2006. Execution patterns for visualizing web services. In Proceedings of the International Symposium on Software Visualization (SoftVis\u201906). 37--45."},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the International Conference on Runtime Verification (RV\u201910)","author":"Pauw Wim De","unstructured":"Wim De Pauw , Mihai Letia , Bugra Gedik , Henrique Andrade , Andy Frenkiel , Michael Pfeifer , and Daby M. Sow . 2010. Visual debugging for stream processing applications . In Proceedings of the International Conference on Runtime Verification (RV\u201910) . 18--35. Wim De Pauw, Mihai Letia, Bugra Gedik, Henrique Andrade, Andy Frenkiel, Michael Pfeifer, and Daby M. Sow. 2010. Visual debugging for stream processing applications. In Proceedings of the International Conference on Runtime Verification (RV\u201910). 18--35."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the Workshop Ion on Object-Oriented Technology. 541--542","author":"Pauw Wim De","unstructured":"Wim De Pauw and John M. Vlissides . 1998. Visualizing object-oriented programs with Jinsight . In Proceedings of the Workshop Ion on Object-Oriented Technology. 541--542 . Wim De Pauw and John M. Vlissides. 1998. Visualizing object-oriented programs with Jinsight. In Proceedings of the Workshop Ion on Object-Oriented Technology. 541--542."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the IEEE Working Conference on Software Visualization (VISSOFT\u201913)","author":"Pauw Wim De","year":"2013","unstructured":"Wim De Pauw , Joel L. Wolf , and Andrey Balmin . 2013 . Visualizing jobs with shared resources in distributed environments . In Proceedings of the IEEE Working Conference on Software Visualization (VISSOFT\u201913) . DOI:https:\/\/doi.org\/10.1109\/VISSOFT.2013.6650535 10.1109\/VISSOFT.2013.6650535 Wim De Pauw, Joel L. Wolf, and Andrey Balmin. 2013. Visualizing jobs with shared resources in distributed environments. In Proceedings of the IEEE Working Conference on Software Visualization (VISSOFT\u201913). DOI:https:\/\/doi.org\/10.1109\/VISSOFT.2013.6650535"},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.entcs.2004.02.050","article-title":"OverView: A framework for generic online visualization of distributed systems","volume":"107","author":"Desell Travis","year":"2004","unstructured":"Travis Desell , Harihar Narasimha Iyer , Carlos Varela , and Abe Stephens . 2004 . OverView: A framework for generic online visualization of distributed systems . Electron. Notes Theor. Comput. Sci. (Eclipse Technol. Exch.: eTX Eclipse Phenom.) 107 (2004), 87 -- 101 . DOI:https:\/\/doi.org\/10.1016\/j.entcs.2004.02.050 2004. 10.1016\/j.entcs.2004.02.050 Travis Desell, Harihar Narasimha Iyer, Carlos Varela, and Abe Stephens. 2004. OverView: A framework for generic online visualization of distributed systems. Electron. Notes Theor. Comput. Sci. (Eclipse Technol. Exch.: eTX Eclipse Phenom.) 107 (2004), 87--101. DOI:https:\/\/doi.org\/10.1016\/j.entcs.2004.02.050 2004.","journal-title":"Electron. Notes Theor. Comput. Sci. (Eclipse Technol. Exch.: eTX Eclipse Phenom.)"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/SPDP.1994.346156"},{"key":"e_1_2_1_34_1","unstructured":"elasticsearch 2016. Retrieved from https:\/\/www.elastic.co\/products\/elasticsearch.  elasticsearch 2016. Retrieved from https:\/\/www.elastic.co\/products\/elasticsearch."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2013.6693102"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the Australasian Computer Science Conference (ACSC\u201988)","author":"Fidge Colin J.","year":"1988","unstructured":"Colin J. Fidge . 1988 . Timestamps in message-passing systems that preserve the partial ordering . In Proceedings of the Australasian Computer Science Conference (ACSC\u201988) . 55--66. Colin J. Fidge. 1988. Timestamps in message-passing systems that preserve the partial ordering. In Proceedings of the Australasian Computer Science Conference (ACSC\u201988). 55--66."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1040305.1040315"},{"key":"e_1_2_1_38_1","unstructured":"fluentd 2016. Retrieved from http:\/\/www.fluentd.org\/.  fluentd 2016. Retrieved from http:\/\/www.fluentd.org\/."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the USENIX Conference on Networked Systems Design 8 Implementation (NSDI\u201907)","author":"Fonseca Rodrigo","year":"2007","unstructured":"Rodrigo Fonseca , George Porter , Randy H. Katz , Scott Shenker , and Ion Stoica . 2007 . X-Trace: A pervasive network tracing framework . In Proceedings of the USENIX Conference on Networked Systems Design 8 Implementation (NSDI\u201907) . 271--284. Rodrigo Fonseca, George Porter, Randy H. Katz, Scott Shenker, and Ion Stoica. 2007. X-Trace: A pervasive network tracing framework. In Proceedings of the USENIX Conference on Networked Systems Design 8 Implementation (NSDI\u201907). 271--284."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591062.2591175"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1453101.1453150"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3297858.3304013"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the International Conference on Large Installation System Administration: Strategies, Tools, and Techniques (LISA\u201912)","author":"Garduno Elmer","year":"2012","unstructured":"Elmer Garduno , Soila P. Kavulya , Jiaqi Tan , Rajeev Gandhi , and Priya Narasimhan . 2012 . Theia: Visual signatures for problem diagnosis in large hadoop clusters . In Proceedings of the International Conference on Large Installation System Administration: Strategies, Tools, and Techniques (LISA\u201912) . 33--42. Elmer Garduno, Soila P. Kavulya, Jiaqi Tan, Rajeev Gandhi, and Priya Narasimhan. 2012. Theia: Visual signatures for problem diagnosis in large hadoop clusters. In Proceedings of the International Conference on Large Installation System Administration: Strategies, Tools, and Techniques (LISA\u201912). 33--42."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the USENIX Conference on Networked Systems Design 8 Implementation (NSDI\u201907)","author":"Geels Dennis","year":"2007","unstructured":"Dennis Geels , Gautam Altekar , Petros Maniatis , Timothy Roscoe , and Ion Stoica . 2007 . Friday: Global comprehension for distributed replay . In Proceedings of the USENIX Conference on Networked Systems Design 8 Implementation (NSDI\u201907) . 21--21. Dennis Geels, Gautam Altekar, Petros Maniatis, Timothy Roscoe, and Ion Stoica. 2007. Friday: Global comprehension for distributed replay. In Proceedings of the USENIX Conference on Networked Systems Design 8 Implementation (NSDI\u201907). 21--21."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568234"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180199"},{"key":"e_1_2_1_47_1","unstructured":"graylog. 2016. Retrieved from https:\/\/www.graylog.org\/.  graylog. 2016. Retrieved from https:\/\/www.graylog.org\/."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909476"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the USENIX Annual Technical Conference (ATC\u201917)","author":"Gregg Brendan","year":"2017","unstructured":"Brendan Gregg . 2017 . Visualizing performance with flame graphs . In Proceedings of the USENIX Annual Technical Conference (ATC\u201917) . 81--88. Brendan Gregg. 2017. Visualizing performance with flame graphs. In Proceedings of the USENIX Annual Technical Conference (ATC\u201917). 81--88."},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the ACM Symposium on Cloud Computing (SoCC\u201914)","author":"Gunawi Haryadi S.","unstructured":"Haryadi S. Gunawi , Mingzhe Hao , Tanakorn Leesatapornwongsa , Tiratat Patana-Anake , Thanh Do , Jeffry Adityatama , Kurnia J. Eliazar , Agung Laksono , Jeffrey F. Lukman , Vincentius Martin , and Anang D. Satria . 2014. What bugs live in the cloud? A study of 3000+ issues in cloud systems . In Proceedings of the ACM Symposium on Cloud Computing (SoCC\u201914) . Haryadi S. Gunawi, Mingzhe Hao, Tanakorn Leesatapornwongsa, Tiratat Patana-Anake, Thanh Do, Jeffry Adityatama, Kurnia J. Eliazar, Agung Laksono, Jeffrey F. Lukman, Vincentius Martin, and Anang D. Satria. 2014. What bugs live in the cloud? A study of 3000+ issues in cloud systems. In Proceedings of the ACM Symposium on Cloud Computing (SoCC\u201914)."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the ACM Symposium on Cloud Computing (SoCC\u201916)","author":"Gunawi Haryadi S.","unstructured":"Haryadi S. Gunawi , Mingzhe Hao , Riza O. Suminto , Agung Laksono , Anang D. Satria , Jeffry Adityatama , and Kurnia J. Eliazar . 2016. Why does the cloud stop computing?: Lessons from hundreds of service outages . In Proceedings of the ACM Symposium on Cloud Computing (SoCC\u201916) . Haryadi S. Gunawi, Mingzhe Hao, Riza O. Suminto, Agung Laksono, Anang D. Satria, Jeffry Adityatama, and Kurnia J. Eliazar. 2016. Why does the cloud stop computing?: Lessons from hundreds of service outages. In Proceedings of the ACM Symposium on Cloud Computing (SoCC\u201916)."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-6423(87)90035-9"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2835238.2835241"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807634"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346456"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2015.2417531"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the Eurographics Conference on Visualization (EuroVis\u201914)","author":"Isaacs Katherine E.","year":"2014","unstructured":"Katherine E. Isaacs , Alfredo Gim\u00e9nez , Ilir Jusufi , Todd Gamblin , Abhinav Bhatele , Martin Schulz , Bernd Hamann , and Peer-Timo Bremer . 2014 . State-of-the-art of performance visualization . In Proceedings of the Eurographics Conference on Visualization (EuroVis\u201914) . Katherine E. Isaacs, Alfredo Gim\u00e9nez, Ilir Jusufi, Todd Gamblin, Abhinav Bhatele, Martin Schulz, Bernd Hamann, and Peer-Timo Bremer. 2014. State-of-the-art of performance visualization. In Proceedings of the Eurographics Conference on Visualization (EuroVis\u201914)."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.471177"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/SAINT.2011.19"},{"key":"e_1_2_1_60_1","unstructured":"kibana 2016. Retrieved from https:\/\/www.elastic.co\/products\/kibana.  kibana 2016. Retrieved from https:\/\/www.elastic.co\/products\/kibana."},{"key":"e_1_2_1_61_1","doi-asserted-by":"crossref","unstructured":"J. Klensin. 2008. Simple Mail Transfer Protocol. RFC 5321 (Draft Standard). Retrieved from http:\/\/www.ietf.org\/rfc\/rfc5321.txt.  J. Klensin. 2008. Simple Mail Transfer Protocol. RFC 5321 (Draft Standard). Retrieved from http:\/\/www.ietf.org\/rfc\/rfc5321.txt.","DOI":"10.17487\/rfc5321"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635890"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/1810295.1810324"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2012.6227128"},{"key":"e_1_2_1_65_1","first-page":"452","article-title":"Poet: Target-system independent visualizations of complex distributed-application executions","volume":"1","author":"Kunz Thomas","year":"1997","unstructured":"Thomas Kunz , David J. Taylor , and James P. Black . 1997 . Poet: Target-system independent visualizations of complex distributed-application executions . Comput. J. 1 (1997), 452 -- 461 . Thomas Kunz, David J. Taylor, and James P. Black. 1997. Poet: Target-system independent visualizations of complex distributed-application executions. Comput. J. 1 (1997), 452--461.","journal-title":"Comput. J."},{"key":"e_1_2_1_66_1","volume-title":"Ross","author":"Kurose James F.","year":"2012","unstructured":"James F. Kurose and Keith W . Ross . 2012 . Computer Networking : A Top-down Approach (6th ed.). Pearson . James F. Kurose and Keith W. Ross. 2012. Computer Networking: A Top-down Approach (6th ed.). Pearson."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/MobServ.2015.15"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/359545.359563"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.286"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2008.4639052"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.83"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSN.2011.5958209"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591062.2591074"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/1858996.1859081"},{"key":"e_1_2_1_75_1","unstructured":"loggly 2016. Retrieved from https:\/\/www.loggly.com\/.  loggly 2016. Retrieved from https:\/\/www.loggly.com\/."},{"key":"e_1_2_1_76_1","unstructured":"logstash 2016. Retrieved from https:\/\/www.elastic.co\/products\/logstash.  logstash 2016. Retrieved from https:\/\/www.elastic.co\/products\/logstash."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/1368088.1368157"},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the Asia-Pacific Symposium on Information Visualisation (APVis\u201903)","volume":"24","author":"Marshall Stuart","year":"2003","unstructured":"Stuart Marshall , Kirk Jackson , Craig Anslow , and Robert Biddle . 2003 . Aspects to visualising reusable components . In Proceedings of the Asia-Pacific Symposium on Information Visualisation (APVis\u201903) , Vol. 24 . 81--88. Stuart Marshall, Kirk Jackson, Craig Anslow, and Robert Biddle. 2003. Aspects to visualising reusable components. In Proceedings of the Asia-Pacific Symposium on Information Visualisation (APVis\u201903), Vol. 24. 81--88."},{"key":"e_1_2_1_79_1","volume-title":"Proceedings of the Asia-Pacific Symposium on Information Visualisation (APVis\u201901)","volume":"9","author":"Marshall Stuart","year":"2001","unstructured":"Stuart Marshall , Kirk Jackson , Robert Biddle , Michael McGavin , Ewan Tempero , and Matthew Duignan . 2001 . Visualising reusable software over the web . In Proceedings of the Asia-Pacific Symposium on Information Visualisation (APVis\u201901) , Vol. 9 . 103--111. Stuart Marshall, Kirk Jackson, Robert Biddle, Michael McGavin, Ewan Tempero, and Matthew Duignan. 2001. Visualising reusable software over the web. In Proceedings of the Asia-Pacific Symposium on Information Visualisation (APVis\u201901), Vol. 9. 103--111."},{"key":"e_1_2_1_80_1","unstructured":"Friedemann Mattern. 1989. Virtual time and global states of distributed systems. In Parallel and Distributed Algorithms. North-Holland 215--226.  Friedemann Mattern. 1989. Virtual time and global states of distributed systems. In Parallel and Distributed Algorithms. North-Holland 215--226."},{"key":"e_1_2_1_81_1","unstructured":"mongodb 2016. Retrieved from https:\/\/www.mongodb.org\/.  mongodb 2016. Retrieved from https:\/\/www.mongodb.org\/."},{"key":"e_1_2_1_82_1","volume-title":"Proceedings of the IEEE\/IFIP International Conference on Dependable Systems and Networks (DSN\u201918)","author":"Neves F.","year":"2018","unstructured":"F. Neves , N. Machado , and J. Pereira . 2018. Falcon: A practical log-based analysis tool for distributed systems . In Proceedings of the IEEE\/IFIP International Conference on Dependable Systems and Networks (DSN\u201918) . 534--541. DOI:https:\/\/doi.org\/10.1109\/DSN. 2018 .00061 10.1109\/DSN.2018.00061 F. Neves, N. Machado, and J. Pereira. 2018. Falcon: A practical log-based analysis tool for distributed systems. In Proceedings of the IEEE\/IFIP International Conference on Dependable Systems and Networks (DSN\u201918). 534--541. DOI:https:\/\/doi.org\/10.1109\/DSN.2018.00061"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-C.2017.9"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642937.2642988"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/2076450.2076466"},{"key":"e_1_2_1_86_1","volume-title":"Proceedings of the USENIX Annual Technical Conference (ATC\u201914)","author":"Ongaro Diego","year":"2014","unstructured":"Diego Ongaro and John Ousterhout . 2014 . In search of an understandable consensus algorithm . In Proceedings of the USENIX Annual Technical Conference (ATC\u201914) . 305--320. Diego Ongaro and John Ousterhout. 2014. In search of an understandable consensus algorithm. In Proceedings of the USENIX Annual Technical Conference (ATC\u201914). 305--320."},{"key":"e_1_2_1_87_1","unstructured":"papertrailapp 2016. Retrieved from https:\/\/papertrailapp.com\/.  papertrailapp 2016. Retrieved from https:\/\/papertrailapp.com\/."},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.145"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635925"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/3307681.3325404"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1985.232211"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.1987.231801"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.56450"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFVIS.1997.636785"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/322993.322994"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/379605.379629"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2003.1201303"},{"key":"e_1_2_1_98_1","volume-title":"Proceedings of the ACM\/IEEE International Conference on Software Engineering (ICSE\u201901)","author":"Steven","unstructured":"Steven P. Reiss and Manos Renieris. 2001. Encoding program executions . In Proceedings of the ACM\/IEEE International Conference on Software Engineering (ICSE\u201901) . 221--230. Steven P. Reiss and Manos Renieris. 2001. Encoding program executions. In Proceedings of the ACM\/IEEE International Conference on Software Engineering (ICSE\u201901). 221--230."},{"key":"e_1_2_1_99_1","volume-title":"Proceedings of the ACM\/IEEE International Conference on Software Engineering (ICSE Demo Track). 662--663","author":"Steven","unstructured":"Steven P. Reiss and Manos Renieris. 2005. Demonstration of JIVE and JOVE: Java as it happens . In Proceedings of the ACM\/IEEE International Conference on Software Engineering (ICSE Demo Track). 662--663 . DOI:https:\/\/doi.org\/10.1145\/1062455.1062597 10.1145\/1062455.1062597 Steven P. Reiss and Manos Renieris. 2005. Demonstration of JIVE and JOVE: Java as it happens. In Proceedings of the ACM\/IEEE International Conference on Software Engineering (ICSE Demo Track). 662--663. DOI:https:\/\/doi.org\/10.1145\/1062455.1062597"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1145\/1135777.1135830"},{"key":"e_1_2_1_101_1","volume-title":"Proceedings of the IFIP\/ACM International Conference on Distributed Systems Platforms and Open Distributed Processing (Middleware\u201901)","author":"Antony I.","unstructured":"Antony I. T. Rowstron and Peter Druschel. 2001. Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems . In Proceedings of the IFIP\/ACM International Conference on Distributed Systems Platforms and Open Distributed Processing (Middleware\u201901) . 329--350. Antony I. T. Rowstron and Peter Druschel. 2001. Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems. In Proceedings of the IFIP\/ACM International Conference on Distributed Systems Platforms and Open Distributed Processing (Middleware\u201901). 329--350."},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.82"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.233"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.22237\/jmasm\/1257035100"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1109\/VISSOFT.2016.17"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491411.2491426"},{"key":"e_1_2_1_107_1","volume-title":"Proceedings of the USENIX Conference on Networked Systems Design 8 Implementation (NSDI\u201916)","author":"Scott Colin","year":"2016","unstructured":"Colin Scott , Vjekoslav Brajkovic , George Necula , Arvind Krishnamurthy , and Scott Shenker . 2016 . Minimizing faulty executions of distributed systems . In Proceedings of the USENIX Conference on Networked Systems Design 8 Implementation (NSDI\u201916) . 291--309. Colin Scott, Vjekoslav Brajkovic, George Necula, Arvind Krishnamurthy, and Scott Shenker. 2016. Minimizing faulty executions of distributed systems. In Proceedings of the USENIX Conference on Networked Systems Design 8 Implementation (NSDI\u201916). 291--309."},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1145\/2619239.2626304"},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2014.24"},{"key":"e_1_2_1_110_1","volume-title":"Mike Burrows, Pat Stephenson, Manoj Plakal, Donald Beaver, Saul Jaspan, and Chandan Shanbhag.","author":"Sigelman Benjamin H.","year":"2010","unstructured":"Benjamin H. Sigelman , Luiz Andr\u00e9 Barroso , Mike Burrows, Pat Stephenson, Manoj Plakal, Donald Beaver, Saul Jaspan, and Chandan Shanbhag. 2010 . Dapper, a Large-Scale Distributed Systems Tracing Infrastructure. Technical Report. Google, Inc. Retrieved from http:\/\/research.google.com\/archive\/papers\/dapper-2010-1.pdf. Benjamin H. Sigelman, Luiz Andr\u00e9 Barroso, Mike Burrows, Pat Stephenson, Manoj Plakal, Donald Beaver, Saul Jaspan, and Chandan Shanbhag. 2010. Dapper, a Large-Scale Distributed Systems Tracing Infrastructure. Technical Report. Google, Inc. Retrieved from http:\/\/research.google.com\/archive\/papers\/dapper-2010-1.pdf."},{"key":"e_1_2_1_111_1","unstructured":"splunk 2016. Retrieved from http:\/\/www.splunk.com\/.  splunk 2016. Retrieved from http:\/\/www.splunk.com\/."},{"key":"e_1_2_1_112_1","volume-title":"Proceedings of the USENIX Conference on File and Storage Technologies (FAST\u201912)","author":"Sumbaly Roshan","year":"2012","unstructured":"Roshan Sumbaly , Jay Kreps , Lei Gao , Alex Feinberg , Chinmay Soman , and Sam Shah . 2012 . Serving large-scale batch computed data with Project Voldemort . In Proceedings of the USENIX Conference on File and Storage Technologies (FAST\u201912) . 18--18. Roshan Sumbaly, Jay Kreps, Lei Gao, Alex Feinberg, Chinmay Soman, and Sam Shah. 2012. Serving large-scale batch computed data with Project Voldemort. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST\u201912). 18--18."},{"key":"e_1_2_1_113_1","unstructured":"sumologic 2016. Retrieved from http:\/\/www.sumologic.com\/.  sumologic 2016. Retrieved from http:\/\/www.sumologic.com\/."},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTER.2019.8891027"},{"key":"e_1_2_1_115_1","volume-title":"Proceedings of the USENIX Annual Technical Conference (USENIX\u201909)","author":"Tak Byung Chul","unstructured":"Byung Chul Tak , Chunqiang Tang , Chun Zhang , Sriram Govindan , Bhuvan Urgaonkar , and Rong N. Chang . 2009. vPath: Precise discovery of request processing paths from black-box observations of thread and network activities . In Proceedings of the USENIX Annual Technical Conference (USENIX\u201909) . 19:1--19:14. Byung Chul Tak, Chunqiang Tang, Chun Zhang, Sriram Govindan, Bhuvan Urgaonkar, and Rong N. Chang. 2009. vPath: Precise discovery of request processing paths from black-box observations of thread and network activities. In Proceedings of the USENIX Annual Technical Conference (USENIX\u201909). 19:1--19:14."},{"key":"e_1_2_1_116_1","volume-title":"Proceedings of the 1st USENIX Conference on Analysis of System Logs (WASL\u201908)","author":"Tan Jiaqi","year":"2008","unstructured":"Jiaqi Tan , Xinghao Pan , Soila Kavulya , Rajeev Gandhi , and Priya Narasimhan . 2008 . SALSA: analyzing logs as state machines . In Proceedings of the 1st USENIX Conference on Analysis of System Logs (WASL\u201908) . Jiaqi Tan, Xinghao Pan, Soila Kavulya, Rajeev Gandhi, and Priya Narasimhan. 2008. SALSA: analyzing logs as state machines. In Proceedings of the 1st USENIX Conference on Analysis of System Logs (WASL\u201908)."},{"key":"e_1_2_1_117_1","volume-title":"Proceedings of the USENIX Workshop on Hot Topics in Cloud Computing (HotCloud\u201909)","author":"Tan Jiaqi","year":"2009","unstructured":"Jiaqi Tan , Xinghao Pan , Soila Kavulya , Rajeev Gandhi , and Priya Narasimhan . 2009 . Mochi: Visual log-analysis based tools for debugging hadoop . In Proceedings of the USENIX Workshop on Hot Topics in Cloud Computing (HotCloud\u201909) . Jiaqi Tan, Xinghao Pan, Soila Kavulya, Rajeev Gandhi, and Priya Narasimhan. 2009. Mochi: Visual log-analysis based tools for debugging hadoop. In Proceedings of the USENIX Workshop on Hot Topics in Cloud Computing (HotCloud\u201909)."},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2013.6613833"},{"key":"e_1_2_1_119_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2008.35"},{"key":"e_1_2_1_120_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025999"},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1145\/2791577"},{"key":"e_1_2_1_122_1","volume-title":"Proceedings of the Workshop on Managing Systems via Log Analysis and Machine Learning Techniques (SLAML\u201910)","author":"Xu Wei","year":"2010","unstructured":"Wei Xu , Ling Huang , Armando Fox , David Patterson , and Michael Jordan . 2010 . Experience mining Google\u2019s production console logs . In Proceedings of the Workshop on Managing Systems via Log Analysis and Machine Learning Techniques (SLAML\u201910) . Wei Xu, Ling Huang, Armando Fox, David Patterson, and Michael Jordan. 2010. Experience mining Google\u2019s production console logs. In Proceedings of the Workshop on Managing Systems via Log Analysis and Machine Learning Techniques (SLAML\u201910)."},{"key":"e_1_2_1_123_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2012.6227202"},{"key":"e_1_2_1_124_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132778"},{"key":"e_1_2_1_125_1","unstructured":"Zipkin 2016. Retrieved from http:\/\/zipkin.io\/.  Zipkin 2016. Retrieved from http:\/\/zipkin.io\/."}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375633","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3375633","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3375633","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:15Z","timestamp":1750199895000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375633"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,4]]},"references-count":125,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,4,30]]}},"alternative-id":["10.1145\/3375633"],"URL":"https:\/\/doi.org\/10.1145\/3375633","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,4]]},"assertion":[{"value":"2018-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-03-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}