{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T14:11:57Z","timestamp":1761487917415,"version":"3.41.0"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2007,7,1]],"date-time":"2007-07-01T00:00:00Z","timestamp":1183248000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Comput. Simul."],"published-print":{"date-parts":[[2007,7]]},"abstract":"<jats:p>We present a multivariate analysis technique called Co-Plot that is especially suitable for few samples of many variables. Co-Plot embeds the multidimensional samples in two dimensions, in a way that allows key variables to be identified, and relations between both variables and observations to be analyzed together. When applied to the workloads on parallel supercomputers, we find two stable perpendicular axes of highly correlated variables, one representing individual job attributes and the other representing multijob attributes. The different workloads, on the other hand, are rather different from one another, and may also change over time. Synthetic models for workload generation are also analyzed, and found to be reasonable in the sense that they span the same range of variable combinations as the real workloads. However, the spread of real workloads implies that a single model cannot be similar to all of them. This leads us to construct a parameterized model, with parameters that correspond to the two axes identified above. We also find that existing models do not model the temporal structure of the workload well, and hence are wanting for tasks such as comparing schedulers, and that the common methodology for load manipulation of workloads is problematic.<\/jats:p>","DOI":"10.1145\/1243991.1243993","type":"journal-article","created":{"date-parts":[[2007,9,14]],"date-time":"2007-09-14T13:44:55Z","timestamp":1189777495000},"page":"12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["A Co-Plot analysis of logs and models of parallel workloads"],"prefix":"10.1145","volume":"17","author":[{"given":"David","family":"Talby","sequence":"first","affiliation":[{"name":"The Hebrew University of Jerusalem, Jerusalem, Israel"}]},{"given":"Dror G.","family":"Feitelson","sequence":"additional","affiliation":[{"name":"The Hebrew University of Jerusalem, Jerusalem, Israel"}]},{"given":"Adi","family":"Raveh","sequence":"additional","affiliation":[{"name":"The Hebrew University of Jerusalem, Jerusalem, Israel"}]}],"member":"320","published-online":{"date-parts":[[2007,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/C-M.1976.218610"},{"volume-title":"Statistics for Long-Memory Processes (Monographs on Statistics and Applied Probability), Chapman and Hall","author":"Beran J.","key":"e_1_2_1_2_1","unstructured":"Beran , J. 1994. Statistics for Long-Memory Processes (Monographs on Statistics and Applied Probability), Chapman and Hall , New York, NY . Beran, J. 1994. Statistics for Long-Memory Processes (Monographs on Statistics and Applied Probability), Chapman and Hall, New York, NY."},{"key":"e_1_2_1_3_1","first-page":"29","volume-title":"Modern Multidimensional Scaling---Theory and Applications. Springer Series in Statistics","author":"Borg I.","unstructured":"Borg , I. and Groenen , P . 1997 . Modern Multidimensional Scaling---Theory and Applications. Springer Series in Statistics , Springer , pp. 29 -- 48 and pp. 199--205. Borg, I. and Groenen, P. 1997. Modern Multidimensional Scaling---Theory and Applications. Springer Series in Statistics, Springer, pp. 29--48 and pp. 199--205."},{"volume-title":"Proc. IEEE 81","author":"Calzarossa M.","key":"e_1_2_1_4_1","unstructured":"Calzarossa , M. and Serazzi , G . 1993. Workload characterization: A survey . In Proc. IEEE 81 , 8, (Aug.) 1136--1150. Calzarossa, M. and Serazzi, G. 1993. Workload characterization: A survey. In Proc. IEEE 81, 8, (Aug.) 1136--1150."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/0166-5316(94)90046-9"},{"volume-title":"Proceedings of the 15th International Parallel & Distributed Processing Symposium, Apr.","author":"Cirne W.","key":"e_1_2_1_6_1","unstructured":"Cirne , W. and Berman , F . 2001. A model for moldable supercomputer workloads . In Proceedings of the 15th International Parallel & Distributed Processing Symposium, Apr. Cirne, W. and Berman, F. 2001. A model for moldable supercomputer workloads. In Proceedings of the 15th International Parallel & Distributed Processing Symposium, Apr."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/822082.823160"},{"volume-title":"Job Scheduling Strategies for Parallel Processing","author":"Downey A. B.","key":"e_1_2_1_8_1","unstructured":"Downey , A. B. 1997b. Using queue time predictions for processor allocation . In Job Scheduling Strategies for Parallel Processing , D. G. Feitelson and L. Rudolph, Eds. Lecture Notes in Computer Science, vol. 1291 . Springer-Verlag . 35--57. Downey, A. B. 1997b. Using queue time predictions for processor allocation. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph, Eds. Lecture Notes in Computer Science, vol. 1291. Springer-Verlag. 35--57."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/309746.309750"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/646377.689375"},{"key":"e_1_2_1_11_1","unstructured":"Feitelson D. G. 1999. The Parallel Workloads Archive. Available from World Wide Web: (http:\/\/www.cs.huji.ac.il\/labs\/parallel\/workload)  Feitelson D. G. 1999. The Parallel Workloads Archive. Available from World Wide Web: (http:\/\/www.cs.huji.ac.il\/labs\/parallel\/workload)"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/646667.700018"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2003.1231190"},{"key":"e_1_2_1_14_1","volume-title":"Eds. Lecture Notes in Computer Science","volume":"1291","author":"Feitelson D. G.","unstructured":"Feitelson , D. G. and Jette , M. A . 1997. Improved utilization and responsiveness with Gang scheduling. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph , Eds. Lecture Notes in Computer Science , vol. 1291 . Springer-Verlag. 238--261. Feitelson, D. G. and Jette, M. A. 1997. Improved utilization and responsiveness with Gang scheduling. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph, Eds. Lecture Notes in Computer Science, vol. 1291. Springer-Verlag. 238--261."},{"key":"e_1_2_1_15_1","volume-title":"Eds. Lecture Notes in Computer Science","volume":"949","author":"Feitelson D. G.","unstructured":"Feitelson , D. G. and Nitzberg , B . 1995. Job characteristics of a production parallel scientific workload on the NASA Ames iPSC\/860. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph , Eds. Lecture Notes in Computer Science , vol. 949 . Springer-Verlag. 337--360. Feitelson, D. G. and Nitzberg, B. 1995. Job characteristics of a production parallel scientific workload on the NASA Ames iPSC\/860. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph, Eds. Lecture Notes in Computer Science, vol. 949. Springer-Verlag. 337--360."},{"key":"e_1_2_1_16_1","volume-title":"Eds. Lecture Notes in Computer Science","volume":"1459","author":"Feitelson D. G.","unstructured":"Feitelson , D. G. and Rudolph , L . 1998. Metrics and benchmarking for parallel job scheduling. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph , Eds. Lecture Notes in Computer Science , vol. 1459 . Springer-Verlag. 1--24. Feitelson, D. G. and Rudolph, L. 1998. Metrics and benchmarking for parallel job scheduling. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph, Eds. Lecture Notes in Computer Science, vol. 1459. Springer-Verlag. 1--24."},{"volume-title":"Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software, Mar.","author":"Feitelson D. G.","key":"e_1_2_1_17_1","unstructured":"Feitelson , D. G. and Tsafrir , D . 2006. Workload sanitation for performance evaluation . In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software, Mar. Feitelson, D. G. and Tsafrir, D. 2006. Workload sanitation for performance evaluation. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software, Mar."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/C-M.1972.216939"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02290164"},{"volume-title":"Job Scheduling Strategies for Parallel Processing","author":"Hotovy S.","key":"e_1_2_1_20_1","unstructured":"Hotovy , S. 1996. Workload evolution on the Cornell Theory Center IBM SP2 . In Job Scheduling Strategies for Parallel Processing , D. G. Feitelson and L. Rudolph, Eds. Lecture Notes in Computer Science, vol. 1162 . Springer-Verlag . 27--40. Hotovy, S. 1996. Workload evolution on the Cornell Theory Center IBM SP2. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph, Eds. Lecture Notes in Computer Science, vol. 1162. Springer-Verlag. 27--40."},{"key":"e_1_2_1_21_1","volume-title":"Eds. Lecture Notes in Computer Science","volume":"1291","author":"Jann J.","unstructured":"Jann , J. , Pattnaik , P. , Franke , H. , Wang , F. , Skovira , J. , and Riodan , J . 1997. Modeling of workload in MPPs. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph , Eds. Lecture Notes in Computer Science , vol. 1291 . Springer-Verlag. 95--116. Jann, J., Pattnaik, P., Franke, H., Wang, F., Skovira, J., and Riodan, J. 1997. Modeling of workload in MPPs. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph, Eds. Lecture Notes in Computer Science, vol. 1291. Springer-Verlag. 95--116."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/115952.115977"},{"key":"e_1_2_1_23_1","unstructured":"Lazowska E. D. 1977. The use of percentiles in modeling CPU service time distributions. In Computer Performance K. M. Chandy and M. Reiser Eds. North Holland 53--66.  Lazowska E. D. 1977. The use of percentiles in modeling CPU service time distributions. In Computer Performance K. M. Chandy and M. Reiser Eds. North Holland 53--66."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1080\/00420989420080071"},{"key":"e_1_2_1_25_1","volume-title":"Eds. Lecture Notes in Computer Science","volume":"1459","author":"Lo V.","unstructured":"Lo , V. , Mache , J. , and Windisch , K . 1998. A comparative study of real workload traces and synthetic workload models for parallel job scheduling. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph , Eds. Lecture Notes in Computer Science , vol. 1459 , Springer Verlag. 25--46. Lo, V., Mache, J., and Windisch, K. 1998. A comparative study of real workload traces and synthetic workload models for parallel job scheduling. In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph, Eds. Lecture Notes in Computer Science, vol. 1459, Springer Verlag. 25--46."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0743-7315(03)00108-4"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/0304-4076(78)90088-X"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/55595.55608"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(98)00384-1"},{"key":"e_1_2_1_30_1","unstructured":"Talby D. 1999. Visual Co-Plot. Available from World Wide Web: (http:\/\/www.cs.huji.ac.il\/~davidt\/vcoplot).  Talby D. 1999. Visual Co-Plot. Available from World Wide Web: (http:\/\/www.cs.huji.ac.il\/~davidt\/vcoplot)."},{"volume-title":"20th International Parallel and Distributed Processing Symposium, Apr.","author":"Tsafrir D.","key":"e_1_2_1_31_1","unstructured":"Tsafrir , D. and Feitelson , D. G . 2006. Instability in parallel job scheduling simulation: The role of workload flurries . In 20th International Parallel and Distributed Processing Symposium, Apr. Tsafrir, D. and Feitelson, D. G. 2006. Instability in parallel job scheduling simulation: The role of workload flurries. In 20th International Parallel and Distributed Processing Symposium, Apr."},{"volume-title":"Proceedings of the 6th Symposium on Frontiers Massively Parallel Computing, Oct. 319--326","author":"Windisch K.","key":"e_1_2_1_32_1","unstructured":"Windisch , K. , Lo , V. , Moore , R. , Feitelson , D. , and Nitzberg , B . 1996. A comparison of workload traces from two production parallel machines . In Proceedings of the 6th Symposium on Frontiers Massively Parallel Computing, Oct. 319--326 . Windisch, K., Lo, V., Moore, R., Feitelson, D., and Nitzberg, B. 1996. A comparison of workload traces from two production parallel machines. In Proceedings of the 6th Symposium on Frontiers Massively Parallel Computing, Oct. 319--326."}],"container-title":["ACM Transactions on Modeling and Computer Simulation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1243991.1243993","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1243991.1243993","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T14:47:49Z","timestamp":1750258069000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1243991.1243993"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,7]]},"references-count":32,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2007,7]]}},"alternative-id":["10.1145\/1243991.1243993"],"URL":"https:\/\/doi.org\/10.1145\/1243991.1243993","relation":{},"ISSN":["1049-3301","1558-1195"],"issn-type":[{"type":"print","value":"1049-3301"},{"type":"electronic","value":"1558-1195"}],"subject":[],"published":{"date-parts":[[2007,7]]},"assertion":[{"value":"2007-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}