{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,19]],"date-time":"2025-03-19T17:08:50Z","timestamp":1742404130810,"version":"3.30.1"},"reference-count":50,"publisher":"Elsevier BV","issue":"2-3","license":[{"start":{"date-parts":[[2001,7,1]],"date-time":"2001-07-01T00:00:00Z","timestamp":993945600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.elsevier.com\/tdm\/userlicense\/1.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Performance Evaluation"],"published-print":{"date-parts":[[2001,7]]},"DOI":"10.1016\/s0166-5316(01)00032-3","type":"journal-article","created":{"date-parts":[[2002,10,14]],"date-time":"2002-10-14T23:55:37Z","timestamp":1034639737000},"page":"125-146","source":"Crossref","is-referenced-by-count":10,"title":["Performance validation tools for software\/hardware systems"],"prefix":"10.1016","volume":"45","author":[{"given":"Ulrich","family":"Herzog","sequence":"first","affiliation":[]},{"given":"Jerry","family":"Rolia","sequence":"additional","affiliation":[]}],"member":"78","reference":[{"key":"10.1016\/S0166-5316(01)00032-3_BIB1","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/12.368012","article-title":"The stochastic rendezvous network model for performance of synchronous client\u2013server-like distributed software","volume":"44","author":"Woodside","year":"1995","journal-title":"IEEE Trans. Comput."},{"issue":"8","key":"10.1016\/S0166-5316(01)00032-3_BIB2","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1109\/32.403785","article-title":"The method of layers","volume":"21","author":"Rolia","year":"1995","journal-title":"IEEE Trans. Softw. Eng."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB3","unstructured":"E.D. Lazowska, J. Zahorjan, G.S. Graham, K. Sevcik, Quantitative System Performance Using Queuing Network Models, Prentice-Hall, Englewood Cliffs, NJ, 1984."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB4","doi-asserted-by":"crossref","unstructured":"S. Ramesh, H.G. Perros, A multi-layer client\u2013server queueing network model with synchronous and asynchronous messages, in: Proceedings of the First International Workshop on Software and Performance (WOSP \u201998), Santa Fe, NM, October 1998, pp. 107\u2013119.","DOI":"10.1145\/287318.287343"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB5","doi-asserted-by":"crossref","first-page":"1201","DOI":"10.1109\/TCOM.1979.1094531","article-title":"A queuing network analysis of computer communication networks with window flow control","volume":"27","author":"Reiser","year":"1979","journal-title":"IEEE Trans. Commun."},{"issue":"1\u20132","key":"10.1016\/S0166-5316(01)00032-3_BIB6","first-page":"117","article-title":"A toolset for performance engineering and software design of client\u2013server systems","volume":"24","author":"Franks","year":"1996","journal-title":"Perform. Evaluation"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB7","unstructured":"F. Sheihk, J. Rolia, P. Garg, S. Frolund, A. Shepherd, Layered modeling of large-scale distributed applications, in: Proceedings of the First World Congress on Systems Simulation, Quality of Service Modeling, Singapore, September 1\u20133, 1997, pp. 247\u2013254."},{"issue":"1","key":"10.1016\/S0166-5316(01)00032-3_BIB8","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1109\/32.748921","article-title":"Trace-based load characterization for generating software performance models","volume":"25","author":"Hrischuk","year":"1999","journal-title":"IEEE Trans. Softw. Eng."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB9","unstructured":"F. El-Rayes, J. Rolia, R. Friedrich, The performance impact of workload characterization for distributed applications using ARM, in: Proceedings of the Computer Measurement Group (CMG\u201998), Anaheim, CA, December 1998, pp. 821\u2013830."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB10","unstructured":"C. Hrischuk, Trace-based load characterization for the automated development of software performance models, Ph.D. Thesis, Carleton University, Canada, 1998."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB11","unstructured":"Microsoft Visual Studio Analyser. http:\/\/www.microsoft.com\/Mind\/0699\/analyzer\/analyzer.htm."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB12","unstructured":"CMG ARM Homepage. http:\/\/www.cmg.org\/regions\/cmgarmw\/index.html."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB13","unstructured":"F. El-Rayes, Design and implementation of an ARM 2.0 compatible performance monitoring and model building framework, M.Eng. Thesis, Carleton University, Canada, May 1999."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB14","unstructured":"D. Krishnamurthy, Performance characterization of web-based shopping systems, M.Eng. Thesis, Department of Systems and Computer Engineering, Carleton University, Canada, September 1998."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB15","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/S0166-5316(98)00008-X","article-title":"Web server performance measurement and modeling techniques","volume":"33","author":"Dilley","year":"1998","journal-title":"Perform. Evaluation"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB16","unstructured":"M. Litoiu, D. Krishnamurthy, J. Rolia, Performance testing for distributed object applications, in: Web Proceedings of ICSE Workshop on Testing Distributed Component-based Systems, Los Angeles, CA, May 17, 1999. http:\/\/www.siemens.com\/ICSE99workshop\/prog.html."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB17","unstructured":"D. Krishnamurthy, M. Litoiu, J. Rolia, Performance stress conditions and capacity planning for E-business applications, in: Proceedings of the International Symposium on Electronic Commerce, Beijing, PR China, May 17\u201320, 1999."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB18","doi-asserted-by":"crossref","unstructured":"R. Friedrich, J. Rolia, Applying performance engineering to a distributed application monitoring system, in: A. Schill, C. Mittasch, O. Spaniol, C. Popien (Eds.), Distributed Platforms, Chapman & Hall, New York, 1996, pp. 258\u2013271.","DOI":"10.1007\/978-0-387-34947-3_20"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB19","doi-asserted-by":"crossref","unstructured":"H. El-Sayed, D. Cameron, C.M. Woodside, Automated performance modeling from scenarios and SDL designs of telecom systems, in: Proceedings of the International Symposium on Software Engineering for Parallel and Distributed Systems (PDSE\u201998), Kyoto, April 1998.","DOI":"10.1109\/PDSE.1998.668171"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB20","unstructured":"F. Sheikh, C.M. Woodside, Sensitivity analysis of performance predictions of distributed application models, in: Proceedings of the Second International Symposium on Sensitivity Analysis of Model Output, Venice, April 1998."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB21","doi-asserted-by":"crossref","unstructured":"F. Sheikh, C.M. Woodside, Layered analytic performance modeling of a distributed database system, in: Proceedings of the 1997 International Conference on Distributed Computing Systems, May 1997, pp. 482\u2013490.","DOI":"10.1109\/ICDCS.1997.603390"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB22","unstructured":"P.P. Jogalekar, G. Boersma, R. MacGillivray, C.M. Woodside, TINA architectures and performance: a telepresence case study, in: Proceedings of the TINA\u201995, Melbourne, Australia, February 1995."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB23","doi-asserted-by":"crossref","unstructured":"D.C. Petriu, C.M. Woodside, Approximate MVA from Markov model of software client\/server systems, in: Proceedings of the Third IEEE Symposium on Parallel and Distributed Processing, Dallas, TX, December 1\u20135, 1991, pp. 322\u2013329.","DOI":"10.1109\/SPDP.1991.218224"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB24","unstructured":"D.C. Petriu, X. Wang, Deriving software performance models from architectural patterns by graph transformations, in: Proceedings of the Sixth International Workshop on Theory and Applications of Graph Transformations (TAGT\u201998), Paderborn, Germany, November 1998 pp. 340\u2013347."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB25","doi-asserted-by":"crossref","unstructured":"C. Shousha, D.C. Petriu, A. Jalnapurkar, K. Ngo, Applying performance modeling to a telecommunication system, in: Proceedings of the First International Workshop on Software and Performance (WOSP\u201998), Santa Fe, NM, October 1998, pp. 1\u20136.","DOI":"10.1145\/287318.287320"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB26","doi-asserted-by":"crossref","unstructured":"G. Franks, C.M. Woodside, Performance of multi-level client\u2013server systems with parallel service operations, in: Proceedings of the First International Workshop on Software and Performance (WOSP\u201998), Santa Fe, NM, October 1998, pp. 120\u2013130.","DOI":"10.1145\/287318.287346"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB27","doi-asserted-by":"crossref","unstructured":"D.C. Petriu, S. Majumdar, J. Lin, C. Hrischuk, Analytic performance estimation of client\u2013server systems with multi-threaded clients, in: Proceedings of the International Workshop on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS\u201994), January 1994, pp. 96\u2013100.","DOI":"10.1109\/MASCOT.1994.284440"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB28","unstructured":"R. Milner, Communication and Concurrency, Prentice-Hall, Englewood Cliffs, NJ, 1989."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB29","unstructured":"C.A.R. Hoare, Communicating Sequential Processes, Prentice-Hall, Englewood Cliffs, NJ, 1985."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB30","doi-asserted-by":"crossref","unstructured":"T. Bolognesi, E. Brinksma, Introduction to the ISO specification language LOTOS, Comput. Networks ISDN Syst. 14 (1987) 25-59.","DOI":"10.1016\/0169-7552(87)90085-7"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB31","unstructured":"N. G\u00f6tz, U. Herzog, M. Rettelbach, TIPP \u2014 Einf\u00fchrung in die leistungsbewertung von verteilten systemen mit Hilfe von Prozessalgebren, in: Verteilte Systeme, Grundlagen und Zuk\u00fcnftige Entwicklungen aus der Sicht des SFB 182, BI-Wissenschaftsverlag, 1993."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB32","unstructured":"U. Herzog, A concept for graph-based stochastic process algebras, generally distributed activity times and hierarchical modeling, in: M. Ribaudo (Ed.), Proceedings of the Fourth Workshop on Process Algebras and Performance Modeling, Universit\u00e0 di Torino, CLUT, 1996."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB33","doi-asserted-by":"crossref","unstructured":"E. Brinksma, J.P. Katoen, R. Langerak, D. Latella, Partial order models for quantitative extensions of LOTOS, Comput. Networks ISDN Syst. 30 (1998) 925\u2013950.","DOI":"10.1016\/S0169-7552(97)00134-7"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB34","unstructured":"C. Priami, Stochastic \u03c0-calculus with general distributions, in: M. Ribaudo (Ed.), Proceedings of the Fourth Workshop on Process Algebras and Performance Modeling, Universit\u00e0 di Torino, CLUT, 1996."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB35","doi-asserted-by":"crossref","unstructured":"S. Gilmore, J. Hillston, The PEPA workbench: a tool to support a process algebra-based approach to performance modeling, in: G. Haring, G. Kotsis (Eds.), Proceedings of the Seventh International Conference on Modeling Techniques and Tools for Computer Performance Evaluation, Wien, 1994.","DOI":"10.1007\/3-540-58021-2_20"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB36","doi-asserted-by":"crossref","unstructured":"M. Bernardo, W.R. Cleaveland, S.T. Sims, W.J. Stewart, Two towers: a tool integrating functional and performance analysis of concurrent systems, in: Proceedings of the FORTE\/PSTV \u201998, Paris, 1998.","DOI":"10.1007\/978-0-387-35394-4_28"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB37","doi-asserted-by":"crossref","unstructured":"H. Hermanns, V. Mertsiotakis, M. Rettelbach, A construction and analysis tool based on the stochastic process algebra TIPP, in: Proceedings of the Second International Workshop on Tools and Algorithms for the Construction and Analysis of Systems (TACAS\u201996), Lecture Notes in Computer Science, Vol. 1055, Springer, Berlin, 1996.","DOI":"10.1007\/3-540-61042-1_65"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB38","doi-asserted-by":"crossref","unstructured":"J. Hillston, V. Mertsiotakis, A simple time scale decomposition technique for stochastic process algebras, in: S. Gilmore, J. Hillston (Eds.), Proceedings of the Third Workshop on Process Algebras and Performance Modeling (special issue), Comput. J., 38 (7) (1995), Oxford University Press, Oxford.","DOI":"10.1093\/comjnl\/38.7.566"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB39","doi-asserted-by":"crossref","unstructured":"V. Mertsiotakis, M. Silva, Throughput approximation of decision-free processes using decomposition, in: Proceedings of the Seventh International Workshop on Petri Nets and Performance Models, St. Malo, IEEE Computer Society Press, June 1997.","DOI":"10.1109\/PNPM.1997.595548"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB40","doi-asserted-by":"crossref","unstructured":"P. Dauphin, F. Hartleb, M. Kienow, V. Mertsiotakis, A. Quick, PEPP: Performance Evaluation of Parallel Programs \u2014 User\u2019s Guide, Version 3.3, Technical Report 17, Universit\u00e4t Erlangen, IMMD7, 1993.","DOI":"10.1007\/978-3-642-78495-8_5"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB41","unstructured":"K. Marzbani, Hierarchische Beschreibung und Analyse von Kommunikationssystemen mittels graphbasieren Prozessalgebren, Master\u2019s Thesis, Universit\u00e4t Erlangen, IMMD7, 1997."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB42","unstructured":"M. Siegle, B. Wentz, A. Klingler, M. Simon, Neue Ans\u00e4tze zur Planung von Klinikkommunikationssystemen mittels stochastischer Leistungsmodellierung, in: R. Muche, G. B\u00fcchele, D. Harder, W. Gaus (Eds.), 42. Jahrestagung der Deutschen Gesellschaft f\u00fcr Medizinische Informatik, Biometrie und Epidemiologie (GMDS), MMV Medien & Medizin Verlag, Ulm, September 1997, pp. 188\u2013192."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB43","unstructured":"M. Siegle, D. Kraska, M. Simon, B. Wentz, Analyse des Erlanger Klinikkommunikationssystems mit Hilfe von Leistungsmessungen, in: E. Greiser, M. Wischnewsky (Eds.), 43. Jahrestagung der Deutschen Gesellschaft f\u00fcr Medizinische Informatik, Biometrie und Episemiologie (GMDS), MMV Medien & Medizin Verlag, Bremen, September 1998, pp. CD-ROM C24."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB44","unstructured":"B. Aures, Modellierung des Erlanger Klinikkommunikationssystems mit Hilfe von stochastischen Prozessalgebren und TIPPtool, Studienarbeit, Universit\u00e4t Erlangen-N\u00fcrnberg, MMD7, October 1998."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB45","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/S0166-5316(99)00056-5","article-title":"Compositional performance modeling with the TIPPtool (extended version of the TOOLS \u201998 paper, Lecture Notes in Computer Science, Vol. 1469)","volume":"39","author":"Hermanns","year":"2000","journal-title":"Perform. Evaluation"},{"key":"10.1016\/S0166-5316(01)00032-3_BIB46","doi-asserted-by":"crossref","unstructured":"H. Garavel, OPEN\/CAESAR: an open software architecture for verification, simulation and testing, in: B. Steffen (Ed.), Tools and Algorithms for the Construction and Analysis of Systems, Lecture Notes in Computer Science, Vol. 1384, Springer, Berlin, 1998, pp. 68\u201384.","DOI":"10.1007\/BFb0054165"},{"issue":"1\/2","key":"10.1016\/S0166-5316(01)00032-3_BIB47","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1007\/s100090050012","article-title":"Protocol verification with the ALD\u00c9BARAN toolset","volume":"1","author":"Bozga","year":"1997","journal-title":"Int. J. Softw. Tools Techn. Transf."},{"issue":"1","key":"10.1016\/S0166-5316(01)00032-3_BIB48","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/S0167-6423(99)00019-2","article-title":"Automated compositional Markov chain generation for a plain old telephony system","volume":"36","author":"Hermanns","year":"2000","journal-title":"Sci. Comput. Program."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB49","unstructured":"Yi-Chun Chu, C.J. Antonelli, T. Teorey, Performance measurement of peoplesoft multi-tier remote computing application, Parts I and II, in: Proceedings of the CMG \u201998, Anaheim, December 1998, pp. 1\u201325."},{"key":"10.1016\/S0166-5316(01)00032-3_BIB50","unstructured":"A. Aldini, M. Bernardo, R. Gorrieri, An algebraic model for evaluating the performance of an ATM-switch with explicit rate marking. in: Proceedings of the PAPM Workshop, PAPM\u201999, Zaragoza."}],"container-title":["Performance Evaluation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.elsevier.com\/content\/article\/PII:S0166531601000323?httpAccept=text\/xml","content-type":"text\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.elsevier.com\/content\/article\/PII:S0166531601000323?httpAccept=text\/plain","content-type":"text\/plain","content-version":"vor","intended-application":"text-mining"}],"deposited":{"date-parts":[[2024,12,5]],"date-time":"2024-12-05T17:22:49Z","timestamp":1733419369000},"score":1,"resource":{"primary":{"URL":"https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0166531601000323"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2001,7]]},"references-count":50,"journal-issue":{"issue":"2-3","published-print":{"date-parts":[[2001,7]]}},"alternative-id":["S0166531601000323"],"URL":"https:\/\/doi.org\/10.1016\/s0166-5316(01)00032-3","relation":{},"ISSN":["0166-5316"],"issn-type":[{"type":"print","value":"0166-5316"}],"subject":[],"published":{"date-parts":[[2001,7]]}}}