{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,30]],"date-time":"2026-05-30T00:29:02Z","timestamp":1780100942832,"version":"3.54.0"},"reference-count":64,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2011,4,3]],"date-time":"2011-04-03T00:00:00Z","timestamp":1301788800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Software Qual J"],"published-print":{"date-parts":[[2011,12]]},"DOI":"10.1007\/s11219-011-9135-x","type":"journal-article","created":{"date-parts":[[2011,4,2]],"date-time":"2011-04-02T03:16:10Z","timestamp":1301714170000},"page":"801-839","source":"Crossref","is-referenced-by-count":31,"title":["Automated GUI performance testing"],"prefix":"10.1007","volume":"19","author":[{"given":"Andrea","family":"Adamoli","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dmitrijs","family":"Zaparanuks","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Milan","family":"Jovic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias","family":"Hauswirth","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2011,4,3]]},"reference":[{"key":"9135_CR1","unstructured":"Adamoli, A., & Hauswirth, M. (2010). Trevis: A context tree visualization & analysis framework and its use for classifying performance failure reports. In SoftVis \u201910: Proceedings of the ACM symposium on software visualization."},{"key":"9135_CR2","unstructured":"Alsmadi, I. (2008). The utilization of user sessions in testing. In ICIS \u201908: Proceedings of the seventh IEEE\/ACIS international conference on computer and information science (icis 2008) (pp. 581\u2013585). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR3","unstructured":"Belli, F. (2001). Finite-state testing and analysis of graphical user interfaces. Software reliability engineering, international symposium on, 0:34."},{"key":"9135_CR4","unstructured":"Blackburn, S. M., Garner, R., Hoffmann, C., Khang, A. M., McKinley, K. S., Bentzur, R., et al. (2006). The dacapo benchmarks: Java benchmarking development and analysis. In OOPSLA \u201906: Proceedings of the 21st annual ACM SIGPLAN conference on object-oriented programming systems, languages, and applications (pp. 169\u2013190). New York, NY, USA: ACM."},{"key":"9135_CR5","unstructured":"Brooks, P. A., & Memon, A. M. (2007). Automated gui testing guided by usage profiles. In ASE \u201907: Proceedings of the twenty-second IEEE\/ACM international conference on Automated software engineering (pp. 333\u2013342). New York, NY, USA: ACM."},{"key":"9135_CR6","unstructured":"Brooks, P. A., Robinson, B. P., & Memon, A. M. (2009). An initial characterization of industrial graphical user interface systems. Software testing, verification, and validation, 2008 international conference on, 0:11\u201320."},{"key":"9135_CR8","unstructured":"Chang, T.-H., Yeh, T., & Miller, R. C. (2010). Gui testing using computer vision. In Proceedings of the 28th international conference on human factors in computing systems, CHI \u201910 (pp. 1535\u20131544). New York, NY, USA: ACM."},{"key":"9135_CR7","unstructured":"Chinnapongse, V., Lee, I., Sokolsky, O., Wang, S., & Jones, P. L. (2009). Model-based testing of gui-driven applications. In Proceedings of the 7th IFIP WG 10.2 international workshop on software technologies for embedded and ubiquitous systems, SEUS \u201909 (pp. 203\u2013214). Berlin, Heidelberg: Springer-Verlag."},{"key":"9135_CR10","unstructured":"de Oliveira, D. A. S., Crandall, J. R., Wassermann, G., Felix Wu, S., Su, Z., & Chong, F. T. (2006). Execrecorder: Vm-based full-system replay for attack analysis and system recovery. In ASID \u201906: Proceedings of the 1st workshop on architectural and system support for improving software dependability (pp. 66\u201371). New York, NY, USA: ACM."},{"key":"9135_CR9","unstructured":"Deursen, A.,, & Mesbah, A. (2010). Research issues in the automated testing of ajax applications. In Proceedings of the 36th conference on current trends in theory and practice of computer science, SOFSEM \u201910 (pp. 16\u201328). Berlin, Heidelberg: Springer-Verlag."},{"key":"9135_CR11","unstructured":"El Ariss, O., Xu, D., Dandey, S., Vender, B., McClean, P., & Slator, B. (2010). A systematic capture and replay strategy for testing complex gui based java applications. In Proceedings of the 2010 seventh international conference on information technology: New generations, ITNG \u201910 (pp. 1038\u20131043). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR12","unstructured":"Elbaum, S., Karre, S., & Rothermel, G. (2003). Improving web application testing with user session data. In Proceedings of the 25th international conference on software engineering, ICSE \u201903 (pp. 49\u201359). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR13","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1109\/TSE.2005.36","volume":"31","author":"S. Elbaum","year":"2005","unstructured":"Elbaum, S., Rothermel, G., Karre, S., & Fisher, M., II. (2005). Leveraging user-session data to support web application testing. IEEE Transactions on Software Engineering, 31, 187\u2013202.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"9135_CR14","unstructured":"Georges, A., Buytaert, D., & Eeckhout, L. (2007). Statistically rigorous java performance evaluation. In OOPSLA \u201907: Proceedings of the 22nd annual ACM SIGPLAN conference on object-oriented programming systems and applications (pp. 57\u201376). New York, NY, USA: ACM."},{"key":"9135_CR15","unstructured":"Grechanik, M., Xie, Q., Fu, C. (2009). Maintaining and evolving gui-directed test scripts. In ICSE \u201909: Proceedings of the 2009 IEEE 31st international conference on software engineering (pp. 408\u2013418). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR16","unstructured":"Hackner, D. R., & Memon, A. M. (2008). Test case generator for guitar. In Companion of the 30th international conference on software engineering, ICSE Companion \u201908 (pp. 959\u2013960). New York, NY, USA: ACM."},{"key":"9135_CR17","doi-asserted-by":"crossref","unstructured":"Jovic, M., Adamoli, A., Zaparanuks, D., & Hauswirth, M. (2010) Automating performance testing of interactive java applications. In: AST \u201910: Proceedings of the 5th Workshop on Automation of Software Test, pp. 8\u201315, New York, NY, USA, 2010. ACM.","DOI":"10.1145\/1808266.1808268"},{"key":"9135_CR18","unstructured":"Jovic, M., & Hauswirth, M. (2008). Measuring the performance of interactive applications with listener latency profiling. In: PPPJ \u201908: Proceedings of the 6th international symposium on principles and practice of programming in java (pp. 137\u2013146). New York, NY, USA: ACM."},{"key":"9135_CR19","unstructured":"Kasik, D. J., & George, H. G. (1996). Toward automatic generation of novice user test scripts. In Proceedings of the SIGCHI conference on human factors in computing systems: Common ground, CHI \u201996 (pp. 244\u2013251). New York, NY, USA: ACM."},{"key":"9135_CR21","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1007\/s10664-006-9031-3","volume":"12","author":"P. Li","year":"2007","unstructured":"Li, P., Huynh, T., Reformat, M., & Miller, J. (2007). A practical approach to testing gui systems. Empirical Software Engineering, 12, 331\u2013357.","journal-title":"Empirical Software Engineering"},{"key":"9135_CR27","volume-title":"Effective GUI testing automation: Developing an automated GUI testing tool","author":"K. Li","year":"2004","unstructured":"Li, K., Wu, M. (2004). Effective GUI testing automation: Developing an automated GUI testing tool. Alameda, CA, USA: SYBEX Inc."},{"issue":"4","key":"9135_CR25","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1007\/s10664-006-9034-0","volume":"12","author":"M. Lindvall","year":"2007","unstructured":"Lindvall, M., Rus, I., Donzelli, P., Memon, A., Zelkowitz, M., Betin-Can, A, et al. (2007). Experimenting with software testbeds for evaluating new technologies. Empirical Software Engineering: An International Journal, 12(4), 417\u2013444.","journal-title":"Empirical Software Engineering: An International Journal"},{"key":"9135_CR22","unstructured":"Liu, H., Jin, H., Liao, X., Hu, L., & Yu, C. (2009). Live migration of virtual machine based on full system trace and replay. In HPDC \u201909: Proceedings of the 18th ACM international symposium on high performance distributed computing (pp. 101\u2013110). New York, NY, USA: ACM."},{"key":"9135_CR23","unstructured":"Liu, C.-H., Kung, D. C., Hsia, P., Hsu, C.-T. (2000a). Object-based data flow testing of web applications. In Proceedings of the the first Asia-Pacific conference on quality software (APAQS\u201900), APAQS \u201900 (pp. 7\u201316). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR24","unstructured":"Liu, C.-H., Kung, D. C., Hsia, P., & Hsu, C.-T. (2000b). Structural testing of web applications. In Proceedings of the 11th international symposium on software reliability engineering (pp. 84\u201396). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR26","doi-asserted-by":"crossref","unstructured":"Lowell, C., & Stell-Smith, J. (2003) Successful automation of gui driven acceptance testing. In Proceedings of the 4th international conference on extreme programming and agile processes in software engineering, XP\u201903 (pp. 331\u2013333). Berlin, Heidelberg: Springer-Verlag.","DOI":"10.1007\/3-540-44870-5_43"},{"key":"9135_CR20","unstructured":"Lucca, G. D., Fasolino, A., & Faralli, F. (2002). Testing web applications. In Proceedings of the international conference on software maintenance (ICSM\u201902) (pp. 310\u2013319). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR38","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1007\/s10009-008-0086-x","volume":"10","author":"A. Marchetto","year":"2008","unstructured":"Marchetto, A., Ricca, F., & Tonella, P. (2008a). A case study-based comparison of web testing techniques applied to ajax web applications. International Journal of Software Tools and Technology Transactions, 10, 477\u2013492.","journal-title":"International Journal of Software Tools and Technology Transactions"},{"key":"9135_CR39","doi-asserted-by":"crossref","unstructured":"Marchetto, A., Tonella, P., & Ricca, F. (2008b). State-based testing of ajax web applications. In ICST (pp. 121\u2013130). IEEE Computer Society.","DOI":"10.1109\/ICST.2008.22"},{"key":"9135_CR33","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1109\/TSE.2007.70756","volume":"34","author":"S. McMaster","year":"2008","unstructured":"McMaster, S., & Memon, A. (2008). Call-stack coverage for gui test suite reduction. ACM Transactions of Software Engineering, 34, 99\u2013115.","journal-title":"ACM Transactions of Software Engineering"},{"key":"9135_CR34","unstructured":"McMaster, S., & Memon, A. M. (2009). An extensible heuristic-based framework for gui test case maintenance. In TESTBEDS \u201909: Proceedings of the first international workshop on TESTing techniques & experimentation benchmarks for event-driven software."},{"issue":"2","key":"9135_CR30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1416563.1416564","volume":"18","author":"A. M. Memon","year":"2008","unstructured":"Memon, A. M. (2008). Automatically repairing event sequence-based gui test suites for regression testing. ACM Transactions of Software Engineering Methodology, 18(2), 1\u201336.","journal-title":"ACM Transactions of Software Engineering Methodology"},{"key":"9135_CR37","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1109\/32.908959","volume":"27","author":"A. M. Memon","year":"2001","unstructured":"Memon, A. M., Pollack, M. E., & Soffa, M. L. (2001) Hierarchical gui test case generation using automated planning. IEEE Transactions of Software Engineering, 27, 144\u2013155.","journal-title":"IEEE Transactions of Software Engineering"},{"key":"9135_CR35","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1002\/smr.305","volume":"17","author":"A. Memon","year":"2005","unstructured":"Memon, A., Nagarajan, A., & Xie, Q. (2005). Automating regression testing for evolving gui software. Journal of Software Maintenance, 17, 27\u201364.","journal-title":"Journal of Software Maintenance"},{"key":"9135_CR41","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1109\/TSE.2005.117","volume":"31","author":"A. M. Memon","year":"2005","unstructured":"Memon, A. M., & Xie, Q. (2005). Studying the fault-detection effectiveness of gui test cases for rapidly evolving software. IEEE Transactions of Software Engineering, 31, 884\u2013896.","journal-title":"IEEE Transactions of Software Engineering"},{"key":"9135_CR40","unstructured":"Mesbah, A. , & van Deursen, A. (2009). Invariant-based automatic testing of ajax user interfaces. In Proceedings of the 31st international conference on software engineering, ICSE \u201909 (pp. 210\u2013220). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR31","unstructured":"Meszaros, G. (2003). Agile regression testing using record & playback. In Companion of the 18th annual ACM SIGPLAN conference on object-oriented programming, systems, languages, and applications, OOPSLA \u201903 (pp. 353\u2013360). New York, NY, USA: ACM."},{"key":"9135_CR36","unstructured":"Mitchell, A., & James F. Power. An approach to quantifying the run-time behaviour of java gui applications. In: WISICT \u201904: Proceedings of the winter international symposium on Information and communication technologies, pp. 1\u20136. Trinity College Dublin, 2004."},{"key":"9135_CR42","unstructured":"Mu, B, Zhan, M., & Hu, L. (2009). Design and implementation of gui automated testing framework based on xml. In Proceedings of the 2009 WRI world congress on software engineering\u2014Vol. 04, WCSE \u201909 (pp. 194\u2013199). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR28","unstructured":"Mytkowicz, T., Diwan, A., Hauswirth, M., & Sweeney, P. F. (2009). Producing wrong data without doing anything obviously wrong! In: ASPLOS \u201909: Proceeding of the 14th international conference on architectural support for programming languages and operating systems (pp. 265\u2013276). New York, NY, USA: ACM."},{"key":"9135_CR29","unstructured":"Mytkowicz, T., Diwan, A., Hauswirth, M., & Sweeney, P. F. (2010). Evaluating the accuracy of java profilers. In PLDI \u201910: Proceedings of the 2010 ACM SIGPLAN conference on programming language design and implementation (pp. 187\u2013197). New York, NY, USA: ACM."},{"key":"9135_CR43","unstructured":"Narayanasamy, S., Pokam, G., & Calder, B. (2005). Bugnet: Continuously recording program execution for deterministic replay debugging. In ISCA \u201905: Proceedings of the 32nd annual international symposium on computer architecture (pp. 284\u2013295). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR44","unstructured":"Nguyen, D. H., Strooper, P., & Suess, J. G. (2010). Model-based testing of multiple gui variants using the gui test generator. In Proceedings of the 5th workshop on automation of software test, AST \u201910 (pp. 24\u201330). New York, NY, USA: ACM."},{"key":"9135_CR49","unstructured":"Ricca, F., & Tonella, P. (2001). Analysis and testing of web applications. In Proceedings of the 23rd international conference on software engineering, ICSE \u201901 (pp. 25\u201334). Washington, DC, USA: IEEE Computer Society."},{"issue":"2","key":"9135_CR45","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1145\/312203.312214","volume":"17","author":"M. Ronsse","year":"1999","unstructured":"Ronsse, M., & Bosschere, K. D. (1999). Recplay: a fully integrated practical record\/replay system. ACM Transactions on Computer System, 17(2), 133\u2013152.","journal-title":"ACM Transactions on Computer System"},{"issue":"9","key":"9135_CR46","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1145\/903893.903895","volume":"46","author":"M. Ronsse","year":"2003","unstructured":"Ronsse, M., De Bosschere, K., Christiaens, M., de Kergommeaux, J. C., & Kranzlm\u00fcller, D. (2003). Record\/replay for nondeterministic program executions. Commun. ACM, 46(9):62\u201367.","journal-title":"Commun. ACM"},{"key":"9135_CR47","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1109\/MS.2007.92","volume":"24","author":"Alex Ruiz","year":"2007","unstructured":"Ruiz, A., & Price, Y. W. (2007). Test-driven gui development with testng and abbot. IEEE Software, 24, 51\u201357.","journal-title":"IEEE Software"},{"key":"9135_CR48","unstructured":"Ruiz, A., & Price, Y. W. (2008). Gui testing made easy. In Proceedings of the testing: Academic & industrial conference\u2014practice and research techniques (pp. 99\u2013103). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR50","doi-asserted-by":"crossref","unstructured":"Sampath, S. (2004). Towards defining and exploiting similarities in web application use cases through user session analysis. In Proceedings of the second international workshop on dynamic analysis.","DOI":"10.1049\/ic:20040294"},{"key":"9135_CR54","unstructured":"Shehady, R. K., & Siewiorek, D. P. (1997). A method to automate user interface testing using variable finite state machines. In Proceedings of the 27th international symposium on fault-tolerant computing (FTCS \u201997), FTCS \u201997 (p. 80). Washington, DC, USA: IEEE Computer Society."},{"issue":"5","key":"9135_CR51","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1145\/347636.348993","volume":"25","author":"J. Steven","year":"2000","unstructured":"Steven, J., Chandra, P., Fleck, B., & Podgurski, A. (2000). jRapture: A Capture\/Replay tool for observation-based testing. SIGSOFT Software Engineering Notes, 25(5), 158\u2013167.","journal-title":"SIGSOFT Software Engineering Notes"},{"key":"9135_CR53","unstructured":"Strecker, J., & Memon, A. M. (2008). Relationships between test suites, faults, and fault detection in gui testing. In ICST \u201908: Proceedings of the first international conference on software testing, verification, and validation. Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR52","unstructured":"Sun, Y., & Jones, E. L. (2004). Specification-driven automated testing of gui-based java programs. In Proceedings of the 42nd annual Southeast regional conference, ACM-SE 42 (pp. 140\u2013145). New York, NY, USA: ACM."},{"key":"9135_CR32","unstructured":"Sun Microsystems. (2004). Java Virtual Machine Tool Interface (JVMTI), http:\/\/www.java.sun.com\/j2se\/1.5.0\/docs\/guide\/jvmti ."},{"key":"9135_CR55","unstructured":"Silva, J. C., Saraiva, J., & Campos, J. C. (2009). A generic library for gui reasoning and testing. In Proceedings of the 2009 ACM symposium on applied computing, SAC \u201909 (pp. 121\u2013128). New York, NY, USA: ACM."},{"key":"9135_CR56","unstructured":"White, L., & Almezen, H. (2000). Generating test cases for gui responsibilities using complete interaction sequences. Software reliability engineering, international symposium on, 0:110."},{"key":"9135_CR57","unstructured":"Xie, Q. (2006). Developing cost-effective model-based techniques for gui testing. In Proceedings of the 28th international conference on software engineering, ICSE \u201906 (pp. 997\u20131000), New York, NY, USA: ACM."},{"key":"9135_CR58","doi-asserted-by":"crossref","unstructured":"Xie, Q., & Memon, A. M. (2007). Designing and comparing automated test oracles for gui-based software applications. ACM Transactions of Software Engineering Methodology.","DOI":"10.1145\/1189748.1189752"},{"key":"9135_CR59","first-page":"7:1","volume":"18","author":"Q. Xie","year":"2008","unstructured":"Xie, Q., & Memon, A. M. (2008) Using a pilot study to derive a gui model for automated testing. ACM Transactions of Software Engineering Methodology, 18, 7:1\u20137:35.","journal-title":"ACM Transactions of Software Engineering Methodology"},{"key":"9135_CR60","doi-asserted-by":"crossref","unstructured":"Yuan, X., Cohen, M. B., & Memon, A. M. (2009). Towards dynamic adaptive automated test generation for graphical user interfaces. In Proceedings of the IEEE international conference on software testing, verification, and validation workshops (pp. 263\u2013266). Washington, DC, USA, 2009. IEEE Computer Society.","DOI":"10.1109\/ICSTW.2009.26"},{"key":"9135_CR61","unstructured":"Yang, J.-T., Huang, J.-L., Wang, F.-J., & Chu, W. C. (1999). An object-oriented architecture supporting web application testing. In 23rd international computer software and applications conference, COMPSAC \u201999 (pp. 122\u2013127). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR62","unstructured":"Yuan, X., & Memon, A. M. (2007). Using GUI run-time state as feedback to generate test cases. In ICSE \u201907: Proceedings of the 29th international conference on software engineering (pp. 396\u2013405). Washington, DC, USA: IEEE Computer Society."},{"key":"9135_CR63","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/TSE.2009.68","volume":"36","author":"X. Yuan","year":"2010","unstructured":"Yuan, X., & Memon, A. M. (2010). Generating event sequence-based test cases using gui runtime state feedback. IEEE Transactions on Software Engineering, 36, 81\u201395.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"9135_CR64","doi-asserted-by":"crossref","unstructured":"Zaparanuks, D., & Hauswirth, M. (2010). Characterizing the design and performance of interactive java applications. In ISPASS (pp. 23\u201332). IEEE Computer Society.","DOI":"10.1109\/ISPASS.2010.5452075"}],"container-title":["Software Quality Journal"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-011-9135-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11219-011-9135-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-011-9135-x","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,9]],"date-time":"2019-06-09T12:37:04Z","timestamp":1560083824000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11219-011-9135-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,4,3]]},"references-count":64,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2011,12]]}},"alternative-id":["9135"],"URL":"https:\/\/doi.org\/10.1007\/s11219-011-9135-x","relation":{},"ISSN":["0963-9314","1573-1367"],"issn-type":[{"value":"0963-9314","type":"print"},{"value":"1573-1367","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,4,3]]}}}