{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T16:30:01Z","timestamp":1774629001477,"version":"3.50.1"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2011,6,1]],"date-time":"2011-06-01T00:00:00Z","timestamp":1306886400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int J Syst Assur Eng Manag"],"published-print":{"date-parts":[[2011,6]]},"DOI":"10.1007\/s13198-011-0065-6","type":"journal-article","created":{"date-parts":[[2011,9,6]],"date-time":"2011-09-06T16:57:11Z","timestamp":1315328231000},"page":"114-125","source":"Crossref","is-referenced-by-count":36,"title":["Trade-off between automated and manual software testing"],"prefix":"10.1007","volume":"2","author":[{"given":"Ossi","family":"Taipale","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jussi","family":"Kasurinen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katja","family":"Karhu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kari","family":"Smolander","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2011,9,7]]},"reference":[{"key":"65_CR1","unstructured":"Atlas (2009) ATLAS.ti\u2014The knowledge workbench. Scientific Software Development, http:\/\/www.atlasti.com Acessed 29 July 2009"},{"key":"65_CR2","unstructured":"Bach J (1997) Test automation snake oil. In: Proceedings of 14th international conference and exposition on testing computer"},{"key":"65_CR3","doi-asserted-by":"crossref","unstructured":"Berner S, Weber R, Keller RK (2005) Observations and lessons learned from automated testing. In: Proceedings of the 27th international conference on Software engineering, St. Louis, Mo, USA, 571\u2013579. doi: 10.1145\/1062455.1062556","DOI":"10.1145\/1062455.1062556"},{"key":"65_CR4","doi-asserted-by":"crossref","unstructured":"Bertolino A (2007) Software testing research: achievements, challenges, dreams, future of software engineering. IEEE Computer Society, pp 85\u2013103. doi: 10.1109\/FOSE.2007.25","DOI":"10.1109\/FOSE.2007.25"},{"key":"65_CR5","unstructured":"Blackburn M, Busser R, Nauman A (2004) Why model-based test automation is different and what you should know to get started.In: International conference on practical software quality and testing"},{"key":"65_CR6","doi-asserted-by":"crossref","unstructured":"Briand LC (2007) A critical analysis of empirical research in software testing. In: First international symposium on empirical software engineering and measurement Madrid, Spain: IEEE Computer Society. doi: 10.1109\/ESEM.2007.40","DOI":"10.1109\/ESEM.2007.40"},{"key":"65_CR7","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1111\/j.1745-493X.2001.tb00102.x","volume":"37","author":"CR Carter","year":"2001","unstructured":"Carter CR, Dresner M (2001) Purchasing\u2019s role in environmental management: Cross-functional development of grounded theory. J Supply Chain Manag 37:12\u201328","journal-title":"J Supply Chain Manag"},{"key":"65_CR8","volume-title":"The research act: a theoretical introduction to sociological methods","author":"NK Denzin","year":"1978","unstructured":"Denzin NK (1978) The research act: a theoretical introduction to sociological methods. McGraw Hill, New York"},{"key":"65_CR9","volume-title":"Automated software testing: introduction management, and performance","author":"E Dustin","year":"1999","unstructured":"Dustin E, Rashka J, Paul J (1999) Automated software testing: introduction management, and performance. Addison-Wesley, Boston"},{"key":"65_CR10","doi-asserted-by":"crossref","first-page":"532","DOI":"10.5465\/amr.1989.4308385","volume":"14","author":"KM Eisenhardt","year":"1989","unstructured":"Eisenhardt KM (1989) Building theories from case study research. Acad Manag Rev 14:532\u2013550","journal-title":"Acad Manag Rev"},{"key":"65_CR11","unstructured":"EU (2003) SME Definition. European Commission"},{"key":"65_CR12","doi-asserted-by":"crossref","unstructured":"Fewster M (2001) Common mistakes in test automation.In: Fall test automation conference, Boston","DOI":"10.1002\/0471028959.sof331"},{"key":"65_CR13","volume-title":"The discovery of grounded theory: strategies for qualitative research","author":"B Glaser","year":"1967","unstructured":"Glaser B, Strauss AL (1967) The discovery of grounded theory: strategies for qualitative research. Aldine, Chicago"},{"key":"65_CR14","doi-asserted-by":"crossref","unstructured":"Hartman A, Katara M, Paradkar A (2007) Domain specific approaches to software test automation. In: Proceedings of 6th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on the foundations of software engineering, Dubrovnik, 621\u2013622, 2007. doi: 10.1145\/1287624.1287730","DOI":"10.1145\/1287624.1287730"},{"key":"65_CR15","unstructured":"ISO\/IEC (2002) ISO\/IEC 15504-1 Information Technology\u2014Process Assessment\u2014Part 1: Concepts and Vocabulary"},{"key":"65_CR16","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1109\/2.299437","volume":"27","author":"C Jones","year":"1994","unstructured":"Jones C (1994) Economics of software reuse. IEEE Computer 27:106\u2013107. doi: 10.1109\/2.299437","journal-title":"IEEE Computer"},{"issue":"4","key":"65_CR17","first-page":"28","volume":"4","author":"C Kaner","year":"1997","unstructured":"Kaner C (1997) Improving the maintainability of automated test suites. Softw QA 4(4):28","journal-title":"Softw QA"},{"key":"65_CR18","unstructured":"Kaner C (2000) Architectures of test automation. In: Software testing, analysis and review conference (Star) West, San Jose"},{"key":"65_CR19","doi-asserted-by":"crossref","unstructured":"Karhu K, Taipale O, Smolander K (2007) Outsourcing and knowledge management in software testing. In: Proceedings of the 11th international conference on evaluation and assessment in software engineering (EASE), Keele University, Staffordshire, UK, BCS, 2\u20133 April 2007","DOI":"10.14236\/ewic\/EASE2007.6"},{"key":"65_CR33","doi-asserted-by":"crossref","unstructured":"Karhu K, Repo T, Taipale O, Smolander, K (2009) Empirical observations on software testing automation. In: Proceedings of the 2nd international conference on software testing, verification and validation, Denver, CO, USA. doi: 10.1109\/ICST.2009.16","DOI":"10.1109\/ICST.2009.16"},{"key":"65_CR20","volume-title":"Software testing in the real world: improving the process. Reading","author":"E Kit","year":"1995","unstructured":"Kit E (1995) Software testing in the real world: improving the process. Reading. Addison-Wesley, Boston"},{"key":"65_CR21","doi-asserted-by":"crossref","first-page":"67","DOI":"10.2307\/249410","volume":"23","author":"HK Klein","year":"1999","unstructured":"Klein HK, Myers MD (1999) A set of principles for conducting and evaluating interpretive field studies in information systems. MIS Q 23:67\u201394. doi: 10.2307\/249410","journal-title":"MIS Q"},{"key":"65_CR22","unstructured":"Mantere T (2003) Automatic software testing by genetic algorithms. Dissertation, Universitas Wasaensis, Vaasa, vol. 112"},{"key":"65_CR23","volume-title":"Qualitative data analysis","author":"MB Miles","year":"1994","unstructured":"Miles MB, Huberman AM (1994) Qualitative data analysis. SAGE Publications, Thousand Oaks"},{"key":"65_CR24","unstructured":"Ng SP, Murmane T, Reed K, Grant D, Chen TY (2004) A preliminary survey on software testing practices in Australia. In: Proceedings of 2004 Australian software engineering conference, Melbourne, Australia, 116\u2013125"},{"key":"65_CR25","doi-asserted-by":"crossref","unstructured":"Pare\u2032 G, Elam JJ (1997) Using case study research to build theories of IT implementation.In: IFIP TC8 WG international conference on information systems and qualitative research, Philadelphia, USA","DOI":"10.1007\/978-0-387-35309-8_27"},{"key":"65_CR26","doi-asserted-by":"crossref","unstructured":"Persson C, Yilmazt\u00fcrk N (2004) Establishment of automated regression testing at ABB: industrial experience report on \u2018Avoiding the Pitfalls\u2019.In: the 19th international conference on automated software engineering (ASE\u201904): IEEE Computer Society. doi: 10.1109\/ASE.2004.1342729","DOI":"10.1109\/ASE.2004.1342729"},{"key":"65_CR27","volume-title":"Economic perspectives in test automation: balancing automated and manual testing with opportunity cost. AST\u201906 Shanghai","author":"R Ramler","year":"2006","unstructured":"Ramler R, Wolfmaier K (2006) Economic perspectives in test automation: balancing automated and manual testing with opportunity cost. AST\u201906 Shanghai. ACM, China. doi: 10.1145\/1138929.1138946"},{"key":"65_CR28","volume-title":"Real world research","author":"C Robson","year":"2002","unstructured":"Robson C (2002) Real world research, 2nd edn. Blackwell Publishing, Oxford","edition":"2"},{"key":"65_CR29","doi-asserted-by":"crossref","unstructured":"Santos-Neto P, Resende R, P\u00e1dua C (2007) Requirements for information systems model-based testing. In: Proceedings of the 2007 ACM symposium on applied computing, Seoul, Korea, 1409\u20131415. doi: 10.1145\/1244002.1244306","DOI":"10.1145\/1244002.1244306"},{"key":"65_CR30","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1109\/32.799955","volume":"25","author":"CB Seaman","year":"1999","unstructured":"Seaman CB (1999) Qualitative methods in empirical studies of software engineering. IEEE Trans Softw Eng 25:557\u2013572. doi: 10.1109\/32.799955","journal-title":"IEEE Trans Softw Eng"},{"key":"65_CR31","doi-asserted-by":"crossref","unstructured":"Shaw M (2003) Writing good software engineering research papers. In: Proceedings of the 25th international conference on software engineering (ICSE\u2019 03), Portland, pp 726\u2013736","DOI":"10.1109\/ICSE.2003.1201262"},{"key":"65_CR32","doi-asserted-by":"crossref","unstructured":"Sj\u00f6berg DIK, Dyb\u00e5 T, Jorgensen M (2007) The future of empirical methods in software engineering research. FOSE\u201907: 2007 Future of Software Engineering, pp. 358\u2013378. doi: 10.1109\/FOSE.2007.30","DOI":"10.1109\/FOSE.2007.30"},{"key":"65_CR34","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1057\/ejis.2008.48","volume":"17","author":"K Smolander","year":"2008","unstructured":"Smolander K, Rossi M, Purao S (2008) Software architectures: blueprint literature, language or decision. Eur J Inf Syst 17:575\u2013588","journal-title":"Eur J Inf Syst"},{"key":"65_CR35","volume-title":"Software engineering","author":"I Sommerville","year":"1995","unstructured":"Sommerville I (1995) Software engineering. Addison Wesley, Essex"},{"key":"65_CR36","volume-title":"Basics of qualitative research: grounded theory procedures and techniques","author":"A Strauss","year":"1990","unstructured":"Strauss A, Corbin J (1990) Basics of qualitative research: grounded theory procedures and techniques. SAGE Publications, Newbury Park"},{"key":"65_CR37","doi-asserted-by":"crossref","unstructured":"Taipale O, Smolander K, K\u00e4lvi\u00e4inen H (2005) Finding and ranking research directions for software testing. In: European software process improvement and innovation conference, Budapest, Hungary, pp 39\u201348. doi: 10.1145\/336512.336532","DOI":"10.1145\/336512.336532"},{"key":"65_CR38","unstructured":"Taipale O, Smolander K, K\u00e4lvi\u00e4inen H (2006a) A survey on software testing.In: The 6th international SPICE conference on software process improvement and capability dEtermination (SPICE\u2019 2006), Luxembourg"},{"key":"65_CR39","doi-asserted-by":"crossref","unstructured":"Taipale O, Smolander K, K\u00e4lvi\u00e4inen H (2006b) Factors affecting software testing time schedule. In: Australian software engineering conference, Sydney. doi: 10.1109\/ASWEC.2006.27","DOI":"10.1109\/ASWEC.2006.27"},{"key":"65_CR40","unstructured":"Taipale O, Smolander K, K\u00e4lvi\u00e4inen H (2006c) Cost reduction and quality improvement in software testing.In: Software quality management conference, Southampton, UK"},{"key":"65_CR41","doi-asserted-by":"crossref","unstructured":"Taipale O, Karhu K, Smolander K (2007) Observing software testing practice from the viewpoint of organizations and knowledge management. In: Proceedings of the 1st international symposium on empirical software engineering and measurement (ESEM), 2007, Madrid, Spain, IEEE. doi: 10.1109\/ESEM.2007.18","DOI":"10.1109\/ESEM.2007.18"},{"key":"65_CR42","unstructured":"Tassey G (2002) The economic impacts of inadequate infrastructure for software testing. US national institute of standards and technology report, RTI Project Number 7007.011"},{"key":"65_CR43","unstructured":"Torkar R, Mankefors S (2003) A survey on testing and reuse. In: IEEE international conference on software-science, technology and engineering (SwSTE\u201903), Herzlia, Israel"}],"container-title":["International Journal of System Assurance Engineering and Management"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s13198-011-0065-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s13198-011-0065-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s13198-011-0065-6","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,6,23]],"date-time":"2020-06-23T06:37:47Z","timestamp":1592894267000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s13198-011-0065-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,6]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2011,6]]}},"alternative-id":["65"],"URL":"https:\/\/doi.org\/10.1007\/s13198-011-0065-6","relation":{},"ISSN":["0975-6809","0976-4348"],"issn-type":[{"value":"0975-6809","type":"print"},{"value":"0976-4348","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,6]]}}}