{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T06:29:59Z","timestamp":1778567399069,"version":"3.51.4"},"reference-count":46,"publisher":"Emerald","issue":"4","license":[{"start":{"date-parts":[[2017,11,6]],"date-time":"2017-11-06T00:00:00Z","timestamp":1509926400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ITP"],"published-print":{"date-parts":[[2017,11,6]]},"abstract":"\nPurpose<\/jats:title>\nTesting is one of the indispensable activities in software development and is being adopted as an independent course by software engineering (SE) departments at universities worldwide. The purpose of this paper is to carry out an investigation of the performance of learners about testing, given the tendencies in the industry and motivation caused by the unavailability of similar studies in software testing field.<\/jats:p>\n<\/jats:sec>\n\nDesign\/methodology\/approach<\/jats:title>\nThis study is based on the data collected over three years (between 2012 and 2014) from students taking the software testing course. The course is included in the second year of undergraduate curriculum for the bachelor of engineering (SE).<\/jats:p>\n<\/jats:sec>\n\nFindings<\/jats:title>\nIt has been observed that, from the performance perspective, automated testing outperforms structural and functional testing techniques, and that a strong correlation exists among these three approaches. Moreover, a strong programming background does help toward further success in structural and automated testing, but has no effect on functional testing. The results of different teaching styles within the course are also presented together with an analysis exploring the relationship between students\u2019 gender and success in the software testing course, revealing that there is no difference in terms of performance between male and female students in the course. Moreover, it is advisable to introduce teaching concepts one at a time because students find it difficult to grasp the ideas otherwise.<\/jats:p>\n<\/jats:sec>\n\nResearch limitations\/implications<\/jats:title>\nThese findings are based on the analysis conducted using three years of data collected while teaching a course in testing. Obviously, there are some limitations to this study. For example, student\u2019s strength in programming is calculated using the score of C programming courses taken in previous year\/semester. Such scores may not reflect their current level of programming knowledge. Furthermore, attempt was made to ensure that the exercises given for different testing techniques have similar difficulty level to guarantee that the difference in success between these testing techniques is due to the inherent complexity of the technique itself and not because of different exercises. Still, there is small probability that a certain degree of change in success may be due to the difference in the difficulty levels of the exercises. As such, it is obviously premature to consider the present results as final since there is a lack of similar type of studies, with which the authors can compare the results. Therefore, more work needs to be done in different settings to draw sound conclusions in this respect.<\/jats:p>\n<\/jats:sec>\n\nOriginality\/value<\/jats:title>\nAlthough there are few studies (see e.g. Chan et al.<\/jats:italic>, 2005; Garousi and Zhi, 2013; Ng et al.<\/jats:italic>, 2004) exploring the preference of testers over distinct software testing techniques in the industry, there appears to be no paper comparing the preferences and performances of learners in terms of different testing techniques.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/itp-06-2016-0129","type":"journal-article","created":{"date-parts":[[2017,10,3]],"date-time":"2017-10-03T19:12:49Z","timestamp":1507057969000},"page":"927-945","source":"Crossref","is-referenced-by-count":11,"title":["Exploring and expanding students\u2019 success in software testing"],"prefix":"10.1108","volume":"30","author":[{"given":"Deepti","family":"Mishra","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sofiya","family":"Ostrovska","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tuna","family":"Hacaloglu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2020120501012869300_ref001","doi-asserted-by":"crossref","unstructured":"Alvarado, C., Lee, C.B. and Gillespie, G. (2014), \u201cNew CS1 pedagogies and curriculum, the same success factors?\u201d, in Dougherty, J., Nagel, K., Decker, A. and Eiselt, K. (Eds), Proceedings of the 45th ACM Technical Symposium on Computer Science Education, ACM, New York, NY, pp. 379-384.","DOI":"10.1145\/2538862.2538897"},{"issue":"1","key":"key2020120501012869300_ref002","first-page":"26","article-title":"An investigation of factors related to self-efficacy for Java programming among engineering students","volume":"8","year":"2009","journal-title":"The Turkish Online Journal of Educational Technology"},{"key":"key2020120501012869300_ref003","article-title":"Integrated teaching of programming foundations and software testing","year":"2008"},{"key":"key2020120501012869300_ref004","doi-asserted-by":"crossref","unstructured":"Buffardi, K. and Edwards, S.H. (2014), \u201cA formative study of influences on student testing behaviors\u201d, in Dougherty, J., Nagel, K., Decker, A. and Eiselt, K. (Eds), Proceedings of the 45th ACM Technical Symposium on Computer Science Education, ACM, New York, NY, pp. 597-602.","DOI":"10.1145\/2538862.2538982"},{"key":"key2020120501012869300_ref005","doi-asserted-by":"crossref","unstructured":"Byrne, P. and Lyons, G. (2001), \u201cThe effect of student attributes on success in programming\u201d, in Fincher, S., Klein, B.J., Culwin, F. and McCracken, M. (Eds), Proceedings of the 6th Annual Conference on Innovation and Technology in Computer Science Education, ACM, New York, NY, pp. 49-52.","DOI":"10.1145\/377435.377467"},{"issue":"3","key":"key2020120501012869300_ref006","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/384267.305824","article-title":"Gender and programming: what\u2019s going on?","volume":"31","year":"1999","journal-title":"SIGCSE Bulletin"},{"key":"key2020120501012869300_ref007","first-page":"313","article-title":"Software testing education and training in Hong Kong","year":"2005"},{"key":"key2020120501012869300_ref008","doi-asserted-by":"crossref","unstructured":"Charles, M. and Bradley, K. (2006), \u201cA matter of degrees: female underrepresentation in computer science programs cross-nationally\u201d, in Aspray, W. and McGrath Cohoon, J. (Eds), Women and Information Technology, MIT Press, Cambridge, MA, pp. 183-203.","DOI":"10.7551\/mitpress\/9780262033459.003.0006"},{"key":"key2020120501012869300_ref009","doi-asserted-by":"crossref","unstructured":"Chen, Z., Memon, A. and Luo, B. (2014), \u201cCombining research and education of software testing: a preliminary study\u201d, in Cho, Y., Shin, S.Y., Kim, S., Hung, C.-C. and Hong, J. (Eds), Proceedings of the 29th Annual ACM Symposium on Applied Computing, ACM, New York, NY, pp. 1179-1180.","DOI":"10.1145\/2554850.2555124"},{"key":"key2020120501012869300_ref010","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.compedu.2014.09.004","article-title":"Adolescents\u2019 computer performance: the role of self-concept and motivational aspects","volume":"81","year":"2015","journal-title":"Computers & Education"},{"key":"key2020120501012869300_ref011","doi-asserted-by":"crossref","unstructured":"Cohoon, J.M. and Aspray, W. (2006), \u201cA critical review of the research on women\u2019s participation in postsecondary computing education\u201d, in Aspray, W. and McGrath Cohoon, J. (Eds), Women and Information Technology: Research on Underrepresentation, The MIT Press, Cambridge, MA, pp. 137-180.","DOI":"10.7551\/mitpress\/9780262033459.003.0005"},{"issue":"5","key":"key2020120501012869300_ref012","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1111\/j.1365-2729.2006.00185.x","article-title":"The digital divide: the special case of gender","volume":"22","year":"2006","journal-title":"Journal of Computer Assisted Learning"},{"key":"key2020120501012869300_ref013","doi-asserted-by":"crossref","unstructured":"Cowling, T. (2012), \u201cStages in teaching software testing\u201d, in Glinz, M., Murphy, G. and Pezz\u00e8, M. (Eds), Proceedings of the 34th International Conference on Software Engineering, IEEE Press, Piscataway, NJ, pp. 1185-1194.","DOI":"10.1109\/ICSE.2012.6227024"},{"issue":"3","key":"key2020120501012869300_ref014","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1023\/A:1024735227657","article-title":"Gender differences in the choice of computer courses: applying an expectancy-value model","volume":"6","year":"2003","journal-title":"Social Psychology of Education"},{"issue":"5","key":"key2020120501012869300_ref015","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1016\/S0747-5632(02)00006-7","article-title":"Computer self-efficacy, computer anxiety, attitudes towards the internet and reported experience with the internet, by gender, in an East European sample","volume":"18","year":"2002","journal-title":"Computers in Human Behavior"},{"key":"key2020120501012869300_ref016","doi-asserted-by":"crossref","unstructured":"Edwards, S.H. (2004), \u201cUsing software testing to move students from trial-and-error to reflection-in-action\u201d, in Joyce, D.T., Knox, D., Dann, W. and Naps, T.L. (Eds), Proceedings of the 35th SIGCSE Technical Symposium on Computer Science Education, ACM, New York, NY, pp. 26-30.","DOI":"10.1145\/971300.971312"},{"key":"key2020120501012869300_ref017","first-page":"688","article-title":"Bug hunt: making early software testing lessons engaging and affordable","year":"2007"},{"issue":"4","key":"key2020120501012869300_ref046","doi-asserted-by":"crossref","first-page":"477","DOI":"10.2190\/EC.45.4.f","article-title":"Promoting gender equality in digital literacy","volume":"45","year":"2011","journal-title":"Journal of Educational Computing Research"},{"issue":"C","key":"key2020120501012869300_ref018","first-page":"63","article-title":"See feminine \u2013 think incompetent? The effects of a feminine outfit on the evaluation of women\u2019s computer competence","volume":"95","year":"2016","journal-title":"Computers & Education"},{"issue":"3","key":"key2020120501012869300_ref019","first-page":"43","article-title":"Computer self-efficacy, gender, and educational background in South Africa, technology and society magazine","volume":"22","year":"2003","journal-title":"IEEE"},{"key":"key2020120501012869300_ref020","first-page":"177","article-title":"An open modern software testing laboratory courseware \u2013 an experience report","year":"2010"},{"issue":"5","key":"key2020120501012869300_ref021","doi-asserted-by":"crossref","first-page":"1354","DOI":"10.1016\/j.jss.2012.12.051","article-title":"A survey of software testing practices in Canada","volume":"86","year":"2013","journal-title":"Journal of Systems and Software"},{"key":"key2020120501012869300_ref022","doi-asserted-by":"crossref","unstructured":"Grant, N.S. (2003), \u201cA study on critical thinking, cognitive learning style, and gender in various information science programming classes\u201d, in Brewer, J.L. and Mendonca, J. (Eds), Proceedings of the 4th Conference on Information Technology Curriculum, ACM, New York, NY, pp. 96-99.","DOI":"10.1145\/947121.947142"},{"issue":"2","key":"key2020120501012869300_ref023","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1108\/09593840910962212","article-title":"IT occupational culture: the cultural fit and commitment of new information technologists","volume":"22","year":"2009","journal-title":"Information Technology & People"},{"issue":"2","key":"key2020120501012869300_ref024","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1111\/j.1540-6237.2006.00389.x","article-title":"Differences in actual and perceived online skills: the role of gender","volume":"87","year":"2006","journal-title":"Social Science Quarterly"},{"issue":"2","key":"key2020120501012869300_ref025","first-page":"55","article-title":"Teaching software testing from two viewpoints","volume":"26","year":"2010","journal-title":"Journal of Computing in Small Colleges"},{"key":"key2020120501012869300_ref026","unstructured":"Hendrickson, E. (2010), \u201cDo testers have to write code?\u201d, available at: testobsessed.com\/2010\/10\/testers-code\/ (accessed March 3, 2016)."},{"issue":"3","key":"key2020120501012869300_ref027","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1108\/09593841211254330","article-title":"Sequential attrition of secondary school student interest in IT courses and careers","volume":"25","year":"2012","journal-title":"Information Technology & People"},{"issue":"2","key":"key2020120501012869300_ref028","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/j.compedu.2005.01.007","article-title":"Gender and cultural differences in internet use: a study of China and the UK","volume":"48","year":"2007","journal-title":"Computers & Education"},{"key":"key2020120501012869300_ref029","first-page":"81","article-title":"Teaching an end-user testing methodology","year":"2010"},{"key":"key2020120501012869300_ref030","first-page":"645","article-title":"Towards a question-driven teaching method for software testing course","year":"2008"},{"issue":"1","key":"key2020120501012869300_ref031","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1145\/1124706.1121350","article-title":"Women catch up: gender differences in learning programming concepts","volume":"38","year":"2006","journal-title":"SIGCSE Bulletin"},{"key":"key2020120501012869300_ref032","article-title":"A preliminary survey on software testing practices in Australia","year":"2004"},{"issue":"2","key":"key2020120501012869300_ref033","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1016\/j.compedu.2007.06.009","article-title":"Are computer science and information technology still masculine fields? high school students\u2019 perceptions and career choices","volume":"51","year":"2008","journal-title":"Computers & Education"},{"issue":"C","key":"key2020120501012869300_ref034","first-page":"409","article-title":"Closing the gender gap in an introductory programming course","volume":"82","year":"2015","journal-title":"Computer & Education"},{"key":"key2020120501012869300_ref035","unstructured":"Sabitzer, B. and Pasterk, S. (2014), \u201cBrain-based programming continued\u201d, in Castro, M., Tovar, E., Cardella, M., Meier, R. and Pears, A. (Eds), Frontiers in education Conference, IEEE, Washington, DC, pp. 1495-1500."},{"key":"key2020120501012869300_ref036","volume-title":"Statistics and Data Analysis: An Introduction","year":"1996","edition":"2nd ed."},{"issue":"3","key":"key2020120501012869300_ref037","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1016\/j.compedu.2008.11.016","article-title":"(Self-)evaluation of computer competence: how gender matters","volume":"52","year":"2009","journal-title":"Computers & Education"},{"key":"key2020120501012869300_ref038","doi-asserted-by":"crossref","unstructured":"Smith, J., Tessler, J., Kramer, E. and Lin, C. (2012), \u201cUsing peer review to teach software testing\u201d, in Clear, A., Sanders, K. and Simon, B. (Eds), Proceedings of the Ninth Annual International Conference on International Computing Education Research, ACM, New York, NY, pp. 93-98.","DOI":"10.1145\/2361276.2361295"},{"issue":"2","key":"key2020120501012869300_ref039","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1177\/0013164404272486","article-title":"Investigating a measure of computer technology domain identification: a tool for understanding gender differences and stereotypes","volume":"65","year":"2005","journal-title":"Educational and Psychological Measurement"},{"issue":"6","key":"key2020120501012869300_ref040","doi-asserted-by":"crossref","first-page":"2723","DOI":"10.1016\/j.chb.2008.03.016","article-title":"An examination of disposition, motivation, and involvement in the new technology context computers in human behavior","volume":"24","year":"2008","journal-title":"Computers in Human Behavior"},{"key":"key2020120501012869300_ref041","first-page":"2686","article-title":"Experiences in software testing education: some observations from an international cooperation","year":"2008"},{"issue":"1","key":"key2020120501012869300_ref042","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1016\/j.compedu.2010.12.011","article-title":"Gender-differences in self-efficacy ICT related to various ICT-user profiles in Finland and Norway: how do self-efficacy, gender and ICT-user profiles relate to findings from PISA 2006","volume":"57","year":"2011","journal-title":"Computers & Education"},{"issue":"3","key":"key2020120501012869300_ref043","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1177\/030631200030003005","article-title":"Reflections on gender and technology studies: in what state is the art?","volume":"30","year":"2000","journal-title":"Social Studies of Science"},{"issue":"1","key":"key2020120501012869300_ref044","article-title":"Pair-programming helps female computer science students","volume":"4","year":"2004","journal-title":"Journal on Educational Resources in Computing"},{"issue":"5","key":"key2020120501012869300_ref045","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/j.infsof.2003.09.006","article-title":"On the testing methods used by beginning software testers","volume":"46","year":"2004","journal-title":"Information and Software Technology"}],"container-title":["Information Technology & People"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/ITP-06-2016-0129\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/ITP-06-2016-0129\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T21:54:57Z","timestamp":1753394097000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/itp\/article\/30\/4\/927-945\/175703"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,6]]},"references-count":46,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,11,6]]}},"alternative-id":["10.1108\/ITP-06-2016-0129"],"URL":"https:\/\/doi.org\/10.1108\/itp-06-2016-0129","relation":{},"ISSN":["0959-3845"],"issn-type":[{"value":"0959-3845","type":"print"}],"subject":[],"published":{"date-parts":[[2017,11,6]]}}}