{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T01:37:44Z","timestamp":1785548264436,"version":"3.56.0"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2017,8,26]],"date-time":"2017-08-26T00:00:00Z","timestamp":1503705600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DUE-0736833 and DUE-1225742"],"award-info":[{"award-number":["DUE-0736833 and DUE-1225742"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2017,12,31]]},"abstract":"<jats:p>Software continues to affect a major part of our daily lives, including the way we use our phones, home appliances, medical devices, and cars. The pervasiveness of software has led to a growing demand for software developers over the next decade. To ensure the high quality of software developed in industry, students being trained in software engineering also need to be trained on how to use testing techniques and supporting tools effectively at all levels of development.<\/jats:p>\n          <jats:p>In this article, we investigate how testing tools are used in the software project of an undergraduate testing course. We also investigate how a cyberlearning environment\u2014the Web-Based Repository of Software Testing Tutorials (WReSTT)\u2014is used to supplement the learning materials presented in class, particularly the tutorials on different software testing tools. The results of a study spanning three semesters of the undergraduate course suggest that (1) the use of code coverage tools motivates students to improve their test suites; (2) the number of bugs found when using coverage tools slightly increased, which is similar to the results found in the research literature; and (3) students find WReSTT to be a useful resource for learning about software testing techniques and the use of code coverage tools.<\/jats:p>","DOI":"10.1145\/3068324","type":"journal-article","created":{"date-parts":[[2017,8,28]],"date-time":"2017-08-28T12:45:15Z","timestamp":1503924315000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Impact of Using Tools in an Undergraduate Software Testing Course Supported by WReSTT"],"prefix":"10.1145","volume":"17","author":[{"given":"Peter J.","family":"Clarke","sequence":"first","affiliation":[{"name":"Florida International University, Miami, Florida"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Debra L.","family":"Davis","sequence":"additional","affiliation":[{"name":"Florida International University, Miami, Florida"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raymond","family":"Chang-Lau","sequence":"additional","affiliation":[{"name":"Florida International University, Miami, Florida"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tariq M.","family":"King","sequence":"additional","affiliation":[{"name":"Ultimate Software Group Inc., Ultimate Way, Weston, FL"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,8,26]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 2013 TUES Principal Investigators (Pls) Conference. http:\/\/ccliconference.org\/files\/2013\/01\/2013-Tues-Conference-Program.pdf","author":"AAAS","year":"2013"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869542.1869567"},{"key":"e_1_2_1_3_1","volume-title":"Retrieved","author":"ACM\/IEEE-CS Interim Review Task Force","year":"2008"},{"key":"e_1_2_1_4_1","volume-title":"Introduction to Software Testing","author":"Ammann Paul"},{"key":"e_1_2_1_5_1","volume-title":"Testing Object-Oriented Systems: Models, Patterns, and Tools","author":"Binder Robert V."},{"key":"e_1_2_1_6_1","unstructured":"P. Bourque and R. Dupuis. 2004. Guide to the Software Engineering Body of Knowledge 2004 Version. IEEE Los Alamitos California.  P. Bourque and R. Dupuis. 2004. Guide to the Software Engineering Body of Knowledge 2004 Version. IEEE Los Alamitos California."},{"key":"e_1_2_1_7_1","unstructured":"Tom Britton Lisa Jeng Graham Carver and Paul Cheak. 2013. Reversible Debugging Software \u201cQuantify the Time and Cost Saved Using Reversible Debuggers.\u201d Available at http:\/\/citeseerx.ist.psu.edu\/viewdoc\/summary? doi&equals;10.1.1.370.9611  Tom Britton Lisa Jeng Graham Carver and Paul Cheak. 2013. Reversible Debugging Software \u201cQuantify the Time and Cost Saved Using Reversible Debuggers.\u201d Available at http:\/\/citeseerx.ist.psu.edu\/viewdoc\/summary? doi&equals;10.1.1.370.9611"},{"key":"e_1_2_1_8_1","volume-title":"Dutoit","author":"Bruegge Bernd","year":"2009"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSEET.2011.5876084"},{"key":"e_1_2_1_10_1","volume-title":"121st American Society for Engineering Education (ASEE)\u2014Software Engineering Constituent Committee Division Track (SWECC). Paper No. 10123. ASEE, Washington DC.","author":"Clarke Peter J."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2648787"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157227"},{"key":"e_1_2_1_13_1","volume-title":"Retrieved","author":"Team CodeCover","year":"2011"},{"key":"e_1_2_1_14_1","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen Jacob","edition":"2"},{"key":"e_1_2_1_15_1","volume-title":"Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research","author":"Creswell John W.","year":"2004","edition":"2"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2181037.2181040"},{"key":"e_1_2_1_17_1","volume-title":"Software Engineering Techniques. Report on a conference sponsored by the NATO Science Committee","author":"Dijkstra E. W.","year":"1969"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSEET.2011.5876137"},{"key":"e_1_2_1_19_1","unstructured":"Stephen Edwards. 2015. Web-CAT: The Web-Based Center for Automated Testing. http:\/\/web-cat.org\/.  Stephen Edwards. 2015. Web-CAT: The Web-Based Center for Automated Testing. http:\/\/web-cat.org\/."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/971300.971312"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591062.2591164"},{"key":"e_1_2_1_22_1","volume-title":"Retrieved","author":"Team FitNesse","year":"2015"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.221133"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2002.1158637"},{"key":"e_1_2_1_25_1","volume-title":"JUnit Home Page. Retrieved","author":"Gamma E.","year":"2017"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSEET.2011.5876112"},{"key":"e_1_2_1_27_1","first-page":"7","article-title":"The changing landscape of software testing","volume":"7","author":"Hackett Michael","year":"2013","journal-title":"LogiGear Magazine"},{"key":"e_1_2_1_28_1","volume-title":"Retrieved","author":"Hofer Joachim","year":"2010"},{"key":"e_1_2_1_29_1","volume-title":"Retrieved","author":"Hoffmann Marc R.","year":"2015"},{"key":"e_1_2_1_30_1","volume-title":"Retrieved","author":"IBM.","year":"2015"},{"key":"e_1_2_1_31_1","volume-title":"Retrieved","author":"IBM.","year":"2015"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568271"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124706.1121419"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/359369.359392"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSEET.2007.38"},{"key":"e_1_2_1_36_1","first-page":"584","article-title":"Creating learning objects in collaborative e-learning settings","volume":"4","author":"Koohang Alex","year":"2004","journal-title":"Issues in Information Systems"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1345375.1345442"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/800088.802839"},{"key":"e_1_2_1_39_1","unstructured":"Aditya P. Mathur. 2008. Foundations of Software Testing. Pearson Education Delhi India.  Aditya P. Mathur. 2008. Foundations of Software Testing. Pearson Education Delhi India."},{"key":"e_1_2_1_40_1","volume-title":"Sykes","author":"McGregor John D.","year":"2001"},{"key":"e_1_2_1_41_1","volume-title":"Retrieved","author":"Team Unit","year":"2015"},{"key":"e_1_2_1_42_1","volume-title":"Retrieved","author":"Team Selenium Development","year":"2014"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the WASET International Conference on Computer and Information Technology (ICCIT\u201909)","author":"Shim Charlie Y.","year":"2009"},{"key":"e_1_2_1_44_1","volume-title":"MacGregor","author":"Smith Barbara Leigh","year":"1992"},{"key":"e_1_2_1_45_1","volume-title":"Guidelines for Authors of Learning Objects","author":"Smith Rachel S."},{"key":"e_1_2_1_46_1","volume-title":"Retrieved","author":"Tesser Jean","year":"2010"},{"key":"e_1_2_1_47_1","volume-title":"Retrieved","year":"2013"},{"key":"e_1_2_1_48_1","volume-title":"Retrieved","author":"Team STT","year":"2015"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxm021"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.491648"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/267580.267590"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3068324","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3068324","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3068324","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:03:44Z","timestamp":1750215824000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3068324"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,26]]},"references-count":51,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,12,31]]}},"alternative-id":["10.1145\/3068324"],"URL":"https:\/\/doi.org\/10.1145\/3068324","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,8,26]]},"assertion":[{"value":"2015-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-08-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}