{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,12]],"date-time":"2026-11-12T11:51:58Z","timestamp":1794484318648,"version":"4.9.1"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2014,10,27]],"date-time":"2014-10-27T00:00:00Z","timestamp":1414368000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000172","name":"Division of Undergraduate Education","doi-asserted-by":"publisher","award":["DUE-0736833 and DUE-1225742 (FIU), and grant DUE-0736771 (FAMU)"],"award-info":[{"award-number":["DUE-0736833 and DUE-1225742 (FIU), and grant DUE-0736771 (FAMU)"]}],"id":[{"id":"10.13039\/100000172","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2014,11,3]]},"abstract":"<jats:p>As software becomes more ubiquitous and complex, the cost of software bugs continues to grow at a staggering rate. To remedy this situation, there needs to be major improvement in the knowledge and application of software validation techniques. Although there are several software validation techniques, software testing continues to be one of the most widely used in industry. The high demand for software engineers in the next decade has resulted in more software engineering (SE) courses being offered in academic institutions. However, due to the number of topics to be covered in SE courses, little or no attention is given to software testing, resulting in students entering industry with little or no testing experience.<\/jats:p>\n          <jats:p>We propose a minimally disruptive approach of integrating software testing into SE courses by providing students access to a collaborative learning environment containing learning materials on testing techniques and testing tools. In this article, we describe the learning environment and the studies conducted to measure the benefits accrued by students using the learning environment in the SE courses.<\/jats:p>","DOI":"10.1145\/2648787","type":"journal-article","created":{"date-parts":[[2014,10,28]],"date-time":"2014-10-28T12:40:29Z","timestamp":1414500029000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":35,"title":["Integrating Testing into Software Engineering Courses Supported by a Collaborative Learning Environment"],"prefix":"10.1145","volume":"14","author":[{"given":"Peter J.","family":"Clarke","sequence":"first","affiliation":[{"name":"Florida International University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Debra","family":"Davis","sequence":"additional","affiliation":[{"name":"Florida International University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tariq M.","family":"King","sequence":"additional","affiliation":[{"name":"North Dakota State University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jairo","family":"Pava","sequence":"additional","affiliation":[{"name":"Florida International University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edward L.","family":"Jones","sequence":"additional","affiliation":[{"name":"Florida A&amp;M University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2014,10,27]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Computer Science Curriculum 2008: An Interim Revision of CS","author":"ACM\/IEEE-CS Interim Review Task Force","year":"2001"},{"key":"e_1_2_1_2_1","volume-title":"Introduction to Software Testing","author":"Ammann Paul"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEE.2010.5508833"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/794194.794977"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/9775.9777"},{"key":"e_1_2_1_6_1","unstructured":"Sebastian Bergmann. 2013. PHPUnit. Retrieved August 7 2014 from https:\/\/github.com\/sebastianbergmann\/phpunit\/.  Sebastian Bergmann. 2013. PHPUnit. Retrieved August 7 2014 from https:\/\/github.com\/sebastianbergmann\/phpunit\/."},{"key":"e_1_2_1_7_1","volume-title":"Testing Object-Oriented Systems: Models, Patterns, and Tools","author":"Binder Robert V."},{"key":"e_1_2_1_8_1","volume-title":"Guide to the Software Engineering Body of Knowledge 2004 Version","author":"Bourque Pierre"},{"key":"e_1_2_1_9_1","volume-title":"Dutoit","author":"Bruegge Bernd","year":"2009"},{"key":"e_1_2_1_10_1","volume-title":"Ensemble: Computing Portal Connecting Computing Educators. Retrieved","author":"Cassel Lilian","year":"2012"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2005.55"},{"key":"e_1_2_1_12_1","volume-title":"CITIDEL: Computing and Information Technology Interactive Digital Educational Library. Retrieved","author":"Team CITIDEL","year":"2010"},{"key":"e_1_2_1_13_1","unstructured":"Mike Clark. 2012. JDepend. Retrieved August 7 2014 from http:\/\/clarkware.com\/software\/JDepend.html.  Mike Clark. 2012. JDepend. Retrieved August 7 2014 from http:\/\/clarkware.com\/software\/JDepend.html."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869542.1869573"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157227"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953208"},{"key":"e_1_2_1_17_1","volume-title":"August 9. Retrieved","author":"Is Knight\u2019s CNN.","year":"2012"},{"key":"e_1_2_1_19_1","unstructured":"Cobertura Team. 2012. Cobertura. Retrieved August 7 2014 from http:\/\/cobertura.sourceforge.net\/.  Cobertura Team. 2012. Cobertura. Retrieved August 7 2014 from http:\/\/cobertura.sourceforge.net\/."},{"key":"e_1_2_1_20_1","unstructured":"CoverStory Team. 2013. CoverStory. Retrieved August 7 2014 from http:\/\/code.google.com\/p\/coverstory\/.  CoverStory Team. 2013. CoverStory. Retrieved August 7 2014 from http:\/\/code.google.com\/p\/coverstory\/."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/2337223.2337379"},{"key":"e_1_2_1_22_1","first-page":"26","article-title":"Examining software testing tools","volume":"373","author":"Crowther David C.","year":"2005","journal-title":"Dr. Dobbs Journal"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1539024.1508921"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2012.12.020"},{"key":"e_1_2_1_25_1","unstructured":"Drupal Community. 2012. Drupal. Retrieved August 7 2014 from http:\/\/drupal.org\/.  Drupal Community. 2012. Drupal. Retrieved August 7 2014 from http:\/\/drupal.org\/."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSEET.2011.5876137"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/949344.949390"},{"key":"e_1_2_1_28_1","unstructured":"Facebook Team. 2012. Facebook. Retrieved August 7 2014 from http:\/\/www.facebook.com\/.  Facebook Team. 2012. Facebook. Retrieved August 7 2014 from http:\/\/www.facebook.com\/."},{"key":"e_1_2_1_29_1","unstructured":"Michael Feathers. 2012. CppUnit. Retrieved August 7 2014 from http:\/\/sourceforge.net\/projects\/cppunit\/.  Michael Feathers. 2012. CppUnit. Retrieved August 7 2014 from http:\/\/sourceforge.net\/projects\/cppunit\/."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2002.1158637"},{"key":"e_1_2_1_31_1","volume-title":"Kropp","author":"Gallaher Michael P.","year":"2011"},{"key":"e_1_2_1_32_1","unstructured":"Erich Gamma and Kent Beck. 2012. JUnit. Retrieved August 7 2014 from http:\/\/www.junit.org\/.  Erich Gamma and Kent Beck. 2012. JUnit. Retrieved August 7 2014 from http:\/\/www.junit.org\/."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSEET.2010.40"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/563340.563446"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of WEB98","author":"Hiltz Starr R.","year":"1998"},{"key":"e_1_2_1_36_1","unstructured":"Marc R. Hoffmann. 2012. EclEmma. Retrieved August 8 2014 from http:\/\/www.eclemma.org\/.  Marc R. Hoffmann. 2012. EclEmma. Retrieved August 8 2014 from http:\/\/www.eclemma.org\/."},{"key":"e_1_2_1_37_1","volume-title":"Rational Functional Tester. Retrieved","author":"IBM.","year":"2014"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124706.1121419"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/359369.359392"},{"key":"e_1_2_1_40_1","volume-title":"Lessons Learned in Software Testing","author":"Kaner Cem"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/FOSE.2007.13"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.7763\/IJIET.2013.V3.237"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1323651.1323656"},{"key":"e_1_2_1_44_1","volume-title":"Hilburn","author":"Lutz Michael J.","year":"2010"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/800088.802839"},{"key":"e_1_2_1_46_1","unstructured":"Aditya P. Mathur. 2008. Foundations of Software Testing. Pearson Education Delhi India.   Aditya P. Mathur. 2008. Foundations of Software Testing. Pearson Education Delhi India."},{"key":"e_1_2_1_47_1","volume-title":"Using Testing Tools in Visual Studio Professional Edition. Retrieved","author":"Microsoft Corporation","year":"2014"},{"key":"e_1_2_1_48_1","volume-title":"Art of Software Testing","author":"Myers Glenford J.","edition":"2"},{"key":"e_1_2_1_49_1","volume-title":"Kutner","author":"Neter John","year":"1990"},{"key":"e_1_2_1_50_1","volume-title":"Effective Methods for Software Testing","author":"Perry William","edition":"3"},{"key":"e_1_2_1_51_1","volume-title":"Atlee","author":"Pfleeger Shari Lawrence","year":"2009"},{"key":"e_1_2_1_52_1","volume-title":"Fox","author":"Ram\u00edrez Alex","year":"2011"},{"key":"e_1_2_1_53_1","volume-title":"Moving OCUnit tests between Logic and Application tests. Retrieved","year":"2014"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/376134.376180"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the WASET International Conference on Computer and Information Technology (ICCIT \u201909)","author":"Shim Charlie Y.","year":"2009"},{"key":"e_1_2_1_56_1","volume-title":"Nonparametric Statistics for the Behavioral Sciences","author":"Siegel Sidney","edition":"2"},{"key":"e_1_2_1_57_1","volume-title":"MacGregor","author":"Smith Barbara Leigh","year":"1992"},{"key":"e_1_2_1_58_1","volume-title":"SoftQual Repository of Software Testing Laboratory Courseware. Retrieved","author":"Software Quality Engineering Research Group (SoftQual). 2012.","year":"2014"},{"key":"e_1_2_1_59_1","volume-title":"Software Engineering","author":"Sommerville Ian","edition":"7"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2009.61"},{"key":"e_1_2_1_61_1","volume-title":"The Research Methods Knowledge Base","author":"Trochim William","edition":"2"},{"key":"e_1_2_1_62_1","volume-title":"Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics","author":"Tullis Tom"},{"key":"e_1_2_1_63_1","volume-title":"Simple Web Automation Toolkit. Retrieved","author":"Software Ultimate","year":"2014"},{"key":"e_1_2_1_64_1","volume-title":"List of Software Bugs. Retrieved","year":"2014"},{"key":"e_1_2_1_65_1","volume-title":"Software Engineering: Testing. OpenSeminar. Retrieved","author":"Williams Laurie","year":"2010"},{"key":"e_1_2_1_66_1","volume-title":"Experimentation in Software Engineering: An Introduction","author":"Wohlin Claes"},{"key":"e_1_2_1_67_1","volume-title":"WReSTT: Web-based Repository of Software Testing Tools. Retrieved","author":"Team STT","year":"2014"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2648787","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2648787","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:19:18Z","timestamp":1750231158000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2648787"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,10,27]]},"references-count":66,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,11,3]]}},"alternative-id":["10.1145\/2648787"],"URL":"https:\/\/doi.org\/10.1145\/2648787","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,10,27]]},"assertion":[{"value":"2012-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-10-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}