{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,24]],"date-time":"2025-08-24T01:27:43Z","timestamp":1755998863352,"version":"3.41.0"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2008,9,1]],"date-time":"2008-09-01T00:00:00Z","timestamp":1220227200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2008,9]]},"abstract":"<jats:p>Visual dataflow languages (VDFLs), which include commercial and research systems, have had a substantial impact on end-user programming. Like any other programming languages, whether visual or textual, VDFLs often contain faults. A desire to provide programmers of these languages with some of the benefits of traditional testing methodologies has been the driving force behind our effort in this work. In this article we introduce, in the context of prograph, a testing methodology for VDFLs based on structural test adequacy criteria and coverage. This article also reports on the results of two empirical studies. The first study was conducted to obtain meaningful information about, in particular, the effectiveness of our all-Dus criteria in detecting a reasonable percentage of faults in VDFLs. The second study was conducted to evaluate, under the same criterion, the effectiveness of our methodology in assisting users to visually localize faults by reducing their search space. Both studies were conducted using a testing system that we have implemented in Prograph's IDE.<\/jats:p>","DOI":"10.1145\/1391984.1391985","type":"journal-article","created":{"date-parts":[[2008,10,7]],"date-time":"2008-10-07T12:48:29Z","timestamp":1223383709000},"page":"1-40","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Unit-level test adequacy criteria for visual dataflow languages and a testing methodology"],"prefix":"10.1145","volume":"18","author":[{"given":"Marcel R.","family":"Karam","sequence":"first","affiliation":[{"name":"American University of Beirut, New York, NY"}]},{"given":"Trevor J.","family":"Smedley","sequence":"additional","affiliation":[{"name":"Dalhousie University"}]},{"given":"Sergiu M.","family":"Dascalu","sequence":"additional","affiliation":[{"name":"University of Nevada Reno"}]}],"member":"320","published-online":{"date-parts":[[2008,10,7]]},"reference":[{"volume-title":"Proceedings of the 6th IEEE International Symposium on Software Reliability Engineering. 143--151","author":"Agrawal H.","key":"e_1_2_1_1_1","unstructured":"Agrawal , H. , Horgan , J. , London , S. , and Wong , W . 1995. Fault localization using execution slices and dataflow tests . In Proceedings of the 6th IEEE International Symposium on Software Reliability Engineering. 143--151 . Agrawal, H., Horgan, J., London, S., and Wong, W. 1995. Fault localization using execution slices and dataflow tests. In Proceedings of the 6th IEEE International Symposium on Software Reliability Engineering. 143--151."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/1177220"},{"volume-title":"Proceedings of the 4th International Symposium on Software Reliability Engineering. 318--327","author":"Azem A.","key":"e_1_2_1_3_1","unstructured":"Azem , A. , Belli , F. , Jack , O. , and Jedrzejowicz , P . 1993. Testing and reliability of logic programs . In Proceedings of the 4th International Symposium on Software Reliability Engineering. 318--327 . Azem, A., Belli, F., Jack, O., and Jedrzejowicz, P. 1993. Testing and reliability of logic programs. In Proceedings of the 4th International Symposium on Software Reliability Engineering. 318--327."},{"volume-title":"Proceedings of the 6th IEEE International Symposium on Software Reliability Engineering. IEEE Computer Society","author":"Belli F.","key":"e_1_2_1_4_1","unstructured":"Belli , F. and Jack , O . 1995. A Test coverage notion for logic programming . In Proceedings of the 6th IEEE International Symposium on Software Reliability Engineering. IEEE Computer Society , Los Alamitos, CA, 133--142. Belli, F. and Jack, O. 1995. A Test coverage notion for logic programming. In Proceedings of the 6th IEEE International Symposium on Software Reliability Engineering. IEEE Computer Society, Los Alamitos, CA, 133--142."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/192309.192361"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/2117976.2118082"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/99.338768"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.24700"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/001872087501700602"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1976.233817"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.41326"},{"volume-title":"proceedings of the 6th International Symposium on Software Reliability Engineering. 124--132","author":"Del Frate F.","key":"e_1_2_1_12_1","unstructured":"Del Frate , F. , Garg , P. , Mathur , A. , and Pasquini , A . 1995. On the correlation between code coverage and software reliability . In proceedings of the 6th International Symposium on Software Reliability Engineering. 124--132 . Del Frate, F., Garg, P., Mathur, A., and Pasquini, A. 1995. On the correlation between code coverage and software reliability. In proceedings of the 6th International Symposium on Software Reliability Engineering. 124--132."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the International Lisp Conference","author":"Fisk D.","year":"2003","unstructured":"Fisk , D. 2003 . Full metal jacket: A pure visual dataflow language built on top of Lisp . In Proceedings of the International Lisp Conference . New York, NY, 232--238. Fisk, D. 2003. Full metal jacket: A pure visual dataflow language built on top of Lisp. In Proceedings of the International Lisp Conference. New York, NY, 232--238."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.238581"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the IEE Conference on Software Tools. 72--79","author":"Frankl P.","year":"1985","unstructured":"Frankl , P. , Weiss , S. , Weyuker , E. J. 1985 . ASSET: A system to select and evaluate tests . In Proceedings of the IEE Conference on Software Tools. 72--79 . Frankl, P., Weiss, S., Weyuker, E. J. 1985. ASSET: A system to select and evaluate tests. In Proceedings of the IEE Conference on Software Tools. 72--79."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.6194"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvlc.1996.0009"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1689(199606)6:2<83::AID-STVR112>3.0.CO;2-9"},{"volume-title":"Proceedings of the Conference on Software Maintenance. 362--367","author":"Harrold M. J.","key":"e_1_2_1_19_1","unstructured":"Harrold , M. J. and Soffa , M. L . 1988. An incremental approach to unit testing during maintenance . In Proceedings of the Conference on Software Maintenance. 362--367 . Harrold, M. J. and Soffa, M. L. 1988. An incremental approach to unit testing during maintenance. In Proceedings of the Conference on Software Maintenance. 362--367."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/77606.77608"},{"volume-title":"Proceedings of the 16th International Conference on Software Engineering. 191--200","author":"Hutchins M.","key":"e_1_2_1_21_1","unstructured":"Hutchins , M. , Foster , H. , Goradia , T. , and Ostrand , T . 1994. Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria . In Proceedings of the 16th International Conference on Software Engineering. 191--200 . Hutchins, M., Foster, H., Goradia, T., and Ostrand, T. 1994. Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Engineering. 191--200."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/581339.581397"},{"volume-title":"Proceedings of the IEEE Symposia on Human Centric Computing Languages and Environments. 280--287","author":"Karam M. R.","key":"e_1_2_1_23_1","unstructured":"Karam , M. R. and Smedley , T. J . 2001. A testing methodology for a dataflow-based visual programming language . In Proceedings of the IEEE Symposia on Human Centric Computing Languages and Environments. 280--287 . Karam, M. R. and Smedley, T. J. 2001. A testing methodology for a dataflow-based visual programming language. In Proceedings of the IEEE Symposia on Human Centric Computing Languages and Environments. 280--287."},{"volume-title":"Proceedings of the International Conference on Internet and Web Applications and Services. Guadeloupe, French Caribbean, IEEE Computer Society Press, 196\/1--6.","author":"Karam M.","key":"e_1_2_1_24_1","unstructured":"Karam , M. , Boulos , J. , Ollaic , H. , and Koteiche , Z . 2006. XQueryViz: a visual dataflow XQuery tool . In Proceedings of the International Conference on Internet and Web Applications and Services. Guadeloupe, French Caribbean, IEEE Computer Society Press, 196\/1--6. Karam, M., Boulos, J., Ollaic, H., and Koteiche, Z. 2006. XQueryViz: a visual dataflow XQuery tool. In Proceedings of the International Conference on Internet and Web Applications and Services. Guadeloupe, French Caribbean, IEEE Computer Society Press, 196\/1--6."},{"volume-title":"A visual programming environment for functional languages. Ph. D. Thesis","author":"Kelso J.","key":"e_1_2_1_25_1","unstructured":"Kelso J. 2002. A visual programming environment for functional languages. Ph. D. Thesis . Murdoch University , Australia . Kelso J. 2002. A visual programming environment for functional languages. Ph. D. Thesis. Murdoch University, Australia."},{"key":"e_1_2_1_26_1","unstructured":"Kimura T. D. Choi J. W. and Mack J. M. 1990. Show and tell: a visual programming language. In E. P. Glinert Ed. Visual Progrmming Environments. IEEE Computer Society Press 397--404.  Kimura T. D. Choi J. W. and Mack J. M. 1990. Show and tell: a visual programming language. In E. P. Glinert Ed. Visual Progrmming Environments. IEEE Computer Society Press 397--404."},{"volume-title":"Proceedings of the International Conference and Workshop on Interoperating Geographic Information Systems.","author":"Kuhn W.","key":"e_1_2_1_27_1","unstructured":"Kuhn , W. and Frank , A. U . 1997. The use of functional programming in the specification and testing process . In Proceedings of the International Conference and Workshop on Interoperating Geographic Information Systems. Kuhn, W. and Frank, A. U. 1997. The use of functional programming in the specification and testing process. In Proceedings of the International Conference and Workshop on Interoperating Geographic Information Systems."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1983.236871"},{"volume-title":"Proceedings of the 2nd Conference on Software Development Tools. Techniques and Alternatives, 34--37","author":"Korel B.","key":"e_1_2_1_29_1","unstructured":"Korel , B. and Laski , J . 1985. A tool for data flow oriented program testing . In Proceedings of the 2nd Conference on Software Development Tools. Techniques and Alternatives, 34--37 . Korel, B. and Laski, J. 1985. A tool for data flow oriented program testing. In Proceedings of the 2nd Conference on Software Development Tools. Techniques and Alternatives, 34--37."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1065010.1065014"},{"volume-title":"Proceedings of the 3rd International Symposium on Software Reliability Engineering. 104--113","author":"Luo G.","key":"e_1_2_1_31_1","unstructured":"Luo , G. , Bochmann , G. , Sarikaya , B. , and Boyer , M . 1992. Control-flow based testing of Prolog programs . In Proceedings of the 3rd International Symposium on Software Reliability Engineering. 104--113 . Luo, G., Bochmann, G., Sarikaya, B., and Boyer, M. 1992. Control-flow based testing of Prolog programs. In Proceedings of the 3rd International Symposium on Software Reliability Engineering. 104--113."},{"key":"e_1_2_1_32_1","unstructured":"Marten#8482;. 2007. http:\/\/www.andescotia.com.  Marten#8482;. 2007. http:\/\/www.andescotia.com."},{"key":"e_1_2_1_33_1","unstructured":"Meyer M. R. and Masterson T. 2000. Towards a better visual programming language: critiquing Prograph's control structures. In Proceedings of the 5th annual CCSC Northeastern Conference on The Journal of Computing in Small Colleges. 181--193.   Meyer M. R. and Masterson T. 2000. Towards a better visual programming language: critiquing Prograph's control structures. In Proceedings of the 5th annual CCSC Northeastern Conference on The Journal of Computing in Small Colleges. 181--193."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/2347.2349"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1984.5010308"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-024X(199602)26:2%3C165::AID-SPE5%3E3.0.CO;2-K"},{"volume-title":"Proceedings of the 2nd International Workshop on Automated and Algorithmic Debugging. 249--260","author":"Ouabdesselam F.","key":"e_1_2_1_37_1","unstructured":"Ouabdesselam , F. and Parissis , I . 1995. Testing techniques for dataflow synchronous programs . In Proceedings of the 2nd International Workshop on Automated and Algorithmic Debugging. 249--260 . Ouabdesselam, F. and Parissis, I. 1995. Testing techniques for dataflow synchronous programs. In Proceedings of the 2nd International Workshop on Automated and Algorithmic Debugging. 249--260."},{"volume-title":"Transducers &amp","author":"Paton B. E.","key":"e_1_2_1_38_1","unstructured":"Paton , B. E. 1998. Sensors , Transducers &amp ; LabView, Prentice Hall. Paton, B. E. 1998. Sensors, Transducers &amp; LabView, Prentice Hall."},{"key":"e_1_2_1_39_1","first-page":"13","article-title":"Adequate testing and object-oriented programming","volume":"2","author":"Perry D. E.","year":"1990","unstructured":"Perry , D. E. and Kaiser , G. E. 1990 . Adequate testing and object-oriented programming . J. Object-Oriented Prog. 2 , 5, 13 -- 19 . Perry, D. E. and Kaiser, G. E. 1990. Adequate testing and object-oriented programming. J. Object-Oriented Prog. 2, 5, 13--19.","journal-title":"J. Object-Oriented Prog."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1985.232226"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/248233.248262"},{"volume-title":"Proceedings of the 20th International Conference on Software Engineering (ICSE'98)","author":"Rothermel G.","key":"e_1_2_1_42_1","unstructured":"Rothermel , G. , Li , L. , Dupuis , C. , and Burnett , M . 1998. What you see is what you test: A methodology for testing form-based visual programs . In Proceedings of the 20th International Conference on Software Engineering (ICSE'98) . IEEE Press, Los Alamitos, CA, 198--207. Rothermel, G., Li, L., Dupuis, C., and Burnett, M. 1998. What you see is what you test: A methodology for testing form-based visual programs. In Proceedings of the 20th International Conference on Software Engineering (ICSE'98). IEEE Press, Los Alamitos, CA, 198--207."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/366378.366385"},{"key":"e_1_2_1_44_1","unstructured":"Shafer D. 1994. The Power of Prograph CPX The Reader Network.  Shafer D. 1994. The Power of Prograph CPX The Reader Network."},{"key":"e_1_2_1_45_1","volume-title":"Designing the User Interface: Strategies for Effective Human-Computer Interaction","author":"Shneiderman B.","unstructured":"Shneiderman , B. 1998. Designing the User Interface: Strategies for Effective Human-Computer Interaction , 3 rd ed. Addison-Wesley, Reading , MA. Shneiderman, B. 1998. Designing the User Interface: Strategies for Effective Human-Computer Interaction, 3rd ed. Addison-Wesley, Reading, MA.","edition":"3"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1984.5010248"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/15550.15553"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.241773"},{"volume-title":"Proceedings of the 6th International Workshop on Software Specification and Design. 120--129","author":"Wing J. M.","key":"e_1_2_1_49_1","unstructured":"Wing , J. M. , and Zaremski , A. M . 1991. A formal specification of a visual language editor . In Proceedings of the 6th International Workshop on Software Specification and Design. 120--129 . Wing, J. M., and Zaremski, A. M. 1991. A formal specification of a visual language editor. In Proceedings of the 6th International Workshop on Software Specification and Design. 120--129."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/225014.225018"},{"volume-title":"Proceedings of the 11th International Symposium on Visual Languages. 187--194","author":"Woodruff A.","key":"e_1_2_1_51_1","unstructured":"Woodruff , A. and Stonebraker , M . 1995. Buffering of intermediate results in dataflow diagrams . In Proceedings of the 11th International Symposium on Visual Languages. 187--194 . Woodruff, A. and Stonebraker, M. 1995. Buffering of intermediate results in dataflow diagrams. In Proceedings of the 11th International Symposium on Visual Languages. 187--194."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvlc.1997.0047"},{"volume-title":"Proceedings of the IEEE Symposium on Visual Languages. 284--291","author":"Zhang D. Q.","key":"e_1_2_1_53_1","unstructured":"Zhang , D. Q. and Zhang , K . 1997. Reserved graph grammar: A specification tool for diagrammatic VPLs . In Proceedings of the IEEE Symposium on Visual Languages. 284--291 . Zhang, D. Q. and Zhang, K. 1997. Reserved graph grammar: A specification tool for diagrammatic VPLs. In Proceedings of the IEEE Symposium on Visual Languages. 284--291."}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1391984.1391985","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1391984.1391985","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:58:05Z","timestamp":1750255085000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1391984.1391985"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,9]]},"references-count":53,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2008,9]]}},"alternative-id":["10.1145\/1391984.1391985"],"URL":"https:\/\/doi.org\/10.1145\/1391984.1391985","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"type":"print","value":"1049-331X"},{"type":"electronic","value":"1557-7392"}],"subject":[],"published":{"date-parts":[[2008,9]]},"assertion":[{"value":"2006-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2007-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-10-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}