{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:19:41Z","timestamp":1740122381862,"version":"3.37.3"},"reference-count":117,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2019,12,28]],"date-time":"2019-12-28T00:00:00Z","timestamp":1577491200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,12,28]],"date-time":"2019-12-28T00:00:00Z","timestamp":1577491200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2020,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The graphical nature of prominent modelling notations, such as the standards UML and SysML, enables them to tap into the cognitive benefits of diagrams. However, these notations hardly exploit the cognitive potential of diagrams and are only partially graphical with invariants and operations being expressed textually. The Visual Contract Language (VCL) aims at improving visual modelling; it tries to (a) maximise diagrammatic cognitive effectiveness, (b) increase visual expressivity, and (c) level of rigour and formality. It is an alternative to UML that does largely pictorially what is traditionally done textually. The paper presents the results of a controlled experiment carried out four times in different academic settings and involving 43 participants, which compares VCL against UML and OCL and whose goal is to provide insight on benefits and limitations of visual modelling. The paper\u2019s hypotheses are evaluated using a crossover design with the following tasks: (i) modelling of state space, invariants and operations, (ii) comprehension of modelled problem, (iii) detection of model defects and (iv) comprehension of a given model. Although visual approaches have been used and advocated for decades, this is the first empirical investigation looking into the effects of graphical expression of invariants and operations on modelling and model usage tasks. Results suggest VCL benefits in defect detection, model comprehension, and modelling of operations, providing some empirical evidence on the benefits of graphical software design.<\/jats:p>","DOI":"10.1007\/s10664-019-09784-9","type":"journal-article","created":{"date-parts":[[2019,12,28]],"date-time":"2019-12-28T09:02:10Z","timestamp":1577523730000},"page":"1205-1258","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["An experimental scrutiny of visual design modelling: VCL up against UML+OCL"],"prefix":"10.1007","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8751-5039","authenticated-orcid":false,"given":"Nuno","family":"Am\u00e1lio","sequence":"first","affiliation":[]},{"given":"Lionel","family":"Briand","sequence":"additional","affiliation":[]},{"given":"Pierre","family":"Kelsen","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2019,12,28]]},"reference":[{"key":"9784_CR1","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511624162","volume-title":"The B book: assigning meaning to programs","author":"JR Abrial","year":"1996","unstructured":"Abrial JR (1996) The B book: assigning meaning to programs. Cambridge University Press, Cambridge"},{"issue":"3","key":"9784_CR2","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1037\/1082-989X.10.3.317","volume":"10","author":"J Algina","year":"2005","unstructured":"Algina J, Keselman HJ, Penfield RD (2005) An alternative to cohen\u2019s standardized mean difference effect size: a robust parameter and confidence interval in the two independent groups case. Psychol Methods 10(3):317\u2013328","journal-title":"Psychol Methods"},{"issue":"3","key":"9784_CR3","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1007\/s10270-012-0293-5","volume":"13","author":"S Ali","year":"2014","unstructured":"Ali S, Yue T, Briand L (2014) Does aspect-oriented modeling help improve the readability of UML state machines? Softw Syst Model 13(3):1189\u20131221","journal-title":"Softw Syst Model"},{"key":"9784_CR4","doi-asserted-by":"crossref","unstructured":"Am\u00e1lio N (2007) Generative frameworks for rigorous model-driven development. Ph.D. thesis, Dept. Computer Science, Univ. of York","DOI":"10.1016\/j.entcs.2007.09.002"},{"key":"9784_CR5","unstructured":"Am\u00e1lio N (2011) VCL model of the secure simple bank case study. Tech. Rep. TR-LASSY-11-05, Univ. of Luxembourg. http:\/\/bit.ly\/q1LrPj"},{"key":"9784_CR6","unstructured":"Am\u00e1lio N (2012) The VCL model of the Barbados crisis management system. Tech. Rep. TR-LASSY-12-09, Univ. of Luxembourg. http:\/\/bit.ly\/W5C8ZY"},{"key":"9784_CR7","unstructured":"Am\u00e1lio N (2019) Sound and relaxed behavioural inheritance. In: Adamatzky A, Kendon V (eds) From astrophysics to unconventional computation: essays presented to Susan Stepney on the occasion of her 60th birthday, emergence, complexity and computation, vol 35. Springer, pp 255\u2013298"},{"key":"9784_CR8","unstructured":"Am\u00e1lio N, Briand L, Kelsen P (2013) An empirical evaluation of visualisation in software design modelling: the VCL vs UML+OCL experiment. Tech. Rep. TR-LASSY-13-05, LASSY, Univ. of Luxembourg. http:\/\/bit.ly\/2uVXGkz"},{"key":"9784_CR9","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.scico.2014.05.002","volume":"98 Part 1","author":"N Am\u00e1lio","year":"2015","unstructured":"Am\u00e1lio N, Glodt C (2015) A tool for visual and formal modelling of software designs. Sci Comput Program 98 Part 1:52\u201379. https:\/\/doi.org\/10.1016\/j.scico.2014.05.002","journal-title":"Sci Comput Program"},{"key":"9784_CR10","doi-asserted-by":"crossref","unstructured":"Am\u00e1lio N, Glodt C, Kelsen P (2011) Building VCL models and automatically generating Z specifications from them. In: FM. Springer","DOI":"10.1007\/978-3-642-21437-0_13"},{"issue":"3","key":"9784_CR11","first-page":"3","volume":"279","author":"N Am\u00e1lio","year":"2011","unstructured":"Am\u00e1lio N, Glodt C, Pinto F, Kelsen P (2011) Platform-variant applications from platform-independent models via templates. ENTCS 279(3):3\u201325","journal-title":"ENTCS"},{"key":"9784_CR12","unstructured":"Am\u00e1lio N, Kelsen P (2010) Modular design by contract visually and formally using VCL. In: VL\/HCC 2010"},{"key":"9784_CR13","unstructured":"Am\u00e1lio N, Kelsen P (2010) VCL, a visual language for abstract specification of software systems formally and modularly (short paper). In: Diagrams 2010, LNAI, vol 6170. Springer"},{"key":"9784_CR14","doi-asserted-by":"crossref","unstructured":"Am\u00e1lio N, Kelsen P, Ma Q (2010) Specifying structural properties and their constraints formally, visually and modularly using VCL. In: EMMSAD 2010, LNBIP, vol 50. Springer, pp 261\u2013273","DOI":"10.1007\/978-3-642-13051-9_22"},{"key":"9784_CR15","first-page":"151","volume":"VII","author":"N Am\u00e1lio","year":"2010","unstructured":"Am\u00e1lio N, Kelsen P, Ma Q, Glodt C (2010) Using VCL as an aspect-oriented approach to requirements modelling. TAOSD VII:151\u2013199","journal-title":"TAOSD"},{"key":"9784_CR16","doi-asserted-by":"crossref","unstructured":"Am\u00e1lio N, Payne R, Cavalcanti A, Woodcock J (2016) Checking sysML models for co-simulation. In: ICFEM 2016, LNCS, vol 10009. Springer","DOI":"10.1007\/978-3-319-47846-3_28"},{"key":"9784_CR17","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1007\/11415787_16","volume-title":"ZB 2005: Formal Specification and Development in Z and B","author":"Nuno Am\u00e1lio","year":"2005","unstructured":"Am\u00e1lio N, Polack F, Stepney S (2005) An object-oriented structuring for Z based on views. In: ZB 2005, LNCS, vol 3455, pp 262\u2013278"},{"key":"9784_CR18","doi-asserted-by":"crossref","unstructured":"Am\u00e1lio N, Polack F, Stepney S (2006) UML+Z: augmenting UML with Z. In: Abrias H, Frappier M (eds) Methods, software specification, ISTE, pp 81\u2013102","DOI":"10.1002\/9780470612514.ch5"},{"key":"9784_CR19","doi-asserted-by":"crossref","unstructured":"Am\u00e1lio N, Stepney S, Polack F (2004) Formal proof from UML models. In: Proc. ICFEM 2004, LNCS, vol 3308. Springer, pp 418\u2013433","DOI":"10.1007\/978-3-540-30482-1_35"},{"issue":"6","key":"9784_CR20","first-page":"365","volume":"32","author":"E Arisholm","year":"2006","unstructured":"Arisholm E, Briand L, Hove SE, Labiche Y (2006) The impact of UML documentation on software maintenance: an experimental evaluation. IEEE TSE 32 (6):365\u2013381","journal-title":"IEEE TSE"},{"issue":"8","key":"9784_CR21","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1109\/TSE.2004.43","volume":"30","author":"E Arisholm","year":"2004","unstructured":"Arisholm E, Sj\u00f8berg DI (2004) Evaluating the effect of a delegated versus centralized control style on the maintainability of object-oriented software. IEEE Trans Softw Eng 30(8):521\u2013534","journal-title":"IEEE Trans Softw Eng"},{"issue":"1","key":"9784_CR22","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"Y Benjamini","year":"1995","unstructured":"Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B 57(1):289\u2013300","journal-title":"Journal of the Royal Statistical Society. Series B"},{"issue":"4","key":"9784_CR23","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.1214\/aos\/1013699998","volume":"29","author":"Y Benjamini","year":"2001","unstructured":"Benjamini Y, Yekutieli D (2001) The control of the false discovery rate in multiple testing under dependency. The Annals of Statistics 29(4):1165\u20131188","journal-title":"The Annals of Statistics"},{"key":"9784_CR24","doi-asserted-by":"crossref","unstructured":"Blackwell A, Britton C, Cox A, Green T, Gurr C, Kadoda G, Kutar M, Loomes M, Nehaniv C, Petre M, Roast C, Roes C, Wong A, Young R (2001) Cognitive dimensions of notations: design tools for cognitive technology. Cognitive Technology, pp 325\u2013341","DOI":"10.1007\/3-540-44617-6_31"},{"key":"9784_CR25","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1023\/A:1006689708296","volume":"15","author":"AF Blackwell","year":"2001","unstructured":"Blackwell AF, Whitley KN, Good J, Petre M (2001) Cognitive factors in programming with diagrams. Artificial Intell Rev 15:95\u2013114","journal-title":"Artificial Intell Rev"},{"key":"9784_CR26","unstructured":"Booch G (1994) Object-oriented analysis and design with applications. Addison-Wesley"},{"key":"9784_CR27","unstructured":"Bottoni P, Koch M, Parisi-Presicce F, Taentzer G (2001) A visualisation of OCL using collaborations. In: UML 2001, LNCS, vol 2185. Springer, pp 257\u2013271"},{"key":"9784_CR28","doi-asserted-by":"crossref","unstructured":"Briand L, Labiche Y, Madrazo-Rivera R (2011) An experimental evaluation of the impact of system sequence diagrams and system operation contracts on the quality of the domain model. In: Empirical software engineering and measurement. IEEE","DOI":"10.1109\/ESEM.2011.24"},{"issue":"10","key":"9784_CR29","first-page":"833","volume":"31","author":"L Briand","year":"2005","unstructured":"Briand L, Labiche Y, Penta MD, Yan-Bondoc H (2005) An experimental investigation of formality in UML-based development. IEEE TSE 31(10):833\u2013849","journal-title":"IEEE TSE"},{"key":"9784_CR30","unstructured":"Chen PCH (2004) Why diagrams are (sometimes) six times easier than words: benefits beyond locational indexing. In: Diagrams 2004"},{"issue":"1","key":"9784_CR31","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1145\/320434.320440","volume":"1","author":"PPS Chen","year":"1976","unstructured":"Chen PPS (1976) The entity-relationship model\u2014toward a unified view of data. ACM Trans Database Syst 1(1):9\u201336","journal-title":"ACM Trans Database Syst"},{"key":"9784_CR32","unstructured":"Clark T, Evans A, Kent S, Brodsky S, Cook S (2000) A feasibility study in rearchitecting UML as a family of languages using a precise OO meta-modeling approach. Tech. rep."},{"key":"9784_CR33","unstructured":"Cohen J (1988) Statistical power analysis for the behavioural sciences. Lawrence Erlbaum Associates"},{"issue":"2","key":"9784_CR34","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1037\/0003-066X.49.12.997","volume":"49","author":"J Cohen","year":"1994","unstructured":"Cohen J (1994) The earth is round (p <.05). Am Psychol 49(2):997\u20131003","journal-title":"Am Psychol"},{"key":"9784_CR35","doi-asserted-by":"crossref","unstructured":"Cook S, Kleppe A, Warmer J, Mitchell R, Rumpe B, Wills AC (1999) Defining UML family members using prefaces. In: TOOLS \u201999","DOI":"10.1109\/TOOLS.1999.809418"},{"key":"9784_CR36","doi-asserted-by":"crossref","unstructured":"Cumming G (2012) Understanding the new statistics: effect sizes, confidence intervals and meta-analysis. Routledge","DOI":"10.4324\/9780203807002"},{"key":"9784_CR37","doi-asserted-by":"crossref","unstructured":"Cumming G (2013) The new statistics: why and how. Psychological Science","DOI":"10.1177\/0956797613504966"},{"issue":"4","key":"9784_CR38","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1177\/0013164401614002","volume":"61","author":"G Cumming","year":"2001","unstructured":"Cumming G, Finch S (2001) A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educ Psychol Meas 61(4):532\u2013574","journal-title":"Educ Psychol Meas"},{"issue":"3","key":"9784_CR39","doi-asserted-by":"crossref","first-page":"319","DOI":"10.2307\/249008","volume":"13","author":"FD Davis","year":"1989","unstructured":"Davis FD (1989) Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q 13(3):319\u2013340","journal-title":"MIS Q"},{"issue":"5","key":"9784_CR40","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1145\/1125944.1125949","volume":"49","author":"B Dobing","year":"2006","unstructured":"Dobing B, Parsons J (2006) How UML is used. Comunications of the ACM 49(5):109\u2013113","journal-title":"Comunications of the ACM"},{"key":"9784_CR41","first-page":"23","volume":"152","author":"K Ehrig","year":"2006","unstructured":"Ehrig K, Winkelmann J (2006) Model transformation from visual OCL to OCL using graph transformation. ENTCS 152:23\u201337","journal-title":"ENTCS"},{"key":"9784_CR42","unstructured":"Evans A, France R, Lano K, Rumpe B (1998) The UML as a formal modeling notation. In: UML\u201998, LNCS, vol 1618. Springer, pp 336\u2013348"},{"key":"9784_CR43","doi-asserted-by":"crossref","unstructured":"Falessi D, Juristo N, Wohlin C, Turhan B, M\u00fcnch J, Jedlitschka A, Oivo M (2017) Empirical software engineering experts on the use of students and professionals in experiments. Empirical Software Engineering","DOI":"10.1007\/s10664-017-9523-3"},{"key":"9784_CR44","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/978-3-642-33666-9_15","volume-title":"Model Driven Engineering Languages and Systems","author":"Kleinner Farias","year":"2012","unstructured":"Farias K, Garcia A, Lucena C (2012) Evaluating the impact of aspects on inconsistency detection effort: a controlled experiment. In: Models 2012, LNCS, vol 7590, pp 219\u2013234"},{"key":"9784_CR45","unstructured":"Farias K, Garcia A, Whittle J (2012) Assessing the impact of aspects on model composition effort. In: ACM (ed) AOSD 2010, pp 73\u201384"},{"issue":"4306","key":"9784_CR46","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1126\/science.197.4306.827","volume":"197","author":"E. S. Ferguson","year":"1977","unstructured":"Ferguson ES (1977) The mind\u2019s eye: nonverbal thought in technology. Science 197(4306)","journal-title":"Science"},{"key":"9784_CR47","unstructured":"Ferguson ES (1992) Engineering and the mind\u2019s eye. MIT Press"},{"key":"9784_CR48","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1016\/j.jvlc.2005.03.001","volume":"16","author":"A Fish","year":"2005","unstructured":"Fish A, Flower J, Howse J (2005) The semantics of augmented constraint diagrams. J Vis Lang Comput 16:541\u2013573","journal-title":"J Vis Lang Comput"},{"issue":"2","key":"9784_CR49","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1109\/MC.2006.65","volume":"39","author":"R France","year":"2006","unstructured":"France R, Ghosh S, Dinh-Trong T (2006) Model-driven development using UML 2.0: promises and pitfalls. IEEE Computer 39(2):59\u201366","journal-title":"IEEE Computer"},{"issue":"3","key":"9784_CR50","doi-asserted-by":"crossref","first-page":"395","DOI":"10.3758\/s13423-012-0230-1","volume":"19","author":"VH Franz","year":"2012","unstructured":"Franz VH, Loftus GR (2012) Standard errors and confidence intervals in within-subjects designs: Generalizing loftus and masson (1994) and avoiding the biases of alternative accounts. Psychonomic Bulletin & Review 19(3):395\u2013404","journal-title":"Psychonomic Bulletin & Review"},{"issue":"6","key":"9784_CR51","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/52.329400","volume":"11","author":"RL Glass","year":"1994","unstructured":"Glass RL (1994) The software-research crisis. IEEE Softw 11(6):42\u201347","journal-title":"IEEE Softw"},{"issue":"2","key":"9784_CR52","doi-asserted-by":"crossref","first-page":"584","DOI":"10.3758\/BF03201085","volume":"24","author":"P Golkasian","year":"1996","unstructured":"Golkasian P (1996) Picture-word differences in a sentence verification task. Memory & Cognition 24(2):584\u2013594","journal-title":"Memory & Cognition"},{"issue":"4","key":"9784_CR53","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1080\/00221300009598596","volume":"127","author":"P Goolkasian","year":"2000","unstructured":"Goolkasian P (2000) Pictures, words, and sounds: from which format are we best able to reason? J Gen Psychol 127(4):439\u2013459","journal-title":"J Gen Psychol"},{"key":"9784_CR54","unstructured":"Green TR (1989) Cognitive dimensions of notations. In: Sutcliffe A, Macaulay L (eds) People and computers V. Cambridge University Press, pp 443\u2013460"},{"key":"9784_CR55","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1006\/jvlc.1996.0009","volume":"7","author":"TRG Green","year":"1996","unstructured":"Green TRG, Petre M (1996) Usability analysis of visual programming environments: a cognitive dimensions framework. J Visual Lang Comput 7:131\u2013174","journal-title":"J Visual Lang Comput"},{"issue":"2","key":"9784_CR56","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1037\/0033-2909.83.2.314","volume":"83","author":"AG Greenwald","year":"1976","unstructured":"Greenwald AG (1976) Within-subjects designs: to use or not to use? Psychol Bull 83(2):314\u2013320","journal-title":"Psychol Bull"},{"key":"9784_CR57","unstructured":"Grissom RJ, Kim JJ (2005) Effect sizes for research: a broad practical approach. Lawrence Erlbaum Associates"},{"key":"9784_CR58","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/0167-6423(87)90035-9","volume":"8","author":"D Harel","year":"1987","unstructured":"Harel D (1987) Statecharts: a visual formalism for complex systems. Sci Comput Program 8:231\u2013 274","journal-title":"Sci Comput Program"},{"issue":"5","key":"9784_CR59","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1145\/42411.42414","volume":"31","author":"D Harel","year":"1988","unstructured":"Harel D (1988) On visual formalisms. Commun. of the ACM 31(5):514\u2013530","journal-title":"Commun. of the ACM"},{"issue":"1","key":"9784_CR60","first-page":"8","volume":"25","author":"D Harel","year":"1992","unstructured":"Harel D (1992) Biting the silver bullet. IEEE Softw 25(1):8\u201320","journal-title":"IEEE Softw"},{"issue":"1","key":"9784_CR61","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1007\/s10270-004-0076-8","volume":"3","author":"B Henderson-Sellers","year":"2005","unstructured":"Henderson-Sellers B (2005) UML \u2013 The good, the bad or the ugly? Perpectives from a panel of experts. Softw Syst Model 3(1):4\u201313","journal-title":"Softw Syst Model"},{"key":"9784_CR62","doi-asserted-by":"crossref","unstructured":"Henderson-Sellers B, Barbier F (1999) Black and white diamonds. In: UML\u201999, LNCS, vol 1723. Springer, pp 550\u2013565","DOI":"10.1007\/3-540-46852-8_39"},{"issue":"2","key":"9784_CR63","first-page":"65","volume":"6","author":"S Holm","year":"1979","unstructured":"Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6(2):65\u201370","journal-title":"Scand J Stat"},{"issue":"3","key":"9784_CR64","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1023\/A:1026586415054","volume":"5","author":"M H\u00f6st","year":"2000","unstructured":"H\u00f6st M, Regnell B, Wohlin C (2000) Using students as subjects \u2013 a comparative study of students and professionals in lead-time impact assessment. Empir Softw Eng 5(3):201\u2013214","journal-title":"Empir Softw Eng"},{"key":"9784_CR65","unstructured":"ISO (2002) Information technology\u2014Z formal specification notation\u2014syntax, type system and semantics. ISO\/IEC 13568:2002, Int. Standard"},{"issue":"8","key":"9784_CR66","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v020.i08","volume":"20","author":"K Kelley","year":"2007","unstructured":"Kelley K (2007) Confidence intervals for standardized effect sizes: theory, application, and implementation. J Stat Softw 20(8):1\u201324","journal-title":"J Stat Softw"},{"key":"9784_CR67","unstructured":"Kelsen P (2006) A declarative executable model for object-based systems based on functional decomposition. In: ICSOFT 2006, pp 63\u201371"},{"key":"9784_CR68","doi-asserted-by":"crossref","unstructured":"Kelsen P, Ma Q (2008) A lightweight approach for defining the formal semantics of a modeling language. In: Models 2008, LNCS, vol 5301, pp 690\u2013704","DOI":"10.1007\/978-3-540-87875-9_48"},{"issue":"6","key":"9784_CR69","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1145\/203241.203265","volume":"38","author":"YG Kim","year":"1995","unstructured":"Kim YG, March ST (1995) Comparing data formalisms. CACM 38(6):103\u2013115","journal-title":"CACM"},{"key":"9784_CR70","unstructured":"Lange CF, Chaudron MR (2006) Effects of defects in UML models \u2013 an experimental investigation. In: ICSE 2006. IEEE, pp 401\u2013410"},{"key":"9784_CR71","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1111\/j.1551-6708.1987.tb00863.x","volume":"11","author":"JH Larkin","year":"1987","unstructured":"Larkin JH, Simon HA (1987) Why a diagram is (sometimes) worth ten thousand words. Cogn Sci 11:65\u201399","journal-title":"Cogn Sci"},{"key":"9784_CR72","doi-asserted-by":"crossref","unstructured":"Leemans J, Am\u00e1lio N (2012) Modelling a cardiac pacemaker visually and formally. In: VL\/HCC 2012. IEEE, pp 257\u2013258","DOI":"10.1109\/VLHCC.2012.6344542"},{"key":"9784_CR73","unstructured":"Leemans J, Am\u00e1lio N (2012) A VCL model of a cardiac pacemaker. Tech. Rep. TR-LASSY-12-04, Univ. of Luxembourg. http:\/\/bit.ly\/xiob5d"},{"issue":"4","key":"9784_CR74","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1007\/s10270-011-0207-y","volume":"10","author":"MVC Manfred Broy","year":"2011","unstructured":"Manfred Broy MVC (2011) UML Formal semantics: lessons learned. Softw Syst Model 10(4):441\u2013446","journal-title":"Softw Syst Model"},{"issue":"10","key":"9784_CR75","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1109\/2.161279","volume":"25","author":"B Meyer","year":"1992","unstructured":"Meyer B (1992) Applying design by contract. Computer 25(10):40\u201351","journal-title":"Computer"},{"issue":"4","key":"9784_CR76","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1007\/s10270-010-0157-9","volume":"10","author":"Z Micskei","year":"2011","unstructured":"Micskei Z, Waeselynck H (2011) The many meanings of UML 2 sequence diagrams: a survey. Softw Syst Model 10(4):489\u2013514","journal-title":"Softw Syst Model"},{"key":"9784_CR77","doi-asserted-by":"crossref","unstructured":"Moody D, van Hillegersberg J (2009) Evaluating the visual syntax of UML: an analysis of the cognitive effectiveness of the UML family of diagrams. In: SLE, LNCS, vol 5452. Springer","DOI":"10.1007\/978-3-642-00434-6_3"},{"key":"9784_CR78","unstructured":"Moody DL (2002) Complexity effects on end user understanding of data models: an experimental comparison of large data model representation methods. In: ECIS 2002"},{"issue":"35","key":"9784_CR79","first-page":"756","volume":"6","author":"DL Moody","year":"2009","unstructured":"Moody DL (2009) The physics of notations: toward a scientific basis for constructing visual notations in software engineering. IEEE TSE 6(35):756\u2013779","journal-title":"IEEE TSE"},{"key":"9784_CR80","doi-asserted-by":"crossref","unstructured":"Mussbacher G, Alam O, Alhaj M, Ali S, Am\u00e1lio N, Barn B, Br\u00e6k R, Clark T, Combemale B, Cysneiros LM, Fatima U, France R, Georg G, Horkoff J, Kienzle J, Leite JC, Lethbridge TC, Luckey M, Moreira A, Mutz F, Oliveira APA, Petriu DC, Sch\u00f6ttle M, Troup L, Werneck VMB (2012) Assessing composition in modeling approaches. In: CMA \u201912. ACM","DOI":"10.1145\/2459031.2459032"},{"issue":"8","key":"9784_CR81","doi-asserted-by":"crossref","first-page":"857","DOI":"10.1002\/(SICI)1097-0258(19980430)17:8<857::AID-SIM777>3.0.CO;2-E","volume":"17","author":"RG Newcombe","year":"1998","unstructured":"Newcombe RG (1998) Two-sided confidence intervals for the single proportion: comparison of seven methods. Statistics in Medecine 17(8):857\u201372","journal-title":"Statistics in Medecine"},{"key":"9784_CR82","unstructured":"Newcombe RG, Altman DG (2000) Proportions and their differences. In: Statistics with confidence: confidence intervals and statistical guidelines. Wiley"},{"key":"9784_CR83","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1038\/506150a","volume":"506","author":"R Nuzzo","year":"2014","unstructured":"Nuzzo R (2014) Scientific method: statistical errors. Nature 506:150\u2013152","journal-title":"Nature"},{"key":"9784_CR84","unstructured":"OMG (2012) OMG Systems modeling language version 1.3. Tech. rep., OMG"},{"key":"9784_CR85","unstructured":"Oppenheim AN (1996) Questionnaire design, interviewing and attitude measurement continuum"},{"issue":"1","key":"9784_CR86","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1023\/A:1014819010099","volume":"7","author":"MC Otero","year":"2002","unstructured":"Otero MC, Dolado JJ (2002) An initial experimental assessment of the dynamic modelling in uml. Empir Softw Eng 7(1):27\u201347","journal-title":"Empir Softw Eng"},{"key":"9784_CR87","doi-asserted-by":"crossref","unstructured":"Petre M (1995) Why looking isn\u2019t always seeing. Communications of the ACM 6(38)","DOI":"10.1145\/203241.203251"},{"key":"9784_CR88","doi-asserted-by":"crossref","unstructured":"Pfister R, Janczyk M (2013) Confidence intervals for two sample means: calculation, interpretation, and a few simple rules. Advances in Cognitive Psychology","DOI":"10.5709\/acp-0133-x"},{"key":"9784_CR89","unstructured":"Pinker S, Freedle R (1990) A theory of graph comprehension. In: Artificial inteligence and the future of testing, pp 73\u2013126"},{"key":"9784_CR90","doi-asserted-by":"crossref","unstructured":"Purchase HC, Colpoys L, McGill M, Carrington D (2002) UML Collaboration diagram syntax: an empirical study of comprehension. In: VISSOFT 2002. IEEE, pp 13\u201322","DOI":"10.1109\/VISSOF.2002.1019790"},{"key":"9784_CR91","unstructured":"Purchase HC, Colpoys L, McGill M, Carrington D, Britton C (2001) UML class diagram syntax: an empirical study of comprehension. In: APVIs\u201901"},{"key":"9784_CR92","unstructured":"R Core Team R (2015) A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. https:\/\/www.R-project.org\/"},{"key":"9784_CR93","doi-asserted-by":"crossref","unstructured":"Ricca F, Penta MD, Torchiano M, Tonella P, Ceccato M (2007) The role of experience and ability in comprehension tasks supported by UML stereotypes. In: ICSE 2007. IEEE","DOI":"10.1109\/ICSE.2007.86"},{"issue":"1","key":"9784_CR94","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1109\/TSE.2009.69","volume":"36","author":"F Ricca","year":"2010","unstructured":"Ricca F, Penta MD, Torchiano M, Tonella P, Ceccato M (2010) How developers\u2019 experience and ability influence web application comprehension tasks supported by UML stereotypes: a series of four experiments. IEEE Trans Softw Eng 36(1):96\u2013118","journal-title":"IEEE Trans Softw Eng"},{"key":"9784_CR95","doi-asserted-by":"crossref","unstructured":"Richters M (2001) A precise approach to validating UML models and OCL constraints. Ph.D. thesis, Universit\u00e4t Bremen","DOI":"10.1007\/3-540-40011-7_19"},{"key":"9784_CR96","doi-asserted-by":"crossref","unstructured":"Richters M, Gogolla M (1998) On formalizing the UML object constraint language OCL. In: ER \u201998, LNCS, vol 1507. Springer, pp 449\u2013464","DOI":"10.1007\/978-3-540-49524-6_35"},{"issue":"1","key":"9784_CR97","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/TSE.1977.229900","volume":"3","author":"DT Ross","year":"1977","unstructured":"Ross DT (1977) Structured analysis (SA): a language for communicating ideas. IEEE Trans Softw Eng 3(1):16\u201334","journal-title":"IEEE Trans Softw Eng"},{"issue":"1","key":"9784_CR98","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/TSE.1977.229899","volume":"3","author":"DT Ross","year":"1977","unstructured":"Ross DT, Schoman KE (1977) Structured analysis for requirements definition. IEEE Trans Softw Eng 3(1):6\u201315","journal-title":"IEEE Trans Softw Eng"},{"key":"9784_CR99","unstructured":"Rumbaugh J, Blaha M, Permerlani W, Eddy F, Lorensen W (1991) Object oriented modelling and design. Prentice-Hall"},{"issue":"4","key":"9784_CR100","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1007\/s10270-011-0210-3","volume":"10","author":"B Rumpe","year":"2011","unstructured":"Rumpe B, France R (2011) Variability in UML language and semantics. Softw Syst Model 10(4):439\u2013 440","journal-title":"Softw Syst Model"},{"key":"9784_CR101","doi-asserted-by":"crossref","unstructured":"Salman I, Misirli AT, Juristo N (2015) Are students representatives of professionals in software engineering experiments? ICSE\u201915, pp 666\u2013676","DOI":"10.1109\/ICSE.2015.82"},{"key":"9784_CR102","doi-asserted-by":"crossref","unstructured":"Shimojima A (1996) Operational constraints in diagrammatic reasoning. In: Allwein G, Barwise J (eds) Logical reasoning with diagrams","DOI":"10.1093\/oso\/9780195104271.003.0006"},{"key":"9784_CR103","unstructured":"Sj\u00f8berg DIK, Anda B, Arisholm E, Dyba T, Jorgensen M, Karahasanovic A, Koren E, Vokac M (2002) Conducting realistic experiments in software engineering. In: International symposium on empirical software engineering (ISESE \u201902)"},{"key":"9784_CR104","volume-title":"The Z notation: a reference manual","author":"JM Spivey","year":"1992","unstructured":"Spivey JM (1992) The Z notation: a reference manual, 2nd edn. Prentice Hall, Englewood Cliffs","edition":"2nd edn."},{"issue":"5","key":"9784_CR105","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1016\/j.jss.2005.09.014","volume":"79","author":"M Staron","year":"2006","unstructured":"Staron M, Kuzniarz L, Wohlin C (2006) Empirical assessment of using stereotypes to improve comprehension of UML models: a set of experiments. J Syst Softw 79(5):727\u2013742","journal-title":"J Syst Softw"},{"issue":"1","key":"9784_CR106","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1007\/s10270-002-0002-x","volume":"1","author":"P Stevens","year":"2002","unstructured":"Stevens P (2002) On the interpretation of binary associations in the unified modelling language. Softw Syst Model 1(1):68\u201379","journal-title":"Softw Syst Model"},{"key":"9784_CR107","doi-asserted-by":"crossref","unstructured":"St\u00f6rrle H (2003) Semantics of interactions in UML 2.0. In: Human centric computing languages and environments (HCC 2003). IEEE, pp 129\u2013136","DOI":"10.1109\/HCC.2003.1260216"},{"key":"9784_CR108","doi-asserted-by":"crossref","unstructured":"Tilley S, Huang S (2003) A qualitative assessment of the efficacy of uml diagrams as a form of graphical documentation in aiding program understanding. In: SIGDOC\u201903, pp 184\u2013191","DOI":"10.1145\/944868.944908"},{"key":"9784_CR109","doi-asserted-by":"crossref","unstructured":"Tobias E, Ras E, Am\u00e1lio N (2012) Suitability of visual modelling languages for modelling tangible user interface applications. In: VL\/HCC 2012. IEEE, pp 269\u2013270","DOI":"10.1109\/VLHCC.2012.6344548"},{"key":"9784_CR110","unstructured":"Torchiano M (2004) Empirical assessment of UML static object diagrams. In: Program comprehension, 2004. IEEE"},{"key":"9784_CR111","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1007\/3-540-45832-8_28","volume-title":"Graph Transformation","author":"D\u00e1niel Varr\u00f3","year":"2002","unstructured":"Varr\u00f3 D (2002) A formal semantics of UML statecharts by model transition systems. In: ICGT 2002, LNCS. Springer, pp 378\u2013392"},{"issue":"4","key":"9784_CR112","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1145\/299917.299919","volume":"30","author":"R Wieringa","year":"1998","unstructured":"Wieringa R (1998) A survey of structured and object-oriented software specification methods and techniques. ACM Comput Surv 30(4):459\u2013527","journal-title":"ACM Comput Surv"},{"issue":"3","key":"9784_CR113","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1037\/1082-989X.8.3.254","volume":"8","author":"RR Wilcox","year":"2003","unstructured":"Wilcox RR, Keselman HJ (2003) Modern robust data analysis methods: measures of central tendency. Psychol Methods 8(3):254\u201374","journal-title":"Psychol Methods"},{"issue":"7","key":"9784_CR114","doi-asserted-by":"crossref","first-page":"1359","DOI":"10.1080\/02664763.2010.498507","volume":"38","author":"RR Wilcox","year":"2011","unstructured":"Wilcox RR, Tian TS (2011) Measuring effect size: a robust heteroscedastic approach for two or more groups. J Appl Stat 38(7):1359\u20131368","journal-title":"J Appl Stat"},{"key":"9784_CR115","unstructured":"Woodcock J, Davies J (1996) Using z: specification, refinement, and proof. Prentice-Hall"},{"issue":"1","key":"9784_CR116","first-page":"65","volume":"61","author":"KK Yuen","year":"1974","unstructured":"Yuen KK (1974) The two-sample trimmed t for unequal population variances. Biometrika 61(1):65\u2013 170","journal-title":"Biometrika"},{"issue":"2","key":"9784_CR117","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1207\/s15516709cog2102_3","volume":"21","author":"J Zhang","year":"1997","unstructured":"Zhang J (1997) The nature of external representations in problem solving. Cogn Sci 21(2):179\u2013217","journal-title":"Cogn Sci"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-019-09784-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10664-019-09784-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-019-09784-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,29]],"date-time":"2024-07-29T07:58:23Z","timestamp":1722239903000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10664-019-09784-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,28]]},"references-count":117,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,3]]}},"alternative-id":["9784"],"URL":"https:\/\/doi.org\/10.1007\/s10664-019-09784-9","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"type":"print","value":"1382-3256"},{"type":"electronic","value":"1573-7616"}],"subject":[],"published":{"date-parts":[[2019,12,28]]},"assertion":[{"value":"28 December 2019","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}