{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T23:31:12Z","timestamp":1768001472374,"version":"3.49.0"},"reference-count":87,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,2,26]],"date-time":"2019-02-26T00:00:00Z","timestamp":1551139200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"FWF","award":["I 2885-N33"],"award-info":[{"award-number":["I 2885-N33"]}]},{"name":"FFG","award":["843461"],"award-info":[{"award-number":["843461"]}]},{"DOI":"10.13039\/501100004955","name":"\u00d6sterreichische Forschungsf\u00f6rderungsgesellschaft","doi-asserted-by":"crossref","award":["864707"],"award-info":[{"award-number":["864707"]}],"id":[{"id":"10.13039\/501100004955","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2019,4,30]]},"abstract":"<jats:p>\n            This article reports a controlled experiment with 116 participants on the understandability of representative graphical and textual pattern-based behavioral constraint representations from the viewpoint of novice software designers. Particularly, graphical and textual behavioral constraint patterns present in the declarative business process language\n            <jats:italic>Declare<\/jats:italic>\n            and textual behavioral constraints based on\n            <jats:italic>Property Specification Patterns<\/jats:italic>\n            are the subjects of this study. In addition to measuring the understandability construct, this study assesses subjective aspects such as perceived difficulties regarding learning and application of the tested approaches. An interesting finding of this study is the overall low achieved correctness in the experimental tasks, which seems to indicate that pattern-based behavioral constraint representations are hard to understand for novice software designers in the absence of additional supportive measures. The results of the descriptive statistics regarding achieved correctness are slightly in favor of the textual representations, but the inference statistics do not indicate any significant differences in terms of understandability between graphical and textual behavioral constraint representations.\n          <\/jats:p>","DOI":"10.1145\/3306608","type":"journal-article","created":{"date-parts":[[2019,2,26]],"date-time":"2019-02-26T15:05:33Z","timestamp":1551193533000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["How Understandable Are Pattern-based Behavioral Constraints for Novice Software Designers?"],"prefix":"10.1145","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0043-5541","authenticated-orcid":false,"given":"Christoph","family":"Czepa","sequence":"first","affiliation":[{"name":"University of Vienna, Vienna, Austria"}]},{"given":"Uwe","family":"Zdun","sequence":"additional","affiliation":[{"name":"University of Vienna, Vienna, Austria"}]}],"member":"320","published-online":{"date-parts":[[2019,2,26]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvlc.2010.11.002"},{"key":"e_1_2_1_2_1","volume-title":"Principles of Model Checking (Representation and Mind Series)","author":"Baier Christel"},{"key":"e_1_2_1_3_1","volume-title":"Encyclopedia of Software Engineering","author":"Basili Victor R."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/logcom\/exn075"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2000799.2000800"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 34th International Conference on Software Engineering (ICSE\u201912)","author":"Bianculli D."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/FOSE.2007.17"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/647771.734431"},{"key":"e_1_2_1_10_1","volume-title":"Logics of Programs","author":"Clarke Edmund M."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.114.3.494"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/337180.337234"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Christoph Czepa Huy Tran Uwe Zdun Thanh Tran Erhard Weiss and Christoph Ruhsam. 2016. Ontology-based behavioral constraint authoring. In Proceedings of the 2nd International Workshop on Compliance Evolution and Security in Intra- and Cross-Organizational Processes (CeSCoP\u201916) and 20th IEEE International Enterprise Computing Workshops (EDOCW\u201916).  Christoph Czepa Huy Tran Uwe Zdun Thanh Tran Erhard Weiss and Christoph Ruhsam. 2016. Ontology-based behavioral constraint authoring. In Proceedings of the 2nd International Workshop on Compliance Evolution and Security in Intra- and Cross-Organizational Processes (CeSCoP\u201916) and 20th IEEE International Enterprise Computing Workshops (EDOCW\u201916).","DOI":"10.1109\/EDOCW.2016.7584380"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSA.2017.10"},{"key":"e_1_2_1_15_1","unstructured":"Christoph Czepa and Uwe Zdun. 2018. On the Understandability of Graphical and Textual Pattern-Based Behavioral Constraint Representations {Data set}.  Christoph Czepa and Uwe Zdun. 2018. On the Understandability of Graphical and Textual Pattern-Based Behavioral Constraint Representations {Data set}."},{"key":"e_1_2_1_16_1","volume-title":"On the understandability of temporal properties formalized in linear temporal logic, property specification patterns and event processing language","author":"Czepa Christoph","year":"2018"},{"key":"e_1_2_1_17_1","volume-title":"Biotools: An R function to predict spatial gene diversity via an individual-based approach. Genetics and Molecular Research 16, 2","author":"da Silva A. R.","year":"2017"},{"key":"e_1_2_1_18_1","volume-title":"Marco Grasso, Fabrizio Maria Maggi, and Marco Montali.","author":"Giacomo Giuseppe De","year":"2014"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 28th AAAI Conference on Artificial Intelligence (AAAI\u201914)","author":"Giacomo Giuseppe De","year":"2014"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 23rd International Joint Conference on Artificial Intelligence (IJCAI\u201913)","author":"Giacomo Giuseppe De"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-39696-5_6"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-09195-2_4"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/298595.298598"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/302405.302672"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-014-0395-3"},{"key":"e_1_2_1_26_1","volume-title":"Simon","author":"Anders Ericsson K.","year":"1984"},{"key":"e_1_2_1_27_1","volume-title":"Retrieved","author":"EsperTech Inc.","year":"2017"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-013-0323-y"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-012-9208-x"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00766-014-0210-2"},{"key":"e_1_2_1_31_1","volume-title":"An R Companion to Applied Regression","author":"Fox John","edition":"2"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/17517575.2013.830340"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07869-4_17"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38484-4_2"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 25th International Conference on Software Engineering (ICSE\u201903)","author":"Hatcliff J."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v057.i05"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM.2011.25"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the International Conference on the Quality of Information and Communications Technology (QUATIC\u201914)","author":"Hoisl B."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.588521"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1177\/1049732305276687"},{"key":"e_1_2_1_41_1","volume-title":"Retrieved","author":"Bryer Jason","year":"2016"},{"key":"e_1_2_1_42_1","volume-title":"Guide to Advanced Empirical Software Engineering, Forrest Shull, Janice Singer, and Dag I","author":"Jedlitschka Andreas"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3019612.3019827"},{"key":"e_1_2_1_44_1","volume-title":"Moreno","author":"Juristo Natalia","year":"2010"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-016-9437-5"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2002.1027796"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF03037383"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/3155562.3155664"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/11596141_7"},{"key":"e_1_2_1_50_1","volume-title":"On the Move to Meaningful Internet Systems (OTM\u201911), Robert Meersman, Tharam Dillon, Pilar Herrero, Akhil Kumar, Manfred Reichert, Li Qing, Beng-Chin Ooi, Ernesto Damiani, Douglas C","author":"Ly Linh Thao"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29860-8_11"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the 19th International Conference on Human Interface and the Management of Information: Supporting Learning, Decision-Making and Collaboration:","author":"Cunha Lilian Mendes"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0043158"},{"key":"e_1_2_1_54_1","doi-asserted-by":"crossref","volume-title":"Specification and Verification of Declarative Open Interaction Models: A Logic-Based Approach","author":"Montali Marco","DOI":"10.1007\/978-3-642-14538-4"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2542182.2542199"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-013-0366-0"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1600-0587.2013.00205.x"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.5555\/1781503.1781524"},{"key":"e_1_2_1_59_1","volume-title":"Retrieved","author":"OMG.","year":"2011"},{"key":"e_1_2_1_60_1","volume-title":"van der Aalst","author":"Pe\u0161i\u0107 Maja","year":"2010"},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the 11th IEEE International Enterprise Distributed Object Computing Conference (EDOC\u201907)","author":"Pesic Maja"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/11837862_18"},{"key":"e_1_2_1_63_1","volume-title":"Retrieved","author":"Filzmoser Peter","year":"2017"},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of the Business Process Management Workshops (BPM\u201911)","author":"Pichler Paul"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/SFCS.1977.32"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00766-011-0145-9"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2010.2087017"},{"key":"e_1_2_1_68_1","volume-title":"psych: Procedures for Psychological, Psychometric, and Personality Research","author":"Revelle William"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124113509605"},{"key":"e_1_2_1_70_1","unstructured":"J. J. Rogmann. 2013. Ordinal Dominance Statistics (orddom): An R Project for Statistical Computing package to compute ordinal nonparametric alternatives to mean comparison (Version 3.1). Retrieved from http:\/\/cran.r-project.org\/.  J. J. Rogmann. 2013. Ordinal Dominance Statistics (orddom): An R Project for Statistical Computing package to compute ordinal nonparametric alternatives to mean comparison (Version 3.1). Retrieved from http:\/\/cran.r-project.org\/."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.07.040"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2010.06.002"},{"key":"e_1_2_1_73_1","volume-title":"Advances in Enterprise Engineering I, Jan L","author":"Schonenberg Helen"},{"key":"e_1_2_1_74_1","volume-title":"Proceedings of the 21st International Conference on Program Comprehension (ICPC\u201913)","author":"Sharafi Z."},{"key":"e_1_2_1_75_1","volume-title":"Retrieved","author":"Jarek Slawomir","year":"2012"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/581339.581345"},{"key":"e_1_2_1_77_1","unstructured":"Thanh Tran Erhard Weiss Alexander Adensamer Christoph Ruhsam Christoph Czepa Huy Tran and Uwe Zdun. 2016. An ontology-based approach for defining compliance rules by knowledge workers in adaptive case management. In Proceedings of the 5th International Workshop on Adaptive Case Management and other Non-workflow Approaches to BPM (AdaptiveCM\u201916) and Proceedings of the 20th IEEE International Enterprise Computing Workshops (EDOCW\u201916).  Thanh Tran Erhard Weiss Alexander Adensamer Christoph Ruhsam Christoph Czepa Huy Tran and Uwe Zdun. 2016. An ontology-based approach for defining compliance rules by knowledge workers in adaptive case management. In Proceedings of the 5th International Workshop on Adaptive Case Management and other Non-workflow Approaches to BPM (AdaptiveCM\u201916) and Proceedings of the 20th IEEE International Enterprise Computing Workshops (EDOCW\u201916)."},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the 4th International Workshop on Adaptive Case Management and other Non-workflow Approaches to BPM (AdaptiveCM\u201915)","author":"Tran Thanh","year":"2015"},{"key":"e_1_2_1_79_1","volume-title":"Proceedings of the 13th International Conference on Business Process Management (BPM\u201915)","author":"Tran Thanh","year":"2015"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1007\/11841197_1"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40355-2_15"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02144-2_37"},{"key":"e_1_2_1_83_1","volume-title":"ggplot2: Elegant Graphics for Data Analysis","author":"Wickham Hadley"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.5555\/330775"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-00255-7_5"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1007\/11912873_18"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-013-0356-2"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3306608","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3306608","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:02:25Z","timestamp":1750208545000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3306608"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,26]]},"references-count":87,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,4,30]]}},"alternative-id":["10.1145\/3306608"],"URL":"https:\/\/doi.org\/10.1145\/3306608","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,26]]},"assertion":[{"value":"2018-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-02-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}