{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T07:27:37Z","timestamp":1772177257401,"version":"3.50.1"},"reference-count":50,"publisher":"Emerald","issue":"8","license":[{"start":{"date-parts":[[2023,4,5]],"date-time":"2023-04-05T00:00:00Z","timestamp":1680652800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BPMJ"],"published-print":{"date-parts":[[2023,12,18]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>Testing business processes is crucial to assess the compliance of business process models with requirements. Automating this task optimizes testing efforts and reduces human error while also providing improvement insights for the business process modeling activity. The primary purposes of this paper are to conduct a literature review of Business Process Model and Notation (BPMN) testing and formal verification and to propose the Business Process Evaluation and Research Framework for Enhancement and Continuous Testing (bPERFECT) framework, which aims to guide business process testing (BPT) research and implementation. Secondary objectives include (1) eliciting the existing types of testing, (2) evaluating their impact on efficiency and (3) assessing the formal verification techniques that complement testing.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>The methodology used is based on Kitchenham's (2004) original procedures for conducting systematic literature reviews.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>Results of this study indicate that three distinct business process model testing types can be found in the literature: black\/gray-box, regression and integration. Testing and verification approaches differ in aspects such as awareness of test data, coverage criteria and auxiliary representations used. However, most solutions pose notable hindrances, such as BPMN element limitations, that lead to limited practicality.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Research limitations\/implications<\/jats:title><jats:p>The databases selected in the review protocol may have excluded relevant studies on this topic. More databases and gray literature could also be considered for inclusion in this review.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>Three main originality aspects are identified in this study as follows: (1) the classification of process model testing types, (2) the future trends foreseen for BPMN model testing and verification and (3) the bPERFECT framework for testing business processes.<\/jats:p><\/jats:sec>","DOI":"10.1108\/bpmj-11-2022-0557","type":"journal-article","created":{"date-parts":[[2023,4,5]],"date-time":"2023-04-05T09:44:49Z","timestamp":1680687889000},"page":"133-162","source":"Crossref","is-referenced-by-count":22,"title":["Assessing business process models: a literature review on\u00a0techniques for BPMN testing and formal verification"],"prefix":"10.1108","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5454-2927","authenticated-orcid":false,"given":"Tom\u00e1s","family":"Lopes","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8627-3338","authenticated-orcid":false,"given":"S\u00e9rgio","family":"Guerreiro","sequence":"additional","affiliation":[]}],"member":"140","published-online":{"date-parts":[[2023,4,5]]},"reference":[{"key":"key2023120806072269100_ref001","doi-asserted-by":"publisher","DOI":"10.1016\/j.compind.2022.103837","article-title":"The biggest business process management problems to solve before we die","volume":"146","year":"2023","journal-title":"Computers in Industry"},{"key":"key2023120806072269100_ref002","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1109\/ICSTW.2009.24","article-title":"A first approach to test case generation for BPEL compositions of web services using Scatter Search","year":"2009"},{"key":"key2023120806072269100_ref003","unstructured":"B\u00f6hmer, K. and Rinderle-Ma, S. (2015), \u201cA systematic literature review on process model testing: approaches, challenges, and research directions\u201d. doi: 10.48550\/arXiv.1509.04076."},{"issue":"4","key":"key2023120806072269100_ref004","doi-asserted-by":"publisher","first-page":"1740002.1","DOI":"10.1142\/S0218843017400020","article-title":"Automatic business process test case selection: coverage metrics, algorithms, and performance optimizations","volume":"25","year":"2016","journal-title":"International Journal of Cooperative Information Systems"},{"issue":"3","key":"key2023120806072269100_ref005","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1108\/07378830610692127","article-title":"Clear and present questions: formulating questions for evidence based practice","volume":"24","year":"2006","journal-title":"Library Hi Tech"},{"key":"key2023120806072269100_ref006","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1007\/978-3-642-24749-1_5","article-title":"Performance evaluation of business processes through a formal transformation to SAN","year":"2011"},{"key":"key2023120806072269100_ref007","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1007\/978-3-642-01924-1_5","article-title":"Model checking techniques for test generation from business process models","year":"2009"},{"key":"key2023120806072269100_ref008","doi-asserted-by":"crossref","unstructured":"Bures, M., Cerny, T. and Klima, M. (2017), \u201cPrioritized Process Test: more efficiency in testing of business processes and workflows\u201d, in Information Science and Applications 2017: ICISA 2017, Springer, Macau, China, pp.\u00a0585-593, doi: 10.1007\/978-981-10-4154-9_67.","DOI":"10.1007\/978-981-10-4154-9_67"},{"key":"key2023120806072269100_ref009","unstructured":"Clarivate (2021), \u201cWeb of science coverage details - resources for librarians\u201d, Archived Using Wayback Machine, October 27, 2021, available at: https:\/\/web.archive.org\/web\/20211027164550\/https:\/\/clarivate.libguides.com\/librarianresources\/coverage (accessed 10 October 2022)."},{"key":"key2023120806072269100_ref010","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.scico.2018.05.008","article-title":"A formal approach to modeling and verification of business process collaborations","volume":"166","year":"2018","journal-title":"Science of Computer Programming"},{"key":"key2023120806072269100_ref011","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111007","article-title":"A formal approach for the\u00a0analysis of BPMN collaboration models","volume":"180","year":"2021","journal-title":"Journal of Systems and Software"},{"key":"key2023120806072269100_ref012","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/ICCSA.2017.7999652","article-title":"Test case generation from BPMN models for automated testing of web-based BPM applications","year":"2017"},{"key":"key2023120806072269100_ref013","doi-asserted-by":"publisher","first-page":"38421","DOI":"10.1109\/ACCESS.2018.2853669","article-title":"Transformation of the BPMN design model into a colored Petri net using the partitioning approach","volume":"6","year":"2018","journal-title":"IEEE Access"},{"key":"key2023120806072269100_ref014","doi-asserted-by":"publisher","first-page":"16795","DOI":"10.1109\/ACCESS.2019.2892958","article-title":"Hierarchical verification for the BPMN design model using state space analysis","volume":"7","year":"2019","journal-title":"IEEE Access"},{"issue":"2","key":"key2023120806072269100_ref015","doi-asserted-by":"publisher","first-page":"135","DOI":"10.4186\/ej.2021.25.2.135","article-title":"An automated framework for BPMN model verification achieving branch coverage","volume":"25","year":"2021","journal-title":"Engineering Journal-Thailand"},{"key":"key2023120806072269100_ref016","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1007\/978-3-642-16298-5_4","article-title":"BPMN 2.0 execution semantics formalized as graph rewrite rules","year":"2010"},{"key":"key2023120806072269100_ref017","volume-title":"Fundamentals of Business Process Management","year":"2018"},{"key":"key2023120806072269100_ref018","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1007\/978-3-319-99840-4_5","article-title":"Symbolic specification and verification of data-aware BPMN processes using Rewriting Modulo SMT","year":"2018"},{"key":"key2023120806072269100_ref019","doi-asserted-by":"crossref","unstructured":"Guangquan, Z., Mei, R. and Jun, Z. (2007), \u201cA business process of web services testing method based on UML2.0 Activity Diagram\u201d, Workshop on Intelligent Information Technology Application (IITA 2007), IEEE, Zhangjiajie, pp.\u00a059-65, doi: 10.1109\/IITA.2007.83.","DOI":"10.1109\/IITA.2007.83"},{"issue":"1","key":"key2023120806072269100_ref020","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1108\/BPMJ-02-2020-0072","article-title":"Conceptualizing on dynamically stable business processes operation: a literature review on existing concepts","volume":"27","year":"2020","journal-title":"Business Process Management Journal"},{"key":"key2023120806072269100_ref021","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1145\/1985793.1985882","article-title":"Model-driven engineering practices in industry","year":"2011"},{"key":"key2023120806072269100_ref022","doi-asserted-by":"publisher","first-page":"891","DOI":"10.1109\/INDIN.2007.4384891","article-title":"W-method for hierarchical and communicating finite state machines","year":"2007"},{"issue":"2","key":"key2023120806072269100_ref023","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1016\/j.tcs.2008.02.045","article-title":"Testing data processing-oriented systems from Stream X-machine models","volume":"403","year":"2008","journal-title":"Theoretical Computer Science"},{"key":"key2023120806072269100_ref024","doi-asserted-by":"publisher","first-page":"623","DOI":"10.1109\/PIC.2016.7949575","article-title":"Test case generation for BPEL-based web service composition using colored Petri nets","year":"2016"},{"key":"key2023120806072269100_ref025","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1007\/978-3-662-46675-9_5","article-title":"BPEL integration testing","year":"2015"},{"key":"key2023120806072269100_ref026","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1016\/j.ins.2016.12.044","article-title":"Formal verification of complex business processes based on high-level Petri nets","volume":"385","year":"2017","journal-title":"Information Sciences"},{"key":"key2023120806072269100_ref027","unstructured":"Kitchenham, B. (2004), \u201cProcedures for performing systematic reviews\u201d, Technical report, Keele University, Keele, Staffs, available at: https:\/\/www.inf.ufsc.br\/%7Ealdo.vw\/kitchenham.pdf"},{"key":"key2023120806072269100_ref028","doi-asserted-by":"crossref","unstructured":"Kog, F., Scherer, R.J. and Dikbas, A. (2012), \u201cPetri net based verification of BPMN represented configured construction processes\u201d, in ECCPM 2012 - eWork and eBusiness in Architecture, Engineering and Construction, CRC Press, Reykjavik, pp.\u00a0243-249.","DOI":"10.1201\/b12516-39"},{"issue":"7","key":"key2023120806072269100_ref029","doi-asserted-by":"publisher","first-page":"987","DOI":"10.1142\/S0218194010005079","article-title":"Formal analysis of BPMN models: a NuSMV-based approach","volume":"20","year":"2010","journal-title":"International Journal of Software Engineering and Knowledge Engineering"},{"key":"key2023120806072269100_ref030","unstructured":"Link Consulting (2016), \u201cEdoclink white paper\u201d, available at: https:\/\/pdfhost.io\/v\/nsLgUFJTc_edoclink_white_paper_2016"},{"key":"key2023120806072269100_ref031","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1109\/ISISE.2008.201","article-title":"Testing BPEL with Stream X-machine","year":"2008"},{"issue":"3","key":"key2023120806072269100_ref032","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1145\/2993236.2993257","article-title":"Automated regression testing of BPMN 2.0 processes","volume":"52","year":"2017","journal-title":"ACM SIGPLAN Notices"},{"issue":"1","key":"key2023120806072269100_ref033","doi-asserted-by":"publisher","first-page":"17","DOI":"10.4018\/IJSI.2020010102","article-title":"An approach for the transformation and verification of BPMN models to colored Petri nets models","volume":"8","year":"2020","journal-title":"International Journal of Software Innovation"},{"key":"key2023120806072269100_ref034","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1109\/CLEI.2013.6670616","article-title":"Compositional verification of business processes by model-checking","year":"2010"},{"key":"key2023120806072269100_ref035","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1007\/978-981-13-0514-6_77","article-title":"A new test case generation for web service choreography testing by using metaheuristic algorithm","year":"2019"},{"key":"key2023120806072269100_ref036","doi-asserted-by":"publisher","first-page":"349","DOI":"10.5220\/0005930903490358","article-title":"Verification of BPMN model functional completeness by using the Topological Functioning Model","year":"2016"},{"key":"key2023120806072269100_ref037","article-title":"Business process model and notation (BPMN), version 2.0","author":"Object Management Group","year":"2010"},{"key":"key2023120806072269100_ref038","doi-asserted-by":"publisher","first-page":"999","DOI":"10.1016\/j.procs.2018.04.104","article-title":"End-to-end automatic business process validation","volume":"130","year":"2018","journal-title":"Procedia Computer Science"},{"key":"key2023120806072269100_ref039","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1007\/978-3-319-46140-3_27","article-title":"Verification of common business rules in BPMN process models","year":"2016"},{"issue":"1","key":"key2023120806072269100_ref040","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1109\/MS.2012.13","article-title":"Model-based testing","volume":"29","year":"2012","journal-title":"IEEE Software"},{"key":"key2023120806072269100_ref041","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1109\/EDOC52215.2021.00014","article-title":"Automated regression tests: a no-code approach for BPMN-based Process-Driven Applications","year":"2021"},{"key":"key2023120806072269100_ref042","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1007\/s00766-018-0304-3","article-title":"Automatic test cases generation from business process models","volume":"24","year":"2019","journal-title":"Requirements Engineering"},{"issue":"6","key":"key2023120806072269100_ref043","doi-asserted-by":"publisher","first-page":"778","DOI":"10.1108\/14637150810915973","article-title":"Business process improvement: empirical assessment and extensions","volume":"14","year":"2008","journal-title":"Business Process Management Journal"},{"issue":"3","key":"key2023120806072269100_ref044","doi-asserted-by":"publisher","first-page":"525","DOI":"10.15388\/Informatica.2017.143","article-title":"From process models to concurrent systems in Alvis language","volume":"28","year":"2017","journal-title":"Informatica"},{"key":"key2023120806072269100_ref045","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1007\/978-3-540-88871-0_19","article-title":"BPEL to BPMN: the myth of a straight-forward mapping","year":"2008"},{"issue":"8","key":"key2023120806072269100_ref046","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1016\/j.scico.2009.09.010","article-title":"Formalisations and applications of BPMN","volume":"76","year":"2011","journal-title":"Science of Computer Programming"},{"issue":"1","key":"key2023120806072269100_ref047","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1108\/14637150910931479","article-title":"Business process verification \u2013 finally a reality!","volume":"15","year":"2009","journal-title":"Business Process Management Journal"},{"key":"key2023120806072269100_ref048","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1109\/DICTAP.2014.6821684","article-title":"An approach to construct formal model of business process model from BPMN workflow patterns","year":"2014"},{"key":"key2023120806072269100_ref049","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/ICODSE.2014.7062692","article-title":"Design of a tool for generating test cases from BPMN","year":"2014"},{"key":"key2023120806072269100_ref050","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1109\/WSE.2008.4655394","article-title":"A model driven approach toward business process test case generation","year":"2008"}],"container-title":["Business Process Management Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/BPMJ-11-2022-0557\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/BPMJ-11-2022-0557\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T23:16:34Z","timestamp":1753398994000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/bpmj\/article\/29\/8\/133-162\/258196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,5]]},"references-count":50,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,4,5]]},"published-print":{"date-parts":[[2023,12,18]]}},"alternative-id":["10.1108\/BPMJ-11-2022-0557"],"URL":"https:\/\/doi.org\/10.1108\/bpmj-11-2022-0557","relation":{},"ISSN":["1463-7154"],"issn-type":[{"value":"1463-7154","type":"print"}],"subject":[],"published":{"date-parts":[[2023,4,5]]}}}