{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T06:58:50Z","timestamp":1762066730473,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2022,9,23]],"date-time":"2022-09-23T00:00:00Z","timestamp":1663891200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Education, Kingdom of Saudi Arabia"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Goal models are commonly used requirements engineering artefacts that capture stakeholder requirements and their inter-relationships in a way that supports reasoning about their satisfaction, trade-off analysis, and decision making. However, when there is uncertainty in the data used as evidence to evaluate goal models, it is crucial to understand the confidence or trust level in such evaluations, as uncertainty may increase the risk of making premature or incorrect decisions. Different approaches have been proposed to tackle goal model uncertainty issues and risks. However, none of them considers simple quality measures of collected data as a starting point. In this paper, we propose a Data Quality Tagging and Propagation Mechanism to compute the confidence level of a goal\u2019s satisfaction level based on the quality of input data sources. The paper uses the Goal-oriented Requirement Language (GRL), part of the User Requirements Notation (URN) standard, in examples, with an implementation of the proposed mechanism and a case study conducted in order to demonstrate and assess the approach. The availability of computed confidence levels as an additional piece of information enables decision makers to (i) modulate the satisfaction information returned by goal models and (ii) make better-informed decisions, including looking for higher-quality data when needed.<\/jats:p>","DOI":"10.3390\/a15100343","type":"journal-article","created":{"date-parts":[[2022,9,25]],"date-time":"2022-09-25T21:14:28Z","timestamp":1664140468000},"page":"343","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Reasoning about Confidence in Goal Satisfaction"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4002-4480","authenticated-orcid":false,"given":"Malak","family":"Baslyman","sequence":"first","affiliation":[{"name":"Information and Computer Science Department, King Fahd University of Petroleum and Minerals, Dhahran 31261, Saudi Arabia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2414-1791","authenticated-orcid":false,"given":"Daniel","family":"Amyot","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, ON K1N 6N5, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8698-3292","authenticated-orcid":false,"given":"John","family":"Mylopoulos","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, ON K1N 6N5, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,23]]},"reference":[{"key":"ref_1","unstructured":"Letier, E., Stefan, D., and Barr, E.T. (June, January 31). Uncertainty, Risk, and Information Value in Software Requirements and Architecture. Proceedings of the 36th International Conference on Software Engineering (ICSE), Hyderabad, India."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Reinhartz-Berger, I., Sturm, A., Clark, T., Cohen, S., and Bettin, J. (2013). Domain-Specific Modeling Languages: Requirements Analysis and Design Guidelines. Domain Engineering: Product Lines, Languages, and Conceptual Models, Springer.","DOI":"10.1007\/978-3-642-36654-3"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Mussbacher, G., and Amyot, D. (2009, January 16\u201324). Goal and scenario modeling, analysis, and transformation with jUCMNav. Proceedings of the 31st International Conference on Software Engineering\u2014Companion Volume, Vancouver, BC, Canada.","DOI":"10.1109\/ICSE-COMPANION.2009.5071047"},{"key":"ref_4","unstructured":"(2022, June 02). ITU-T. Recommendation Z.151 (10\/18) User Requirements Notation (URN)\u2014Language definition. Available online: https:\/\/www.itu.int\/rec\/T-REC-Z.151\/en."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Fan, Y., Anda, A.A., and Amyot, D. (2018, January 15\u201316). An Arithmetic Semantics for GRL Goal Models with Function Generation. Proceedings of the International Conference on System Analysis and Modeling, Copenhagen, Denmark.","DOI":"10.1007\/978-3-030-01042-3_9"},{"key":"ref_6","unstructured":"Busari, S.A. (2019). Modelling and Analysing Software Requirements and Architecture Decisions under Uncertainty. [Ph.D. Thesis, UCL (University College London)]. Available online: https:\/\/discovery.ucl.ac.uk\/id\/eprint\/10067421."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Busari, S.A., and Letier, E. (2017, January 20\u201328). Radar: A lightweight tool for requirements and architecture decision analysis. Proceedings of the 2017 IEEE\/ACM 39th International Conference on Software Engineering (ICSE), Buenos Aires, Argentina.","DOI":"10.1109\/ICSE.2017.57"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Cailliau, A., and van Lamsweerde, A. (2015, January 24\u201328). Handling knowledge uncertainty in risk-based requirements engineering. Proceedings of the IEEE 23rd International Requirements Engineering Conference (RE), Ottawa, ON, Canada.","DOI":"10.1109\/RE.2015.7320413"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sabetzadeh, M., Falessi, D., Briand, L., Alesio, S.D., McGeorge, D., \u00c5hjem, V., and Borg, J. (2011, January 10\u201312). Combining Goal Models, Expert Elicitation, and Probabilistic Simulation for Qualification of New Technology. Proceedings of the IEEE 13th International Symposium on High-Assurance Systems Engineering, Boca Raton, FL, USA.","DOI":"10.1109\/HASE.2011.22"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.jss.2013.12.033","article-title":"Uncertainty handling in goal-driven self-optimization\u2013limiting the negative effect on adaptation","volume":"90","author":"Chen","year":"2014","journal-title":"J. Syst. Softw."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liaskos, S., Khan, S.M., and Mylopoulos, J. (2022). Modeling and reasoning about uncertainty in goal models: A decision-theoretic approach. Softw. Syst. Model., 1\u201324.","DOI":"10.1007\/s10270-021-00968-w"},{"key":"ref_12","unstructured":"Salay, R., Famelis, M., and Chechik, M. (April, January 24). Language independent refinement using partial modeling. Proceedings of the 15th International Conference on Fundamental Approaches to Software Engineering, Tallinn, Estonia."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bowers, K.M., Fredericks, E.M., and Cheng, B.H. (2018, January 8\u20139). Automated Optimization of Weighted Non-functional Objectives in Self-adaptive Systems. Proceedings of the 10th International Symposium on Search Based Software Engineering, Montpellier, France.","DOI":"10.1007\/978-3-319-99241-9_9"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1466","DOI":"10.1007\/s10664-014-9305-0","article-title":"AutoRELAX: Automatically RELAXing a goal model to address uncertainty","volume":"19","author":"Fredericks","year":"2014","journal-title":"Empir. Softw. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zawawy, H., Mankovskii, S., Kontogiannis, K., and Mylopoulos, J. (2015). Mining software logs for goal-driven root cause analysis. The Art and Science of Analyzing Software Data, Elsevier.","DOI":"10.1016\/B978-0-12-411519-4.00018-5"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"D\u0105browski, J. (2017, January 4\u20138). Towards an adaptive framework for goal-oriented strategic decision-making. Proceedings of the 2017 IEEE 25th International Requirements Engineering Conference (RE), Lisbon, Portugal.","DOI":"10.1109\/RE.2017.53"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1007\/s00766-015-0229-z","article-title":"Automating trade-off analysis of security requirements","volume":"21","author":"Pasquale","year":"2016","journal-title":"Requir. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Dale, C., and Anderson, T. (2012). The Application of Bayesian Belief Networks to Assurance Case Preparation. Achieving Systems Safety, Proceedings of the Twentieth Safety-Critical Systems Symposium, Bristol, UK, 7\u20139 February 2012, Springer.","DOI":"10.1007\/978-1-4471-2494-8"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Guiochet, J., Do Hoang, Q.A., and Kaaniche, M. (2015, January 23\u201325). A Model for Safety Case Confidence Assessment. Proceedings of the 34th International Conference, Computer Safety, Reliability, and Security, Delft, The Netherlands.","DOI":"10.1007\/978-3-319-24255-2_23"},{"key":"ref_20","unstructured":"Hall, R.J. (September, January 31). Forensic System Verification. Proceedings of the 17th IEEE International Requirements Engineering Conference, Atlanta, GA, USA."},{"key":"ref_21","first-page":"3","article-title":"Towards a generic method for articulating design uncertainty","volume":"12","author":"Dhaouadi","year":"2021","journal-title":"J. Object Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3049","DOI":"10.1007\/s10270-018-00712-x","article-title":"Models@run.time: A guided tour of the state of the art and research challenges","volume":"18","author":"Bencomo","year":"2019","journal-title":"Softw. Syst. Model."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Alwidian, S., Dhaouadi, M., and Famelis, M. (2020, January 19\u201320). A Vision towards a Conceptual Basis for the Systematic Treatment of Uncertainty in Goal Modelling. Proceedings of the 12th System Analysis and Modelling Conference, Montreal, QC, Canada.","DOI":"10.1145\/3419804.3421451"},{"key":"ref_24","first-page":"56","article-title":"An analysis of multi-criteria decision making methods","volume":"10","author":"Velasquez","year":"2013","journal-title":"Int. J. Oper. Res."},{"key":"ref_25","unstructured":"Lilja, K.K., Laakso, K., and Palom\u00e4ki, J. (August, January 31). Using the Delphi method. Proceedings of the 2011 Proceedings of PICMET\u201911: Technology Management in the Energy Smart World (PICMET), Portland, OR, USA. Available online: https:\/\/ieeexplore.ieee.org\/document\/6017716."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Akhigbe, O., Alhaj, M., Amyot, D., Badreddin, O., Braun, E., Cartwright, N., Richards, G., and Mussbacher, G. (2014, January 27\u201329). Creating quantitative goal models: Governmental experience. Proceedings of the International Conference on Conceptual Modeling, Atlanta, GA, USA.","DOI":"10.1007\/978-3-319-12206-9_40"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liaskos, S., Jalman, R., and Aranda, J. (2012, January 24\u201328). On eliciting contribution measures in goal models. Proceedings of the 2012 20th IEEE International Requirements Engineering Conference (RE), Chicago, IL, USA.","DOI":"10.1109\/RE.2012.6345808"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Vinay, S., Aithal, S., and Sudhakara, G. (2014). Effect of Contribution Links on Choosing Hard Goals in GORE Using AHP and TOPSIS. Emerging Research in Electronics, Computer Science and Technology: Proceedings of International Conference, ICERECT 2012, Springer.","DOI":"10.1007\/978-81-322-1157-0_75"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kassab, M. (2013, January 29\u201331). An integrated approach of AHP and NFRs framework. Proceedings of the IEEE 7th International Conference on Research Challenges in Information Science (RCIS), Paris, France.","DOI":"10.1109\/RCIS.2013.6577705"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhao, T., Zhao, H., Zhang, W., and Jin, Z. (2015, January 24). Goal model driven alternative selection: A quantitative approach. Proceedings of the 2015 IEEE International Model-Driven Requirements Engineering Workshop (MoDRE), Ottawa, ON, Canada.","DOI":"10.1109\/MoDRE.2015.7343877"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"433","DOI":"10.3233\/MGS-200339","article-title":"Hybrid analytic hierarchy process-based quantitative satisfaction propagation in goal-oriented requirements engineering through sensitivity analysis","volume":"16","author":"Sumesh","year":"2020","journal-title":"Multiagent Grid Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Baslyman, M., Almoaber, B., Amyot, D., and Bouattane, E.M. (2017, January 17\u201319). Activity-based Process Integration in Healthcare with the User Requirements Notation. Proceedings of the 7th International Conference on E-Technologies, Ottawa, ON, Canada.","DOI":"10.1007\/978-3-319-59041-7_9"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"110649","DOI":"10.1016\/j.jss.2020.110649","article-title":"PRISE: A process to support iStar extensions","volume":"168","author":"Araujo","year":"2020","journal-title":"J. Syst. Softw."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"101091","DOI":"10.1016\/j.cola.2022.101091","article-title":"Modelling human-centric aspects of end-users with iStar","volume":"68","author":"Singh","year":"2022","journal-title":"J. Comput. Lang."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s10664-008-9102-8","article-title":"Guidelines for conducting and reporting case study research in software engineering","volume":"14","author":"Runeson","year":"2009","journal-title":"Empir. Softw. Eng."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/10\/343\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:38:35Z","timestamp":1760143115000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/10\/343"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,23]]},"references-count":35,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["a15100343"],"URL":"https:\/\/doi.org\/10.3390\/a15100343","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2022,9,23]]}}}