{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T13:50:50Z","timestamp":1770040250683,"version":"3.49.0"},"reference-count":63,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T00:00:00Z","timestamp":1643068800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T00:00:00Z","timestamp":1643068800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"EPSRC Research Project Twenty20Insight","award":["EP\/T017627\/1"],"award-info":[{"award-number":["EP\/T017627\/1"]}]},{"name":"The Lerver-hulme Trust Fellowship","award":["RF-2019-548\/9"],"award-info":[{"award-number":["RF-2019-548\/9"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Softw Syst Model"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Self-adaptive systems (SASs) are increasingly leveraging autonomy in their decision-making to manage uncertainty in their operating environments. A key problem with SASs is ensuring their requirements remain satisfied as they adapt. The trade-off analysis of the non-functional requirements (NFRs) is key to establish balance among them. Further, when performing the trade-offs it is necessary to know the importance of each NFR to be able to resolve conflicts among them. Such trade-off analyses are often built upon optimisation methods, including decision analysis and utility theory. A problem with these techniques is that they use a single-scalar utility value to represent the overall combined priority for all the NFRs. However, this combined scalar priority value may hide information about the impacts of the environmental contexts on the individual NFRs\u2019 priorities, which may change over time. Hence, there is a need for support for runtime, autonomous reasoning about the separate priority values for each NFR, while using the knowledge acquired based on evidence collected. In this paper, we propose Pri-AwaRE, a self-adaptive architecture that makes use of Multi-Reward Partially Observable Markov Decision Process (MR-POMDP) to perform decision-making for SASs while offering awareness of NFRs\u2019 priorities. MR-POMDP is used as a priority-aware runtime specification model to support runtime reasoning and autonomous tuning of the distinct priority values of NFRs using a vector-valued reward function. We also evaluate the usefulness of our Pri-AwaRE approach by applying it to two substantial example applications from the networking and IoT domains.<\/jats:p>","DOI":"10.1007\/s10270-021-00956-0","type":"journal-article","created":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T02:02:30Z","timestamp":1643076150000},"page":"2213-2242","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Decision-making under uncertainty: be aware of your priorities"],"prefix":"10.1007","volume":"21","author":[{"given":"Huma","family":"Samin","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nelly","family":"Bencomo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Sawyer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,1,25]]},"reference":[{"key":"956_CR1","doi-asserted-by":"crossref","unstructured":"Abundo, M., Cardellini, V., Presti, F.L.: An MDP-based admission control for a QOS-aware service-oriented system. In: 2011 IEEE Nineteenth IEEE International Workshop on Quality of Service (2011), pp.\u00a01\u20133. IEEE","DOI":"10.1109\/IWQOS.2011.5931324"},{"issue":"15","key":"956_CR2","doi-asserted-by":"publisher","first-page":"2787","DOI":"10.1016\/j.comnet.2010.05.010","volume":"54","author":"L Atzori","year":"2010","unstructured":"Atzori, L., Iera, A., Morabito, G.: The internet of things: a survey. Comput. Netw. 54(15), 2787\u20132805 (2010)","journal-title":"Comput. Netw."},{"key":"956_CR3","doi-asserted-by":"crossref","unstructured":"Bencomo, N., Belaggoun, A.: Supporting decision-making for self-adaptive systems: from goal models to dynamic decision networks. In: International Working Conference on Requirements Engineering: Foundation for Software Quality, pp.\u00a0221\u2013236. Springer (2013)","DOI":"10.1007\/978-3-642-37422-7_16"},{"key":"956_CR4","doi-asserted-by":"crossref","unstructured":"Bencomo, N., Belaggoun, A. Supporting decision-making for self-adaptive systems: from goal models to dynamic decision networks. In: Proceedings of the 19th International Conference on Requirements Engineering: Foundation for Software Quality (Berlin, Heidelberg, 2013), REFSQ\u201913, pp.\u00a0221\u2013236. Springer, Essen, Germany","DOI":"10.1007\/978-3-642-37422-7_16"},{"key":"956_CR5","doi-asserted-by":"crossref","unstructured":"Bencomo, N., Belaggoun, A., Issarny, V.: Bayesian artificial intelligence for tackling uncertainty in self-adaptive systems: the case of dynamic decision networks. In: 2013 2nd International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering (RAISE), pp.\u00a07\u201313 (2013)","DOI":"10.1109\/RAISE.2013.6615198"},{"key":"956_CR6","doi-asserted-by":"crossref","unstructured":"Bencomo, N., Belaggoun, A., Issarny, V.: Dynamic decision networks for decision-making in self-adaptive systems: a case study. In: 2013 8th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS) (San Francisco, CA, USA, May 2013), pp.\u00a0113\u2013122. IEEE","DOI":"10.1109\/SEAMS.2013.6595498"},{"issue":"4","key":"956_CR7","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1109\/12.919277","volume":"50","author":"G Bernat","year":"2001","unstructured":"Bernat, G., Burns, A., Liamosi, A.: Weakly hard real-time systems. IEEE Trans. Comput. 50(4), 308\u2013321 (2001)","journal-title":"IEEE Trans. Comput."},{"key":"956_CR8","doi-asserted-by":"crossref","unstructured":"Bowers, K.M., Fredericks, E.M., Cheng, B.H.: Automated optimization of weighted non-functional objectives in self-adaptive systems. In: International Symposium on Search Based Software Engineering, pp.\u00a0182\u2013197. Springer (2018)","DOI":"10.1007\/978-3-319-99241-9_9"},{"key":"956_CR9","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1016\/j.scico.2015.12.006","volume":"127","author":"J C\u00e1mara","year":"2016","unstructured":"C\u00e1mara, J., Lopes, A., Garlan, D., Schmerl, B.: Adaptation impact and environment models for architecture-based self-adaptive systems. Sci. Comput. Program. 127, 50\u201375 (2016)","journal-title":"Sci. Comput. Program."},{"key":"956_CR10","doi-asserted-by":"crossref","unstructured":"Chen, B., Peng, X., Yu, Y., Nuseibeh, B., Zhao, W.: Self-adaptation through incremental generative model transformations at runtime. In: Proceedings of the 36th International Conference on Software Engineering\u2014ICSE 2014 (Hyderabad, India), pp.\u00a0676\u2013687. ACM Press (2014)","DOI":"10.1145\/2568225.2568310"},{"key":"956_CR11","unstructured":"Cheng, H.-T.: Algorithms for partially observable Markov decision processes. Ph.D. thesis, University of British Columbia (1988)"},{"key":"956_CR12","doi-asserted-by":"crossref","unstructured":"Chung, L., do\u00a0Prado\u00a0Leite, J.C.S.: On non-functional requirements in software engineering. In: Conceptual Modeling: Foundations and Applications. Springer, pp.\u00a0363\u2013379 (2009)","DOI":"10.1007\/978-3-642-02463-4_19"},{"key":"956_CR13","doi-asserted-by":"crossref","unstructured":"De\u00a0Lemos, R., Garlan, D., Ghezzi, C., Giese, H., Andersson, J., Litoiu, M., Schmerl, B., Weyns, D., Baresi, L., Bencomo, N., et\u00a0al.: Software engineering for self-adaptive systems: research challenges in the provision of assurances. In: Software Engineering for Self-Adaptive Systems III. Assurances, pp.\u00a03\u201330. Springer (2017)","DOI":"10.1007\/978-3-319-74183-3_1"},{"key":"956_CR14","doi-asserted-by":"crossref","unstructured":"Edwards, R., Bencomo, N.: DeSiRE: further understanding nuances of degrees of satisfaction of non-functional requirements trade-off. In: Proceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems\u2014SEAMS \u201918 (Gothenburg, Sweden, 2018), pp.\u00a012\u201318. ACM Press","DOI":"10.1145\/3194133.3194142"},{"key":"956_CR15","unstructured":"Feldt, R., Magazinius, A.: Validity threats in empirical software engineering research-an initial survey. In: Seke, pp. 374\u2013379 (2010)"},{"key":"956_CR16","doi-asserted-by":"crossref","unstructured":"Filieri, A., Tamburrelli, G.: Probabilistic verification at runtime for self-adaptive systems. In: Assurances for Self-Adaptive Systems, pp.\u00a030\u201359. Springer (2013)","DOI":"10.1007\/978-3-642-36249-1_2"},{"key":"956_CR17","volume-title":"Mitigating Uncertainty at Design Time and Run Time to Address Assurance for Dynamically Adaptive Systems","author":"EM Fredericks","year":"2015","unstructured":"Fredericks, E.M.: Mitigating Uncertainty at Design Time and Run Time to Address Assurance for Dynamically Adaptive Systems. Michigan State University, Computer Science, East Lansing (2015)"},{"key":"956_CR18","doi-asserted-by":"crossref","unstructured":"Garcia\u00a0Paucar, L.H., Bencomo, N.: Knowledge base K models to support trade-offs for self-adaptation using Markov processes. In: 2019 IEEE 13th International Conference on Self-Adaptive and Self-Organizing Systems (SASO), pp.\u00a011\u201316. ISSN: 1949-3681, 1949\u20133673 (2019)","DOI":"10.1109\/SASO.2019.00011"},{"key":"956_CR19","doi-asserted-by":"crossref","unstructured":"Glinz, M.: On non-functional requirements. In: 15th IEEE International Requirements Engineering Conference (RE 2007), pp.\u00a021\u201326. IEEE (2007)","DOI":"10.1109\/RE.2007.45"},{"key":"956_CR20","doi-asserted-by":"crossref","unstructured":"Goldsby, H.J., Sawyer, P., Bencomo, N., Cheng, B.H., Hughes, D.: Goal-based modeling of dynamically adaptive system requirements. In: 15Th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ECBS 2008), pp.\u00a036\u201345. IEEE (2008)","DOI":"10.1109\/ECBS.2008.22"},{"key":"956_CR21","doi-asserted-by":"crossref","unstructured":"Iftikhar, M.U., Ramachandran, G.S., Bollansee, P., Weyns, D., Hughes, D.: DeltaIoT: a self-adaptive internet of things exemplar. In: 2017 IEEE\/ACM 12th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS) (Buenos Aires, Argentina, May 2017), pp.\u00a076\u201382. IEEE","DOI":"10.1109\/SEAMS.2017.21"},{"key":"956_CR22","unstructured":"Ji, M., Veitch, A.C., Wilkes, J.: Seneca: remote mirroring done write. In: USENIX Annual Technical Conference, General Track (2003)"},{"key":"956_CR23","doi-asserted-by":"publisher","first-page":"370","DOI":"10.1016\/j.jclinepi.2009.08.005","volume":"63","author":"SR Johnson","year":"2010","unstructured":"Johnson, S.R., Tomlinson, G.A., Hawker, G.A., Granton, J.T., Grosbein, H.A., Feldman, B.M.A.: A valid and reliable belief elicitation method for Bayesian priors. J. Clin. Epidemiol. 63, 370\u2013383 (2010)","journal-title":"J. Clin. Epidemiol."},{"key":"956_CR24","unstructured":"Keeton, K., Santos, C., Beyer, D., Chase J., Wilkes, J.: Designing for disasters. In: USENIX Conference on File and Storage Technologies, Berkeley (2004)"},{"issue":"1","key":"956_CR25","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1109\/MC.2003.1160055","volume":"36","author":"JO Kephart","year":"2003","unstructured":"Kephart, J.O., Chess, D.M.: The vision of autonomic computing. Computer 36(1), 41\u201350 (2003)","journal-title":"Computer"},{"key":"956_CR26","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1016\/j.pmcj.2014.09.009","volume":"17","author":"C Krupitzer","year":"2015","unstructured":"Krupitzer, C., Roth, F.M., VanSyckel, S., Schiele, G., Becker, C.: A survey on engineering approaches for self-adaptive systems. Pervasive Mob. Comput. 17, 184\u2013206 (2015)","journal-title":"Pervasive Mob. Comput."},{"issue":"5","key":"956_CR27","doi-asserted-by":"publisher","first-page":"233","DOI":"10.14257\/ijca.2017.10.5.22","volume":"10","author":"T Le","year":"2017","unstructured":"Le, T., Moh, S.: An energy-efficient topology control algorithm based on reinforcement learning for wireless sensor networks. Int. J. Control Autom. 10(5), 233\u2013244 (2017)","journal-title":"Int. J. Control Autom."},{"key":"956_CR28","first-page":"22","volume":"2016","author":"TT Le","year":"2016","unstructured":"Le, T.T., Moh, S.: Reinforcement-learning-based topology control for wireless sensor networks. Proc. Grid Distrib. Comput. 2016, 22\u20137 (2016)","journal-title":"Proc. Grid Distrib. Comput."},{"key":"956_CR29","unstructured":"Lemos, R.d.: Ed. Software engineering for self-adaptive systems II: international seminar, Dagstuhl Castle, Germany, October 24-29, 2010: revised selected and invited papers. No.\u00a07475 in Lecture notes in computer science. Springer, Berlin, New York, 2013. OCLC: ocn839358754"},{"issue":"3","key":"956_CR30","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1007\/s00766-011-0129-9","volume":"16","author":"S Liaskos","year":"2011","unstructured":"Liaskos, S., McIlraith, S.A., Sohrabi, S., Mylopoulos, J.: Representing and reasoning about preferences in requirements engineering. Requir. Eng. 16(3), 227\u2013249 (2011)","journal-title":"Requir. Eng."},{"issue":"3","key":"956_CR31","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1109\/TSMC.2014.2358639","volume":"45","author":"C Liu","year":"2015","unstructured":"Liu, C., Xu, X., Hu, D.: Multiobjective reinforcement learning: a comprehensive overview. IEEE Trans. Syst. Man Cybern. Syst. 45(3), 385\u2013398 (2015)","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"956_CR32","doi-asserted-by":"crossref","unstructured":"Maggio, M., Papadopoulos, A.V., Filieri, A., Hoffmann, H.: Automated control of multiple software goals using multiple actuators. In: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, pp.\u00a0373\u2013384 (2017)","DOI":"10.1145\/3106237.3106247"},{"issue":"1","key":"956_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3149180","volume":"13","author":"GA Moreno","year":"2018","unstructured":"Moreno, G.A., C\u00e1mara, J., Garlan, D., Schmerl, B.: Flexible and efficient decision-making for proactive latency-aware self-adaptation. ACM Trans. Auton. Adapt. Syst. (TAAS) 13(1), 1\u201336 (2018)","journal-title":"ACM Trans. Auton. Adapt. Syst. (TAAS)"},{"key":"956_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.envsoft.2013.10.010","volume":"52","author":"DE Morris","year":"2014","unstructured":"Morris, D.E., Oakley, J.E., Crowe, J.A.: A web-based tool for eliciting probability distributions from experts. Environ. Model. Softw. 52, 1\u20134 (2014)","journal-title":"Environ. Model. Softw."},{"key":"956_CR35","doi-asserted-by":"crossref","unstructured":"Nguyen, T.N., Ho, C.V., Le, T.T.: A topology control algorithm in wireless sensor networks for IOT-based applications. In: 2019 International Symposium on Electrical and Electronics Engineering (ISEE) (2019), pp.\u00a0141\u2013145. IEEE","DOI":"10.1109\/ISEE2.2019.8921357"},{"key":"956_CR36","doi-asserted-by":"crossref","unstructured":"O\u2019Hagan, A.: Probabilistic uncertainty specification: overview, elaboration techniques and their application to a mechanistic model of carbon flux. Environ. Model. Softw. 36, 35\u201348 (2012)","DOI":"10.1016\/j.envsoft.2011.03.003"},{"key":"956_CR37","doi-asserted-by":"crossref","unstructured":"Parra-Ullauri, J.M., Garc\u00eda-Dom\u00ednguez, A., Garc\u00eda-Paucar, L.H., Bencomo, N.: Temporal models for history-aware explainability. In: Proceedings of the 12th System Analysis and Modelling Conference (New York, NY, USA, 2020), SAM \u201920, Association for Computing Machinery, pp.\u00a0155\u2013164","DOI":"10.1145\/3419804.3420276"},{"key":"956_CR38","doi-asserted-by":"crossref","unstructured":"Paucar, L.H.G., Bencomo, N.: RE-STORM: mapping the decision-making problem and non-functional requirements trade-off to partially observable Markov decision processes. In: Proceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems\u2014SEAMS \u201918 (Gothenburg, Sweden, 2018), pp.\u00a019\u201325. ACM Press","DOI":"10.1145\/3194133.3195537"},{"key":"956_CR39","unstructured":"Paucar, L.H.G., Bencomo, N., Yuen, K.K.F.: ARRoW: automatic runtime reappraisal of weights for self-adaptation. In: Proceedings of the 34th ACM\/SIGAPP Symposium on Applied Computing\u2014SAC \u201919 (Limassol, Cyprus, 2019), pp.\u00a01584\u20131591. ACM Press"},{"key":"956_CR40","doi-asserted-by":"crossref","unstructured":"Peng, X., Chen, B., Yu, Y., Zhao, W.: Self-tuning of software systems through goal-based feedback loop control. In: 2010 18th IEEE International Requirements Engineering Conference (Sydney, Australia, Sept. 2010), pp.\u00a0104\u2013107. IEEE","DOI":"10.1109\/RE.2010.22"},{"key":"956_CR41","doi-asserted-by":"crossref","unstructured":"Ramirez, A.J., Cheng, B.H.C.: Automatic derivation of utility functions for monitoring software requirements. In: J.\u00a0Whittle, T.\u00a0Clark, and T.\u00a0K\u00fchne (Eds.) Model Driven Engineering Languages and Systems (2011), Lecture Notes in Computer Science, pp.\u00a0501\u2013516. Springer, Berlin","DOI":"10.1007\/978-3-642-24485-8_37"},{"key":"956_CR42","doi-asserted-by":"crossref","unstructured":"Roijers, D.: Multi-objective decision-theoretic planning. OCLC: 6893481195 (2016)","DOI":"10.1007\/978-3-031-01576-2"},{"key":"956_CR43","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1613\/jair.3987","volume":"48","author":"DM Roijers","year":"2013","unstructured":"Roijers, D.M., Vamplew, P., Whiteson, S., Dazeley, R.: A survey of multi-objective sequential decision-making. J. Artif. Intell. Res. 48, 67\u2013113 (2013)","journal-title":"J. Artif. Intell. Res."},{"key":"956_CR44","unstructured":"Roijers, D.M., Whiteson, S., Oliehoek, F.A.: Point-based planning for multi-objective POMDPs. In: Twenty-Fourth International Joint Conference on Artificial Intelligence (2015)"},{"key":"956_CR45","doi-asserted-by":"publisher","first-page":"663","DOI":"10.1613\/jair.2567","volume":"32","author":"S Ross","year":"2008","unstructured":"Ross, S., Pineau, J., Paquet, S., Chaib-draa, B.: Online planning algorithms for POMDPs. J. Artif. Intell. Res. 32, 663\u2013704 (2008)","journal-title":"J. Artif. Intell. Res."},{"key":"956_CR46","doi-asserted-by":"crossref","unstructured":"Roush, F.W.: Multicriteria decision-aid. : Philippe Vincke, Chichester: John Wiley, 1992, 154 pages. Math. Soc. Sci. 25(2), 204 (1993)","DOI":"10.1016\/0165-4896(93)90056-O"},{"key":"956_CR47","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-2500-1","volume-title":"Multicriteria Methodology for Decision Aiding","author":"B Roy","year":"1996","unstructured":"Roy, B.: Multicriteria Methodology for Decision Aiding. Kluwer Academic, Dordrecht (1996)"},{"key":"956_CR48","unstructured":"Samin, H.: Remote data mirroring\u2014experiments. https:\/\/gitlab.com\/re_research\/rdmexperiments\/. Tech. Rep. v0.9 (2020)"},{"key":"956_CR49","doi-asserted-by":"crossref","unstructured":"Samin, H., Garcia\u00a0Paucar, L., Nelly, B., Sawyer, P. Towards priority-awareness in autonomous intelligent systems. In: 36th ACM\/SIGAPP Symposium On Applied Computing (SAC). ACM (2021)","DOI":"10.1145\/3412841.3442007"},{"key":"956_CR50","doi-asserted-by":"crossref","unstructured":"Samin, H., Paucar, L.H.G., Bencomo, N., Hurtado, C.M.C., Fredericks, E.M.: RDMSim: an exemplar for evaluation and comparison of decision-making techniques for self-adaptation. In: 16th international symposium on software engineering for adaptive and self-managing systems (SEAMS), p.\u00a07 (2021)","DOI":"10.1109\/SEAMS51251.2021.00039"},{"key":"956_CR51","doi-asserted-by":"crossref","unstructured":"Sawyer, P., Bencomo, N., Whittle, J., Letier, E., Finkelstein, A.: Requirements-aware systems: a research agenda for RE for self-adaptive systems. In: 2010 18th IEEE International Requirements Engineering Conference, pp.\u00a095\u2013103 (2010)","DOI":"10.1109\/RE.2010.21"},{"key":"956_CR52","doi-asserted-by":"crossref","unstructured":"Shanavas, J., Simi, S.: An energy efficient topology control scheme with connectivity learning in wireless networks. In: 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp.\u00a01770\u20131774. IEEE (2014)","DOI":"10.1109\/ICACCI.2014.6968247"},{"issue":"1","key":"956_CR53","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10458-012-9200-2","volume":"27","author":"G Shani","year":"2013","unstructured":"Shani, G., Pineau, J., Kaplow, R.: A survey of point-based pomdp solvers. Auton. Agents Multi-Agent Syst. 27(1), 1\u201351 (2013)","journal-title":"Auton. Agents Multi-Agent Syst."},{"key":"956_CR54","doi-asserted-by":"crossref","unstructured":"Soh, H., Demiris, Y.: Evolving policies for multi-reward partially observable Markov decision processes (MR-POMDPs). In: Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation, pp.\u00a0713\u2013720 (2011)","DOI":"10.1145\/2001576.2001674"},{"key":"956_CR55","doi-asserted-by":"crossref","unstructured":"Soh, H., Demiris, Y., Soh, H., Demiris, Y.: Multi-reward policies for medical applications: anthrax attacks and smart wheelchairs. In: Proceedings of the 13th Annual Conference Companion on Genetic and Evolutionary Computation (2011), pp.\u00a0471\u2013478","DOI":"10.1145\/2001858.2002036"},{"key":"956_CR56","doi-asserted-by":"crossref","unstructured":"Spaan, M.T.J.: Partially observable markov decision processes. In: Reinforcement Learning, vol. 27 (2012)","DOI":"10.1007\/978-3-642-27645-3_12"},{"key":"956_CR57","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1613\/jair.1659","volume":"24","author":"MTJ Spaan","year":"2005","unstructured":"Spaan, M.T.J., Vlassis, N.: Perseus: randomized point-based value iteration for POMDPs. J. Artif. Intell. Res. 24, 195\u2013220 (2005). arXiv: 1109.2145","journal-title":"J. Artif. Intell. Res."},{"issue":"1","key":"956_CR58","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00766-018-0301-6","volume":"25","author":"A Sutcliffe","year":"2020","unstructured":"Sutcliffe, A., Sawyer, P., Stringer, G., Couth, S., Brown, L.J., Gledson, A., Bull, C., Rayson, P., Keane, J., Zeng, X.-J., et al.: Known and unknown requirements in healthcare. Requir. Eng. 25(1), 1\u201320 (2020)","journal-title":"Requir. Eng."},{"key":"956_CR59","first-page":"1","volume":"2016","author":"D Weyns","year":"2016","unstructured":"Weyns, D., Iftikhar, U.: Model-based simulation at runtime for self-adaptive systems. Proc. Models Runtime W\u00fcrzburg 2016, 1\u20139 (2016)","journal-title":"Proc. Models Runtime W\u00fcrzburg"},{"key":"956_CR60","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1007\/s00766-010-0101-0","volume":"15","author":"J Whittle","year":"2010","unstructured":"Whittle, J., Sawyer, P., Bencomo, N., Cheng, B.H.C., Bruel, J.M.: RELAX: a language to address uncertainty in self-adaptive systems requirement. Requir. Eng. 15, 177\u2013196 (2010)","journal-title":"Requir. Eng."},{"key":"956_CR61","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1002\/dac.2417","volume":"25","author":"F Xia","year":"2012","unstructured":"Xia, F., Yang, L.T., Wang, L., Vinel, A.: Internet of things. Int. J. Commun. Syst. 25, 97\u2013114 (2012)","journal-title":"Int. J. Commun. Syst."},{"key":"956_CR62","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/j.asoc.2013.06.028","volume":"14","author":"KKF Yuen","year":"2014","unstructured":"Yuen, K.K.F.: The primitive cognitive network process in healthcare and medical decision making: comparisons with the analytic hierarchy process. Appl. Soft Comput. 14, 109\u2013119 (2014)","journal-title":"Appl. Soft Comput."},{"issue":"1","key":"956_CR63","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/237432.237434","volume":"6","author":"P Zave","year":"1997","unstructured":"Zave, P., Jackson, M.: Four dark corners of requirements engineering. ACM Trans. Softw. Eng. Methodol. (TOSEM) 6(1), 1\u201330 (1997)","journal-title":"ACM Trans. Softw. Eng. Methodol. (TOSEM)"}],"container-title":["Software and Systems Modeling"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10270-021-00956-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10270-021-00956-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10270-021-00956-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,11]],"date-time":"2022-11-11T17:13:06Z","timestamp":1668186786000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10270-021-00956-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,25]]},"references-count":63,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["956"],"URL":"https:\/\/doi.org\/10.1007\/s10270-021-00956-0","relation":{},"ISSN":["1619-1366","1619-1374"],"issn-type":[{"value":"1619-1366","type":"print"},{"value":"1619-1374","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,25]]},"assertion":[{"value":"18 November 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 November 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 January 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}