{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T15:58:55Z","timestamp":1782316735327,"version":"3.54.5"},"reference-count":57,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2022,2,5]],"date-time":"2022-02-05T00:00:00Z","timestamp":1644019200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,5]],"date-time":"2022-02-05T00:00:00Z","timestamp":1644019200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006365","name":"Universidad de Cantabria","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006365","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Ambient Intell Human Comput"],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Context-aware systems adapt their services to the user\u2019s intentions and environment to improve the user experience. However, how to evaluate the quality of these systems in terms of user perception and context recognition is still an open problem. Our goal in this work is to evaluate the Quality-in-Use (QinU) for context-aware software systems according to the ISO\/IEC 25010 standard and in an automated manner. This evaluation is oriented to be model-based, with domain specification and log data as input, while quality metrics and representations of users\u2019 behavior as output. In this process, we use probabilistic models to discover user patterns, heuristic metrics as QinU estimation, clustering techniques to obtain user profiles according to their QinU, and feature selection to identify relevant factors of context. We propose a framework for assessing the QinU in context-aware software systems called Framework for Assessing Quality-in-use of Software (FAQuiS). FAQuiS includes a set of models to represent all dimensions of context, a methodology to apply the quality analysis to any system, and a set of tools and metrics to support and automate the process. We seek to test the impact and ease of integration in the industry for this framework. A case study in a company allows us to validate the applicability in a real environment. We analyze the mechanisms that support the QinU evaluation in context-aware systems, the feasibility of the QinU quantification, and the suitability of the integration in companies. Compared to previous works, our proposal offers a novel data-driven approach with general-purpose and industrial viability. FAQuiS can be used as a solution to assess the QinU based on the ISO 25010 standard and the models of user behaviors in different contexts. This solution analyzes the context changes in the user interaction, can quantify the quality loss in these contexts, and does not require big efforts to be integrated into a software development process.<\/jats:p>","DOI":"10.1007\/s12652-021-03693-w","type":"journal-article","created":{"date-parts":[[2022,2,5]],"date-time":"2022-02-05T14:02:49Z","timestamp":1644069769000},"page":"10321-10346","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Towards automatic evaluation of the Quality-in-Use in context-aware software systems"],"prefix":"10.1007","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4052-0556","authenticated-orcid":false,"given":"Sergio","family":"Salom\u00f3n","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8636-3213","authenticated-orcid":false,"given":"Rafael","family":"Duque","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9338-6085","authenticated-orcid":false,"given":"Jos\u00e9 Luis","family":"Monta\u00f1a","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luis","family":"Ten\u00e9s","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,2,5]]},"reference":[{"key":"3693_CR1","doi-asserted-by":"crossref","unstructured":"Abowd GD, Dey AK, Brown PJ, Davies N, Smith M, Steggles P (1999) Towards a better understanding of context and context-awareness. In: Proceedings of the 1st international symposium on handheld and ubiquitous computing, Springer-Verlag, Berlin, Heidelberg, HUC \u201999, pp 304\u2013307","DOI":"10.1007\/3-540-48157-5_29"},{"key":"3693_CR2","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1007\/978-3-642-02583-9_47","volume-title":"Human-computer interaction. Interacting in various application domains","author":"R Al-Nanih","year":"2009","unstructured":"Al-Nanih R, Al-Nuaim H, Ormandjieva O (2009) New health information systems (HIS) quality-in-use model based on the GQM approach and HCI principles. In: Jacko JA (ed) Human-computer interaction. Interacting in various application domains. Springer, Berlin, pp 429\u2013438. https:\/\/doi.org\/10.1007\/978-3-642-02583-9_47"},{"key":"3693_CR3","doi-asserted-by":"crossref","unstructured":"Alnanih R, Ormandjieva O, Radhakrishnan T (2013) A new quality-in-use model for mobile user interfaces. In: 2013 Joint Conference of the 23rd International Workshop on Software Measurement and the 8th International Conference on Software Process and Product Measurement, pp 165\u2013170","DOI":"10.1109\/IWSM-Mensura.2013.32"},{"key":"3693_CR4","doi-asserted-by":"publisher","unstructured":"Alshareet O, Itradat A, Doush IA, Quttoum A (2018) Incorporation of ISO 25010 with machine learning to develop a novel quality in use prediction system (QiUPS). Int J Syst Assur Eng Manag 9(2):344\u2013353. https:\/\/doi.org\/10.1007\/s13198-017-0649-x, http:\/\/link.springer.com\/10.1007\/s13198-017-0649-x","DOI":"10.1007\/s13198-017-0649-x"},{"key":"3693_CR5","unstructured":"Arthur D, Vassilvitskii S (2007) K-means++: The advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, SODA \u201907, pp 1027\u20131035"},{"key":"3693_CR6","doi-asserted-by":"publisher","unstructured":"Atoum I (2020) A novel framework for measuring software Quality-in-Use based on semantic similarity and sentiment analysis of software reviews. J King Saud Univ Comput Inf Sci 32(1):113\u2013125, https:\/\/doi.org\/10.1016\/j.jksuci.2018.04.012, http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1319157817305268","DOI":"10.1016\/j.jksuci.2018.04.012"},{"key":"3693_CR7","doi-asserted-by":"publisher","unstructured":"Augusto JC, Jose Quinde M, Oguego CL (2019) Context-aware systems testing and validation. In: 2019 10th International Conference on Dependable Systems, Services and Technologies (DESSERT), pp 7\u201312, https:\/\/doi.org\/10.1109\/DESSERT.2019.8770048","DOI":"10.1109\/DESSERT.2019.8770048"},{"key":"3693_CR8","doi-asserted-by":"publisher","unstructured":"Ben Ayed E, Kolski C, Magdich R, Ezzedine H (2016) Towards a context based evaluation support system for quality in use assessment of mobile systems. In: 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp 004350\u2013004355, https:\/\/doi.org\/10.1109\/SMC.2016.7844915","DOI":"10.1109\/SMC.2016.7844915"},{"issue":"1","key":"3693_CR9","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/S0164-1212(99)00070-9","volume":"49","author":"N Bevan","year":"1999","unstructured":"Bevan N (1999) Quality in use: meeting user needs for quality. J Syst Softw 49(1):89\u201396. https:\/\/doi.org\/10.1016\/S0164-1212(99)00070-9","journal-title":"J Syst Softw"},{"key":"3693_CR10","doi-asserted-by":"crossref","unstructured":"Brereton P, Kitchenham B, Budgen D, Li Z (2008) Using a protocol template for case study planning. In: Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering, BCS Learning & Development Ltd., Swindon, GBR, EASE 2008, pp 41\u201348","DOI":"10.14236\/ewic\/EASE2008.5"},{"key":"3693_CR11","doi-asserted-by":"publisher","unstructured":"Capdevila MG, Saltiveri TG, Garrido JE, M\u00fcller OH, Ruas LC (2021) Do current user testing practices meet the needs of the new interactive paradigms? In: Proceedings of the XXI International Conference on Human Computer Interaction, Association for Computing Machinery, New York, NY, USA, Interacci\u00f3n \u201921, https:\/\/doi.org\/10.1145\/3471391.3471416, https:\/\/doi.org\/10.1145\/3471391.3471416","DOI":"10.1145\/3471391.3471416"},{"key":"3693_CR12","doi-asserted-by":"publisher","unstructured":"Caron F, Vanthienen J, Baesens B (2013) Comprehensive rule-based compliance checking and risk management with process mining. Decis Support Syst 54(3):1357\u20131369. https:\/\/doi.org\/10.1016\/j.dss.2012.12.012, https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0167923612003788","DOI":"10.1016\/j.dss.2012.12.012"},{"issue":"3","key":"3693_CR13","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1007\/s11219-016-9320-z","volume":"25","author":"RM Carvalho","year":"2017","unstructured":"Carvalho RM, Castro Andrade RM, Oliveira KM, Sousa Santos I, Bezerra CI (2017) Quality characteristics and measures for human\u2013computer interaction evaluation in ubiquitous systems. Software Qual J 25(3):743\u2013795. https:\/\/doi.org\/10.1007\/s11219-016-9320-z","journal-title":"Software Qual J"},{"issue":"4","key":"3693_CR14","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1504\/IJCCBS.2016.081808","volume":"6","author":"TA Cherfia","year":"2017","unstructured":"Cherfia TA, Belala F, Barkaoui K (2017) A bigraph-based framework for specification and analysis of context-aware systems. Int J Crit Comput-Based Syst 6(4):322\u2013342. https:\/\/doi.org\/10.1504\/IJCCBS.2016.081808","journal-title":"Int J Crit Comput-Based Syst"},{"key":"3693_CR15","unstructured":"Chrissis MB, Konrad M, Shrum S (2011) CMMI for development: guidelines for process integration and product improvement, 3rd edn. SEI Series in Software Engineering, Addison-Wesley, Upper Saddle River, NJ, http:\/\/my.safaribooksonline.com\/9780321711502"},{"key":"3693_CR16","doi-asserted-by":"publisher","unstructured":"de Medeiros AKA, van Dongen BF, van der Aalst WMP, Weijters AJMM (2004) Process mining for ubiquitous mobile systems: an overview and a concrete algorithm. In: Proceedings of the Second CAiSE Conference on Ubiquitous Mobile Information and Collaboration Systems, Springer-Verlag, Berlin, Heidelberg, UMICS 04:151\u2013165. https:\/\/doi.org\/10.1007\/978-3-540-30188-2_12, https:\/\/doi.org\/10.1007\/978-3-540-30188-2%5F12","DOI":"10.1007\/978-3-540-30188-2_12"},{"key":"3693_CR17","doi-asserted-by":"publisher","unstructured":"de\u00a0Sousa\u00a0Santos I, de\u00a0Castro\u00a0Andrade RM, Rocha LS, Matalonga S, [de Oliveira] KM, Travassos GH (2017) Test case design for context-aware applications: Are we there yet? Inf Softw Technol 88:1\u201316, https:\/\/doi.org\/10.1016\/j.infsof.2017.03.008, http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0950584917302513","DOI":"10.1016\/j.infsof.2017.03.008"},{"key":"3693_CR18","doi-asserted-by":"publisher","unstructured":"Djoudi B, Bouanaka C, Zeghib N (2016) A formal framework for context-aware systems specification and verification. J Syst Softw 122:445\u2013462, https:\/\/doi.org\/10.1016\/j.jss.2015.11.035, http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0164121215002599","DOI":"10.1016\/j.jss.2015.11.035"},{"key":"3693_CR19","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-01492-5","volume-title":"Handbook of weighted automata","author":"M Droste","year":"2009","unstructured":"Droste M, Kuich W, Vogler H (2009) Handbook of weighted automata, 1st edn. Springer Publishing Company, Berlin (Incorporated)","edition":"1"},{"key":"3693_CR20","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1016\/j.knosys.2012.08.005","volume":"37","author":"R Duque","year":"2013","unstructured":"Duque R, Bravo C, Ortega M (2013) An ontological approach to automating collaboration and interaction analysis in groupware systems. Knowl-Based Syst 37:211\u2013229","journal-title":"Knowl-Based Syst"},{"key":"3693_CR21","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1007\/978-3-030-42517-3_32","volume-title":"Applied technologies","author":"L Erazo-Garzon","year":"2020","unstructured":"Erazo-Garzon L, Erraez J, Cedillo P, Illescas-Pe\u00f1a L (2020) Quality assessment approaches for ambient assisted living systems: a systematic review. In: Botto-Tobar M, Zambrano Vizuete M, Torres-Carri\u00f3n P, Montes Le\u00f3n S, Pizarro V\u00e1squez G, Durakovic B (eds) Applied technologies. Springer International Publishing, Cham, pp 421\u2013439"},{"key":"3693_CR22","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1007\/978-3-030-71503-8_50","volume-title":"Applied technologies","author":"L Erazo-Garzon","year":"2021","unstructured":"Erazo-Garzon L, Illescas-Pe\u00f1a L, Cedillo P (2021) A quality in use model for ambient assisted living (AAL) systems. In: Botto-Tobar M, Montes Le\u00f3n S, Camacho O, Ch\u00e1vez D, Torres-Carri\u00f3n P, Zambrano Vizuete M (eds) Applied technologies. Springer International Publishing, Cham, pp 643\u2013660"},{"key":"3693_CR23","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1007\/978-3-642-02710-9_19","volume-title":"Universal access in human-computer interaction. Intelligent and ubiquitous interaction environments","author":"C Fern\u00e1ndez","year":"2009","unstructured":"Fern\u00e1ndez C, L\u00e1zaro JP, Bened\u00ed JM (2009) Workflow mining application to ambient intelligence behavior modeling. In: Stephanidis C (ed) Universal access in human-computer interaction. Intelligent and ubiquitous interaction environments. Springer, Berlin, pp 160\u2013167"},{"issue":"3","key":"3693_CR24","doi-asserted-by":"publisher","first-page":"15:1","DOI":"10.1145\/3184646","volume":"12","author":"D Fogli","year":"2018","unstructured":"Fogli D, Guida G (2018) Evaluating quality in use of corporate web sites: an empirical investigation. ACM Trans Web 12(3):15:1-15:35","journal-title":"ACM Trans Web"},{"key":"3693_CR25","doi-asserted-by":"publisher","unstructured":"Gadler D, Mairegger M, Janes A, Russo B (2017) Mining logs to model the use of a system. In: 2017 ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), pp 334\u2013343, https:\/\/doi.org\/10.1109\/ESEM.2017.47","DOI":"10.1109\/ESEM.2017.47"},{"issue":"1","key":"3693_CR26","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1007\/s00766-018-00308-3","volume":"25","author":"M Ghasemi","year":"2020","unstructured":"Ghasemi M, Amyot D (2020) From event logs to goals: a systematic literature review of goal-oriented process mining. Requir Eng 25(1):67\u201393. https:\/\/doi.org\/10.1007\/s00766-018-00308-3","journal-title":"Requir Eng"},{"key":"3693_CR27","doi-asserted-by":"publisher","unstructured":"Hynninen T, Kasurinen J, Taipale O (2018) Framework for observing the maintenance needs, runtime metrics and the overall Quality-in-Use. J Softw Eng Appl 11(04):139\u2013152. https:\/\/doi.org\/10.4236\/jsea.2018.114009, http:\/\/www.scirp.org\/journal\/doi.aspx?DOI=10.4236\/jsea.2018.114009","DOI":"10.4236\/jsea.2018.114009"},{"key":"3693_CR28","unstructured":"International Organization for Standardization (2010) ISO 9241-210:2010 - Ergonomics of human-system interaction \u2013 Part 210: Human-centred design for interactive systems"},{"key":"3693_CR29","unstructured":"ISO, IEC 25010, (2011) ISO 25010\u2014Systems and software quality requirements and evaluation (SQuaRE)\u2014system and software quality models. Iso\/Iec Fdis 25010:2011"},{"key":"3693_CR30","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1007\/978-981-15-1377-0_40","volume-title":"Computer supported cooperative work and social computing","author":"Y Jiang","year":"2019","unstructured":"Jiang Y, Hu T, Zhao H (2019) Users\u2019 comment mining for app software\u2019s Quality-in-Use. In: Sun Y, Lu T, Yu Z, Fan H, Gao L (eds) Computer supported cooperative work and social computing. Springer, Singapore, pp 510\u2013525"},{"key":"3693_CR31","doi-asserted-by":"publisher","unstructured":"Kim SH, Kim WJ (2019) Evaluation of software quality-in-use attributes based on analysis network process. Cluster Comput 22(S1):2101\u20132114. https:\/\/doi.org\/10.1007\/s10586-018-2309-6, http:\/\/link.springer.com\/10.1007\/s10586-018-2309-6","DOI":"10.1007\/s10586-018-2309-6"},{"key":"3693_CR32","doi-asserted-by":"publisher","unstructured":"Leopairote W, Surarerks A, Prompoon N (2013) Evaluating software quality in use using user reviews mining. In: The 2013 10th International Joint Conference on Computer Science and Software Engineering (JCSSE), IEEE, pp 257\u2013262, https:\/\/doi.org\/10.1109\/JCSSE.2013.6567355, https:\/\/ieeexplore.ieee.org\/document\/6567355","DOI":"10.1109\/JCSSE.2013.6567355"},{"key":"3693_CR33","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1007\/s10664-005-1290-x","volume":"10","author":"T Lethbridge","year":"2005","unstructured":"Lethbridge T, Sim S, Singer J (2005) Studying software engineers: data collection techniques for software field studies. Empir Softw Eng 10:311\u2013341. https:\/\/doi.org\/10.1007\/s10664-005-1290-x","journal-title":"Empir Softw Eng"},{"key":"3693_CR34","doi-asserted-by":"crossref","unstructured":"Liu Y, Li Z, Xiong H, Gao X, Wu J (2010) Understanding of internal clustering validation measures. In: 2010 IEEE International Conference on Data Mining, pp 911\u2013916","DOI":"10.1109\/ICDM.2010.35"},{"key":"3693_CR35","doi-asserted-by":"publisher","unstructured":"Lu H, Chan WK, Tse TH (2006) Testing context-aware middleware-centric programs: a data flow approach and an rfid-based experimentation. In: Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering, Association for Computing Machinery, New York, NY, USA, SIGSOFT \u201906\/FSE-14, pp 242\u2013252, https:\/\/doi.org\/10.1145\/1181775.1181805","DOI":"10.1145\/1181775.1181805"},{"key":"3693_CR36","doi-asserted-by":"publisher","unstructured":"Maguire M (2001) Context of use within usability activities. Int J Hum-Comput Stud 55(4):453\u2013483. https:\/\/doi.org\/10.1006\/ijhc.2001.0486, https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S1071581901904860","DOI":"10.1006\/ijhc.2001.0486"},{"key":"3693_CR37","doi-asserted-by":"publisher","first-page":"46568","DOI":"10.1109\/ACCESS.2018.2865213","volume":"6","author":"AM Mirza","year":"2018","unstructured":"Mirza AM, Khan MNA (2018) An automated functional testing framework for context-aware applications. IEEE Access 6:46568\u201346583","journal-title":"IEEE Access"},{"key":"3693_CR38","doi-asserted-by":"publisher","unstructured":"M\u00fcllner D (2013) Fastcluster: fast hierarchical, agglomerative clustering routines for R and Python. J Stat Softw 53(9), https:\/\/doi.org\/10.18637\/jss.v053.i09, http:\/\/www.jstatsoft.org\/v53\/i09\/","DOI":"10.18637\/jss.v053.i09"},{"key":"3693_CR39","doi-asserted-by":"publisher","unstructured":"Orehova\u010dki T, Grani\u0107 A, Kermek D (2013) Evaluating the perceived and estimated quality in use of web 2.0 applications. J Syst Softw 86(12):3039\u20133059, https:\/\/doi.org\/10.1016\/j.jss.2013.05.071, http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0164121213001362","DOI":"10.1016\/j.jss.2013.05.071"},{"key":"3693_CR40","doi-asserted-by":"publisher","unstructured":"Osman NB, Osman IM (2013) Attributes for the quality in use of mobile government systems. In: 2013 International conference on computing, electrical and electronic engineering (ICCEEE), pp 274\u2013279, https:\/\/doi.org\/10.1109\/ICCEEE.2013.6633947","DOI":"10.1109\/ICCEEE.2013.6633947"},{"key":"3693_CR41","doi-asserted-by":"publisher","unstructured":"Penichet V, Marin I, Gallud J, Lozano M, Tesoriero R (2007) A classification method for CSCW systems. Electron Notes Theor Comput Sci 168:237\u2013247, https:\/\/doi.org\/10.1016\/j.entcs.2006.12.007, http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1571066107000394 (proceedings of the Second International Workshop on Views on Designing Complex Architectures (VODCA 2006))","DOI":"10.1016\/j.entcs.2006.12.007"},{"key":"3693_CR42","doi-asserted-by":"publisher","unstructured":"Qian Z, Wan C, Chen Y (2016) Evaluating Quality-in-Use of floss through analyzing user reviews. In: 2016 17th IEEE\/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel\/Distributed Computing (SNPD), pp 547\u2013552, https:\/\/doi.org\/10.1109\/SNPD.2016.7515956","DOI":"10.1109\/SNPD.2016.7515956"},{"key":"3693_CR43","doi-asserted-by":"publisher","unstructured":"Rana R, Staron M (2015) Machine learning approach for quality assessment and prediction in large software organizations. In: 2015 6th IEEE International Conference on Software Engineering and Service Science (ICSESS), IEEE, vol 2015-Novem, pp 1098\u20131101, https:\/\/doi.org\/10.1109\/ICSESS.2015.7339243, http:\/\/ieeexplore.ieee.org\/document\/7339243\/","DOI":"10.1109\/ICSESS.2015.7339243"},{"key":"3693_CR44","doi-asserted-by":"publisher","unstructured":"Rauschenberger M, Schrepp M, Perez-Cota M, Olschner S, Thomaschewski J (2013) Efficient measurement of the user experience of interactive products. How to use the user experience questionnaire (UEQ). Example: Spanish language version. Int J Interact Multimed Artif Intell 2(1):39. https:\/\/doi.org\/10.9781\/ijimai.2013.215","DOI":"10.9781\/ijimai.2013.215"},{"key":"3693_CR45","doi-asserted-by":"publisher","DOI":"10.1002\/9781118181034","volume-title":"Case study research in software engineering: guidelines and examples","author":"P Runeson","year":"2012","unstructured":"Runeson P, Host M, Rainer A, Regnell B (2012) Case study research in software engineering: guidelines and examples, 1st edn. Wiley Publishing, Hoboken","edition":"1"},{"key":"3693_CR46","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1007\/978-3-540-87481-2_21","volume-title":"Machine learning and knowledge discovery in databases","author":"Y Saeys","year":"2008","unstructured":"Saeys Y, Abeel T, Van de Peer Y (2008) Robust feature selection using ensemble feature selection techniques. In: Daelemans W, Goethals B, Morik K (eds) Machine learning and knowledge discovery in databases. Springer, Berlin, pp 313\u2013325"},{"key":"3693_CR47","doi-asserted-by":"publisher","unstructured":"Salom\u00f3n S, Duque R, Monta\u00f1a JL, Ten\u00e9s L (2019) A method for analyzing the Quality-in-Use in collaborative contexts. In: Proceedings of the XX International Conference on Human Computer Interaction, Association for Computing Machinery, New York, NY, USA, Interaccion \u201919, https:\/\/doi.org\/10.1145\/3335595.3335633","DOI":"10.1145\/3335595.3335633"},{"issue":"5","key":"3693_CR48","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1109\/65.313011","volume":"8","author":"BN Schilit","year":"1994","unstructured":"Schilit BN, Theimer MM (1994) Disseminating active map information to mobile hosts. Network Mag Global Internet Wkg 8(5):22\u201332. https:\/\/doi.org\/10.1109\/65.313011","journal-title":"Network Mag Global Internet Wkg"},{"key":"3693_CR49","doi-asserted-by":"publisher","DOI":"10.1007\/BF01324126","author":"A Schmidt","year":"1999","unstructured":"Schmidt A (1999) Implicit human computer interaction through context. Personal Technol. https:\/\/doi.org\/10.1007\/BF01324126","journal-title":"Personal Technol"},{"key":"3693_CR50","doi-asserted-by":"publisher","unstructured":"Seffah A, Donyaee M, Kline RB, Padda HK (2006) Usability measurement and metrics: a consolidated model. Softw Qual J 14(2):159\u2013178. https:\/\/doi.org\/10.1007\/s11219-006-7600-8, http:\/\/link.springer.com\/10.1007\/s11219-006-7600-8","DOI":"10.1007\/s11219-006-7600-8"},{"key":"3693_CR51","doi-asserted-by":"publisher","unstructured":"Souza-Pereira L, Ouhbi S, Pombo N (2021) Quality-in-Use characteristics for clinical decision support system assessment. Comput Method Programs Biomed 207:106169. https:\/\/doi.org\/10.1016\/j.cmpb.2021.106169, https:\/\/linkinghub.elsevier.com\/retrieve\/pii\/S0169260721002431","DOI":"10.1016\/j.cmpb.2021.106169"},{"key":"3693_CR52","doi-asserted-by":"publisher","unstructured":"van der Aalst W (2012) Process mining. ACM Trans Manag Inf Syst 3(2):1\u201317. https:\/\/doi.org\/10.1145\/2229156.2229157, https:\/\/dl.acm.org\/doi\/10.1145\/2229156.2229157","DOI":"10.1145\/2229156.2229157"},{"issue":"9","key":"3693_CR53","doi-asserted-by":"publisher","first-page":"1128","DOI":"10.1109\/TKDE.2004.47","volume":"16","author":"W van der Aalst","year":"2004","unstructured":"van der Aalst W, Weijters T, Maruster L (2004) Workflow mining: discovering process models from event logs. IEEE Trans Knowl Data Eng 16(9):1128\u20131142. https:\/\/doi.org\/10.1109\/TKDE.2004.47","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"3693_CR54","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1007\/11494744_5","volume-title":"Applications and theory of Petri nets 2005","author":"WMP van der Aalst","year":"2005","unstructured":"van der Aalst WMP, de Medeiros AKA, Weijters AJMM (2005) Genetic process mining. In: Ciardo G, Darondeau P (eds) Applications and theory of Petri nets 2005. Springer, Berlin, pp 48\u201369"},{"key":"3693_CR55","volume-title":"Test planning with TMMi practices: assuring the quality by applying continuous test planning methods with TMMi practices","author":"SK Vemulapalli","year":"2015","unstructured":"Vemulapalli SK (2015) Test planning with TMMi practices: assuring the quality by applying continuous test planning methods with TMMi practices, vol 1. CreateSpace Independent Publishing Platform, North Charleston"},{"key":"3693_CR56","doi-asserted-by":"publisher","unstructured":"Weijters AJMM, Ribeiro JTS (2011) Flexible heuristics miner (FHM). In: 2011 IEEE symposium on computational intelligence and data mining (CIDM), pp 310\u2013317, https:\/\/doi.org\/10.1109\/CIDM.2011.5949453","DOI":"10.1109\/CIDM.2011.5949453"},{"key":"3693_CR57","unstructured":"Yin RK (2008) Case study research: design and methods (applied social research methods), fourth edition. edn. Sage Publications"}],"container-title":["Journal of Ambient Intelligence and Humanized Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12652-021-03693-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12652-021-03693-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12652-021-03693-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,21]],"date-time":"2023-06-21T15:15:52Z","timestamp":1687360552000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12652-021-03693-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,5]]},"references-count":57,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["3693"],"URL":"https:\/\/doi.org\/10.1007\/s12652-021-03693-w","relation":{},"ISSN":["1868-5137","1868-5145"],"issn-type":[{"value":"1868-5137","type":"print"},{"value":"1868-5145","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,5]]},"assertion":[{"value":"21 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}