{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T02:36:22Z","timestamp":1782354982600,"version":"3.54.5"},"reference-count":54,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T00:00:00Z","timestamp":1675036800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T00:00:00Z","timestamp":1675036800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Objective\/aim<\/jats:title>\n                <jats:p>Good design of cancer registry systems makes them easy to use, while poor design of their user interfaces leads to user dissatisfaction and resistance. The objective of this study was to evaluate the usability of a cancer registry system using Cognitive Walkthrough (CW) and to assess users' agreement with its usability problems.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>CW was used to evaluate the registry system. We developed a checklist to help evaluators speed up the evaluation process, a problems form to collect the usability issues identified by the evaluators, and a problems severity form to determine the severity of problems by the evaluators. The problems were classified into two categories according to the CW questions and the system tasks. The agreement of the users with the system problems was examined by an online questionnaire. Users' agreement with the problems was then analyzed using the Interclass Correlation Coefficient in the SPSS 22 (Statistical Package for Social Science).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>In this study, 114 problems were identified. In the categorization of problems based on the CW questions, 41% (n\u2009=\u200947) of the problems concerned the issue of \u201cusers do not know what to do at each stage of working with the system\u201d, 24% (n\u2009=\u200927) were classified as \u201cusers cannot link what they intend to do with system controls\u201d, and 22% (n\u2009=\u200925) were related to \u201cuser's lack of understanding of the system processes\u201d. Based on user tasks, about 36% (n\u2009=\u200941) of the problems were related to \u201cremoving patient duplication\u201d and 33% (n\u2009=\u200938) were related to \u201cregistration of patient identification information\u201d. User agreement with the problems was high (CI 95%\u2009=\u20090.9 (0.96, 0.98)).\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>System problems often originate from user ignorance about what to do at each stage of using the system. Also, half of the system problems concern a mismatch between what users want to do and the system controls, or a lack of understanding about what the system does at different stages. Therefore, to avoid user confusion, designers should use clues and guides on the screen for users, design controls consistent with the user model of thinking, and provide appropriate feedback after each user action to help users understand what the system is doing. The high agreement of users with the problems showed that in the absence of users system designers can use CW to identify the problems that users face in the real environment.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-023-02120-8","type":"journal-article","created":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T16:04:54Z","timestamp":1675094694000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Evaluating the usability of a cancer registry system using Cognitive Walkthrough, and assessing user agreement with its problems"],"prefix":"10.1186","volume":"23","author":[{"given":"Fatemeh","family":"Bagheri","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Faezeh","family":"Abbasi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mojtaba","family":"Sadeghi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Reza","family":"Khajouei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,1,30]]},"reference":[{"key":"2120_CR1","unstructured":"World Health Organization (WHO). Cancer. 2019. https:\/\/www.who.int\/cancer\/en\/. Accessed 22 Dec 2022."},{"issue":"2","key":"2120_CR2","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/S1470-2045(08)70028-7","volume":"9","author":"MG Valsecchi","year":"2008","unstructured":"Valsecchi MG, Steliarova-Foucher E. Cancer registration in developing countries: luxury or necessity? Lancet Oncol. 2008;9(2):159\u201367.","journal-title":"Lancet Oncol"},{"issue":"2","key":"2120_CR3","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1007\/s10147-008-0768-0","volume":"13","author":"T Sobue","year":"2008","unstructured":"Sobue T. Cancer registration system: an introduction. Int J Clin Oncol. 2008;13(2):89.","journal-title":"Int J Clin Oncol"},{"issue":"8","key":"2120_CR4","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1016\/j.ijmedinf.2010.05.001","volume":"79","author":"J Choi","year":"2010","unstructured":"Choi J, Bakken S. Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing. Int J Med Informatics. 2010;79(8):565\u201375.","journal-title":"Int J Med Informatics"},{"key":"2120_CR5","doi-asserted-by":"publisher","DOI":"10.4324\/9781410607157","volume-title":"Multimedia and virtual reality: designing multisensory user interfaces","author":"A Sutcliffe","year":"2003","unstructured":"Sutcliffe A. Multimedia and virtual reality: designing multisensory user interfaces. 1st ed. New York: Psychology Press; 2003.","edition":"1"},{"issue":"e1","key":"2120_CR6","doi-asserted-by":"publisher","first-page":"e55","DOI":"10.1093\/jamia\/ocw100","volume":"24","author":"R Khajouei","year":"2017","unstructured":"Khajouei R, Zahiri Esfahani M, Jahani Y. Comparison of heuristic and cognitive walkthrough usability evaluation methods for evaluating health information systems. J Am Med Inform Assoc. 2017;24(e1):e55\u201360.","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2120_CR7","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1197\/jamia.M2187","volume":"14","author":"SR Simon","year":"2007","unstructured":"Simon SR, Kaushal R, Cleary PD, Jenter CA, Volk LA, Poon EG, et al. Correlates of electronic health record adoption in office practices: a statewide survey. J Am Med Inform Assoc. 2007;14(1):110\u20137.","journal-title":"J Am Med Inform Assoc"},{"key":"2120_CR8","doi-asserted-by":"publisher","unstructured":"Nielsen J. Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI conference on human factors in computing systems; Monterey, California, USA: ASSOCIATION for Computing Machinery; 1992. DOI:https:\/\/doi.org\/10.1145\/142750.142834.","DOI":"10.1145\/142750.142834"},{"key":"2120_CR9","doi-asserted-by":"publisher","DOI":"10.5812\/jcrps.80331","author":"Z Yasemi","year":"2018","unstructured":"Yasemi Z, Rahimi B, Khajouei R, Yusefzadeh H. Evaluating the usability of a nationwide pharmacy information system in Iran: application of Nielson\u2019s heuristics. J Clin Res Paramed Sci. 2018. https:\/\/doi.org\/10.5812\/jcrps.80331.","journal-title":"J Clin Res Paramed Sci"},{"key":"2120_CR10","unstructured":"ISO. ISO Online browsing platform. In: Switzerland. 2018. https:\/\/www.iso.org\/obp\/ui\/#iso:std:iso:9241:-11:ed-2:v1:en. Accessd 12 Dec 2022."},{"key":"2120_CR11","doi-asserted-by":"publisher","first-page":"224","DOI":"10.11604\/pamj.2018.29.224.12683","volume":"29","author":"M Sibanda","year":"2018","unstructured":"Sibanda M, Summers R, Meyer JC. A comparison of five international clinical trial registers with the South African register for access to information and usability. Pan Afr Med J. 2018;29:224.","journal-title":"Pan Afr Med J"},{"key":"2120_CR12","volume-title":"Usability engineering","author":"J Nielsen","year":"1994","unstructured":"Nielsen J. Usability engineering. Amsterdam: Elsevier Sciense; 1994."},{"key":"2120_CR13","unstructured":"Nielsen J, editor. Usability engineering at a discount. In: Proceedings of the third international conference on human-computer interaction on Designing and using human-computer interfaces and knowledge based systems (2nd ed); 1989."},{"key":"2120_CR14","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.jbi.2019.103110","volume":"91","author":"M Georgsson","year":"2019","unstructured":"Georgsson M, Staggers N, \u00c5rsand E, Kushniruk A. Employing a user-centered cognitive walkthrough to evaluate a mHealth diabetes self-management application: a case study and beginning method validation. J Biomed Inform. 2019;91:103\u201310.","journal-title":"J Biomed Inform"},{"key":"2120_CR15","doi-asserted-by":"crossref","unstructured":"Lewis C, Wharton C. Cognitive walkthroughs. In: Handbook of human-computer interaction (1st ed). Amsterdam: Elsevier; 1997.","DOI":"10.1016\/B978-044481862-1.50096-0"},{"key":"2120_CR16","doi-asserted-by":"publisher","DOI":"10.1155\/2013\/931698","author":"L-O Blig\u00e5rd","year":"2013","unstructured":"Blig\u00e5rd L-O, Osvalder A-L. Enhanced cognitive walkthrough: development of the cognitive walkthrough method to better predict, identify, and present usability problems. Adv Hum-Comput Interact. 2013. https:\/\/doi.org\/10.1155\/2013\/931698.","journal-title":"Adv Hum-Comput Interact"},{"key":"2120_CR17","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.ijmedinf.2018.05.012","volume":"117","author":"R Khajouei","year":"2018","unstructured":"Khajouei R, Ameri A, Jahani Y. Evaluating the agreement of users with usability problems identified by heuristic evaluation. Int J Med Inform. 2018;117:13\u20138.","journal-title":"Int J Med Inform"},{"issue":"2","key":"2120_CR18","first-page":"1295","volume":"107","author":"T Cohen","year":"2004","unstructured":"Cohen T, Kaufman D, White T, Segal G, Staub AB, Patel V, et al. Cognitive evaluation of an innovative psychiatric clinical knowledge enhancement system. Stud Health Technol Inform. 2004;107(2):1295\u20139.","journal-title":"Stud Health Technol Inform"},{"key":"2120_CR19","first-page":"331","volume":"208","author":"E Usselman","year":"2015","unstructured":"Usselman E, Borycki EM, Kushniruk AW. The evaluation of electronic perioperative nursing documentation using a cognitive walkthrough approach. Stud Health Technol Inform. 2015;208:331\u20136.","journal-title":"Stud Health Technol Inform"},{"issue":"4","key":"2120_CR20","doi-asserted-by":"publisher","first-page":"6682","DOI":"10.19082\/6682","volume":"10","author":"AK Ghalibaf","year":"2018","unstructured":"Ghalibaf AK, Jangi M, Habibi MRM, Zangouei S, Khajouei R. Usability evaluation of obstetrics and gynecology information system using cognitive walkthrough method. Electron Physician. 2018;10(4):6682\u20138.","journal-title":"Electron Physician"},{"issue":"3","key":"2120_CR21","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1207\/s15327590ijhc0903_2","volume":"9","author":"A Sears","year":"1997","unstructured":"Sears A. Heuristic walkthroughs: finding the problems without the noise. Int J Hum-Comput Interact. 1997;9(3):213\u201334.","journal-title":"Int J Hum-Comput Interact"},{"issue":"1","key":"2120_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-022-01905-7","volume":"22","author":"M Farzandipour","year":"2022","unstructured":"Farzandipour M, Nabovati E, Sadeqi JM. Comparison of usability evaluation methods for a health information system: heuristic evaluation versus cognitive walkthrough method. BMC Med Inform Decis Mak. 2022;22(1):1\u201311.","journal-title":"BMC Med Inform Decis Mak"},{"key":"2120_CR23","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/j.ijmedinf.2018.11.012","volume":"122","author":"M Beauchemin","year":"2019","unstructured":"Beauchemin M, Gradilla M, Baik D, Cho H, Schnall R. A multi-step usability evaluation of a self-management app to support medication adherence in persons living with HIV. Int J Med Inform. 2019;122:37\u201344.","journal-title":"Int J Med Inform"},{"key":"2120_CR24","first-page":"185","volume":"261","author":"M Georgsson","year":"2019","unstructured":"Georgsson M. NASA RTLX as a novel assessment for determining cognitive load and user acceptance of expert and user-based evaluation methods exemplified through a mHealth diabetes self-management application evaluation. Stud Health Technol Inform. 2019;261:185\u201390.","journal-title":"Stud Health Technol Inform"},{"key":"2120_CR25","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.ijmedinf.2007.05.007","volume":"76","author":"T-Y Lai","year":"2007","unstructured":"Lai T-Y. Iterative refinement of a tailored system for self-care management of depressive symptoms in people living with HIV\/AIDS through heuristic evaluation and end user testing. Int J Med Inform. 2007;76:17\u201324.","journal-title":"Int J Med Inform"},{"issue":"2","key":"2120_CR26","doi-asserted-by":"publisher","first-page":"e24998","DOI":"10.2196\/24998","volume":"9","author":"BS Langlet","year":"2021","unstructured":"Langlet BS, Odegi D, Zandian M, Nolstam J, S\u00f6dersten P, Bergh C. Virtual reality app for treating eating behavior in eating disorders: development and usability study. JMIR Serious Games. 2021;9(2):e24998.","journal-title":"JMIR Serious Games"},{"issue":"2","key":"2120_CR27","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1207\/s15327051hci0502&3_3","volume":"5","author":"PG Polson","year":"1990","unstructured":"Polson PG, Lewis CH. Theory-based design for easily learned interfaces. Hum-Comput Interact. 1990;5(2):191\u2013220.","journal-title":"Hum-Comput Interact"},{"issue":"5","key":"2120_CR28","doi-asserted-by":"publisher","first-page":"741","DOI":"10.1016\/0020-7373(92)90039-N","volume":"36","author":"PG Polson","year":"1992","unstructured":"Polson PG, Lewis C, Rieman J, Wharton C. Cognitive walkthroughs: a method for theory-based evaluation of user interfaces. Int J Man Mach Stud. 1992;36(5):741\u201373.","journal-title":"Int J Man Mach Stud"},{"issue":"4","key":"2120_CR29","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1145\/2133806.2133824","volume":"55","author":"M Schmettow","year":"2012","unstructured":"Schmettow M. Sample size in usability studies. Commun ACM. 2012;55(4):64\u201370.","journal-title":"Commun ACM"},{"key":"2120_CR30","unstructured":"Philips M. Heuristic analysis for UX: How to run a usability evaluation. 2010\u201322 https:\/\/www.toptal.com\/designers\/usability-testing\/usability-analysis-how-to-run-a-heuristic-evaluation. Accessed 12 Dec 2022."},{"issue":"5","key":"2120_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2506210","volume":"20","author":"S Borsci","year":"2013","unstructured":"Borsci S, Macredie RD, Barnett J, Martin J, Kuljis J, Young T. Reviewing and extending the five-user assumption: a grounded procedure for interaction evaluation. ACM Trans Comput-Hum Interact (TOCHI). 2013;20(5):1\u201323.","journal-title":"ACM Trans Comput-Hum Interact (TOCHI)"},{"key":"2120_CR32","unstructured":"Shliachkov V. Sample size for usability study. Part 1. About Nielsen and probability. 2019. https:\/\/uxplanet.org\/sample-size-for-usability-study-part-1-about-nielsen-and-probability-efffecdbfa95. Accessed 12 Dec 2022."},{"issue":"3","key":"2120_CR33","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1016\/S1553-7250(13)39019-9","volume":"39","author":"ES Patterson","year":"2013","unstructured":"Patterson ES, Zhang J, Abbott P, Gibbons MC, Lowry SZ, Quinn MT, et al. Enhancing electronic health record usability in pediatric patient care: a scenario-based approach. Jt Comm J Qual Patient Safety. 2013;39(3):129\u201335.","journal-title":"Jt Comm J Qual Patient Safety"},{"key":"2120_CR34","doi-asserted-by":"crossref","unstructured":"Nielsen J, Usability inspection methods. In: Conference companion on human factors in computing systems. ConferenceCompan. 1994; 413\u20134.","DOI":"10.1145\/259963.260531"},{"key":"2120_CR35","unstructured":"Travis D. How to prioritise usability problems. 2009. http:\/\/www.userfocus.co.uk\/articles\/prioritise.html. Accessd 12 Dec 2022."},{"issue":"3","key":"2120_CR36","doi-asserted-by":"publisher","first-page":"e11617","DOI":"10.2196\/11617","volume":"3","author":"M Welbie","year":"2019","unstructured":"Welbie M, Wittink H, Westerman MJ, Topper I, Snoei J, Devill\u00e9 WL. A mobile patient-reported outcome measure app with talking touchscreen: usability assessment. JMIR formative research. 2019;3(3):e11617.","journal-title":"JMIR formative research"},{"issue":"6","key":"2120_CR37","doi-asserted-by":"publisher","first-page":"948","DOI":"10.1016\/j.jbi.2011.07.002","volume":"44","author":"R Khajouei","year":"2011","unstructured":"Khajouei R, Peute LW, Hasman A, Jaspers MW. Classification and prioritization of usability problems using an augmented classification scheme. J Biomed Inform. 2011;44(6):948\u201357.","journal-title":"J Biomed Inform"},{"issue":"2","key":"2120_CR38","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1016\/j.jbi.2009.09.002","volume":"43","author":"A Karahoca","year":"2010","unstructured":"Karahoca A, Bayraktar E, Tatoglu E, Karahoca D. Information system design for a hospital emergency department: a usability analysis of software prototypes. J Biomed Inform. 2010;43(2):224\u201332.","journal-title":"J Biomed Inform"},{"key":"2120_CR39","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/j.ijmedinf.2016.07.010","volume":"94","author":"B Brown","year":"2016","unstructured":"Brown B, Balatsoukas P, Williams R, Sperrin M, Buchan I. Interface design recommendations for computerised clinical audit and feedback: hybrid usability evidence from a research-led system. Int J Med Informatics. 2016;94:191\u2013206.","journal-title":"Int J Med Informatics"},{"key":"2120_CR40","unstructured":"Nielsen J. Severity ratings for usability problems. 1994. https:\/\/www.nngroup.com\/articles\/how-to-rate-the-severity-of-usability-problems\/. Accessed 12 Dec 2022."},{"key":"2120_CR41","doi-asserted-by":"crossref","unstructured":"Jadhav D, Bhutkar G, Mehta V. Usability evaluation of messenger applications for Android phones using cognitive walkthrough. In: Proceedings of the 11th Asia pacific conference on computer human interaction. 2013; 9\u201311.","DOI":"10.1145\/2525194.2525202"},{"issue":"1\u20132","key":"2120_CR42","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1016\/S1532-0464(03)00062-5","volume":"36","author":"J Horsky","year":"2003","unstructured":"Horsky J, Kaufman DR, Oppenheim MI, Patel VL. A framework for analyzing the cognitive complexity of computer-assisted clinical ordering. J Biomed Inform. 2003;36(1\u20132):4\u201322.","journal-title":"J Biomed Inform"},{"issue":"2","key":"2120_CR43","doi-asserted-by":"publisher","first-page":"202","DOI":"10.4338\/ACI-2011-01-RA-0004","volume":"2","author":"J Guo","year":"2011","unstructured":"Guo J, Iribarren S, Kapsandoy S, Perri S, Staggers N. Usability evaluation of an electronic medication administration record (eMAR) application. Appl Clin Inform. 2011;2(2):202\u201324.","journal-title":"Appl Clin Inform"},{"key":"2120_CR44","first-page":"92","volume":"9","author":"C Gatsou","year":"2012","unstructured":"Gatsou C, Politis A, Zevgolis D. the importance of mobile interface icons on user interaction. Int J Comput Sci Appl. 2012;9:92\u2013107.","journal-title":"Int J Comput Sci Appl"},{"key":"2120_CR45","first-page":"306","volume":"10","author":"NA Zaini","year":"2019","unstructured":"Zaini NA, Fadzilah S, Siti T. Evaluation of APi interface design by applying cognitive walkthrough. Int J Adv Comput Sci Appl. 2019;10:306\u201315.","journal-title":"Int J Adv Comput Sci Appl"},{"key":"2120_CR46","first-page":"239","volume":"284","author":"A-F Abdulai","year":"2021","unstructured":"Abdulai A-F, Howard AF, Noga H, Yong PJ, Currie LM. Application of Anti-Stigma design heuristics for usability inspection. Stud Health Technol Informatics. 2021;284:239\u201343.","journal-title":"Stud Health Technol Informatics"},{"key":"2120_CR47","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2021.104459","author":"M Farzandipour","year":"2021","unstructured":"Farzandipour M, Nabovati E, Tadayon H, Sadeqi JM. Usability evaluation of a nursing information system by applying cognitive walkthrough method. Int J Med Informatics. 2021. https:\/\/doi.org\/10.1016\/j.ijmedinf.2021.104459.","journal-title":"Int J Med Informatics"},{"issue":"1","key":"2120_CR48","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.sapharm.2019.02.011","volume":"16","author":"RJ Holden","year":"2020","unstructured":"Holden RJ, Campbell NL, Abebe E, Clark DO, Ferguson D, Bodke K, et al. Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults. Res Social Adm Pharm. 2020;16(1):54\u201361.","journal-title":"Res Social Adm Pharm"},{"key":"2120_CR49","first-page":"795","volume-title":"Assessing the usability of a telemedicine-based medication delivery unit for older adults through inspection methods","author":"FM Ligons","year":"2011","unstructured":"Ligons FM, Romagnoli KM, Browell S, Hochheiser HS, Handler SM. Assessing the usability of a telemedicine-based medication delivery unit for older adults through inspection methods. USA: American Medical Informatics Association; 2011. p. 795\u2013804."},{"key":"2120_CR50","first-page":"850","volume-title":"The cognitive demands of an innovative query user interface","year":"2002","unstructured":"Di Wang DRK, Mendonca EA, Seol Y-H, Johnson SB, Cimino JJ, editors. The cognitive demands of an innovative query user interface. USA: American Medical Informatics Association; 2002. p. 850\u20134."},{"key":"2120_CR51","first-page":"714","volume-title":"A comparison of usability evaluation methods: heuristic evaluation versus end-user think-aloud protocol\u2014an example from a web-based communication tool for nurse scheduling","year":"2009","unstructured":"Yen P-Y, Bakken S, editors. A comparison of usability evaluation methods: heuristic evaluation versus end-user think-aloud protocol\u2014an example from a web-based communication tool for nurse scheduling. USA: American Medical Informatics Association; 2009. p. 714\u20138."},{"key":"2120_CR52","doi-asserted-by":"crossref","unstructured":"Maguire M, Isherwood P, editors. A comparison of user testing and heuristic evaluation methods for identifying website usability problems. In: International conference of design, user experience, and usability; 2018; 409\u201329.","DOI":"10.1007\/978-3-319-91797-9_31"},{"key":"2120_CR53","first-page":"356","volume":"2003","author":"DR Kaufman","year":"2003","unstructured":"Kaufman DR, Starren J, Patel VL, Morin PC, Hilliman C, Pevzner J, et al. A cognitive framework for understanding barriers to the productive use of a diabetes home telemedicine system. AMIA Annu Symp Proc AMIA Symp. 2003;2003:356\u201360.","journal-title":"AMIA Annu Symp Proc AMIA Symp"},{"key":"2120_CR54","first-page":"1209","volume":"180","author":"WT Gude","year":"2012","unstructured":"Gude WT, Simon AC, Peute LW, Holleman F, Hoekstra JB, Peek N, et al. Formative usability evaluation of a web-based insulin self-titration system: preliminary results. Stud Health Technol Inform. 2012;180:1209\u201311.","journal-title":"Stud Health Technol Inform"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02120-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-023-02120-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02120-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,21]],"date-time":"2023-04-21T16:51:27Z","timestamp":1682095887000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-023-02120-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,30]]},"references-count":54,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2120"],"URL":"https:\/\/doi.org\/10.1186\/s12911-023-02120-8","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,30]]},"assertion":[{"value":"6 May 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 January 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 January 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"In this study, we did not collect identifiable personal data. The questionnaires were completely filled out without names, surnames, and other identifiable data. Therefore, to participate in the study, oral informed consent was obtained from the participants, and the participants were assured that their information would be kept confidential. This study was approved by the research ethics committee of KUMS (ethics code: IR.KMU.REC.1399.41). In this study, all methods were performed in accordance with the relevant guidelines and regulations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"23"}}