{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T14:06:42Z","timestamp":1780409202726,"version":"3.54.1"},"reference-count":64,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2020,11,11]],"date-time":"2020-11-11T00:00:00Z","timestamp":1605052800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"RESEARCH &amp; TECHNOLOGICAL DEVELOPMENT INCENTIVE SYSTEM (SI I&amp;DT Co-Promotion)","award":["POCI-01-0247-FEDER-017604"],"award-info":[{"award-number":["POCI-01-0247-FEDER-017604"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>Background: Flushing a venous access device is an important procedure to maintain their patency and prevent malfunctioning and complications. An innovative double-chamber syringe was developed, allowing for the assessment of catheter patency, drug delivery and final flush. This study aims to assess the usability of this new device, considering three development stages (concept, semi-functional prototype, functional prototype). Methods: An iterative methodology based on a mix-method design (qualitative and quantitative) enabled the assessment of the devices\u2019 usability by their primary end-users. A usability questionnaire was developed and applied, along with focus groups and individual interviews to nurses. Results: The usability questionnaire integrated 42 items focused on four dimensions (usefulness; ease of use; ease of learning; satisfaction and intention to use). The initial psychometric findings indicate a good internal consistency and the conceptual relevance of the items. The scores seem to be sensitive to the usability evaluation of the medical devices in different stages of product development (with lower values on functional prototype evaluation), and related to nurses\u2019 perceptions about functional and ergonomic characteristics. Conclusions: Quantitative and qualitative data provided a comprehensive overview of the double-chamber syringes\u2019 usability from the nurses\u2019 point of view, informing us of features that must be addressed.<\/jats:p>","DOI":"10.3390\/ijerph17228335","type":"journal-article","created":{"date-parts":[[2020,11,11]],"date-time":"2020-11-11T19:08:28Z","timestamp":1605121708000},"page":"8335","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Usability Assessment of an Innovative Device in Infusion Therapy: A Mix-Method Approach Study"],"prefix":"10.3390","volume":"17","author":[{"given":"Pedro","family":"Parreira","sequence":"first","affiliation":[{"name":"Health Sciences Research Unit: Nursing (UICISA:E), Nursing School of Coimbra (ESEnfC), 3046-851 Coimbra, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8914-6975","authenticated-orcid":false,"given":"Liliana B.","family":"Sousa","sequence":"additional","affiliation":[{"name":"Health Sciences Research Unit: Nursing (UICISA:E), Nursing School of Coimbra (ESEnfC), 3046-851 Coimbra, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5690-3020","authenticated-orcid":false,"given":"In\u00eas A.","family":"Marques","sequence":"additional","affiliation":[{"name":"Biophysics Institute, Faculty of Medicine, University of Coimbra, 3000-354 Coimbra, Portugal"},{"name":"Coimbra Institute for Clinical and Biomedical Research (iCBR), Area of Environment Genetics and Oncobiology (CIMAGO), Faculty of Medicine, University of Coimbra, 3000-354 Coimbra, Portugal"},{"name":"CNC.IBILI (Center for Neuroscience and Cell Biology and Institute for Biomedical Imaging and Life Sciences), University of Coimbra, 3000-354 Coimbra, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0761-6548","authenticated-orcid":false,"given":"Paulo","family":"Santos-Costa","sequence":"additional","affiliation":[{"name":"Health Sciences Research Unit: Nursing (UICISA:E), Nursing School of Coimbra (ESEnfC), 3046-851 Coimbra, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sara","family":"Cortez","sequence":"additional","affiliation":[{"name":"Muropl\u00e1s-Plastic Engineering Industry, 4745-334 Muro, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4439-4166","authenticated-orcid":false,"given":"Filipa","family":"Carneiro","sequence":"additional","affiliation":[{"name":"PIEP\u2014Innovation in Polymer Engineering, 4800-058 Braga, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3254-3176","authenticated-orcid":false,"given":"Arm\u00e9nio","family":"Cruz","sequence":"additional","affiliation":[{"name":"Health Sciences Research Unit: Nursing (UICISA:E), Nursing School of Coimbra (ESEnfC), 3046-851 Coimbra, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8231-8279","authenticated-orcid":false,"given":"Anabela","family":"Salgueiro-Oliveira","sequence":"additional","affiliation":[{"name":"Health Sciences Research Unit: Nursing (UICISA:E), Nursing School of Coimbra (ESEnfC), 3046-851 Coimbra, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,11]]},"reference":[{"key":"ref_1","first-page":"CD011429","article-title":"Vascular access specialist teams for device insertion and prevention of failure","volume":"3","author":"Carr","year":"2018","journal-title":"Cochrane Database Syst. Rev."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kaur, P., Rickard, C., Rickard, C., Domer, G.S., and Kaur, P. (2019). Dangers of peripheral intravenous catheterization: The forgotten tourniquet and other patient safety considerations. Intechopen.","DOI":"10.5772\/intechopen.83854"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1002\/jhm.2389","article-title":"International prevalence of the use of peripheral intravenous catheters","volume":"10","author":"Alexandrou","year":"2015","journal-title":"J. Hosp. Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.4037\/ccn2017657","article-title":"Complications of peripheral venous access devices: Prevention, detection, and recovery strategies","volume":"37","author":"Mattox","year":"2017","journal-title":"Crit. Care Nurse"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Miliani, K., Taravella, R., Thillard, D., Chauvin, V., Martin, E., Edouard, S., Astagneau, P., and CATHEVAL Study Group (2017). Peripheral venous catheter-related adverse events: Evaluation from a multicentre epidemiological study in France (the CATHEVAL project). PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0168637"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"993","DOI":"10.2147\/TCRM.S74685","article-title":"Prospective study of incidence and predictors of peripheral intravenous catheter-induced complications","volume":"10","author":"Abolfotouh","year":"2014","journal-title":"Ther. Clin. Risk Manag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2539","DOI":"10.1111\/jan.12403","article-title":"Phlebitis risk varies by peripheral venous catheter site and increases after 96 hours: A large multi-centre prospective study","volume":"70","author":"Cicolini","year":"2014","journal-title":"J. Adv. Nurs."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1177\/0268355514537254","article-title":"Management, clinical outcomes, and complications of acute cannula-related peripheral vein phlebitis of the upper extremity: A retrospective study","volume":"30","author":"Dunda","year":"2015","journal-title":"Phlebology"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"137","DOI":"10.12707\/RIII1027","article-title":"Interven\u00e7\u00f5es de enfermagem e flebites decorrentes de cateteres venosos perif\u00e9ricos. Revis\u00e3o sistem\u00e1tica da literatura","volume":"serIII","author":"Oliveira","year":"2010","journal-title":"Rev. Enferm. Ref."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1590\/1982-0194201600012","article-title":"Artigo Original Complica\u00e7\u00f5es relacionadas ao uso do cateter venoso perif\u00e9rico: Ensaio cl\u00ednico randomizado","volume":"29","author":"Danski","year":"2016","journal-title":"Acta Paul Enferm."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e437","DOI":"10.1097\/CCM.0000000000002092","article-title":"Cumulative Evidence of Randomized Controlled and Observational Studies on Catheter-Related Infection Risk of Central Venous Catheter Insertion Site in ICU Patients","volume":"45","author":"Arvaniti","year":"2017","journal-title":"Crit. Care Med."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1007\/s00134-016-4480-7","article-title":"Understanding biofilm formation in intravascular device-related infections","volume":"43","author":"Beloin","year":"2017","journal-title":"Intensive Care Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.jhin.2017.07.008","article-title":"Nationwide study on peripheral-venous-catheter-associated-bloodstream infections in internal medicine departments","volume":"97","author":"Guembe","year":"2017","journal-title":"J. Hosp. Infect."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1678","DOI":"10.1016\/j.ijnurstu.2015.07.001","article-title":"Nursing and midwifery practice for maintenance of vascular access device patency. A cross-sectional survey","volume":"52","author":"Keogh","year":"2015","journal-title":"Int. J. Nurs. Stud."},{"key":"ref_15","unstructured":"Gorski, L.A., Hadaway, L., Hagle, M., McGoldrick, M., Orr, M., and Doellman, D. (2016). The 2016 Infusion Therapy Standards of Practice, Wolters Kluwer."},{"key":"ref_16","unstructured":"Queensland Government, Department of Health (2018). Guidelines: Peripheral Intravenous Catheter (PIVC), Queensland Government."},{"key":"ref_17","unstructured":"Royal College of Nursing (Andrea Denton) (2016). Standards for Infusion Therapy, Royal College of London. R Coll Nurs."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Parreira, P., Sousa, L.B., Marques, I.A., Costa, P., Cortez, S., Carneiro, F., Cruz, A., and Salgueiro-Oliveira, A. (2020). Development of an innovative double-chamber syringe for intravenous therapeutics and flushing: Nurses\u2019 involvement through a human-centred approach. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0235087"},{"key":"ref_19","unstructured":"Minist\u00e9rio da Sa\u00fade (2009). Decreto-Lei n.o 145\/2009 de 17 de Junho (Regras a que Devem Obedecer a Investiga\u00e7\u00e3o, o Fabrico, a Comercializa\u00e7\u00e3o, a Entrada em Servi\u00e7o, a Vigil\u00e2ncia e a Publicidade dos Dispositivos M\u00e9dicos e Respectivos Acess\u00f3rios), Minist\u00e9rio da Sa\u00fade."},{"key":"ref_20","unstructured":"European Council\u2019s Recent Revision in MedDev 2 (2017). 7.1 Guidelines (Revision 4)\u2014Quantifying its Change and its Impact. J. Bioeng. Biomed. Sci., 7, 1\u20137."},{"key":"ref_21","unstructured":"(2017). Legislation117. Regulation (EU) 2017\/745 of the European Parliament and of the Council of 5 April 2017 on medical devices, amending Directive 2001\/83\/EC, Regulation (EC) No 178\/2002 and Regulation (EC) No 1223\/2009 and repealing Council Directives 90\/385\/EEC and 93\/42\/EE. Off. J. Eur. Union, 60, 2\u2013175."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.apergo.2016.08.034","article-title":"Human factors in the design of medical devices \u2013 Approaches to meeting international standards in the European Union and USA","volume":"59","author":"Privitera","year":"2017","journal-title":"Appl. Ergon."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1016\/j.apergo.2013.05.009","article-title":"Integration of human factors and ergonomics during medical device design and development: It\u2019s all about communication","volume":"45","author":"Vincent","year":"2014","journal-title":"Appl. Ergon."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1080\/0951192X.2014.934292","article-title":"Designing, prototyping and manufacturing medical devices: An overview","volume":"27","author":"Ciurana","year":"2014","journal-title":"Int. J. Comput. Integr. Manuf."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1002\/hec.3469","article-title":"Challenges in the Assessment of Medical Devices: The MedtecHTA Project","volume":"26","author":"Tarricone","year":"2017","journal-title":"Health Econ. UK"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1002\/hec.3479","article-title":"Linking the Regulatory and Reimbursement Processes for Medical Devices: The Need for Integrated Assessments","volume":"26","author":"Ciani","year":"2017","journal-title":"Health Econ."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.healthpol.2016.08.010","article-title":"HTA of medical devices: Challenges and ideas for the future from a European perspective","volume":"121","author":"Fuchs","year":"2017","journal-title":"Health Policy"},{"key":"ref_28","unstructured":"(2016). EUnetHTA Joint Action 2, Work Package 8. HTA Core Model \u00ae version 3.0 (Pdf). EUnetHTA JA, National Institute for Health and Welfare."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"e8","DOI":"10.2196\/humanfactors.5443","article-title":"A Human-Centered Design Methodology to Enhance the Usability, Human Factors, and User Experience of Connected Health Systems: A Three-Phase Methodology","volume":"4","author":"Harte","year":"2017","journal-title":"JMIR Hum. Factors"},{"key":"ref_30","unstructured":"ISO 9241-11: 2018 (2018). Ergonomics of Human-System Interaction\u2014Part 11: Usability: Definitions and Concepts, International Organization for Standardization."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1080\/10447318.2012.681221","article-title":"Usability Ratings for Everyday Products Measured With the System Usability Scale","volume":"29","author":"Kortum","year":"2013","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.jbi.2004.11.005","article-title":"A user-centered framework for redesigning health care interfaces","volume":"38","author":"Johnson","year":"2005","journal-title":"J. Biomed. Inform."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wiklund, M., Kendler, J., and Strochlic, A. (2016). Usability Testing of Medical Devices, CRC Press. [2nd ed.].","DOI":"10.1201\/b19082"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Money, A.G., Barnett, J., Kuljis, J., Craven, M.P., Martin, J.L., and Young, T. (2011). The role of the user within the medical device design and development process: Medical device manufacturers\u2019 perspectives. BMC Med. Inform. Decis. Mak., 11.","DOI":"10.1186\/1472-6947-11-15"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"R49","DOI":"10.1088\/0967-3334\/27\/8\/R01","article-title":"Capturing user requirements in medical device development: The role of ergonomics","volume":"27","author":"Martin","year":"2006","journal-title":"Physiol. Meas."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1586\/17434440.2014.940312","article-title":"How many testers are needed to assure the usability of medical devices?","volume":"11","author":"Borsci","year":"2014","journal-title":"Expert Rev. Med. Devices"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Blig\u00e5rd, L.O., Str\u00f6mberg, H., and Karlsson, M.A. (2017). Developers as Users: Exploring the Experiences of Using a New Theoretical Method for Usability Assessment. Adv. Hum. Comput. Interact.","DOI":"10.1155\/2017\/6131575"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.jbi.2017.03.010","article-title":"An extended protocol for usability validation of medical devices: Research design and reference model","volume":"69","author":"Schmettow","year":"2017","journal-title":"J. Biomed. Inform."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.apergo.2007.10.002","article-title":"Medical device development: The challenge for ergonomics","volume":"39","author":"Martin","year":"2008","journal-title":"Appl. Ergon."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Martin, J.L., and Barnett, J. (2012). Integrating the results of user research into medical device development: Insights from a case study. BMC Med. Inform. Decis. Mak., 12.","DOI":"10.1186\/1472-6947-12-74"},{"key":"ref_41","unstructured":"ISO 14155 (2011). Clinical Investigation of Medical Devices for Human Subjects\u2014Good Clinical Practice, International Standard Organization."},{"key":"ref_42","unstructured":"ISO 14971 (2012). Medical Devices\u2014Application of Risk Management to Medical Devices, International Standard Organization."},{"key":"ref_43","unstructured":"ISO 62366-2 (2016). Medical Devices\u2014Part 2: Guidance on the Application of Usability Engineering to Medical Devices, International Standard Organization."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1080\/10447310802205776","article-title":"An empirical evaluation of the system usability scale","volume":"24","author":"Bangor","year":"2008","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.procs.2015.09.273","article-title":"European Portuguese validation of the System Usability Scale (SUS)","volume":"67","author":"Martins","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Lewis, J.R. (1992, January 12\u201316). Psychometric Evaluation of the Post-Study System Usability Questionaire: The PSSUQ. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Atlanta, GA, USA.","DOI":"10.1177\/154193129203601617"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1207\/S15327590IJHC143&4_11","article-title":"Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies","volume":"14","author":"Lewis","year":"2002","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Rosa, A.F., Martins, A.I., Costa, V., Queir\u00f3s, A., Silva, A., and Rocha, N.P. (2015, January 17\u201320). Valida\u00e7\u00e3o para portugu\u00eas europeu do Post-Study System Usability Questionnaire (PPSUQ). Proceedings of the 10th Iberian Conference on Information Systems and Technologies (CISTI), Aveiro, Portugal.","DOI":"10.1109\/CISTI.2015.7170431"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.procs.2015.09.257","article-title":"Definition and validation of the ICF-Usability Scale","volume":"67","author":"Martins","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1007\/s10209-019-00659-w","article-title":"Validation of a usability assessment instrument according to the evaluators\u2019 perspetive about users\u2019 performance","volume":"19","author":"Martins","year":"2020","journal-title":"Univers. Access Inf. Soc."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"101","DOI":"10.3233\/TAD-2002-14304","article-title":"The Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0): An overview and recent progress","volume":"14","author":"Demers","year":"2019","journal-title":"Technol. Disabil."},{"key":"ref_52","first-page":"3","article-title":"Measuring usability with the USE questionnaire","volume":"8","author":"Lund","year":"2001","journal-title":"Usability Interface"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1145\/122672.122692","article-title":"Psychometric evaluation of an after-scenario questionnaire for computer usability studies: The ASQ","volume":"23","author":"Lewis","year":"1991","journal-title":"ACM SIGCHI Bulletin."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1145\/122672.122692","article-title":"Psychometric evaluation of an after-scenario questionnaire for computer usability studies","volume":"23","author":"Lewis","year":"2007","journal-title":"ACM SIGCHI Bull."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"211","DOI":"10.18869\/acadpub.johe.5.4.211","article-title":"Evaluation of Rating Scale Mental Effort (RSME) effectiveness for mental workload assessment in nurses","volume":"5","author":"Ashnagar","year":"2016","journal-title":"J. Occup. Health Epidemiol."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived Usefulness, Perceived Ease Of Use, And User Acceptance","volume":"13","author":"Davis","year":"1989","journal-title":"MIS Q."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Davis, F.D., Bagozzi, R.P., and Warshaw, P.R. (1989). User Acceptance of Computer Technology: A Comparison of Two Theoretical Models. Manag. Sci., 35.","DOI":"10.1287\/mnsc.35.8.982"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1287\/isre.11.4.342.11872","article-title":"Determinants of perceived ease of use: Integrating control, intrinsic motivation, and emotion into the technology acceptance model","volume":"11","author":"Venkatesh","year":"2000","journal-title":"Inf. Syst. Res."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1586\/erd.12.89","article-title":"Additional peculiarities of medical devices that should be considered in their development process","volume":"10","author":"Santos","year":"2013","journal-title":"Expert Rev. Med. Devices"},{"key":"ref_60","unstructured":"Bardin, L. (2007). L\u2019analyse de Contenu, Quadrige\/PUF."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.ijmedinf.2017.11.007","article-title":"Usability evaluation of a commercial inpatient portal","volume":"110","author":"Yen","year":"2018","journal-title":"Int. J. Med. Inf."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1186\/s13063-019-3887-1","article-title":"Double-chamber syringe versus classic syringes for peripheral intravenous drug administration and catheter flushing: A study protocol for a randomised controlled trial","volume":"21","author":"Parreira","year":"2020","journal-title":"Trials"},{"key":"ref_63","first-page":"1","article-title":"Evaluating an instrument to measure mental load and mental effort using Item Response Theory","volume":"3","author":"Krell","year":"2015","journal-title":"Sci. Educ. Rev. Lett."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/2331186X.2017.1280256","article-title":"Evaluating an instrument to measure mental load and mental effort considering different sources of validity evidence","volume":"4","author":"Krell","year":"2017","journal-title":"Cogent Educ."}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/17\/22\/8335\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:32:01Z","timestamp":1760178721000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/17\/22\/8335"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,11]]},"references-count":64,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["ijerph17228335"],"URL":"https:\/\/doi.org\/10.3390\/ijerph17228335","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,11]]}}}