{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T16:22:57Z","timestamp":1780762977431,"version":"3.54.1"},"reference-count":150,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,9,25]],"date-time":"2023-09-25T00:00:00Z","timestamp":1695600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100016370","name":"Bundesministerium f\u00fcr Arbeit und Soziales","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100016370","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>This study aimed to develop an evaluation tool that assesses the use of AI-based decision support systems (DSSs) in professional practice from a human-centered perspective. Following the International Organization for Standardization, this perspective aims to ensure that the use of interactive technologies improves users' psychological load experience and behavior, e.g., in the form of reduced stress experience or increased performance. Concomitantly, this perspective attempts to proactively prevent or detect and correct the potential negative effects of these technologies on user load, such as impaired satisfaction and engagement, as early as possible. Based on this perspective, we developed and validated a questionnaire instrument, the Psychological Assessment of AI-based DSSs (PAAI), for the user-centered evaluation of the use of AI-based DSSs in practice. In particular, the instrument considers central design characteristics of AI-based DSSs and the corresponding work situation, which have a significant impact on users' psychological load. The instrument was tested in two independent studies. In Study 1, <jats:italic>N<\/jats:italic> = 223 individuals were recruited. Based on the results of item and scale analyses and an exploratory factor analysis, the newly developed instrument was refined, and the final version was tested using a confirmatory factor analysis. Findings showed acceptable-to-good fit indices, confirming the factorial validity of the <jats:italic>PAAI<\/jats:italic>. This was confirmed in a second study, which had <jats:italic>N<\/jats:italic> = 471 participants. Again, the CFA yielded acceptable-to-good fit indices. The validity was further confirmed using convergent and criterion validity analyses.<\/jats:p>","DOI":"10.3389\/frai.2023.1249322","type":"journal-article","created":{"date-parts":[[2023,9,26]],"date-time":"2023-09-26T07:05:28Z","timestamp":1695711928000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Psychological assessment of AI-based decision support systems: tool development and expected benefits"],"prefix":"10.3389","volume":"6","author":[{"given":"Katharina","family":"Buschmeyer","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Hatfield","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julie","family":"Zenner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,9,25]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"8071","DOI":"10.1007\/s10639-022-10947-3","article-title":"Understanding key drivers affecting students' use of artificial intelligence-based voice assistants","volume":"27","author":"Al Shamsi","year":"2022","journal-title":"Educ. Inf. Technol"},{"key":"B2","first-page":"393","article-title":"\u201cCritical success factors for implementing artificial intelligence (AI) projects in Dubai Government United Arab Emirates (UAE) health sector: Applying the extended technology acceptance model (TAM),\u201d","author":"Alhashmi","year":"2020","journal-title":"Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2019"},{"key":"B3","first-page":"406","article-title":"\u201cExamining the main mobile learning system drivers' effects: a Mix empirical examination of both the expectation-confirmation model (ECM) and the technology acceptance model (TAM),\u201d","author":"Alshurideh","year":"2020","journal-title":"Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2019"},{"key":"B4","article-title":"\u201cHow can you verify that I am using AI? Complementary frameworks for describing and evaluating AI-based digital agents in their usage contexts,\u201d","author":"Alter","year":"2023","journal-title":"56th Hawaii Conference on System Sciences (HICSS)"},{"key":"B5","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1108\/NBRI-01-2014-0005","article-title":"User satisfaction with mobile websites: the impact of perceived usefulness (PU), perceived ease of use (PEOU) and trust","volume":"5","author":"Amin","year":"2014","journal-title":"Nankai Bus. Rev. Int"},{"key":"B6","doi-asserted-by":"publisher","first-page":"102","DOI":"10.5751\/ES-00043-020102","article-title":"Embracing uncertainty: the interface of Bayesian statistics and cognitive psychology","volume":"2","author":"Anderson","year":"1998","journal-title":"Conserv. Ecol"},{"key":"B7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3405755.3406172","article-title":"\u201cPerceived usefulness of conversational agents predicts search performance in aerospace domain,\u201d","volume-title":"Proceedings of the 2nd Conference on Conversational User Interfaces","author":"Arnold","year":"2020"},{"key":"B8","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI","volume":"58","author":"Arrieta","year":"2020","journal-title":"Inform. Fusion"},{"key":"B9","doi-asserted-by":"publisher","first-page":"257","DOI":"10.4172\/2151-6200.1000257","article-title":"The effect of usability and information quality on decision support information system (DSS)","volume":"8","author":"Atta","year":"2017","journal-title":"Arts Soc. Sci. J"},{"key":"B10","first-page":"661","article-title":"\u201cInformation overload: coping mechanisms and tools impact,\u201d","volume-title":"Research Challenges in Information Science: Information Science and the Connected World. Proceedings: 17th International Conference, RCIS 2023 Corfu, Greece, May 23\u201326, 2023","author":"Aussu","year":"2023"},{"key":"B11","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1145\/3428361.3428362","article-title":"\u201cTrust me, I'm a doctor \u2013 User perceptions of AI-driven apps for mobile health diagnosis,\u201d","volume-title":"Proceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia","author":"Baldauf","year":"2020"},{"key":"B12","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1207\/S15328007SEM0901_5","article-title":"The effects of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling","volume":"9","author":"Bandalos","year":"2002","journal-title":"Struct. Equ Model. Multidiscip. J"},{"key":"B13","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1080\/10447310802205776","article-title":"An empirical evaluation of the system usability scale","volume":"24","author":"Bangor","year":"2008","journal-title":"Int. J. Hum. Comput. Interact"},{"key":"B14","volume-title":"Forschungsmethoden und Evaluation in den Sozial- und Humanwissenschaften. 5th Edn.","author":"Bortz","year":"2016"},{"key":"B15","doi-asserted-by":"crossref","unstructured":"BrynjolfssonE.\n            HittL. M.\n            KimH. H.\n          BerlinStrength in Numbers: How Does Data-driven Decisionmaking Affect Firm Performance?2011","DOI":"10.2139\/ssrn.1819486"},{"key":"B16","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1026\/0932-4089.48.4.165","article-title":"Psychische und physische Belastungen in der ambulanten Pflege: Ein Screening zum Arbeits- und Gesundheitsschutz","volume":"48","author":"B\u00fcssing","year":"2004","journal-title":"Z. Arbeits Organisationspsychol"},{"key":"B17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3290605.3300234","article-title":"\u201cHuman-centered tools for coping with imperfect algorithms during medical decision-making,\u201d","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems","author":"Cai","year":"2019"},{"key":"B18","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1016\/j.chb.2003.10.004","article-title":"The relation of interface usability characteristics, perceived usefulness, and perceived ease of use to end-user satisfaction with enterprise resource planning (ERP) systems","volume":"20","author":"Calisir","year":"2004","journal-title":"Comput. Hum. Behav."},{"key":"B19","doi-asserted-by":"publisher","first-page":"3","DOI":"10.22235\/cp.v13i1.1805","article-title":"Work engagement: a study of daily changes","volume":"13","author":"Chinelato","year":"2019","journal-title":"Ciencias Psicol."},{"key":"B20","volume-title":"Statistical Power Analysis for the Behavioral Sciences.","author":"Cohen","year":"1988"},{"key":"B21","doi-asserted-by":"publisher","first-page":"113664","DOI":"10.1016\/j.dss.2021.113664","article-title":"Interpretable data science for decision making","volume":"150","author":"Coussement","year":"2021","journal-title":"Decis. Support Syst"},{"key":"B22","doi-asserted-by":"publisher","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived usefulness, perceived ease of use, and user acceptance of information technology","volume":"13","author":"Davis","year":"1989","journal-title":"MIS Q"},{"key":"B23","unstructured":"DebitzU.\n            Hans-EberhardtP.\n            RichterP.\n          BMS \u2013 Beanspruchungs-mess-skalen | Testzentrale2016"},{"key":"B24","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1026\/0932-4089\/a000318","article-title":"Der Fragebogen zur Gef\u00e4hrdungsbeurteilung psychischer Belastungen (FGBU)","volume":"64","author":"Dettmers","year":"2020","journal-title":"Z. Arbeits Organisationspsychol"},{"key":"B25","doi-asserted-by":"crossref","DOI":"10.24251\/HICSS.2022.720","article-title":"\u201cArtificial intelligence for managerial information processing and decision- making in the era of information overload,\u201d","author":"Dietzmann","year":"2022","journal-title":"Proceedings of the Annual Hawaii International Conference on System Sciences. Proceedings of the 55th Hawaii International Conference on System Sciences"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1702.08608","article-title":"Towards a rigorous science of interpretable machine learning","author":"Doshi-Velez","year":"2017","journal-title":"arXiv"},{"key":"B27","doi-asserted-by":"publisher","first-page":"e0279720","DOI":"10.1371\/journal.pone.0279720","article-title":"Data quality in online human-subjects research: comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA","volume":"18","author":"Douglas","year":"2023","journal-title":"PLoS ONE"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1383","DOI":"10.1038\/s41598-023-28633-w","article-title":"Non-task expert physicians benefit from correct explainable AI advice when reviewing X-rays","volume":"13","author":"Gaube","year":"2023","journal-title":"Sci. Rep"},{"key":"B29","unstructured":"GimpelH.\n            BergerM.\n            RegalC.\n            UrbachN.\n            KreilosM.\n            BeckerJ.\n          Belastungsfaktoren der Digitalen Arbeit: Eine beispielhafte Darstellung der Faktoren, die Digitalen Stress Hervorrufen2020"},{"key":"B30","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1027\/1866-5888\/a000127","article-title":"The impact of learning demands, work-related resources, and job stressors on creative performance and health","volume":"14","author":"Glaser","year":"2015","journal-title":"J. Pers. Psychol"},{"key":"B31","doi-asserted-by":"publisher","first-page":"213","DOI":"10.2307\/249689","article-title":"Task-technology fit and individual performance","volume":"19","author":"Goodhue","year":"1995","journal-title":"MIS Q"},{"key":"B32","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1016\/j.jsis.2010.05.001","article-title":"Organizational impact of system quality, information quality, and service quality","volume":"19","author":"Gorla","year":"2010","journal-title":"J. Strateg. Inf. Syst"},{"key":"B33","author":"Hacker","year":"1978","journal-title":"Allgemeine Arbeits- und Ingenieurpsychologie: Psychische Struktur und Regulation von Arbeitst\u00e4tigkeiten"},{"key":"B34","first-page":"4","article-title":"Vernetzte k\u00fcnstliche Intelligenz\/Internet der Dinge am deregulierten Arbeitsmarkt: Psychische Arbeitsanforderungen","volume":"9","author":"Hacker","year":"2016","journal-title":"J. Psychol. Alltagshandelns"},{"key":"B35","doi-asserted-by":"publisher","first-page":"120392","DOI":"10.1016\/j.techfore.2020.120392","article-title":"Artificial intelligence and innovation management: a review, framework, and research agenda","volume":"162","author":"Haefner","year":"2021","journal-title":"Technol. Forecasting Soc. Change"},{"key":"B36","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"Development of NASA-TLX (task load index): results of empirical and theoretical research","volume":"52","author":"Hart","year":"1988","journal-title":"Adv. Psychol"},{"key":"B37","doi-asserted-by":"publisher","first-page":"143","DOI":"10.3390\/ai1020008","article-title":"Artificial intelligence (AI) or intelligence augmentation (IA): what is the future?","volume":"1","author":"Hassani","year":"2020","journal-title":"AI"},{"key":"B38","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1515\/ABITECH.2002.22.4.340","article-title":"Inmitten der Informationsflut herrscht Informationsmangel","volume":"22","author":"Heinisch","year":"2002","journal-title":"ABI-Technik"},{"key":"B39","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1515\/zwf-2021-0104","article-title":"Augmented intelligence \u2013 Mensch trifft K\u00fcnstliche Intelligenz","volume":"116","author":"Hellebrandt","year":"2021","journal-title":"Zeitschrift f\u00fcr wirtschaftlichen Fabrikbetrieb"},{"key":"B40","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1145\/1989098.1989104","article-title":"Dynamic collaboration","volume":"42","author":"Helquist","year":"2011","journal-title":"SIGMIS Database"},{"key":"B41","doi-asserted-by":"publisher","first-page":"e0271183","DOI":"10.1371\/journal.pone.0271183","article-title":"Initial experience with AI Pathway Companion: evaluation of dashboard-enhanced clinical decision making in prostate cancer screening","volume":"17","author":"Henkel","year":"2022","journal-title":"PLoS ONE"},{"key":"B42","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1186\/1472-6947-13-16","article-title":"Factors of accepting pain management decision support systems by nurse anesthetists","volume":"13","author":"Hsiao","year":"2013","journal-title":"BMC Med. Inform. Decis. Mak"},{"key":"B43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/10705519909540118","article-title":"Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives","volume":"6","author":"Hu","year":"1999","journal-title":"Struct. Equ Model. Multidiscip. J"},{"key":"B44","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-34362-9","volume-title":"Forschungsmethoden in Psychologie und Sozialwissenschaften f\u00fcr Bachelor, 2nd Edn","author":"Hussy","year":"2013"},{"key":"B45","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1177\/016555159902500305","article-title":"Information dimension, information overload and decision quality","volume":"25","author":"Hwang","year":"1999","journal-title":"J. Inf. Sci"},{"key":"B46","first-page":"313","article-title":"Analysis of perceived usefulness, perceived ease of use, and perceived risk toward online shopping in the era of Covid-19 pandemic","volume":"11","author":"Iriani","year":"2020","journal-title":"Syst. Rev. Pharm"},{"key":"B47","unstructured":"ISO 10075-1:2017. Ergonomic Principles Related to Mental Workload \u2014 Part 1: General Issues and Concepts, Terms and Definitions2017"},{"key":"B48","unstructured":"ISO 9241-210:2010. Ergonomics of Human-System Interaction: Human-Centred Design for Interactive Systems2019"},{"key":"B49","unstructured":"ISO 9241-210:2010. Ergonomics of Human-System Interaction: Human-Centred Design for Interactive Systems2020"},{"key":"B50","first-page":"265","article-title":"\u201cDas Ressourcen-Anforderungen-Stressoren-Modell,\u201d","volume-title":"Zur Psychologie der T\u00e4tigkeiten. Schriften zur Arbeitspsychologie","author":"Iwanowa","year":"2006"},{"key":"B51","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1038\/s41398-021-01224-x","article-title":"How machine-learning recommendations influence clinician treatment selections: the example of antidepressant selection","volume":"11","author":"Jacobs","year":"2021","journal-title":"Transl. Psychiatry"},{"key":"B52","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1016\/j.bushor.2018.03.007","article-title":"Artificial intelligence and the future of work: human-AI symbiosis in organizational decision making","volume":"61","author":"Jarrahi","year":"2018","journal-title":"Bus. Horiz"},{"key":"B53","doi-asserted-by":"publisher","first-page":"881","DOI":"10.1177\/0275074016643817","article-title":"Understanding employee engagement in the public sector: the role of immediate supervisor, perceived organizational support, and learning opportunities","volume":"47","author":"Jin","year":"2017","journal-title":"Am. Rev. Public Admin"},{"key":"B54","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1287\/isre.2020.0980","article-title":"Augmenting medical diagnosis decisions? An investigation into physicians' decision-making process with artificial intelligence","volume":"32","author":"Jussupow","year":"2021","journal-title":"Inform. Syst. Res."},{"key":"B55","doi-asserted-by":"publisher","first-page":"267","DOI":"10.15241\/mtk.11.3.267","article-title":"Enhancing assessment literacy in professional counseling: a practical overview of factor analysis","volume":"11","author":"Kalkbrenner","year":"2021","journal-title":"Prof. Couns"},{"key":"B56","doi-asserted-by":"publisher","first-page":"285","DOI":"10.2307\/2392498","article-title":"Job demands, job decision latitude, and mental strain: implications for job redesign","volume":"24","author":"Karasek","year":"1979","journal-title":"Admin. Sci. Q"},{"key":"B57","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/978-3-642-16999-1_10","article-title":"\u201cArbeitszufriedenheit und Arbeitsmotivation,\u201d","volume-title":"Springer-Lehrbuch. Arbeits-, Organisations- und Personalpsychologie f\u00fcr Bachelor","author":"Kauffeld","year":"2011"},{"key":"B58","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/978-3-030-84729-6_10","article-title":"\u201cAugmented intelligence: enhancing human decision making,\u201d","volume-title":"Bridging Human Intelligence and Artificial Intelligence","author":"Kim","year":"2022"},{"key":"B59","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1007\/978-3-662-58042-4_4","article-title":"\u201cAugmented Intelligence \u2013 Wie Menschen mit KI zusammen Arbeiten,\u201d","volume-title":"Open. K\u00fcnstliche Intelligenz: Technologie, Anwendung, Gesellschaft, 1st Edn","author":"Kirste","year":"2019"},{"key":"B60","first-page":"1","article-title":"Extending the technology acceptance model and the task-technology fit model to consumer e-commerce","volume":"22","author":"Klopping","year":"2004","journal-title":"Inf. Technol. Learn. Perform. J"},{"key":"B61","doi-asserted-by":"publisher","first-page":"79","DOI":"10.6000\/1929-6029.2012.01.01.08","article-title":"Performance measures in binary classification","volume":"1","author":"Kohl","year":"2012","journal-title":"Int. J. Stat. Med. Res"},{"key":"B62","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/978-3-319-59090-5_10","article-title":"\u201cInformation overload in a data-intensive world,\u201d","volume-title":"Understanding Information","author":"Koltay","year":"2017"},{"key":"B63","doi-asserted-by":"publisher","first-page":"927","DOI":"10.3390\/electronics12040927","article-title":"Knowledge engineering and data mining","volume":"12","author":"Konys","year":"2023","journal-title":"Electronics"},{"key":"B64","doi-asserted-by":"publisher","first-page":"420","DOI":"10.1037\/h0080555","article-title":"Exclusion of children from family psychotherapy: family therapists' beliefs and practices","volume":"3","author":"Korner","year":"1990","journal-title":"J. Fam. Psychol"},{"key":"B65","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1002\/smi.2853","article-title":"Perceived stress in human-machine interaction in modern manufacturing environments-Results of a qualitative interview study","volume":"35","author":"K\u00f6rner","year":"2019","journal-title":"Stress Health"},{"key":"B66","unstructured":"KrausT.\n            GaschowL.\n            Eisentr\u00e4gerM.\n            WischmannS.\n          Erkl\u00e4rbare KI \u2013 Anforderungen, Anwendungsf\u00e4lle und L\u00f6sungen2021"},{"key":"B67","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-15831-5","volume-title":"Einf\u00fchrung in das Informationsmanagement","author":"Krcmar","year":"2011"},{"key":"B68","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1365\/s41056-020-00044-2","article-title":"Entscheidungen, Entscheidungsfindung und Entscheidungsunterst\u00fctzung in der Immobilienwirtschaft: Eine systematische Literatur\u00fcbersicht","volume":"7","author":"Krieger","year":"2021","journal-title":"Z. Immobilien\u00f6konomie"},{"key":"B69","doi-asserted-by":"publisher","first-page":"1060","DOI":"10.1080\/00140139.2015.1122234","article-title":"The stress and workload of virtual reality training: the effects of presence, immersion and flow","volume":"59","author":"Lackey","year":"2016","journal-title":"Ergonomics"},{"key":"B70","doi-asserted-by":"publisher","first-page":"751","DOI":"10.1007\/s10869-020-09711-6","article-title":"Changing the means of managerial work: effects of automated decision support systems on personnel selection tasks","volume":"36","author":"Langer","year":"2021","journal-title":"J. Bus. Psychol."},{"key":"B71","doi-asserted-by":"crossref","DOI":"10.1109\/IEEM.2017.8290059","article-title":"\u201cTransformation of working environments through digitalization: exploration and systematization of complexity drivers,\u201d","volume-title":"IEEE International Conference on Industrial Engineering and Engineering Management (IEEM) 2017","author":"Latos","year":"2017"},{"key":"B72","volume-title":"Stress, Appraisal, and Coping.","author":"Lazarus","year":"1984"},{"key":"B73","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1002\/hfm.20269","article-title":"Brief review on physiological and biochemical evaluations of human mental workload","volume":"22","author":"Lean","year":"2012","journal-title":"Hum. Factors Man"},{"key":"B74","article-title":"\u201cThe effect of simplicity and perceived control on perceived ease of use,\u201d","author":"Lee","year":"2007","journal-title":"AMCIS 2007 Proceedings"},{"key":"B75","doi-asserted-by":"crossref","DOI":"10.1145\/3411764.3445472","article-title":"\u201cA human-AI collaborative approach for clinical decision making on rehabilitation assessment,\u201d","volume-title":"Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems","author":"Lee","year":"2021"},{"key":"B76","doi-asserted-by":"publisher","first-page":"2206","DOI":"10.3390\/diagnostics11122206","article-title":"The added effect of artificial intelligence on physicians' performance in detecting thoracic pathologies on CT and chest X-ray: a systematic review","volume":"11","author":"Li","year":"2021","journal-title":"Diagnostics"},{"key":"B77","doi-asserted-by":"publisher","first-page":"120302","DOI":"10.1016\/j.techfore.2020.120302","article-title":"The contingent effect of job automating technology awareness on perceived job insecurity: exploring the moderating role of organizational culture","volume":"161","author":"Lingmont","year":"2020","journal-title":"Technol. Forecasting Soc. Change"},{"key":"B78","doi-asserted-by":"publisher","first-page":"104884","DOI":"10.1016\/j.ijmedinf.2022.104884","article-title":"Does AI explainability affect physicians' intention to use AI?","volume":"168","author":"Liu","year":"2022","journal-title":"Int. J. Med. Inform"},{"key":"B79","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1111\/j.1468-2370.2009.00267.x","article-title":"Boredom in the workplace: more than monotonous tasks","volume":"11","author":"Loukidou","year":"2009","journal-title":"Int. J. Manag. Rev"},{"key":"B80","doi-asserted-by":"publisher","first-page":"1019","DOI":"10.1016\/0191-8869(91)90032-7","article-title":"Happiness and cooperation","volume":"12","author":"Lu","year":"1991","journal-title":"Pers. Individ. Dif"},{"key":"B81","doi-asserted-by":"publisher","first-page":"1008","DOI":"10.1177\/0018720818781224","article-title":"The effect of cognitive load and task complexity on automation bias in electronic prescribing","volume":"60","author":"Lyell","year":"2018","journal-title":"Hum. Factors"},{"key":"B82","doi-asserted-by":"publisher","first-page":"131","DOI":"10.25105\/ber.v15i2.4630","article-title":"The effect of information quality on perceived usefulness and perceived ease of use","volume":"15","author":"Machdar","year":"2019","journal-title":"Bus. Entrep. Rev"},{"key":"B83","first-page":"811","article-title":"\u201cAgents that reduce work and information overload,\u201d","volume-title":"Readings in Human\u2013Computer Interaction","author":"Maes","year":"1995"},{"key":"B84","doi-asserted-by":"publisher","first-page":"239","DOI":"10.17705\/2msqe.00036","article-title":"Unintended consequences of introducing AI systems for decision making","volume":"19","author":"Mayer","year":"2020","journal-title":"MIS Q. Exec"},{"key":"B85","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1207\/s15327043hup1004_1","article-title":"Effects of objective and subjective task complexity on performance","volume":"10","author":"Maynard","year":"1997","journal-title":"Hum. Perform"},{"key":"B86","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1177\/0018720815621206","article-title":"Intelligent agent transparency in human-agent teaming for multi-UxV management","volume":"58","author":"Mercado","year":"2016","journal-title":"Hum. Factors"},{"key":"B87","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1007\/s10796-021-10234-5","article-title":"Design principles for user interfaces in AI-based decision support systems: the case of explainable hate speech detection","volume":"25","author":"Meske","year":"2022","journal-title":"Inf. Syst. Front"},{"key":"B88","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1177\/014920630102700203","article-title":"The people make the process: commitment to employees, decision making, and performance","volume":"27","author":"Miller","year":"2001","journal-title":"J. Manag"},{"key":"B89","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/978-3-319-41685-4_11","article-title":"\u201cThe meCUE questionnaire: a modular tool for measuring user experience,\u201d","volume-title":"Advances in Ergonomics Modeling, Usability and Special Populations","author":"Minge","year":"2017"},{"key":"B90","doi-asserted-by":"publisher","first-page":"101762","DOI":"10.1016\/j.ijdrr.2020.101762","article-title":"Information overload, stress, and emergency managerial thinking","volume":"51","author":"Misra","year":"2020","journal-title":"Int. J. Disaster Risk Reduc"},{"key":"B91","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1027\/1015-5759.22.3.198","article-title":"The assessment of psychological strain in work contexts","volume":"22","author":"Mohr","year":"2006","journal-title":"Eur. J. Psychol. Assess"},{"key":"B92","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-540-71635-8","volume-title":"Testtheorie und Fragebogenkonstruktion","author":"Moosbrugger","year":"2008"},{"key":"B93","doi-asserted-by":"publisher","first-page":"1321","DOI":"10.1037\/0021-9010.91.6.1321","article-title":"The Work Design Questionnaire (WDQ): developing and validating a comprehensive measure for assessing job design and the nature of work","volume":"91","author":"Morgeson","year":"2006","journal-title":"J. Appl. Psychol"},{"key":"B94","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1080\/10447318.2017.1365459","article-title":"Relating task demand, mental effort and task difficulty with physicians' performance during interactions with electronic health records (EHRs)","volume":"34","author":"Mosaly","year":"2018","journal-title":"Int. J. Hum. Comput. Interact"},{"key":"B95","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1177\/2150137813494766","article-title":"Factor analysis in counseling research and practice","volume":"4","author":"Mvududu","year":"2013","journal-title":"Couns. Outcome Res. Eval"},{"key":"B96","doi-asserted-by":"crossref","DOI":"10.1109\/HSI49210.2020.9142668","article-title":"\u201cBuild confidence and acceptance of AI-based decision support systems - Explainable and liable AI,\u201d","volume-title":"13th International Conference on Human System Interaction (HSI) 2020","author":"Nicodeme","year":"2020"},{"key":"B97","doi-asserted-by":"publisher","first-page":"e1986","DOI":"10.1002\/pa.1986","article-title":"Stress and performance: investigating relationship between occupational stress, career satisfaction, and job performance of police employees","volume":"20","author":"Nisar","year":"2020","journal-title":"J. Public Aff"},{"key":"B98","doi-asserted-by":"publisher","first-page":"6074","DOI":"10.6007\/IJARBSS\/v9-i6\/6074","article-title":"The impact of employees motivation, perceived usefulness and perceived ease of use on employee performance among selected public sector employees","volume":"9","author":"Omar","year":"2019","journal-title":"Int. J. Acad. Res. Bus. Soc. Sci"},{"key":"B99","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3491102.3502104","article-title":"\u201cUnderstanding the impact of explanations on advice-taking: a user study for AI-based clinical Decision Support Systems,\u201d","volume-title":"CHI Conference on Human Factors in Computing System","author":"Panigutti","year":"2022"},{"key":"B100","doi-asserted-by":"publisher","first-page":"9780","DOI":"10.1609\/aaai.v33i01.33019780","article-title":"Meaningful explanations of black Box AI decision systems","volume":"33","author":"Pedreschi","year":"2019","journal-title":"AAAI"},{"key":"B101","doi-asserted-by":"publisher","first-page":"1643","DOI":"10.3758\/s13428-021-01694-3","article-title":"Data quality of platforms and panels for online behavioral research","volume":"54","author":"Peer","year":"2022","journal-title":"Behav. Res. Methods"},{"key":"B102","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1080\/12460125.2020.1768680","article-title":"Decision making under stress: the role of information overload, time pressure, complexity, and uncertainty","volume":"29","author":"Phillips-Wren","year":"2020","journal-title":"J. Decis. Syst"},{"key":"B103","volume-title":"Fragebogen: Ein Arbeitsbuch","author":"Porst","year":"2013"},{"key":"B104","doi-asserted-by":"publisher","first-page":"1","DOI":"10.17705\/1thci.12201","article-title":"Intelligent conversational agents in mental healthcare services: a thematic analysis of user perceptions","volume":"12","author":"Prakash","year":"2020","journal-title":"PAJAIS"},{"key":"B105","doi-asserted-by":"publisher","first-page":"455","DOI":"10.3390\/medicina56090455","article-title":"Comparison of conventional statistical methods with machine learning in medicine: diagnosis, drug development, and treatment","volume":"56","author":"Rajula","year":"2020","journal-title":"Medicina"},{"key":"B106","volume-title":"Verfahren zur T\u00e4tigkeitsanalyse und-Gestaltung bei Mentalen Arbeitsanforderungen (TAG-MA)","author":"Rau","year":"2021"},{"key":"B107","volume-title":"Psychische Belastung und Beanspruchung. Stress, psychische Erm\u00fcdung, Monotonie, psychische S\u00e4ttigung","author":"Richter","year":"2000"},{"key":"B108","article-title":"\u201cInfoteil A: Beschreibung psychischer Belastungsfaktoren bei der Arbeit,\u201d","volume-title":"Erfahrungen und Empfehlungen","author":"Richter","year":"2014"},{"key":"B109","doi-asserted-by":"publisher","first-page":"899","DOI":"10.3923\/jas.2008.899.902","article-title":"A TAM model to evaluate user's attitude towards adoption of decision support systems","volume":"8","author":"Rigopoulos","year":"2008","journal-title":"J. Appl. Sci"},{"key":"B110","first-page":"193","article-title":"Das Belastungs-Beanspruchungs-Konzept. Z","volume":"38","author":"Rohmert","year":"1984","journal-title":"Arbeitswissenschaft"},{"key":"B111","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1108\/13665620510597176","article-title":"The impact of workplace learning on job satisfaction in small US commercial banks","volume":"17","author":"Rowden","year":"2005","journal-title":"J. Workplace Learn"},{"key":"B112","author":"Rudolph","year":"2017","journal-title":"T\u00e4tigkeitsbewertungssystem \u2013 Geistige Arbeit (Langform) TBS-GA (L) (PT Verlag)"},{"key":"B113","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1186\/1471-2458-8-48","article-title":"Working conditions, self-perceived stress, anxiety, depression and quality of life: a structural equation modelling approach","volume":"8","author":"Rusli","year":"2008","journal-title":"BMC Public Health"},{"key":"B114","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-658-14309-1_4","volume-title":"Wirkung von Gamification auf Motivation","author":"Sailer","year":"2016"},{"key":"B115","volume-title":"Effect of Perception of Benefits, Easy Perception of Use, Trust and Risk Perception Towards Interest Using E-money","author":"Sati","year":"2020"},{"key":"B116","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1177\/0165551517693712","article-title":"Information overload and coping strategies in the big data context: evidence from the hospitality sector","volume":"44","author":"Saxena","year":"2018","journal-title":"J. Inf. Sci"},{"key":"B117","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1007\/s11553-017-0582-5","article-title":"Umgang mit Zeit-und Leistungsdruck","volume":"12","author":"Schulz-Dadaczynski","year":"2017","journal-title":"Eher Anpassung als Reduktion. Pr\u00e4v. Gesundheitsf"},{"key":"B118","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/978-3-662-49322-9_1","article-title":"\u201cTheorien der Stressentstehung und -bew\u00e4ltigung,\u201d","volume-title":"Handbuch Stressregulation und Sport","author":"Semmer","year":"2018"},{"key":"B119","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1080\/08838151.2020.1843357","article-title":"User perceptions of algorithmic decisions in the personalized AI system:perceptual evaluation of fairness, accountability, transparency, and explainability","volume":"64","author":"Shin","year":"2020","journal-title":"J. Broadcast. Electron. Media"},{"key":"B120","doi-asserted-by":"publisher","first-page":"102551","DOI":"10.1016\/j.ijhcs.2020.102551","article-title":"The effects of explainability and causability on perception, trust, and acceptance: implications for explainable AI","volume":"146","author":"Shin","year":"2021","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B121","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ijinfomgt.2019.102061","article-title":"Beyond user experience: what constitutes algorithmic experiences?","volume":"52","author":"Shin","year":"2020","journal-title":"Int. J. Inform. Manag."},{"key":"B122","doi-asserted-by":"crossref","DOI":"10.1109\/TEMSCON-EUR52034.2021.9488649","article-title":"\u201cInformation overload in organization: impact on decision making and influencing strategies,\u201d","volume-title":"IEEE Technology and Engineering Management Conference \u2013 Europe (TEMSCON-EUR) 2021","author":"Shrivastav","year":"2021"},{"key":"B123","doi-asserted-by":"crossref","DOI":"10.1109\/ISDFS55398.2022.9800804","article-title":"Process standardization: \u201cThe driving factor for bringing artificial intelligence and management analytics to SMEs,\u201d","volume-title":"10th International Symposium on Digital Forensics and Security (ISDFS) 2022","author":"Silva","year":"2022"},{"key":"B124","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1006\/ijhc.1999.0252","article-title":"Does automation bias decision-making?","volume":"51","author":"Skitka","year":"1999","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B125","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40561-019-0088-z","article-title":"Inquiry and critical thinking skills for the next generation: from artificial intelligence back to human intelligence","volume":"6","author":"Spector","year":"2019","journal-title":"Smart Learn. Environ"},{"key":"B126","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1108\/JWL-04-2019-0045","article-title":"Perceived learning opportunities, behavioral intentions and employee retention in technology organizations","volume":"32","author":"Steil","year":"2020","journal-title":"J. Workplace Learn"},{"key":"B127","first-page":"80","article-title":"Theoretische Konzeption einer allgemeinen technischen Probleml\u00f6sef\u00e4higkeit und M\u00f6glichkeiten ihrer Diagnose","volume":"2","author":"Stemmann","year":"2014","journal-title":"J. Tech. Educ"},{"key":"B128","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1111\/bju.15662","article-title":"Application of artificial intelligence to overcome clinical information overload in urological cancer","volume":"130","author":"Stenzl","year":"2022","journal-title":"BJU Int"},{"key":"B129","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1109\/THMS.2020.2978041","article-title":"The Impact of agent transparency on human performance","volume":"50","author":"Stowers","year":"2020","journal-title":"IEEE Trans. Hum. Mach. Syst"},{"key":"B130","first-page":"1","article-title":"Exploring the relationship between perceived usefulness, perceived ease of use, perceived enjoyment, attitude and subscribers' intention towards using 3G mobile services","volume":"22","author":"Suki","year":"2011","journal-title":"J. Inf. Technol. Manag"},{"key":"B131","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1037\/a0033085","article-title":"Stress in highly demanding IT jobs: transformational leadership moderates the impact of time pressure on exhaustion and work-life balance","volume":"18","author":"Syrek","year":"2013","journal-title":"J. Occup. Health Psychol"},{"key":"B132","doi-asserted-by":"publisher","first-page":"1454","DOI":"10.7553\/66-1-1454","article-title":"Dying for information? An investigation into the effects of information overload in the UK and worldwide","volume":"66","author":"Theron","year":"2014","journal-title":"S. Afr. J. Libr. Inf. Sci"},{"key":"B133","doi-asserted-by":"publisher","first-page":"e29943","DOI":"10.2196\/29943","article-title":"A novel diagnostic decision support system for medical professionals: prospective feasibility study","volume":"6","author":"Timiliotis","year":"2022","journal-title":"JMIR Form. Res"},{"key":"B134","volume-title":"Arbeitszeitschutzrechtliche Bewertung der Intensit\u00e4t von Arbeitsleistungen: Unter Besonderer Ber\u00fccksichtigung der Rechtsprechung des Europ\u00e4ischen Gerichtshofes zum Bereitschaftsdienst.","author":"Tr\u00e4gner","year":"2006"},{"key":"B135","doi-asserted-by":"publisher","first-page":"1234","DOI":"10.1016\/j.ipm.2007.07.008","article-title":"Exploring usefulness and usability in the evaluation of open access digital libraries","volume":"44","author":"Tsakonas","year":"2008","journal-title":"Inf. Process. Manag"},{"key":"B136","doi-asserted-by":"publisher","first-page":"1261","DOI":"10.1007\/s10796-022-10282-5","article-title":"An AI-based decision support system for predicting mental health disorders","volume":"25","author":"Tutun","year":"2023","journal-title":"Inf. Syst. Front"},{"key":"B137","volume-title":"Arbeitspsychologie","author":"Ulich","year":"2011"},{"key":"B138","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1016\/j.chb.2017.03.010","article-title":"The relation between 21st-century skills and digital skills: a systematic literature review","volume":"72","author":"van Laar","year":"2017","journal-title":"Comput. Hum. Behav"},{"key":"B139","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1287\/mnsc.46.2.186.11926","article-title":"A theoretical extension of the technology acceptance model: four longitudinal field studies","volume":"46","author":"Venkatesh","year":"2000","journal-title":"Manag. Sci"},{"key":"B140","doi-asserted-by":"publisher","first-page":"660","DOI":"10.1016\/S2212-5671(12)00211-0","article-title":"The influence of the employee's performance on the Company's growth - A managerial perspective","volume":"3","author":"Vosloban","year":"2012","journal-title":"Procedia Econ. Fin"},{"key":"B141","unstructured":"WalchK.\n          Is There A Difference Between Assisted Intelligence Vs. Augmented Intelligence? Forbes2020"},{"key":"B142","article-title":"Do you really want to know why? \u201cEffects of AI-based DSS advice on human decisions,\u201d","author":"Wanner","year":"2021","journal-title":"Proceedings of Americas Conference on Information Systems (AMCIS) 2021"},{"key":"B143","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1016\/j.procs.2021.11.074","article-title":"Failure of AI projects: understanding the critical factors","volume":"196","author":"Westenberger","year":"2022","journal-title":"Procedia Comput. Sci"},{"key":"B144","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1108\/IJILT-02-2020-0022","article-title":"Artificial intelligence in the workplace \u2013 A double-edged sword","volume":"37","author":"Wilkens","year":"2020","journal-title":"Int. J. Inf. Learn. Technol"},{"key":"B145","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1108\/14684521311311658","article-title":"The impact of ubiquitous decision support systems on decision quality through individual absorptive capacity and perceived usefulness","volume":"37","author":"Wook Seo","year":"2013","journal-title":"Online Inf. Rev"},{"key":"B146","doi-asserted-by":"publisher","first-page":"5671","DOI":"10.3390\/su13105671","article-title":"Ai technology and online purchase intention: structural equation model based on perceived value","volume":"13","author":"Yin","year":"2021","journal-title":"Sustainability"},{"key":"B147","unstructured":"ZapfD.\n          Psychische Belastungen in der Arbeitswelt \u2013 Ein \u00dcberblick1998"},{"key":"B148","doi-asserted-by":"publisher","first-page":"618","DOI":"10.1108\/01409170610712326","article-title":"Cooperation and stress: exploring the differential impact of job satisfaction, communication and culture","volume":"29","author":"Zeffane","year":"2006","journal-title":"Manag. Res. Rev"},{"key":"B149","doi-asserted-by":"publisher","first-page":"657015","DOI":"10.3389\/fpsyg.2021.657015","article-title":"Development and validation of the win-win scale","volume":"12","author":"Zhang","year":"2021","journal-title":"Front. Psychol"},{"key":"B150","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1145\/3351095.3372852","article-title":"\u201cEffect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making.\u201d","volume-title":"Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency","author":"Zhang","year":"2020"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1249322\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,26]],"date-time":"2023-09-26T07:06:08Z","timestamp":1695711968000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1249322\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,25]]},"references-count":150,"alternative-id":["10.3389\/frai.2023.1249322"],"URL":"https:\/\/doi.org\/10.3389\/frai.2023.1249322","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,25]]},"article-number":"1249322"}}