{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T06:27:44Z","timestamp":1775197664788,"version":"3.50.1"},"reference-count":36,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,8,16]],"date-time":"2024-08-16T00:00:00Z","timestamp":1723766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Radiologists frequently lack direct patient contact due to time constraints. Digital medical interview assistants aim to facilitate the collection of health information. In this paper, we propose leveraging conversational agents to realize a medical interview assistant to facilitate medical history taking, while at the same time offering patients the opportunity to ask questions on the examination.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>MIA, the digital medical interview assistant, was developed using a person-based design approach, involving patient opinions and expert knowledge during the design and development with a specific use case in collecting information before a mammography examination. MIA consists of two modules: the interview module and the question answering module (Q&amp;amp;A). To ensure interoperability with clinical information systems, we use HL7 FHIR to store and exchange the results collected by MIA during the patient interaction. The system was evaluated according to an existing evaluation framework that covers a broad range of aspects related to the technical quality of a conversational agent including usability, but also accessibility and security.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Thirty-six patients recruited from two Swiss hospitals (Lindenhof group and Inselspital, Bern) and two patient organizations conducted the usability test. MIA was favorably received by the participants, who particularly noted the clarity of communication. However, there is room for improvement in the perceived quality of the conversation, the information provided, and the protection of privacy. The Q&amp;amp;A module achieved a precision of 0.51, a recall of 0.87 and an F-Score of 0.64 based on 114 questions asked by the participants. Security and accessibility also require improvements.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>The applied person-based process described in this paper can provide best practices for future development of medical interview assistants. The application of a standardized evaluation framework helped in saving time and ensures comparability of results.<\/jats:p><\/jats:sec>","DOI":"10.3389\/frai.2024.1431156","type":"journal-article","created":{"date-parts":[[2024,8,16]],"date-time":"2024-08-16T14:42:55Z","timestamp":1723819375000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Person-based design and evaluation of MIA, a digital medical interview assistant for radiology"],"prefix":"10.3389","volume":"7","author":[{"given":"Kerstin","family":"Denecke","sequence":"first","affiliation":[]},{"given":"Daniel","family":"Reichenpfader","sequence":"additional","affiliation":[]},{"given":"Dominic","family":"Willi","sequence":"additional","affiliation":[]},{"given":"Karin","family":"Kennel","sequence":"additional","affiliation":[]},{"given":"Harald","family":"Bonel","sequence":"additional","affiliation":[]},{"given":"Knud","family":"Nairz","sequence":"additional","affiliation":[]},{"given":"Nikola","family":"Cihoric","sequence":"additional","affiliation":[]},{"given":"Damien","family":"Papaux","sequence":"additional","affiliation":[]},{"given":"Hendrik","family":"von Tengg-Kobligk","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2024,8,16]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"35","DOI":"10.5811\/westjem.2013.2.11498","article-title":"Patient impression and satisfaction of a self-administered, automated medical history-taking device in the emergency department","volume":"15","author":"Arora","year":"2014","journal-title":"West. J. Emerg. Med"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2020.5867","article-title":"Frequency and types of patient-reported errors in electronic health record ambulatory care notes","author":"Bell","year":"2020","journal-title":"J. Am. Med. Assoc. Netw. Open"},{"key":"B3","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1007\/s00779-021-01582-9","article-title":"The chatbot usability scale: the design and pilot of a usability scale for interaction with ai-based conversational agents","volume":"26","author":"Borsci","year":"2022","journal-title":"Person. Ubiquit. Comput"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.2196\/humanfactors.5919","article-title":"Integrating patient-generated health data into clinical care settings or clinical decision-making: lessons learned from project healthdesign","author":"Cohen","year":"2016","journal-title":"JMIR Hum. Fact"},{"key":"B5","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1097\/NCN.0b013e31819f7c7c","article-title":"User-centered design and interactive health technologies for patients","volume":"27","author":"Dabbs","year":"2009","journal-title":"Comput. Informat. Nurs"},{"key":"B6","doi-asserted-by":"publisher","first-page":"1061","DOI":"10.3390\/healthcare11081061","article-title":"Framework for guiding the development of high-quality conversational agents in healthcare","volume":"11","author":"Denecke","year":"","journal-title":"Healthcare"},{"key":"B7","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1038\/s41572-023-00482-x","article-title":"Potential and pitfalls of conversational agents in health care","volume":"9","author":"Denecke","year":"","journal-title":"Nat. Rev. Dis. Prim"},{"key":"B8","first-page":"66","author":"Denecke","year":"2023","journal-title":"Studies in Health Technology and Informatics"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.2196\/41583","article-title":"Developing a technical-oriented taxonomy to define archetypes of conversational agents in health care: literature review and cluster analysis","author":"Denecke","year":"2023","journal-title":"J. Med. Internet Res"},{"key":"B10","doi-asserted-by":"publisher","first-page":"52399","DOI":"10.2196\/52399","article-title":"Potentials of large language models in healthcare: a delphi study","volume":"2024","author":"Denecke","year":"2024","journal-title":"J. Med. Internet Res"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.2196\/38740","article-title":"Designing, developing, evaluating, and implementing a smartphone-delivered, rule-based conversational agent (discover): development of a conceptual framework","author":"Dhinagaran","year":"2022","journal-title":"JMIR mHealth uHealth"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2012-001570","article-title":"A systematic review of evidence on the links between patient experience and clinical safety and effectiveness","author":"Doyle","year":"2013","journal-title":"Br. Med. J. Open"},{"key":"B13","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1145\/3106426.3106427","article-title":"\u201cLarge-scale readability analysis of privacy policies,\u201d","volume-title":"Proceedings of the International Conference on Web Intelligence, WI '17","author":"Fabian","year":"2017"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooad073","article-title":"A chatbot for hypertension self-management support: user-centered design, development, and usability testing","author":"Griffin","year":"2023","journal-title":"J. Am. Med. Assoc. Open"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2021.48983","article-title":"Family history of breast cancer and mammographic breast density in premenopausal women","author":"Han","year":"2022","journal-title":"J. Am. Med. Assoc. Netw. Open"},{"key":"B16","unstructured":"SDC Home Page\u2014Structured Data Capture v3.0.0\n          \n          2023"},{"key":"B17","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1308\/rcsann.2020.0103","article-title":"Impact of family history risk assessment on surgical decisions and imaging surveillance at breast cancer diagnosis","volume":"102","author":"Jones","year":"2020","journal-title":"Ann. Royal Coll. Surg. Engl"},{"key":"B18","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1016\/j.jacr.2015.11.011","article-title":"Patients want to meet with imaging experts","volume":"13","author":"Koney","year":"2016","journal-title":"J. Am. Coll. Radiol"},{"key":"B19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3411764.3445312","article-title":"\u201cHeuristic evaluation of conversational agents,\u201d","volume-title":"Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems","author":"Langevin","year":"2021"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1248","DOI":"10.1093\/jamia\/ocy072","article-title":"Conversational agents in healthcare: a systematic review","volume":"25","author":"Laranjo","year":"2018","journal-title":"J. Am. Med. Informat. Assoc"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.2196\/20346","article-title":"The effectiveness of artificial intelligence conversational agents in health care: systematic review","author":"Milne-Ives","year":"2020","journal-title":"J. Med. Internet Res"},{"key":"B22","doi-asserted-by":"publisher","first-page":"2055207619871808","DOI":"10.1177\/2055207619871808","article-title":"Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: a mixed-methods study","volume":"5","author":"Nadarzynski","year":"2019","journal-title":"Digit. Health"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0203807","article-title":"Enhancing patient value efficiently: medical history interviews create patient satisfaction and contribute to an improved quality of radiologic examinations","author":"Nairz","year":"2018","journal-title":"PLoS ONE"},{"key":"B24","unstructured":"Nielsen\n              J.\n            \n          \n          Quantitative Studies: How Many Users to Test?\n          \n          2006"},{"key":"B25","doi-asserted-by":"publisher","first-page":"155","DOI":"10.14236\/jhi.v19i3.808","article-title":"Computer-assisted history-taking systems (CAHTS) in health care: benefits, risks and potential for further development","volume":"19","author":"Pappas","year":"2011","journal-title":"Inform Prim. Care"},{"key":"B26","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1136\/bmj.297.6650.697","article-title":"Using computers to take patient histories","volume":"297","author":"Pringle","year":"1988","journal-title":"Br. Med. J"},{"key":"B27","doi-asserted-by":"publisher","first-page":"22","DOI":"10.3233\/SHTI240006","article-title":"Large language model-based evaluation of medical question answering systems: algorithm development and case study","volume":"313","author":"Reichenpfader","year":"2024","journal-title":"Stud. Health Technol. Informat"},{"key":"B28","doi-asserted-by":"publisher","first-page":"110464","DOI":"10.1016\/j.ejrad.2022.110464","article-title":"Patient communication in radiology: moving up the agenda","volume":"155","author":"Rockall","year":"2022","journal-title":"Eur. J. Radiol"},{"key":"B29","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1148\/radiol.2016161553","article-title":"Common data elements in radiology","volume":"283","year":"2017","journal-title":"Radiology"},{"key":"B30","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1056\/NEJM196601272740406","article-title":"A computer-based medical-history system","volume":"274","author":"Slack","year":"1966","journal-title":"N. Engl. J. Med"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.2196\/19306","article-title":"The computer will see you now: overcoming barriers to adoption of computer-assisted history taking (CAHT) in primary care","author":"Spinazze","year":"2021","journal-title":"J. Med. Internet Res"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1211150","DOI":"10.3389\/frhs.2023.1211150","article-title":"Implementing ai in healthcare\u2014the relevance of trust: a scoping review","volume":"3","author":"Steerling","year":"2023","journal-title":"Front. Health Serv"},{"key":"B33","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1007\/s00270-015-1228-7","article-title":"Patient evaluation and preparation in vascular and interventional radiology: what every interventional radiologist should know (part 1: patient assessment and laboratory tests)","volume":"39","author":"Taslakian","year":"2016","journal-title":"Cardiovasc. Intervent. Radiol"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.2196\/17158","article-title":"Conversational agents in health care: scoping review and conceptual analysis","author":"Tudor Car","year":"2020","journal-title":"J. Med. Internet Res"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD008488.pub2","article-title":"Computer-assisted vs. oral-and-written dietary history taking for diabetes mellitus","author":"Wei","year":"2011","journal-title":"Cochr. Datab. Systemat. Rev"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.4055","article-title":"The person-based approach to intervention development: application to digital health-related behavior change interventions","author":"Yardley","year":"2015","journal-title":"J. Med. Internet Res"}],"updated-by":[{"DOI":"10.3389\/frai.2024.1546421","type":"corrigendum","label":"Corrigendum","source":"publisher","updated":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T00:00:00Z","timestamp":1736208000000}}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1431156\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T09:13:03Z","timestamp":1736241183000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1431156\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,16]]},"references-count":36,"alternative-id":["10.3389\/frai.2024.1431156"],"URL":"https:\/\/doi.org\/10.3389\/frai.2024.1431156","relation":{"corrigendum":[{"id-type":"doi","id":"10.3389\/frai.2024.1546421","asserted-by":"object"}]},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,16]]},"article-number":"1431156"}}