{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T10:30:37Z","timestamp":1769596237036,"version":"3.49.0"},"reference-count":52,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T00:00:00Z","timestamp":1761523200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["5DP1LM014558-03"],"award-info":[{"award-number":["5DP1LM014558-03"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["1DP1OD035237-01"],"award-info":[{"award-number":["1DP1OD035237-01"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Helping Doctors Doctor: Using AI to Automate Documentation and \u2018De-Autonomate\u2019 Health Care"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To support ambulatory care innovation, we created Observer, a multimodal dataset comprising videotaped outpatient visits, electronic health record (EHR) data, and structured surveys. This paper describes the data collection procedures and summarizes the clinical and contextual features of the dataset.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>A multistakeholder steering group shaped recruitment strategies, survey design, and privacy-preserving design. Consented patients and primary care providers (PCPs) were recorded using room-view and egocentric cameras. EHR data, metadata, and audit logs were also captured. A custom de-identification pipeline, combining transcript redaction, voice masking, and facial blurring, ensured video and EHR HIPAA compliance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We report on the first 100 visits in this continually growing dataset. Thirteen PCPs from 4 clinics participated. Recording the first 100 visits required approaching 210 patients, from which 129 consented (61%), with 29 patients missing their scheduled encounter after consenting. Visit lengths ranged from 5 to 100 minutes, covering preventive care to chronic disease management. Survey responses revealed high satisfaction: 4.24\/5 (patients) and 3.94\/5 (PCPs). Visit experience was unaffected by the presence of video recording technology.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>We demonstrate the feasibility of capturing rich, real-world primary care interactions using scalable, privacy-sensitive methods. Room layout and camera placement were key influences on recorded communication and are now added to the dataset. The Observer dataset enables future clinical AI research\/development, communication studies, and informatics education among public and private user groups.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Observer is a new, shareable, real-world clinic encounter research and teaching resource with a representative sample of adult primary care data.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocaf182","type":"journal-article","created":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T12:04:49Z","timestamp":1760097889000},"page":"424-433","source":"Crossref","is-referenced-by-count":0,"title":["Observer: creation of a novel multimodal dataset for outpatient care research"],"prefix":"10.1093","volume":"33","author":[{"given":"Kevin B","family":"Johnson","sequence":"first","affiliation":[{"name":"Division of Biomedical Informatics, Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine at the University of Pennsylvania , Philadelphia, PA, 19104,","place":["United States"]},{"name":"Department of Computer and Information Science, School of Engineering and Applied Science, University of Pennsylvania , Philadelphia, PA, 19104,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0805-595X","authenticated-orcid":false,"given":"Basam","family":"Alasaly","sequence":"additional","affiliation":[{"name":"Division of Biomedical Informatics, Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine at the University of Pennsylvania , Philadelphia, PA, 19104,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kuk Jin","family":"Jang","sequence":"additional","affiliation":[{"name":"Division of Biomedical Informatics, Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine at the University of Pennsylvania , Philadelphia, PA, 19104,","place":["United States"]},{"name":"Department of Computer and Information Science, School of Engineering and Applied Science, University of Pennsylvania , Philadelphia, PA, 19104,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric","family":"Eaton","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Science, School of Engineering and Applied Science, University of Pennsylvania , Philadelphia, PA, 19104,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sriharsha","family":"Mopidevi","sequence":"additional","affiliation":[{"name":"Division of Biomedical Informatics, Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine at the University of Pennsylvania , Philadelphia, PA, 19104,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8235-9900","authenticated-orcid":false,"given":"Ross","family":"Koppel","sequence":"additional","affiliation":[{"name":"Division of Biomedical Informatics, Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine at the University of Pennsylvania , Philadelphia, PA, 19104,","place":["United States"]},{"name":"School of Arts and Sciences, University of Pennsylvania , Philadelphia, PA, 19104,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2025,10,27]]},"reference":[{"key":"2026012716161830100_ocaf182-B1","author":"Blumenthal"},{"key":"2026012716161830100_ocaf182-B2","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1146\/annurev.med.58.061705.144942","article-title":"Rethinking electronic health records to better achieve quality and safety goals","volume":"58","author":"Stead","year":"2007","journal-title":"Annu Rev Med"},{"key":"2026012716161830100_ocaf182-B3","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1001\/jama.2022.12243","article-title":"Making electronic health records both SAFER and SMARTER","volume":"328","author":"Johnson","year":"2022","journal-title":"JAMA"},{"key":"2026012716161830100_ocaf182-B4","volume-title":"Computational Technology for Effective Health Care: Immediate Steps and Strategic Directions","author":"National Research Council (US) Committee on Engaging the Computer Science Research Community in Health Care Informatics","year":"2009"},{"key":"2026012716161830100_ocaf182-B5","doi-asserted-by":"publisher","first-page":"967","DOI":"10.1093\/jamia\/ocaa274","article-title":"Electronic health records and clinician burnout: a story of three eras","volume":"28","author":"Johnson","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716161830100_ocaf182-B6","doi-asserted-by":"publisher","first-page":"161","DOI":"10.14236\/jhi.v21i4.72","article-title":"Using video-based observation research methods in primary care health encounters to evaluate complex interactions","volume":"21","author":"Asan","year":"2014","journal-title":"Inform Prim Care"},{"key":"2026012716161830100_ocaf182-B7","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.pec.2022.09.017","article-title":"Video-based observation research: a systematic review of studies in outpatient health care settings","volume":"106","author":"Golembiewski","year":"2023","journal-title":"Patient Educ Couns"},{"key":"2026012716161830100_ocaf182-B8","article-title":"Transforming education research through open video data sharing","volume":"5","author":"Gilmore","year":"2016","journal-title":"Adv Eng Educ"},{"key":"2026012716161830100_ocaf182-B9","doi-asserted-by":"publisher","first-page":"69","DOI":"10.5172\/ijtr.2013.11.1.69","article-title":"Using videos and multimodal discourse analysis to study how students learn a trade","volume":"11","author":"Chan","year":"2013","journal-title":"Int J Training Res"},{"key":"2026012716161830100_ocaf182-B10","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1093\/fampra\/17.5.422","article-title":"Using video-recorded consultations for research in primary care: advantages and limitations","volume":"17","author":"Coleman","year":"2000","journal-title":"Fam Pract"},{"key":"2026012716161830100_ocaf182-B11","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1177\/0049124118769093","article-title":"Video data analysis: a methodological frame for a novel research trend","volume":"50","author":"Nassauer","year":"2021","journal-title":"Sociol Meth Res"},{"key":"2026012716161830100_ocaf182-B12","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1515\/9783110290691.255","volume-title":"Principles of Visual Anthropology","author":"Schaeffer","year":"1995"},{"key":"2026012716161830100_ocaf182-B13","doi-asserted-by":"publisher","first-page":"1976","DOI":"10.3233\/SHTI190742","article-title":"Use of eye-tracking in studies of EHR usability\u2014the current state: a scoping review","volume":"264","author":"Senathirajah","year":"2019","journal-title":"Stud Health Technol Inform"},{"key":"2026012716161830100_ocaf182-B14","first-page":"1k","article-title":"Evaluation of physicians\u2019 electronic health records experience using actual and perceived measures","volume":"19","author":"Khairat","year":"2022","journal-title":"Perspect Health Inf Manag"},{"key":"2026012716161830100_ocaf182-B15","doi-asserted-by":"publisher","first-page":"e207385","DOI":"10.1001\/jamanetworkopen.2020.7385","article-title":"Association of electronic health record use with physician fatigue and efficiency","volume":"3","author":"Khairat","year":"2020","journal-title":"JAMA Netw Open"},{"key":"2026012716161830100_ocaf182-B16","doi-asserted-by":"publisher","first-page":"25983","DOI":"10.17226\/25983","volume-title":"Implementing High-Quality Primary Care: Rebuilding the Foundation of Health Care","author":"Committee on Implementing High-Quality Primary Care, Board on Health Care Services, Health and Medicine Division, National Academies of Sciences, Engineering, and Medicine","year":"2021"},{"key":"2026012716161830100_ocaf182-B17","volume-title":"Doing Qualitative Research","author":"Crabtree","year":"2012","edition":"2nd ed"},{"key":"2026012716161830100_ocaf182-B18","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1001\/jama.297.4.403","article-title":"Practice-based research\u2014\"Blue Highways\" on the NIH roadmap","volume":"297","author":"Westfall","year":"2007","journal-title":"JAMA"},{"key":"2026012716161830100_ocaf182-B19","doi-asserted-by":"publisher","first-page":"423","DOI":"10.3122\/jabfm.2009.04.090105","article-title":"Practice-based research is community engagement","volume":"22","author":"Westfall","year":"2009","journal-title":"J Am Board Fam Med"},{"key":"2026012716161830100_ocaf182-B20","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1370\/afm.1199","article-title":"Card studies for observational research in practice","volume":"9","author":"Westfall","year":"2011","journal-title":"Ann Fam Med"},{"key":"2026012716161830100_ocaf182-B21","doi-asserted-by":"publisher","first-page":"113","DOI":"10.18865\/ed.29.S1.113","article-title":"Practice-based research networks: strategic opportunities to advance implementation research for health equity","volume":"29","author":"Westfall","year":"2019","journal-title":"Ethn Dis"},{"key":"2026012716161830100_ocaf182-B22","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1093\/ije\/dyy001","article-title":"Growing inequality: bridging complex systems, population health and health disparities","volume":"47","author":"Braithwaite","year":"2018","journal-title":"Int J Epidemiol"},{"key":"2026012716161830100_ocaf182-B23","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1007\/BF02599656","article-title":"Multimethod research: approaches for integrating qualitative and quantitative methods","volume":"9","author":"Stange","year":"1994","journal-title":"J Gen Intern Med"},{"key":"2026012716161830100_ocaf182-B24","first-page":"286","article-title":"Developing the knowledge base of family practice","volume":"33","author":"Stange","year":"2001","journal-title":"Fam Med"},{"key":"2026012716161830100_ocaf182-B25","first-page":"448","article-title":"Integrating qualitative and quantitative research methods","volume":"21","author":"Stange","year":"1989","journal-title":"Fam Med"},{"key":"2026012716161830100_ocaf182-B26","volume-title":"Identifying Personal Strengths to Help Patients Manage Chronic Illness","author":"Aungst","year":"2019"},{"key":"2026012716161830100_ocaf182-B27","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1136\/bmj.319.7212.774","article-title":"Participatory research maximises community and lay involvement","volume":"319","author":"Macaulay","year":"1999","journal-title":"BMJ"},{"key":"2026012716161830100_ocaf182-B28","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1370\/afm.1841","article-title":"A participatory model of the paradox of primary care","volume":"13","author":"Homa","year":"2015","journal-title":"Ann Fam Med"},{"key":"2026012716161830100_ocaf182-B29","doi-asserted-by":"publisher","first-page":"113885","DOI":"10.1016\/j.eswa.2020.113885","article-title":"A cross-disciplinary comparison of multimodal data fusion approaches and applications: accelerating learning through trans-disciplinary information sharing","volume":"165","author":"Bokade","year":"2021","journal-title":"Expert Syst Appl"},{"key":"2026012716161830100_ocaf182-B30","doi-asserted-by":"publisher","first-page":"2995","DOI":"10.1007\/s11606-024-08870-z","article-title":"Can the administrative loads of physicians be alleviated by AI-facilitated clinical documentation?","volume":"39","author":"Bundy","year":"2024","journal-title":"J Gen Intern Med. Published"},{"key":"2026012716161830100_ocaf182-B31","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1186\/s12891-022-05376-9","article-title":"A multicentre validation study of a smartphone application to screen hand arthritis","volume":"23","author":"Reed","year":"2022","journal-title":"BMC Musculoskelet Disord"},{"key":"2026012716161830100_ocaf182-B32","doi-asserted-by":"crossref","DOI":"10.4135\/9781036233358","volume-title":"Interpreting Qualitative Data","author":"Silverman","year":"2024","edition":"7th"},{"key":"2026012716161830100_ocaf182-B33","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1038\/s41746-022-00731-5","article-title":"Bending the patient safety curve: how much can AI help?","volume":"6","author":"Classen","year":"2023","journal-title":"NPJ Digit Med"},{"key":"2026012716161830100_ocaf182-B34","doi-asserted-by":"publisher","first-page":"1773","DOI":"10.1038\/s41591-022-01981-2","article-title":"Multimodal biomedical AI","volume":"28","author":"Acosta","year":"2022","journal-title":"Nat Med"},{"key":"2026012716161830100_ocaf182-B35","doi-asserted-by":"publisher","first-page":"2977","DOI":"10.1038\/s41591-024-03118-z","article-title":"AI-based differential diagnosis of dementia etiologies on multimodal data","volume":"30","author":"Xue","year":"2024","journal-title":"Nat Med"},{"key":"2026012716161830100_ocaf182-B36","first-page":"455","article-title":"Does awareness of being video recorded affect doctors\u2019 consultation behaviour?","volume":"40","author":"Pringle","year":"1990","journal-title":"Br J Gen Pract"},{"key":"2026012716161830100_ocaf182-B37","doi-asserted-by":"publisher","first-page":"160018","DOI":"10.1038\/sdata.2016.18","article-title":"The FAIR Guiding Principles for scientific data management and stewardship","volume":"3","author":"Wilkinson","year":"2016","journal-title":"Sci Data"},{"key":"2026012716161830100_ocaf182-B38","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1016\/j.jbi.2008.08.010","article-title":"Research electronic data capture (REDCap)\u2014a metadata-driven methodology and workflow process for providing translational research informatics support","volume":"42","author":"Harris","year":"2009","journal-title":"J Biomed Inform"},{"key":"2026012716161830100_ocaf182-B39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/NYSDS.2016.7747817","author":"Gilmore","year":"2016"},{"key":"2026012716161830100_ocaf182-B40","author":"Liberman","year":"2024"},{"key":"2026012716161830100_ocaf182-B41","author":"Talby","year":"2025"},{"key":"2026012716161830100_ocaf182-B42","doi-asserted-by":"publisher","first-page":"1448351","DOI":"10.3389\/fdgth.2024.1448351","article-title":"Voice EHR: introducing multimodal audio data for health","volume":"6","author":"Anibal","year":"2025","journal-title":"Front Digit Health"},{"key":"2026012716161830100_ocaf182-B43","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1016\/j.ijmedinf.2013.11.003","article-title":"Dynamic modeling of patient and physician eye gaze to understand the effects of electronic health records on doctor-patient communication and attention","volume":"83","author":"Montague","year":"2014","journal-title":"Int J Med Inform"},{"key":"2026012716161830100_ocaf182-B44","doi-asserted-by":"publisher","author":"Mopidevi","year":"2025","DOI":"10.2139\/ssrn.5194782"},{"key":"2026012716161830100_ocaf182-B45","author":"U.S. Department of Health and Human Services","year":"2025"},{"key":"2026012716161830100_ocaf182-B46","doi-asserted-by":"publisher","first-page":"e67","DOI":"10.1136\/amiajnl-2012-001081","article-title":"Using the computer in the clinical consultation; setting the stage, reviewing, recording, and taking actions: multi-channel video study","volume":"20","author":"Kumarapeli","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716161830100_ocaf182-B47","doi-asserted-by":"publisher","first-page":"e207","DOI":"10.1093\/jamia\/ocw121","article-title":"Developing an evidence base of best practices for integrating computerized systems into the exam room: a systematic review","volume":"24","author":"Patel","year":"2017","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716161830100_ocaf182-B48","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1080\/1047840X.2012.705133","article-title":"Toward open behavioral science","volume":"23","author":"Adolph","year":"2012","journal-title":"Psychol Inq"},{"key":"2026012716161830100_ocaf182-B49","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.cd000259.pub4","article-title":"Audit and feedback: effects on professional practice","volume":"2025","author":"Ivers","year":"2025","journal-title":"Cochrane Database Syst Rev"},{"key":"2026012716161830100_ocaf182-B50","author":"Jang","year":"2025"},{"key":"2026012716161830100_ocaf182-B51","doi-asserted-by":"publisher","first-page":"16094069231165949","DOI":"10.1177\/16094069231165949","article-title":"Ethical issues when using digital platforms to perform interviews in qualitative health research","volume":"22","author":"Maldonado-Castellanos","year":"2023","journal-title":"Int J Qual Methods"},{"key":"2026012716161830100_ocaf182-B52","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1007\/s10676-022-09624-3","article-title":"A sociotechnical perspective for the future of AI: narratives, inequalities, and human control","volume":"24","author":"Sartori","year":"2022","journal-title":"Ethics Inf Technol"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/2\/424\/64959741\/ocaf182.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/2\/424\/64959741\/ocaf182.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T21:16:26Z","timestamp":1769548586000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/33\/2\/424\/8304365"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,27]]},"references-count":52,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,10,27]]},"published-print":{"date-parts":[[2026,2,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaf182","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,2]]},"published":{"date-parts":[[2025,10,27]]}}}