{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T07:27:50Z","timestamp":1767338870896,"version":"3.37.3"},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,11,11]],"date-time":"2024-11-11T00:00:00Z","timestamp":1731283200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,11]],"date-time":"2024-11-11T00:00:00Z","timestamp":1731283200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002839","name":"Charit\u00e9 - Universit\u00e4tsmedizin Berlin","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100002839","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Clinical data warehouses provide harmonized access to healthcare data for medical researchers. Informatics for Integrating Biology and the Bedside (i2b2) is a well-established open-source solution with the major benefit that data representations can be tailored to support specific use cases. These data representations can be defined and improved via an iterative approach together with domain experts and the medical researchers using the platform. To facilitate these discussions, it is important to understand how users interact with the system.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Objective<\/jats:title>\n                <jats:p>The objective of this work was to develop metrics for describing user interactions with clinical data warehouses in general and i2b2 in particular. Moreover, we aimed to develop a dashboard featuring interactive visualizations that inform data engineers and data stewards about potential improvements.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We first identified metrics for different data usage dimensions and extracted the relevant metadata about previous user queries from the i2b2 database schema for further analysis. We then implemented associated visualizations in Python and integrated the results into an interactive dashboard using Dash.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The identified categories of metrics include frequency of use, session duration, and use of functionality and features. We created a dashboard that extends our local i2b2 data warehouse platform, focusing on the latter category, further broken down into the number of queries, frequently queried concepts, and query complexity. The implementation is available as open-source software.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>A range of metrics can be derived from metadata logged in the i2b2 database schema to provide data engineers and data stewards with a comprehensive understanding of how users interact with the platform. This can help to identify the strengths and limitations of specific instances of the platform for specific use cases and aid their iterative improvement.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-024-02748-0","type":"journal-article","created":{"date-parts":[[2024,11,11]],"date-time":"2024-11-11T12:09:01Z","timestamp":1731326941000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["An interactive dashboard for analyzing user interaction patterns in the i2b2 clinical data warehouse"],"prefix":"10.1186","volume":"24","author":[{"given":"Lena","family":"Baum","sequence":"first","affiliation":[]},{"given":"Armin","family":"M\u00fcller","sequence":"additional","affiliation":[]},{"given":"Marco","family":"Johns","sequence":"additional","affiliation":[]},{"given":"Hammam","family":"Abu Attieh","sequence":"additional","affiliation":[]},{"given":"Mehmed","family":"Halilovic","sequence":"additional","affiliation":[]},{"given":"Vladimir","family":"Milicevic","sequence":"additional","affiliation":[]},{"given":"Diogo Telmo","family":"Neves","sequence":"additional","affiliation":[]},{"given":"Karen","family":"Otte","sequence":"additional","affiliation":[]},{"given":"Anna","family":"Pasquier","sequence":"additional","affiliation":[]},{"given":"Felix Nikolaus","family":"Wirth","sequence":"additional","affiliation":[]},{"given":"Patrick","family":"Segelitz","sequence":"additional","affiliation":[]},{"given":"Katharina","family":"Sch\u00f6nrath","sequence":"additional","affiliation":[]},{"given":"Joachim E.","family":"Weber","sequence":"additional","affiliation":[]},{"given":"Fabian","family":"Prasser","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,11,11]]},"reference":[{"issue":"1","key":"2748_CR1","doi-asserted-by":"publisher","first-page":"38","DOI":"10.3414\/ME9132","volume":"48","author":"HU Prokosch","year":"2009","unstructured":"Prokosch HU, Ganslandt T. Perspectives for medical informatics. Reusing the electronic medical record for clinical research. Methods Inf Med. 2009;48(1):38\u201344.","journal-title":"Methods Inf Med"},{"key":"2748_CR2","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1136\/jamia.2009.000893","volume":"17","author":"SN Murphy","year":"2010","unstructured":"Murphy SN, Weber G, Mendis M, Gainer V, Chueh HC, Churchill S, et al. Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2). J Am Med Inf Assoc. 2010;17:124\u201330.","journal-title":"J Am Med Inf Assoc"},{"key":"2748_CR3","unstructured":"Meystre SM, Deshmukh VG, Mitchell J. A clinical use case to evaluate the i2b2 Hive: predicting asthma exacerbations. AMIA Annu Symp Proc AMIA Symp. 2009;2009:442\u20136."},{"issue":"10","key":"2748_CR4","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.1093\/jamia\/ocy093","volume":"25","author":"JG Klann","year":"2018","unstructured":"Klann JG, Phillips LC, Herrick C, Joss MAH, Wagholikar KB, Murphy SN. Web services for data warehouses: OMOP and PCORnet on i2b2. J Am Med Inf Assoc. 2018;25(10):1331\u20138.","journal-title":"J Am Med Inf Assoc"},{"key":"2748_CR5","unstructured":"Solbrig HR, Hong N, Murphy SN, Jiang G. Automated Population of an i2b2 Clinical Data Warehouse using FHIR. AMIA Annu Symp Proc AMIA Symp. 2018;2018:979\u201388."},{"key":"2748_CR6","doi-asserted-by":"crossref","unstructured":"Gagalova KK, Leon Elizalde MA, Portales-Casamar E, G\u00f6rges M. JMIR Form Res. 2020;4(8):e17687. What You Need to Know Before Implementing a Clinical Research Data Warehouse: Comparative Review of Integrated Data Repositories in Health Care Institutions.","DOI":"10.2196\/17687"},{"issue":"7","key":"2748_CR7","doi-asserted-by":"publisher","first-page":"e15918","DOI":"10.2196\/15918","volume":"8","author":"H Spengler","year":"2020","unstructured":"Spengler H, Lang C, Mahapatra T, Gatz I, Kuhn KA, Prasser F. Enabling Agile Clinical and Translational Data Warehousing: platform development and evaluation. JMIR Med Inf. 2020;8(7):e15918.","journal-title":"JMIR Med Inf"},{"key":"2748_CR8","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.jbi.2014.02.003","volume":"52","author":"I Danciu","year":"2014","unstructured":"Danciu I, Cowan JD, Basford M, Wang X, Saip A, Osgood S, et al. Secondary use of clinical data: the Vanderbilt approach. J Biomed Inf. 2014;52:28\u201335.","journal-title":"J Biomed Inf"},{"key":"2748_CR9","first-page":"462","volume":"281","author":"M Johns","year":"2021","unstructured":"Johns M, M\u00fcller A, Wirth FN, Prasser F. A Comprehensive Portal for Clinical and Translational Data warehouses. Stud Health Technol Inf. 2021;281:462\u20136.","journal-title":"Stud Health Technol Inf"},{"key":"2748_CR10","unstructured":"Obe RO, Hsu LS. PostgreSQL: up and running: a practical guide to the advanced open source database. Third edition. Beijing Boston Farnham Sebastopol Tokyo: O\u2019Reilly; 2018. 294 p."},{"key":"2748_CR11","unstructured":"Data Repository (CRC). Cell - Server (Cells) Design - i2b2 Community Wiki [Internet]. [cited 2024 Jun 12]. https:\/\/community.i2b2.org\/wiki\/display\/ServerSideDesign\/Data+Repository+%28CRC%29+Cell"},{"key":"2748_CR12","unstructured":"QT_QUERY_MASTER - Server. (Cells) Architecture Home - i2b2 Community Wiki [Internet]. [cited 2024 Jun 12]. https:\/\/community.i2b2.org\/wiki\/display\/ServersideArchitectureHome\/QT_QUERY_MASTER"},{"issue":"10","key":"2748_CR13","doi-asserted-by":"publisher","first-page":"e076415","DOI":"10.1136\/bmjopen-2023-076415","volume":"13","author":"JE Weber","year":"2023","unstructured":"Weber JE, Ahmadi M, Boldt LH, Eckardt KU, Edelmann F, Gerhardt H, et al. Protocol of the Berlin Long-Term Observation of vascular events (BeLOVE): a prospective cohort study with deep phenotyping and long-term follow up of cardiovascular high-risk patients. BMJ Open. 2023;13(10):e076415.","journal-title":"BMJ Open"},{"key":"2748_CR14","unstructured":"BIH-MI\/i2b. 2-usage-dashboard [Internet]. [cited 2024 Jul 15]. https:\/\/github.com\/BIH-MI\/i2b2-usage-dashboard"},{"key":"2748_CR15","unstructured":"Welcome to the i2. b2 Community Wiki - i2b2 Community Wiki - i2b2 Community Wiki [Internet]. [cited 2024 Jun 11]. https:\/\/community.i2b2.org\/wiki\/"},{"key":"2748_CR16","doi-asserted-by":"publisher","unstructured":"Wagholikar KB, Mendis M, Dessai P, Sanz J, Law S, Gilson M et al. Automating Installation of the Integrating Biology and the Bedside (i2b2) Platform. Biomed Inform Insights [Internet]. 2018 Jan 1 [cited 2021 Jan 25];10. http:\/\/journals.sagepub.com\/doi\/https:\/\/doi.org\/10.1177\/1178222618777749","DOI":"10.1177\/1178222618777749"},{"issue":"7","key":"2748_CR17","doi-asserted-by":"publisher","first-page":"e25531","DOI":"10.2196\/25531","volume":"9","author":"C Sch\u00fcttler","year":"2021","unstructured":"Sch\u00fcttler C, Prokosch HU, Sedlmayr M, Sedlmayr B. Evaluation of three feasibility tools for identifying Patient Data and Biospecimen availability: comparative usability study. JMIR Med Inf. 2021;9(7):e25531.","journal-title":"JMIR Med Inf"},{"key":"2748_CR18","first-page":"92","volume":"2015","author":"ES Lee","year":"2015","unstructured":"Lee ES, Black RA, Harrington RD, Tarczy-Hornoch P. Characterizing secondary use of Clinical Data. AMIA Jt Summits Transl Sci Proc AMIA Jt Summits Transl Sci. 2015;2015:92\u20136.","journal-title":"AMIA Jt Summits Transl Sci Proc AMIA Jt Summits Transl Sci"},{"key":"2748_CR19","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.ijmedinf.2017.02.006","volume":"102","author":"AS Jannot","year":"2017","unstructured":"Jannot AS, Zapletal E, Avillach P, Mamzer MF, Burgun A, Degoulet P. The Georges Pompidou University Hospital Clinical Data Warehouse: a 8-years follow-up experience. Int J Med Inf. 2017;102:21\u20138.","journal-title":"Int J Med Inf"},{"key":"2748_CR20","first-page":"589","volume":"2020","author":"ET Sholle","year":"2020","unstructured":"Sholle ET, Cusick M, Davila MA, Kabariti J, Flores S, Campion TR. Characterizing basic and complex usage of i2b2 at an Academic Medical Center. AMIA Jt Summits Transl Sci Proc AMIA Jt Summits Transl Sci. 2020;2020:589\u201396.","journal-title":"AMIA Jt Summits Transl Sci Proc AMIA Jt Summits Transl Sci"},{"key":"2748_CR21","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1186\/1471-2288-9-70","volume":"9","author":"VG Deshmukh","year":"2009","unstructured":"Deshmukh VG, Meystre SM, Mitchell JA. Evaluating the informatics for integrating biology and the bedside system for clinical research. BMC Med Res Methodol. 2009;9:70.","journal-title":"BMC Med Res Methodol"},{"issue":"01","key":"2748_CR22","doi-asserted-by":"publisher","first-page":"116","DOI":"10.4338\/ACI-2010-09-CR-0051","volume":"02","author":"T Ganslandt","year":"2011","unstructured":"Ganslandt T, Mate S, Helbing K, Sax U, Prokosch HU. Unlocking Data for Clinical Research \u2013 the German i2b2 experience. Appl Clin Inf. 2011;02(01):116\u20137.","journal-title":"Appl Clin Inf"},{"key":"2748_CR23","doi-asserted-by":"publisher","unstructured":"Scheible R, Thomczyk F, Blum M, Rautenberg M, Prunotto A, Yazijy S, Boeker M. Integrating row level security in i2b2: segregation of medical records into data marts without data replication and synchronization. JAMIA Open. 2023;6(3). https:\/\/doi.org\/10.1093\/jamiaopen\/ooad068.","DOI":"10.1093\/jamiaopen\/ooad068"},{"key":"2748_CR24","doi-asserted-by":"publisher","first-page":"102004","DOI":"10.1016\/j.is.2022.102004","volume":"108","author":"C Moreau","year":"2022","unstructured":"Moreau C, Legroux C, Peralta V, Hamrouni MA. Mining SQL workloads for learning analysis behavior. Inf Syst. 2022;108:102004.","journal-title":"Inf Syst"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02748-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-024-02748-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02748-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,13]],"date-time":"2024-11-13T05:03:41Z","timestamp":1731474221000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-024-02748-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,11]]},"references-count":24,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["2748"],"URL":"https:\/\/doi.org\/10.1186\/s12911-024-02748-0","relation":{},"ISSN":["1472-6947"],"issn-type":[{"type":"electronic","value":"1472-6947"}],"subject":[],"published":{"date-parts":[[2024,11,11]]},"assertion":[{"value":"14 September 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 November 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 November 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"333"}}