{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T16:31:01Z","timestamp":1753893061872,"version":"3.41.2"},"reference-count":17,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,3,31]],"date-time":"2025-03-31T00:00:00Z","timestamp":1743379200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Res. Metr. Anal."],"abstract":"Background<\/jats:title>The Evaluation Unit at the Altman Clinical and Translational Research Institute (ACTRI) implemented a balanced scorecard model in conjunction with a project management tool to consolidate data collection for progress monitoring, strategic alignment, and impact assessment. This approach aims to streamline communication and enhance information accessibility for all partners. We developed an efficient system for collecting, analyzing, and reporting key information on unit progress, impact, and alignment with institutional goals. The Translational Science Benefits Model (TSBM) was proposed as a framework to evaluate the broader impact of our translational research, beyond immediate scientific advancements, across clinical, societal, economic, and policy domains.<\/jats:p><\/jats:sec>Methods<\/jats:title>The ACTRI Evaluation Unit initially adapted the balanced scorecard (BSC) to the research environment, substituting business perspectives with research grant aims. In its second iteration, the BSC was integrated into Monday.com<\/jats:ext-link>, a project management platform, to create customized, real-time monitoring dashboards for each unit within the institute. The Evaluation Unit's 3.0 version further adapted the TSBM to assess the broader impacts of unit activities. Quarterly data collection was implemented, and partners were trained in impact assessment and dashboard usage. This process began in early 2023 and is ongoing.<\/jats:p><\/jats:sec>Results<\/jats:title>Eleven monitoring dashboards were developed and successfully implemented across the institute. The new system facilitated more efficient data collection and reporting, reducing communication overhead and increasing the frequency of updates. The data collected were utilized to draft annual reports as well as inform strategic planning and executive sessions.<\/jats:p><\/jats:sec>Conclusions<\/jats:title>Integrating the TSBM into our existing BSC framework, combined with a project management tool, effectively streamlined impact assessment and progress monitoring. This approach not only enhanced data collection and reporting efficiency but also encouraged units to align their goals and activities with desired impacts, thereby strengthening the institute's overall strategic focus.<\/jats:p><\/jats:sec>","DOI":"10.3389\/frma.2025.1534394","type":"journal-article","created":{"date-parts":[[2025,3,31]],"date-time":"2025-03-31T06:33:16Z","timestamp":1743402796000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Modernizing CTSA hub evaluation: an integrated system for performance monitoring and translational science impact assessment"],"prefix":"10.3389","volume":"10","author":[{"given":"Maryam","family":"Gholami","sequence":"first","affiliation":[]},{"given":"Elizabeth","family":"Johnson","sequence":"additional","affiliation":[]},{"given":"Kera","family":"Swanson","sequence":"additional","affiliation":[]},{"given":"Carlos","family":"Rojas","sequence":"additional","affiliation":[]},{"given":"Daniel","family":"Bouland","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,3,31]]},"reference":[{"key":"B1","first-page":"331","article-title":"Introduction of the balanced scorecard into an academic department of medicine: creating a road map to success","volume":"26","author":"Bouland","year":"2011","journal-title":"J. Med. Pract. Manag."},{"journal-title":"NCATS Strategic Plan for 2025\u20132030","year":"2025","key":"B2"},{"key":"B3","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1108\/JOEPP-06-2017-0057","article-title":"Research performance and the organizational effectiveness of universities","volume":"5","author":"Croucher","year":"2018","journal-title":"J. Organ. Eff."},{"key":"B4","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1093\/reseval\/rvac004","article-title":"Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of finnish universities","volume":"31","author":"Himanen","year":"2022","journal-title":"Res. Eval."},{"key":"B5","doi-asserted-by":"publisher","first-page":"16","DOI":"10.55834\/plj.1620793732","article-title":"Lessons learned: evaluating the role of a balanced scorecard in the strategic management of a translational science research institution","volume":"9","author":"Hoyo","year":"2022","journal-title":"Physician Lead. J"},{"key":"B6","first-page":"71","article-title":"The balanced scorecard\u2013measures that drive performance","volume":"70","author":"Kaplan","year":"1992","journal-title":"Harv. Bus. Rev"},{"key":"B7","doi-asserted-by":"publisher","first-page":"624","DOI":"10.1016\/j.ijproman.2022.05.007","article-title":"Does project management matter? The relationship between project management effort, complexity, and profitability","volume":"40","author":"Kaufmann","year":"2022","journal-title":"Int. J. Project Manag"},{"key":"B8","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1111\/cts.12495","article-title":"The translational science benefits model: a new framework for assessing the health and societal benefits of clinical and translational sciences","volume":"11","author":"Luke","year":"2018","journal-title":"Clin. Transl. Sci."},{"key":"B9","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1017\/cts.2023.216","article-title":"134 comparing real-world impacts of cohorts using the translational science benefits model","volume":"7","author":"Miovsky","year":"2023","journal-title":"J. Clin. Transl. Sci."},{"key":"B10","unstructured":"Work Operating System"},{"key":"B11","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1177\/0163278713499586","article-title":"Common metrics to assess the efficiency of clinical research","volume":"36","author":"Rubio","year":"2013","journal-title":"Eval. Health Prof"},{"key":"B12","doi-asserted-by":"publisher","first-page":"e70","DOI":"10.1017\/cts.2022.399","article-title":"Moving beyond annual data reports: a blueprint for communicating and disseminating actionable intelligence","volume":"6","author":"Ruiz","year":"2022","journal-title":"J. Clin. Transl. Sci."},{"key":"B13","first-page":"60","article-title":"A framework for the management of research and innovation projects in academic settings","volume":"53","author":"Santos","year":"2022","journal-title":"J. Res. Admin"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/cts.2019.430","article-title":"National common metrics for the NIH clinical and translational science award institutions: a signal of the transformation of the American biomedical research enterprise","volume":"4","author":"Selker","year":"2020","journal-title":"J. Clin. Transl. Sci."},{"key":"B15","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1017\/cts.2023.213","article-title":"131 beyond the case study: advancing development and use of the translational science benefits model (TSBM) framework through application across diverse CTSA contexts","volume":"7","author":"Sperling","year":"2023","journal-title":"J. Clin. Transl. Sci."},{"key":"B16","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1111\/cts.12036","article-title":"Evaluation guidelines for the clinical and translational science awards (CTSAs)","volume":"6","author":"Trochim","year":"2013","journal-title":"Clin. Transl. Sci."},{"key":"B17","doi-asserted-by":"publisher","first-page":"e68","DOI":"10.1017\/cts.2020.565","article-title":"Do common metrics add value? Perspectives from NIH clinical and translational science awards (CTSA) consortium hubs","volume":"5","author":"Welch","year":"2021","journal-title":"J. Clin. Transl. Sci."}],"container-title":["Frontiers in Research Metrics and Analytics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2025.1534394\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,31]],"date-time":"2025-03-31T06:33:25Z","timestamp":1743402805000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2025.1534394\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,31]]},"references-count":17,"alternative-id":["10.3389\/frma.2025.1534394"],"URL":"https:\/\/doi.org\/10.3389\/frma.2025.1534394","relation":{},"ISSN":["2504-0537"],"issn-type":[{"type":"electronic","value":"2504-0537"}],"subject":[],"published":{"date-parts":[[2025,3,31]]},"article-number":"1534394"}}