{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T12:58:19Z","timestamp":1769000299253,"version":"3.49.0"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T00:00:00Z","timestamp":1719446400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T00:00:00Z","timestamp":1719446400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000024","name":"Canadian Institutes of Health Research","doi-asserted-by":"publisher","award":["#146261"],"award-info":[{"award-number":["#146261"]}],"id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Theories, models and frameworks (TMFs) are useful when implementing, evaluating and sustaining healthcare evidence-based interventions. Yet it can be challenging to identify an appropriate TMF for an implementation project. We developed and tested the usability of an online tool to help individuals who are doing or supporting implementation practice activities to identify appropriate models and\/or frameworks to inform their work.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We used methods guided by models and evidence on implementation science and user-centered design. Phases of tool development included applying findings from a scoping review of TMFs and interviews with 24 researchers\/implementers on barriers and facilitators to identifying and selecting TMFs. Based on interview findings, we categorized the TMFs by aim, stage of implementation, and target level of change to inform the tool\u2019s algorithm. We then conducted interviews with 10 end-users to test the usability of the prototype tool and administered the System Usability Scale (SUS). Usability issues were addressed and incorporated into the tool.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We developed <jats:italic>Find TMF<\/jats:italic>, an online tool consisting of 3\u20134 questions about the user\u2019s implementation project. The tool\u2019s algorithm matches key characteristics of the user\u2019s project (aim, stage, target change level) with characteristics of different TMFs and presents a list of candidate models\/frameworks. Ten individuals from Canada or Australia participated in usability testing (mean SUS score 84.5, standard deviation 11.4). Overall, participants found the tool to be simple, easy to use and visually appealing with a useful output of candidate models\/frameworks to consider for an implementation project. Users wanted additional instruction and guidance on what to expect from the tool and how to use the information in the output table. Tool improvements included incorporating an overview figure outlining the tool steps and output, displaying the tool questions on a single page, and clarifying the available functions of the results page, including adding direct links to the glossary and to complementary tools.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p><jats:italic>Find TMF<\/jats:italic> is an easy-to-use online tool that may benefit individuals who support implementation practice activities by making the vast number of models and frameworks more accessible, while also supporting a consistent approach to identifying and selecting relevant TMFs.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-024-02580-6","type":"journal-article","created":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T11:02:33Z","timestamp":1719486153000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Development and usability testing of an online support tool to identify models and frameworks to inform implementation"],"prefix":"10.1186","volume":"24","author":[{"given":"Lisa","family":"Strifler","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christine","family":"Fahim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael P.","family":"Hillmer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jan M.","family":"Barnsley","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sharon E.","family":"Straus","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,6,27]]},"reference":[{"issue":"1","key":"2580_CR1","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1186\/s13012-015-0242-0","volume":"10","author":"P Nilsen","year":"2015","unstructured":"Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10(1):53.","journal-title":"Implement Sci"},{"issue":"1","key":"2580_CR2","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1186\/s13012-017-0656-y","volume":"12","author":"SA Birken","year":"2017","unstructured":"Birken SA, Powell BJ, Shea CM, Haines ER, Alexis Kirk M, Leeman J, et al. Criteria for selecting implementation science theories and frameworks: results from an international survey. Implement Sci. 2017;12(1):124.","journal-title":"Implement Sci"},{"issue":"3","key":"2580_CR3","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1136\/bmjqs-2014-003627","volume":"24","author":"F Davidoff","year":"2015","unstructured":"Davidoff F, Dixon-Woods M, Leviton L, Michie S. Demystifying theory and its use in improvement. BMJ Qual Saf. 2015;24(3):228.","journal-title":"BMJ Qual Saf"},{"key":"2580_CR4","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1186\/s43058-020-00023-7","volume":"1","author":"JC Moullin","year":"2020","unstructured":"Moullin JC, Dickson KS, Stadnick NA, Albers B, Nilsen P, Broder-Fingert S, et al. Ten recommendations for using implementation frameworks in research and practice. Implement Sci Commun. 2020;1:42\u20137. eCollection 2020.","journal-title":"Implement Sci Commun"},{"issue":"1","key":"2580_CR5","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1186\/s13012-018-0836-4","volume":"13","author":"SA Birken","year":"2018","unstructured":"Birken SA, Rohweder CL, Powell BJ, Shea CM, Scott J, Leeman J, et al. T-CaST: an implementation theory comparison and selection tool. Implement Sci. 2018;13(1):143.","journal-title":"Implement Sci"},{"issue":"1","key":"2580_CR6","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1186\/s12913-023-09609-y","volume":"23","author":"R Barnden","year":"2023","unstructured":"Barnden R, Snowdon DA, Lannin NA, Lynch E, Srikanth V, Andrew NE. Prospective application of theoretical implementation frameworks to improve health care in hospitals - a systematic review. BMC Health Serv Res. 2023;23(1):607.","journal-title":"BMC Health Serv Res"},{"key":"2580_CR7","doi-asserted-by":"crossref","unstructured":"Lynch EA, Mudge A, Knowles S, Kitson AL, Hunter SC, Harvey G. There is nothing so practical as a good theory: a pragmatic guide for selecting theoretical approaches for implementation projects. BMC Health Serv Res 2018;18.","DOI":"10.1186\/s12913-018-3671-z"},{"issue":"3","key":"2580_CR8","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1016\/j.amepre.2012.05.024","volume":"43","author":"RG Tabak","year":"2012","unstructured":"Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging Research and Practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337\u201350.","journal-title":"Am J Prev Med"},{"key":"2580_CR9","unstructured":"University of Colorado Denver. Dissemination & implementation models in health research and practice. 2024; https:\/\/dissemination-implementation.org\/. Accessed September 18, 2023."},{"issue":"Complete","key":"2580_CR10","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1016\/j.jclinepi.2018.04.008","volume":"100","author":"L Strifler","year":"2018","unstructured":"Strifler L, Cardoso R, McGowan J, Cogo E, Nincic V, Khan PA, et al. Scoping review identifies significant number of knowledge translation theories, models, and frameworks with limited use. J Clin Epidemiol. 2018;100(Complete):92\u2013102.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"2580_CR11","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1186\/s12911-020-01128-8","volume":"20","author":"L Strifler","year":"2020","unstructured":"Strifler L, Barnsley JM, Hillmer M, Straus SE. Identifying and selecting implementation theories, models and frameworks: a qualitative study to inform the development of a decision support tool. BMC Med Inf Decis Mak. 2020;20(1):91\u20138.","journal-title":"BMC Med Inf Decis Mak"},{"issue":"1","key":"2580_CR12","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1002\/chp.47","volume":"26","author":"ID Graham","year":"2006","unstructured":"Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13\u201324.","journal-title":"J Contin Educ Health Prof"},{"key":"2580_CR13","doi-asserted-by":"crossref","unstructured":"Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ 2021;374:n2061.","DOI":"10.1136\/bmj.n2061"},{"issue":"11","key":"2580_CR14","doi-asserted-by":"publisher","first-page":"1163","DOI":"10.1016\/j.jclinepi.2012.04.011","volume":"65","author":"M Kastner","year":"2012","unstructured":"Kastner M, Straus SE. Application of the knowledge-to-action and Medical Research Council frameworks in the development of an osteoporosis clinical decision support tool. J Clin Epidemiol. 2012;65(11):1163\u201370.","journal-title":"J Clin Epidemiol"},{"key":"2580_CR15","doi-asserted-by":"publisher","first-page":"19e32","DOI":"10.1080\/1364557032000119616","volume":"8","author":"H Arksey","year":"2005","unstructured":"Arksey H, O\u2019Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8:19e32.","journal-title":"Int J Soc Res Methodol"},{"key":"2580_CR16","unstructured":"Peters MD, Godfrey CM, McInerney P, Soares CB, Khalil H, Parker D. Methodology for JBI scoping reviews. The Joanna Briggs\u2019 Institute reviewers\u2019 manual 2015. 2015."},{"issue":"1","key":"2580_CR17","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1186\/s13012-020-0964-5","volume":"15","author":"R Esmail","year":"2020","unstructured":"Esmail R, Hanson HM, Holroyd-Leduc J, Brown S, Strifler L, Straus SE, et al. A scoping review of full-spectrum knowledge translation theories, models, and frameworks. Implement Sci. 2020;15(1):11\u20135.","journal-title":"Implement Sci"},{"key":"2580_CR18","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1186\/s13012-014-0172-2","volume":"9","author":"B Field","year":"2014","unstructured":"Field B, Booth A, Ilott I, Gerrish K. Using the knowledge to Action Framework in practice: a citation analysis and systematic review. Implement Sci. 2014;9:172\u20132.","journal-title":"Implement Sci"},{"key":"2580_CR19","first-page":"1643","volume-title":"The International Encyclopedia of Education","author":"U Bronfenbrenner","year":"1994","unstructured":"Bronfenbrenner U. Ecological models of human development. In: Hus\u00e9n T, Postlethwaite TN, editors. The International Encyclopedia of Education. Oxford, England: Elsevier Science; 1994. pp. 1643\u20137."},{"key":"2580_CR20","unstructured":"Kushniruk AW, Patel VL, Cimino JJ. Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces. Proceedings: a conference of the American Medical Informatics Association. AMIA Fall Symposium. 1997:218\u2013222."},{"issue":"6","key":"2580_CR21","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1093\/intqhc\/mzm042","volume":"19","author":"A Tong","year":"2007","unstructured":"Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349\u201357.","journal-title":"Int J Qual Health Care"},{"issue":"2","key":"2580_CR22","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1177\/001872089403600215","volume":"36","author":"JR Lewis","year":"1994","unstructured":"Lewis JR. Sample sizes for usability studies: additional considerations. Hum Factors. 1994;36(2):368\u201378.","journal-title":"Hum Factors"},{"issue":"1","key":"2580_CR23","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.jbi.2004.01.003","volume":"37","author":"AW Kushniruk","year":"2004","unstructured":"Kushniruk AW, Patel VL. Cognitive and usability engineering methods for the evaluation of clinical information systems. J Biomed Inf. 2004;37(1):56\u201376.","journal-title":"J Biomed Inf"},{"key":"2580_CR24","unstructured":"Brooke J. SUS - a quick and dirty usability scale. 1995; https:\/\/hell.meiert.org\/core\/pdf\/sus.pdf. Accessed March 22, 2023."},{"issue":"6","key":"2580_CR25","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1080\/10447310802205776","volume":"24","author":"A Bangor","year":"2008","unstructured":"Bangor A, Kortum PT, Miller JT. An empirical evaluation of the System Usability Scale. Int J Hum-Comput Interact. 2008;24(6):574\u201394.","journal-title":"Int J Hum-Comput Interact"},{"issue":"1","key":"2580_CR26","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1186\/s13012-023-01296-x","volume":"18","author":"Y Wang","year":"2023","unstructured":"Wang Y, Wong EL, Nilsen P, Chung VC, Tian Y, Yeoh E. A scoping review of implementation science theories, models, and frameworks - an appraisal of purpose, characteristics, usability, applicability, and testability. Implement Sci. 2023;18(1):43.","journal-title":"Implement Sci"},{"issue":"8","key":"2580_CR27","doi-asserted-by":"publisher","first-page":"982","DOI":"10.1287\/mnsc.35.8.982","volume":"35","author":"FD Davis","year":"1989","unstructured":"Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: a comparison of two theoretical models. Manag Sci. 1989;35(8):982\u20131003.","journal-title":"Manag Sci"},{"issue":"1","key":"2580_CR28","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/j.jbi.2009.07.002","volume":"43","author":"RJ Holden","year":"2010","unstructured":"Holden RJ, Karsh B. The technology acceptance model: its past and its future in health care. J Biomed Inf. 2010;43(1):159\u201372.","journal-title":"J Biomed Inf"},{"key":"2580_CR29","doi-asserted-by":"publisher","first-page":"1003","DOI":"10.12688\/f1000research.124821.1","volume":"11","author":"J Porat-Dahlerbruch","year":"2022","unstructured":"Porat-Dahlerbruch J, Fontaine G, Bourbeau-Allard \u00c8, Spinewine A, Grimshaw JM, Ellen ME. Desirable attributes of theories, models, and frameworks for implementation strategy design in healthcare: a scoping review protocol. F1000Res. 2022;11:1003.","journal-title":"F1000Res"},{"issue":"1","key":"2580_CR30","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1186\/1748-5908-7-37","volume":"7","author":"J Cane","year":"2012","unstructured":"Cane J, O\u2019Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7(1):37.","journal-title":"Implement Sci"},{"key":"2580_CR31","doi-asserted-by":"publisher","first-page":"111205","DOI":"10.1016\/j.jclinepi.2023.10.021","volume":"165","author":"AR Bhuiya","year":"2023","unstructured":"Bhuiya AR, Sutherland J, Boateng R, Bain T, Skidmore B, Perrier L, et al. A scoping review reveals candidate quality indicators of knowledge translation and implementation science practice tools. J Clin Epidemiol. 2023;165:111205.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"2580_CR32","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1186\/s12916-019-1322-9","volume":"17","author":"M Wensing","year":"2019","unstructured":"Wensing M, Grol R. Knowledge translation in health: how implementation science could contribute more. BMC Med. 2019;17(1):88\u20139.","journal-title":"BMC Med"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02580-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-024-02580-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02580-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T11:03:33Z","timestamp":1719486213000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-024-02580-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,27]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["2580"],"URL":"https:\/\/doi.org\/10.1186\/s12911-024-02580-6","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,27]]},"assertion":[{"value":"5 April 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 June 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 June 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Research ethics approval was obtained from the Unity Health Toronto Research Ethics Board (#20\u2013038) and the University of Toronto Research Ethics Board (#42891). Verbal informed consent was obtained and recorded at the start of each interview.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"182"}}