{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T13:52:57Z","timestamp":1790949177559,"version":"4.1.0"},"reference-count":78,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2019,4,1]],"date-time":"2019-04-01T00:00:00Z","timestamp":1554076800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000037","name":"Institute of Health Services and Policy Research","doi-asserted-by":"publisher","award":["HI5\u2010154962"],"award-info":[{"award-number":["HI5\u2010154962"]}],"id":[{"id":"10.13039\/501100000037","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Learning Health Systems"],"published-print":{"date-parts":[[2019,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Introduction<\/jats:title><jats:p>Robust evaluation of service models can improve the quality and efficiency of care while articulating the models for potential replication. Even though it is an essential part of learning health systems, evaluations that benchmark and sustain models serving adults with developmental disabilities are lacking, impeding pilot programs from becoming official care pathways. Here, we describe the development of a program evaluation for a specialized medical\u2010dental community clinic serving adults with autism and intellectual disabilities in Montreal, Canada.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>Using a Participatory Action\u2010oriented approach, researchers and staff co\u2010designed an evaluation for a primary care service for this population. We performed an evaluability assessment to identify the processes and outcomes that were feasible to capture and elicited perspectives at both clinical and health system levels. The RE\u2010AIM framework was used to categorize and select tools to capture data elements that would inform practice at the clinic.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We detail the process of conceptualizing the evaluation framework and operationalizing the domains using a mixed\u2010methods approach. Our experience demonstrated (1) the utility of a comprehensive framework that captures contextual factors in addition to clinical outcomes, (2) the need for validated measures that are not cumbersome for everyday practice, (3) the importance of understanding the functional needs of the organization and building a sustainable data infrastructure that addresses those needs, and (4) the need to commit to an evolving, \u201cliving\u201d evaluation in a dynamic health system.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Evaluation employing rigorous patient\u2010centered and systems\u2010relevant metrics can help organizations effectively implement and continuously improve service models. Using an established framework and a collaborative approach provides an important blueprint for a program evaluation in a learning health system. This work provides insight into the process of integrating care for vulnerable populations with chronic conditions in health care systems and integrated knowledge generation processes between research and health systems.<\/jats:p><\/jats:sec>","DOI":"10.1002\/lrh2.10192","type":"journal-article","created":{"date-parts":[[2019,4,1]],"date-time":"2019-04-01T10:43:50Z","timestamp":1554115430000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Designing a program evaluation for a medical\u2010dental service for adults with autism and intellectual disabilities using the RE\u2010AIM framework"],"prefix":"10.1002","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3060-1232","authenticated-orcid":false,"given":"Jonathan","family":"Lai","sequence":"first","affiliation":[{"name":"Centre for Innovation in Autism and Intellectual Disabilities Miriam Foundation  Montreal Canada"},{"name":"School of Physical and Occupational Therapy McGill University  Montreal Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Malvina","family":"Klag","sequence":"additional","affiliation":[{"name":"Centre for Innovation in Autism and Intellectual Disabilities Miriam Foundation  Montreal Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Keiko","family":"Shikako\u2010Thomas","sequence":"additional","affiliation":[{"name":"School of Physical and Occupational Therapy McGill University  Montreal Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2019,4]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2014-002977"},{"key":"e_1_2_9_3_1","doi-asserted-by":"publisher","DOI":"10.1186\/2001-1326-2-10"},{"key":"e_1_2_9_4_1","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-157-3-201208070-00012"},{"key":"e_1_2_9_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/ev.20054"},{"key":"e_1_2_9_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/0886-1633(94)90026-4"},{"key":"e_1_2_9_7_1","doi-asserted-by":"publisher","DOI":"10.1177\/0163278705284445"},{"key":"e_1_2_9_8_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.290.12.1624"},{"key":"e_1_2_9_9_1","doi-asserted-by":"publisher","DOI":"10.1002\/lrh2.10053"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.books.9780890425596"},{"key":"e_1_2_9_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10879-010-9160-2"},{"key":"e_1_2_9_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/1362361315577517"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-006-0307-7"},{"key":"e_1_2_9_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dhjo.2014.11.002"},{"key":"e_1_2_9_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.rasd.2009.06.005"},{"key":"e_1_2_9_16_1","doi-asserted-by":"publisher","DOI":"10.1177\/1744629516665242"},{"key":"e_1_2_9_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ridd.2009.05.004"},{"issue":"2","key":"e_1_2_9_18_1","first-page":"S51","article-title":"Circles of care for people with intellectual and developmental disabilities: communication, collaboration, and coordination","volume":"64","author":"McNeil K","year":"2018","journal-title":"Canadian Family Physician"},{"key":"e_1_2_9_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-017-3292-0"},{"key":"e_1_2_9_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-018-3615-9"},{"key":"e_1_2_9_21_1","doi-asserted-by":"publisher","DOI":"10.1111\/dme.12573"},{"key":"e_1_2_9_22_1","doi-asserted-by":"publisher","DOI":"10.1177\/1362361314531341"},{"key":"e_1_2_9_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dhjo.2016.11.002"},{"key":"e_1_2_9_24_1","doi-asserted-by":"publisher","DOI":"10.1186\/1475-9276-12-18"},{"key":"e_1_2_9_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0009.2005.00409.x"},{"key":"e_1_2_9_26_1","doi-asserted-by":"publisher","DOI":"10.1111\/jar.12132"},{"key":"e_1_2_9_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/1362361317709970"},{"key":"e_1_2_9_28_1","doi-asserted-by":"publisher","DOI":"10.1352\/1934-9556-50.3.243"},{"issue":"4","key":"e_1_2_9_29_1","first-page":"254","article-title":"Primary care of adults with intellectual and developmental disabilities: 2018 Canadian consensus guidelines","volume":"64","author":"Sullivan WF","year":"2018","journal-title":"Canadian Family Physician"},{"key":"e_1_2_9_30_1","doi-asserted-by":"publisher","DOI":"10.1258\/135581906778476490"},{"key":"e_1_2_9_31_1","doi-asserted-by":"publisher","DOI":"10.1111\/dmcn.13227"},{"key":"e_1_2_9_32_1","doi-asserted-by":"publisher","DOI":"10.2105\/AJPH.89.9.1322"},{"key":"e_1_2_9_33_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2018.00071"},{"key":"e_1_2_9_34_1","doi-asserted-by":"crossref","DOI":"10.5888\/pcd15.170271","article-title":"Peer reviewed: pragmatic applications of RE\u2010AIM for health care initiatives in community and clinical settings","volume":"15","author":"Glasgow RE","year":"2018","journal-title":"Prev Chronic Dis"},{"key":"e_1_2_9_35_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40608-015-0050-8"},{"key":"e_1_2_9_36_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-015-0872-6"},{"key":"e_1_2_9_37_1","doi-asserted-by":"publisher","DOI":"10.7224\/1537-2073.2014-055"},{"key":"e_1_2_9_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amepre.2007.04.005"},{"key":"e_1_2_9_39_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13012-016-0399-1"},{"key":"e_1_2_9_40_1","article-title":"Health system transformation through research innovation","volume":"16","author":"Tamblyn R","year":"2016","journal-title":"Healthcare Papers"},{"key":"e_1_2_9_41_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2013-002779"},{"key":"e_1_2_9_42_1","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/cmn055"},{"key":"e_1_2_9_43_1","volume-title":"Realistic evaluation","author":"Pawson R","year":"1997"},{"key":"e_1_2_9_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.evalprogplan.2007.08.004"},{"key":"e_1_2_9_45_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.h1258"},{"key":"e_1_2_9_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/jan.12633"},{"key":"e_1_2_9_47_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12875-018-0722-9"},{"key":"e_1_2_9_48_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15326888chc3301_3"},{"key":"e_1_2_9_49_1","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/15.2.165"},{"key":"e_1_2_9_50_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2296-12-71"},{"key":"e_1_2_9_51_1","doi-asserted-by":"publisher","DOI":"10.1001\/archpedi.154.5.499"},{"key":"e_1_2_9_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/1471301213494499"},{"key":"e_1_2_9_53_1","doi-asserted-by":"publisher","DOI":"10.1037\/fsh0000253"},{"key":"e_1_2_9_54_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.2014.0053"},{"key":"e_1_2_9_55_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.323.7313.625"},{"key":"e_1_2_9_56_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2012.7551"},{"key":"e_1_2_9_57_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12961-016-0122-3"},{"key":"e_1_2_9_58_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-018-2938-8"},{"key":"e_1_2_9_59_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014301607592"},{"key":"e_1_2_9_60_1","doi-asserted-by":"publisher","DOI":"10.1038\/gim.2015.187"},{"key":"e_1_2_9_61_1","doi-asserted-by":"publisher","DOI":"10.5210\/ojphi.v9i3.8129"},{"key":"e_1_2_9_62_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.2015.1018"},{"key":"e_1_2_9_63_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMp1401111"},{"key":"e_1_2_9_64_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.2014.0147"},{"key":"e_1_2_9_65_1","article-title":"Measuring and improving patient safety through health information technology: the health IT safety framework","author":"Singh H","year":"2015","journal-title":"BMJ Qual Saf"},{"key":"e_1_2_9_66_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.2014.0445"},{"issue":"12","key":"e_1_2_9_67_1","first-page":"1076","article-title":"Progress in electronic medical record adoption in Canada","volume":"61","author":"Chang F","year":"2015","journal-title":"Canadian Family Physician"},{"key":"e_1_2_9_68_1","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2016\/40.3.02"},{"key":"e_1_2_9_69_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13012-015-0219-z"},{"key":"e_1_2_9_70_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12961-017-0176-x"},{"key":"e_1_2_9_71_1","first-page":"30","article-title":"Embedding research in the learning health system","volume":"16","author":"Reid RJ","year":"2016","journal-title":"Healthc Pap"},{"key":"e_1_2_9_72_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-018-4633-1"},{"key":"e_1_2_9_73_1","doi-asserted-by":"publisher","DOI":"10.1097\/PEP.0000000000000381"},{"key":"e_1_2_9_74_1","doi-asserted-by":"publisher","DOI":"10.1002\/aur.1786"},{"key":"e_1_2_9_75_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10826-010-9419-y"},{"key":"e_1_2_9_76_1","doi-asserted-by":"publisher","DOI":"10.1093\/geronb\/57.1.P74"},{"key":"e_1_2_9_77_1","doi-asserted-by":"publisher","DOI":"10.1002\/jclp.21908"},{"key":"e_1_2_9_78_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2702.2000.00350.x"},{"key":"e_1_2_9_79_1","doi-asserted-by":"publisher","DOI":"10.1370\/afm.1643"}],"container-title":["Learning Health Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Flrh2.10192","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lrh2.10192","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/lrh2.10192","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lrh2.10192","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,9]],"date-time":"2023-09-09T23:44:51Z","timestamp":1694303091000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/lrh2.10192"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4]]},"references-count":78,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,7]]}},"alternative-id":["10.1002\/lrh2.10192"],"URL":"https:\/\/doi.org\/10.1002\/lrh2.10192","archive":["Portico"],"relation":{},"ISSN":["2379-6146","2379-6146"],"issn-type":[{"value":"2379-6146","type":"print"},{"value":"2379-6146","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,4]]},"assertion":[{"value":"2018-09-04","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-10","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-04-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e10192"}}