{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T17:24:12Z","timestamp":1762017852492,"version":"3.38.0"},"reference-count":43,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2016,7,26]],"date-time":"2016-07-26T00:00:00Z","timestamp":1469491200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Health Informatics J"],"published-print":{"date-parts":[[2016,9]]},"abstract":"<jats:p> Evaluation of an eHealth platform, Intelligent Research and Intervention Software was undertaken via cross-sectional survey of staff users and application performance monitoring. The platform is used to deliver psychosocial interventions across a range of clinical contexts, project scopes, and delivery modalities (e.g. hybrid telehealth, fully online self-managed, randomized control trials, and clinical service delivery). Intelligent Research and Intervention Software supports persuasive technology elements (e.g. tailoring, reminders, and personalization) as well as staff management tools. Results from the System Usability Scale involving 30 Staff and Administrative users across multiple projects were positive with overall mean score of 70 (\u201cAcceptable\u201d). The mean score for \u201cUsability\u201d sub-scale was 82 and for \u201cLearnability\u201d sub-scale 61. There were no significant differences in perceptions of usability across user groups or levels of experience. Application performance management analytics (e.g. Application Performance Index scores) across two test sites indicate the software platform is robust and reliable when compared to industry standards. Intelligent Research and Intervention Software is successfully operating as a flexible platform for creating, delivering, and evaluating eHealth interventions. <\/jats:p>","DOI":"10.1177\/1460458215586803","type":"journal-article","created":{"date-parts":[[2015,6,24]],"date-time":"2015-06-24T00:25:43Z","timestamp":1435105543000},"page":"730-743","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":18,"title":["Usability, learnability and performance evaluation of Intelligent Research and Intervention Software: A delivery platform for eHealth interventions"],"prefix":"10.1177","volume":"22","author":[{"given":"Lori","family":"Wozney","sequence":"first","affiliation":[{"name":"IWK Health Centre, Canada"}]},{"given":"Patrick J","family":"McGrath","sequence":"additional","affiliation":[{"name":"IWK Health Centre, Canada; Dalhousie University, Canada"}]},{"given":"Amanda","family":"Newton","sequence":"additional","affiliation":[{"name":"University of Alberta, Canada"}]},{"given":"Anna","family":"Huguet","sequence":"additional","affiliation":[{"name":"IWK Health Centre, Canada; Dalhousie University, Canada"}]},{"given":"Marcia","family":"Franklin","sequence":"additional","affiliation":[]},{"given":"Kaitlin","family":"Perri","sequence":"additional","affiliation":[]},{"given":"K","family":"Leuschen","sequence":"additional","affiliation":[]},{"given":"Elaine","family":"Toombs","sequence":"additional","affiliation":[{"name":"IWK Health Centre, Canada"}]},{"given":"Patricia","family":"Lingley-Pottie","sequence":"additional","affiliation":[{"name":"Dalhousie University, Canada"}]}],"member":"179","published-online":{"date-parts":[[2016,7,26]]},"reference":[{"key":"bibr1-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2013.07.002"},{"key":"bibr2-1460458215586803","doi-asserted-by":"publisher","DOI":"10.2196\/resprot.2547"},{"key":"bibr3-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1007\/s12160-009-9131-6"},{"key":"bibr4-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1177\/0004867412471439"},{"key":"bibr5-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2013.12753"},{"key":"bibr6-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1177\/1460458212458915"},{"key":"bibr7-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1002\/jclp.22032"},{"key":"bibr8-1460458215586803","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1672"},{"key":"bibr9-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1111\/jan.12196"},{"key":"bibr10-1460458215586803","unstructured":"E-Mental Health in Canada: transforming the mental health system using technology. Ottawa, ON, Canada: Mental Health Commission of Canada, 2014, http:\/\/www.mentalhealthcommission.ca"},{"key":"bibr11-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2458-13-985"},{"key":"bibr12-1460458215586803","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2104"},{"key":"bibr13-1460458215586803","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1559"},{"key":"bibr14-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1016\/B978-155860643-2\/50011-1"},{"issue":"1","key":"bibr15-1460458215586803","first-page":"485","volume":"24","author":"Oinas-Kukkonen H","year":"2009","journal-title":"Commun Assoc Inf Syst"},{"key":"bibr16-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1080\/10810730.2013.768727"},{"key":"bibr17-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2008.08.023"},{"key":"bibr18-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.133.4.673"},{"first-page":"159","volume-title":"Proceedings of the 16th international symposium on health information management research: exploiting health informatics for connected, collaborative and customized patient care","author":"Wozney L","key":"bibr19-1460458215586803"},{"key":"bibr20-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1186\/1748-5908-4-50"},{"volume-title":"Research design and methods: a process approach","year":"2011","author":"Bordens KS","key":"bibr21-1460458215586803"},{"key":"bibr22-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2014.01.010"},{"key":"bibr23-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1080\/10447310802205776"},{"key":"bibr24-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02806-9_12"},{"key":"bibr25-1460458215586803","unstructured":"Sauro J. Measuring usability: 10 things to know about the System Usability Scale (SUS), http:\/\/www.measuringusability.com\/blog\/10-things-SUS.php (18 June 2013, accessed 12 October 2014)."},{"key":"bibr26-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02806-9_12"},{"first-page":"871","volume-title":"2013 IEEE 6th international conference on cloud computing (CLOUD)","author":"Farnaz F","key":"bibr27-1460458215586803"},{"key":"bibr28-1460458215586803","unstructured":"Yahoo Finance. New relic to bring SaaS-based app performance monitoring to windows Azure developer portal, http:\/\/finance.yahoo.com\/news\/relic-bring-saas-based-app-160000220.html (2012, accessed 15 September 2014)."},{"key":"bibr29-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2010.06.002"},{"key":"bibr30-1460458215586803","unstructured":"Sevcik P. Defining the application performance index. Business Communications Review, March, http:\/\/apdex.org\/docs\/Defining_The_Application_Performance_Index.pdf (2005, accessed 12 October 2014)."},{"key":"bibr31-1460458215586803","unstructured":"International Telecommunications Union. Definition of \u201cOpen Standards\u201d, http:\/\/www.itu.int\/en\/ITU-T\/ipr\/Pages\/open.aspx (2005, accessed October 12 2014)."},{"key":"bibr32-1460458215586803","unstructured":"Gunther NJ. The Apdex Index revealed. CMG MeasureIT, February 2009, http:\/\/www.cmg.org\/publications\/measureit\/2009-2\/mit56\/measureit-issue-7-02-the-apdex-index-revealed\/"},{"key":"bibr33-1460458215586803","unstructured":"Patton M. Qualitative evaluation and research methods. Beverly Hills, CA: SAGE, 1990, pp. 169\u2013186."},{"volume-title":"Mail and telephone surveys: the total design method","year":"1978","author":"Dillman DA.","key":"bibr34-1460458215586803"},{"key":"bibr35-1460458215586803","unstructured":"Haletky EA. Using application performance management for security. New Relic, https:\/\/try.newrelic.com\/rs\/newrelic\/images\/NewRelic-Using_APM_for_Security.pdf (2012, accessed 12 October 2014)."},{"key":"bibr36-1460458215586803","first-page":"114","volume":"4","author":"Bangor A","year":"2009","journal-title":"J Usability Stud"},{"issue":"2","key":"bibr37-1460458215586803","first-page":"56","volume":"7","author":"McLellan S","year":"2012","journal-title":"J Usability Stud"},{"volume-title":"A practical guide to the System Usability Scale: background, benchmarks, & best practices","year":"2011","author":"Sauro J.","key":"bibr38-1460458215586803"},{"key":"bibr39-1460458215586803","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1863"},{"key":"bibr40-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-009-0472-7"},{"key":"bibr41-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1016\/j.hitech.2011.04.002"},{"key":"bibr42-1460458215586803","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-013-9453-9"},{"issue":"4","key":"bibr43-1460458215586803","first-page":"1","volume":"38","author":"Sandeep D","year":"2013","journal-title":"ACM SIGSOFT"}],"container-title":["Health Informatics Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1460458215586803","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1460458215586803","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1460458215586803","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,3]],"date-time":"2025-03-03T08:51:36Z","timestamp":1740991896000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1460458215586803"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,7,26]]},"references-count":43,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2016,9]]}},"alternative-id":["10.1177\/1460458215586803"],"URL":"https:\/\/doi.org\/10.1177\/1460458215586803","relation":{},"ISSN":["1460-4582","1741-2811"],"issn-type":[{"type":"print","value":"1460-4582"},{"type":"electronic","value":"1741-2811"}],"subject":[],"published":{"date-parts":[[2016,7,26]]}}}