{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T16:59:59Z","timestamp":1790873999346,"version":"4.1.0"},"reference-count":61,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T00:00:00Z","timestamp":1670198400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Rehabilit. Sci."],"abstract":"<jats:sec><jats:title>Objective<\/jats:title><jats:p>To design a multi-domain return-to-play assessment system (<jats:italic>R2Play<\/jats:italic>) for youth athletes with concussion.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>The <jats:italic>R2Play<\/jats:italic> system was developed using an overarching user-centered approach, the Design Thinking Framework, and research activities included: 1) structured brainstorming within our research team, 2) interviews with clinician and youth sports coaches, 3) building a testable prototype, and 4) interface testing through cognitive walkthroughs with clinician partners.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Clinician and coach participants provided feedback on the <jats:italic>R2Play<\/jats:italic> concept, which was integrated into the design process and provided future directions for research. Examples of feedback-driven design choices included reducing assessment time, increasing ecological validity by adding in background noise, and developing youth-friendly graphical results screens. Following refinement based on stakeholder feedback, the <jats:italic>R2Play<\/jats:italic> system was outlined in detail and a testable prototype was developed. It is made up of two parts: a clinician tablet, and a series of tablet \u201cbuttons\u201d that display numbers and letters. Youth athletes run between the buttons to connect a \u201ctrail\u201d in ascending alphanumeric order, 1-A-2-B, etc. Their performance across a series of levels of increasing difficulty is logged on the clinician tablet. Initial testing with five clinicians showed the system's interface to have excellent usability with a score of 81% (SD\u2009=\u20098.02) on the System Usability Scale.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Through this research, a prototype of the <jats:italic>R2Play<\/jats:italic> system was innovated and evaluated by clinician and coach stakeholders. Initial usability was excellent and directions for future iterations were highlighted. Outcomes suggest the potential benefits of using technologies to assist in complex clinical assessment, as well as utilizing a user-centered approach to design.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fresc.2022.1051579","type":"journal-article","created":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T05:30:45Z","timestamp":1670218245000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["R2Play development: Fostering user-driven technology that supports return-to-play decision-making following pediatric concussion"],"prefix":"10.3389","volume":"3","author":[{"given":"Danielle","family":"DuPlessis","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily","family":"Lam","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fanny","family":"Hotze","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ajmal","family":"Khan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hiba","family":"Al-Hakeem","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie","family":"McFarland","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea","family":"Hickling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Hutchison","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"F. Virginia","family":"Wright","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nick","family":"Reed","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elaine","family":"Biddiss","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shannon E.","family":"Scratch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,12,5]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"E60","DOI":"10.1097\/HTR.0000000000000503","article-title":"Increasing incidence of concussion: true epidemic or better recognition?","volume":"35","author":"Langer","year":"2020","journal-title":"J Head Trauma Rehabil"},{"key":"B2","year":""},{"key":"B3","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1016\/j.jpeds.2010.06.040","article-title":"Pediatric concussions in United States emergency departments in the years 2002\u20132006","volume":"157","author":"Meehan","year":"2010","journal-title":"J Pediatr"},{"key":"B4","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1136\/bjsports-2015-094978","article-title":"The incidence of concussion in youth sports: a systematic review and meta-analysis","volume":"50","author":"Pfister","year":"2016","journal-title":"Br J Sports Med"},{"key":"B5","doi-asserted-by":"publisher","first-page":"1359","DOI":"10.1542\/peds.2005-0994","article-title":"Pediatric sport-related concussion: a review of the clinical management of an oft-neglected population","volume":"117","author":"Kirkwood","year":"2006","journal-title":"Pediatr"},{"key":"B6","doi-asserted-by":"crossref","first-page":"147","DOI":"10.4324\/9781351200516-10","article-title":"Child and adolescent athletes","volume-title":"Psychological aspects of sport-related concussions","author":"Purcell","year":"2019"},{"key":"B7","doi-asserted-by":"publisher","first-page":"742","DOI":"10.1177\/0363546515622387","article-title":"Concussion increases odds of sustaining a lower extremity musculoskeletal injury after return to play among collegiate athletes","volume":"44","author":"Brooks","year":"2016","journal-title":"Am J Sports Med"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1097","DOI":"10.1007\/s40279-018-0871-y","article-title":"Neuromuscular control\u00a0deficits and the risk of subsequent injury after a concussion: a scoping review","volume":"48","author":"Howell","year":"2018","journal-title":"Sports Med Auckl NZ"},{"key":"B9","doi-asserted-by":"publisher","first-page":"876","DOI":"10.1227\/01.NEU.0000350155.89800.00","article-title":"Effects of a symptom-free waiting period on clinical outcome and risk of reinjury after sport-related concussion","volume":"65","author":"McCrea","year":"2009","journal-title":"Neurosurg"},{"key":"B10","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1017\/cjn.2019.14","article-title":"Fatal second impact syndrome in rowan stringer, A 17-year-old rugby player","volume":"46","author":"Tator","year":"2019","journal-title":"Can J Neurol Sci J Can Sci Neurol"},{"key":"B11","doi-asserted-by":"publisher","first-page":"3232","DOI":"10.1093\/brain\/awq200","article-title":"Assessment of metabolic brain damage and recovery following mild traumatic brain injury: a multicentre, proton magnetic resonance spectroscopic study in concussed patients","volume":"133","author":"Vagnozzi","year":"2010","journal-title":"Brain"},{"key":"B12","doi-asserted-by":"publisher","first-page":"838","DOI":"10.1136\/bjsports-2017-097699","article-title":"Consensus statement on concussion in sport\u2014the 5th international conference on concussion in sport held in Berlin, October 2016","volume":"51","author":"McCrory","year":"2017","journal-title":"Br J Sports Med"},{"key":"B13","doi-asserted-by":"publisher","first-page":"1179","DOI":"10.1136\/bjsports-2016-096551","article-title":"A systematic review of criteria used to define recovery from sport-related concussion in youth athletes","volume":"52","author":"Haider","year":"2018","journal-title":"Br J Sports Med"},{"key":"B14","first-page":"237","article-title":"Balancing demands and resources in sport: adaptation and validation of the demand-induced strain compensation questionnaire for use in sport","volume":"17","author":"Balk","year":"2018","journal-title":"J Sports Sci Med"},{"key":"B15","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1111\/apps.12188","article-title":"\u201cWhat a match!\u201d: the specific role of resources in the relation between demands and vigour in elite sport","volume":"69","author":"Balk","year":"2020","journal-title":"Appl Psychol"},{"key":"B16","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1007\/s40279-019-01144-3","article-title":"Increased risk of musculoskeletal injury following sport-related concussion: a perception-action coupling approach","volume":"50","author":"Eagle","year":"2020","journal-title":"Sports Med Auckl"},{"key":"B17","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1186\/1479-5868-10-98","article-title":"A systematic review of the psychological and social benefits of participation in sport for children and adolescents: informing development of a conceptual model of health through sport","volume":"10","author":"Eime","year":"2013","journal-title":"Int J Behav Nutr Phys Act"},{"key":"B18","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.gaitpost.2018.03.021","article-title":"Detecting gait abnormalities after concussion or mild traumatic brain injury: a systematic review of single-task, dual-task, and complex gait","volume":"62","author":"Fino","year":"2018","journal-title":"Gait Posture"},{"key":"B19","doi-asserted-by":"publisher","first-page":"87","DOI":"10.2519\/jospt.2018.7432","article-title":"Dual-Task assessment protocols in concussion assessment: a systematic literature review","volume":"48","author":"Kleiner","year":"2018","journal-title":"J Orthop Sports Phys Ther"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1648","DOI":"10.1080\/02699052.2016.1200143","article-title":"Executive dysfunction following a mild traumatic brain injury revealed in early adolescence with locomotor-cognitive dual-tasks","volume":"30","author":"Cossette","year":"2016","journal-title":"Brain Inj"},{"key":"B21","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1097\/HTR.0b013e3182407ace","article-title":"Altered integrated locomotor and cognitive function in elite athletes 30 days postconcussion: a preliminary study","volume":"28","author":"Fait","year":"2013","journal-title":"J Head Trauma Rehabil"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1513","DOI":"10.1016\/j.apmr.2013.04.015","article-title":"Dual-Task effect on gait balance control in adolescents with concussion","volume":"94","author":"Howell","year":"2013","journal-title":"Arch Phys Med Rehabil"},{"key":"B23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1123\/jsr.2020-0279","article-title":"Sensitivity and specificity of a multimodal approach for concussion assessment in youth athletes","volume":"30","author":"Toong","year":"2021","journal-title":"J Sport Rehabil"},{"key":"B24","author":"DuPlessis","year":""},{"key":"B25","doi-asserted-by":"publisher","first-page":"e268","DOI":"10.1093\/milmed\/usy425","article-title":"Clinical utility and analysis of the run-roll-aim task: informing return-to-duty readiness decisions in active-duty service members","volume":"184","author":"Prim","year":"2019","journal-title":"Mil Med"},{"key":"B26","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1080\/17483107.2016.1229048","article-title":"A virtual reality avatar interaction (VRai) platform to assess residual executive dysfunction in active military personnel with previous mild traumatic brain injury: proof of concept","volume":"12","author":"Robitaille","year":"2017","journal-title":"Disabil Rehabil Assist Technol"},{"key":"B27","doi-asserted-by":"publisher","first-page":"1254","DOI":"10.2522\/ptj.20120143","article-title":"Returning service members to duty following mild traumatic brain injury: exploring the use of dual-task and multitask assessment methods","volume":"93","author":"Scherer","year":"2013","journal-title":"Phys Ther"},{"key":"B28","first-page":"493","article-title":"Understanding design thinking: a process model based on method engineering","author":"Thoring","year":"2011","journal-title":"69 Proc EPDE 2011 13th Int Conf Eng Prod Des Educ Lond UK 08-09092011"},{"key":"B29","author":"Luchs","year":""},{"key":"B30","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.hjdsi.2015.12.002","article-title":"A design thinking framework for healthcare management and innovation","volume":"4","author":"Roberts","year":"2016","journal-title":"Healthcare"},{"key":"B31","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1111\/jpim.12061","article-title":"Adopting design thinking in novice multidisciplinary teams: the application and limits of design methods and reflexive practices","volume":"30","author":"Seidel","year":"2013","journal-title":"J Prod Innov Manag"},{"key":"B32","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1080\/17518423.2019.1604580","article-title":"The nature, value, and experience of engagement in pediatric rehabilitation: perspectives of youth, caregivers, and service providers","volume":"23","author":"King","year":"2020","journal-title":"Dev Neurorehabilitation"},{"key":"B33","doi-asserted-by":"publisher","first-page":"335","DOI":"10.2147\/JMDH.S103881","article-title":"Adoption of e-health technology by physicians: a scoping review","volume":"9","author":"de Grood","year":"2016","journal-title":"J Multidiscip Healthc"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1037\/t15082\/000","article-title":"Delis-Kaplan executive function system","author":"Delis","year":"2001"},{"key":"B35","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1093\/jpepsy\/12.3.395","article-title":"Postirradiation treatment outcomes for children with acute lymphocytic leukemia: clarification of risks","volume":"12","author":"Taylor","year":"1987","journal-title":"J Pediatr Psychol"},{"key":"B36","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1016\/j.intell.2011.03.001","article-title":"What cognitive abilities are involved in trail-making performance?","volume":"39","author":"Salthouse","year":"2011","journal-title":"Intelligence"},{"key":"B37","doi-asserted-by":"publisher","first-page":"271","DOI":"10.2466\/pms.1958.8.3.271","article-title":"Validity of the trail making test as an indicator of organic brain damage","volume":"8","author":"Reitan","year":"1958","journal-title":"Percept Mot Skills"},{"key":"B38","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1016\/S0887-6177(03)00039-8","article-title":"Trail making test A and B: normative data stratified by age and education","volume":"19","author":"Tombaugh","year":"2004","journal-title":"Arch Clin Neuropsychol"},{"key":"B39","doi-asserted-by":"publisher","first-page":"575","DOI":"10.2466\/pms.1971.33.2.575","article-title":"Trail making test results for Normal and brain-damaged children","volume":"33","author":"Reitan","year":"1971","journal-title":"Percept Mot Skills"},{"key":"B40","doi-asserted-by":"publisher","first-page":"e55773","DOI":"10.1371\/journal.pone.0055773","article-title":"Open vs. Closed skill sports and the modulation of inhibitory control","volume":"8","author":"Wang","year":"2013","journal-title":"PLOS ONE"},{"key":"B41","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1016\/j.jpeds.2016.10.067","article-title":"Annual and seasonal trends in ambulatory visits for pediatric concussion in Ontario between 2003 and 2013","volume":"181","author":"Zemek","year":"2017","journal-title":"J Pediatr"},{"key":"B42","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1177\/1473325002001003636","article-title":"Two decades of developments in qualitative inquiry: a personal, experiential perspective","volume":"1","author":"Patton","year":"2002","journal-title":"Qual Soc Work"},{"key":"B43","doi-asserted-by":"publisher","first-page":"1753","DOI":"10.1177\/1049732315617444","article-title":"Sample size in qualitative interview studies: guided by information power","volume":"1","author":"Malterud","year":"2015","journal-title":"Qual Health Res"},{"key":"B44","author":"Yuan","year":"2021"},{"key":"B45","article-title":"Microsoft PowerPoint","author":"Gaskins","year":"2021","journal-title":"Microsoft Corporation"},{"key":"B46","doi-asserted-by":"publisher","first-page":"1277","DOI":"10.1177\/1049732305276687","article-title":"Three approaches to qualitative content analysis","volume":"15","author":"Hsieh","year":"2005","journal-title":"Qual Health Res"},{"key":"B47","first-page":"303","volume-title":"The coding manual for qualitative researchers","author":"Salda\u00f1a","year":"2013"},{"key":"B48","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1097\/00006223-200307000-00008","article-title":"Exploring the audit trail for qualitative investigations","volume":"28","author":"Wolf","year":"2003","journal-title":"Nurse Educ"},{"key":"B49","year":""},{"key":"B50","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1201\/9781410607775.ch2","article-title":"Hierarchical task analysis","volume-title":"Handbook of cognitive task design 2","author":"Annett","year":"2003"},{"key":"B51","doi-asserted-by":"publisher","first-page":"348","DOI":"10.1093\/arclin\/acu014","article-title":"Psychometric characteristics of the postconcussion symptom inventory in children and adolescents","volume":"29","author":"Sady","year":"2014","journal-title":"Arch Clin Neuropsychol"},{"key":"B52","doi-asserted-by":"publisher","first-page":"1630","DOI":"10.1089\/neu.2017.5570","article-title":"Worsening dual-task gait costs after concussion and their association with subsequent sport-related injury","volume":"35","author":"Howell","year":"2018","journal-title":"J Neurotrauma"},{"key":"B53","doi-asserted-by":"publisher","first-page":"1594","DOI":"10.1016\/j.apmr.2014.03.019","article-title":"A preliminary study to identify locomotor-cognitive dual tasks that reveal persistent executive dysfunction after mild traumatic brain injury","volume":"95","author":"Cossette","year":"2014","journal-title":"Arch Phys Med Rehabil"},{"key":"B54","doi-asserted-by":"publisher","first-page":"4070","DOI":"10.1038\/s41598-017-04165-y","article-title":"Cognitive and motor dual task gait training improve dual task gait performance after stroke - A randomized controlled pilot trial","volume":"7","author":"Liu","year":"2017","journal-title":"Sci Rep"},{"key":"B55","doi-asserted-by":"publisher","first-page":"857","DOI":"10.1001\/jamaneurol.2017.0643","article-title":"Association of dual-task gait with incident dementia in mild cognitive impairment: results from the gait and brain study","volume":"74","author":"Montero-Odasso","year":"2017","journal-title":"JAMA Neurol"},{"key":"B56","first-page":"362","volume-title":"Usability engineering. San Francisco","author":"Nielsen","year":"1994"},{"key":"B57","doi-asserted-by":"crossref","DOI":"10.1145\/169059.169166","volume-title":"A mathematical model of the finding of usability problems. In: Proceedings of the SIGCHI conference on human factors in computing systems - CHI \u201893","author":"Nielsen","year":"1993"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1201\/9781498710411","article-title":"SUS - A quick and dirty usability scale","volume":"8","author":"Brooke","year":"1996","journal-title":"Usability Eval Ind"},{"key":"B59","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1080\/10447318.2018.1455307","article-title":"The system usability scale: past, present, and future","volume":"34","author":"Lewis","year":"2018","journal-title":"Int J Human\u2013Computer Interact"},{"key":"B60","author":"Sauro","year":""},{"key":"B61","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1097\/NCN.0b013e31819f7c7c","article-title":"User-Centered design and interactive health technologies for patients","volume":"27","author":"De Vito Dabbs","year":"2009","journal-title":"Comput Inform Nurs CIN"}],"container-title":["Frontiers in Rehabilitation Sciences"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fresc.2022.1051579\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T05:30:50Z","timestamp":1670218250000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fresc.2022.1051579\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,5]]},"references-count":61,"alternative-id":["10.3389\/fresc.2022.1051579"],"URL":"https:\/\/doi.org\/10.3389\/fresc.2022.1051579","relation":{},"ISSN":["2673-6861"],"issn-type":[{"value":"2673-6861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,5]]},"article-number":"1051579"}}