{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T19:03:59Z","timestamp":1782846239738,"version":"3.54.5"},"reference-count":45,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec sec-type=\"background\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>People who sustain a concussion and live in remote areas can experience challenges in accessing specialized assessments. In these cases, virtual approaches to assessment are of value. There is limited information on important psychometric properties of physical assessment measures used to evaluate people postconcussion virtually.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"objective\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>The aims of this method-comparison psychometric study were to determine (1) inter- and intrarater reliability of a battery of concussion physical tests administered virtually in people with brain injury and (2) sensitivity and specificity of the virtual battery when compared to the in-person assessment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"methods\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A total of 60 people living with acquired brain injuries attended an in-person and virtual assessment at the Ottawa Hospital Rehabilitation Centre. The order of the assessments, in-person and virtual, was randomized. The following physical measures were administered in-person and virtually: finger-to-nose test, vestibular ocular motor screening (VOMS), static balance testing (double leg, single leg, and tandem), saccades, cervical spine range of motion, and evaluation of effort. The virtual assessment was recorded, and a second clinician viewed and independently documented findings from the recordings twice at 1-month intervals.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"results\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The mean age of the participants was 45.65 (SD 16.50) years. The sensitivity metrics ranged from moderate (60%, 95% CI 30-86) to excellent (100%, 95% CI 71-100) for saccades and cervical spine right lateral flexion, respectively. Specificity ranged from 75%, 95% CI 35-95 to 100%, 95% CI 91-100 for left single leg stance eyes closed and left finger-to-nose testing, respectively. The interrater reliability ranged from poor for cervical spine extension (Cohen \u03ba=0.20, 95% CI \u22120.07 to 0.47) to excellent for VOMS change in symptoms (Cohen \u03ba=0.93, 95% CI 0.83-1). The intrarater reliability ranged from poor for cervical spine extension (Cohen \u03ba=0.31, 95% CI 0.04-0.58) to excellent for the finger-to-nose testing on the right (Cohen \u03ba=0.90, 95% CI 0.71-1). The wide CIs highlight variability in precision and suggest that further research with larger samples is needed before clinical use can be fully standardized.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"conclusions\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This study provides information on the psychometric properties associated with virtual administration of concussion measures. The VOMS change in symptoms measure appears to have the most promising properties when administered virtually when in-person visits are not possible. This is particularly relevant for patients in rural areas, for those facing access barriers, and in contexts where timely follow-up is challenging. However, caution should be maintained when administering certain concussion measures virtually. The wide CIs for some measures caution against over-reliance on single test findings, and clinicians should consider both the strengths and limitations of virtual delivery. Clinicians are encouraged to make informed decisions about which measures can be effectively used remotely, and which may still require in-person administration to maintain accuracy.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/76995","type":"journal-article","created":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T15:00:08Z","timestamp":1759158008000},"page":"e76995-e76995","source":"Crossref","is-referenced-by-count":1,"title":["Application of Commonly Used Physical Tests in a Virtual Environment in Patients With Concussion to Patients With Various Types and Severities of Acquired Brain Injury: Prospective Cohort Method Comparison Study"],"prefix":"10.2196","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7371-3816","authenticated-orcid":false,"given":"Keely","family":"Barnes","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7335-8121","authenticated-orcid":false,"given":"Heidi","family":"Sveistrup","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7860-9463","authenticated-orcid":false,"given":"Mark","family":"Bayley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9326-9903","authenticated-orcid":false,"given":"Michel","family":"Rathbone","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3978-8961","authenticated-orcid":false,"given":"Monica","family":"Taljaard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0149-958X","authenticated-orcid":false,"given":"Mary","family":"Egan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8464-8837","authenticated-orcid":false,"given":"Martin","family":"Bilodeau","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3252-864X","authenticated-orcid":false,"given":"Motahareh","family":"Karimijashni","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0893-6159","authenticated-orcid":false,"given":"Shawn","family":"Marshall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,10,27]]},"reference":[{"issue":"5","key":"R1","doi-asserted-by":"publisher","first-page":"599","DOI":"10.1055\/s-0035-1563567","article-title":"The concussion toolbox: the role of vision in the assessment of concussion","volume":"35","author":"Ventura","journal-title":"Semin Neurol"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2018.01113","article-title":"A multidimensional approach to post-concussion symptoms in mild traumatic brain injury","volume":"9","author":"Polinder","journal-title":"Front Neurol"},{"issue":"12","key":"R3","doi-asserted-by":"publisher","first-page":"1247","DOI":"10.4085\/1062-6050-455-18","article-title":"Relationship between the King-Devick test and commonly used concussion tests at baseline","volume":"54","author":"Clugston","journal-title":"J Athl Train"},{"issue":"4","key":"R4","doi-asserted-by":"publisher","first-page":"496","DOI":"10.3109\/02699052.2014.887144","article-title":"Assessment of oculomotor control and balance post-concussion: a preliminary study for a novel approach to concussion management","volume":"28","author":"Murray","journal-title":"Brain Inj"},{"key":"R5","unstructured":"McKay C Velikonja D Davis J et al. Ontario psychological association evidence-based guidelines for the assessment of concussion and related symptoms. Ontario Psychological Association; 2016. URL: https:\/\/www.psych.on.ca\/getmedia\/b7ada02e-76ca-4a5c-891a-bc610c81a213\/OPAConcussionGuidelinesFINAL2018.pdf [Accessed 22-10-2025]"},{"issue":"7","key":"R6","first-page":"426","volume":"99","author":"Scorza","journal-title":"Am Fam Physician"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1016\/j.spen.2019.03.017","article-title":"Concussion: a global perspective","volume":"30","author":"Hon","journal-title":"Semin Pediatr Neurol"},{"issue":"24","key":"R8","doi-asserted-by":"publisher","first-page":"2250","DOI":"10.1212\/WNL.0b013e31828d57dd","article-title":"Summary of evidence-based guideline update: evaluation and management of concussion in sports [RETIRED]: report of the Guideline Development Subcommittee of the American Academy of Neurology","volume":"80","author":"Giza","journal-title":"Neurology (ECronicon)"},{"issue":"6","key":"R9","doi-asserted-by":"publisher","first-page":"1400","DOI":"10.1177\/0363546516632754","article-title":"Reliability and associated risk factors for performance on the vestibular\/ocular motor screening (VOMS) tool in healthy collegiate athletes","volume":"44","author":"Kontos","journal-title":"Am J Sports Med"},{"issue":"12","key":"R10","doi-asserted-by":"publisher","DOI":"10.1007\/s11910-021-01159-2","article-title":"Clinical assessment of concussion and persistent post-concussive symptoms for neurologists","volume":"21","author":"Leddy","journal-title":"Curr Neurol Neurosci Rep"},{"issue":"1","key":"R11","doi-asserted-by":"publisher","first-page":"E60","DOI":"10.1097\/HTR.0000000000000503","article-title":"Increasing incidence of concussion: true epidemic or better recognition?","volume":"35","author":"Langer","journal-title":"J Head Trauma Rehabil"},{"issue":"2","key":"R12","doi-asserted-by":"publisher","DOI":"10.2196\/16407","article-title":"Barriers and facilitators that influence telemedicine-based, real-time, online consultation at patients\u2019 homes: systematic literature review","volume":"22","author":"Almathami","journal-title":"J Med Internet Res"},{"issue":"2","key":"R13","doi-asserted-by":"publisher","first-page":"E49","DOI":"10.1097\/HTR.0000000000000713","article-title":"The emerging role of telehealth for concussion clinical care during the coronavirus (COVID-19) pandemic","volume":"37","author":"Womble","journal-title":"J Head Trauma Rehabil"},{"issue":"5","key":"R14","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1017\/cjn.2020.96","article-title":"The virtual neurologic exam: instructional videos and guidance for the COVID-19 era","volume":"47","author":"Al Hussona","journal-title":"Can J Neurol Sci"},{"issue":"9","key":"R15","doi-asserted-by":"publisher","first-page":"797","DOI":"10.1177\/1357633X17727772","article-title":"Method-comparison studies in telehealth: study design and analysis considerations","volume":"23","author":"Russell","journal-title":"J Telemed Telecare"},{"key":"R16","doi-asserted-by":"crossref","unstructured":"Barnes K Sveistrup H Bayley M et al. Investigation of study procedures to estimate sensitivity and reliability of a virtual physical assessment developed for workplace concussions: a feasibility study. JMIR Preprints. JMIR Neurotechnology. Preprint posted online on Sep 25, 2024. [doi: 10.2196\/preprints.57661]","DOI":"10.2196\/preprints.57661"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.2196\/57663","article-title":"Reliability and sensitivity of a virtual assessment developed for workplace concussions: protocol for a method-comparison study","volume":"13","author":"Barnes","journal-title":"JMIR Res Protoc"},{"issue":"3","key":"R18","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1176\/appi.neuropsych.14050111","article-title":"Pilot study of neurological soft signs and depressive and postconcussive symptoms during recovery from mild traumatic brain injury (mTBI)","volume":"27","author":"Greenberg","journal-title":"J Neuropsychiatry Clin Neurosci"},{"issue":"7","key":"R19","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1016\/s0003-9993(98)90361-6","article-title":"Interrater reliability of neurologic soft signs in an acquired brain injury population","volume":"79","author":"Masanic","journal-title":"Arch Phys Med Rehabil"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.17348\/era.5.0.147-158","article-title":"Purposive sampling as a tool for informant selection","volume":"5","author":"Tongco","journal-title":"Ethnobot Res App"},{"key":"R21","unstructured":"Johnston S Leddy J Nick RO Cortel-LeBlanc A Hafizi R Laing S . Virtual Concussion Exam Training Manual. 2024. URL: https:\/\/pedsconcussion.com\/wp-content\/uploads\/VirtualConcussionExamManual.pdf [Accessed 28-06-2024]"},{"issue":"6","key":"R22","doi-asserted-by":"publisher","first-page":"597","DOI":"10.4085\/1062-6050-174-17","article-title":"Acute sport-related concussion screening for collegiate athletes using an instrumented balance assessment","volume":"53","author":"Baracks","journal-title":"J Athl Train"},{"issue":"2","key":"R23","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1097\/HTR.0000000000000608","article-title":"Clinical detection and recovery of vestibular and oculomotor impairments among amateur athletes following sport-related concussion: a prospective, matched-cohort study","volume":"36","author":"B\u00fcttner","journal-title":"J Head Trauma Rehabil"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2017.00307","article-title":"Sensitivity, specificity, and predictive values: foundations, pliabilities, and pitfalls in research and practice","volume":"5","author":"Trevethan","journal-title":"Front Public Health"},{"issue":"2","key":"R25","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1093\/ptj\/73.2.71","article-title":"Reliability of the scores for the finger-to-nose test in adults with traumatic brain injury","volume":"73","author":"Swaine","journal-title":"Phys Ther"},{"issue":"2","key":"R26","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1093\/ptj\/71.2.98","article-title":"Reliability of measurements of cervical spine range of motion--comparison of three methods","volume":"71","author":"Youdas","journal-title":"Phys Ther"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.2196\/56158","article-title":"Barriers and facilitators associated with remote concussion physical assessments from the perspectives of clinicians and people living with workplace concussions: focus group study","volume":"26","author":"Barnes","journal-title":"J Med Internet Res"},{"issue":"6","key":"R28","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1177\/1357633X19878330","article-title":"The virtual physical exam in the 21st century","volume":"27","author":"Ansary","journal-title":"J Telemed Telecare"},{"issue":"3","key":"R29","doi-asserted-by":"publisher","DOI":"10.1016\/j.arrct.2021.100146","article-title":"Reliability of virtual physical performance assessments in veterans during the COVID-19 pandemic","volume":"3","author":"Ogawa","journal-title":"Arch Rehabil Res Clin Transl"},{"issue":"2","key":"R30","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1002\/msc.1525","article-title":"Virtual assessments of knee and wrist joint range motion have comparable reliability with face-to-face assessments","volume":"19","author":"Mehta","journal-title":"Musculoskeletal Care"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.1016\/j.msard.2024.105766","article-title":"The agreement between face-to-face and tele-assessment of balance tests in patients with multiple sclerosis","volume":"90","author":"Erekdag","journal-title":"Mult Scler Relat Disord"},{"issue":"4","key":"R32","doi-asserted-by":"publisher","first-page":"659","DOI":"10.1016\/j.apmr.2016.10.019","article-title":"Tele-assessment of the Berg Balance Scale: effects of transmission characteristics","volume":"98","author":"Venkataraman","journal-title":"Arch Phys Med Rehabil"},{"issue":"6","key":"R33","doi-asserted-by":"publisher","DOI":"10.1212\/CPJ.0000000000200339","article-title":"Virtual compared with in-person neurologic examination study","volume":"14","author":"Hophing","journal-title":"Neurol Clin Pract"},{"issue":"8","key":"R34","doi-asserted-by":"publisher","first-page":"1238","DOI":"10.1016\/j.apmr.2011.03.014","article-title":"Comparison of virtual reality versus physical reality on movement characteristics of persons with Parkinson\u2019s disease: effects of moving targets","volume":"92","author":"Wang","journal-title":"Arch Phys Med Rehabil"},{"key":"R35","doi-asserted-by":"publisher","DOI":"10.1186\/s12984-016-0116-y","article-title":"Concurrent validity and test-retest reliability of the Virtual Peg Insertion Test to quantify upper limb function in patients with chronic stroke","volume":"13","author":"Tobler-Ammann","journal-title":"J Neuroeng Rehabil"},{"issue":"5","key":"R36","doi-asserted-by":"publisher","first-page":"659","DOI":"10.1682\/jrrd.2006.11.0144","article-title":"Televideo assessment using Functional Reach Test and European Stroke Scale","volume":"44","author":"Palsbo","journal-title":"J Rehabil Res Dev"},{"key":"R37","doi-asserted-by":"publisher","DOI":"10.1258\/135763303322596318","article-title":"Assessment of motor speech disorders online: a pilot study","volume":"9 Suppl 2","author":"Theodoros","journal-title":"J Telemed Telecare"},{"issue":"4","key":"R38","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1258\/jtt.2008.070904","article-title":"Teleneurology in patients with multiple sclerosis: EDSS ratings derived remotely and from hands-on examination","volume":"14","author":"Kane","journal-title":"J Telemed Telecare"},{"key":"R39","doi-asserted-by":"publisher","DOI":"10.1016\/j.msard.2019.05.001","article-title":"Comparison of telemedicine versus in-person visits for persons with multiple sclerosis: a randomized crossover study of feasibility, cost, and satisfaction","volume":"36","author":"Robb","journal-title":"Mult Scler Relat Disord"},{"issue":"4","key":"R40","doi-asserted-by":"publisher","first-page":"241","DOI":"10.3138\/ptc.59.4.241","article-title":"Weighing the evidence: clinical decision making in neurological physical therapy","volume":"59","author":"McGlynn","journal-title":"Physiotherapy Canada"},{"issue":"3","key":"R41","doi-asserted-by":"publisher","first-page":"233","DOI":"10.2522\/ptj.20080131","article-title":"Factors that influence the clinical decision making of physical therapists in choosing a balance assessment approach","volume":"89","author":"McGinnis","journal-title":"Phys Ther"},{"key":"R42","doi-asserted-by":"publisher","DOI":"10.1186\/1748-5908-5-77","article-title":"Determinants of research use in clinical decision making among physical therapists providing services post-stroke: a cross-sectional study","volume":"5","author":"Salbach","journal-title":"Implement Sci"},{"issue":"4","key":"R43","doi-asserted-by":"publisher","DOI":"10.3390\/cancers14041075","article-title":"Test\/retest reliability and validity of remote vs. in-person anthropometric and physical performance assessments in cancer survivors and supportive partners","volume":"14","author":"Hoenemeyer","journal-title":"Cancers (Basel)"},{"key":"R44","doi-asserted-by":"publisher","DOI":"10.2196\/47246","article-title":"Clinician-prioritized measures to use in a remote concussion assessment: Delphi study","volume":"8","author":"Barnes","journal-title":"JMIR Form Res"},{"issue":"9","key":"R45","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0274349","article-title":"Psychometric properties of performance-based measures of physical function administered via telehealth among people with chronic conditions: a systematic review","volume":"17","author":"Barry Walsh","journal-title":"PLoS ONE"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2025\/1\/e76995","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:08:59Z","timestamp":1782842939000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2025\/1\/e76995"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,27]]},"references-count":45,"URL":"https:\/\/doi.org\/10.2196\/76995","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,27]]},"article-number":"v27i5e76995"}}