{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T18:29:41Z","timestamp":1779301781271,"version":"3.51.4"},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2020,4,1]],"date-time":"2020-04-01T00:00:00Z","timestamp":1585699200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,4,17]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Patient-reported outcomes (PROs) have been touted as the ultimate assessment of quality medical care and have been proposed as performance measures after appropriate risk adjustment. Although spine conditions represent the most common orthopedic disorders, the most used PROs for disabilities related to the back and neck\u2014the Modified Low Back Pain Disability Questionnaire (MDQ) and the Neck Disability Index (NDI)\u2014have not been evaluated as performance measures.<\/jats:p><\/jats:sec><jats:sec><jats:title>Objective<\/jats:title><jats:p>The objective of this study was to benchmark physical therapists\u2019 performance in the management of spine conditions not involving surgery through the use of risk-adjusted MDQ and NDI outcomes.<\/jats:p><\/jats:sec><jats:sec><jats:title>Design<\/jats:title><jats:p>This was a retrospective observational study.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Data were accessed for patients seeking physical therapy with no history of related surgery for back or neck pain (315,274 treatment episodes) between January 2015 and June 2018. Patients with complete data, including initial and matched final MDQ or NDI, were considered for analysis (182,276 patients; 2799 physical therapists). Linear models controlling for baseline PRO and patient characteristics predicted PRO change for each patient. An aggregated performance ratio of actual PRO change to predicted PRO change was calculated for each physical therapist, and then empirical bootstrapping was used to develop the median performance ratio and its confidence intervals. Physical therapists who met a 40-patient threshold for either cohort (MDQ or NDI) were classified as \u201coutperforming,\u201d \u201cmeeting expectations,\u201d or \u201cunderperforming\u201d relative to predicted values using these 95% confidence intervals.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Performance ratios indicated that 10% and 11% of physical therapists outperformed, 79% and 78% met expectations, and 11% and 11% underperformed relative to the risk-adjusted predicted change in the MDQ (1240 therapists; 97,908 patients) and NDI (461 therapists; 26,123 patients), respectively. To demonstrate the clinical importance of risk adjustment, clinical performance was evaluated in the seemingly homogeneous subset of 208 physical therapists within 0.5 SD of the median baseline MDQ and the median actual change in the MDQ. Following risk adjustment, 2 physical therapists were classified in each of the outperforming and underperforming cohorts.<\/jats:p><\/jats:sec><jats:sec><jats:title>Limitations<\/jats:title><jats:p>The secondarily obtained observational data used were not collected for research purposes. Additionally, the analyses were limited by missing baseline information and follow-up PROs.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The risk-adjusted performance ratios for the MDQ and NDI resulted in disparate conclusions regarding the quality of care compared with the raw, unadjusted change scores. According to the baseline and unadjusted change in the MDQ, even physical therapists in the most homogeneous sample were differentiated following appropriate risk adjustment. Clinically important improvements in actual PROs were observed in the outperforming but not in the underperforming physical therapists. Clinically meaningful differences in the performance ratio are unknown and are a limitation to clinical application and an opportunity for future research.<\/jats:p><\/jats:sec>","DOI":"10.1093\/ptj\/pzaa019","type":"journal-article","created":{"date-parts":[[2020,1,23]],"date-time":"2020-01-23T12:12:25Z","timestamp":1579781545000},"page":"609-620","source":"Crossref","is-referenced-by-count":18,"title":["Risk Adjustment of the Modified Low Back Pain Disability Questionnaire and Neck Disability Index to Benchmark Physical Therapist Performance: Analysis From an Outcomes Registry"],"prefix":"10.1093","volume":"100","author":[{"given":"Adam D","family":"Lutz","sequence":"first","affiliation":[{"name":"Department of Exercise Science , University of South Carolina, 200 Patewood Dr, Suite 150C, Greenville, SC 29615 (USA); ATI Physical Therapy, Greenville, South Carolina; and SC Center for Effectiveness Research in Orthopaedics, Greenville, South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John M","family":"Brooks","sequence":"additional","affiliation":[{"name":"SC Center for Effectiveness Research in Orthopaedics , University of South Carolina; and Department of Health Services Policy and Management, University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cole G","family":"Chapman","sequence":"additional","affiliation":[{"name":"Department of Pharmacy Practice and Science , Health Services Research Division, University of Iowa, Iowa City, Iowa"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ellen","family":"Shanley","sequence":"additional","affiliation":[{"name":"ATI Physical Therapy , Greenville, South Carolina; and SC Center for Effectiveness Research in Orthopaedics, University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris E","family":"Stout","sequence":"additional","affiliation":[{"name":"The Chicago School of Professional Psychology , Chicago, Illinois"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Charles A","family":"Thigpen","sequence":"additional","affiliation":[{"name":"ATI Physical Therapy ; and SC Center for Effectiveness Research in Orthopaedics, University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,4,14]]},"reference":[{"key":"2023011708474953300_ref1","author":"National Health Expenditure Summary including share of GDP"},{"key":"2023011708474953300_ref2","author":"The Burden of Musculoskeletal Diseases in the United States, 3rd ed","year":"2014"},{"key":"2023011708474953300_ref3","author":"Better, smarter, healthier: Health Care Payment Learning and Action Network kick off to advance value and quality in health care","year":"2015"},{"key":"2023011708474953300_ref4","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1056\/NEJMp1500445","article-title":"Setting value-based payment goals\u2014HHS efforts to improve U.S. health care","volume":"372","author":"Burwell","year":"2015","journal-title":"N Engl J Med."},{"key":"2023011708474953300_ref5","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1056\/NEJMp0904131","article-title":"A strategy for health care reform-toward a value-based system","volume":"361","author":"Porter","year":"2009","journal-title":"N Engl J Med."},{"key":"2023011708474953300_ref6","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1001\/jama.1994.03510340051033","article-title":"Improving the outcomes of coronary artery bypass surgery in New York state","volume":"271","author":"Hannon","year":"1994","journal-title":"JAMA."},{"key":"2023011708474953300_ref7","doi-asserted-by":"crossref","first-page":"S2","DOI":"10.1016\/j.athoracsur.2011.06.100","article-title":"Public reporting of cardiac surgery performance: part 1\u2014history, rationale, consequences","volume":"92","author":"Shahian","year":"2011","journal-title":"Ann Thorac Surg."},{"key":"2023011708474953300_ref8","doi-asserted-by":"crossref","first-page":"S12","DOI":"10.1016\/j.athoracsur.2011.06.101","article-title":"Public reporting of cardiac surgery performance: part 2\u2014implementation","volume":"92","author":"Shahian","year":"2011","journal-title":"Ann Thorac Surg."},{"key":"2023011708474953300_ref9","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1001\/jama.2016.11698","article-title":"From volume to value in health care: the work begins","volume":"316","author":"Porter","year":"2016","journal-title":"JAMA."},{"key":"2023011708474953300_ref10","first-page":"5","article-title":"A methodological critique of the ProPublica surgeon scorecard","author":"Friedberg","year":"2016","journal-title":"RAND Corporation"},{"key":"2023011708474953300_ref11","doi-asserted-by":"crossref","first-page":"2477","DOI":"10.1056\/NEJMp1011024","article-title":"What is value in health care?","volume":"363","author":"Porter","year":"2010","journal-title":"N Engl J Med."},{"key":"2023011708474953300_ref12","doi-asserted-by":"crossref","first-page":"691","DOI":"10.2307\/3348969","article-title":"Evaluating the quality of medical care","volume":"44","author":"Donabedian","year":"1966","journal-title":"Milbank Mem Fund Q."},{"key":"2023011708474953300_ref13","doi-asserted-by":"crossref","first-page":"1296","DOI":"10.1111\/j.1475-6773.2006.00536.x","article-title":"State regulation and the delivery of physical therapy services","volume":"41","author":"Resnik","year":"2006","journal-title":"Health Serv Res."},{"key":"2023011708474953300_ref14","doi-asserted-by":"crossref","first-page":"990","DOI":"10.1093\/ptj\/83.11.990","article-title":"Using clinical outcomes to identify expert physical therapists","volume":"83","author":"Resnik","year":"2003","journal-title":"Phys Ther."},{"key":"2023011708474953300_ref15","doi-asserted-by":"crossref","first-page":"768","DOI":"10.1111\/1475-6773.12344","article-title":"Benchmarking outpatient rehabilitation clinics using functional status outcomes","volume":"51","author":"Gozalo","year":"2016","journal-title":"Health Serv Res."},{"key":"2023011708474953300_ref16","doi-asserted-by":"crossref","first-page":"1692","DOI":"10.2522\/ptj.20140444","article-title":"Risk adjustment for lumbar dysfunction: comparison of linear mixed models with and without inclusion of between-clinic variation as a random effect","volume":"95","author":"Yen","year":"2015","journal-title":"Phys Ther."},{"key":"2023011708474953300_ref17","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1097\/SLA.0000000000001631","article-title":"Rating the raters: the inconsistent quality of health care performance measurement","volume":"264","author":"Shahian","year":"2016","journal-title":"Ann Surg."},{"key":"2023011708474953300_ref18","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.2522\/ptj.20070327","article-title":"Benchmarking physical therapy clinic performance: statistical methods to enhance internal validity when using observational data","volume":"88","author":"Resnik","year":"2008","journal-title":"Phys Ther."},{"key":"2023011708474953300_ref19","doi-asserted-by":"crossref","first-page":"989","DOI":"10.2522\/ptj.20070110","article-title":"Predictors of physical therapy clinic performance in the treatment of patients with low back pain syndromes","volume":"88","author":"Resnik","year":"2008","journal-title":"Phys Ther."},{"key":"2023011708474953300_ref20","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1093\/ptj\/81.2.776","article-title":"A comparison of a modified Oswestry low back pain disability questionnaire and the Quebec Back Pain Disability Scale","volume":"81","author":"Fritz","year":"2001","journal-title":"Phys Ther."},{"key":"2023011708474953300_ref21","first-page":"409","article-title":"The neck disability index: a study of reliability and validity","volume":"14","author":"Vernon","year":"1991","journal-title":"J Manipulative Physiol Ther."},{"key":"2023011708474953300_ref22","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1093\/ptj\/83.12.1090","article-title":"Using clinical outcomes to explore the theory of expert practice in physical therapy","volume":"83","author":"Resnik","year":"2003","journal-title":"Phys Ther."},{"key":"2023011708474953300_ref23","article-title":"The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement","volume":"12","author":"Benchimol","year":"2015","journal-title":"PLoS ONE."},{"key":"2023011708474953300_ref24","article-title":"Use of patient reported outcomes in physical therapist practice: report of the industry stakeholder collaborative task force on outcomes instrumentation","author":"Thigpen","year":"2017","journal-title":"Impact"},{"key":"2023011708474953300_ref25","first-page":"107","article-title":"Using the neck disability index to make decisions concerning individual patients","volume":"51","author":"Stratford","year":"1999","journal-title":"Physiother Canada."},{"key":"2023011708474953300_ref26","doi-asserted-by":"crossref","first-page":"307","DOI":"10.2519\/jospt.2003.33.6.307","article-title":"Guide to outcomes measurement for patients with low back pain syndromes","volume":"3","author":"Resnik","year":"2003","journal-title":"J Orthop Sports Phys Ther."},{"key":"2023011708474953300_ref27","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1093\/ptj\/74.6.528","article-title":"Assessing change over time in patients with low back pain","volume":"74","author":"Stratford","year":"1994","journal-title":"Phys Ther."},{"key":"2023011708474953300_ref28","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/0304-3959(95)00149-2","article-title":"Responsiveness of functional status in low back pain: a comparison of different instruments","volume":"65","author":"Beurskens","year":"1996","journal-title":"Pain."},{"key":"2023011708474953300_ref29","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1097\/PHM.0b013e3181ec98e6","article-title":"Reliability, construct validity, and responsiveness of the neck disability index, patient-specific functional scale, and numeric pain rating scale in patients with cervical radiculopathy","volume":"89","author":"Young","year":"2010","journal-title":"Am J Phys Med Rehabil."},{"key":"2023011708474953300_ref30","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1016\/j.spinee.2009.06.002","article-title":"Responsiveness of the neck disability index in patients with mechanical neck disorders","volume":"9","author":"Young","year":"2009","journal-title":"Spine J."},{"key":"2023011708474953300_ref31","first-page":"2018","article-title":"American community survey 5-year estimates","volume":"S1901","author":"U.S. Census Bureau. American Community Survey","year":"2016","journal-title":"Table"},{"key":"2023011708474953300_ref32","doi-asserted-by":"crossref","first-page":"267","DOI":"10.3233\/JEM-2000-0190","article-title":"Specification issues in measurement of quality of medical care using risk adjusted outcomes","volume":"26","author":"Mukamel","year":"2000","journal-title":"J Econ Soc Meas."},{"key":"2023011708474953300_ref33","volume-title":"Technical Expert Panel Summary Report: Development of Functional Outcome Quality Measures for Skilled Nursing Facilities (SNFs).","author":"Deutsch","year":"2016"},{"key":"2023011708474953300_ref34","first-page":"54","article-title":"Bootstrap methods for standard errors, confidence intervals and other measures of statistical accuracy","volume":"1","author":"Efron","year":"1986","journal-title":"Stat Sci."},{"key":"2023011708474953300_ref35","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1016\/0021-9681(87)90171-8","article-title":"A new method of classifying prognostic comorbidity in longitudinal studies: development and validation","volume":"40","author":"Charlson","year":"1987","journal-title":"J Chronic Dis."},{"key":"2023011708474953300_ref36","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1177\/1077558715572387","article-title":"New evidence on the persistence of health spending","volume":"72","author":"Hirth","year":"2015","journal-title":"Med Care Res Rev."},{"key":"2023011708474953300_ref37","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0201348","article-title":"Health seeking behavior as a predictor of healthcare utilization in a population of patients with spinal pain","volume":"13","author":"Clewley","year":"2018","journal-title":"PLoS ONE."},{"key":"2023011708474953300_ref38","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1097\/00002508-199103000-00053","article-title":"The Tampa scale: a measure of Kinisophobia","volume":"7","author":"Miller","year":"1991","journal-title":"Clin J Pain."},{"key":"2023011708474953300_ref39","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/0304-3959(93)90127-B","article-title":"A Fear-Avoidance Beliefs Questionnaire (FABQ) and the role of fear-avoidance beliefs in chronic low back pain and disability","volume":"52","author":"Waddell","year":"1993","journal-title":"Pain."},{"key":"2023011708474953300_ref40","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2016-015188","article-title":"The Optimal Screening for Prediction of Referral and Outcome (OSPRO) in patients with musculoskeletal pain conditions: a longitudinal validation cohort from the USA","volume":"7","author":"George","year":"2017","journal-title":"BMJ Open."}],"container-title":["Physical Therapy"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/ptj\/advance-article-pdf\/doi\/10.1093\/ptj\/pzaa019\/33041470\/pzaa019.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ptj\/article-pdf\/100\/4\/609\/48728303\/ptj_100_4_609.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ptj\/article-pdf\/100\/4\/609\/48728303\/ptj_100_4_609.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T16:07:34Z","timestamp":1722355654000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ptj\/article\/100\/4\/609\/5819659"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4]]},"references-count":40,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,4,17]]}},"URL":"https:\/\/doi.org\/10.1093\/ptj\/pzaa019","relation":{},"ISSN":["0031-9023","1538-6724"],"issn-type":[{"value":"0031-9023","type":"print"},{"value":"1538-6724","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,4]]},"published":{"date-parts":[[2020,4]]}}}