{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T15:41:58Z","timestamp":1779378118376,"version":"3.53.1"},"reference-count":49,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2020,10,23]],"date-time":"2020-10-23T00:00:00Z","timestamp":1603411200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"Suzanne Nielsen was supported by NHMRC","award":["#1132433"],"award-info":[{"award-number":["#1132433"]}]},{"name":"Suzanne Nielsen was supported by NHMRC","award":["#1163961"],"award-info":[{"award-number":["#1163961"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,12,25]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>The Routine Opioid Outcome Monitoring (ROOM) tool measures outcomes with opioids using an established framework which includes domains such as pain, mood, opioid use disorder, alcohol use, and constipation. This study aims to validate and establish the test-retest reliability of the computer-administered ROOM tool.<\/jats:p><\/jats:sec><jats:sec><jats:title>Design and Setting<\/jats:title><jats:p>Cross-sectional analysis of an online sample.<\/jats:p><\/jats:sec><jats:sec><jats:title>Subjects<\/jats:title><jats:p>Participants comprised those with chronic noncancer pain who regularly used prescription opioids.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Participants self-completed the online ROOM tool along with other validated measures (validation questionnaire), and those who were agreeable also completed the online test-retest questionnaire approximately two weeks later. Subcomponents of the ROOM tool (i.e., pain, mood, alcohol use, opioid use disorder, and constipation) were validated against longer measures of the same construct using Pearson correlation coefficients. Intraclass correlation coefficients were used to assess the stability of the ROOM tool over time.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>A total of 324 participants completed the validation questionnaire, of whom 260 also completed the test-retest questionnaire. The opioid use disorder domain showed good sensitivity (73.6) and specificity (75.8) against the Diagnostic and Statistical Manual of Mental Disorders, 5th Edition, any opioid use disorder. All ROOM components showed moderate correlation (r\u2009=\u20090.55\u20130.73) with their longer counterparts. Test-retest reliability was fair (0.58\u20130.75), indicating that responses were relatively stable over time. Reliability did vary, however, based on the components being measured and how certain tools were scored.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>The computer-administered ROOM tool is a valid approach for brief monitoring of outcomes with prescribed opioids in primary care settings and appears to be acceptable to people who are using prescribed opioids for chronic pain.<\/jats:p><\/jats:sec>","DOI":"10.1093\/pm\/pnaa297","type":"journal-article","created":{"date-parts":[[2020,8,4]],"date-time":"2020-08-04T19:31:30Z","timestamp":1596569490000},"page":"3645-3654","source":"Crossref","is-referenced-by-count":7,"title":["Validity and Reliability of the\u00a0Computer-Administered Routine Opioid Outcome Monitoring (ROOM) Tool"],"prefix":"10.1093","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7593-3209","authenticated-orcid":false,"given":"Louisa","family":"Picco","sequence":"first","affiliation":[{"name":"Monash Addiction Research Centre, Monash University Peninsula Campus, Frankston, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Melissa","family":"Middleton","sequence":"additional","affiliation":[{"name":"Monash Addiction Research Centre, Monash University Peninsula Campus, Frankston, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raimondo","family":"Bruno","sequence":"additional","affiliation":[{"name":"National Drug and Alcohol Research Centre, University of New South Wales, Sydney, NSW, Australia"},{"name":"School of Medicine, University of Tasmania, Hobart, Tasmania, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michala","family":"Kowalski","sequence":"additional","affiliation":[{"name":"National Drug and Alcohol Research Centre, University of New South Wales, Sydney, NSW, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suzanne","family":"Nielsen","sequence":"additional","affiliation":[{"name":"Monash Addiction Research Centre, Monash University Peninsula Campus, Frankston, Victoria, Australia"},{"name":"National Drug and Alcohol Research Centre, University of New South Wales, Sydney, NSW, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,10,23]]},"reference":[{"issue":"10028","key":"2020122823523332200_pnaa297-B1","doi-asserted-by":"crossref","first-page":"1644","DOI":"10.1016\/S0140-6736(16)00161-6","article-title":"Use of and barriers to access to opioid analgesics: A worldwide, regional, and national study","volume":"387","author":"Berterame","year":"2016","journal-title":"Lancet"},{"issue":"5","key":"2020122823523332200_pnaa297-B2","doi-asserted-by":"crossref","first-page":"1159","DOI":"10.1111\/bcp.12446","article-title":"An overview of the patterns of prescription opioid use, costs and related harms in Australia","volume":"78","author":"Blanch","year":"2014","journal-title":"Br J Clin Pharmacol"},{"issue":"8","key":"2020122823523332200_pnaa297-B3","doi-asserted-by":"crossref","first-page":"955","DOI":"10.1111\/imj.12966","article-title":"Prescription opioid analgesics for pain management in Australia: 20 years of dispensing","volume":"46","author":"Islam","year":"2016","journal-title":"Intern Med J"},{"key":"2020122823523332200_pnaa297-B4","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/j.drugalcdep.2017.07.018","article-title":"Trends in heroin and pharmaceutical opioid overdose deaths in Australia","volume":"179","author":"Roxburgh","year":"2017","journal-title":"Drug Alcohol Depend"},{"key":"2020122823523332200_pnaa297-B5","author":"Roxburgh","year":"2018"},{"issue":"9","key":"2020122823523332200_pnaa297-B6","doi-asserted-by":"crossref","first-page":"1745","DOI":"10.1111\/pme.12773","article-title":"Pharmaceutical opioid use and dependence among people living with chronic pain: Associations observed within the Pain and Opioids In Treatment (POINT) cohort","volume":"16","author":"Campbell","year":"2015","journal-title":"Pain Med"},{"issue":"5","key":"2020122823523332200_pnaa297-B7","doi-asserted-by":"crossref","first-page":"280","DOI":"10.5694\/mja10.11450","article-title":"Prescription of opioid analgesics and related harms in Australia","volume":"195","author":"Roxburgh","year":"2011","journal-title":"Med J Aust"},{"issue":"1","key":"2020122823523332200_pnaa297-B8","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1370\/afm.1885","article-title":"Prescription opioid duration, dose, and increased risk of depression in 3 large patient populations","volume":"14","author":"Scherrer","year":"2016","journal-title":"Ann Fam Med"},{"issue":"2","key":"2020122823523332200_pnaa297-B9","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1097\/01.j.pain.0000460303.63948.8e","article-title":"The Pain and Opioids In Treatment study: Characteristics of a cohort using opioids to manage chronic non-cancer pain","volume":"156","author":"Campbell","year":"2015","journal-title":"Pain"},{"key":"2020122823523332200_pnaa297-B10","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.drugalcdep.2016.02.048","article-title":"Pain, alcohol use disorders and risky patterns of drinking among people with chronic non-cancer pain receiving long-term opioid therapy","volume":"162","author":"Larance","year":"2016","journal-title":"Drug Alcohol Depend"},{"issue":"8","key":"2020122823523332200_pnaa297-B11","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1586\/17474124.2014.939629","article-title":"Naloxegol for the treatment of opioid-induced constipation","volume":"8","author":"Tack","year":"2014","journal-title":"Expert Rev Gastroenterol Hepatol"},{"issue":"13","key":"2020122823523332200_pnaa297-B12","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1001\/jama.2011.401","article-title":"Characteristics of opioid prescriptions in 2009","volume":"305","author":"Volkow","year":"2011","journal-title":"JAMA"},{"issue":"4","key":"2020122823523332200_pnaa297-B13","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1016\/S0149-2918(04)90057-4","article-title":"A new tool to assess and document pain outcomes in chronic pain patients receiving opioid therapy","volume":"26","author":"Passik","year":"2004","journal-title":"Clin Ther"},{"key":"2020122823523332200_pnaa297-B14","volume-title":"Quick Reference Recommendations for Conduct of an Opioid Trial in Chronic Non-Cancer Pain","year":"2015"},{"issue":"40","key":"2020122823523332200_pnaa297-B15","first-page":"881","article-title":"Alcohol involvement in opioid pain reliever and benzodiazepine drug abuse-related emergency department visits and drug-related deaths\u2014United States, 2010","volume":"63","author":"Jones","year":"2014","journal-title":"MMWR Morb Mortal Wkly Rep"},{"issue":"3","key":"2020122823523332200_pnaa297-B16","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1111\/acer.13594","article-title":"Alcohol and opioid use, co-use, and chronic pain in the context of the opioid epidemic: A critical review","volume":"42","author":"Witkiewitz","year":"2018","journal-title":"Alcoholism"},{"issue":"8","key":"2020122823523332200_pnaa297-B17","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1016\/j.sapharm.2018.10.024","article-title":"Routine opioid outcome monitoring in community pharmacy: Pilot implementation study protocol","volume":"15","author":"Nielsen","year":"2019","journal-title":"Res Social Adm Pharm"},{"issue":"2","key":"2020122823523332200_pnaa297-B18","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1111\/j.1526-4637.2005.05031.x","article-title":"Universal precautions in pain medicine: A rational approach to the treatment of chronic pain","volume":"6","author":"Gourlay","year":"2005","journal-title":"Pain Med"},{"issue":"6","key":"2020122823523332200_pnaa297-B19","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1007\/s11606-009-0981-1","article-title":"Development and initial validation of the PEG, a three-item scale assessing pain intensity and interference","volume":"24","author":"Krebs","year":"2009","journal-title":"J Gen Intern Med"},{"key":"2020122823523332200_pnaa297-B20","first-page":"129","article-title":"Pain assessment: Global use of the Brief Pain Inventory","volume":"23","author":"Cleeland","year":"1994","journal-title":"Ann Acad Med Singapore"},{"issue":"9","key":"2020122823523332200_pnaa297-B21","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1046\/j.1525-1497.2001.016009606.x","article-title":"The PHQ-9: Validity of a brief depression severity measure","volume":"16","author":"Kroenke","year":"2001","journal-title":"J Gen Intern Med"},{"issue":"11","key":"2020122823523332200_pnaa297-B22","doi-asserted-by":"crossref","first-page":"1284","DOI":"10.1097\/01.MLR.0000093487.78664.3C","article-title":"The Patient Health Questionnaire-2: Validity of a two-item depression screener","volume":"41","author":"Kroenke","year":"2003","journal-title":"Med Care"},{"issue":"7","key":"2020122823523332200_pnaa297-B23","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1007\/s11606-009-0928-6","article-title":"Primary care validation of a single-question alcohol screening test","volume":"24","author":"Smith","year":"2009","journal-title":"J Gen Intern Med"},{"key":"2020122823523332200_pnaa297-B24","author":"Babor","year":"2001"},{"issue":"3","key":"2020122823523332200_pnaa297-B25","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1185\/03007995.2012.657301","article-title":"The Bowel Function Index: A new validated scale for assessing opioid-induced constipation","volume":"28","author":"Ducrott\u00e9","year":"2012","journal-title":"Curr Med Res Opin"},{"issue":"2","key":"2020122823523332200_pnaa297-B26","doi-asserted-by":"crossref","DOI":"10.1093\/pm\/pnz213","article-title":"Development of a brief patient-administered screening tool for prescription opioid dependence for primary care settings","volume":"21","author":"Nielsen","year":"2020","journal-title":"Pain Med"},{"issue":"7","key":"2020122823523332200_pnaa297-B27","doi-asserted-by":"crossref","first-page":"1208","DOI":"10.1111\/j.1530-0277.2007.00403.x","article-title":"AUDIT-C as a brief screen for alcohol misuse in primary care","volume":"31","author":"Bradley","year":"2007","journal-title":"Alcoholism"},{"key":"2020122823523332200_pnaa297-B28","article-title":"Routine opioid outcome monitoring in community pharmacy: Outcomes from an open-label single-arm implementation-effectiveness pilot study","author":"Nielsen","journal-title":"Res Social Adm Pharm"},{"issue":"X","key":"2020122823523332200_pnaa297-B29","first-page":"XXX","article-title":"Validation of the OWLS, a screening tool for measuring prescription opioid use disorder in primary care","volume":"XXX","author":"Picco","year":"2020","journal-title":"Pain Med"},{"key":"2020122823523332200_pnaa297-B30","doi-asserted-by":"crossref","DOI":"10.1176\/appi.books.9780890425596","volume-title":"Diagnostic and Statistical Manual of Mental Disorders (DSM-5\u00ae)","author":"Association","year":"2013"},{"issue":"3","key":"2020122823523332200_pnaa297-B31","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1071\/PY14149","article-title":"Validation of the PHQ-2 against the PHQ-9 for detecting depression in a large sample of Australian general practice patients","volume":"22","author":"Carey","year":"2016","journal-title":"Aust J Prim Health"},{"issue":"2","key":"2020122823523332200_pnaa297-B32","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.jbi.2008.08.010","article-title":"Research Electronic Data Capture (REDCap): A metadata-driven methodology and workflow process for providing translational research informatics support","volume":"42","author":"Harris","year":"2009","journal-title":"J Biomed Inform"},{"key":"2020122823523332200_pnaa297-B33","volume-title":"Composite International Diagnostic Interview-Substance Abuse Module (SAM)","author":"Cottler","year":"2000"},{"issue":"4","key":"2020122823523332200_pnaa297-B34","first-page":"176","article-title":"Cut points for mild, moderate, and severe pain among cancer and non-cancer patients: A literature review","volume":"4","author":"Woo","year":"2015","journal-title":"Ann Palliat Med"},{"issue":"2","key":"2020122823523332200_pnaa297-B35","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.jpain.2003.12.005","article-title":"Validation of the Brief Pain Inventory for chronic nonmalignant pain","volume":"5","author":"Tan","year":"2004","journal-title":"The J Pain"},{"issue":"3","key":"2020122823523332200_pnaa297-B36","doi-asserted-by":"crossref","first-page":"E191","DOI":"10.1503\/cmaj.110829","article-title":"Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): A meta-analysis","volume":"184","author":"Manea","year":"2012","journal-title":"CMAJ"},{"issue":"4","key":"2020122823523332200_pnaa297-B37","doi-asserted-by":"crossref","first-page":"371","DOI":"10.3111\/13696990903430481","article-title":"Validation of the Bowel Function Index to detect clinically meaningful changes in opioid-induced constipation","volume":"12","author":"Rentz","year":"2009","journal-title":"J Med Econ"},{"issue":"1","key":"2020122823523332200_pnaa297-B38","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1177\/147323001103900106","article-title":"The bowel function index for evaluating constipation in pain patients: Definition of a reference range for a non-constipated population of pain patients","volume":"39","author":"Ueberall","year":"2011","journal-title":"J Int Med Res"},{"issue":"13","key":"2020122823523332200_pnaa297-B39","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1002\/(SICI)1097-0258(19970715)16:13<1529::AID-SIM565>3.0.CO;2-H","article-title":"Sample size determination for diagnostic accuracy studies involving binormal ROC curve indices","volume":"16","author":"Obuchowski","year":"1997","journal-title":"Stat Med"},{"issue":"7","key":"2020122823523332200_pnaa297-B40","doi-asserted-by":"crossref","first-page":"1489","DOI":"10.1097\/j.pain.0000000000000548","article-title":"Defining problematic pharmaceutical opioid use among people prescribed opioids for chronic noncancer pain: Do different measures identify the same patients?","volume":"157","author":"Campbell","year":"2016","journal-title":"Pain"},{"key":"2020122823523332200_pnaa297-B41","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511996214","volume-title":"Measurement in Medicine: A Practical Guide","author":"de Vet","year":"2011"},{"issue":"2","key":"2020122823523332200_pnaa297-B42","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A guideline of selecting and reporting intraclass correlation coefficients for reliability research","volume":"15","author":"Koo","year":"2016","journal-title":"J Chiropr Med"},{"key":"2020122823523332200_pnaa297-B43","doi-asserted-by":"crossref","first-page":"g7594","DOI":"10.1136\/bmj.g7594","article-title":"Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD statement","volume":"350","author":"Collins","year":"2015","journal-title":"BMJ"},{"key":"2020122823523332200_pnaa297-B44","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2147\/SAR.S22575","article-title":"Electronic health records: Essential tools in integrating substance abuse treatment with primary care","volume":"3","author":"Tai","year":"2012","journal-title":"Subst Abuse Rehabil"},{"key":"2020122823523332200_pnaa297-B45","doi-asserted-by":"crossref","DOI":"10.1016\/j.pain.2009.01.012","volume-title":"Measuring and Distilling the Impact of Pain","author":"Kroenke","year":"2009"},{"issue":"4","key":"2020122823523332200_pnaa297-B46","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1016\/j.genhosppsych.2010.03.006","article-title":"The Patient Health Questionnaire somatic, anxiety, and depressive symptom scales: A systematic review","volume":"32","author":"Kroenke","year":"2010","journal-title":"Gen Hosp Psychiatry"},{"issue":"13","key":"2020122823523332200_pnaa297-B47","doi-asserted-by":"crossref","first-page":"1155","DOI":"10.1001\/archinternmed.2010.140","article-title":"A single-question screening test for drug use in primary care","volume":"170","author":"Smith","year":"2010","journal-title":"Arch Int Med"},{"issue":"1","key":"2020122823523332200_pnaa297-B48","first-page":"25","article-title":"Screening for alcohol and drug use disorders among adults in primary care: A review","volume":"3","author":"Pilowsky","year":"2012","journal-title":"Subst Abuse Rehabil"},{"issue":"614","key":"2020122823523332200_pnaa297-B49","doi-asserted-by":"crossref","first-page":"e620","DOI":"10.3399\/bjgp13X671605","article-title":"Access to chronic disease care in general practice: The acceptability of implementing systematic waiting-room screening using computer-based patient-reported risk status","volume":"63","author":"Paul","year":"2013","journal-title":"Br J Gen Pract"}],"container-title":["Pain Medicine"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/painmedicine\/article-pdf\/21\/12\/3645\/35206215\/pnaa297.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/painmedicine\/article-pdf\/21\/12\/3645\/35206215\/pnaa297.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,5]],"date-time":"2022-11-05T18:51:47Z","timestamp":1667674307000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/painmedicine\/article\/21\/12\/3645\/5936095"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,23]]},"references-count":49,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,10,23]]},"published-print":{"date-parts":[[2020,12,25]]}},"URL":"https:\/\/doi.org\/10.1093\/pm\/pnaa297","relation":{},"ISSN":["1526-2375","1526-4637"],"issn-type":[{"value":"1526-2375","type":"print"},{"value":"1526-4637","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,12]]},"published":{"date-parts":[[2020,10,23]]}}}