{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,19]],"date-time":"2026-09-19T15:47:38Z","timestamp":1789832858579,"version":"4.0.1"},"reference-count":37,"publisher":"American Medical Association (AMA)","issue":"10","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Netw Open"],"abstract":"Importance<\/jats:title>Potentially inappropriate medications (PIMs) and potential prescribing omissions (PPOs) are used in research to reflect the quality of drug treatment in older people and have been suggested for inclusion in core outcome sets for evaluation of interventions for improved prescribing. Their validation so far, however, is primarily restricted to expert opinion\u2013based processes.<\/jats:p><\/jats:sec>Objective<\/jats:title>To evaluate the performance of 3 explicit PIM\/PPO criteria sets as diagnostic tools to identify inadequate drug treatment in older patients.<\/jats:p><\/jats:sec>Design, Setting, and Participants<\/jats:title>This diagnostic study analyzed patients aged 65 years or older consecutively included from 2 primary health care centers from October to November 2017. Data were analyzed from February to August 2022.<\/jats:p><\/jats:sec>Exposures<\/jats:title>The PIMs\/PPOs were concordantly identified by 2 specialist physicians (2018-2019) retrospectively after a planned physician visit, using 3 European PIM\/PPO criteria sets and without knowledge of this diagnostic study.<\/jats:p><\/jats:sec>Main Outcomes and Measures<\/jats:title>Area under the receiver operating characteristic (ROC) curve, reflecting the ability of PIM\/PPO criteria sets to identify the reference standard of inadequate drug treatment, determined by 2 specialist physicians in consensus. Inadequate drug treatment implied that additional action related to the medication could be medically justified before the next regular visit.<\/jats:p><\/jats:sec>Results<\/jats:title>A total of 302 patients were analyzed (median age, 74 [IQR, 69-81] years; 178 women [59%]; median number of drugs in the medication list, 6 [IQR, 3-9]); 98 patients (32%) had inadequate drug treatment. A total of 0 to 8 PIMs\/PPOs per patient were identified using the Screening Tool of Older Persons\u2019 Prescriptions (STOPP)\/Screening Tool to Alert to Right Treatment (START) criteria, 0 to 6 with the European EU(7)-PIM list, and 0 to 12 with the Swedish set of indicators of prescribing quality. The areas under the ROC curve for the 3 sets to identify the reference standard for inadequate drug treatment were 0.60 (95% CI, 0.53-0.66) for the STOPP\/START criteria, 0.69 (95% CI, 0.63-0.75) for the EU(7)-PIM list, and 0.73 (95% CI, 0.67-0.80) for the Swedish set. For comparison, the area under the ROC curve was 0.71 (95% CI, 0.65-0.78) using the number of drugs in the medication list.<\/jats:p><\/jats:sec>Conclusions and Relevance<\/jats:title>In this diagnostic study, the evaluated PIM\/PPO sets had poor to fair performance as diagnostic tools to identify inadequate drug treatment, comparable with a simple count of the number of drugs in the medication list. These findings suggest that use of PIMs\/PPOs as indicators of drug treatment quality in core outcome sets for the evaluation of interventions for improved prescribing may need reconsideration.<\/jats:p><\/jats:sec>","DOI":"10.1001\/jamanetworkopen.2022.36757","type":"journal-article","created":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T15:03:00Z","timestamp":1666278180000},"page":"e2236757","source":"Crossref","is-referenced-by-count":13,"title":["Performance of 3 Sets of Criteria for Potentially Inappropriate Prescribing in Older People to Identify Inadequate Drug Treatment"],"prefix":"10.1001","volume":"5","author":[{"given":"Susanna M.","family":"Wallerstedt","sequence":"first","affiliation":[{"name":"Department of Pharmacology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden"},{"name":"HTA-Centrum, Sahlgrenska University Hospital, Gothenburg, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Staffan A.","family":"Svensson","sequence":"additional","affiliation":[{"name":"Department of Pharmacology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden"},{"name":"N\u00e4rh\u00e4lsan Hj\u00e4llbo Health Center, Gothenburg, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johan","family":"L\u00f6nnbro","sequence":"additional","affiliation":[{"name":"Department of Pharmacology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden"},{"name":"Department of Internal Medicine, Sahlgrenska University Hospital, Gothenburg, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fredrik","family":"Hieronymus","sequence":"additional","affiliation":[{"name":"Department of Pharmacology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johan","family":"Fastbom","sequence":"additional","affiliation":[{"name":"Aging Research Center, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet and Stockholm University, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mikael","family":"Hoffmann","sequence":"additional","affiliation":[{"name":"NEPI Foundation\u2013Swedish Network for Pharmacoepidemiology, Link\u00f6ping University, Link\u00f6ping, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Naldy","family":"Parodi L\u00f3pez","sequence":"additional","affiliation":[{"name":"Department of Pharmacology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden"},{"name":"N\u00e4rh\u00e4lsan Kungsh\u00f6jd Health Center, Gothenburg, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","published-online":{"date-parts":[[2022,10,20]]},"reference":[{"issue":"9","key":"zoi221045r1","doi-asserted-by":"publisher","first-page":"1825","DOI":"10.1001\/archinte.1991.00400090107019","article-title":"Explicit criteria for determining inappropriate medication use in nursing home residents.","volume":"151","author":"Beers","year":"1991","journal-title":"Arch Intern Med"},{"issue":"14","key":"zoi221045r2","doi-asserted-by":"publisher","first-page":"1531","DOI":"10.1001\/archinte.1997.00440350031003","article-title":"Explicit criteria for determining potentially inappropriate medication use by the elderly: an update.","volume":"157","author":"Beers","year":"1997","journal-title":"Arch Intern Med"},{"issue":"11","key":"zoi221045r3","doi-asserted-by":"publisher","first-page":"831","DOI":"10.1007\/s00228-004-0845-x","article-title":"Indicators of prescribing quality in drug utilisation research: report of a European meeting (DURQUIM, 13-15 May 2004).","volume":"60","author":"Hoven","year":"2005","journal-title":"Eur J Clin Pharmacol"},{"issue":"4","key":"zoi221045r4","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1007\/s00228-018-02612-x","article-title":"Identifying potentially inappropriate prescribing in older people with dementia: a systematic review.","volume":"75","author":"Hukins","year":"2019","journal-title":"Eur J Clin Pharmacol"},{"issue":"12","key":"zoi221045r5","doi-asserted-by":"publisher","first-page":"1415","DOI":"10.1007\/s00228-015-1954-4","article-title":"Potentially inappropriate prescribing in community-dwelling older people across Europe: a systematic literature review.","volume":"71","author":"Tommelein","year":"2015","journal-title":"Eur J Clin Pharmacol"},{"issue":"9","key":"zoi221045r6","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD008165.pub4","article-title":"Interventions to improve the appropriate use of polypharmacy for older people.","volume":"9","author":"Rankin","year":"2018","journal-title":"Cochrane Database Syst Rev"},{"issue":"1","key":"zoi221045r7","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/s12916-018-1007-9","article-title":"International core outcome set for clinical trials of medication review in multi-morbid older patients with polypharmacy.","volume":"16","author":"Beuscart","year":"2018","journal-title":"BMC Med"},{"issue":"1","key":"zoi221045r8","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1186\/s13063-017-1915-6","article-title":"Development of a core outcome set for effectiveness trials aimed at optimising prescribing in older adults in care homes.","volume":"18","author":"Millar","year":"2017","journal-title":"Trials"},{"issue":"6","key":"zoi221045r9","doi-asserted-by":"publisher","first-page":"1206","DOI":"10.1111\/jgs.15245","article-title":"Core outcome set for trials aimed at improving the appropriateness of polypharmacy in older people in primary care.","volume":"66","author":"Rankin","year":"2018","journal-title":"J Am Geriatr Soc"},{"issue":"2","key":"zoi221045r10","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1093\/ageing\/afu145","article-title":"STOPP\/START criteria for potentially inappropriate prescribing in older people: version 2.","volume":"44","author":"O\u2019Mahony","year":"2015","journal-title":"Age Ageing"},{"issue":"7","key":"zoi221045r11","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1007\/s00228-015-1860-9","article-title":"The EU(7)-PIM list: a list of potentially inappropriate medications for older people consented by experts from seven European countries.","volume":"71","author":"Renom-Guiteras","year":"2015","journal-title":"Eur J Clin Pharmacol"},{"issue":"3","key":"zoi221045r12","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1007\/s40266-015-0242-4","article-title":"National indicators for quality of drug therapy in older persons: the Swedish experience from the first 10 years.","volume":"32","author":"Fastbom","year":"2015","journal-title":"Drugs Aging"},{"issue":"4","key":"zoi221045r13","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1111\/jgs.2019.67.issue-4","article-title":"American Geriatrics Society 2019 Updated AGS Beers criteria for potentially inappropriate medication use in older adults.","volume":"67","author":"By the 2019 American Geriatrics Society Beers Criteria Update Expert Panel","year":"2019","journal-title":"J Am Geriatr Soc"},{"issue":"31-32","key":"zoi221045r14","first-page":"543","article-title":"Potentially inappropriate medications in the elderly: the PRISCUS list.","volume":"107","author":"Holt","year":"2010","journal-title":"Dtsch Arztebl Int"},{"issue":"8","key":"zoi221045r15","doi-asserted-by":"publisher","first-page":"725","DOI":"10.1007\/s00228-007-0324-2","article-title":"Potentially inappropriate medications in the elderly: a French consensus panel list.","volume":"63","author":"Laroche","year":"2007","journal-title":"Eur J Clin Pharmacol"},{"issue":"8","key":"zoi221045r16","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.1007\/s00228-022-03337-8","article-title":"Clinical relevance of potentially inappropriate medications and potential prescribing omissions according to explicit criteria-a validation study.","volume":"78","author":"Parodi L\u00f3pez","year":"2022","journal-title":"Eur J Clin Pharmacol"},{"issue":"4","key":"zoi221045r17","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1007\/s00228-016-2188-9","article-title":"Clinical relevance of the STOPP\/START criteria in hip fracture patients.","volume":"73","author":"L\u00f6nnbro","year":"2017","journal-title":"Eur J Clin Pharmacol"},{"issue":"5","key":"zoi221045r18","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1007\/s00228-019-02634-z","article-title":"A systematic review and novel classification of listing tools to improve medication in older people.","volume":"75","author":"Pazan","year":"2019","journal-title":"Eur J Clin Pharmacol"},{"key":"zoi221045r19","doi-asserted-by":"publisher","first-page":"g3725","DOI":"10.1136\/bmj.g3725","article-title":"Evidence based medicine: a movement in crisis?","volume":"348","author":"Greenhalgh","year":"2014","journal-title":"BMJ"},{"issue":"7","key":"zoi221045r20","doi-asserted-by":"publisher","first-page":"1118","DOI":"10.1373\/clinchem.2004.031823","article-title":"ROC curves in clinical chemistry: uses, misuses, and possible solutions.","volume":"50","author":"Obuchowski","year":"2004","journal-title":"Clin Chem"},{"issue":"9","key":"zoi221045r21","doi-asserted-by":"publisher","first-page":"1315","DOI":"10.1097\/JTO.0b013e3181ec173d","article-title":"Receiver operating characteristic curve in diagnostic test assessment.","volume":"5","author":"Mandrekar","year":"2010","journal-title":"J Thorac Oncol"},{"issue":"1","key":"zoi221045r22","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1007\/s40266-021-00904-z","article-title":"Frequency and acceptance of clinical decision support system\u2013generated STOPP\/START signals for hospitalised older patients with polypharmacy and multimorbidity.","volume":"39","author":"Sallevelt","year":"2022","journal-title":"Drugs Aging"},{"issue":"2","key":"zoi221045r23","first-page":"627","article-title":"Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation.","volume":"4","author":"Hajian-Tilaki","year":"2013","journal-title":"Caspian J Intern Med"},{"issue":"4","key":"zoi221045r24","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1080\/02813432.2021.1973239","article-title":"Association between recorded medication reviews in primary care and adequate drug treatment management\u2014a cross-sectional study.","volume":"39","author":"Parodi L\u00f3pez","year":"2021","journal-title":"Scand J Prim Health Care"},{"issue":"8","key":"zoi221045r26","doi-asserted-by":"publisher","first-page":"1757","DOI":"10.1111\/bcp.v84.8","article-title":"Hospital readmissions, mortality and potentially inappropriate prescribing: a retrospective study of older adults discharged from hospital.","volume":"84","author":"Counter","year":"2018","journal-title":"Br J Clin Pharmacol"},{"issue":"3","key":"zoi221045r27","doi-asserted-by":"publisher","first-page":"297","DOI":"10.11613\/issn.1846-7482","article-title":"On determining the most appropriate test cut-off value: the case of tests with continuous results.","volume":"26","author":"Habibzadeh","year":"2016","journal-title":"Biochem Med (Zagreb)"},{"issue":"10","key":"zoi221045r28","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD008165.pub3","article-title":"Interventions to improve the appropriate use of polypharmacy for older people.","volume":"10","author":"Patterson","year":"2014","journal-title":"Cochrane Database Syst Rev"},{"issue":"1","key":"zoi221045r29","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1007\/s12561-016-9159-7","article-title":"ROC curve analysis in the presence of imperfect reference standards.","volume":"9","author":"Liao","year":"2017","journal-title":"Stat Biosci"},{"issue":"1","key":"zoi221045r30","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1186\/s12877-017-0621-2","article-title":"What is polypharmacy? a systematic review of definitions.","volume":"17","author":"Masnoon","year":"2017","journal-title":"BMC Geriatr"},{"issue":"4","key":"zoi221045r31","doi-asserted-by":"publisher","first-page":"605","DOI":"10.1093\/ageing\/afaa072","article-title":"Prevention of adverse drug reactions in hospitalized older patients with multi-morbidity and polypharmacy: the SENATOR* randomized controlled clinical trial.","volume":"49","author":"O\u2019Mahony","year":"2020","journal-title":"Age Ageing"},{"issue":"9","key":"zoi221045r32","doi-asserted-by":"publisher","first-page":"906","DOI":"10.1002\/pds.v24.9","article-title":"Association between drug-specific indicators of prescribing quality and quality of drug treatment: a validation study.","volume":"24","author":"Wallerstedt","year":"2015","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"2","key":"zoi221045r33","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1093\/fampra\/cms060","article-title":"Comparing measures of multimorbidity to predict outcomes in primary care: a cross sectional study.","volume":"30","author":"Brilleman","year":"2013","journal-title":"Fam Pract"},{"issue":"2","key":"zoi221045r34","doi-asserted-by":"publisher","first-page":"72","DOI":"10.5414\/CPP46072","article-title":"STOPP (Screening Tool of Older Person\u2019s Prescriptions) and START (Screening Tool to Alert doctors to Right Treatment): consensus validation.","volume":"46","author":"Gallagher","year":"2008","journal-title":"Int J Clin Pharmacol Ther"},{"key":"zoi221045r35","doi-asserted-by":"publisher","DOI":"10.1111\/bcp.15530","article-title":"Revisiting the inter-rater reliability of drug treatment assessments according to the STOPP\/START criteria.","author":"Parodi L\u00f3pez","journal-title":"Br J Clin Pharmacol"},{"issue":"5","key":"zoi221045r36","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1093\/ageing\/afp058","article-title":"Inter-rater reliability of STOPP (Screening Tool of Older Persons\u2019 Prescriptions) and START (Screening Tool to Alert Doctors to Right Treatment) criteria amongst physicians in six European countries.","volume":"38","author":"Gallagher","year":"2009","journal-title":"Age Ageing"},{"issue":"7","key":"zoi221045r37","doi-asserted-by":"publisher","first-page":"1239","DOI":"10.1345\/aph.1M157","article-title":"Application of STOPP and START criteria: interrater reliability among pharmacists.","volume":"43","author":"Ryan","year":"2009","journal-title":"Ann Pharmacother"},{"key":"zoi221045r25","year":"2017"}],"container-title":["JAMA Network Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/articlepdf\/2797503\/wallerstedt_2022_oi_221045_1665581916.18685.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T15:03:04Z","timestamp":1666278184000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2797503"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,20]]},"references-count":37,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2022,10,3]]}},"URL":"https:\/\/doi.org\/10.1001\/jamanetworkopen.2022.36757","relation":{},"ISSN":["2574-3805"],"issn-type":[{"value":"2574-3805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,20]]}}}