{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T23:08:04Z","timestamp":1740179284189,"version":"3.37.3"},"reference-count":10,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T00:00:00Z","timestamp":1710201600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T00:00:00Z","timestamp":1710201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100011542","name":"Center for Clinical and Translational Science, Mayo Clinic","doi-asserted-by":"publisher","award":["UL1 TR002377"],"award-info":[{"award-number":["UL1 TR002377"]}],"id":[{"id":"10.13039\/100011542","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Patient Rep Outcomes"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>The Upper Digestive Disease (UDD) Tool\u2122 is used to monitor symptom frequency, intensity, and interference across nine symptom domains and includes two Patient-Reported Outcome Measurement Information System (PROMIS) domains assessing physical and mental health. This study aimed to establish cut scores for updated symptom domains through standard setting exercises and evaluate the effectiveness and acceptability of virtual standard setting.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>The extended Angoff method was employed to determine cut scores. Subject matter experts refined performance descriptions for symptom control categories and achieved consensus. Domains were categorized into good, moderate, and poor symptom control. Two cut scores were established, differentiating good vs. moderate and moderate vs. poor. Panelists estimated average scores for 100 borderline patients per item. Cut scores were computed based on the sum of the average ratings for individual questions, converted to 0-100 scale.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Performance descriptions were refined. Panelists discussed that interpretation of the scores should take into account the timing of symptoms after surgery and patient populations, and the importance of items asking symptom frequency, severity, and interference with daily life. The good\/moderate cut scores ranged from 21.3 to 35.0 (mean 28.6, SD 3.6) across domains, and moderate\/poor ranged from 47.5 to 71.3 (mean 54.5, SD 7.0).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Panelists were confident in the virtual standard setting process, expecting valid cut scores. Future studies can further validate the cut scores using patient perspectives and collect patient and physician preferences for displaying contextual items on patient- and physician-facing dashboard.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s41687-024-00707-x","type":"journal-article","created":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T19:02:53Z","timestamp":1710270173000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["PRO-Angoff method for remote standard setting: establishing clinical thresholds for the upper digestive disease tool"],"prefix":"10.1186","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1301-4319","authenticated-orcid":false,"given":"Minji K.","family":"Lee","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohamad K","family":"Abou Chaar","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shanda H","family":"Blackmon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kathleen J","family":"Yost","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,3,12]]},"reference":[{"issue":"6","key":"707_CR1","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1200\/JCO.2015.63.0830","volume":"34","author":"E Basch","year":"2016","unstructured":"Basch E et al (2016) Symptom Monitoring with patient-reported outcomes during Routine Cancer treatment: a Randomized Controlled Trial. J Clin Oncology: Official J Am Soc Clin Oncol 34(6):557\u2013565","journal-title":"J Clin Oncology: Official J Am Soc Clin Oncol"},{"issue":"1","key":"707_CR2","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1186\/s12955-018-1023-7","volume":"16","author":"MK Lee","year":"2018","unstructured":"Lee MK et al (2018) Patient-reported outcome domains for the esophageal CONDUIT report card: a prospective trial to establish domains. Health Qual Life Outcomes 16(1):197","journal-title":"Health Qual Life Outcomes"},{"issue":"1","key":"707_CR3","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1186\/s41687-018-0073-2","volume":"2","author":"MK Lee","year":"2018","unstructured":"Lee MK et al (2018) Standard setting for a novel esophageal conduit questionnaire: CONDUIT Report Card. J Patient Rep Outcomes 2(1):51","journal-title":"J Patient Rep Outcomes"},{"issue":"4","key":"707_CR4","doi-asserted-by":"publisher","first-page":"2240","DOI":"10.21037\/jtd-22-1343","volume":"15","author":"MKA Chaar","year":"2023","unstructured":"Chaar MKA et al (2023) Developing & integrating a mobile application tool into a survivorship clinic for esophageal cancer patients. J Thorac Dis 15(4):2240\u20132252","journal-title":"J Thorac Dis"},{"issue":"4","key":"707_CR5","doi-asserted-by":"publisher","first-page":"1142","DOI":"10.1016\/j.athoracsur.2022.02.054","volume":"114","author":"LL Chlan","year":"2022","unstructured":"Chlan LL et al (2022) Upper Digestive Disease App for Electronic patient-reported outcomes: a mixed methods pilot study. Ann Thorac Surg 114(4):1142\u20131151","journal-title":"Ann Thorac Surg"},{"key":"707_CR6","unstructured":"Angoff WH (1971) Scales, norms and equivalent scores, in Educational Measurement, R.L. Thorndike, Editor. American Council on Education: Washington, DC"},{"issue":"1","key":"707_CR7","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1207\/s15324818ame0801_4","volume":"8","author":"RK Hambleton","year":"1995","unstructured":"Hambleton RK, Plake BS (1995) Using an extended Angoff procedure to set standards on complex performance assessments. Appl Measur Educ 8(1):41\u201355","journal-title":"Appl Measur Educ"},{"issue":"1","key":"707_CR8","first-page":"53","volume":"52","author":"KL Ricker","year":"2006","unstructured":"Ricker KL (2006) Setting cut-scores: a critical review of the Angoff and modified Angoff methods. Alta J Educational Res 52(1):53\u201364","journal-title":"Alta J Educational Res"},{"issue":"8","key":"707_CR9","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1038\/s41574-020-0357-5","volume":"16","author":"E Scarpellini","year":"2020","unstructured":"Scarpellini E et al (2020) International consensus on the diagnosis and management of dumping syndrome. Nat Rev Endocrinol 16(8):448\u2013466","journal-title":"Nat Rev Endocrinol"},{"issue":"2","key":"707_CR10","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1016\/j.athoracsur.2022.06.060","volume":"116","author":"MD Traynor","year":"2023","unstructured":"Traynor MD et al (2023) Agreement between Upper Digestive Disease app and provider evaluation of esophagectomy symptoms in a Mobile App Tool. Ann Thorac Surg 116(2):255\u2013261","journal-title":"Ann Thorac Surg"}],"container-title":["Journal of Patient-Reported Outcomes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41687-024-00707-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s41687-024-00707-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41687-024-00707-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T19:02:58Z","timestamp":1710270178000},"score":1,"resource":{"primary":{"URL":"https:\/\/jpro.springeropen.com\/articles\/10.1186\/s41687-024-00707-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,12]]},"references-count":10,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["707"],"URL":"https:\/\/doi.org\/10.1186\/s41687-024-00707-x","relation":{},"ISSN":["2509-8020"],"issn-type":[{"type":"electronic","value":"2509-8020"}],"subject":[],"published":{"date-parts":[[2024,3,12]]},"assertion":[{"value":"23 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"We obtained verbal consent from the subject matter experts to participate in the study. This study was determined to be exempt from the requirement for IRB approval by the institutional IRB (ID: 22\u2013000230).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"We obtained the verbal consent from the subject matter experts to use the data for publication.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Blackmon reports the following competing interests: Speaker for Astra Zeneca and Medtronic, esophageal anastomotic device and minimally invasive equipment US patents, Steris funded clinical trial for mesothelioma, Medtronic funded clinical trial for ablation of lung tumors, and Natera IIT funded clinical trials for esophageal cancer. Other authors report no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"30"}}