{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T12:04:11Z","timestamp":1792670651073,"version":"4.5.0"},"reference-count":34,"publisher":"American Society of Clinical Oncology (ASCO)","issue":"9","content-domain":{"domain":["ascopubs.org"],"crossmark-restriction":true},"short-container-title":["JCO Clin Cancer Inform"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:sec>\n                    <jats:title>PURPOSE<\/jats:title>\n                    <jats:p>Emoji are digital images or icons used to express an idea or emotion in electronic communication. The purpose of this study was to develop and evaluate the psychometric properties of two patient-reported scales that incorporate emoji.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>METHODS<\/jats:title>\n                    <jats:p>The Emoji Response Scale developed for this study has two parts: the Emoji-Ordinal and Emoji-Mood scales. A pilot study was designed to validate the ordinal nature of the Emoji-Ordinal Scale. Twenty patients were shown all possible pairs of five emoji and asked to select the most positive from each pair. The psychometric ordering was assessed using Coombs unfolding and Thurstone scaling. A separate pilot study was designed to determine which emoji to include in the Emoji-Mood Scale. Ten common feelings experienced by patients with cancer were chosen by the study team. Patients and providers were asked to select the one emoji that best represented each feeling from the selection. The most commonly selected emotions and representative emoji were chosen for the Emoji-Mood Scale. In a randomized study of 294 patients, Spearman correlations, Wilcoxon tests, and Bland-Altman analyses determined the construct validity of the scales compared with Linear Analog Scale Assessments (LASA) and Patient-Reported Outcomes Measurement Information System (PROMIS) scores.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>RESULTS<\/jats:title>\n                    <jats:p>\n                      Ninety-five percent of patients selected the same ordering among the ordinal emoji, and Thurstone scaling confirmed the ordinal nature of the response scale. The construct validity of the scales was high with correlations between the Emoji-Ordinal Scale and the LASA scale of 0.70 for emotional well-being, 0.72 for physical well-being, 0.74 for overall quality of life, and \u20130.81 for fatigue. Emoji-Mood Scale ratings were strongly related to PROMIS global mental, global physical, fatigue, anxiety, sleep disturbance, and social activity scales (\n                      <jats:italic>P<\/jats:italic>\n                      &lt; .0001).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSION<\/jats:title>\n                    <jats:p>This study provides evidence that scales incorporating emoji are valid for collecting patient-reported outcomes.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1200\/cci-24-00148","type":"journal-article","created":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T16:00:20Z","timestamp":1736265620000},"update-policy":"https:\/\/doi.org\/10.1200\/crossmark","source":"Crossref","is-referenced-by-count":5,"title":["Development and Validation of Emoji Response Scales for Assessing Patient-Reported Outcomes"],"prefix":"10.1200","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4518-2309","authenticated-orcid":true,"given":"Carrie A.","family":"Thompson","sequence":"first","affiliation":[{"name":"Division of Hematology, Mayo Clinic, Rochester, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul J.","family":"Novotny","sequence":"additional","affiliation":[{"name":"Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9641-5627","authenticated-orcid":true,"given":"Kathleen","family":"Yost","sequence":"additional","affiliation":[{"name":"Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alicia C.","family":"Bartz","sequence":"additional","affiliation":[{"name":"Global Business Solutions, Mayo Clinic, Rochester, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-9430-2256","authenticated-orcid":true,"given":"Lauren","family":"Rogak","sequence":"additional","affiliation":[{"name":"Department of Quantitative Health Sciences, Mayo Clinic, Scottsdale, AZ"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9912-1085","authenticated-orcid":false,"given":"Amylou C.","family":"Dueck","sequence":"additional","affiliation":[{"name":"Department of Quantitative Health Sciences, Mayo Clinic, Scottsdale, AZ"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"233","reference":[{"key":"e_1_3_8_2_2","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2018.78.8620"},{"key":"e_1_3_8_3_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoncol.2015.2639"},{"key":"e_1_3_8_4_2","doi-asserted-by":"publisher","DOI":"10.2196\/10070"},{"key":"e_1_3_8_5_2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2022.9265"},{"key":"e_1_3_8_6_2","first-page":"205520762311854","article-title":"A pilot project investigating the use of ONCOpatient\u00ae\u2014An electronic patient-reported outcomes app for oncology patients","volume":"9","author":"Macanovic B","year":"2023","unstructured":"Macanovic B, O'Reilly D, Harvey H, et al: A pilot project investigating the use of ONCOpatient\u00ae\u2014An electronic patient-reported outcomes app for oncology patients. Digit Health 9:20552076231185428, 2023","journal-title":"Digit Health"},{"key":"e_1_3_8_7_2","unstructured":"Pardes A: The WIRED guide to emoji 2018. https:\/\/www.wired.com\/story\/guide-emoji\/"},{"key":"e_1_3_8_8_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.NEP.0000476112.24899.a1"},{"key":"e_1_3_8_9_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2023.18073"},{"key":"e_1_3_8_10_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2015.01045"},{"key":"e_1_3_8_11_2","first-page":"516","article-title":"Predicting individual well-being through the language of social media","volume":"21","author":"Schwartz HA","year":"2016","unstructured":"Schwartz HA, Sap M, Kern ML, et al: Predicting individual well-being through the language of social media. Pac Symp Biocomput 21:516-527, 2016","journal-title":"Pac Symp Biocomput"},{"key":"e_1_3_8_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.foodqual.2018.03.002"},{"key":"e_1_3_8_13_2","volume-title":"Examining the Efficacy of Emoji Anchors for the O*NET Interest Profiler Short Form Prepared for U.S. Department of Labor Employment and Training Administration, Office of Workforce Investment, Division of National Programs, Tools, & Technical Assistance Washington, DC","author":"Rounds R","year":"2016","unstructured":"Rounds R, Phan WMJ, Amrhein R, et al: Examining the Efficacy of Emoji Anchors for the O*NET Interest Profiler Short Form Prepared for U.S. Department of Labor Employment and Training Administration, Office of Workforce Investment, Division of National Programs, Tools, & Technical Assistance Washington, DC. Raleigh, NC, National Center for O*NET Development, 2016"},{"key":"e_1_3_8_14_2","doi-asserted-by":"publisher","DOI":"10.2501\/JAR-2017-053"},{"key":"e_1_3_8_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-3959(01)00314-1"},{"key":"e_1_3_8_16_2","doi-asserted-by":"publisher","DOI":"10.1097\/00002508-199803000-00005"},{"key":"e_1_3_8_17_2","doi-asserted-by":"publisher","DOI":"10.1097\/00152193-200205000-00064"},{"key":"e_1_3_8_18_2","first-page":"21","article-title":"The Control Preferences Scale","volume":"29","author":"Degner LF","year":"1997","unstructured":"Degner LF, Sloan JA, Venkatesh P: The Control Preferences Scale. Can J Nurs Res 29:21-43, 1997","journal-title":"Can J Nurs Res"},{"key":"e_1_3_8_19_2","first-page":"688","article-title":"Preferred roles in treatment decision making among patients with cancer: A pooled analysis of studies using the Control Preferences Scale","volume":"16","author":"Singh JA","year":"2010","unstructured":"Singh JA, Sloan JA, Atherton PJ, et al: Preferred roles in treatment decision making among patients with cancer: A pooled analysis of studies using the Control Preferences Scale. Am J Manag Care 16:688-696, 2010","journal-title":"Am J Manag Care"},{"key":"e_1_3_8_20_2","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2001.19.6.1728"},{"key":"e_1_3_8_21_2","article-title":"Patient-reported outcomes, emoji, and activity measured on the Apple Watch in cancer patients","volume":"36","author":"Thompson CA","year":"2018","unstructured":"Thompson CA, Yost KJ, Bartz A, et al: Patient-reported outcomes, emoji, and activity measured on the Apple Watch in cancer patients. J Clin Oncol 36, 2018 (suppl 15; abstr 6501)","journal-title":"J Clin Oncol"},{"key":"e_1_3_8_22_2","unstructured":"Consortium U: Short names and keywords. https:\/\/cldr.unicode.org\/translation\/characters\/short-names-and-keywords"},{"key":"e_1_3_8_23_2","unstructured":"Consortium U: Full emoji list. https:\/\/www.unicode.org\/emoji\/charts\/full-emoji-list.html#1f610"},{"key":"e_1_3_8_24_2","unstructured":"Corsortium U: Full emoji list. Unicode.org"},{"key":"e_1_3_8_25_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12955-014-0187-z"},{"key":"e_1_3_8_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpainsymman.2007.01.016"},{"key":"e_1_3_8_27_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.mlr.0000258615.42478.55"},{"key":"e_1_3_8_28_2","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0b013e31815ceca9"},{"key":"e_1_3_8_29_2","doi-asserted-by":"publisher","DOI":"10.1177\/001316448504500312"},{"key":"e_1_3_8_30_2","doi-asserted-by":"publisher","DOI":"10.4135\/9781412986441"},{"key":"e_1_3_8_31_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0070288"},{"key":"e_1_3_8_32_2","doi-asserted-by":"publisher","DOI":"10.1006\/jmps.1998.1206"},{"key":"e_1_3_8_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12282-023-01480-3"},{"key":"e_1_3_8_34_2","volume-title":"Mobile Technology and Home Broadband 2021","author":"Perrin A","year":"2021","unstructured":"Perrin A: Mobile Technology and Home Broadband 2021. Pew Research Center, 2021. https:\/\/www.pewresearch.org\/internet\/2021\/06\/03\/mobile-technology-and-home-broadband-2021\/"},{"key":"e_1_3_8_35_2","volume-title":"About One-in-Five Americans Use a Smart Watch or Fitness Tracker","author":"Vogels EA","year":"2020","unstructured":"Vogels EA: About One-in-Five Americans Use a Smart Watch or Fitness Tracker. Pew Research Center, 2020. https:\/\/www.pewresearch.org\/short-reads\/2020\/01\/09\/about-one-in-five-americans-use-a-smart-watch-or-fitness-tracker\/"}],"container-title":["JCO Clinical Cancer Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ascopubs.org\/doi\/pdfdirect\/10.1200\/CCI-24-00148","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T16:00:26Z","timestamp":1736265626000},"score":1,"resource":{"primary":{"URL":"https:\/\/ascopubs.org\/doi\/10.1200\/CCI-24-00148"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1]]},"references-count":34,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["10.1200\/CCI-24-00148"],"URL":"https:\/\/doi.org\/10.1200\/cci-24-00148","relation":{},"ISSN":["2473-4276"],"issn-type":[{"value":"2473-4276","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1]]},"assertion":[{"value":"2024-06-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-25","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-11-13","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2400148"}}