{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T18:48:08Z","timestamp":1791830888558,"version":"4.3.4"},"reference-count":36,"publisher":"Wiley","issue":"7","license":[{"start":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T00:00:00Z","timestamp":1791763200000},"content-version":"vor","delay-in-days":11,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T00:00:00Z","timestamp":1790812800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Evaluation Clinical Practice"],"published-print":{"date-parts":[[2026,10]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Satisfaction data is a commonly used construct to evaluate programs, products, and experiences. This data is collected through forced choice (scales, surveys) and\/or open\u2010ended measures. While open\u2010ended questions have the greatest potential for more useful and candid feedback, analysis of this data can be time\u2010consuming.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This paper compares two evaluation methods, traditional qualitative analysis (TQA) and Natural Language Processing (NLP), to analyze themes from open\u2010ended satisfaction data of a caregiver\u2010mediated intervention for families of autistic children, called \u2018Mind the Gap (MTG)\u2019.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This secondary analysis utilized existing survey data from 73 caregivers that participated in the MTG trial. To identify themes, TQA was performed using latent coding, and R statistical software was used for NLP, with strategies including term frequency and sentiment analysis. Methods were evaluated independently and in combination.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results and Conclusion<\/jats:title>\n                    <jats:p>\n                      Both methods are comparable in thoroughly analysing this type of data, with each method contributing both unique and overlapping themes. TQA and NLP showed parent satisfaction with materials and organization, as well as peer coach support. NLP may provide more thorough results while also reducing the time burden associated with TQA, although this strategy may also overlook important nuance in data. This clinical trial is registered as \u2018Mind the Gap (AIRB\u20103) (MTG)\u2019 at\n                      <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"http:\/\/clinicaltrials.gov\">clinicaltrials.gov<\/jats:ext-link>\n                      , registration number NCT03711799.\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1111\/jep.70667","type":"journal-article","created":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T18:28:20Z","timestamp":1791829700000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Comparison of Natural Language Processing and Traditional Qualitative Analyses of Caregiver Feedback From a Community\u2010Based Intervention for Children With Autism"],"prefix":"10.1111","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-8866-1346","authenticated-orcid":false,"given":"Carmen","family":"Caruthers","sequence":"first","affiliation":[{"name":"University of Rochester Medical Center Rochester New York USA"},{"name":"University of North Carolina Chapel Hill North Carolina USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samantha","family":"Hochheimer","sequence":"additional","affiliation":[{"name":"University of Rochester Medical Center Rochester New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1924-0269","authenticated-orcid":false,"given":"Melanie","family":"Pellecchia","sequence":"additional","affiliation":[{"name":"University of Pennsylvania Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9537-8601","authenticated-orcid":false,"given":"Amanda","family":"Gulsrud","sequence":"additional","affiliation":[{"name":"University of California Los Angeles Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0520-2598","authenticated-orcid":false,"given":"Elizabeth McGhee","family":"Hassrick","sequence":"additional","affiliation":[{"name":"Drexel University Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8240-820X","authenticated-orcid":false,"given":"David","family":"Mandell","sequence":"additional","affiliation":[{"name":"University of Pennsylvania Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1596-9848","authenticated-orcid":false,"given":"Aubyn","family":"Stahmer","sequence":"additional","affiliation":[{"name":"University of California Davis Sacramento California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2266-170X","authenticated-orcid":false,"given":"Connie","family":"Kasari","sequence":"additional","affiliation":[{"name":"University of California Los Angeles Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6828-8379","authenticated-orcid":false,"given":"Suzannah","family":"Iadarola","sequence":"additional","affiliation":[{"name":"University of Rochester Medical Center Rochester New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,10,12]]},"reference":[{"key":"e_1_2_12_2_1","doi-asserted-by":"publisher","DOI":"10.2147\/PPA.S320242"},{"key":"e_1_2_12_3_1","doi-asserted-by":"publisher","DOI":"10.1097\/nnr.0b013e3181dbb2e2"},{"key":"e_1_2_12_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40615-019-00575-y"},{"key":"e_1_2_12_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2024.116109"},{"key":"e_1_2_12_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bpsc.2019.11.015"},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2850.2008.01371.x"},{"key":"e_1_2_12_8_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0026242"},{"key":"e_1_2_12_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/1054773811431883"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/1049731514564990"},{"key":"e_1_2_12_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0277-9536(96)00140-2"},{"key":"e_1_2_12_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijnsa.2024.100174"},{"key":"e_1_2_12_13_1","doi-asserted-by":"publisher","DOI":"10.9790\/0837-194399104"},{"key":"e_1_2_12_14_1","volume-title":"Practical Natural Language Processing: A Comprehensive Guide to Building Real\u2010World NLP Systems","author":"Sowmya V. B.","year":"2020"},{"key":"e_1_2_12_15_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocy173"},{"key":"e_1_2_12_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bpsc.2021.02.001"},{"key":"e_1_2_12_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2020.10.043"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2018.18932"},{"key":"e_1_2_12_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10803-019-04242-3"},{"issue":"4","key":"e_1_2_12_20_1","first-page":"204","article-title":"Sentiment Analysis on Autism Spectrum Disorder Using Twitter Data","volume":"7","author":"Lakshmi Praveena T.","year":"2018","journal-title":"International Journal of Recent Technology and Engineering"},{"key":"e_1_2_12_21_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0229985"},{"issue":"5","key":"e_1_2_12_22_1","first-page":"395","article-title":"A Sentiment Analysis of Risperidone Use in the Autism Spectrum Disorder Treatment","volume":"28","author":"Gil\u2010Vera V. D.","year":"2020","journal-title":"Middle\u2010East Journal of Scientific Research"},{"key":"e_1_2_12_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pedn.2025.05.020"},{"key":"e_1_2_12_24_1","doi-asserted-by":"publisher","DOI":"10.1177\/1362361321990931"},{"key":"e_1_2_12_25_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40814-020-00662-6"},{"key":"e_1_2_12_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/15374410903532585"},{"key":"e_1_2_12_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10826-018-1144-y"},{"key":"e_1_2_12_28_1","unstructured":"Autism Intervention Research Network on Behavioral Health (AIR\u2010B). (2022). Mission. Updated 2022. Accessed December 12 2022 https:\/\/www.airbnetwork.org\/mission."},{"key":"e_1_2_12_29_1","unstructured":"QSR International Pty Ltd. (2020). NVivo (released in March 2020) https:\/\/www.qsrinternational.com\/nvivo-qualitative-data-analysis-software\/home."},{"key":"e_1_2_12_30_1","volume-title":"R: A Language and Environment for Statistical Computing","author":"R Core Team","year":"2020"},{"key":"e_1_2_12_31_1","volume-title":"Qualitative Research From Start to Finish","author":"Yin R. K.","year":"2016"},{"key":"e_1_2_12_32_1","unstructured":"F. A.Nielsen \u201cA New ANEW:Evaluation of a Word List for Sentiment Analysis in Microblogs \u201d inPresentation presented at: ESWC2\u201011 Workshop on Making Sense of Microposts: Big Things Come in Small Packagaes May 30 2011 Heraklion Greece https:\/\/doi.org\/10.48550\/arXiv.1103.2903."},{"key":"e_1_2_12_33_1","unstructured":"M.HuandB.Liu 2004.Opinion Mining Sentiment Analysis and Opinion Spam Detection(May 2004) https:\/\/www.cs.uic.edu\/~liub\/FBS\/sentiment-analysis.html."},{"key":"e_1_2_12_34_1","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-019-03228-6"},{"key":"e_1_2_12_35_1","doi-asserted-by":"crossref","unstructured":"J.Dastin \u201cAmazon Scraps Secret AI Recruiting Tool that Showed Bias Against Women \u201d Reuters Oct 10 2018. [Online]. Accessed by December 12 2022 https:\/\/www.reuters.com\/article\/us-amazon-com-jobs-authomation-insight\/amazon-scraps-secret-ai-recruiting-tool-that-showed-bias-against-women-idUSKCN1MK08G\/.","DOI":"10.1201\/9781003278290-44"},{"key":"e_1_2_12_36_1","doi-asserted-by":"crossref","unstructured":"S.Corbett\u2010Davies E.Pierson A.Feller S.Goel andA.Huq \u201cAlgorithmic Decision Making and the Cost of Fairness \u201d inProceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '17)(Association for Computing Machinery 2017) 797\u2013806.","DOI":"10.1145\/3097983.3098095"},{"key":"e_1_2_12_37_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139084789"}],"container-title":["Journal of Evaluation in Clinical Practice"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/jep.70667","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/jep.70667","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/jep.70667","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T18:28:23Z","timestamp":1791829703000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/jep.70667"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10]]},"references-count":36,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,10]]}},"alternative-id":["10.1111\/jep.70667"],"URL":"https:\/\/doi.org\/10.1111\/jep.70667","archive":["Portico"],"relation":{},"ISSN":["1356-1294","1365-2753"],"issn-type":[{"value":"1356-1294","type":"print"},{"value":"1365-2753","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10]]},"assertion":[{"value":"2026-03-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-30","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-10-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70667"}}