{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T10:47:40Z","timestamp":1790938060381,"version":"4.1.0"},"reference-count":34,"publisher":"BMJ","issue":"1","license":[{"start":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T00:00:00Z","timestamp":1708041600000},"content-version":"unspecified","delay-in-days":15,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000897","name":"Cystic Fibrosis Foundation","doi-asserted-by":"publisher","award":["GODFRE20QI2"],"award-info":[{"award-number":["GODFRE20QI2"]}],"id":[{"id":"10.13039\/100000897","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open Qual"],"accepted":{"date-parts":[[2024,1,9]]},"published-print":{"date-parts":[[2024,2]]},"abstract":"<jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Surveys are a commonly used tool in quality improvement (QI) projects, but little is known about the standards to which they are designed and applied. We aimed to investigate the quality of surveys used within a QI collaborative, and to characterise the common errors made in survey design.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>Five reviewers (two research methodology and QI, three clinical and QI experts) independently assessed 20 surveys, comprising 250 survey items, that were developed in a North American cystic fibrosis lung transplant transition collaborative. Content Validity Index (CVI) scores were calculated for each survey. Reviewer consensus discussions decided an overall quality assessment for each survey and survey item (analysed using descriptive statistics) and explored the rationale for scoring (using qualitative thematic analysis).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>3\/20 surveys scored as high quality (CVI &gt;80%). 19% (n=47) of survey items were recommended by the reviewers, with 35% (n=87) requiring improvements, and 46% (n=116) not recommended. Quality assessment criteria were agreed upon. Types of common errors identified included the ethics and appropriateness of questions and survey format; usefulness of survey items to inform learning or lead to action, and methodological issues with survey questions, survey response options; and overall survey design.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Survey development is a task that requires careful consideration, time and expertise. QI teams should consider whether a survey is the most appropriate form for capturing information during the improvement process. There is a need to educate and support QI teams to adhere to good practice and avoid common errors, thereby increasing the value of surveys for evaluation and QI. The methodology, quality assessment criteria and common errors described in this paper can provide a useful resource for this purpose.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1136\/bmjoq-2023-002387","type":"journal-article","created":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T13:15:13Z","timestamp":1708089313000},"page":"e002387","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":8,"title":["Quality of locally designed surveys in a quality improvement collaborative: review of survey validity and identification of common errors"],"prefix":"10.1136","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9974-2017","authenticated-orcid":false,"given":"Julie E","family":"Reed","sequence":"first","affiliation":[{"name":"Julie Reed Consultancy Ltd, London, UK"},{"name":"Halmstad University School of Health and Welfare, Halmstad, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julie K","family":"Johnson","sequence":"additional","affiliation":[{"name":"Northwestern Quality Improvement, Research, and Education in Surgery, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Zanni","sequence":"additional","affiliation":[{"name":"Robert Wood Johnson Barnabas Health Medical Group, Monmouth Medical Center, Long Branch, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Randy","family":"Messier","sequence":"additional","affiliation":[{"name":"University of New Hampshire, Durham, New Hampshire, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fadi","family":"Asfour","sequence":"additional","affiliation":[{"name":"UTHSC, Utah, Utah, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marjorie M","family":"Godfrey","sequence":"additional","affiliation":[{"name":"University of New Hampshire, Durham, New Hampshire, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2024,2,16]]},"reference":[{"key":"2025083114220498000_13.1.e002387.1","unstructured":"Boaden R , Harvey G , Moxham C , et al . Quality improvement: theory and practice in healthcare. NHS Institute for Innovation and Improvement, 2008."},{"key":"2025083114220498000_13.1.e002387.2","unstructured":"Langley G , Moen R , Nolan K , et al . The improvement guide: a practical approach to enhancing organizational performance, 2nd edn. Jossey-Bass, 2009."},{"key":"2025083114220498000_13.1.e002387.3","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1080\/1359432X.2020.1803960","article-title":"How to design, implement and evaluate organizational interventions for maximum impact: the Sigtuna Principles","volume":"30","author":"von Thiele Schwarz","year":"2021","journal-title":"Eur J Work Organ Psychol"},{"key":"2025083114220498000_13.1.e002387.4","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2018-009048"},{"key":"2025083114220498000_13.1.e002387.5","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2013-001862"},{"key":"2025083114220498000_13.1.e002387.6","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2010.06.028"},{"key":"2025083114220498000_13.1.e002387.7","first-page":"468","article-title":"Improving the quality of quality improvement projects","volume":"36","author":"Berenholtz","year":"2010","journal-title":"Jt Comm J Qual Patient Saf"},{"key":"2025083114220498000_13.1.e002387.8","doi-asserted-by":"publisher","DOI":"10.1177\/1062860607313146"},{"key":"2025083114220498000_13.1.e002387.9","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2012-000859"},{"key":"2025083114220498000_13.1.e002387.10","doi-asserted-by":"publisher","DOI":"10.1136\/qhc.12.3.210"},{"key":"2025083114220498000_13.1.e002387.11","doi-asserted-by":"publisher","DOI":"10.5001\/omj.2014.02"},{"key":"2025083114220498000_13.1.e002387.12","doi-asserted-by":"publisher","DOI":"10.3399\/bjgp17X690617"},{"key":"2025083114220498000_13.1.e002387.13","doi-asserted-by":"publisher","DOI":"10.1007\/s40271-014-0060-5"},{"key":"2025083114220498000_13.1.e002387.14","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2013-002220"},{"key":"2025083114220498000_13.1.e002387.15","doi-asserted-by":"publisher","DOI":"10.1136\/qhc.9.4.210"},{"key":"2025083114220498000_13.1.e002387.16","unstructured":"Godfrey M . Improvement Capability at the Front Lines of Healthcare: Helping through Leading and Coaching. Jonkoping University, 2013."},{"key":"2025083114220498000_13.1.e002387.17","unstructured":"Kelly K . Measurement Made Accessible: A research approach using qualitative, quantitative & quality improvement methods. 1999."},{"key":"2025083114220498000_13.1.e002387.18","doi-asserted-by":"crossref","unstructured":"Smith PJ , Dunitz JM , Lucy A , et al . Incorporating patient and caregiver feedback into lung transplant referral guidelines for individuals with cystic fibrosis\u2014Preliminary findings from a novel paradigm. Clinical Transplantation 2020;34. doi:10.1111\/ctr.14038 Available: https:\/\/onlinelibrary.wiley.com\/toc\/13990012\/34\/10","DOI":"10.1111\/ctr.14038"},{"key":"2025083114220498000_13.1.e002387.19","doi-asserted-by":"publisher","DOI":"10.1097\/00019514-199806040-00001"},{"key":"2025083114220498000_13.1.e002387.20","doi-asserted-by":"crossref","first-page":"i23","DOI":"10.1136\/bmjqs-2014-002804","article-title":"Accelerating the rate of improvement in cystic fibrosis care: contributions and insights of the learning and leadership collaborative","volume":"23 Suppl 1","author":"Godfrey","year":"2014","journal-title":"BMJ Qual Saf"},{"key":"2025083114220498000_13.1.e002387.21","unstructured":"Nelson E , Batalden P , Godfrey M . Quality by design: a clinical microsystems approach. John Wiley & Sons, 2007."},{"key":"2025083114220498000_13.1.e002387.22","doi-asserted-by":"crossref","unstructured":"Sangoseni O , Hellman M , Hill C . Development and Validation of a Questionnaire to Assess the Effect of Online Learning on Behaviors, Attitudes, and Clinical Practices of Physical Therapists in the United States Regarding Evidenced-based Clinical Practice. IJAHSP 2013. doi:10.46743\/1540-580X\/2013.1439","DOI":"10.46743\/1540-580X\/2013.1439"},{"key":"2025083114220498000_13.1.e002387.23","doi-asserted-by":"publisher","DOI":"10.1111\/j.1369-7625.2007.00483.x"},{"key":"2025083114220498000_13.1.e002387.24","doi-asserted-by":"crossref","DOI":"10.1186\/1472-6963-11-334","article-title":"Factors affecting the use of patient survey data for quality improvement in the Veterans Health Administration","volume":"11","author":"Davies","year":"2011","journal-title":"BMC Health Serv Res"},{"key":"2025083114220498000_13.1.e002387.25","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1186\/s12913-018-3348-7","article-title":"A new typology for understanding context: qualitative exploration of the model for understanding success in quality (MUSIQ)","volume":"18","author":"Reed","year":"2018","journal-title":"BMC Health Serv Res"},{"key":"2025083114220498000_13.1.e002387.26","doi-asserted-by":"publisher","DOI":"10.1177\/1525822X10379795"},{"key":"2025083114220498000_13.1.e002387.27","doi-asserted-by":"crossref","DOI":"10.2307\/270979","article-title":"Survey Pretesting: Do Different Methods Produce Different Results?","volume":"24","author":"Presser","year":"1994","journal-title":"Soc Methodol"},{"key":"2025083114220498000_13.1.e002387.28","unstructured":"DeMaio TJ , Landreth A . Examining expert reviews as a pretest method. In: Pr\u00fcfer P , Fowler J , Jackson F , eds. ZUMA-Nachrichten Spezial Band 9, questionnaire evaluation standards. Mannheim, Germany: ZUMA, 2003: 60\u201373."},{"key":"2025083114220498000_13.1.e002387.29","doi-asserted-by":"crossref","DOI":"10.1186\/s12874-019-0886-6","article-title":"A modified Delphi study to identify the features of high quality measurement plans for healthcare improvement projects","volume":"20","author":"Woodcock","year":"2020","journal-title":"BMC Med Res Methodol"},{"key":"2025083114220498000_13.1.e002387.30","doi-asserted-by":"publisher","DOI":"10.1136\/qshc.2009.038034"},{"key":"2025083114220498000_13.1.e002387.31","doi-asserted-by":"crossref","DOI":"10.1186\/1472-6963-12-271","article-title":"Using patients\u2019 experiences to identify priorities for quality improvement in breast cancer care: patient narratives, surveys or both?","volume":"12","author":"Tsianakas","year":"2012","journal-title":"BMC Health Serv Res"},{"key":"2025083114220498000_13.1.e002387.32","doi-asserted-by":"publisher","DOI":"10.1136\/qhc.11.2.148"},{"key":"2025083114220498000_13.1.e002387.33","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2012-001081"},{"key":"2025083114220498000_13.1.e002387.34","doi-asserted-by":"publisher","DOI":"10.1093\/intqhc\/mzg031"}],"container-title":["BMJ Open Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjoq-2023-002387","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,31]],"date-time":"2025-08-31T21:22:16Z","timestamp":1756675336000},"score":1,"resource":{"primary":{"URL":"https:\/\/qir.bmj.com\/lookup\/doi\/10.1136\/bmjoq-2023-002387"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,2,16]]},"published-print":{"date-parts":[[2024,2]]}},"alternative-id":["10.1136\/bmjoq-2023-002387"],"URL":"https:\/\/doi.org\/10.1136\/bmjoq-2023-002387","relation":{},"ISSN":["2399-6641"],"issn-type":[{"value":"2399-6641","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2]]}}}