{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T22:51:35Z","timestamp":1792536695676,"version":"4.5.0"},"reference-count":33,"publisher":"BMJ","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Epidemiol Community Health"],"published-print":{"date-parts":[[1999,2]]},"abstract":"<jats:p>OBJECTIVE: To develop a short instrument, called DISCERN, which will enable patients and information providers to judge the quality of written information about treatment choices. DISCERN will also facilitate the production of new, high quality, evidence-based consumer health information. DESIGN: An expert panel, representing a range of expertise in consumer health information, generated criteria from a random sample of information for three medical conditions with varying degrees of evidence: myocardial infarction, endometriosis, and chronic fatigue syndrome. A graft instrument, based on this analysis, was tested by the panel on a random sample of new material for the same three conditions. The panel re-drafted the instrument to take account of the results of the test. The DISCERN instrument was finally tested by a national sample of 15 information providers and 13 self help group members on a random sample of leaflets from 19 major national self help organisations. Participants also completed an 8 item questionnaire concerning the face and content validity of the instrument. RESULTS: Chance corrected agreement (weighted kappa) for the overall quality rating was kappa = 0.53 (95% CI kappa = 0.48 to kappa = 0.59) among the expert panel, kappa = 0.40 (95% CI kappa = 0.36 to kappa = 0.43) among information providers, and kappa = 0.23 (95% CI kappa = 0.19 to kappa = 0.27) among self help group members. Higher agreement levels were associated with experience of using the instrument and with professional knowledge of consumer health information. Levels of agreement varied across individual items on the instrument, reflecting the need for subjectivity in rating certain criteria. The trends in levels of agreement were similar among all groups. The final instrument consisted of 15 questions plus an overall quality rating. Responses to the questionnaire after the final testing revealed the instrument to have good face and content validity and to be generally applicable. CONCLUSIONS: DISCERN is a reliable and valid instrument for judging the quality of written consumer health information. While some subjectivity is required for rating certain criteria, the findings demonstrate that the instrument can be applied by experienced users and providers of health information to discriminate between publications of high and low quality. The instrument will also be of benefit to patients, though its use will be improved by training.<\/jats:p>","DOI":"10.1136\/jech.53.2.105","type":"journal-article","created":{"date-parts":[[2009,1,5]],"date-time":"2009-01-05T14:15:53Z","timestamp":1231164953000},"page":"105-111","source":"Crossref","is-referenced-by-count":3016,"title":["DISCERN: an instrument for judging the quality of written consumer health information on treatment choices."],"prefix":"10.1136","volume":"53","author":[{"given":"D","family":"Charnock","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S","family":"Shepperd","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"G","family":"Needham","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"R","family":"Gann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[1999,2,1]]},"reference":[{"key":"ref_1","article-title":"Based on the answers to all of the above questions, rate the overall quality of the publication as a source of information about treatment choices: Low Serious or extensive shortcomings Moderate Potentially important but not serious shortcomings High Minimal shortcomings Copyright British Library and the","year":"1997","unstructured":"Based on the answers to all of the above questions, rate the overall quality of the publication as a source of information about treatment choices: Low Serious or extensive shortcomings Moderate Potentially important but not serious shortcomings High Minimal shortcomings Copyright British Library and the University of Oxford 1997"},{"key":"ref_2","article-title":"White Paper. The National Health Service. A service with ambitions","author":"Department of Health NHS","year":"1996","unstructured":"Department of Health NHS White Paper. The National Health Service. A service with ambitions. London: HMSO, 1996. (Cm 3425)."},{"key":"ref_3","article-title":"Executive: Patient partnership: building a collaborative strategy","author":"NHS","year":"1996","unstructured":"NHS Executive: Patient partnership: building a collaborative strategy. Leeds: Department of Health, 1996."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1136\/bmj.311.6996.4","article-title":"New directions in information for patients","volume":"311","author":"Meredith, P.; Emberton, M.; Wood, C.","year":"1995","unstructured":"Meredith P, Emberton M, Wood C. New directions in information for patients. BMJ 1995;311:4\u20135.","journal-title":"BMJ"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"958","DOI":"10.1136\/bmj.312.7036.958","article-title":"Patients\u2019 prerogatives and perceptions of benefit","volume":"312","author":"Kee, F.","year":"1996","unstructured":"Kee F. Patients\u2019 prerogatives and perceptions of benefit. BMJ 1996;312:958\u201360.","journal-title":"BMJ"},{"key":"ref_6","article-title":"OVering choice of treatment to patients with cancers. A review based on a symposium held at","volume-title":"the 10th Annual Conference of The British Psychosocial Oncology Group","author":"Richards, M.A.; Ramirez, A.J.; Degner, L.F.","year":"1993","unstructured":"Richards MA, Ramirez AJ, Degner LF, et al. OVering choice of treatment to patients with cancers. A review based on a symposium held at the 10th Annual Conference of The British Psychosocial Oncology Group, December 1993."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1136\/qshc.4.1.18","article-title":"Comparison of patients\u2019 needs for information on prostate surgery with printed materials provided by surgeons","volume":"4","author":"Meredith, P.; Emberton, M.; Wood, C.","year":"1995","unstructured":"Meredith P, Emberton M, Wood C, et al. Comparison of patients\u2019 needs for information on prostate surgery with printed materials provided by surgeons. Quality in Health Care 1995;4:18\u201323.","journal-title":"Quality in Health Care"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1136\/bmj.301.6752.575","article-title":"Psychological outcomes of diVerent treatment policies in women with early breast cancer outside a clinical trial","volume":"301","author":"Fallowfield, L.J.; Hall, A.; Maguire, G.P.","year":"1990","unstructured":"Fallowfield LJ, Hall A, Maguire GP, et al. Psychological outcomes of diVerent treatment policies in women with early breast cancer outside a clinical trial. BMJ 1990;301:575\u2013 80.","journal-title":"BMJ"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"506","DOI":"10.1007\/BF02599549","article-title":"Patient perception of involvement in medical care. Relationship to illness attitudes and outcomes","volume":"4","author":"Brody, D.S.; Miller, S.M.; Lerman, C.E.","year":"1989","unstructured":"Brody DS, Miller SM, Lerman CE, et al. Patient perception of involvement in medical care. Relationship to illness attitudes and outcomes. J Gen Intern Med 1989;4:506\u201311.","journal-title":"J Gen Intern Med"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"520","DOI":"10.7326\/0003-4819-102-4-520","article-title":"Expanding patient involvement in care","volume":"102","author":"Greenfield, S.; Kaplan, S.; Ware, J.E.","year":"1985","unstructured":"Greenfield S, Kaplan S, Ware JE. Expanding patient involvement in care. Ann Intern Med 1985;102:520\u20138.","journal-title":"Ann Intern Med"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1097\/00005650-198903001-00010","article-title":"Assessing the eVects of physician-patient interactions on the outcomes of chronic disease","volume":"27","author":"Kaplan, S.H.; Greenfield, S.; Ware, J.E.","year":"1989","unstructured":"Kaplan SH, Greenfield S, Ware JE. Assessing the eVects of physician-patient interactions on the outcomes of chronic disease. Med Care 1989;27:S110\u201327.","journal-title":"Med Care"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1177\/135581969700200209","article-title":"Partnerships with patients: the pros and cons of shared clinical decision making","volume":"2","author":"Coulter, A.","year":"1997","unstructured":"Coulter A. Partnerships with patients: the pros and cons of shared clinical decision making. Journal of Health Services Research and Policy 1997;2:112\u201321.","journal-title":"Journal of Health Services Research and Policy"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1139","DOI":"10.1016\/0277-9536(88)90343-7","article-title":"Information and decision-making preferences of hospitalized adult cancer patients","volume":"27","author":"Blanchard, C.G.; Labrecque, M.S.; Ruckdeschel, J.C.","year":"1988","unstructured":"Blanchard CG, Labrecque MS, Ruckdeschel JC, et al. Information and decision-making preferences of hospitalized adult cancer patients. Soc Sci Med 1988;27:1139\u201345.","journal-title":"Soc Sci Med"},{"key":"ref_14","first-page":"241","article-title":"Consumer health information in the year 2000","volume":"48","author":"Gann, B.","year":"1996","unstructured":"Gann B. Consumer health information in the year 2000. Association for Information Managers 1996;48:241\u20135.","journal-title":"Association for Information Managers"},{"key":"ref_15","article-title":"Dissemination of information on treatment outcomes by consumer health information services. Report to the King\u2019s Fund","author":"Gann, B.; Buckland, S.","year":"1994","unstructured":"Gann B, Buckland S. Dissemination of information on treatment outcomes by consumer health information services. Report to the King\u2019s Fund. Winchester: Help for Health Trust, 1994."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1016\/0895-4356(93)90166-X","article-title":"An index of scientific quality for health reports in the lay press","volume":"46","author":"Oxman, A.D.; Guyatt, G.H.; Cook, D.J.","year":"1993","unstructured":"Oxman AD, Guyatt GH, Cook DJ, et al. An index of scientific quality for health reports in the lay press. J Clin Epidemiol 1993;46:987\u20131001.","journal-title":"J Clin Epidemiol"},{"key":"ref_17","first-page":"15","article-title":"Health measurement scales: a practical guide to their development and use","author":"Streiner, D.L.; Norman, G.R.","year":"1995","unstructured":"Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. 2nd ed. Oxford: Oxford University Press, 1995:15\u201327.","edition":"2nd ed"},{"key":"ref_18","article-title":"National Council for Voluntary Organisations. The voluntary agencies directory","year":"1996","unstructured":"National Council for Voluntary Organisations. The voluntary agencies directory. London: NCVO Publications, 1996."},{"key":"ref_19","article-title":"The popular medical index","author":"Knight, S.T.","year":"1996","unstructured":"Knight ST, ed. The popular medical index. Letchworth: Meade Publishing, 1996."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1136\/bmj.311.6996.42","article-title":"Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research","volume":"311","author":"Pope, C.; Mays, N.","year":"1995","unstructured":"Pope C, Mays N. Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research. BMJ 1995;311:42\u20135.","journal-title":"BMJ"},{"key":"ref_21","first-page":"212","article-title":"The measurement of interrater agreement. In: Statistical methods for rates and proportions","author":"Fleiss, J.L.","year":"1981","unstructured":"Fleiss JL. The measurement of interrater agreement. In: Statistical methods for rates and proportions. 2nd ed. NewYork: John Wiley, 1981:212\u201336.","edition":"2nd ed"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1037\/h0026256","article-title":"Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit","volume":"70","author":"Cohen, J.","year":"1968","unstructured":"Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 1968;70:213\u201320.","journal-title":"Psychol Bull"},{"key":"ref_23","first-page":"407","article-title":"Practical statistics for medical research","author":"Altman, D.G.","year":"1991","unstructured":"Altman DG. Practical statistics for medical research. London: Chapman and Hall, 1991:407\u20139."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis, JR, Koch; G.G.","year":"1977","unstructured":"Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159\u201374.","journal-title":"Biometrics"},{"key":"ref_25","article-title":"Writing leaflets for patients. Guidelines for producing written information","author":"Secker, J.; Pollard, R.","year":"1995","unstructured":"Secker J, Pollard R. Writing leaflets for patients. Guidelines for producing written information. Edinburgh: Health Education Board for Scotland, 1995."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1177\/001789699505400110","article-title":"Improving written patient education materials: a review of the evidence","volume":"54","author":"Vahabi, M.; Ferris, L.","year":"1995","unstructured":"Vahabi M, Ferris L. Improving written patient education materials: a review of the evidence. Health Educ J 1995;54: 99\u2013106.","journal-title":"Health Educ J"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1037\/h0057532","article-title":"A new readability yardstick","volume":"32","author":"Flesch, R.F.","year":"1948","unstructured":"Flesch RF. A new readability yardstick. J Appl Psychol 1948; 32:221\u201333.","journal-title":"J Appl Psychol"},{"issue":"12","key":"ref_28","first-page":"639","article-title":"SMOG grading - a new readability formula","volume":"1969","author":"McLaughlin, G.H.","unstructured":"McLaughlin GH. SMOG grading - a new readability formula. Journal of Reading 1969;12:639\u201346.","journal-title":"Journal of Reading"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1111\/j.2044-8309.1989.tb00849.x","article-title":"Framing of information: its influence upon decisions of doctors and patients","volume":"28","author":"Marteau, T.","year":"1989","unstructured":"Marteau T. Framing of information: its influence upon decisions of doctors and patients. Br J Soc Psychol 1989;28: 89\u201394.","journal-title":"Br J Soc Psychol"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1007\/BF02599636","article-title":"The framing eVect of relative and absolute risk","volume":"8","author":"Malenka, D.; Baron, J.; Johansen, S.","year":"1993","unstructured":"Malenka D, Baron J, Johansen S, et al. The framing eVect of relative and absolute risk. J Gen Intern Med 1993;8:543\u20138.","journal-title":"J Gen Intern Med"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1097\/00006416-199311000-00008","article-title":"Developing and evaluating printed education materials: a prescriptive model for quality","volume":"12","author":"Bernier, M.J.","year":"1993","unstructured":"Bernier MJ. Developing and evaluating printed education materials: a prescriptive model for quality. Orthopaedic Nursing 1993;12:39\u201346.","journal-title":"Orthopaedic Nursing"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1046\/j.1365-2648.1995.21061081.x","article-title":"Written patient information: a review of the literature","volume":"21","author":"Arthur, V.A.M.","year":"1995","unstructured":"Arthur VAM. Written patient information: a review of the literature. J Adv Nurs 1995;21:1081\u20136.","journal-title":"J Adv Nurs"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1244","DOI":"10.1001\/jama.1997.03540390074039","article-title":"Assessing, controlling and assuring the quality of medical information on the Internet. Caveant lector et viewor - let the reader and viewer beware","volume":"277","author":"Silberg, W.M.; Lundberg, G.D.; Musacchio, R.A.","year":"1997","unstructured":"Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling and assuring the quality of medical information on the Internet. Caveant lector et viewor - let the reader and viewer beware. JAMA 1997;277:1244\u20135.","journal-title":"JAMA"}],"container-title":["Journal of Epidemiology and Community Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/jech.53.2.105","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T11:07:53Z","timestamp":1759835273000},"score":1,"resource":{"primary":{"URL":"https:\/\/jech.bmj.com\/lookup\/doi\/10.1136\/jech.53.2.105"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1999,2]]},"references-count":33,"journal-issue":{"issue":"2","published-online":{"date-parts":[[1999,2,1]]},"published-print":{"date-parts":[[1999,2]]}},"alternative-id":["10.1136\/jech.53.2.105"],"URL":"https:\/\/doi.org\/10.1136\/jech.53.2.105","relation":{},"ISSN":["0143-005X","1470-2738"],"issn-type":[{"value":"0143-005X","type":"print"},{"value":"1470-2738","type":"electronic"}],"subject":[],"published":{"date-parts":[[1999,2]]}}}