{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T20:26:16Z","timestamp":1777753576351,"version":"3.51.4"},"reference-count":31,"publisher":"SAGE Publications","issue":"3-4","license":[{"start":{"date-parts":[[2022,4,26]],"date-time":"2022-04-26T00:00:00Z","timestamp":1650931200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ISU"],"published-print":{"date-parts":[[2022,4,26]]},"abstract":"<jats:p>Donald A.B. Lindberg, M.D., brought with him when he joined NLM an inquisitive mind, tech savvy, and new ideas. He was an early advocate of both outreach and evaluation innovation at NLM. Dr. Lindberg initiated and supported multiple pilot test and implementation projects to strengthen NLM\u2019s health information outreach to healthcare providers, research scientists, health science and hospital librarians, and the general public, including minority and underserved populations. He helped steer NLM\u2019s transition to the Internet, and NLM\u2019s development of a robust framework for evaluating Internet and Web-based health information dissemination and outreach to its many audiences. Dr. Lindberg\u2019s leadership led to numerous landmark accomplishments, including the capacity-building \u201cMeasuring the Difference\u201d outreach evaluation Guide, and a multi-dimensional approach to Internet and website evaluation that placed NLM at the forefront of federal agencies using these new and emerging technologies to support their missions.<\/jats:p>","DOI":"10.3233\/isu-210126","type":"journal-article","created":{"date-parts":[[2021,12,28]],"date-time":"2021-12-28T12:33:19Z","timestamp":1640694799000},"page":"241-254","source":"Crossref","is-referenced-by-count":0,"title":["Are we making a difference? Outreach evaluation in practice"],"prefix":"10.1177","volume":"41","author":[{"given":"Frederick B.","family":"Wood","sequence":"first","affiliation":[{"name":"U.S. National Library of Medicine (retired), USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elliot R.","family":"Siegel","sequence":"additional","affiliation":[{"name":"U.S. National Library of Medicine (retired), USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/ISU-210126_ref1","unstructured":"National Library of Medicine (U.S.). Board of Regents. Long range plan, U.S. Department of Health and Human Services. National Institutes of Health, Bethesda, MD, January 1987."},{"key":"10.3233\/ISU-210126_ref2","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1037\/h0061470","article-title":"The critical incident technique","volume":"51","author":"Flanagan","year":"1954","journal-title":"Psychol Bull"},{"issue":"24","key":"10.3233\/ISU-210126_ref3","doi-asserted-by":"crossref","first-page":"3124","DOI":"10.1001\/jama.1993.03500240068028","article-title":"Use of MEDLINE by physicians for clinical problem solving","volume":"269","author":"Lindberg","year":"1993","journal-title":"JAMA"},{"issue":"1","key":"10.3233\/ISU-210126_ref4","first-page":"35","article-title":"A comparative evaluation of the technical performance and user acceptance of two prototype online catalog system","volume":"3","author":"Siegel","year":"1984","journal-title":"Information Technology and Libraries"},{"key":"10.3233\/ISU-210126_ref5","first-page":"166","article-title":"Bibliographic retrieval: A survey of individual users of MEDLINE","volume":"7","author":"Wallingford","year":"1990","journal-title":"MD Computing"},{"issue":"3","key":"10.3233\/ISU-210126_ref6","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1108\/eb024340","article-title":"Evaluating MEDLINE on CD-ROM: An overview of field tests in library and clinical settings","volume":"14","author":"Rapp","year":"1990","journal-title":"Online Review"},{"key":"10.3233\/ISU-210126_ref7","unstructured":"U.S. Congress, Senate, Committee on Appropriations, Department of Labor, Health and Human Services, and Education and Related Agencies Appropriations Bill, 1987."},{"key":"10.3233\/ISU-210126_ref8","unstructured":"U.S. Congress, Joint resolution amending the National Library of Medicine Act, Public Law 100-202, section 215, 1987."},{"key":"10.3233\/ISU-210126_ref10","volume-title":"Transforming Biomedical Informatics and Health Information Access: Don Lindberg and the U.S. National Library of Medicine","author":"Shipman","year":"2021"},{"issue":"2","key":"10.3233\/ISU-210126_ref11","first-page":"1","article-title":"Outreach activities of the National Library of Medicine: A five-year review","volume":"84","author":"Wallingford","year":"1996","journal-title":"Bull Med Libr Assoc"},{"key":"10.3233\/ISU-210126_ref14","volume-title":"Transforming Biomedical Informatics and Health Information Access: Don Lindberg and the U.S. National Library of Medicine","author":"Dutcher","year":"2021"},{"key":"10.3233\/ISU-210126_ref15","unstructured":"National Library of Medicine\u2019s 2004 \u201csymposium on community-based health information outreach'', W.J. Peay, M.L.\u00a0Rockoff (eds) J Med Libr Assoc, 93(4) (2005). Supplement: S1\u201392."},{"issue":"4","key":"10.3233\/ISU-210126_ref16","first-page":"S4","article-title":"The National Library of Medicine\u2019s 2004 \u201csymposium on community-based health information outreach\u201d, Introduction","volume":"93","author":"Peay","year":"2005","journal-title":"J Med Libr Assoc"},{"issue":"4","key":"10.3233\/ISU-210126_ref17","first-page":"S43","article-title":"\u201cSmallball\u201d evaluation: A prescription for studying community-based information interventions","volume":"93","author":"Friedman","year":"2005","journal-title":"J Med Libr Assoc"},{"issue":"1","key":"10.3233\/ISU-210126_ref18","first-page":"57","article-title":"Tribal connections health information outreach: results, evaluation, and challenges","volume":"91","author":"Wood","year":"2003","journal-title":"J Med Libr Assoc"},{"issue":"3","key":"10.3233\/ISU-210126_ref19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1300\/J045v17n03_01","article-title":"Program management and policy issues in information outreach: Lessons from Tribal Connections","volume":"17","author":"Press","year":"2003","journal-title":"J Health Soc Policy"},{"issue":"4","key":"10.3233\/ISU-210126_ref20","first-page":"S21","article-title":"The National Library of Medicine\u2019s Native American outreach portfolio: A descriptive overview","volume":"93","author":"Wood","year":"2005","journal-title":"J Med Libr Assoc"},{"issue":"4","key":"10.3233\/ISU-210126_ref21","first-page":"S10","article-title":"Assessment of the National Library of Medicine\u2019s health disparities plan: A focus on Native American outreach","volume":"93","author":"Siegel","year":"2005","journal-title":"J Med Libr Assoc"},{"key":"10.3233\/ISU-210126_ref22","volume-title":"Transforming Biomedical Informatics and Health Information Access: Don Lindberg and the U.S. National Library of Medicine","author":"Wood","year":"2021"},{"issue":"2","key":"10.3233\/ISU-210126_ref23","first-page":"180","article-title":"Health information Hispanic outreach in the Texas Lower Rio Grande Valley","volume":"94","author":"Bowden","year":"2006","journal-title":"J Med Libr Assoc"},{"issue":"2","key":"10.3233\/ISU-210126_ref24","first-page":"243","article-title":"High school peer tutors teach MedlinePlus: A model for Hispanic outreach","volume":"93","author":"Warner","year":"2005","journal-title":"J Med Libr Assoc"},{"issue":"4","key":"10.3233\/ISU-210126_ref25","doi-asserted-by":"crossref","first-page":"317","DOI":"10.3163\/1536-5050.99.4.012","article-title":"Long-term outcomes of the !VIVA! Peer Tutor Project: Use of MedlinePlus by former peer tutors and the adults they taught","volume":"99","author":"Olney","year":"2011","journal-title":"J Med Libr Assoc"},{"issue":"1","key":"10.3233\/ISU-210126_ref26","first-page":"31","article-title":"MedlinePlus and the challenge of low health literacy: Findings from the Colonias project","volume":"95","author":"Olney","year":"2007","journal-title":"J Med Libr Assoc"},{"issue":"4","key":"10.3233\/ISU-210126_ref27","first-page":"S57","article-title":"Using evaluation to adapt health information outreach to the complex environments of community-based organizations","volume":"93","author":"Olney","year":"2005","journal-title":"J Med Libr Assoc"},{"issue":"3","key":"10.3233\/ISU-210126_ref28","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MITP.2003.1202231","article-title":"A practical approach to e-government Web evaluation","volume":"5","author":"Wood","year":"2003","journal-title":"IEEE IT Pro"},{"key":"10.3233\/ISU-210126_ref29","first-page":"435","volume-title":"Oxford Textbook of Public Health","author":"Siegel","year":"2009"},{"issue":"4","key":"10.3233\/ISU-210126_ref30","first-page":"335","article-title":"Using Bitnet to access the National Library of Medicine databases","volume":"80","author":"Hsieh","year":"1992","journal-title":"Bull Med Libr Assoc"},{"issue":"6","key":"10.3233\/ISU-210126_ref32","first-page":"528","article-title":"Evaluating Internet end-to-end performance: Overview of test methodology and results","volume":"5","author":"Wood","year":"1998","journal-title":"JAMIA"},{"issue":"4","key":"10.3233\/ISU-210126_ref33","first-page":"314","article-title":"Public library consumer health information pilot projects: results of a National Library of Medicine evaluation","volume":"88","author":"Wood","year":"2000","journal-title":"Bull Med Libr Assoc"},{"issue":"1","key":"10.3233\/ISU-210126_ref34","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.2196\/jmir.944","article-title":"Web evaluation at the U.S. National Institutes of Health: Use of the American Customer Satisfaction Index online customer survey","volume":"10","author":"Wood","year":"2008","journal-title":"J Med Internet Res"},{"issue":"3","key":"10.3233\/ISU-210126_ref35","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.2196\/jmir.7.3.e31","article-title":"Use of Internet audience measurement data to gauge market share for online health information","volume":"7","author":"Wood","year":"2005","journal-title":"J Med Internet Res"}],"container-title":["Information Services &amp; Use"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/ISU-210126","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T12:03:12Z","timestamp":1777464192000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/ISU-210126"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,26]]},"references-count":31,"journal-issue":{"issue":"3-4"},"URL":"https:\/\/doi.org\/10.3233\/isu-210126","relation":{},"ISSN":["0167-5265","1875-8789"],"issn-type":[{"value":"0167-5265","type":"print"},{"value":"1875-8789","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,26]]}}}