{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T16:56:16Z","timestamp":1776963376649,"version":"3.51.4"},"reference-count":71,"publisher":"MIT Press - Journals","issue":"3","content-domain":{"domain":["www.mitpressjournals.org"],"crossmark-restriction":true},"short-container-title":["Quantitative Science Studies"],"published-print":{"date-parts":[[2020,9]]},"abstract":"<jats:p> Much scientometric research aims to be relevant to policy, but such research only rarely has a notable policy impact. In this paper, we examine four exemplary cases of policy impact from quantitative studies of science. The cases are analyzed in light of lessons learned about the use of evidence in policy making in health services, which provides very thorough explorations of the problems inherent in policy use of academic research. The analysis highlights key dimensions of the examples, which offer lessons for those aspiring to influence policy with quantitative studies of science. <\/jats:p>","DOI":"10.1162\/qss_a_00060","type":"journal-article","created":{"date-parts":[[2020,6,29]],"date-time":"2020-06-29T11:36:45Z","timestamp":1593430605000},"page":"969-982","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":14,"title":["Powerful numbers: Exemplary quantitative studies of science that had policy impact"],"prefix":"10.1162","volume":"1","author":[{"given":"Diana","family":"Hicks","sequence":"first","affiliation":[{"name":"School of Public Policy, Georgia Institute of Technology, Atlanta, GA 30332"}]},{"given":"Kimberley R.","family":"Isett","sequence":"additional","affiliation":[{"name":"Joseph R. Biden Jr. School of Public Policy and Administration, Newark, DE 19711"}]}],"member":"281","reference":[{"key":"bib1","volume-title":"The economic effects of federal spending on infrastructure and other investments","author":"Alsalam N.","year":"1998"},{"key":"bib2","volume-title":"San Francisco declaration on research assessment","author":"American Society for Cell Biology","year":"2012"},{"issue":"1","key":"bib3","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1377\/hlthaff.24.1.102","volume":"24","author":"Atkins D.","year":"2005","journal-title":"Health Aff (Millwood)"},{"key":"bib4","volume-title":"Varieties of excellence: Diversity, specialisation and regional engagement","author":"Australia Department of Education, Science, and Training","year":"2002"},{"key":"bib5","volume-title":"Evaluation of knowledge and innovation reforms: Issues paper","author":"Australia Department of Education, Science, and Training","year":"2003"},{"key":"bib6","volume-title":"Mapping Australian science & innovation: Main report","author":"Australia Department of Education, Science, and Training","year":"2003"},{"key":"bib7","volume-title":"National report on higher education in Australia: 1991\u20132001","author":"Australia Department of Education, Science, and Training","year":"2003"},{"key":"bib8","volume-title":"Evaluation of knowledge and innovation reforms consultation report","author":"Australia Department of Education, Science and Training","year":"2004"},{"issue":"9","key":"bib9","doi-asserted-by":"crossref","first-page":"1576","DOI":"10.2105\/AJPH.2008.156224","volume":"99","author":"Brownson R. C.","year":"2009","journal-title":"American Journal of Public Health"},{"issue":"8","key":"bib10","doi-asserted-by":"crossref","first-page":"1035","DOI":"10.1007\/s10552-016-0771-0","volume":"27","author":"Brownson R. C.","year":"2016","journal-title":"Cancer Causes & Control"},{"key":"bib11","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1146\/annurev.publhealth.031308.100134","volume":"30","author":"Brownson R. C.","year":"2009","journal-title":"Annual Review of Public Health"},{"issue":"2","key":"bib12","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1111\/j.1468-0009.2010.00595.x","volume":"88","author":"Burris S.","year":"2010","journal-title":"Milbank Quarterly"},{"issue":"1","key":"bib13","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/S0048-7333(02)00007-0","volume":"32","author":"Butler L.","year":"2003","journal-title":"Research Policy"},{"issue":"14","key":"bib14","doi-asserted-by":"crossref","first-page":"8086","DOI":"10.1073\/pnas.1231332100","volume":"100","author":"Cash D. W.","year":"2003","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"4","key":"bib15","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1111\/j.1468-0009.2009.00582.x","volume":"87","author":"Coffman J. M.","year":"2009","journal-title":"Milbank Quarterly"},{"key":"bib16","volume-title":"Unlocking our future: Towards a new national science policy","author":"Committee on Science, United States House of Representatives, One Hundred and Fifth Congress","year":"1998"},{"issue":"4","key":"bib17","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1111\/j.1468-0009.2010.00608.x","volume":"88","author":"Contandriopoulos D.","year":"2010","journal-title":"Milbank Quarterly"},{"key":"bib18","volume-title":"A behavioral theory of the firm","author":"Cyert R. M.","year":"1963"},{"key":"bib19","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.evalprogplan.2015.07.003","volume":"53","author":"Dagenais C.","year":"2015","journal-title":"Evaluation and Program Planning"},{"issue":"6","key":"bib20","first-page":"840","volume":"30","author":"Dodson E. A.","year":"2015","journal-title":"Health Education Research"},{"key":"bib21","volume-title":"Research Evaluation and Policy Project","author":"Donovan C.","year":"2003"},{"key":"bib22","first-page":"81","volume-title":"Organizational decision making","author":"Dutton J. E.","year":"1997"},{"issue":"1","key":"bib23","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1177\/2515245918811301","volume":"2","author":"Elson M.","year":"2019","journal-title":"Advances in Methods and Practices in Psychological Science"},{"key":"bib24","volume-title":"Approved Minutes Open Session 346th Meeting National Science Board November 13\u201314, 1997","author":"Fannoney S.E.","year":"1997"},{"issue":"4","key":"bib25","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1377\/hlthaff.25.4.969","volume":"25","author":"Fielding J. E.","year":"2006","journal-title":"Health Affairs (Millwood)"},{"issue":"2","key":"bib26","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.amepre.2004.04.010","volume":"27","author":"Fielding J. E.","year":"2004","journal-title":"American Journal of Preventive Medicine"},{"issue":"1","key":"bib27","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1215\/03616878-31-1-93","volume":"31","author":"Gamble V. N.","year":"2006","journal-title":"Journal of Health Politics, Policy and Law"},{"issue":"4","key":"bib28","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1111\/j.0887-378X.2004.00325.x","volume":"82","author":"Greenhalgh T.","year":"2004","journal-title":"Milbank Quarterly"},{"issue":"1","key":"bib29","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/1478-4505-1-2","volume":"1","author":"Hanney S. R.","year":"2003","journal-title":"Health Research Policy and Systems"},{"key":"bib30","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.respol.2011.09.007","volume":"41","author":"Hicks D.","year":"2012","journal-title":"Research Policy"},{"key":"bib31","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/520429a","volume":"520","author":"Hicks D.","year":"2015","journal-title":"Nature"},{"key":"bib32","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1038\/316587a0","volume":"316","author":"Irvine J.","year":"1985","journal-title":"Nature"},{"key":"bib33","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1038\/323591a0","volume":"323","author":"Irvine J.","year":"1986","journal-title":"Nature"},{"key":"bib34","volume-title":"Investing in the future","author":"Irvine J.","year":"1990"},{"issue":"2","key":"bib35","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1111\/j.1468-0009.2008.00519.x","volume":"86","author":"Jewell C. J.","year":"2008","journal-title":"Milbank Quarterly"},{"issue":"7","key":"bib36","first-page":"2","volume":"2","author":"Laugesen M. J.","year":"2013","journal-title":"Frontiers in Public Health Services and Systems Research"},{"key":"bib37","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1186\/1748-5908-3-53","volume":"3","author":"Lavis J. N.","year":"2008","journal-title":"Implementation Science"},{"issue":"2","key":"bib38","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1111\/1468-0009.t01-1-00052","volume":"81","author":"Lavis J. N.","year":"2003","journal-title":"Milbank Quarterly"},{"issue":"1","key":"bib39","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1093\/reseval\/rvt029","volume":"23","author":"Lemay M. A.","year":"2014","journal-title":"Research Evaluation"},{"issue":"1","key":"bib40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0048-7333(91)90080-A","volume":"20","author":"Mansfield E.","year":"1991","journal-title":"Research Policy"},{"issue":"6","key":"bib41","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1080\/08956308.1991.11670776","volume":"34","author":"Mansfield E.","year":"1991","journal-title":"Research Technology Management"},{"issue":"7","key":"bib42","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1016\/S0048-7333(97)00043-7","volume":"26","author":"Mansfield E.","year":"1998","journal-title":"Research Policy"},{"issue":"6144","key":"bib43","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1038\/330123a0","volume":"330","author":"Martin B. R.","year":"1987","journal-title":"Nature"},{"key":"bib44","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1038\/316572c0","volume":"316","author":"Martin B.","year":"1985","journal-title":"Nature"},{"key":"bib45","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1038\/323591a0","volume":"323","author":"Martin B.","year":"1986","journal-title":"Nature"},{"key":"bib46","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1038\/330123a0","volume":"330","author":"Martin B.","year":"1987","journal-title":"Nature"},{"issue":"3","key":"bib47","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1332\/174426413X14818994998468","volume":"9","author":"Meagher L.","year":"2013","journal-title":"Evidence & Policy"},{"issue":"3","key":"bib48","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1016\/S0048-7333(99)00040-2","volume":"29","author":"Meyer M.","year":"2000","journal-title":"Research Policy"},{"key":"bib49","first-page":"CD009401","volume":"9","author":"Murthy L.","year":"2012","journal-title":"Cochrane Database Systematic Reviews"},{"issue":"3","key":"bib50","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1016\/S0048-7333(97)00013-9","volume":"26","author":"Narin F.","year":"1997","journal-title":"Research Policy"},{"key":"bib51","volume-title":"Industry trends in research support and links to public research","author":"National Science Board","year":"1998"},{"key":"bib52","unstructured":"National Science Board. (2003). Fulfilling the promise: A report to Congress on the budgetary and programmatic expansion of the National Science Foundation. Washington, DC: National Science Board."},{"key":"bib53","volume-title":"2020 Vision for the National Science Foundation","author":"National Science Board","year":"2005"},{"key":"bib54","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/1472-6963-14-2","volume":"14","author":"Oliver K.","year":"2014","journal-title":"BMC Health Services Research"},{"issue":"1","key":"bib55","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/2585925","volume":"92","author":"Ostrom E.","year":"1998","journal-title":"American Political Science Review"},{"issue":"4","key":"bib56","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1111\/puar.12595","volume":"76","author":"Pisano M.","year":"2016","journal-title":"Public Administration Review"},{"key":"bib57","volume-title":"Trust in numbers: The pursuit of objectivity in science and public life","author":"Porter T. M.","year":"1995"},{"key":"bib58","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.socscimed.2015.05.009","volume":"136","author":"Redman S.","year":"2015","journal-title":"Social Science & Medicine"},{"key":"bib59","unstructured":"Role of Public Investment in Promoting Economic Growth: Hearing before the Committee on Financial Services, U.S. House of Representatives, 110th Cong. 39. (2007). Retrieved from: https:\/\/www.govinfo.gov\/content\/pkg\/CHRG-110hhrg35409\/pdf\/CHRG-110hhrg35409.pdf, January 6, 2020."},{"key":"bib60","volume-title":"Policy change and learning: An advocacy coalition approach","author":"Sabatier P. A.","year":"1993"},{"issue":"2","key":"bib61","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1093\/scipol\/sct046","volume":"41","author":"Sarkki S.","year":"2014","journal-title":"Science and Public Policy"},{"issue":"5081","key":"bib62","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1126\/science.1411532","volume":"258","author":"Science policy: The candidates\u2019 response","year":"1992","journal-title":"Science"},{"issue":"1","key":"bib63","doi-asserted-by":"crossref","first-page":"S99","DOI":"10.1123\/jpah.7.s1.s99","volume":"7","author":"Stamatakis K. A.","year":"2010","journal-title":"Journal of Physical Activity and Health"},{"issue":"7327","key":"bib64","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1038\/4681029a","volume":"468","author":"Stirling A.","year":"2010","journal-title":"Nature"},{"issue":"2","key":"bib65","doi-asserted-by":"crossref","first-page":"281","DOI":"10.2307\/2151585","volume":"104","author":"Stone D.","year":"1989","journal-title":"Political Science Quarterly"},{"key":"bib66","volume-title":"Measuring the moment, Benchmarks of our Innovation Future II","author":"Task Force on the Future of American Innovation","year":"2006"},{"issue":"4","key":"bib67","volume":"11","author":"Tricco A. C.","year":"2016","journal-title":"Implementation Science"},{"issue":"6","key":"bib68","doi-asserted-by":"crossref","first-page":"11","DOI":"10.3928\/00989134-20160516-04","volume":"42","author":"Troy L. M.","year":"2016","journal-title":"Journal of Gerontological Nursing"},{"issue":"3","key":"bib69","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/j.healthpol.2017.01.003","volume":"121","author":"van de Goor I.","year":"2017","journal-title":"Health Policy"},{"issue":"4","key":"bib70","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1111\/puar.12603","volume":"76","author":"VanLandingham G.","year":"2016","journal-title":"Public Administration Review"},{"key":"bib71","volume-title":"A review of Edwin Mansfield\u2019s estimate of the rate of return from academic research and its relevance to the federal budget process","author":"Webre P.","year":"1993"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/qss_a_00060","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:30:30Z","timestamp":1615584630000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/1\/3\/969-982\/96091"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9]]},"references-count":71,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["10.1162\/qss_a_00060"],"URL":"https:\/\/doi.org\/10.1162\/qss_a_00060","relation":{},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9]]},"assertion":[{"value":"2020-08-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}