{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T07:44:41Z","timestamp":1773301481116,"version":"3.50.1"},"reference-count":66,"publisher":"MIT Press","issue":"2","license":[{"start":{"date-parts":[[2021,2,17]],"date-time":"2021-02-17T00:00:00Z","timestamp":1613520000000},"content-version":"vor","delay-in-days":413,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Societal impact considerations play an increasingly important role in research evaluation. In particular, in the context of publicly funded research, proposal templates commonly include sections to outline strategies for achieving broader impact. Both the assessment of the strategies and the later evaluation of their success are associated with challenges in their own right. Ever since their introduction, altmetrics have been discussed as a remedy for assessing the societal impact of research output. On the basis of data from a research center in Switzerland, this study explores their potential for this purpose. The study is based on the papers (and the corresponding metrics) published by about 200 either accepted or rejected applicants for funding by the Competence Center Environment and Sustainability (CCES). The results of the study seem to indicate that altmetrics are not suitable for reflecting the societal impact of research that was considered: The metrics do not correlate with the ex ante considerations of an expert panel.<\/jats:p>","DOI":"10.1162\/qss_a_00032","type":"journal-article","created":{"date-parts":[[2020,3,25]],"date-time":"2020-03-25T13:06:31Z","timestamp":1585141591000},"page":"792-809","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":16,"title":["Can altmetrics reflect societal impact considerations?: Exploring the potential of altmetrics in the context of a sustainability science research center"],"prefix":"10.1162","volume":"1","author":[{"given":"Omar","family":"Kassab","sequence":"first","affiliation":[{"name":"Swiss Federal Institute of Technology (ETH Zurich), Professorship for Social Psychology and Research on Higher Education, Andreasstrasse 15, 8050 Zurich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0810-7091","authenticated-orcid":false,"given":"Lutz","family":"Bornmann","sequence":"additional","affiliation":[{"name":"Administrative Headquarters of the Max Planck Society, Division for Science and Innovation Studies, Hofgartenstrasse 8, 80539 Munich, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7025-7256","authenticated-orcid":false,"given":"Robin","family":"Haunschild","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Solid State Research, Heisenbergstrasse 1, 70569 Stuttgart, Germany"}]}],"member":"281","published-online":{"date-parts":[[2020,6,1]]},"reference":[{"key":"2025073014020256900_bib1","unstructured":"Andersen,  J. P., & Haustein,  S. (2015). Influence of study type on twitter activity for medical research papers. In A. A.Salah, Y.Tonta, A. A. A.Salah, C.Sugimoto, & U.Al (Eds.), The 15th Conference of the International Society for Scientometrics and Informetrics, pp. 26\u201336. Istanbul, Turkey: ISSI, Bogazici University Printhouse."},{"key":"2025073014020256900_bib2","doi-asserted-by":"crossref","unstructured":"Bar-Ilan,  J., Shema,  H., & Thelwall,  M. (2014). Bibliographic references in Web 2.0. In B.Cronin & C. R.Sugimoto (Eds.), Beyond Bibliometrics: Harnessing Multi-Dimensional Indicators of Performance, pp. 307\u2013325. Cambridge, MA: MIT Press.","DOI":"10.7551\/mitpress\/9445.003.0021"},{"key":"2025073014020256900_bib3","doi-asserted-by":"crossref","unstructured":"Bik,  H. M., & Goldstein,  M. C. (2013). An introduction to social media for scientists. PLOS Biology, 11(4), e1001535. https:\/\/doi.org\/10.1371\/journal.pbio.1001535","DOI":"10.1371\/journal.pbio.1001535"},{"key":"2025073014020256900_bib4","doi-asserted-by":"crossref","unstructured":"Bonetta,  L.\n           (2007). Scientists enter the blogosphere. Cell, 129(3), 443\u2013445.","DOI":"10.1016\/j.cell.2007.04.032"},{"key":"2025073014020256900_bib5","doi-asserted-by":"crossref","unstructured":"Bornmann,  L.\n           (2014). Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics. Journal of Informetrics, 8(4), 895\u2013903. https:\/\/doi.org\/10.1016\/j.joi.2014.09.005","DOI":"10.1016\/j.joi.2014.09.005"},{"key":"2025073014020256900_bib6","doi-asserted-by":"crossref","unstructured":"Bornmann,  L.\n           (2015). Alternative metrics in scientometrics: A meta-analysis of research into three altmetrics. Scientometrics, 103(3), 1123\u20131144.","DOI":"10.1007\/s11192-015-1565-y"},{"key":"2025073014020256900_bib7","doi-asserted-by":"crossref","unstructured":"Bornmann,  L., & Haunschild,  R. (2017). Does evaluative scientometrics lose its main focus on scientific quality by the new orientation towards societal impact?Scientometrics, 110(2), 937\u2013943.","DOI":"10.1007\/s11192-016-2200-2"},{"key":"2025073014020256900_bib8","doi-asserted-by":"crossref","unstructured":"Bornmann,  L., & Haunschild,  R. (2018). Normalization of zero-inflated data: An empirical analysis of a new indicator family and its use with altmetrics data. Journal of Informetrics, 12(3), 998\u20131011. https:\/\/doi.org\/10.1016\/j.joi.2018.01.010","DOI":"10.1016\/j.joi.2018.01.010"},{"key":"2025073014020256900_bib9","doi-asserted-by":"crossref","unstructured":"Bornmann,  L., Haunschild,  R., & Adams,  J. (2019). Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework. Journal of Informetrics, 13(1), 325\u2013340. https:\/\/doi.org\/10.1016\/j.joi.2019.01.008","DOI":"10.1016\/j.joi.2019.01.008"},{"key":"2025073014020256900_bib10","doi-asserted-by":"crossref","unstructured":"Bornmann,  L., Haunschild,  R., & Marx,  W. (2016). Policy documents as sources for measuring societal impact: How often is climate change research mentioned in policy-related documents?Scientometrics, 109(3), 1477\u20131495. https:\/\/doi.org\/10.1007\/s11192-016-2115-y","DOI":"10.1007\/s11192-016-2115-y"},{"key":"2025073014020256900_bib11","doi-asserted-by":"crossref","unstructured":"Bornmann,  L., Leydesdorff,  L., & Mutz,  R. (2013). The use of percentiles and percentile rank classes in the analysis of bibliometric data: Opportunities and limits. Journal of Informetrics, 7(1), 158\u2013165. https:\/\/doi.org\/10.1016\/j.joi.2012.10.001","DOI":"10.1016\/j.joi.2012.10.001"},{"key":"2025073014020256900_bib12","doi-asserted-by":"crossref","unstructured":"Brandt,  P., Ernst,  A., Gralla,  F., Luederitz,  C., Lang,  D. J., \u2026 von Hehrden,  H. (2013). A review of transdisciplinary research in sustainability science. Ecological Economics, 92, 1\u201315.","DOI":"10.1016\/j.ecolecon.2013.04.008"},{"key":"2025073014020256900_bib13","unstructured":"CCES. (2005). Competence Center Environmental and Sustainability (CCES) of the ETH Domain: Business Plan. Retrieved from: https:\/\/ethz.ch\/content\/dam\/ethz\/special-interest\/dual\/cces-dam\/documents\/CCES_BP_2005_11_22_final.pdf"},{"key":"2025073014020256900_bib15","doi-asserted-by":"crossref","unstructured":"Clark,  W. C.\n           (2007). Sustainability science: A room of its own. Proceedings of the National Academy of Sciences, 104(6), 1737\u20131738.","DOI":"10.1073\/pnas.0611291104"},{"key":"2025073014020256900_bib16","unstructured":"Dehdarirad,  T., Didegah,  F., & Sotudeh,  H. (2018). Which type of research is cited more often in Wikipedia? A case study of PubMed research. In P.Wouters (Ed.), Proceedings of the Science and Technology Indicators Conference 2018 Leiden \u201cScience, Technology and Innovation Indicators in Transition.\u201dLeiden, Netherlands: University of Leiden."},{"key":"2025073014020256900_bib17","doi-asserted-by":"crossref","unstructured":"Fausto,  S., Machado,  F. A., Bento,  L. F. J., Iamarino,  A., Nahas,  T. R., & Munger,  D. S. (2012). Research blogging: Indexing and registering the change in science 2.0. PLOS ONE, 7(12), e50109. https:\/\/doi.org\/10.1371\/journal.pone.0050109","DOI":"10.1371\/journal.pone.0050109"},{"key":"2025073014020256900_bib18","doi-asserted-by":"crossref","unstructured":"Fleiss,  J., Levin,  B., & Paik,  M. C. (2003). Statistical methods for rates and proportions, 3rd Ed. Hoboken, NJ: Wiley.","DOI":"10.1002\/0471445428"},{"key":"2025073014020256900_bib19","doi-asserted-by":"crossref","unstructured":"Guglielmi,  G.\n           (2018). Wikipedia\u2019s top-cited scholarly articles \u2013 revealed. Nature, 557(7705), 291\u2013292.","DOI":"10.1038\/d41586-018-05161-6"},{"key":"2025073014020256900_bib20","doi-asserted-by":"crossref","unstructured":"Hall,  N.\n           (2014). The Kardashian index: A measure of discrepant social media profile for scientists. Genome Biology, 15(7), 424. https:\/\/doi.org\/10.1186\/s13059-014-0424-0","DOI":"10.1186\/s13059-014-0424-0"},{"key":"2025073014020256900_bib21","doi-asserted-by":"crossref","unstructured":"Haunschild,  R., & Bornmann,  L. (2017). How many scientific papers are mentioned in policy-related documents? An empirical investigation using Web of Science and Altmetric data. Scientometrics, 110(3), 1209\u20131216. https:\/\/doi.org\/10.1007\/s11192-016-2237-2","DOI":"10.1007\/s11192-016-2237-2"},{"key":"2025073014020256900_bib22","doi-asserted-by":"crossref","unstructured":"Haunschild,  R., & Bornmann,  L. (2018). Field- and time-normalization of data with many zeros: An empirical analysis using citation and Twitter data. Scientometrics, 116(2), 997\u20131012. https:\/\/doi.org\/10.1007\/s11192-018-2771-1","DOI":"10.1007\/s11192-018-2771-1"},{"key":"2025073014020256900_bib23","doi-asserted-by":"crossref","unstructured":"Haunschild,  R., Leydesdorff,  L., Bornmann,  L., Hellsten,  I., & Marx,  W. (2019). Does the public discuss other topics on climate change than researchers? A comparison of explorative networks based on author keywords and hashtags. Journal of Informetrics, 13(2), 695\u2013707.","DOI":"10.1016\/j.joi.2019.03.008"},{"key":"2025073014020256900_bib24","doi-asserted-by":"crossref","unstructured":"Haustein,  S., Larivi\u00e8re,  V., Thelwall,  M., Amyot,  D., & Peters,  I. (2014). Tweets vs. Mendeley readers: How do these two social media metrics differ?IT \u2013 Information Technology 2014, 56(5), 207\u2013215.","DOI":"10.1515\/itit-2014-1048"},{"key":"2025073014020256900_bib25","doi-asserted-by":"crossref","unstructured":"Haustein,  S., Peters,  I., Bar-Ilan,  J., Priem,  J., Shema,  H., & Terliesner,  J. (2014). Coverage and adoption of altmetrics sources in the bibliometric community. Scientometrics, 101(2), 1145\u20131163. https:\/\/doi.org\/10.1007\/s11192-013-1221-3","DOI":"10.1007\/s11192-013-1221-3"},{"key":"2025073014020256900_bib26","doi-asserted-by":"crossref","unstructured":"Hessels,  L. K., Van Lente,  H., & Smits,  R. (2009). In search of relevance: The changing contract between science and society. Science and Public Policy, 36(5), 387\u2013401.","DOI":"10.3152\/030234209X442034"},{"key":"2025073014020256900_bib27","unstructured":"Hollander,  M., & Wolfe,  D. A. (1999). Nonparametric statistical methods. New York, NY: Wiley."},{"key":"2025073014020256900_bib28","doi-asserted-by":"crossref","unstructured":"Kajikawa,  Y., Tacoa,  F., & Yamaguchi,  K. (2014). Sustainability science: The changing landscape of sustainability research. Sustainability Science, 9(4), 431\u2013438.","DOI":"10.1007\/s11625-014-0244-x"},{"key":"2025073014020256900_bib29","doi-asserted-by":"crossref","unstructured":"Kassab,  O.\n           (2019). Does public outreach impede research performance? Exploring the \u201cresearcher\u2019s dilemma\u201d in a sustainability research center. Science and Public Policy, 46(5), 710\u2013720. https:\/\/doi.org\/10.1093\/scipol\/scz024","DOI":"10.1093\/scipol\/scz024"},{"key":"2025073014020256900_bib30","doi-asserted-by":"crossref","unstructured":"Kassab,  O., Schwarzenbach,  R. P., & Gotsch,  N. (2018). Assessing ten years of inter- and transdisciplinary research, education, and outreach: The Competence Center Environment and Sustainability (CCES) of the ETH Domain. GAIA \u2013 Ecological Perspectives for Science and Society, 27(2), 226\u2013234.","DOI":"10.14512\/gaia.27.2.10"},{"key":"2025073014020256900_bib31","doi-asserted-by":"crossref","unstructured":"Kates,  R. W.\n           (2011). What kind of a science is sustainability science?Proceedings of the National Academy of Sciences, 108(49), 19449\u201319450.","DOI":"10.1073\/pnas.1116097108"},{"key":"2025073014020256900_bib32","doi-asserted-by":"crossref","unstructured":"Kousha,  K., & Thelwall,  M. (2017). Are Wikipedia citations important evidence of the impact of scholarly articles and books?Journal of the Association for Information Science and Technology, 68(3), 762\u2013779. https:\/\/doi.org\/10.1002\/asi.23694","DOI":"10.1002\/asi.23694"},{"key":"2025073014020256900_bib33","doi-asserted-by":"crossref","unstructured":"Lang,  D. J., Wiek,  A., Bergmann,  M., Stauffacher,  M., Martens,  P., \u2026 Thomas,  C. J. (2012). Transdisciplinary research in sustainability science: Practice, principles, and challenges. Sustainability Science, 7(1), 25\u201343.","DOI":"10.1007\/s11625-011-0149-x"},{"key":"2025073014020256900_bib34","doi-asserted-by":"crossref","unstructured":"Luz\u00f3n,  M. J.\n           (2013). Public communication of science in blogs: Recontextualizing scientific discourse for a diversified audience. Written Communication. https:\/\/doi.org\/10.1177\/0741088313493610","DOI":"10.1177\/0741088313493610"},{"key":"2025073014020256900_bib35","unstructured":"Mantel,  N., & Haenszel,  W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22(4), 719\u2013748."},{"key":"2025073014020256900_bib36","doi-asserted-by":"crossref","unstructured":"Mas-Bleda,  A., & Thelwall,  M. (2016). Can alternative indicators overcome language biases in citation counts? A comparison of Spanish and UK research. Scientometrics, 109(3), 2007\u20132030. https:\/\/doi.org\/10.1007\/s11192-016-2118-8","DOI":"10.1007\/s11192-016-2118-8"},{"key":"2025073014020256900_bib37","doi-asserted-by":"crossref","unstructured":"Mewburn,  I., & Thomson,  P. (2013). Why do academics blog? An analysis of audiences, purposes and challenges. Studies in Higher Education, 38(8), 1105\u20131119. https:\/\/doi.org\/10.1080\/03075079.2013.835624","DOI":"10.1080\/03075079.2013.835624"},{"key":"2025073014020256900_bib38","doi-asserted-by":"crossref","unstructured":"Miller,  T. R.\n           (2013). Constructing sustainability science: Emerging perspectives and research trajectories. Sustainability Science, 8(2), 279\u2013293.","DOI":"10.1007\/s11625-012-0180-6"},{"key":"2025073014020256900_bib39","doi-asserted-by":"crossref","unstructured":"Mobj\u00f6rk,  M.\n           (2010). Consulting versus participatory transdisciplinarity: A refined classification of transdisciplinary research. Futures, 42(8), 866\u2013873.","DOI":"10.1016\/j.futures.2010.03.003"},{"key":"2025073014020256900_bib40","doi-asserted-by":"crossref","unstructured":"Moed,  H. F.\n           (2017). Applied evaluative informetrics. Cham: Springer.","DOI":"10.1007\/978-3-319-60522-7"},{"key":"2025073014020256900_bib41","unstructured":"OPENing UP. (2016). Deliverable D5.1\u2014Altmetrics Status Quo. OPENing UP new methods, indicators and tools for peer review, impact measurement and dissemination of research. https:\/\/ec.europa.eu\/research\/participants\/documents\/downloadPublic?documentIds=080166e5ae8a151c&appId=PPGMS Project acronym: OpenUP. Retrieved from Brussels, Belgium."},{"key":"2025073014020256900_bib42","doi-asserted-by":"crossref","unstructured":"Pohl,  C.\n           (2010). From transdisciplinarity to transdisciplinary research. Transdisciplinary Journal of Engineering Science, 1, 65\u201373.","DOI":"10.22545\/2010\/0006"},{"key":"2025073014020256900_bib43","doi-asserted-by":"crossref","unstructured":"Priem,  J.\n           (2014). Altmetrics. In B.Cronin & C. R.Sugimoto (Eds.), Beyond Bibliometrics: Harnessing Multi-Dimensional Indicators of Performance, pp. 263\u2013288. Cambridge, MA: MIT Press.","DOI":"10.7551\/mitpress\/9445.003.0019"},{"key":"2025073014020256900_bib44","doi-asserted-by":"crossref","unstructured":"Priem,  J., & Hemminger,  B. M. (2010). Scientometrics 2.0: Toward new metrics of scholarly impact on the social Web. First Monday, 15(7).","DOI":"10.5210\/fm.v15i7.2874"},{"key":"2025073014020256900_bib45","doi-asserted-by":"crossref","unstructured":"Puschmann,  C.\n           (2014). (Micro) blogging science? Notes on potentials and constraints of new forms of scholarly communication. In S.Bartling & S.Friesike (Eds.), Opening Science: The Evolving Guide on How the Internet is Changing Research, Collaboration and Scholarly Publishing, pp. 89\u2013106. Cham: Springer.","DOI":"10.1007\/978-3-319-00026-8_6"},{"key":"2025073014020256900_bib46","doi-asserted-by":"crossref","unstructured":"Radhakrishna,  S.\n           (1965). Combination of results from several 2 \u00d7 2 contingency tables. Biometrics, 21, 86\u201398.","DOI":"10.2307\/2528354"},{"key":"2025073014020256900_bib47","doi-asserted-by":"crossref","unstructured":"Ringelhan,  S., Wollersheim,  J., & Welpe,  I. M. (2015). I like, I cite? Do Facebook likes predict the impact of scientific work?PLOS ONE, 10(8), e0134389. https:\/\/doi.org\/10.1371\/journal.pone.0134389","DOI":"10.1371\/journal.pone.0134389"},{"key":"2025073014020256900_bib48","doi-asserted-by":"crossref","unstructured":"Robinson-Garcia,  N., Costas,  R., Isett,  K., Melkers,  J., & Hicks,  D. (2017). The unbearable emptiness of tweeting\u2014About journal articles. PLOS ONE, 12(8), e0183551. https:\/\/doi.org\/10.1371\/journal.pone.0183551","DOI":"10.1371\/journal.pone.0183551"},{"key":"2025073014020256900_bib49","doi-asserted-by":"crossref","unstructured":"Rons,  N.\n           (2012). Partition-based field normalization: An approach to highly specialized publication records. Journal of Informetrics, 6(1), 1\u201310. https:\/\/doi.org\/10.1016\/j.joi.2011.09.008","DOI":"10.1016\/j.joi.2011.09.008"},{"key":"2025073014020256900_bib50","unstructured":"Rons,  N.\n           (2014). Investigation of Partition Cells as a Structural Basis Suitable for Assessments of Individual Scientists. In P.Wouters (Ed.), Proceedings of the Science and Technology Indicators Conference 2014 Leiden \u201cContext Counts: Pathways to Master Big and Little Data\u201d, pp. 463\u2013472. Leiden, Netherlands: University of Leiden."},{"key":"2025073014020256900_bib51","doi-asserted-by":"crossref","unstructured":"Samoilenko,  A., & Yasseri,  T. (2014). The distorted mirror of Wikipedia: A quantitative analysis of Wikipedia coverage of academics. EPJ Data Science, 3(1), 1.","DOI":"10.1140\/epjds20"},{"key":"2025073014020256900_bib52","unstructured":"SDSN Australia\/Pacific. (2017). Getting started with the SDGs in universities: A guide for universities, higher education institutions, and the academic sector. Australia, New Zealand and Pacific Edition. Sustainable Development Solutions Network\u2014Australia\/Pacific, Melbourne."},{"key":"2025073014020256900_bib53","doi-asserted-by":"crossref","unstructured":"Serrano-L\u00f3pez,  A. E., Ingwersen,  P., & Sanz-Casado,  E. (2017). Wind power research in Wikipedia: Does Wikipedia demonstrate direct influence of research publications and can it be used as adequate source in research evaluation?Scientometrics, 112(3), 1471\u20131488. https:\/\/doi.org\/10.1007\/s11192-017-2447-2","DOI":"10.1007\/s11192-017-2447-2"},{"key":"2025073014020256900_bib54","doi-asserted-by":"crossref","unstructured":"Shema,  H., Bar-Ilan,  J., & Thelwall,  M. (2012a). Research blogs and the discussion of scholarly information. PLOS ONE, 7(5), e35869. https:\/\/doi.org\/10.1371\/journal.pone.0035869","DOI":"10.1371\/journal.pone.0035869"},{"key":"2025073014020256900_bib55","unstructured":"Shema,  H., Bar-Ilan,  J., & Thelwall,  M. (2012b). Self-citation of bloggers in the science blogosphere. In A.Tokar, M.Beurskens, S.Keuneke, M.Mahrt, I.Peters, C.Puschmann, K.Weller, & T.van Treeck (Eds.), Science and the Internet, pp. 183\u2013192. D\u00fcsseldorf, Germany: D\u00fcsseldorf University Press."},{"key":"2025073014020256900_bib56","unstructured":"Shema,  H., Bar-Ilan,  J., & Thelwall,  M. (2014a). Scholarly blogs are a promising altmetric source. Research Trends, 37, 11\u201313."},{"key":"2025073014020256900_bib57","doi-asserted-by":"crossref","unstructured":"Shema,  H., Bar-Ilan,  J., & Thelwall,  M. (2014b). Do blog citations correlate with a higher number of future citations? Research blogs as a potential source for alternative metrics. Journal of the Association for Information Science and Technology, 65(5), 1018\u20131027. https:\/\/doi.org\/10.1002\/asi.23037","DOI":"10.1002\/asi.23037"},{"key":"2025073014020256900_bib58","unstructured":"Sheskin,  D.\n           (2007). Handbook of parametric and nonparametric statistical procedures (4th Ed.). Boca Raton, FL: Chapman & Hall\/CRC."},{"key":"2025073014020256900_bib59","unstructured":"Sugimoto,  C. R., Work,  S., Larivi\u00e8re,  V., & Haustein,  S. (2016). Scholarly use of social media and altmetrics: A review of the literature. Retrieved from https:\/\/arxiv.org\/abs\/1608.08112"},{"key":"2025073014020256900_bib60","doi-asserted-by":"crossref","unstructured":"Tattersall,  A., & Carroll,  C. (2018). What can Altmetric.com tell us about policy citations of research? An analysis of Altmetric.com data for research articles from the University of Sheffield. Frontiers in Research Metrics and Analytics, 2(9). https:\/\/doi.org\/10.3389\/frma.2017.00009","DOI":"10.3389\/frma.2017.00009"},{"key":"2025073014020256900_bib61","doi-asserted-by":"crossref","unstructured":"Teplitskiy,  M., Lu,  G., & Duede,  E. (2017). Amplifying the impact of open access: Wikipedia and the diffusion of science. Journal of the Association for Information Science and Technology, 68, 2116\u20132127. https:\/\/doi.org\/10.1002\/asi.23687","DOI":"10.1002\/asi.23687"},{"key":"2025073014020256900_bib62","doi-asserted-by":"crossref","unstructured":"Thune,  T., Reymert,  I., Gulbrandsen,  M., & Olaf Aamodt,  P. (2016). Universities and external engagement activities: Particular profiles for particular universities?Science and Public Policy, 43(6), 774\u2013786. https:\/\/doi:10.1002\/asi.23687","DOI":"10.1093\/scipol\/scw019"},{"key":"2025073014020256900_bib63","doi-asserted-by":"crossref","unstructured":"Vilkins,  S., & Grant,  W. J. (2017). Types of evidence cited in Australian Government publications. Scientometrics, 113(3), 1681\u20131695. https:\/\/doi.org\/10.1007\/s11192-017-2544-2","DOI":"10.1007\/s11192-017-2544-2"},{"key":"2025073014020256900_bib64","doi-asserted-by":"crossref","unstructured":"Wiek,  A., Talwar,  S., O\u2019Shea,  M., & Robinson,  J. (2014). Toward a methodological scheme for capturing societal effects of participatory sustainability research. Research Evaluation, 23(2), 117\u2013132.","DOI":"10.1093\/reseval\/rvt031"},{"key":"2025073014020256900_bib65","doi-asserted-by":"crossref","unstructured":"Wooldridge,  J., & King,  M. B. (2019). Altmetric scores: An early indicator of research impact. Journal of the Association for Information Science and Technology, 70(3), 271\u2013282. https:\/\/doi.org\/10.1002\/asi.24122","DOI":"10.1002\/asi.24122"},{"key":"2025073014020256900_bib66","doi-asserted-by":"crossref","unstructured":"Yarime,  M., Trencher,  G., Mino,  T., Scholz,  R. W., Olsson,  L., Ness,  B., \u2026 Rotmans,  J. (2012). Establishing sustainability science in higher education institutions: Towards an integration of academic development, institutionalization, and stakeholder collaborations. Sustainability Science, 7(1), 101\u2013113.","DOI":"10.1007\/s11625-012-0157-5"},{"key":"2025073014020256900_bib67","doi-asserted-by":"crossref","unstructured":"Yu,  H.\n           (2017). Context of altmetrics data matters: An investigation of count type and user category. Scientometrics, 111(1), 267\u2013283. https:\/\/doi.org\/10.1007\/s11192-017-2251-z","DOI":"10.1007\/s11192-017-2251-z"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/1\/2\/792\/1885750\/qss_a_00032.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/1\/2\/792\/1885750\/qss_a_00032.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T18:02:19Z","timestamp":1753898539000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/1\/2\/792\/96132\/Can-altmetrics-reflect-societal-impact"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"references-count":66,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,6,1]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00032","relation":{},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020]]},"published":{"date-parts":[[2020]]}}}