{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T12:28:02Z","timestamp":1774441682736,"version":"3.50.1"},"reference-count":20,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2019,2,1]],"date-time":"2019-02-01T00:00:00Z","timestamp":1548979200000},"content-version":"vor","delay-in-days":396,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["asistdl.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Proc. Assoc. Info. Sci. Tech."],"published-print":{"date-parts":[[2018,1]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:p>This panel will present views and critical reflections on peer review, bibliometrics and altmetrics against the background of the latest developments and critique of the scientific system (e.g., replication crisis, DORA, open science, data manipulation). Peer review is the oldest form of monitoring the scientific process and research outcomes and is sometimes considered as the gold standard for evaluating quality. However, it also has its drawbacks; therefore, new forms of peer review are being explored. Bibliometrics, comparative statistics based on publication and citation counts, was introduced as a more objective evaluation method, which is applicable on meso and macro levels of research producing units but is not without problems either. Citation counts as a proxy of quality; the impact factor and the h\u2010index are some of the most controversial subjects of research evaluation today. The newest addition to the evaluation toolbox are altmetrics, impact measures based mainly on social media activity. Altmetrics have pros and cons as well. None of the measuring devices is perfect, and rather than replacing they complement each other. By drawing on indicators from all three aspects of research evaluation, negative and adverse effects are limited.<\/jats:p>","DOI":"10.1002\/pra2.2018.14505501073","type":"journal-article","created":{"date-parts":[[2019,2,1]],"date-time":"2019-02-01T16:52:19Z","timestamp":1549039939000},"page":"653-656","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Peer review, bibliometrics and altmetrics \u2010 Do we need them all?"],"prefix":"10.1002","volume":"55","author":[{"given":"Judit","family":"Bar\u2010Ilan","sequence":"first","affiliation":[{"name":"Bar\u2010Ilan University Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefanie","family":"Haustein","sequence":"additional","affiliation":[{"name":"University of Ottawa Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sta\u0161a","family":"Milojevi\u0107","sequence":"additional","affiliation":[{"name":"Indiana University Bloomington United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Isabella","family":"Peters","sequence":"additional","affiliation":[{"name":"ZBW Leibniz Information Center for Economics &amp; Kiel University Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dietmar","family":"Wolfram","sequence":"additional","affiliation":[{"name":"University of Wisconsin\u2010Milwaukee United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2019,2]]},"reference":[{"key":"e_1_2_6_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-012-0671-3"},{"key":"e_1_2_6_3_1","unstructured":"Bar\u2010Ilan J. &Peters I.(2016).Next\u2010generation metrics: responsible metrics and evaluation for open science. Presentation at 3:AM Conference Bucharest Romania. Retrieved fromhttps:\/\/dx.doi.org\/10.6084\/m9.figshare.c.3488817.v1"},{"key":"e_1_2_6_4_1","unstructured":"Belluz J. Plumer B. &Resnick B.(2016).The 7 biggest problems facing science according to 270 scientists. Retrieved from:http:\/\/www.vox.com\/2016\/7\/14\/12016710\/science-challeges-research-funding-peer-review-process."},{"issue":"10","key":"e_1_2_6_5_1","first-page":"2003","article-title":"Do \u201caltmetrics\u201d correlate with citations?","volume":"66","author":"Costas R.","year":"2015","journal-title":"Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology"},{"key":"e_1_2_6_6_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvv038"},{"key":"e_1_2_6_7_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.-pbio.1001677"},{"key":"e_1_2_6_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-016-1910-9"},{"key":"e_1_2_6_9_1","doi-asserted-by":"crossref","unstructured":"Haustein S. Bowman T. D. &Costas R.(2016).Interpreting \u201caltmetrics\u201d: viewing acts on social media through the lens of citation and social theories. In C. R. Sugimoto (Ed.) Theories of informetrics and scholarly communication. A Festschrift in Honor of Blaise Cronin (pp.372\u2013405). Berlin: De Gruyter. Retrieved fromhttp:\/\/arxiv.org\/abs\/1502.05701","DOI":"10.1515\/9783110308464-022"},{"key":"e_1_2_6_10_1","doi-asserted-by":"crossref","unstructured":"Haustein S&Larivi\u00e8re V.(2015).The use of bibliometrics for assessing research: possibilities limitations and adverse effects. In I. M. Welpe J. Wollersheim S. Ringelhahn & M. Osterloh (Eds.) Incentives and Performance. Governance of Research Organizations (pp.121\u2013139). Springer. Retrieved from:http:\/\/crc.ebsi.umontreal.ca\/files\/sites\/60\/2015\/10\/HausteinLariviere_revised2.pdf","DOI":"10.1007\/978-3-319-09785-5_8"},{"key":"e_1_2_6_11_1","doi-asserted-by":"publisher","DOI":"10.1038\/520429a"},{"key":"e_1_2_6_12_1","doi-asserted-by":"crossref","unstructured":"Hirsch J. E.(2005).An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences of the USA 102(46) 16569\u201316572.","DOI":"10.1073\/pnas.0507655102"},{"key":"e_1_2_6_13_1","volume-title":"Citation Analysis in Research Evaluation","author":"Moed H.F.","year":"2005"},{"key":"e_1_2_6_14_1","unstructured":"Nielsen M.(2009).Three myths about scientific peer review. Retrieved fromhttp:\/\/michaelnielsen.org\/blog\/three-myths-about-scientific-peer-review\/"},{"key":"e_1_2_6_15_1","unstructured":"NISO(2016).Outputs of the NISO Alternative Assessment Metrics Project. Retrieved fromhttps:\/\/groups.niso.org\/apps\/group_public\/download.php\/17091\/NISO%20RP-25-2016%20Outputs%20of%20the%20NISO%20Alternative%20Assessment%20Project.pdf"},{"key":"e_1_2_6_16_1","unstructured":"Priem J. Taraborelli D. Groth P. &Neylon V.(2010).Altmetrics: A manifesto. Retrieved fromhttp:\/\/altmetrics.org\/manifesto"},{"key":"e_1_2_6_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-7799(02)01985-6"},{"key":"e_1_2_6_18_1","unstructured":"Sugimoto C. R. Haustein S. Ke Q. &Larivi\u00e8re V.(2016).Social Media Metrics as Indicators of Broader Impact. OECD Blue Sky III Forum on Science and Innovation Indicators. Gent (Belgium). Retrieved fromhttp:\/\/www.oecd.org\/sti\/172%20-%20SugimotoOECDaltmetrics.pdf"},{"key":"e_1_2_6_19_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.318.7175.23"},{"key":"e_1_2_6_20_1","doi-asserted-by":"publisher","DOI":"10.20309\/jdis.201625"},{"key":"e_1_2_6_21_1","doi-asserted-by":"crossref","unstructured":"Wilsdon J. R. Allen L. Belfiore E. Campbell P. Curry S. Hill S. \u2026 &Johnson B.(2015).The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management. doi:10.13140\/RG.2.1.4929.1363","DOI":"10.4135\/9781473978782"}],"container-title":["Proceedings of the Association for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fpra2.2018.14505501073","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/pra2.2018.14505501073","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/pra2.2018.14505501073","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/pra2.2018.14505501073","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T17:43:48Z","timestamp":1761068628000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/pra2.2018.14505501073"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1]]},"references-count":20,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,1]]}},"alternative-id":["10.1002\/pra2.2018.14505501073"],"URL":"https:\/\/doi.org\/10.1002\/pra2.2018.14505501073","archive":["Portico"],"relation":{},"ISSN":["2373-9231","2373-9231"],"issn-type":[{"value":"2373-9231","type":"print"},{"value":"2373-9231","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1]]},"assertion":[{"value":"2019-02-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}