{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,26]],"date-time":"2025-09-26T07:56:00Z","timestamp":1758873360777,"version":"3.40.5"},"reference-count":50,"publisher":"MIT Press","issue":"1","content-domain":{"domain":["www.mitpressjournals.org"],"crossmark-restriction":true},"short-container-title":["Quantitative Science Studies"],"published-print":{"date-parts":[[2020,2]]},"abstract":"<jats:p>Fast-and-frugal heuristics are simple strategies that base decisions on only a few predictor variables. In so doing, heuristics may not only reduce complexity but also boost the accuracy of decisions, their speed, and transparency. In this paper, bibliometrics-based decision trees (BBDTs) are introduced for research evaluation purposes. BBDTs visualize bibliometrics-based heuristics (BBHs), which are judgment strategies solely using publication and citation data. The BBDT exemplar presented in this paper can be used as guidance to find an answer on the question in which situations simple indicators such as mean citation rates are reasonable and in which situations more elaborated indicators (i.e., [sub-]field-normalized indicators) should be applied.<\/jats:p>","DOI":"10.1162\/qss_a_00012","type":"journal-article","created":{"date-parts":[[2019,12,11]],"date-time":"2019-12-11T18:39:21Z","timestamp":1576089561000},"page":"171-182","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":12,"title":["Bibliometrics-based decision trees (BBDTs) based on bibliometrics-based heuristics (BBHs): Visualized guidelines for the use of bibliometrics in research evaluation"],"prefix":"10.1162","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0810-7091","authenticated-orcid":true,"given":"Lutz","family":"Bornmann","sequence":"first","affiliation":[{"name":"Administrative Headquarters of the Max Planck Society, Division for Science and Innovation Studies, Hofgartenstra\u00dfe 8, 80539 Munich, Germany"}]}],"member":"281","reference":[{"volume-title":"Encyclopedia of Research Methods","author":"Bornmann L.","key":"bib1"},{"key":"bib2","doi-asserted-by":"crossref","first-page":"201","DOI":"10.7551\/mitpress\/9445.003.0015","volume-title":"Beyond Bibliometrics: Harnessing Multidimensional Indicators of Scholarly Impact","author":"Bornmann L.","year":"2014"},{"issue":"2","key":"bib4","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1007\/s11192-019-03018-x","volume":"120","author":"Bornmann L.","year":"2019","journal-title":"Scientometrics"},{"issue":"1","key":"bib5","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1007\/s11192-013-1161-y","volume":"98","author":"Bornmann L.","year":"2014","journal-title":"Scientometrics"},{"issue":"2","key":"bib6","doi-asserted-by":"crossref","first-page":"78","DOI":"10.3390\/publications1020078","volume":"1","author":"Bornmann L.","year":"2013","journal-title":"Publications"},{"key":"bib7","doi-asserted-by":"crossref","first-page":"93","DOI":"10.3354\/esep00084","volume":"8","author":"Bornmann L.","year":"2008","journal-title":"Ethics in Science and Environmental Politics"},{"issue":"2","key":"bib8","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1007\/s11192-019-03140-w","volume":"120","author":"Bornmann L.","year":"2019","journal-title":"Scientometrics"},{"key":"bib9","doi-asserted-by":"crossref","first-page":"5192","DOI":"10.1073\/pnas.0307509100","volume":"101","author":"Boyack K. W.","year":"2004","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"bib10","first-page":"97","volume-title":"Simple heuristics that make us smart","author":"Czerlinski J.","year":"1999"},{"volume-title":"Bibliometrics and citation analysis: From the Science Citation Index to cybermetrics","year":"2009","author":"de Bellis N.","key":"bib11"},{"issue":"4","key":"bib12","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1037\/0033-295X.103.4.650","volume":"103","author":"Gigerenzer G.","year":"1996","journal-title":"Psychological Review"},{"volume-title":"Simple heuristics that make us smart","year":"1999","author":"Gigerenzer G.","key":"bib13"},{"issue":"7","key":"bib14","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1002\/asi.24043","volume":"69","author":"Hammarfelt B.","year":"2018","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"bib16","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1002\/047001332X.ch11","volume-title":"Thinking: Psychological Perspectives on Reasoning, Judgment and Decision Making","author":"Hertwig R.","year":"2003"},{"issue":"7548","key":"bib17","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/520429a","volume":"520","author":"Hicks D.","year":"2015","journal-title":"Nature"},{"issue":"6","key":"bib18","doi-asserted-by":"crossref","first-page":"e0199031","DOI":"10.1371\/journal.pone.0199031","volume":"13","author":"Jappe A.","year":"2018","journal-title":"PLOS ONE"},{"issue":"1","key":"bib19","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1287\/deca.1100.0191","volume":"8","author":"Katsikopoulos K. V.","year":"2011","journal-title":"Decision Analysis"},{"key":"bib20","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780199755608.001.0001","volume-title":"The heuristics debate","author":"Kelman M.","year":"2011"},{"issue":"1","key":"bib21","first-page":"48","volume":"3","author":"Kurz-Milcke E.","year":"2007","journal-title":"Marketing"},{"key":"bib22","doi-asserted-by":"crossref","unstructured":"Leydesdorff, L., Wouters, P. & Bornmann, L. (2016). Professional and citizen bibliometrics: Complementarities and ambivalences in the development and use of indicators \u2013 a state-of-the-art report. Scientometrics, 109(3), 2129\u20132150. https:\/\/doi.org\/10.1007\/s11192-016-2150-8","DOI":"10.1007\/s11192-016-2150-8"},{"key":"bib23","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.obhdp.2017.05.003","volume":"141","author":"Luan S. H.","year":"2017","journal-title":"Organizational Behavior and Human Decision Processes"},{"issue":"1","key":"bib24","doi-asserted-by":"crossref","first-page":"72","DOI":"10.3724\/SP.J.1041.2010.00072","volume":"42","author":"Marewski J. N.","year":"2010","journal-title":"Acta Psychologica Sinica"},{"issue":"6","key":"bib25","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1016\/j.jmp.2008.04.003","volume":"52","author":"Martignon L.","year":"2008","journal-title":"Journal of Mathematical Psychology"},{"key":"bib26","first-page":"4","volume-title":"Heuristics: The Foundations of Adaptive Behavior","author":"Martignon L.","year":"2011"},{"volume-title":"On the shoulders of giants","year":"1965","author":"Merton R. K.","key":"bib27"},{"key":"bib28","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-60522-7","volume-title":"Applied evaluative informetrics","author":"Moed H. F.","year":"2017"},{"issue":"3","key":"bib29","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/0048-7333(85)90012-5","volume":"14","author":"Moed H. F.","year":"1985","journal-title":"Research Policy"},{"issue":"4","key":"bib30","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/s41412-017-0058-z","volume":"34","author":"Mousavi S.","year":"2017","journal-title":"Homo Oeconomicus"},{"issue":"2","key":"bib31","first-page":"99","volume":"14","author":"Narin F.","year":"1987","journal-title":"Science and Public Policy"},{"issue":"3","key":"bib32","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/j.joi.2010.02.003","volume":"4","author":"Opthof T.","year":"2010","journal-title":"Journal of Informetrics"},{"issue":"4","key":"bib33","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1017\/S1930297500006239","volume":"12","author":"Phillips N. D.","year":"2017","journal-title":"Judgment and Decision Making"},{"key":"bib34","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1007\/978-3-030-00066-0_17","volume-title":"Digital Libraries for Open Knowledge. TPDL 2018","volume":"11057","author":"Pride D.","year":"2018"},{"key":"bib35","doi-asserted-by":"crossref","DOI":"10.3389\/fpsyg.2015.01672","volume":"6","author":"Raab M.","year":"2015","journal-title":"Frontiers in Psychology"},{"issue":"4","key":"bib36","volume":"83","author":"Radicchi F.","year":"2011","journal-title":"Physical Review E"},{"key":"bib37","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1093\/reseval\/rvz014","volume":"28","author":"Robinson-Garcia N.","year":"2019","journal-title":"Research Evaluation"},{"key":"bib39","first-page":"194","volume-title":"Making Essential Choices with Scant Information; Front-end Decision Making in Major Projects","author":"Scheibehenne B.","year":"2009"},{"issue":"2","key":"bib40","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1037\/h0042769","volume":"63","author":"Simon H. A.","year":"1956","journal-title":"Psychological Review"},{"issue":"1","key":"bib41","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1146\/annurev.ps.41.020190.000245","volume":"41","author":"Simon H. A.","year":"1990","journal-title":"Annual Review of Psychology"},{"key":"bib42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/2378023116640278","volume":"2","author":"Teplitskiy M.","year":"2016","journal-title":"Socius"},{"key":"bib43","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780195315448.001.0001","volume-title":"Ecological rationality: Intelligence in the world","author":"Todd P. M.","year":"2012"},{"key":"bib44","doi-asserted-by":"crossref","DOI":"10.1002\/9783527681969","volume-title":"Handbook of bibliometric indicators: Quantitative tools for studying and evaluating research","author":"Todeschini R.","year":"2016"},{"issue":"1","key":"bib45","doi-asserted-by":"crossref","DOI":"10.1057\/s41599-019-0233-x","volume":"5","author":"Traag V. A.","year":"2019","journal-title":"Palgrave Communications"},{"issue":"3","key":"bib46","first-page":"39","volume":"20","author":"Tuccio W. A.","year":"2011","journal-title":"Journal of Aviation\/Aerospace Education & Research"},{"key":"bib47","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/1-4020-2755-9_2","volume-title":"Handbook of Quantitative Science and Technology Research. The Use of Publication and Patent Statistics in Studies of S&T Systems","author":"van Raan A. F. J.","year":"2004"},{"key":"bib48","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1016\/j.joi.2010.03.008","volume":"4","author":"van Raan A. F. J.","year":"2010","journal-title":"Journal of Informetrics"},{"key":"bib49","doi-asserted-by":"crossref","DOI":"10.1533\/9781780630250","volume-title":"The evaluation of research by scientometric indicators","author":"Vinkler P.","year":"2010"},{"issue":"2","key":"bib50","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/j.joi.2016.02.007","volume":"10","author":"Waltman L.","year":"2016","journal-title":"Journal of Informetrics"},{"key":"bib51","first-page":"526","volume-title":"Proceedings of the Science and Technology Indicators Conference 2018 in Leiden \u201cScience, Technology and Innovation Indicators in Transition\u201d","author":"Waltman L.","year":"2018"},{"issue":"12","key":"bib52","doi-asserted-by":"crossref","first-page":"2419","DOI":"10.1002\/asi.22708","volume":"63","author":"Waltman L.","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"8","key":"bib53","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1111\/j.1365-2923.2009.03359.x","volume":"43","author":"Wegwarth O.","year":"2009","journal-title":"Medical Education"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/qss_a_00012","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,28]],"date-time":"2024-07-28T12:34:51Z","timestamp":1722170091000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/1\/1\/171-182\/15567"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2]]},"references-count":50,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,2]]}},"alternative-id":["10.1162\/qss_a_00012"],"URL":"https:\/\/doi.org\/10.1162\/qss_a_00012","relation":{},"ISSN":["2641-3337"],"issn-type":[{"type":"electronic","value":"2641-3337"}],"subject":[],"published":{"date-parts":[[2020,2]]},"assertion":[{"value":"2019-04-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-11-17","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-02-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}