{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T16:26:10Z","timestamp":1771604770076,"version":"3.50.1"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2021,10,24]],"date-time":"2021-10-24T00:00:00Z","timestamp":1635033600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,24]],"date-time":"2021-10-24T00:00:00Z","timestamp":1635033600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"crossref","award":["01PQ16004"],"award-info":[{"award-number":["01PQ16004"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["01PQ17001"],"award-info":[{"award-number":["01PQ17001"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Deutsches Zentrum f\u00fcr Hochschul- und Wissenschaftsforschung GmbH (DZHW)"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This study investigates the potential of citation analysis of Ph.D. theses to obtain valid and useful early career performance indicators at the level of university departments. For German theses from 1996 to 2018 the suitability of citation data from Scopus and Google Books is studied and found to be sufficient to obtain quantitative estimates of early career researchers\u2019 performance at departmental level in terms of scientific recognition and use of their dissertations as reflected in citations. Scopus and Google Books citations complement each other and have little overlap. Individual theses\u2019 citation counts are much higher for those awarded a dissertation award than others. Departmental level estimates of citation impact agree reasonably well with panel committee peer review ratings of early career researcher support.<\/jats:p>","DOI":"10.1007\/s11192-021-04173-w","type":"journal-article","created":{"date-parts":[[2021,10,24]],"date-time":"2021-10-24T05:02:16Z","timestamp":1635051736000},"page":"9431-9456","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Citation analysis of Ph.D. theses with data from Scopus and Google Books"],"prefix":"10.1007","volume":"126","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5737-8483","authenticated-orcid":false,"given":"Paul","family":"Donner","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,10,24]]},"reference":[{"key":"4173_CR1","doi-asserted-by":"publisher","unstructured":"Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019). Citations, citation indicators, and research quality: An overview of basic concepts and theories. Sage Open, 9(1). https:\/\/doi.org\/10.1177\/2158244019829575.","DOI":"10.1177\/2158244019829575"},{"issue":"4","key":"4173_CR2","doi-asserted-by":"publisher","first-page":"469","DOI":"10.2307\/2095801","volume":"55","author":"PD Allison","year":"1990","unstructured":"Allison, P. D., & Long, J. S. (1990). Departmental effects on scientific productivity. American Sociological Review, 55(4), 469\u2013478. https:\/\/doi.org\/10.2307\/2095801.","journal-title":"American Sociological Review"},{"issue":"1","key":"4173_CR3","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1108\/00220410810844150","volume":"64","author":"L Bornmann","year":"2008","unstructured":"Bornmann, L., & Daniel, H.-D. (2008). What do citation counts measure? A review of studies on citing behavior. Journal of Documentation, 64(1), 45\u201380. https:\/\/doi.org\/10.1108\/00220410810844150.","journal-title":"Journal of Documentation"},{"issue":"1","key":"4173_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v080.i01","volume":"80","author":"P-C B\u00fcrkner","year":"2017","unstructured":"B\u00fcrkner, P.-C. (2017). brms: An R package for Bayesian multilevel models using Stan. Journal of Statistical Software, 80(1), 1\u201328.","journal-title":"Journal of Statistical Software"},{"key":"4173_CR6","unstructured":"Chuadja, M. (2021). Promotionen an der Charit\u00e9 Berlin von 1998 bis 2015. Qualit\u00e4t, Dauer, Promotionstyp (Ph.D. thesis). Charit\u00e9 - Universit\u00e4tsmedizin Berlin."},{"key":"4173_CR7","unstructured":"Consortium for the National Report on Junior Scholars. (2017). 2017 National Report on Junior Scholars. Statistical Data and Research Findings on Doctoral Students and Doctorate Holders in Germany. Overview of Key Results. Retrieved from https:\/\/www.buwin.de\/dateien\/buwin-2017-keyresults.pdf."},{"key":"4173_CR8","doi-asserted-by":"publisher","unstructured":"Diekmann, A., N\u00e4f, M., & Schubiger, M. (2012). Die Rezeption (Thyssen-) preisgekr\u00f6nter Artikel in der \u201cScientific Community.\u201d K\u00f6lner Zeitschrift f\u00fcr Soziologie und Sozialpsychologie, 64(3), 563\u2013581. https:\/\/doi.org\/10.1007\/s11577-012-0175-4.","DOI":"10.1007\/s11577-012-0175-4"},{"issue":"3","key":"4173_CR9","doi-asserted-by":"publisher","first-page":"662","DOI":"10.1002\/asi.23399","volume":"67","author":"P Donner","year":"2016","unstructured":"Donner, P. (2016). Enhanced self-citation detection by fuzzy author name matching and complementary error estimates. Journal of the Association for Information Science and Technology, 67(3), 662\u2013670. https:\/\/doi.org\/10.1002\/asi.23399.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"2","key":"4173_CR10","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1162\/qss_a_00048","volume":"1","author":"P Donner","year":"2020","unstructured":"Donner, P. (2020). A validation of coauthorship credit models with empirical data from the contributions of PhD candidates. Quantitative Science Studies, 1(2), 551\u2013564. https:\/\/doi.org\/10.1162\/qss_a_00048.","journal-title":"Quantitative Science Studies"},{"key":"4173_CR11","doi-asserted-by":"publisher","unstructured":"Evans, S. C., Amaro, C. M., Herbert, R., Blossom, J. B., & Roberts, M. C. (2018). \u201cAre you gonna publish that?\u201d Peer-reviewed publication outcomes of doctoral dissertations in psychology. PloS ONE,13(2), e0192219. https:\/\/doi.org\/10.1371\/journal.pone.0192219","DOI":"10.1371\/journal.pone.0192219"},{"issue":"10","key":"4173_CR12","doi-asserted-by":"publisher","first-page":"2070","DOI":"10.1002\/asi.21372","volume":"61","author":"MA Garc\u00eda-P\u00e9rez","year":"2010","unstructured":"Garc\u00eda-P\u00e9rez, M. A. (2010). Accuracy and completeness of publication and citation records in the Web of Science, PsycINFO, and Google Scholar: A case study for the computation of h indices in Psychology. Journal of the American Society for Information Science and Technology, 61(10), 2070\u20132085. https:\/\/doi.org\/10.1002\/asi.21372.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"3","key":"4173_CR13","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1023\/b:scie.0000045117.13348.b1","volume":"61","author":"W Gl\u00e4nzel","year":"2004","unstructured":"Gl\u00e4nzel, W., & Thijs, B. (2004). Does co-authorship inflate the share of self-citations? Scientometrics, 61(3), 395\u2013404. https:\/\/doi.org\/10.1023\/b:scie.0000045117.13348.b1.","journal-title":"Scientometrics"},{"issue":"2","key":"4173_CR14","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1016\/0143-6236(85)90017-1","volume":"5","author":"A Hay","year":"1985","unstructured":"Hay, A. (1985). Some differences in citation between articles based on thesis work and those written by established researchers: Human geography in the UK 1974\u20131984. Social Science Information Studies, 5(2), 81\u201385. https:\/\/doi.org\/10.1016\/0143-6236(85)90017-1.","journal-title":"Social Science Information Studies"},{"key":"4173_CR15","doi-asserted-by":"publisher","unstructured":"Heinisch, D. P., & Buenstorf, G. (2018). The next generation (plus one): An analysis of doctoral student\u2019s academic fecundity based on a novel approach to advisor identification. Scientometrics,117(1), 351\u2013380. https:\/\/doi.org\/10.1007\/s11192-018-2840-5","DOI":"10.1007\/s11192-018-2840-5"},{"key":"4173_CR16","doi-asserted-by":"publisher","unstructured":"Heinisch, D. P., Koenig, J., & Otto, A. (2020). A supervised machine learning approach to trace doctorate recipient\u2019s employment trajectories. Quantitative Science Studies,1(1), 94\u2013116. https:\/\/doi.org\/10.1162\/qss_a_00001","DOI":"10.1162\/qss_a_00001"},{"issue":"2","key":"4173_CR17","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1080\/02691729608578815","volume":"10","author":"S Hemlin","year":"1996","unstructured":"Hemlin, S. (1996). Research on research evaluation. Social Epistemology, 10(2), 209\u2013250. https:\/\/doi.org\/10.1080\/02691729608578815.","journal-title":"Social Epistemology"},{"issue":"2","key":"4173_CR18","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1017\/S1049096511000242","volume":"44","author":"VL Hesli","year":"2011","unstructured":"Hesli, V. L., & Lee, J. M. (2011). Faculty research productivity: Why do some of our colleagues publish more than others? PS: Political Science & Politics, 44(2), 393\u2013408. https:\/\/doi.org\/10.1017\/S1049096511000242.","journal-title":"PS: Political Science & Politics"},{"issue":"1","key":"4173_CR19","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1111\/j.1467-8276.2007.00970.x","volume":"89","author":"CE Hilmer","year":"2007","unstructured":"Hilmer, C. E., & Hilmer, M. J. (2007). On the relationship between the student-advisor match and early career research productivity for agricultural and resource economics Ph.Ds. American Journal of Agricultural Economics, 89(1), 162\u2013175. https:\/\/doi.org\/10.1111\/j.1467-8276.2007.00970.x.","journal-title":"American Journal of Agricultural Economics"},{"key":"4173_CR20","doi-asserted-by":"publisher","unstructured":"Hinze, S., Butler, L., Donner, P., & McAllister, I. (2019). Different processes, similar results? A comparison of performance assessment in three countries. In W. Gl\u00e4nzel, H. F. Moed, U. Schmoch, & M. Thelwall (Eds.), Springer handbook of science and technology indicators (pp. 465\u2013484). Berlin: Springer. https:\/\/doi.org\/10.1007\/978-3-030-02511-3_18.","DOI":"10.1007\/978-3-030-02511-3_18"},{"key":"4173_CR21","unstructured":"Hochschulrektorenkonferenz. (2012). Zur Qualit\u00e4tssicherung in Promotionsverfahren. Retrieved from https:\/\/www.hrk.de\/positionen\/beschluss\/detail\/zur-qualitaetssicherung-in-promotionsverfahren\/."},{"issue":"3","key":"4173_CR23","first-page":"32","volume":"12","author":"M Jaeger","year":"2006","unstructured":"Jaeger, M. (2006). Leistungsbezogene Budgetierung an deutschen Universit\u00e4ten - Umsetzung und Perspektiven. Wissenschaftsmanagement, 12(3), 32\u201338.","journal-title":"Wissenschaftsmanagement"},{"issue":"2","key":"4173_CR24","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1080\/08832320903258535","volume":"85","author":"K Kim","year":"2009","unstructured":"Kim, K., & Karau, S. J. (2009). Working environment and the research productivity of doctoral students in management. Journal of Education for Business, 85(2), 101\u2013106. https:\/\/doi.org\/10.1080\/08832320903258535.","journal-title":"Journal of Education for Business"},{"issue":"2","key":"4173_CR25","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1002\/asi.23170","volume":"66","author":"K Kousha","year":"2015","unstructured":"Kousha, K., & Thelwall, M. (2015). An automatic method for extracting citations from Google Books. Journal of the Association for Information Science and Technology, 66(2), 309\u2013320. https:\/\/doi.org\/10.1002\/asi.23170.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"2","key":"4173_CR26","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1016\/j.joi.2019.02.009","volume":"13","author":"K Kousha","year":"2019","unstructured":"Kousha, K., & Thelwall, M. (2019). Can Google Scholar and Mendeley help to assess the scholarly impacts of dissertations? Journal of Informetrics, 13(2), 467\u2013484. https:\/\/doi.org\/10.1016\/j.joi.2019.02.009.","journal-title":"Journal of Informetrics"},{"issue":"2","key":"4173_CR27","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1007\/s11192-011-0495-6","volume":"90","author":"V Larivi\u00e8re","year":"2012","unstructured":"Larivi\u00e8re, V. (2012). On the shoulders of students? The contribution of PhD students to the advancement of knowledge. Scientometrics, 90(2), 463\u2013481. https:\/\/doi.org\/10.1007\/s11192-011-0495-6.","journal-title":"Scientometrics"},{"issue":"1","key":"4173_CR28","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1007\/s11192-008-0106-3","volume":"74","author":"V Larivi\u00e8re","year":"2008","unstructured":"Larivi\u00e8re, V., Zuccala, A., & Archambault, \u00c9. (2008). The declining scientific impact of theses: Implications for electronic thesis and dissertation repositories and graduate studies. Scientometrics, 74(1), 109\u2013121. https:\/\/doi.org\/10.1007\/s11192-008-0106-3.","journal-title":"Scientometrics"},{"issue":"3","key":"4173_CR29","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1007\/s10734-007-9063-7","volume":"55","author":"G Laudel","year":"2008","unstructured":"Laudel, G., & Gl\u00e4ser, J. (2008). From apprentice to colleague: The metamorphosis of early career researchers. Higher Education, 55(3), 387\u2013406. https:\/\/doi.org\/10.1007\/s10734-007-9063-7.","journal-title":"Higher Education"},{"issue":"3\u20136","key":"4173_CR30","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1007\/BF02017149","volume":"7","author":"JS Long","year":"1985","unstructured":"Long, J. S., & McGinnis, R. (1985). The effects of the mentor on the academic career. Scientometrics, 7(3\u20136), 255\u2013280. https:\/\/doi.org\/10.1007\/BF02017149.","journal-title":"Scientometrics"},{"issue":"2","key":"4173_CR31","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/0048-7333(83)90005-7","volume":"12","author":"BR Martin","year":"1983","unstructured":"Martin, B. R., & Irvine, J. (1983). Assessing basic research: Some partial indicators of scientific progress in radio astronomy. Research Policy, 12(2), 61\u201390. https:\/\/doi.org\/10.1016\/0048-7333(83)90005-7.","journal-title":"Research Policy"},{"issue":"134","key":"4173_CR32","doi-asserted-by":"publisher","first-page":"20170213","DOI":"10.1098\/rsif.2017.0213","volume":"14","author":"S Nakagawa","year":"2017","unstructured":"Nakagawa, S., Johnson, P. C. D., & Schielzeth, H. (2017). The coefficient of determination $${R}^{2}$$ and intra-class correlation coefficient from generalized linear mixed-effects models revisited and expanded. Journal of the Royal Society Interface, 14(134), 20170213. https:\/\/doi.org\/10.1098\/rsif.2017.0213.","journal-title":"Journal of the Royal Society Interface"},{"issue":"5\u20136","key":"4173_CR33","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1007\/bf02279353","volume":"11","author":"A Nederhof","year":"1987","unstructured":"Nederhof, A., & van Raan, A. (1987). Peer review and bibliometric indicators of scientific performance: A comparison of cum laude doctorates with ordinary doctorates in physics. Scientometrics, 11(5\u20136), 333\u2013350. https:\/\/doi.org\/10.1007\/bf02279353.","journal-title":"Scientometrics"},{"issue":"5\u20136","key":"4173_CR34","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1007\/BF02017463","volume":"17","author":"A Nederhof","year":"1989","unstructured":"Nederhof, A., & van Raan, A. (1989). A validation study of bibliometric indicators: The comparative performance of cum laude doctorates in chemistry. Scientometrics, 17(5\u20136), 427\u2013435. https:\/\/doi.org\/10.1007\/BF02017463.","journal-title":"Scientometrics"},{"issue":"4","key":"4173_CR35","first-page":"94","volume":"14","author":"F Niggemann","year":"2020","unstructured":"Niggemann, F. (2020). Interne LOM und ZLV als Instrumente der Universit\u00e4tsleitung. Qualit\u00e4t in der Wissenschaft, 14(4), 94\u201398.","journal-title":"Qualit\u00e4t in der Wissenschaft"},{"key":"4173_CR36","unstructured":"Oestmann, J. W., Meyer, M., & Ziemann, E. (2015). Medizinische Promotionen: H\u00f6here wissenschaftliche Effizienz. Deutsches \u00c4rzteblatt, 112(42), A\u20131706\/B\u20131416\/C\u20131388."},{"key":"4173_CR22","unstructured":"Projektgruppe Indikatorenmodell. (2014). Indikatorenmodell f\u00fcr die Berichterstattung zum wissenschaftlichen Nachwuchs. Retrieved from https:\/\/www.destatis.de\/DE\/Themen\/Gesellschaft-Umwelt\/Bildung-Forschung-Kultur\/Hochschulen\/Publikationen\/Downloads-Hochschulen\/indikatorenmodell-endbericht.pdf."},{"key":"4173_CR37","doi-asserted-by":"publisher","unstructured":"Rogge, J.-C., & Tesch, J. (2016). Wissenschaftspolitik und wissenschaftliche Karriere. In D. Simon, A. Knie, S. Hornbostel, & K. Zimmermann (Eds.), Handbuch Wissenschaftspolitik (2nd ed., pp. 355\u2013374). Berlin: Springer. https:\/\/doi.org\/10.1007\/978-3-658-05455-7_25","DOI":"10.1007\/978-3-658-05455-7_25"},{"key":"4173_CR4","unstructured":"Statistisches Bundesamt. (2018). Pr\u00fcfungen an Hochschulen 2017. Retrieved from https:\/\/www.destatis.de\/DE\/Themen\/Gesellschaft-Umwelt\/Bildung-Forschung-Kultur\/Hochschulen\/Publikationen\/Downloads-Hochschulen\/pruefungen-hochschulen-2110420177004.pdf."},{"key":"4173_CR38","first-page":"68","volume":"1","author":"M Vollmar","year":"2019","unstructured":"Vollmar, M. (2019). Neue Promovierendenstatistik: Analyse der ersten Erhebung 2017. WISTA - Wirtschaft und Statistik, 1, 68\u201380.","journal-title":"WISTA - Wirtschaft und Statistik"},{"issue":"3+4","key":"4173_CR39","first-page":"97","volume":"10","author":"J Wespel","year":"2015","unstructured":"Wespel, J., & Jaeger, M. (2015). Leistungsorientierte Zuweisungsverfahren der L\u00e4nder: Praktische Umsetzung und Entwicklungen. Hochschulmanagement, 10(3+4), 97\u2013105.","journal-title":"Hochschulmanagement"},{"key":"4173_CR40","unstructured":"Wissenschaftsrat. (2002). Empfehlungen zur Doktorandenausbildung. Saarbr\u00fccken."},{"key":"4173_CR41","unstructured":"Wissenschaftsrat. (2004). Empfehlungen zu forschungs-und lehrf\u00f6rderlichen Strukturen in der Universit\u00e4tsmedizin. Berlin."},{"key":"4173_CR42","unstructured":"Wissenschaftsrat. (2007). Forschungsleistungen deutscher Universit\u00e4ten und au\u00dferuniversit\u00e4rer Einrichtungen in der Chemie. K\u00f6ln."},{"key":"4173_CR43","unstructured":"Wissenschaftsrat. (2008). Forschungsleistungen deutscher Universit\u00e4ten und au\u00dferuniversit\u00e4rer Einrichtungen in der Soziologie. K\u00f6ln."},{"key":"4173_CR44","unstructured":"Wissenschaftsrat. (2011). Ergebnisse des Forschungsratings Elektrotechnik und Informationstechnik. K\u00f6ln."},{"key":"4173_CR45","unstructured":"Wissenschaftsrat. (2012). Ergebnisse des Forschungsratings Anglistik und Amerikanistik. K\u00f6ln."},{"issue":"1","key":"4173_CR46","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/00380237.1974.10570872","volume":"7","author":"WC Yoels","year":"1974","unstructured":"Yoels, W. C. (1974). On the fate of the Ph.D. dissertation: A comparative examination of the physical and social sciences. Sociological Focus, 7(1), 1\u201313. https:\/\/doi.org\/10.1080\/00380237.1974.10570872.","journal-title":"Sociological Focus"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-021-04173-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-021-04173-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-021-04173-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T21:27:17Z","timestamp":1638307637000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-021-04173-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,24]]},"references-count":46,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["4173"],"URL":"https:\/\/doi.org\/10.1007\/s11192-021-04173-w","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,24]]},"assertion":[{"value":"21 January 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 September 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}