{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,17]],"date-time":"2026-02-17T12:21:27Z","timestamp":1771330887986,"version":"3.50.1"},"reference-count":51,"publisher":"MIT Press","issue":"3","license":[{"start":{"date-parts":[[2021,8,23]],"date-time":"2021-08-23T00:00:00Z","timestamp":1629676800000},"content-version":"vor","delay-in-days":234,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["01PQ16004"],"award-info":[{"award-number":["01PQ16004"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["01PQ17001"],"award-info":[{"award-number":["01PQ17001"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,11,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Cumulative dissertations are doctoral theses comprised of multiple published articles. For studies of publication activity and citation impact of early career researchers, it is important to identify these articles and link them to their associated theses. Using a new benchmark data set, this paper reports on experiments of measuring the bilingual textual similarity between, on the one hand, titles and keywords of doctoral theses, and, on the other hand, articles\u2019 titles and abstracts. The tested methods are cosine similarity and L1 distance in the Vector Space Model (VSM) as baselines, the language-indifferent methods Latent Semantic Analysis (LSA) and trigram similarity, and the language-aware methods fastText and Random Indexing (RI). LSA and RI, two supervised methods, were trained on a purposively collected bilingual scientific parallel text corpus. The results show that the VSM baselines and the RI method perform best but that the VSM method is unsuitable for cross-language similarity due to its inherent monolingual bias.<\/jats:p>","DOI":"10.1162\/qss_a_00152","type":"journal-article","created":{"date-parts":[[2021,8,23]],"date-time":"2021-08-23T20:19:25Z","timestamp":1629749965000},"page":"1071-1091","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":3,"title":["Identifying constitutive articles of cumulative dissertation theses by bilingual text similarity. Evaluation of similarity methods on a new short text task"],"prefix":"10.1162","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5737-8483","authenticated-orcid":true,"given":"Paul","family":"Donner","sequence":"first","affiliation":[{"name":"German Centre for Higher Education Research and Science Studies (DZHW), Dept. 2 \u2018Research System and Science Dynamics\u2019, Sch\u00fctzenstr. 6a, 10117 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2021,11,5]]},"reference":[{"key":"2021110817023527000_bib1","doi-asserted-by":"publisher","DOI":"10.21249\/DZHW:nac2018:1.0.0","volume-title":"National Academics Panel Study (Nacaps) 2018","author":"Adrian","year":"2020"},{"key":"2021110817023527000_bib2","doi-asserted-by":"publisher","first-page":"420","DOI":"10.1007\/3-540-44503-X_27","article-title":"On the surprising behavior of distance metrics in high dimensional space","volume-title":"International conference on database theory 2001","author":"Aggarwal","year":"2001"},{"key":"2021110817023527000_bib3","volume-title":"stopwords: Multilingual stopword lists","author":"Benoit","year":"2020"},{"key":"2021110817023527000_bib4","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1162\/tacl_a_00051","article-title":"Enriching word vectors with subword information","volume":"5","author":"Bojanowski","year":"2017","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2021110817023527000_bib5","doi-asserted-by":"publisher","DOI":"10.21249\/DZHW:phd2014:4.0.0","volume-title":"DZHW PhD Panel 2014","author":"Brandt","year":"2020"},{"key":"2021110817023527000_bib6","article-title":"Der wissenschaftliche Nachwuchs in Deutschland: Die Erfassung von Promovierenden und Promovierendendaten","author":"Brauer","year":"2019","journal-title":"Dokumentation der Jahrestagung 2019 der GfHf"},{"issue":"1","key":"2021110817023527000_bib7","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1016\/j.ipm.2014.08.006","article-title":"HPS: High precision stemmer","volume":"51","author":"Brychc\u00edn","year":"2015","journal-title":"Information Processing & Management"},{"issue":"2","key":"2021110817023527000_bib8","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1016\/j.jbi.2009.09.003","article-title":"Reflective random indexing and indirect inference: A scalable method for discovery of implicit connections","volume":"43","author":"Cohen","year":"2010","journal-title":"Journal of Biomedical Informatics"},{"key":"2021110817023527000_bib9","volume-title":"2017 national report on junior scholars. Statistical data and research findings on doctoral students and doctorate holders in Germany. Overview of Key Results","author":"Consortium for the National Report on Junior Scholars","year":"2017"},{"issue":"6","key":"2021110817023527000_bib10","doi-asserted-by":"publisher","first-page":"1188","DOI":"10.1002\/asi.21519","article-title":"Discovering latent topical structure by second-order similarity analysis","volume":"62","author":"Cribbin","year":"2011","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"6","key":"2021110817023527000_bib11","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1002\/(SICI)1097-4571(199009)41:6&lt;391::AID-ASI1&gt;3.0.CO;2-9","article-title":"Indexing by latent semantic analysis","volume":"41","author":"Deerwester","year":"1990","journal-title":"Journal of the American Society for Information Science"},{"key":"2021110817023527000_bib12","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.4467633","volume-title":"Bilingual English-German word embedding models for scientific text","author":"Donner","year":"2021"},{"key":"2021110817023527000_bib13","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.4733850","volume-title":"Ground truth data for \u201cIdentifying publications of cumulative dissertation theses by bilingual text similarity\u201d","author":"Donner","year":"2021"},{"key":"2021110817023527000_bib14","first-page":"21","article-title":"Automatic cross-language retrieval using latent semantic indexing","volume":"15","author":"Dumais","year":"1997","journal-title":"AAAI Spring Symposium on Cross-Language Text and Speech Retrieval"},{"issue":"1","key":"2021110817023527000_bib15","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1007\/s11192-014-1442-0","article-title":"Medical theses and derivative articles: Dissemination of contents and publication patterns","volume":"102","author":"Echeverria","year":"2015","journal-title":"Scientometrics"},{"issue":"5","key":"2021110817023527000_bib16","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v025.i05","article-title":"Text mining infrastructure in R","volume":"25","author":"Feinerer","year":"2008","journal-title":"Journal of Statistical Software"},{"key":"2021110817023527000_bib17","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1613\/jair.5194","article-title":"Lightweight random indexing for polylingual text classification","volume":"57","author":"Fern\u00e1ndez","year":"2016","journal-title":"Journal of Artificial Intelligence Research"},{"key":"2021110817023527000_bib18","volume-title":"Is there a doctor on board? Collecting generalizable data on doctoral candidates in Germany","author":"Fr\u00e4\u00dfdorf","year":"2016"},{"issue":"1","key":"2021110817023527000_bib19","first-page":"74","article-title":"Zur Situation der Doktoranden in Deutschland\u2013Ergebnisse einer bundesweiten Doktorandenbefragung","volume":"27","author":"Gerhardt","year":"2005","journal-title":"Beitr\u00e4ge zur Hochschulforschung"},{"key":"2021110817023527000_bib20","doi-asserted-by":"publisher","first-page":"710","DOI":"10.18653\/v1\/P19-1070","article-title":"How to (properly) evaluate cross-lingual word embeddings: On strong baselines, comparative analyses, and some misconceptions","volume-title":"Proceedings of the 57th annual meeting of the association for computational linguistics","author":"Glava\u0161","year":"2019"},{"key":"2021110817023527000_bib21","volume-title":"Promovierende in Deutschland: Wintersemester 2014\/2015","author":"H\u00e4hnel","year":"2016"},{"issue":"1","key":"2021110817023527000_bib22","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1007\/s11192-018-2840-5","article-title":"The next generation (plus one): An analysis of doctoral students\u2019 academic fecundity based on a novel approach to advisor identification","volume":"117","author":"Heinisch","year":"2018","journal-title":"Scientometrics"},{"issue":"1","key":"2021110817023527000_bib23","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1162\/qss_a_00001","article-title":"A supervised machine learning approach to trace doctorate recipients\u2019 employment trajectories","volume":"1","author":"Heinisch","year":"2020","journal-title":"Quantitative Science Studies"},{"key":"2021110817023527000_bib24","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1330","article-title":"Loss in translation: Learning bilingual word mapping with a retrieval criterion","volume-title":"Proceedings of the 2018 conference on empirical methods in natural language processing","author":"Joulin","year":"2018"},{"key":"2021110817023527000_bib25","doi-asserted-by":"publisher","first-page":"1411","DOI":"10.1145\/2806416.2806475","article-title":"Short text similarity with word embeddings","volume-title":"Proceedings of the 24th ACM international on conference on information and knowledge management","author":"Kenter","year":"2015"},{"key":"2021110817023527000_bib26","doi-asserted-by":"publisher","first-page":"235","DOI":"10.18653\/v1\/W19-0420","article-title":"Fast and discriminative semantic embedding","volume-title":"Proceedings of the 13th international conference on computational semantics","author":"Koopman","year":"2019"},{"issue":"suppl 1","key":"2021110817023527000_bib27","doi-asserted-by":"publisher","first-page":"5214","DOI":"10.1073\/pnas.0400341101","article-title":"From paragraph to graph: Latent semantic analysis for information visualization","volume":"101","author":"Landauer","year":"2004","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2021110817023527000_bib28","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1145\/1150402.1150436","article-title":"Very sparse random projections","volume-title":"Proceedings of the 12th ACM SIGKDD international conference on knowledge discovery and data mining","author":"Li","year":"2006"},{"issue":"1\u20132","key":"2021110817023527000_bib29","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1023\/B:INRT.0000009441.78971.be","article-title":"Character n-gram tokenization for European language text retrieval","volume":"7","author":"McNamee","year":"2004","journal-title":"Information Retrieval"},{"key":"2021110817023527000_bib30","first-page":"3111","article-title":"Distributed representations of words and phrases and their compositionality","volume-title":"Advances in Neural Information Processing Systems","author":"Mikolov","year":"2013"},{"key":"2021110817023527000_bib31","unstructured":"Mitesser, O.\n           (2008). Latente semantische analyse zur messung der diversit\u00e4t von forschungsgebieten (Master\u2019s thesis, Humboldt-Universit\u00e4t zu Berlin, Philosophische Fakult\u00e4t). 10.18452\/18236"},{"key":"2021110817023527000_bib32","article-title":"Measuring diversity of research by extracting latent themes from bipartite networks of papers and references","volume-title":"Proceedings of WIS 2008, Berlin. Fourth International Conference on Webometrics, Informetrics and Scientometrics & Ninth COLLNET Meeting","author":"Mitesser","year":"2008"},{"key":"2021110817023527000_bib33","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1007\/978-3-642-39593-2_15","article-title":"Cross-lingual random indexing for information retrieval","volume-title":"International conference on statistical language and speech processing","author":"Moen","year":"2013"},{"issue":"23","key":"2021110817023527000_bib34","doi-asserted-by":"publisher","first-page":"655","DOI":"10.21105\/joss.00655","article-title":"Fast, consistent tokenization of natural language text","volume":"3","author":"Mullen","year":"2018","journal-title":"Journal of Open Source Software"},{"issue":"3","key":"2021110817023527000_bib35","doi-asserted-by":"publisher","first-page":"983","DOI":"10.1007\/s11192-011-0562-z","article-title":"Mapping the research on aquaculture. A bibliometric analysis of aquaculture literature","volume":"90","author":"Natale","year":"2012","journal-title":"Scientometrics"},{"issue":"1","key":"2021110817023527000_bib36","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1007\/s10579-009-9114-z","article-title":"Cross-language plagiarism detection","volume":"45","author":"Potthast","year":"2011","journal-title":"Language Resources and Evaluation"},{"key":"2021110817023527000_bib37","volume-title":"RSpectra: Solvers for large-scale eigenvalue and SVD problems","author":"Qiu","year":"2019"},{"key":"2021110817023527000_bib38","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1613\/jair.1.11640","article-title":"A survey of cross-lingual word embedding models","volume":"65","author":"Ruder","year":"2019","journal-title":"Journal of Artificial Intelligence Research"},{"key":"2021110817023527000_bib39","article-title":"An introduction to random indexing","volume-title":"Methods and applications of semantic indexing workshop at the 7th international conference on terminology and knowledge engineering, August 16, 2005, Copenhagen, Denmark","author":"Sahlgren","year":"2005"},{"issue":"3","key":"2021110817023527000_bib40","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1017\/S1351324905003876","article-title":"Automatic bilingual lexicon acquisition using random indexing of parallel corpora","volume":"11","author":"Sahlgren","year":"2005","journal-title":"Natural Language Engineering"},{"issue":"11","key":"2021110817023527000_bib41","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1145\/361219.361220","article-title":"A vector space model for automatic indexing","volume":"18","author":"Salton","year":"1975","journal-title":"Communications of the ACM"},{"key":"2021110817023527000_bib42","volume-title":"text2vec: Modern text mining framework for R","author":"Selivanov","year":"2020"},{"key":"2021110817023527000_bib43","volume-title":"Strukturierung der wissenschaftlichen Ausbildung f\u00fcr Medizinerinnen und Mediziner","author":"Senatskommission f\u00fcr Klinische Forschung, Deutsche Forschungsgemeinschaft","year":"2010"},{"issue":"3","key":"2021110817023527000_bib44","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1214\/aoms\/1177728730","article-title":"Correlation between a discrete and a continuous variable. Point-biserial correlation","volume":"25","author":"Tate","year":"1954","journal-title":"The Annals of Mathematical Statistics"},{"issue":"3","key":"2021110817023527000_bib45","doi-asserted-by":"publisher","first-page":"667","DOI":"10.1007\/s11192-012-0896-1","article-title":"Do second-order similarities provide added-value in a hybrid approach?","volume":"96","author":"Thijs","year":"2013","journal-title":"Scientometrics"},{"key":"2021110817023527000_bib46","article-title":"German, French, English and Persian retrieval experiments at CLEF 2009","volume-title":"Working notes for CLEF 2009 workshop","author":"Tomlinson","year":"2009"},{"key":"2021110817023527000_bib47","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1145\/2766462.2767752","article-title":"Monolingual and cross-lingual information retrieval models based on (bilingual) word embeddings","volume-title":"Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval","author":"Vuli\u0107","year":"2015"},{"issue":"2","key":"2021110817023527000_bib48","doi-asserted-by":"publisher","first-page":"1017","DOI":"10.1007\/s11192-017-2298-x","article-title":"Clustering articles based on semantic similarity","volume":"111","author":"Wang","year":"2017","journal-title":"Scientometrics"},{"key":"2021110817023527000_bib49","volume-title":"Empfehlungen zu forschungs-und lehrf\u00f6rderlichen Strukturen in der Universit\u00e4tsmedizin","author":"Wissenschaftsrat","year":"2014"},{"issue":"3","key":"2021110817023527000_bib50","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1016\/j.ipm.2004.06.009","article-title":"Empirical studies on the impact of lexical resources on clir performance","volume":"41","author":"Xu","year":"2005","journal-title":"Information Processing & Management"},{"issue":"1","key":"2021110817023527000_bib51","doi-asserted-by":"publisher","first-page":"3","DOI":"10.4103\/2320-0057.143660","article-title":"A new model to identify the productivity of theses in terms of articles using co-word analysis","volume":"3","author":"Zamudio Igami","year":"2014","journal-title":"Journal of Scientometric Research"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/2\/3\/1071\/1970746\/qss_a_00152.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/2\/3\/1071\/1970746\/qss_a_00152.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,8]],"date-time":"2021-11-08T17:02:59Z","timestamp":1636390979000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/2\/3\/1071\/107043\/Identifying-constitutive-articles-of-cumulative"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":51,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,11,5]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00152","relation":{},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}