{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T02:55:59Z","timestamp":1777431359909,"version":"3.51.4"},"reference-count":27,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2019,4,8]],"date-time":"2019-04-08T00:00:00Z","timestamp":1554681600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"Roche Postdoctoral Fellowship"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Author-centric analyses of fast-growing biomedical reference databases are challenging due to author ambiguity. This problem has been mainly addressed through author disambiguation using supervised machine-learning algorithms. Such algorithms, however, require adequately designed gold standards that reflect the reference database properly. In this study we used MEDLINE to build the first unbiased gold standard in a reference database and improve over the existing state of the art in author disambiguation.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Following a new corpus design method, publication pairs randomly picked from MEDLINE were evaluated by both crowdsourcing and expert curators. Because the latter showed higher accuracy than crowdsourcing, expert curators were tasked to create a full corpus. The corpus was then used to explore new features that could improve state-of-the-art author disambiguation algorithms that would not have been discoverable with previously existing gold standards.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We created a gold standard based on 1900 publication pairs that shows close similarity to MEDLINE in terms of chronological distribution and information completeness. A machine-learning algorithm that includes new features related to the ethnic origin of authors showed significant improvements over the current state of the art and demonstrates the necessity of realistic gold standards to further develop effective author disambiguation algorithms.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion and Conclusion<\/jats:title>\n                  <jats:p>An unbiased gold standard can give a more accurate picture of the status of author disambiguation research and help in the discovery of new features for machine learning. The principles and methods shown here can be applied to other reference databases beyond MEDLINE. The gold standard and code used for this study are available at the following repository: https:\/\/github.com\/amorgani\/AND\/<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocz028","type":"journal-article","created":{"date-parts":[[2019,2,27]],"date-time":"2019-02-27T01:38:52Z","timestamp":1551231532000},"page":"1037-1045","source":"Crossref","is-referenced-by-count":17,"title":["A new approach and gold standard toward author disambiguation in MEDLINE"],"prefix":"10.1093","volume":"26","author":[{"given":"Dina","family":"Vishnyakova","sequence":"first","affiliation":[{"name":"Roche Pharmaceutical Research and Early Development, pRED Informatics, Roche Innovation Center, Basel, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raul","family":"Rodriguez-Esteban","sequence":"additional","affiliation":[{"name":"Roche Pharmaceutical Research and Early Development, pRED Informatics, Roche Innovation Center, Basel, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabio","family":"Rinaldi","sequence":"additional","affiliation":[{"name":"Institute of Computational Linguistics, University of Zurich, Switzerland"},{"name":"Swiss Institute of Bioinformatics, Zurich, Switzerland"},{"name":"Dalle Molle Institute for Artificial Intelligence Research (IDSIA), Manno, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2019,4,8]]},"reference":[{"key":"2020110613065656100_ocz028-B1","doi-asserted-by":"crossref","first-page":"bap018","DOI":"10.1093\/database\/bap018","article-title":"Understanding PubMed user search behavior through log analysis","volume":"2009","author":"Islamaj Dogan","year":"2009","journal-title":"Database"},{"issue":"3","key":"2020110613065656100_ocz028-B2","doi-asserted-by":"crossref","first-page":"1965","DOI":"10.1007\/s11192-017-2341-y","article-title":"Use of ResearchGate and Google CSE for author name disambiguation","volume":"111","author":"Abdulhayoglu","year":"2017","journal-title":"Scientometrics"},{"key":"2020110613065656100_ocz028-B3","volume-title":"International Conference on Theory and Practice of Digital Libraries","author":"Yang","year":"2008"},{"key":"2020110613065656100_ocz028-B4","volume-title":"Proceedings of the 6th ACM\/IEEE-CS Joint Conference on Digital Libraries","author":"Tan","year":"2006"},{"key":"2020110613065656100_ocz028-B5","volume-title":"Extracting Citation Relationships from Web Documents for Author Disambiguation","author":"Yang","year":"2006"},{"key":"2020110613065656100_ocz028-B6","volume-title":"Proceedings of AAAI 2007 Workshop on Information Integration on the Web","author":"Kanani","year":"2007"},{"key":"2020110613065656100_ocz028-B7","volume-title":"Proceedings of AAAI 2007 Workshop on Information Integration on the Web","author":"Lu","year":"2007"},{"issue":"4","key":"2020110613065656100_ocz028-B8","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1016\/j.joi.2015.08.004","article-title":"Exploring author name disambiguation on PubMed-scale","volume":"9","author":"Song","year":"2015","journal-title":"J Informetrics"},{"key":"2020110613065656100_ocz028-B9","doi-asserted-by":"crossref","first-page":"1065","DOI":"10.1145\/1066677.1066920","volume-title":"Proceedings of the 2005 ACM Symposium on Applied Computing","author":"Han","year":"2005"},{"issue":"3","key":"2020110613065656100_ocz028-B10","doi-asserted-by":"crossref","first-page":"1.","DOI":"10.1145\/1552303.1552304","article-title":"Author name disambiguation in MEDLINE","volume":"3","author":"Torvik","year":"2009","journal-title":"ACM Trans Knowl Discov Data"},{"key":"2020110613065656100_ocz028-B11","volume-title":"Sixth International Workshop on Information Integration on the Web (IIWeb-07)","author":"Culotta","year":"2007"},{"key":"2020110613065656100_ocz028-B12","volume-title":"Proceedings of the 10th Annual Joint Conference on Digital Libraries","author":"Ferreira","year":"2010"},{"key":"2020110613065656100_ocz028-B13","volume-title":"European Conference on Principles of Data Mining and Knowledge Discovery","author":"Huang","year":"2006"},{"key":"2020110613065656100_ocz028-B14","doi-asserted-by":"crossref","DOI":"10.1145\/996350.996419","article-title":"Two supervised learning approaches for name disambiguation in author citations","author":"Han","year":"2004","journal-title":"Proceedings of the 2004 Joint ACM\/IEEE Conference on Digital Libraries"},{"key":"2020110613065656100_ocz028-B15","volume-title":"Proceedings of the 9th ACM\/IEEE-CS Joint Conference on Digital Libraries","author":"Treeratpituk","year":"2009"},{"issue":"4","key":"2020110613065656100_ocz028-B16","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1002\/asi.23063","article-title":"Author name disambiguation for PubMed","volume":"65","author":"Liu","year":"2014","journal-title":"J Assoc Inf Sci Technol"},{"issue":"6","key":"2020110613065656100_ocz028-B17","doi-asserted-by":"crossref","first-page":"975","DOI":"10.1109\/TKDE.2011.13","article-title":"A unified probabilistic framework for name disambiguation in digital library","volume":"24","author":"Tang","year":"2012","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"3","key":"2020110613065656100_ocz028-B18","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1016\/j.ipm.2010.10.001","article-title":"Construction of a large-scale test set for author disambiguation","volume":"47","author":"Kang","year":"2011","journal-title":"Inf Process Manage"},{"issue":"4","key":"2020110613065656100_ocz028-B19","doi-asserted-by":"crossref","first-page":"654","DOI":"10.1002\/asi.21495","article-title":"Counting first, last, or all authors in citation analysis: A comprehensive comparison in the highly collaborative stem cell research field","volume":"62","author":"Zhao","year":"2011","journal-title":"J Am Soc Inf Sci"},{"issue":"6","key":"2020110613065656100_ocz028-B20","doi-asserted-by":"crossref","first-page":"1120","DOI":"10.1136\/amiajnl-2012-001110","article-title":"Identifying medical terms in patient-authored text: a crowdsourcing-based approach","volume":"20","author":"MacLean","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613065656100_ocz028-B21","doi-asserted-by":"crossref","first-page":"baw094.","DOI":"10.1093\/database\/baw094","article-title":"Combining machine learning, crowdsourcing and expert knowledge to detect chemical-induced diseases in text","volume":"2016","author":"Bravo","year":"2016","journal-title":"Database"},{"key":"2020110613065656100_ocz028-B22","volume-title":"Proceedings of the Fifth Workshop on Building and Evaluating Resources for Biomedical Text Mining (BioTxtM2016)","author":"Vishnyakova","year":"2016"},{"issue":"9","key":"2020110613065656100_ocz028-B23","doi-asserted-by":"crossref","first-page":"1820","DOI":"10.1002\/asi.22695","article-title":"Author name disambiguation: what difference does it make in author-based citation analysis?","volume":"63","author":"Strotmann","year":"2012","journal-title":"J Am Soc Inf Sci Tec"},{"issue":"3","key":"2020110613065656100_ocz028-B24","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1177\/001316447303300309","article-title":"The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability","volume":"33","author":"Fleiss","year":"1973","journal-title":"Educ Psychol Measur"},{"issue":"7","key":"2020110613065656100_ocz028-B25","doi-asserted-by":"crossref","first-page":"e0158731.","DOI":"10.1371\/journal.pone.0158731","article-title":"Author disambiguation in pubmed: evidence on the precision and recall of author-ity among NIH-funded scientists","volume":"11","author":"Lerchenmueller","year":"2016","journal-title":"PLoS One"},{"issue":"6","key":"2020110613065656100_ocz028-B26","doi-asserted-by":"crossref","first-page":"1050","DOI":"10.1016\/j.jbi.2008.05.002","article-title":"Visualizing evolution and impact of biomedical fields","volume":"41","author":"Cokol","year":"2008","journal-title":"J Biomed Inform"},{"issue":"22","key":"2020110613065656100_ocz028-B27","doi-asserted-by":"crossref","first-page":"2918","DOI":"10.1093\/bioinformatics\/btt505","article-title":"Quantifying the complexity of medical research","volume":"29","author":"Rodriguez-Esteban","year":"2013","journal-title":"Bioinformatics"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/10\/1037\/34151898\/ocz028.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/10\/1037\/34151898\/ocz028.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T19:11:23Z","timestamp":1604689883000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/26\/10\/1037\/5432091"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,8]]},"references-count":27,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2019,4,8]]},"published-print":{"date-parts":[[2019,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocz028","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,10]]},"published":{"date-parts":[[2019,4,8]]}}}