{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T20:49:04Z","timestamp":1775076544043,"version":"3.50.1"},"reference-count":26,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2019,6,12]],"date-time":"2019-06-12T00:00:00Z","timestamp":1560297600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"IQVIA"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Clinical trials, prospective research studies on human participants carried out by a distributed team of clinical investigators, play a crucial role in the development of new treatments in health care. This is a complex and expensive process where investigators aim to enroll volunteers with predetermined characteristics, administer treatment(s), and collect safety and efficacy data. Therefore, choosing top-enrolling investigators is essential for efficient clinical trial execution and is 1 of the primary drivers of drug development cost.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>To facilitate clinical trials optimization, we propose DeepMatch (DM), a novel approach that builds on top of advances in deep learning. DM is designed to learn from both investigator and trial-related heterogeneous data sources and rank investigators based on their expected enrollment performance on new clinical trials.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Large-scale evaluation conducted on 2618 studies provides evidence that the proposed ranking-based framework improves the current state-of-the-art by up to 19% on ranking investigators and up to 10% on detecting top\/bottom performers when recruiting investigators for new clinical trials.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>The extensive experimental section suggests that DM can provide substantial improvement over current industry standards in several regards: (1) the enrollment potential of the investigator list, (2) the time it takes to generate the list, and (3) data-informed decisions about new investigators.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Due to the great significance of the problem at hand, related research efforts are set to shift the paradigm of how investigators are chosen for clinical trials, thereby optimizing and automating them and reducing the cost of new therapies.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocz064","type":"journal-article","created":{"date-parts":[[2019,4,20]],"date-time":"2019-04-20T11:11:18Z","timestamp":1555758678000},"page":"1195-1202","source":"Crossref","is-referenced-by-count":25,"title":["Optimizing clinical trials recruitment via deep learning"],"prefix":"10.1093","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3935-7106","authenticated-orcid":false,"given":"Jelena","family":"Gligorijevic","sequence":"first","affiliation":[{"name":"Center for Data Analytics and Biomedical Informatics, Temple University, Philadelphia, Pennsylvania, USA"}]},{"given":"Djordje","family":"Gligorijevic","sequence":"additional","affiliation":[{"name":"Center for Data Analytics and Biomedical Informatics, Temple University, Philadelphia, Pennsylvania, USA"}]},{"given":"Martin","family":"Pavlovski","sequence":"additional","affiliation":[{"name":"Center for Data Analytics and Biomedical Informatics, Temple University, Philadelphia, Pennsylvania, USA"},{"name":"Macedonian Academy of Sciences and Arts, Skopje, Republic of Macedonia"}]},{"given":"Elizabeth","family":"Milkovits","sequence":"additional","affiliation":[{"name":"IQVIA, Plymouth Meeting, Pennsylvania, USA"}]},{"given":"Lucas","family":"Glass","sequence":"additional","affiliation":[{"name":"IQVIA, Plymouth Meeting, Pennsylvania, USA"}]},{"given":"Kevin","family":"Grier","sequence":"additional","affiliation":[{"name":"IQVIA, Plymouth Meeting, Pennsylvania, USA"}]},{"given":"Praveen","family":"Vankireddy","sequence":"additional","affiliation":[{"name":"IQVIA, Plymouth Meeting, Pennsylvania, USA"}]},{"given":"Zoran","family":"Obradovic","sequence":"additional","affiliation":[{"name":"Center for Data Analytics and Biomedical Informatics, Temple University, Philadelphia, Pennsylvania, USA"}]}],"member":"286","published-online":{"date-parts":[[2019,6,12]]},"reference":[{"key":"2020110613072546300_ocz064-B1"},{"issue":"6","key":"2020110613072546300_ocz064-B2","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1038\/nrd.2017.70","article-title":"How much do clinical trials cost?","volume":"16","author":"Martin","year":"2017","journal-title":"Nat Rev Drug Discov"},{"key":"2020110613072546300_ocz064-B3","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1136\/bmjopen-2016-014796","article-title":"Improving site selection in clinical studies: a standardised, objective, multistep method and first experience results","volume":"7","author":"Hurtado-Chong","year":"2017","journal-title":"BMJ Open"},{"issue":"2","key":"2020110613072546300_ocz064-B4","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1038\/nrd.2017.14","article-title":"2016 FDA drug approvals","volume":"16","author":"Mullard","year":"2017","journal-title":"Nat Rev Drug Discov"},{"key":"2020110613072546300_ocz064-B5"},{"key":"2020110613072546300_ocz064-B6","first-page":"301","volume-title":"Machine Learning for Healthcare Conference","author":"Choi","year":"2016"},{"key":"2020110613072546300_ocz064-B7","first-page":"1","article-title":"Modeling healthcare quality via compact representations of electronic health records","volume":"99","author":"Stojanovic","year":"2016","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform PP"},{"key":"2020110613072546300_ocz064-B8","author":"Che","year":"2015"},{"key":"2020110613072546300_ocz064-B9","first-page":"297","author":"Gligorijevic","year":"2018"},{"key":"2020110613072546300_ocz064-B10","author":"Chapman","year":"2011"},{"issue":"4","key":"2020110613072546300_ocz064-B11","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1136\/jamia.2010.003707","article-title":"Symbolic rule-based classification of lung cancer stages from free-text pathology reports","volume":"17","author":"Nguyen","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2020110613072546300_ocz064-B12","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1016\/j.jbi.2008.12.005","article-title":"Automatically extracting cancer disease characteristics from pathology reports into a Disease Knowledge Representation Model","volume":"42","author":"Coden","year":"2009","journal-title":"J Biomed Inform"},{"issue":"11","key":"2020110613072546300_ocz064-B13","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1109\/78.650093","article-title":"Bidirectional recurrent neural networks","volume":"45","author":"Schuster","year":"1997","journal-title":"IEEE Trans Signal Process"},{"key":"2020110613072546300_ocz064-B14","author":"Jagannatha","year":"2016"},{"key":"2020110613072546300_ocz064-B15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/srep32404","article-title":"Large-scale discovery of disease-disease and disease-gene associations","volume":"6","author":"Gligorijevic","year":"2016","journal-title":"Sci Rep"},{"key":"2020110613072546300_ocz064-B16","author":"Choi","year":"2016"},{"key":"2020110613072546300_ocz064-B17","first-page":"10","article-title":"Convolutional networks for images, speech, and time series","volume":"3361","author":"LeCun","year":"1995","journal-title":"The Handbook of Brain Theory and Neural Networks"},{"key":"2020110613072546300_ocz064-B18"},{"key":"2020110613072546300_ocz064-B19","author":"Huang","year":"2013"},{"key":"2020110613072546300_ocz064-B20","author":"Edizel","year":"2017"},{"key":"2020110613072546300_ocz064-B21","first-page":"3111","volume-title":"Advances in Neural Information Processing Systems","author":"Mikolov","year":"2013"},{"key":"2020110613072546300_ocz064-B22","first-page":"2042","volume-title":"Advances in Neural Information Processing Systems","author":"Hu","year":"2014"},{"key":"2020110613072546300_ocz064-B23","volume-title":"Support Vector Machines","author":"Ingo","year":"2008"},{"key":"2020110613072546300_ocz064-B24","volume-title":"Transforming Clinical Research in the United States: Challenges and Opportunities: Workshop Summary","author":"Giffin","year":"2010"},{"issue":"4","key":"2020110613072546300_ocz064-B25","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1145\/582415.582418","article-title":"Cumulated gain-based evaluation of IR techniques","volume":"20","author":"Jarvelin","year":"2002","journal-title":"ACM Trans Inf Syst (TOIS)"},{"key":"2020110613072546300_ocz064-B26","author":"Wang","year":"2013"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/11\/1195\/34152087\/ocz064.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/11\/1195\/34152087\/ocz064.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T19:14:18Z","timestamp":1604690058000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/26\/11\/1195\/5514216"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,12]]},"references-count":26,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,6,12]]},"published-print":{"date-parts":[[2019,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocz064","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,11]]},"published":{"date-parts":[[2019,6,12]]}}}