{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T22:38:30Z","timestamp":1784759910487,"version":"3.55.0"},"reference-count":80,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2020,6,2]],"date-time":"2020-06-02T00:00:00Z","timestamp":1591056000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2016YFA0501701"],"award-info":[{"award-number":["2016YFA0501701"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Key Research and Development Program of Zhejiang Province","award":["2020C03010"],"award-info":[{"award-number":["2020C03010"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["81773632"],"award-info":[{"award-number":["81773632"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,5,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Machine learning-based scoring functions (MLSFs) have attracted extensive attention recently and are expected to be potential rescoring tools for structure-based virtual screening (SBVS). However, a major concern nowadays is whether MLSFs trained for generic uses rather than a given target can consistently be applicable for VS. In this study, a systematic assessment was carried out to re-evaluate the effectiveness of 14 reported MLSFs in VS. Overall, most of these MLSFs could hardly achieve satisfactory results for any dataset, and they could even not outperform the baseline of classical SFs such as Glide SP. An exception was observed for RFscore-VS trained on the Directory of Useful Decoys-Enhanced dataset, which showed its superiority for most targets. However, in most cases, it clearly illustrated rather limited performance on the targets that were dissimilar to the proteins in the corresponding training sets. We also used the top three docking poses rather than the top one for rescoring and retrained the models with the updated versions of the training set, but only minor improvements were observed. Taken together, generic MLSFs may have poor generalization capabilities to be applicable for the real VS campaigns. Therefore, it should be quite cautious to use this type of methods for VS.<\/jats:p>","DOI":"10.1093\/bib\/bbaa070","type":"journal-article","created":{"date-parts":[[2020,4,3]],"date-time":"2020-04-03T11:08:29Z","timestamp":1585912109000},"source":"Crossref","is-referenced-by-count":70,"title":["Beware of the generic machine learning-based scoring functions in structure-based virtual screening"],"prefix":"10.1093","volume":"22","author":[{"given":"Chao","family":"Shen","sequence":"first","affiliation":[{"name":"Central South University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ye","family":"Hu","sequence":"additional","affiliation":[{"name":"Central South University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhe","family":"Wang","sequence":"additional","affiliation":[{"name":"Central South University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xujun","family":"Zhang","sequence":"additional","affiliation":[{"name":"Central South University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinping","family":"Pang","sequence":"additional","affiliation":[{"name":"Central South University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gaoang","family":"Wang","sequence":"additional","affiliation":[{"name":"Central South University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haiyang","family":"Zhong","sequence":"additional","affiliation":[{"name":"Central South University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Xu","sequence":"additional","affiliation":[{"name":"Central South University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongsheng","family":"Cao","sequence":"additional","affiliation":[{"name":"Central South University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tingjun","family":"Hou","sequence":"additional","affiliation":[{"name":"Central South University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,6,2]]},"reference":[{"key":"2021052109430084400_ref1","doi-asserted-by":"crossref","first-page":"1751","DOI":"10.2174\/1568026619666190816101948","article-title":"Virtual screening techniques in drug discovery: review and recent applications","volume":"19","author":"Silva Rocha","year":"2019","journal-title":"Curr Top Med Chem"},{"key":"2021052109430084400_ref2","doi-asserted-by":"crossref","first-page":"3149","DOI":"10.1039\/C9CP06303J","article-title":"Combined strategies in structure-based virtual screening","volume":"22","author":"Wang","year":"2020","journal-title":"Phys Chem Chem Phys"},{"key":"2021052109430084400_ref3","doi-asserted-by":"crossref","first-page":"1878","DOI":"10.1093\/bib\/bby061","article-title":"Recent applications of deep learning and machine intelligence on in silico drug discovery: methods, tools and databases","volume":"20","author":"Rifaioglu","year":"2019","journal-title":"Brief Bioinform"},{"key":"2021052109430084400_ref4","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.3389\/fphar.2018.01089","article-title":"Empirical scoring functions for structure-based virtual screening: applications, critical aspects, and challenges","volume":"9","author":"Guedes","year":"2018","journal-title":"Front Pharmacol"},{"key":"2021052109430084400_ref5","doi-asserted-by":"crossref","first-page":"1011","DOI":"10.2174\/1381612043452721","article-title":"Recent development and application of virtual screening in drug discovery: an overview","volume":"10","author":"Hou","year":"2004","journal-title":"Curr Pharm Des"},{"key":"2021052109430084400_ref6","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1038\/nrd1549","article-title":"Docking and scoring in virtual screening for drug discovery: methods and applications","volume":"3","author":"Kitchen","year":"2004","journal-title":"Nat Rev Drug Discov"},{"key":"2021052109430084400_ref7","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1208\/s12248-012-9322-0","article-title":"Structure-based virtual screening for drug discovery: a problem-centric review","volume":"14","author":"Cheng","year":"2012","journal-title":"AAPS J"},{"key":"2021052109430084400_ref8","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1002\/wcms.1225","article-title":"Machine-learning scoring functions to improve structure-based binding affinity prediction and virtual screening","volume":"5","author":"Ain","year":"2015","journal-title":"Wiley Interdiscip Rev Comput Mol Sci"},{"key":"2021052109430084400_ref9","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.1093\/bioinformatics\/btq112","article-title":"A machine learning approach to predicting protein-ligand binding affinity with applications to molecular docking","volume":"26","author":"Ballester","year":"2010","journal-title":"Bioinformatics"},{"key":"2021052109430084400_ref10","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1021\/ci500091r","article-title":"Does a more precise chemical description of protein-ligand complexes lead to more accurate prediction of binding affinity?","volume":"54","author":"Ballester","year":"2014","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref11","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1002\/jcc.24667","article-title":"Improving scoring-docking-screening powers of protein-ligand scoring functions using random forest","volume":"38","author":"Wang","year":"2017","journal-title":"J Comput Chem"},{"key":"2021052109430084400_ref12","doi-asserted-by":"crossref","first-page":"46710","DOI":"10.1038\/srep46710","article-title":"Performance of machine-learning scoring functions in structure-based virtual screening","volume":"7","author":"Wojcikowski","year":"2017","journal-title":"Sci Rep"},{"key":"2021052109430084400_ref13","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1021\/ci300508m","article-title":"Characterization of small molecule binding. I. Accurate identification of strong inhibitors in virtual screening","volume":"53","author":"Ding","year":"2013","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref14","doi-asserted-by":"crossref","first-page":"1793","DOI":"10.1021\/acs.jcim.7b00017","article-title":"Protein-ligand empirical interaction components for virtual screening","volume":"57","author":"Yan","year":"2017","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref15","doi-asserted-by":"crossref","first-page":"1865","DOI":"10.1021\/ci100244v","article-title":"NNScore: a neural-network-based scoring function for the characterization of protein-ligand complexes","volume":"50","author":"Durrant","year":"2010","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref16","doi-asserted-by":"crossref","first-page":"2897","DOI":"10.1021\/ci2003889","article-title":"NNScore 2.0: a neural-network receptor-ligand scoring function","volume":"51","author":"Durrant","year":"2011","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref17","doi-asserted-by":"crossref","first-page":"4540","DOI":"10.1021\/acs.jcim.9b00645","article-title":"Incorporating explicit water molecules and ligand conformation stability in machine-learning scoring functions","volume":"59","author":"Lu","year":"2019","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref18","doi-asserted-by":"crossref","first-page":"3291","DOI":"10.1021\/acs.jcim.9b00334","article-title":"Wei G-W. AGL-score: algebraic graph learning score for protein-ligand binding scoring, ranking, docking, and screening","volume":"59","author":"Nguyen","year":"2019","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref19","doi-asserted-by":"crossref","first-page":"e1005929","DOI":"10.1371\/journal.pcbi.1005929","article-title":"Representability of algebraic topology for biomolecules in machine learning based scoring and virtual screening","volume":"14","author":"Cang","year":"2018","journal-title":"PLoS Comput Biol"},{"key":"2021052109430084400_ref20","doi-asserted-by":"crossref","first-page":"2495","DOI":"10.1021\/acs.jcim.6b00355","article-title":"Boosting docking-based virtual screening with deep learning","volume":"56","author":"Pereira","year":"2016","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref21","doi-asserted-by":"crossref","first-page":"942","DOI":"10.1021\/acs.jcim.6b00740","article-title":"Protein-ligand scoring with convolutional neural networks","volume":"57","author":"Ragoza","year":"2017","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref22","doi-asserted-by":"crossref","first-page":"3666","DOI":"10.1093\/bioinformatics\/bty374","article-title":"Development and evaluation of a deep learning model for protein-ligand binding affinity prediction","volume":"34","author":"Stepniewska-Dziubinska","year":"2018","journal-title":"Bioinformatics (Oxford, England)"},{"key":"2021052109430084400_ref23","doi-asserted-by":"crossref","first-page":"15956","DOI":"10.1021\/acsomega.9b01997","article-title":"OnionNet: a multiple-layer intermolecular-contact-based convolutional neural network for protein-ligand binding affinity prediction","volume":"4","author":"Zheng","year":"2019","journal-title":"Acs Omega"},{"key":"2021052109430084400_ref24","first-page":"e1429","article-title":"From machine learning to deep learning: advances in scoring functions for protein-ligand docking","author":"Shen","year":"2019","journal-title":"Wiley Interdiscip Rev Comput Mol Sci"},{"key":"2021052109430084400_ref25","doi-asserted-by":"crossref","first-page":"24817","DOI":"10.1038\/srep24817","article-title":"Constructing and validating high-performance MIEC-SVM models in virtual screening for kinases: a better way for actives discovery","volume":"6","author":"Sun","year":"2016","journal-title":"Sci Rep"},{"key":"2021052109430084400_ref26","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1111\/cbdd.12423","article-title":"Machine-learning techniques applied to antibacterial drug discovery","volume":"85","author":"Durrant","year":"2015","journal-title":"Chem Biol Drug Des"},{"key":"2021052109430084400_ref27","doi-asserted-by":"crossref","first-page":"1953","DOI":"10.1021\/acs.jcim.5b00241","article-title":"Neural-network scoring functions identify structurally novel estrogen-receptor ligands","volume":"55","author":"Durrant","year":"2015","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref28","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1016\/j.cmet.2019.08.023","article-title":"Miro1 marks Parkinson\u2019s disease subset and Miro1 reducer rescues neuron loss in Parkinson\u2019s models","volume":"30","author":"Hsieh","year":"2019","journal-title":"Cell Metab"},{"key":"2021052109430084400_ref29","doi-asserted-by":"crossref","first-page":"83142","DOI":"10.18632\/oncotarget.20915","article-title":"Virtual screening approach to identifying influenza virus neuraminidase inhibitors using molecular docking combined with machine-learning-based scoring function","volume":"8","author":"Zhang","year":"2017","journal-title":"Oncotarget"},{"key":"2021052109430084400_ref30","doi-asserted-by":"crossref","first-page":"2807","DOI":"10.1021\/ci500406k","article-title":"Beware of machine learning-based scoring functions-on the danger of developing black boxes","volume":"54","author":"Gabel","year":"2014","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref31","doi-asserted-by":"crossref","first-page":"1700","DOI":"10.1021\/ci500080q","article-title":"Comparative assessment of scoring functions on an updated benchmark: 1. compilation of the test set","volume":"54","author":"Li","year":"2014","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref32","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1021\/acs.jcim.7b00309","article-title":"Task-specific scoring functions for predicting ligand binding poses and affinity and for screening enrichment","volume":"58","author":"Ashtawy","year":"2018","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref33","doi-asserted-by":"crossref","first-page":"2977","DOI":"10.1021\/jm030580l","article-title":"The PDBbind database: collection of binding affinities for protein-ligand complexes with known three-dimensional structures","volume":"47","author":"Wang","year":"2004","journal-title":"J Med Chem"},{"key":"2021052109430084400_ref34","article-title":"Can machine learning consistently improve the scoring power of classical scoring functions? Insights into the role of machine learning in scoring functions","author":"Shen","year":"2020","journal-title":"Brief Bioinform"},{"key":"2021052109430084400_ref35","doi-asserted-by":"crossref","first-page":"6582","DOI":"10.1021\/jm300687e","article-title":"Directory of useful decoys, enhanced (DUD-E): better ligands and decoys for better benchmarking","volume":"55","author":"Mysinger","year":"2012","journal-title":"J Med Chem"},{"key":"2021052109430084400_ref36","doi-asserted-by":"crossref","first-page":"1447","DOI":"10.1021\/ci400115b","article-title":"Evaluation and optimization of virtual screening workflows with DEKOIS 2.0-a public library of challenging docking benchmark sets","volume":"53","author":"Bauer","year":"2013","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref37","doi-asserted-by":"crossref","first-page":"D930","DOI":"10.1093\/nar\/gky1075","article-title":"ChEMBL: towards direct deposition of bioassay data","volume":"47","author":"Mendez","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2021052109430084400_ref38","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1021\/ci049714+","article-title":"ZINC - a free database of commercially available compounds for virtual screening","volume":"45","author":"Irwin","year":"2005","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref39","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1021\/ci100031x","article-title":"Conformer generation with OMEGA: algorithm and validation using high quality structures from the protein databank and Cambridge structural database","volume":"50","author":"Hawkins","year":"2010","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref40","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1093\/nar\/28.1.235","article-title":"The protein data Bank","volume":"28","author":"Berman","year":"2000","journal-title":"Nucleic Acids Res"},{"key":"2021052109430084400_ref41","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1007\/s10822-013-9644-8","article-title":"Protein and ligand preparation: parameters, protocols, and influence on virtual screening enrichments","volume":"27","author":"Sastry","year":"2013","journal-title":"J Comput Aided Mol Des"},{"key":"2021052109430084400_ref42","doi-asserted-by":"crossref","first-page":"6474","DOI":"10.1021\/jp003919d","article-title":"Evaluation and reparametrization of the OPLS-AA force field for proteins via comparison with accurate quantum chemical calculations on peptides","volume":"105","author":"Kaminski","year":"2001","journal-title":"J Phys Chem B"},{"key":"2021052109430084400_ref43","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1021\/ct100578z","article-title":"PROPKA3: consistent treatment of internal and surface residues in empirical pK(a) predictions","volume":"7","author":"Olsson","year":"2011","journal-title":"J Chem Theory Comput"},{"key":"2021052109430084400_ref44","doi-asserted-by":"crossref","first-page":"D198","DOI":"10.1093\/nar\/gkl999","article-title":"BindingDB: a web-accessible database of experimentally determined protein-ligand binding affinities","volume":"35","author":"Liu","year":"2007","journal-title":"Nucleic Acids Res"},{"key":"2021052109430084400_ref45","volume-title":"Schr\u00f6dinger Release 2019-1: LigPrep","year":"2019"},{"key":"2021052109430084400_ref46","doi-asserted-by":"crossref","first-page":"2719","DOI":"10.1021\/jm901137j","article-title":"New substructure filters for removal of Pan assay interference compounds (PAINS) from screening libraries and for their exclusion in bioassays","volume":"53","author":"Baell","year":"2010","journal-title":"J Med Chem"},{"key":"2021052109430084400_ref47","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1016\/S1367-5931(99)80058-1","article-title":"Recognizing molecules with drug-like properties","volume":"3","author":"Walters","year":"1999","journal-title":"Curr Opin Chem Biol"},{"key":"2021052109430084400_ref48","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.jmgm.2010.05.008","article-title":"Analysis and comparison of 2D fingerprints: insights into database screening performance using eight fingerprint methods","volume":"29","author":"Duan","year":"2010","journal-title":"J Mol Graph Model"},{"key":"2021052109430084400_ref49","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1023\/A:1008130001697","article-title":"Property distribution of drug-related chemical databases","volume":"14","author":"Oprea","year":"2000","journal-title":"J Comput Aided Mol Des"},{"key":"2021052109430084400_ref50","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.addr.2012.09.019","article-title":"Experimental and computational approaches to estimate solubility and permeability in drug discovery and development settings","volume":"64","author":"Lipinski","year":"2012","journal-title":"Adv Drug Deliv Rev"},{"key":"2021052109430084400_ref51","volume-title":"Discovery Studio 2.5 Guide","year":"2009"},{"key":"2021052109430084400_ref52","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1016\/j.cell.2015.04.011","article-title":"Structure of the angiotensin receptor revealed by serial femtosecond crystallography","volume":"161","author":"Zhang","year":"2015","journal-title":"Cell"},{"key":"2021052109430084400_ref53","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1021\/acs.jmedchem.6b01363","article-title":"Structure-based Design of Tricyclic NF-kappa B inducing kinase (NIK) inhibitors that have high selectivity over Phosphoinositide-3-kinase (PI3K)","volume":"60","author":"Castanedo","year":"2017","journal-title":"J Med Chem"},{"key":"2021052109430084400_ref54","doi-asserted-by":"crossref","first-page":"1956","DOI":"10.1021\/jm0310582","article-title":"Crystal structures of the vitamin D nuclear receptor liganded with the vitamin D side chain analogues calcipotriol and seocalcitol, receptor agonists of clinical importance. Insights into a structural basis for the switching of calcipotriol to a receptor antagonist by further side chain modification","volume":"47","author":"Tocchini-Valentini","year":"2004","journal-title":"J Med Chem"},{"key":"2021052109430084400_ref55","doi-asserted-by":"crossref","first-page":"12964","DOI":"10.1039\/C6CP01555G","article-title":"Comprehensive evaluation of ten docking programs on a diverse set of protein-ligand complexes: the prediction accuracy of sampling power and scoring power","volume":"18","author":"Wang","year":"2016","journal-title":"Phys Chem Chem Phys"},{"key":"2021052109430084400_ref56","doi-asserted-by":"crossref","first-page":"1739","DOI":"10.1021\/jm0306430","article-title":"Glide: a new approach for rapid, accurate docking and scoring. 1. Method and assessment of docking accuracy","volume":"47","author":"Friesner","year":"2004","journal-title":"J Med Chem"},{"key":"2021052109430084400_ref57","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1006\/jmbi.1996.0897","article-title":"Development and validation of a genetic algorithm for flexible docking","volume":"267","author":"Jones","year":"1997","journal-title":"J Mol Biol"},{"key":"2021052109430084400_ref58","doi-asserted-by":"crossref","first-page":"3594","DOI":"10.1016\/j.bmcl.2016.06.013","article-title":"Enriching screening libraries with bioactive fragment space","volume":"26","author":"Zhang","year":"2016","journal-title":"Bioorg Med Chem Lett"},{"key":"2021052109430084400_ref59","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1002\/minf.201400132","article-title":"Improving AutoDock Vina using random forest: the growing accuracy of binding affinity prediction by the effective exploitation of larger data sets","volume":"34","author":"Li","year":"2015","journal-title":"Mol Inform"},{"key":"2021052109430084400_ref60","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1186\/s12859-016-1169-4","article-title":"Correcting the impact of docking pose generation error on binding affinity prediction","volume":"17","author":"Li","year":"2016","journal-title":"BMC Bioinform"},{"key":"2021052109430084400_ref61","doi-asserted-by":"crossref","first-page":"2785","DOI":"10.1002\/jcc.21256","article-title":"AutoDock4 and AutoDockTools4: automated docking with selective receptor flexibility","volume":"30","author":"Morris","year":"2009","journal-title":"J Comput Chem"},{"key":"2021052109430084400_ref62","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1186\/s13321-015-0078-2","article-title":"Open drug discovery toolkit (ODDT): a new open-source player in the drug discovery field","volume":"7","author":"Wojcikowski","year":"2015","journal-title":"J Cheminformatics"},{"key":"2021052109430084400_ref63","doi-asserted-by":"crossref","first-page":"1334","DOI":"10.1093\/bioinformatics\/bty757","article-title":"Development of a protein-ligand extended connectivity (PLEC) fingerprint and its application for binding affinity predictions","volume":"35","author":"Wojcikowski","year":"2019","journal-title":"Bioinformatics"},{"key":"2021052109430084400_ref64","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","article-title":"The meaning and use of the area under a receiver operating characteristic (ROC) curve","volume":"143","author":"Hanley","year":"1982","journal-title":"Radiology"},{"key":"2021052109430084400_ref65","doi-asserted-by":"crossref","first-page":"1561","DOI":"10.1021\/ci100214a","article-title":"Rapid context-dependent ligand desolvation in molecular docking","volume":"50","author":"Mysinger","year":"2010","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref66","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/s10822-008-9196-5","article-title":"Recommendations for evaluation of computational methods","volume":"22","author":"Jain","year":"2008","journal-title":"J Comput Aided Mol Des"},{"key":"2021052109430084400_ref67","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1021\/ci600426e","article-title":"Evaluating virtual screening methods: good and bad metrics for the \u201cearly recognition\u201d problem","volume":"47","author":"Truchon","year":"2007","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref68","first-page":"2825","article-title":"Scikit-learn: machine learning in python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J Mach Learn Res"},{"key":"2021052109430084400_ref69","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MCSE.2011.37","article-title":"The NumPy Array: a structure for efficient numerical computation","volume":"13","author":"van der Walt","year":"2011","journal-title":"Comput Sci Eng"},{"key":"2021052109430084400_ref70","first-page":"263","article-title":"Distribution-free multiple comparisons","volume":"18","author":"Nemenyi","year":"1962","journal-title":"Biometrics"},{"key":"2021052109430084400_ref71","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.21105\/joss.01169","article-title":"Scikit-posthocs: pairwise multiple comparison tests in python","volume":"4","author":"Terpilowski","year":"2019","journal-title":"J Open Source Softw"},{"key":"2021052109430084400_ref72","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.pharmthera.2012.12.007","article-title":"Cytochrome P450 enzymes in drug metabolism: regulation of gene expression, enzyme activities, and impact of genetic variation","volume":"138","author":"Zanger","year":"2013","journal-title":"Pharmacol Ther"},{"key":"2021052109430084400_ref73","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1186\/s13321-016-0167-x","article-title":"Benchmark of four popular virtual screening programs: construction of the active\/decoy dataset remains a major determinant of measured performance","volume":"8","author":"Chaput","year":"2016","journal-title":"J Cheminformatics"},{"key":"2021052109430084400_ref74","doi-asserted-by":"crossref","first-page":"e0220113","DOI":"10.1371\/journal.pone.0220113","article-title":"Hidden bias in the DUD-E dataset leads to misleading performance of deep learning in structure-based virtual screening","volume":"14","author":"Chen","year":"2019","journal-title":"PLos One"},{"key":"2021052109430084400_ref75","author":"Zhang","year":"2019"},{"key":"2021052109430084400_ref76","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1002\/prot.20264","article-title":"Scoring function for automated assessment of protein structure template quality","volume":"57","author":"Zhang","year":"2004","journal-title":"Proteins"},{"key":"2021052109430084400_ref77","doi-asserted-by":"crossref","first-page":"345","DOI":"10.3389\/fphar.2019.00345","article-title":"Importance of incorporating protein flexibility in molecule modeling: a theoretical study on type I-1\/2 NIK inhibitors","volume":"10","author":"Shen","year":"2019","journal-title":"Front Pharmacol"},{"key":"2021052109430084400_ref78","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1016\/j.compbiomed.2017.09.007","article-title":"Interaction prediction in structure-based virtual screening using deep learning","volume":"100","author":"Gonczarek","year":"2018","journal-title":"Comput Biol Med"},{"key":"2021052109430084400_ref79","doi-asserted-by":"crossref","DOI":"10.1021\/acs.jcim.9b00927","article-title":"Combining docking pose rank and structure with deep learning improves protein-ligand binding mode prediction over a baseline docking approach","author":"Morrone","year":"2020","journal-title":"J Chem Inf Model"},{"key":"2021052109430084400_ref80","doi-asserted-by":"crossref","first-page":"947","DOI":"10.1021\/acs.jcim.8b00712","article-title":"In need of bias control: evaluating chemical data for machine learning in structure-based virtual screening","volume":"59","author":"Sieg","year":"2019","journal-title":"J Chem Inf Model"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bib\/article-pdf\/22\/3\/bbaa070\/37965236\/bbaa070.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/bib\/article-pdf\/22\/3\/bbaa070\/37965236\/bbaa070.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,21]],"date-time":"2021-05-21T09:43:56Z","timestamp":1621590236000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbaa070\/5850047"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,2]]},"references-count":80,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,5,20]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbaa070","relation":{},"ISSN":["1477-4054"],"issn-type":[{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,5]]},"published":{"date-parts":[[2020,6,2]]},"article-number":"bbaa070"}}