{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T13:29:47Z","timestamp":1781616587207,"version":"3.54.5"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,2,18]],"date-time":"2020-02-18T00:00:00Z","timestamp":1581984000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,2,18]],"date-time":"2020-02-18T00:00:00Z","timestamp":1581984000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cheminform"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Research productivity in the pharmaceutical industry has declined significantly in recent decades, with higher costs, longer timelines, and lower success rates of drug candidates in clinical trials. This has prioritized the scalability and multiobjectivity of drug discovery and design. De novo drug design has emerged as a promising approach; molecules are generated from scratch, thus reducing the reliance on trial and error and premade molecular repositories. However, optimizing for molecular traits remains challenging, impeding the implementation of de novo methods. In this work, we propose a de novo approach capable of optimizing multiple traits collectively. A recurrent neural network was used to generate molecules which were then ranked based on multiple properties by a nondominated sorting algorithm. The best of the molecules generated were selected and used to fine-tune the recurrent neural network through transfer learning, creating a cycle that mimics the traditional design\u2013synthesis\u2013test cycle. We demonstrate the efficacy of this approach through a proof of concept, optimizing for constraints on molecular weight, octanol-water partition coefficient, the number of rotatable bonds, hydrogen bond donors, and hydrogen bond acceptors simultaneously. Analysis of the molecules generated after five iterations of the cycle revealed a 14-fold improvement in the quality of generated molecules, along with improvements to the accuracy of the recurrent neural network and the structural diversity of the molecules generated. This cycle notably does not require large amounts of training data nor any handwritten scoring functions. Altogether, this approach uniquely combines scalable generation with multiobjective optimization of molecules.<\/jats:p>","DOI":"10.1186\/s13321-020-00419-6","type":"journal-article","created":{"date-parts":[[2020,2,18]],"date-time":"2020-02-18T12:02:49Z","timestamp":1582027369000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":70,"title":["Multiobjective de novo drug design with recurrent neural networks and nondominated sorting"],"prefix":"10.1186","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3307-7955","authenticated-orcid":false,"given":"Jacob","family":"Yasonik","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,2,18]]},"reference":[{"issue":"4","key":"419_CR1","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1016\/j.trci.2017.10.005","volume":"3","author":"RC Mohs","year":"2017","unstructured":"Mohs RC, Greig NH (2017) Drug discovery and development: role of basic biological research. Alzheimers Dement Transl Res Clin Intervent 3(4):651\u2013657","journal-title":"Alzheimers Dement Transl Res Clin Intervent"},{"issue":"3","key":"419_CR2","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1038\/nrd3681","volume":"11","author":"JW Scannell","year":"2012","unstructured":"Scannell JW, Blanckley A, Boldon H, Warrington B (2012) Diagnosing the decline in pharmaceutical R&D efficiency. Nat Rev Drug Discov 11(3):191\u2013200","journal-title":"Nat Rev Drug Discov"},{"issue":"7","key":"419_CR3","first-page":"14","volume":"384","author":"JR Broach","year":"1996","unstructured":"Broach JR, Thorner J (1996) High-throughput screening for drug discovery. Nature 384(7):14\u201316","journal-title":"Nature"},{"issue":"16","key":"419_CR4","doi-asserted-by":"publisher","first-page":"1923","DOI":"10.2174\/1568026614666140929124445","volume":"14","author":"E Lionta","year":"2014","unstructured":"Lionta E, Spyrou G, Vassilatis D, Cournia Z (2014) Structure-based virtual screening for drug discovery: principles, applications and recent advances. Curr Top Med Chem 14(16):1923\u20131938","journal-title":"Curr Top Med Chem"},{"issue":"5","key":"419_CR5","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1002\/wcms.1104","volume":"2","author":"J Reymond","year":"2012","unstructured":"Reymond J, Ruddigkeit L, Blum L, Deursen RV (2012) The enumeration of chemical space. Wiley Interdiscip Rev Comput Mol Sci 2(5):717\u2013733","journal-title":"Wiley Interdiscip Rev Comput Mol Sci"},{"issue":"2","key":"419_CR6","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1093\/biostatistics\/kxx069","volume":"20","author":"CH Wong","year":"2018","unstructured":"Wong CH, Siah KW, Lo AW (2018) Estimation of clinical trial success rates and related parameters. Biostatistics 20(2):273\u2013286","journal-title":"Biostatistics"},{"issue":"7","key":"419_CR7","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1038\/nrd4609","volume":"14","author":"MJ Waring","year":"2015","unstructured":"Waring MJ, Arrowsmith J, Leach AR, Leeson PD, Mandrell S, Owen RM, Weir A (2015) An analysis of the attrition of drug candidates from four major pharmaceutical companies. Nat Rev Drug Discovery 14(7):475\u2013486","journal-title":"Nat Rev Drug Discovery"},{"issue":"8","key":"419_CR8","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1038\/nrd1799","volume":"4","author":"G Schneider","year":"2005","unstructured":"Schneider G, Fechner U (2005) Computer-based de novo design of drug-like molecules. Nat Rev Drug Discovery 4(8):649\u2013663","journal-title":"Nat Rev Drug Discovery"},{"issue":"5","key":"419_CR9","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1002\/wcms.1183","volume":"4","author":"JB Mitchell","year":"2014","unstructured":"Mitchell JB (2014) Machine learning methods in chemoinformatics. Wiley Interdiscip Rev Comput Mol Sci 4(5):468\u2013481","journal-title":"Wiley Interdiscip Rev Comput Mol Sci"},{"issue":"1\u20132","key":"419_CR10","first-page":"1700123","volume":"37","author":"T Blaschke","year":"2017","unstructured":"Blaschke T, Olivecrona M, Engkvist O, Bajorath J, Chen H (2017) Application of generative autoencoder in de novo molecular design. Mol Inform 37(1\u20132):1700123","journal-title":"Mol Inform"},{"issue":"2","key":"419_CR11","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1021\/acscentsci.7b00572","volume":"4","author":"R G\u00f3mez-Bombarelli","year":"2018","unstructured":"G\u00f3mez-Bombarelli R, Wei JN, Duvenaud D, Hern\u00e1ndez-Lobato JM, S\u00e1nchez-Lengeling B, Sheberla D, Aspuru-Guzik A (2018) Automatic chemical design using a data-driven continuous representation of molecules. ACS Cent Sci 4(2):268\u2013276","journal-title":"ACS Cent Sci"},{"issue":"7","key":"419_CR12","doi-asserted-by":"crossref","first-page":"10883","DOI":"10.18632\/oncotarget.14073","volume":"8","author":"A Kadurin","year":"2016","unstructured":"Kadurin A, Aliper A, Kazennov A, Mamoshina P, Vanhaelen Q, Khrabrov K, Zhavoronkov A (2016) The cornucopia of meaningful leads: applying deep adversarial autoencoders for new molecule development in oncology. Oncotarget. 8(7):10883","journal-title":"Oncotarget."},{"issue":"2","key":"419_CR13","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1021\/ci800308h","volume":"49","author":"CA Nicolaou","year":"2009","unstructured":"Nicolaou CA, Apostolakis J, Pattichis CS (2009) De novo drug design using multiobjective evolutionary graphs. J Chem Inf Model 49(2):295\u2013307","journal-title":"J Chem Inf Model"},{"issue":"2","key":"419_CR14","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1109\/4235.996017","volume":"6","author":"K Deb","year":"2002","unstructured":"Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182\u2013197","journal-title":"IEEE Trans Evol Comput"},{"issue":"4","key":"419_CR15","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1109\/TEVC.2013.2281535","volume":"18","author":"K Deb","year":"2014","unstructured":"Deb K, Jain H (2014) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Trans Evol Comput 18(4):577\u2013601","journal-title":"IEEE Trans Evol Comput"},{"key":"419_CR16","first-page":"27","volume":"27","author":"I Alberto","year":"2003","unstructured":"Alberto I, Azcarate C, Mallor F, Mateo PM (2003) Multiobjective evolutionary algorithms: pareto rankings. Monogr seminario mat garcia galdeano 27:27\u201335","journal-title":"Monogr seminario mat garcia galdeano"},{"key":"419_CR17","unstructured":"Fonseca CM, Fleming PJ (1993) Genetic algorithms for multiobjective optimization: formulation, discussion and generalization. In: Stephanie Forrest (ed) Proceedings of the fifth international conference on genetic algorithms, San Mateo"},{"key":"419_CR18","unstructured":"Bjerrum E (2017) SMILES enumeration as data augmentation for neural network modeling of molecules. ArXiv 1703.07076v2 Accessed 20 July 2018"},{"key":"419_CR19","unstructured":"Jastrzebski S, Lesniak D, Czarnecki W M (2016) Learning to SMILE(s). ArXiv 1602.06289v2. Accessed 22 July 2018"},{"issue":"1","key":"419_CR20","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1021\/ci00057a005","volume":"28","author":"D Weininger","year":"1988","unstructured":"Weininger D (1988) SMILES, a chemical language and information system. 1. introduction to methodology and encoding rules. J Chem Inf Model 28(1):31\u201336","journal-title":"J Chem Inf Model"},{"key":"419_CR21","unstructured":"Bjerrum E, Threlfall R (2017) Molecular generation with recurrent neural networks. ArXiv 1705.04612v2 Accessed 20 July 2018"},{"key":"419_CR22","unstructured":"Ertl P, Lewis R, Martin E, Polyakov V (2017) In silico generation of novel, drug-like chemical matter using the LSTM neural network. ArXiv 1712.07449v2 Accessed 24 July 2018"},{"issue":"1\u20132","key":"419_CR23","first-page":"1700111","volume":"37","author":"A Gupta","year":"2017","unstructured":"Gupta A, M\u00fcller AT, Huisman BJ, Fuchs JA, Schneider P, Schneider G (2017) Generative recurrent networks for de novo drug design. Mol Inform 37(1\u20132):1700111","journal-title":"Mol Inform"},{"issue":"1","key":"419_CR24","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1021\/acscentsci.7b00512","volume":"4","author":"MH Segler","year":"2017","unstructured":"Segler MH, Kogej T, Tyrchan C, Waller MP (2017) Generating focused molecule libraries for drug discovery with recurrent neural networks. ACS Cent Sci 4(1):120\u2013131","journal-title":"ACS Cent Sci"},{"key":"419_CR25","unstructured":"Guimaraes G, Sanchez-Lengeling B, Outeiral C, Farias P L C, Aspuru-Guzik A (2018) Objective-reinforced generative adversarial networks (ORGAN) for sequence generation. ArXiv 1705.10843v3. Accessed 22 July 2018"},{"issue":"1","key":"419_CR26","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1186\/s13321-017-0235-x","volume":"9","author":"M Olivecrona","year":"2017","unstructured":"Olivecrona M, Blaschke T, Engkvist O, Chen H (2017) Molecular de-novo design through deep reinforcement learning. J Cheminform. 9(1):48","journal-title":"J Cheminform."},{"key":"419_CR27","doi-asserted-by":"crossref","unstructured":"Ciresan D C, Meier U, Schmidhuber J (2012) Transfer learning for latin and chinese characters with deep neural networks. In: The 2012 international joint conference on neural networks, Brisbane, 2012.","DOI":"10.1109\/IJCNN.2012.6252544"},{"issue":"10","key":"419_CR28","doi-asserted-by":"publisher","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","volume":"22","author":"SJ Pan","year":"2010","unstructured":"Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345\u20131359","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"419_CR29","unstructured":"Torrey L, Shavlik J. (2009).Transfer learning. Handbook of research on machine learning applications and trends. 242\u2013264."},{"key":"419_CR30","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/j.addr.2016.05.007","volume":"101","author":"LZ Benet","year":"2016","unstructured":"Benet LZ, Hosey CM, Ursu O, Oprea TI (2016) BDDCS, the rule of 5 and drugability. Adv Drug Deliv Rev 101:89\u201398","journal-title":"Adv Drug Deliv Rev"},{"issue":"8","key":"419_CR31","doi-asserted-by":"publisher","first-page":"644","DOI":"10.1038\/nrd3926-c1","volume":"12","author":"H Jhoti","year":"2013","unstructured":"Jhoti H, Williams G, Rees DC, Murray CW (2013) The rule of three for fragment-based drug discovery: where are we now? Nat Rev Drug Discov 12(8):644\u2013644","journal-title":"Nat Rev Drug Discov"},{"issue":"2","key":"419_CR32","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1038\/nchem.1243","volume":"4","author":"GR Bickerton","year":"2012","unstructured":"Bickerton GR, Paolini GV, Besnard J, Muresan S, Hopkins AL (2012) Quantifying the chemical beauty of drugs. Nat Chem 4(2):90\u201398","journal-title":"Nat Chem"},{"issue":"W1","key":"419_CR33","doi-asserted-by":"publisher","first-page":"W612","DOI":"10.1093\/nar\/gkv352","volume":"43","author":"M Davies","year":"2015","unstructured":"Davies M, Nowotka M, Papadatos G, Dedman N, Gaulton A, Atkinson F, Overington JP (2015) ChEMBL web services: streamlining access to drug discovery data and utilities. Nucleic Acids Res 43(W1):W612\u2013W620","journal-title":"Nucleic Acids Res"},{"key":"419_CR34","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1613\/jair.4992","volume":"57","author":"Y Goldberg","year":"2016","unstructured":"Goldberg Y (2016) A primer on neural network models for natural language processing. J Artif Intell Res 57:345\u2013420","journal-title":"J Artif Intell Res"},{"issue":"2","key":"419_CR35","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1109\/72.279181","volume":"5","author":"Y Bengio","year":"1994","unstructured":"Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157\u2013166","journal-title":"IEEE Trans Neural Netw"},{"key":"419_CR36","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735\u20131780","journal-title":"Neural Comput"},{"key":"419_CR37","unstructured":"Graves A (2013) Generating sequences with recurrent neural networks. ArXiv 1308.0850. Accessed 23 July 2018."},{"key":"419_CR38","unstructured":"Kingma D, Ba J (2015) Adam: a method for stochastic optimization. In: International conference for learning representations, San Diego"},{"key":"419_CR39","unstructured":"Paszke A, Gross S, Chintala S, Lerer A (2017) Conference on neural information Processing Systems, Long Beach"},{"key":"419_CR40","unstructured":"RDKit: Open-Source Cheminformatics. https:\/\/www.rdkit.org. Accessed 15 Jan 2019"},{"issue":"1","key":"419_CR41","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1021\/cc9800071","volume":"1","author":"AK Ghose","year":"1999","unstructured":"Ghose AK, Viswanadhan VN, Wendoloski JJ (1999) A knowledge-based approach in designing combinatorial or medicinal chemistry libraries for drug discovery. 1. a qualitative and quantitative characterization of known drug databases. J Comb Chem 1(1):55\u201368","journal-title":"J Comb Chem"},{"key":"419_CR42","unstructured":"Benhenda M (2017) ChemGAN challenge for drug discovery: can ai reproduce natural chemical diversity. ArXiv 1708.08227v3 Accessed 23 July 2018"},{"issue":"2","key":"419_CR43","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1021\/c160017a018","volume":"5","author":"HL Morgan","year":"1965","unstructured":"Morgan HL (1965) The generation of a unique machine description for chemical structure. J Chem Documentation 5(2):107\u2013113","journal-title":"J Chem Documentation"},{"key":"419_CR44","doi-asserted-by":"crossref","unstructured":"Bajusz D, Racz A, Heberger K (2015) Why is tanimoto index an appropriate choice for fingerprint-based similarity calculations. J Cheminform. 7(20)","DOI":"10.1186\/s13321-015-0069-3"}],"container-title":["Journal of Cheminformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13321-020-00419-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13321-020-00419-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13321-020-00419-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,18]],"date-time":"2021-02-18T17:03:30Z","timestamp":1613667810000},"score":1,"resource":{"primary":{"URL":"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-020-00419-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,18]]},"references-count":44,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["419"],"URL":"https:\/\/doi.org\/10.1186\/s13321-020-00419-6","relation":{},"ISSN":["1758-2946"],"issn-type":[{"value":"1758-2946","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,18]]},"assertion":[{"value":"15 July 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The author declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14"}}