{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T21:02:50Z","timestamp":1776286970094,"version":"3.50.1"},"reference-count":67,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,10,11]],"date-time":"2021-10-11T00:00:00Z","timestamp":1633910400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,11]],"date-time":"2021-10-11T00:00:00Z","timestamp":1633910400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cheminform"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>In recent years, individual and collective human intelligence, defined as the knowledge, skills, reasoning and intuition of individuals and groups, have been used in combination with computer algorithms to solve complex scientific problems. Such approach was successfully used in different research fields such as: structural biology, comparative genomics, macromolecular crystallography and RNA design. Herein we describe an attempt to use a similar approach in small-molecule drug discovery, specifically to drive search strategies of de novo drug design. This is assessed with a case study that consists of a series of public experiments in which participants had to explore the huge chemical space in silico to find predefined compounds by designing molecules and analyzing the score associate with them. Such a process may be seen as an instantaneous surrogate of the classical design-make-test cycles carried out by medicinal chemists during the drug discovery hit to lead phase but not hindered by long synthesis and testing times. We present first findings on (1) assessing human intelligence in chemical space exploration, (2) comparing individual and collective human intelligence performance in this task and (3) contrasting some human and artificial intelligence achievements in de novo drug design.<\/jats:p>","DOI":"10.1186\/s13321-021-00556-6","type":"journal-article","created":{"date-parts":[[2021,10,11]],"date-time":"2021-10-11T14:19:25Z","timestamp":1633961965000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Individual and collective human intelligence in drug design: evaluating the search strategy"],"prefix":"10.1186","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5242-0707","authenticated-orcid":false,"given":"Giovanni","family":"Cincilla","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simone","family":"Masoni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jascha","family":"Blobel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,10,11]]},"reference":[{"issue":"4","key":"556_CR1","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1016\/j.atg.2014.07.001","volume":"3","author":"V Curtis","year":"2014","unstructured":"Curtis V (2014) Online citizen science games: opportunities for the biological sciences. Appl Transl Genomics 3(4):90\u201394. https:\/\/doi.org\/10.1016\/j.atg.2014.07.001","journal-title":"Appl Transl Genomics"},{"issue":"11","key":"556_CR2","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1016\/j.tibs.2014.08.005","volume":"39","author":"A Treuille","year":"2014","unstructured":"Treuille A, Das R (2014) Scientific rigor through videogames. Trends Biochem Sci 39(11):507\u2013509. https:\/\/doi.org\/10.1016\/j.tibs.2014.08.005","journal-title":"Trends Biochem Sci"},{"issue":"1","key":"556_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2091-14-26","volume":"14","author":"TA Rowles","year":"2013","unstructured":"Rowles TA (2013) Power to the people: does eterna signal the arrival of a new wave of crowd-sourced projects? BMC Biochem 14(1):1. https:\/\/doi.org\/10.1186\/1471-2091-14-26","journal-title":"BMC Biochem"},{"issue":"7307","key":"556_CR4","doi-asserted-by":"publisher","first-page":"756","DOI":"10.1038\/nature09304","volume":"466","author":"S Cooper","year":"2010","unstructured":"Cooper S, Khatib F, Treuille A, Barbero J, Lee J, Beenen M, Leaver-Fay A, Baker D, Popovi\u0107 Z, Players F (2010) Predicting protein structures with a multiplayer online game. Nature 466(7307):756\u2013760. https:\/\/doi.org\/10.1038\/nature09304","journal-title":"Nature"},{"issue":"10","key":"556_CR5","doi-asserted-by":"publisher","first-page":"1175","DOI":"10.1038\/nsmb.2119","volume":"18","author":"F Khatib","year":"2010","unstructured":"Khatib F, Dimaio F, Cooper S, Kazmierczyk M, Gilski M, Krzywda S, Zabranska H, Pichova I, Thompson J, Popovi\u0107 Z, Jaskolski M, Baker D (2010) Crystal structure of a monomeric retroviral protease solved by protein folding game players. Nat Struct Mol Biol 18(10):1175\u20131177. https:\/\/doi.org\/10.1038\/nsmb.2119","journal-title":"Nat Struct Mol Biol"},{"issue":"47","key":"556_CR6","doi-asserted-by":"publisher","first-page":"18949","DOI":"10.1073\/pnas.1115898108","volume":"108","author":"F Khatib","year":"2011","unstructured":"Khatib F, Cooper S, Tyka MD, Xu K, Makedon I, Popovic Z, Baker D, Players F (2011) Algorithm discovery by protein folding game players. Proc Natl Acad Sci USA 108(47):18949\u201318953. https:\/\/doi.org\/10.1073\/pnas.1115898108","journal-title":"Proc Natl Acad Sci USA"},{"key":"556_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/ncomms12549","volume":"7","author":"S Horowitz","year":"2016","unstructured":"Horowitz S, Koepnick B, Martin R, Tymieniecki A, Winburn AA, Cooper S, Flatten J, Rogawski DS, Koropatkin NM, Hailu TT, Jain N, Koldewey P, Ahlstrom LS, Chapman MR, Sikkema AP, Skiba MA, Maloney FP, Beinlich FRM, Popovic Z, Baker D, Khatib F, Bardwell JCA (2016) Determining crystal structures through crowdsourcing and coursework. Nat Commun 7:1\u20139. https:\/\/doi.org\/10.1038\/ncomms12549","journal-title":"Nat Commun"},{"issue":"7761","key":"556_CR8","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1038\/s41586-019-1274-4","volume":"570","author":"B Koepnick","year":"2019","unstructured":"Koepnick B, Flatten J, Husain T, Ford A, Silva DA, Bick MJ, Bauer A, Liu G, Ishida Y, Boykov A, Estep RD, Kleinfelter S, N\u00f8rg\u00e5rd-Solano T, Wei L, Players F, Montelione GT, DiMaio F, Popovi\u0107 Z, Khatib F, Cooper S, De BD (2019) Novo protein design by citizen scientists. Nature 570(7761):390\u2013394. https:\/\/doi.org\/10.1038\/s41586-019-1274-4","journal-title":"Nature"},{"key":"556_CR9","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0031362","author":"A Kawrykow","year":"2012","unstructured":"Kawrykow A, Roumanis G, Kam A, Kwak D, Leung C, Wu C, Zarour E, Sarmenta L, Blanchette M, Waldisp\u00fchl J (2012) Phylo: a citizen science approach for improving multiple sequence alignment. PLoS ONE. https:\/\/doi.org\/10.1371\/journal.pone.0031362","journal-title":"PLoS ONE"},{"issue":"Pt 6","key":"556_CR10","doi-asserted-by":"publisher","first-page":"1538","DOI":"10.1107\/S1399004714006427","volume":"70","author":"J Jorda","year":"2014","unstructured":"Jorda J, Sawaya MR, Yeates TO (2014) CrowdPhase: crowdsourcing the phase problem. Acta Crystallogr D Biol Crystallogr 70(Pt 6):1538\u20131548. https:\/\/doi.org\/10.1107\/S1399004714006427","journal-title":"Acta Crystallogr D Biol Crystallogr"},{"issue":"3","key":"556_CR11","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1107\/S2059798316003405","volume":"72","author":"J Jorda","year":"2016","unstructured":"Jorda J, Sawaya MR, Yeates TO (2016) Progress in low-resolution Ab initio phasing with crowdPhase. Acta Crystallogr Sect D Struct Biol 72(3):446\u2013453. https:\/\/doi.org\/10.1107\/S2059798316003405","journal-title":"Acta Crystallogr Sect D Struct Biol"},{"key":"556_CR12","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1039\/c3fd00147d","volume":"169","author":"G Levieux","year":"2014","unstructured":"Levieux G, Tiger G, Mader S, Zagury JF, Natkin S, Montes M (2014) Udock, the interactive docking entertainment system. Faraday Discuss 169:425\u2013441. https:\/\/doi.org\/10.1039\/c3fd00147d","journal-title":"Faraday Discuss"},{"key":"556_CR13","doi-asserted-by":"crossref","unstructured":"Levieux G, Montes M. Towards real-time interactive visulaization modes of molecular surfaces: examples with Udock. In 1st International Workshop on Virtual and Augmented Reality for Molecular Science (VARMS); Arles, France, 2015.","DOI":"10.1109\/VARMS.2015.7151723"},{"issue":"6","key":"556_CR14","doi-asserted-by":"publisher","first-page":"2122","DOI":"10.1073\/pnas.1518065112","volume":"111","author":"J Lee","year":"2014","unstructured":"Lee J, Kladwang W, Lee M, Cantu D, Azizyan M, Kim H, Limpaecher A, Gaikwad S, Yoon S, Treuille A, Das R (2014) RNA design rules from a massive open laboratory. Proc Natl Acad Sci USA 111(6):2122\u20132127. https:\/\/doi.org\/10.1073\/pnas.1518065112","journal-title":"Proc Natl Acad Sci USA"},{"issue":"6","key":"556_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pcbi.1007059","volume":"15","author":"RV Koodli","year":"2019","unstructured":"Koodli RV, Keep B, Coppess KR, Portela F, Das R (2019) EternaBrain: automated RNA design through move sets and strategies from an internet-scale RNA videogame. PLoS Comput Biol 15(6):1\u201322. https:\/\/doi.org\/10.1371\/journal.pcbi.1007059","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"556_CR16","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1002\/(SICI)1098-1128(199601)16:1<3::AID-MED1>3.0.CO;2-6","volume":"16","author":"RS Bohacek","year":"1996","unstructured":"Bohacek RS, Mcmartin C, Guida WC (1996) The art and practice of structure-based drug design: a molecular modeling perspective. Med Res Rev 16(1):3\u201350","journal-title":"Med Res Rev"},{"issue":"10","key":"556_CR17","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1002\/anie.200462457","volume":"44","author":"T Fink","year":"2005","unstructured":"Fink T, Bruggesser H, Reymond J-L (2005) Virtual exploration of the small-molecule chemical Universe below 160 Daltons. Angew Chem Int Ed Engl 44(10):1504\u20131508. https:\/\/doi.org\/10.1002\/anie.200462457","journal-title":"Angew Chem Int Ed Engl"},{"issue":"4","key":"556_CR18","doi-asserted-by":"publisher","first-page":"490","DOI":"10.1111\/j.2042-7158.2011.01424.x","volume":"64","author":"KLM Drew","year":"2012","unstructured":"Drew KLM, Baiman H, Khwaounjoo P, Yu B, Reynisson J (2012) Size estimation of chemical space: how big is it? J Pharm Pharmacol 64(4):490\u2013495. https:\/\/doi.org\/10.1111\/j.2042-7158.2011.01424.x","journal-title":"J Pharm Pharmacol"},{"issue":"1","key":"556_CR19","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1039\/c0md00020e","volume":"1","author":"J-L Reymond","year":"2010","unstructured":"Reymond J-L, van Deursen R, Blum LC, Ruddigkeit L (2010) Chemical space as a source for new drugs. Medchemcomm 1(1):30. https:\/\/doi.org\/10.1039\/c0md00020e","journal-title":"Medchemcomm"},{"issue":"2","key":"556_CR20","doi-asserted-by":"publisher","first-page":"342","DOI":"10.1021\/ci600423u","volume":"47","author":"T Fink","year":"2007","unstructured":"Fink T, Reymond J-L (2007) Virtual Exploration of the chemical Universe up to 11 atoms of C, N, O, F: assembly of 26.4 million structures (110.9 million stereoisomers) and analysis for new ring systems, stereochemistry, physicochemical properties, compound classes, and drug discovery. J Chem Inf Model. 47(2):342\u2013353. https:\/\/doi.org\/10.1021\/ci600423u","journal-title":"J Chem Inf Model."},{"issue":"3","key":"556_CR21","doi-asserted-by":"publisher","first-page":"722","DOI":"10.1021\/ar500432k","volume":"48","author":"J-L Reymond","year":"2015","unstructured":"Reymond J-L (2015) The chemical space project. Acc Chem Res 48(3):722\u2013730. https:\/\/doi.org\/10.1021\/ar500432k","journal-title":"Acc Chem Res"},{"issue":"8","key":"556_CR22","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1007\/s10822-013-9672-4","volume":"27","author":"PG Polishchuk","year":"2013","unstructured":"Polishchuk PG, Madzhidov TI, Varnek A (2013) Estimation of the size of drug-like chemical space based on GDB-17 data. J Comput Aided Mol Des 27(8):675\u2013679. https:\/\/doi.org\/10.1007\/s10822-013-9672-4","journal-title":"J Comput Aided Mol Des"},{"key":"556_CR23","doi-asserted-by":"publisher","first-page":"2864","DOI":"10.1021\/ci300415d","volume":"52","author":"L Ruddigkeit","year":"2012","unstructured":"Ruddigkeit L, Van Deursen R, Blum LC, Reymond J (2012) Enumeration of 166 billion organic small molecules in the chemical Universe database GDB-17. J Chem Inf Model. 52:2864\u20132875","journal-title":"J Chem Inf Model."},{"issue":"3","key":"556_CR24","doi-asserted-by":"publisher","first-page":"1116","DOI":"10.1021\/acs.jmedchem.8b01048","volume":"62","author":"WP Walters","year":"2019","unstructured":"Walters WP (2019) Virtual chemical libraries. J Med Chem 62(3):1116\u20131124. https:\/\/doi.org\/10.1021\/acs.jmedchem.8b01048","journal-title":"J Med Chem"},{"key":"556_CR25","doi-asserted-by":"crossref","unstructured":"Schneider, G. De Novo Molecular Design. Schneider G, Ed; Wiley-VCH, 2014.","DOI":"10.1002\/9783527677016"},{"issue":"5","key":"556_CR26","doi-asserted-by":"publisher","first-page":"742","DOI":"10.1002\/wcms.49","volume":"1","author":"M Hartenfeller","year":"2011","unstructured":"Hartenfeller M, Schneider G (2011) Enabling future drug discovery by de novo design. Wiley Interdiscip Rev Comput Mol Sci 1(5):742\u2013759. https:\/\/doi.org\/10.1002\/wcms.49","journal-title":"Wiley Interdiscip Rev Comput Mol Sci"},{"issue":"1","key":"556_CR27","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1007\/BF00124387","volume":"6","author":"HJ B\u00f6hm","year":"1992","unstructured":"B\u00f6hm HJ (1992) The computer program LUDI: a new method for the de novo design of enzyme inhibitors. J Comput Aided Mol Des 6(1):61\u201378","journal-title":"J Comput Aided Mol Des"},{"issue":"1","key":"556_CR28","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1021\/ci00017a027","volume":"34","author":"VJ Gillet","year":"1994","unstructured":"Gillet VJ, Newell W, Mata P, Myatt G, Sike S, Zsoldos Z, Johnson AP (1994) SPROUT: recent developments in the de novo design of molecules. J Chem Inf Comput Sci 34(1):207\u2013217. https:\/\/doi.org\/10.1021\/ci00017a027","journal-title":"J Chem Inf Comput Sci"},{"issue":"7\u20138","key":"556_CR29","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1007\/s0089400060498","volume":"6","author":"R Wang","year":"2000","unstructured":"Wang R, Gao Y, Lai L (2000) LigBuilder: a multi-purpose program for structure-based drug design. J Mol Model 6(7\u20138):498\u2013516. https:\/\/doi.org\/10.1007\/s0089400060498","journal-title":"J Mol Model"},{"issue":"3","key":"556_CR30","doi-asserted-by":"publisher","first-page":"1079","DOI":"10.1021\/ci034290p","volume":"44","author":"N Brown","year":"2004","unstructured":"Brown N, McKay B, Gilardoni F (2004) A graph-based genetic algorithm and its application to the multiobjective evolution of median molecules. J Chem Inf Comput Sci 44(3):1079\u20131087","journal-title":"J Chem Inf Comput Sci"},{"issue":"11","key":"556_CR31","doi-asserted-by":"publisher","first-page":"1207","DOI":"10.1007\/s10822-012-9609-3","volume":"26","author":"P Ertl","year":"2012","unstructured":"Ertl P, Lewis R (2012) IADE: a system for intelligent automatic design of bioisosteric analogs. J Comput Aided Mol Des 26(11):1207\u20131215. https:\/\/doi.org\/10.1007\/s10822-012-9609-3","journal-title":"J Comput Aided Mol Des"},{"key":"556_CR32","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1021\/ci800308h","volume":"49","author":"CA Nicolaou","year":"2009","unstructured":"Nicolaou CA, Apostolakis J, De PCS (2009) Novo drug design using multiobjective evolutionary graphs. J Chem Inf Model 49:295\u2013307","journal-title":"J Chem Inf Model"},{"issue":"6","key":"556_CR33","doi-asserted-by":"publisher","first-page":"1169","DOI":"10.1021\/acs.jcim.5b00073","volume":"55","author":"NC Firth","year":"2015","unstructured":"Firth NC, Atrash B, Brown N, Blagg J (2015) MOARF, an integrated workflow for multiobjective optimization: implementation, synthesis, and biological evaluation. J Chem Inf Model 55(6):1169\u20131180. https:\/\/doi.org\/10.1021\/acs.jcim.5b00073","journal-title":"J Chem Inf Model"},{"issue":"1","key":"556_CR34","doi-asserted-by":"publisher","first-page":"972","DOI":"10.1080\/14686996.2017.1401424","volume":"18","author":"X Yang","year":"2017","unstructured":"Yang X, Zhang J, Yoshizoe K, Terayama K, Tsuda K (2017) ChemTS: an efficient python library for de novo molecular generation. Sci Technol Adv Mater 18(1):972\u2013976. https:\/\/doi.org\/10.1080\/14686996.2017.1401424","journal-title":"Sci Technol Adv Mater"},{"issue":"6400","key":"556_CR35","doi-asserted-by":"publisher","first-page":"360","DOI":"10.1126\/science.aat2663","volume":"361","author":"B Sanchez-Lengeling","year":"2018","unstructured":"Sanchez-Lengeling B, Aspuru-Guzik A (2018) Inverse molecular design using machine learning: generative models for matter engineering. Science. 361(6400):360\u2013365. https:\/\/doi.org\/10.1126\/science.aat2663","journal-title":"Science."},{"key":"556_CR36","first-page":"6410","volume":"2018","author":"J You","year":"2018","unstructured":"You J, Liu B, Ying R, Pande V, Leskovec J (2018) Graph convolutional policy network for goal-directed molecular graph generation. Adv Neural Inf Process Syst. 2018:6410\u20136421","journal-title":"Adv Neural Inf Process Syst."},{"issue":"2","key":"556_CR37","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1021\/acscentsci.7b00572","volume":"4","author":"R G\u00f3mez-Bombarelli","year":"2018","unstructured":"G\u00f3mez-Bombarelli R, Wei JN, Duvenaud D, Hern\u00e1ndez-Lobato JM, S\u00e1nchez-Lengeling B, Sheberla D, Aguilera-Iparraguirre J, Hirzel TD, Adams RP, Aspuru-Guzik A (2018) Automatic chemical design using a data-driven continuous representation of molecules. ACS Cent Sci 4(2):268\u2013276. https:\/\/doi.org\/10.1021\/acscentsci.7b00572","journal-title":"ACS Cent Sci"},{"issue":"1","key":"556_CR38","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1021\/acscentsci.7b00512","volume":"4","author":"MHS Segler","year":"2018","unstructured":"Segler MHS, Kogej T, Tyrchan C, Waller MP (2018) Generating focused molecule libraries for drug discovery with recurrent neural networks. ACS Cent Sci 4(1):120\u2013131. https:\/\/doi.org\/10.1021\/acscentsci.7b00512","journal-title":"ACS Cent Sci"},{"issue":"7","key":"556_CR39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1126\/sciadv.aap7885","volume":"4","author":"M Popova","year":"2018","unstructured":"Popova M, Isayev O, Tropsha A (2018) Deep reinforcement learning for de novo drug design. Sci Adv 4(7):1\u201315. https:\/\/doi.org\/10.1126\/sciadv.aap7885","journal-title":"Sci Adv"},{"issue":"32","key":"556_CR40","doi-asserted-by":"publisher","first-page":"16200","DOI":"10.1021\/jp202765c","volume":"115","author":"NM Oboyle","year":"2011","unstructured":"Oboyle NM, Campbell CM, Hutchison GR (2011) Computational design and selection of optimal organic photovoltaic materials. J Phys Chem C 115(32):16200\u201316210. https:\/\/doi.org\/10.1021\/jp202765c","journal-title":"J Phys Chem C"},{"issue":"19","key":"556_CR41","doi-asserted-by":"publisher","first-page":"7296","DOI":"10.1021\/ja401184g","volume":"135","author":"AM Virshup","year":"2013","unstructured":"Virshup AM, Contreras-Garc\u00eda J, Wipf P, Yang W, Beratan DN (2013) Stochastic voyages into uncharted chemical space produce a representative library of all possible drug-like compounds. J Am Chem Soc 135(19):7296\u20137303. https:\/\/doi.org\/10.1021\/ja401184g","journal-title":"J Am Chem Soc"},{"issue":"12","key":"556_CR42","doi-asserted-by":"publisher","first-page":"3567","DOI":"10.1039\/c8sc05372c","volume":"10","author":"JH Jensen","year":"2019","unstructured":"Jensen JH (2019) A graph-based genetic algorithm and generative model\/Monte Carlo tree search for the exploration of chemical space. Chem Sci 10(12):3567\u20133572. https:\/\/doi.org\/10.1039\/c8sc05372c","journal-title":"Chem Sci"},{"issue":"3","key":"556_CR43","doi-asserted-by":"publisher","first-page":"1096","DOI":"10.1021\/acs.jcim.8b00839","volume":"59","author":"N Brown","year":"2019","unstructured":"Brown N, Fiscato M, Segler MHS, Vaucher AC (2019) GuacaMol: benchmarking models for de novo molecular design. J Chem Inf Model. 59(3):1096\u20131108","journal-title":"J Chem Inf Model."},{"issue":"12","key":"556_CR44","doi-asserted-by":"publisher","first-page":"3275","DOI":"10.1021\/ci200446y","volume":"51","author":"MD Hack","year":"2011","unstructured":"Hack MD, Rassokhin DN, Buyck C, Seierstad M, Skalkin A, Ten Holte P, Jones TK, Mirzadegan T, Agrafiotis DK (2011) Library enhancement through the wisdom of crowds. J Chem Inf Model 51(12):3275\u20133286. https:\/\/doi.org\/10.1021\/ci200446y","journal-title":"J Chem Inf Model"},{"issue":"6","key":"556_CR45","doi-asserted-by":"publisher","first-page":"1604","DOI":"10.1021\/ci5001778","volume":"54","author":"RP Sheridan","year":"2014","unstructured":"Sheridan RP, Zorn N, Sherer EC, Campeau LC, Chang C, Cumming J, Maddess ML, Nantermet PG, Sinz CJ, O\u2019Shea PD (2014) Modeling a crowdsourced definition of molecular complexity. J Chem Inf Model 54(6):1604\u20131616. https:\/\/doi.org\/10.1021\/ci5001778","journal-title":"J Chem Inf Model"},{"issue":"1","key":"556_CR46","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13321-017-0250-y","volume":"9","author":"S Boobier","year":"2017","unstructured":"Boobier S, Osbourn A, Mitchell JBO (2017) Can human experts predict solubility better than computers? J Cheminform 9(1):1\u201314. https:\/\/doi.org\/10.1186\/s13321-017-0250-y","journal-title":"J Cheminform"},{"issue":"20","key":"556_CR47","doi-asserted-by":"publisher","first-page":"11964","DOI":"10.1021\/acs.jmedchem.0c01148","volume":"63","author":"JT Bush","year":"2020","unstructured":"Bush JT, Pog\u00e1ny P, Pickett SD, Barker M, Baxter A, Campos S, Cooper AWJ, Hirst DJ, Inglis G, Nadin A, Patel VK, Poole D, Pritchard J, Washio Y, White G, Green D (2020) A turing test for molecular generators. J Med Chem 63(20):11964\u201311971. https:\/\/doi.org\/10.1021\/acs.jmedchem.0c01148","journal-title":"J Med Chem"},{"key":"556_CR48","doi-asserted-by":"publisher","first-page":"D1100","DOI":"10.1093\/nar\/gkr777","volume":"40","author":"A Gaulton","year":"2012","unstructured":"Gaulton A, Bellis LJ, Bento P, Chambers J, Davies M, Hersey A, Light Y, McGlinchey S, Michalovich D, Al-Lazikani B, Overington JP (2012) ChEMBL: a large-scale bioactivity database for drug discovery. Nucleic Acids Res. 40:D1100-7. https:\/\/doi.org\/10.1093\/nar\/gkr777","journal-title":"Nucleic Acids Res."},{"key":"556_CR49","doi-asserted-by":"publisher","first-page":"D1083","DOI":"10.1093\/nar\/gkt1031","volume":"42","author":"P Bento","year":"2014","unstructured":"Bento P, Gaulton A, Hersey A, Bellis LJ, Chambers J, Davies M, Kr\u00fcger F, Light Y, Mak L, McGlinchey S, Nowotka M, Papadatos G, Santos R, Overington JP (2014) The ChEMBL bioactivity database: an update. Nucleic Acids Res. 42:D1083-90. https:\/\/doi.org\/10.1093\/nar\/gkt1031","journal-title":"Nucleic Acids Res."},{"issue":"9","key":"556_CR50","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1007\/s10822-015-9860-5","volume":"29","author":"G Papadatos","year":"2015","unstructured":"Papadatos G, Gaulton A, Hersey A, Overington JP (2015) Activity, assay and target data curation and quality in the ChEMBL database. J Comput Aided Mol Des 29(9):885\u2013896. https:\/\/doi.org\/10.1007\/s10822-015-9860-5","journal-title":"J Comput Aided Mol Des"},{"key":"556_CR51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/nar\/gkw1074","volume":"2017","author":"A Gaulton","year":"2017","unstructured":"Gaulton A, Hersey A, Patr A, Chambers J, Mendez D, Mutowo P, Atkinson F, Bellis LJ, Cibri E, Davies M, Dedman N, Karlsson A, Magari P, Overington JP, Papadatos G, Smit I (2017) The ChEMBL database in 2017. Nucleic Acids Res 2017:1\u201310. https:\/\/doi.org\/10.1093\/nar\/gkw1074","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"556_CR52","doi-asserted-by":"publisher","first-page":"D930","DOI":"10.1093\/nar\/gky1075","volume":"47","author":"D Mendez","year":"2019","unstructured":"Mendez D, Gaulton A, Bento AP, Chambers J, De Veij M, F\u00e9lix E, Magari\u00f1os MP, Mosquera JF, Mutowo P, Nowotka M, Gordillo-Mara\u00f1\u00f3n M, Hunter F, Junco L, Mugumbate G, Rodriguez-Lopez M, Atkinson F, Bosc N, Radoux CJ, Segura-Cabrera A, Hersey A, Leach AR (2019) ChEMBL: towards direct deposition of bioassay data. Nucleic Acids Res 47(D1):D930\u2013D940. https:\/\/doi.org\/10.1093\/nar\/gky1075","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"556_CR53","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13321-015-0069-3","volume":"7","author":"D Bajusz","year":"2015","unstructured":"Bajusz D, R\u00e1cz A, H\u00e9berger K (2015) Why is tanimoto index an appropriate choice for fingerprint-based similarity calculations? J Cheminform 7(1):1\u201313. https:\/\/doi.org\/10.1186\/s13321-015-0069-3","journal-title":"J Cheminform"},{"issue":"5","key":"556_CR54","doi-asserted-by":"publisher","first-page":"742","DOI":"10.1021\/ci100050t","volume":"50","author":"D Rogers","year":"2010","unstructured":"Rogers D, Hahn M (2010) Extended-Connectivity Fingerprints. J Chem Inf Model 50(5):742\u2013754. https:\/\/doi.org\/10.1021\/ci100050t","journal-title":"J Chem Inf Model"},{"issue":"2","key":"556_CR55","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1021\/ci025584y","volume":"43","author":"C Steinbeck","year":"2003","unstructured":"Steinbeck C, Han Y, Kuhn S, Horlacher O, Luttmann E, Willighagen E (2003) The chemistry development kit (CDK): an open-source java library for chemo- and bioinformatics. J Chem Inf Comput Sci 43(2):493\u2013500. https:\/\/doi.org\/10.1021\/ci025584y","journal-title":"J Chem Inf Comput Sci"},{"issue":"17","key":"556_CR56","doi-asserted-by":"publisher","first-page":"2111","DOI":"10.1021\/ci025584y","volume":"12","author":"C Steinbeck","year":"2006","unstructured":"Steinbeck C, Hoppe C, Kuhn S, Floris M, Guha R, Willighagen E (2006) Recent developments of the chemistry development kit (CDK)\u2014an open-source java library for chemo- and bioinformatics. Curr Pharm Des 12(17):2111\u20132120. https:\/\/doi.org\/10.1021\/ci025584y","journal-title":"Curr Pharm Des"},{"issue":"3","key":"556_CR57","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1758-2946-6-3","volume":"6","author":"JW May","year":"2014","unstructured":"May JW, Steinbeck C (2014) Efficient ring perception for the chemistry development kit. J Cheminform 6(3):1\u201312. https:\/\/doi.org\/10.1186\/1758-2946-6-3","journal-title":"J Cheminform"},{"issue":"1","key":"556_CR58","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13321-017-0220-4","volume":"9","author":"EL Willighagen","year":"2017","unstructured":"Willighagen EL, Mayfield JW, Alvarsson J, Berg A, Carlsson L, Jeliazkova N, Kuhn S, Pluskal T, Rojas-Chert\u00f3 M, Spjuth O, Torrance G, Evelo CT, Guha R, Steinbeck C (2017) The chemistry development kit (CDK) v2.0: atom typing, depiction, molecular formulas, and substructure searching. J Cheminform. 9(1):1\u201319. https:\/\/doi.org\/10.1186\/s13321-017-0220-4","journal-title":"J Cheminform."},{"key":"556_CR59","doi-asserted-by":"publisher","DOI":"10.1186\/s13321-015-0068-4","author":"SR Heller","year":"2015","unstructured":"Heller SR, McNaught A, Pletnev I, Stein S, Tchekhovskoi D (2015) InChI, the IUPAC international chemical identifier. J Cheminform. https:\/\/doi.org\/10.1186\/s13321-015-0068-4","journal-title":"J Cheminform."},{"issue":"96","key":"556_CR60","doi-asserted-by":"publisher","first-page":"2887","DOI":"10.1021\/jm9602928","volume":"2623","author":"GW Bemis","year":"1996","unstructured":"Bemis GW, Murcko MA (1996) The properties of known drugs. 1. Molecular frameworks. J Med Chem. 2623(96):2887\u20132893","journal-title":"J Med Chem."},{"key":"556_CR61","unstructured":"Mitchell, M. Introduction to Genetic Algorithms, 5th ed.; MIT Press, 1996, Ed.; Cambridge, Massachusetts; London, England, 1998."},{"key":"556_CR62","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735\u20131780","journal-title":"Neural Comput"},{"key":"556_CR63","doi-asserted-by":"crossref","unstructured":"Coulom, R. Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search. In Computers and Games, 5th International Conference; 2006; pp 72\u201383.","DOI":"10.1007\/978-3-540-75538-8_7"},{"issue":"1","key":"556_CR64","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1021\/ci00057a005","volume":"28","author":"D Weininger","year":"1988","unstructured":"Weininger D (1988) SMILES, a chemical language and information system.1. Introduction to methodology and encoding rules. J Chem Inf Comput Sci. 28(1):31\u201336","journal-title":"J Chem Inf Comput Sci."},{"issue":"2","key":"556_CR65","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1021\/ci00062a008","volume":"29","author":"D Weininger","year":"1989","unstructured":"Weininger D, Weininger A, Weininger JL (1989) SMILES. 2. Algorithm for generation of unique SMILES notation. J Chem Inf Comput Sci. 29(2):97\u2013101","journal-title":"J Chem Inf Comput Sci."},{"issue":"11","key":"556_CR66","doi-asserted-by":"publisher","first-page":"1431","DOI":"10.1246\/cl.180665","volume":"47","author":"N Yoshikawa","year":"2018","unstructured":"Yoshikawa N, Terayama K, Sumita M, Homma T, Oono K, Tsuda K (2018) Population-based de novo molecule generation, using grammatical evolution. Chem Lett 47(11):1431\u20131434. https:\/\/doi.org\/10.1246\/cl.180665","journal-title":"Chem Lett"},{"key":"556_CR67","first-page":"2579","volume":"9","author":"L Van Der Maaten","year":"2008","unstructured":"Van Der Maaten L, Hinton G (2008) Visualizing data using T-SNE. J Mach Learn Res. 9:2579\u20132605","journal-title":"J Mach Learn Res."}],"container-title":["Journal of Cheminformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13321-021-00556-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13321-021-00556-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13321-021-00556-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,11]],"date-time":"2021-10-11T14:39:15Z","timestamp":1633963155000},"score":1,"resource":{"primary":{"URL":"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-021-00556-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,11]]},"references-count":67,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["556"],"URL":"https:\/\/doi.org\/10.1186\/s13321-021-00556-6","relation":{"has-preprint":[{"id-type":"doi","id":"10.26434\/chemrxiv.13354328.v2","asserted-by":"object"},{"id-type":"doi","id":"10.26434\/chemrxiv.13354328.v1","asserted-by":"object"}]},"ISSN":["1758-2946"],"issn-type":[{"value":"1758-2946","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,11]]},"assertion":[{"value":"30 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 September 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare the following competing financial interest(s): GC, SM and JB are employees of Molomics Biotech SL, which develops the herein mentioned software application.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"80"}}