{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:22:34Z","timestamp":1750220554131,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":31,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,12,27]],"date-time":"2020-12-27T00:00:00Z","timestamp":1609027200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"FCT - Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","award":["CENTRO-01-0145-FEDER-029266"],"award-info":[{"award-number":["CENTRO-01-0145-FEDER-029266"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,12,27]]},"DOI":"10.1145\/3449258.3449260","type":"proceedings-article","created":{"date-parts":[[2021,6,22]],"date-time":"2021-06-22T22:06:33Z","timestamp":1624399593000},"page":"7-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["End-to-end Deep Reinforcement Learning for Targeted Drug Generation"],"prefix":"10.1145","author":[{"given":"Tiago","family":"Oliveira Pereira","sequence":"first","affiliation":[{"name":"University of Coimbra, Portugal"}]},{"given":"Maryam","family":"Abbasi","sequence":"additional","affiliation":[{"name":"University of Coimbra, Portugal"}]},{"given":"Bernardete","family":"Ribeiro","sequence":"additional","affiliation":[{"name":"University of Coimbra, Portugal"}]},{"given":"Joel","family":"P. Arrais","sequence":"additional","affiliation":[{"name":"University of Coimbra, Portugal"}]}],"member":"320","published-online":{"date-parts":[[2021,6,22]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Getting Started with the RDKit in Python. 2019. https:\/\/www.rdkit.org\/docs\/GettingStartedInPython.html Accessed: 2019-01-31.  Getting Started with the RDKit in Python. 2019. https:\/\/www.rdkit.org\/docs\/GettingStartedInPython.html Accessed: 2019-01-31."},{"volume-title":"Open-Source Cheminformatics Software","year":"2017","key":"e_1_3_2_1_2_1","unstructured":"RDKit : Open-Source Cheminformatics Software . 2017 . https:\/\/www.rdkit.org\/ RDKit: Open-Source Cheminformatics Software. 2017. https:\/\/www.rdkit.org\/"},{"key":"e_1_3_2_1_3_1","unstructured":"Softmax activation function.2019.https:\/\/towardsdatascience.com\/softmax-function-simplified-714068bf8156 Accessed: 2019-01-31  Softmax activation function.2019.https:\/\/towardsdatascience.com\/softmax-function-simplified-714068bf8156 Accessed: 2019-01-31"},{"key":"e_1_3_2_1_4_1","unstructured":"Chemaxon. 2017. Marvin Sketch. www.chemaxon.com\/products\/marvin\/  Chemaxon. 2017. Marvin Sketch. www.chemaxon.com\/products\/marvin\/"},{"key":"e_1_3_2_1_5_1","volume-title":"Kohane","author":"Beam Andrew L.","year":"2018","unstructured":"Andrew L. Beam , Benjamin Kompa , Allen Schmaltz , Inbar Fried , Griffin Weber , Nathan P. Palmer , Xu Shi , Tianxi Cai , and Isaac S . Kohane . 2018 . Clinical Concept Embeddings Learned from Massive Sources of Multimodal Medical Data .arXiv:cs.CL\/1804.01486 Andrew L. Beam, Benjamin Kompa, Allen Schmaltz, Inbar Fried, Griffin Weber, Nathan P. Palmer, Xu Shi, Tianxi Cai, and Isaac S. Kohane. 2018. Clinical Concept Embeddings Learned from Massive Sources of Multimodal Medical Data.arXiv:cs.CL\/1804.01486"},{"key":"e_1_3_2_1_6_1","volume-title":"Dix","author":"Beck Tyler C.","year":"2019","unstructured":"Tyler C. Beck , Matthew A. Hapstack , Kyle R. Beck , and Thomas A . Dix . 2019 . Therapeutic potential of kappa opioid agonists. Pharmaceuticals ( 2019). https:\/\/doi.org\/10.3390\/ph12020095 10.3390\/ph12020095 Tyler C. Beck, Matthew A. Hapstack, Kyle R. Beck, and Thomas A. Dix. 2019. Therapeutic potential of kappa opioid agonists. Pharmaceuticals (2019). https:\/\/doi.org\/10.3390\/ph12020095"},{"key":"e_1_3_2_1_7_1","volume-title":"ChemGAN challenge for drug discovery: can AI reproduce natural chemical diversity? arXiv preprint arXiv:1708.08227","author":"Benhenda Mostapha","year":"2017","unstructured":"Mostapha Benhenda . 2017. ChemGAN challenge for drug discovery: can AI reproduce natural chemical diversity? arXiv preprint arXiv:1708.08227 ( 2017 ). Mostapha Benhenda. 2017. ChemGAN challenge for drug discovery: can AI reproduce natural chemical diversity? arXiv preprint arXiv:1708.08227 (2017)."},{"key":"e_1_3_2_1_8_1","volume-title":"Hopkins","author":"Bickerton G. Richard","year":"2012","unstructured":"G. Richard Bickerton , Gaia V. Paolini , J\u00e9r\u00e9my Besnard , Sorel Muresan , and Andrew L . Hopkins . 2012 . Quantifying the chemical beauty of drugs. Nature Chemistry ( 2012). https:\/\/doi.org\/10.1038\/nchem.1243 10.1038\/nchem.1243 G. Richard Bickerton, Gaia V. Paolini, J\u00e9r\u00e9my Besnard, Sorel Muresan, and Andrew L. Hopkins. 2012. Quantifying the chemical beauty of drugs. Nature Chemistry (2012). https:\/\/doi.org\/10.1038\/nchem.1243"},{"key":"e_1_3_2_1_9_1","volume-title":"Agrafiotis","author":"Cede\u00f1o Walter","year":"2003","unstructured":"Walter Cede\u00f1o and Dimitris K . Agrafiotis . 2003 . Using particle swarms for the development of QSAR models based on Knearest neighbor and kernel regression. Journal of Computer-Aided Molecular Design ( 2003). https:\/\/doi.org\/10.1023\/A:1025338411016 10.1023\/A:1025338411016 Walter Cede\u00f1o and Dimitris K. Agrafiotis. 2003. Using particle swarms for the development of QSAR models based on Knearest neighbor and kernel regression. Journal of Computer-Aided Molecular Design (2003). https:\/\/doi.org\/10.1023\/A:1025338411016"},{"key":"e_1_3_2_1_10_1","volume-title":"Chakravarti and Sai Radha Mani Alla","author":"Suman","year":"2019","unstructured":"Suman K. Chakravarti and Sai Radha Mani Alla . 2019 . Descriptor free QSAR modeling using deep learning with long short-term memory neural networks. Frontiers in Artificial Intelligence ( 2019). https:\/\/doi.org\/10.3389\/frai.2019.00017 10.3389\/frai.2019.00017 Suman K. Chakravarti and Sai Radha Mani Alla. 2019. Descriptor free QSAR modeling using deep learning with long short-term memory neural networks. Frontiers in Artificial Intelligence (2019). https:\/\/doi.org\/10.3389\/frai.2019.00017"},{"key":"e_1_3_2_1_11_1","volume-title":"Chung","author":"Elton Daniel C.","year":"2019","unstructured":"Daniel C. Elton , Zois Boukouvalas , Mark D. Fuge , and Peter W . Chung . 2019 . Deep learning for molecular design \u2013 A review of the state of the art. https:\/\/doi.org\/10.1039\/c9me00039a arXiv:1903.04388 10.1039\/c9me00039a Daniel C. Elton, Zois Boukouvalas, Mark D. Fuge, and Peter W. Chung. 2019. Deep learning for molecular design \u2013 A review of the state of the art. https:\/\/doi.org\/10.1039\/c9me00039a arXiv:1903.04388"},{"key":"e_1_3_2_1_12_1","volume-title":"Estimation of synthetic accessibility score of drug-like molecules based on molecular complexity and fragment contributions. Journal of Cheminformatics","author":"Ertl Peter","year":"2009","unstructured":"Peter Ertl and Ansgar Schuffenhauer . 2009. Estimation of synthetic accessibility score of drug-like molecules based on molecular complexity and fragment contributions. Journal of Cheminformatics ( 2009 ). https:\/\/doi.org\/10.1186\/1758-2946-1-8 10.1186\/1758-2946-1-8 Peter Ertl and Ansgar Schuffenhauer. 2009. Estimation of synthetic accessibility score of drug-like molecules based on molecular complexity and fragment contributions. Journal of Cheminformatics (2009). https:\/\/doi.org\/10.1186\/1758-2946-1-8"},{"key":"e_1_3_2_1_13_1","volume-title":"Current Research on Opioid Receptor Function. Current Drug Targets","author":"Feng Yuan","year":"2012","unstructured":"Yuan Feng , Xiaozhou He , Yilin Yang , Dongman Chao , Lawrence H. Lazarus , and Ying Xia . 2012. Current Research on Opioid Receptor Function. Current Drug Targets ( 2012 ). https:\/\/doi.org\/10.2174\/138945012799201612 10.2174\/138945012799201612 Yuan Feng, Xiaozhou He, Yilin Yang, Dongman Chao, Lawrence H. Lazarus, and Ying Xia. 2012. Current Research on Opioid Receptor Function. Current Drug Targets (2012). https:\/\/doi.org\/10.2174\/138945012799201612"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1561\/2200000071"},{"key":"e_1_3_2_1_15_1","volume-title":"Smiles2vec: An interpretable general purpose deep neural network for predicting chemical properties. arXiv preprint arXiv:1712.02034","author":"Goh Garrett B","year":"2017","unstructured":"Garrett B Goh , Nathan O Hodas , Charles Siegel , and Abhinav Vishnu . 2017. Smiles2vec: An interpretable general purpose deep neural network for predicting chemical properties. arXiv preprint arXiv:1712.02034 ( 2017 ). Garrett B Goh, Nathan O Hodas, Charles Siegel, and Abhinav Vishnu. 2017. Smiles2vec: An interpretable general purpose deep neural network for predicting chemical properties. arXiv preprint arXiv:1712.02034 (2017)."},{"key":"e_1_3_2_1_16_1","volume-title":"Jens A Fuchs, Petra Schneider, and Gisbert Schneider.","author":"Gupta Anvita","year":"2018","unstructured":"Anvita Gupta , Alex T M\u00fcller , Berend JH Huisman , Jens A Fuchs, Petra Schneider, and Gisbert Schneider. 2018 . Generative recurrent networks for de novo drug design. Molecular informatics 37, 1-2 (2018), 1700111. Anvita Gupta, Alex T M\u00fcller, Berend JH Huisman, Jens A Fuchs, Petra Schneider, and Gisbert Schneider. 2018. Generative recurrent networks for de novo drug design. Molecular informatics 37, 1-2 (2018), 1700111."},{"key":"e_1_3_2_1_17_1","volume-title":"Pattichis","author":"Nicolaou Christos A.","year":"2009","unstructured":"Christos A. Nicolaou , Joannis Apostolakis , and Costas S . Pattichis . 2009 . De novo drug design using multiobjective evolutionary graphs. Journal of Chemical Information and Modeling ( 2009). https:\/\/doi.org\/10.1021\/ci800308h 10.1021\/ci800308h Christos A. Nicolaou, Joannis Apostolakis, and Costas S. Pattichis. 2009. De novo drug design using multiobjective evolutionary graphs. Journal of Chemical Information and Modeling (2009). https:\/\/doi.org\/10.1021\/ci800308h"},{"key":"e_1_3_2_1_18_1","volume-title":"Molecular de-novo design through deep reinforcement learning. Journal of Cheminformatics","author":"Olivecrona Marcus","year":"2017","unstructured":"Marcus Olivecrona , Thomas Blaschke , Ola Engkvist , and Hongming Chen . 2017. Molecular de-novo design through deep reinforcement learning. Journal of Cheminformatics ( 2017 ). https:\/\/doi.org\/10.1186\/s13321-017-0235-x arXiv:1704.07555 10.1186\/s13321-017-0235-x Marcus Olivecrona, Thomas Blaschke, Ola Engkvist, and Hongming Chen. 2017. Molecular de-novo design through deep reinforcement learning. Journal of Cheminformatics (2017). https:\/\/doi.org\/10.1186\/s13321-017-0235-x arXiv:1704.07555"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_2_1_20_1","volume-title":"Deep reinforcement learning for de novo drug design. Science Advances","author":"Popova Mariya","year":"2018","unstructured":"Mariya Popova , Olexandr Isayev , and Alexander Tropsha . 2018. Deep reinforcement learning for de novo drug design. Science Advances ( 2018 ). https:\/\/doi.org\/10.1126\/sciadv.aap7885 10.1126\/sciadv.aap7885 Mariya Popova, Olexandr Isayev, and Alexander Tropsha. 2018. Deep reinforcement learning for de novo drug design. Science Advances (2018). https:\/\/doi.org\/10.1126\/sciadv.aap7885"},{"key":"#cr-split#-e_1_3_2_1_21_1.1","doi-asserted-by":"crossref","unstructured":"Jean Louis Reymond Lars Ruddigkeit Lorenz Blum and Ruud van Deursen. 2012. The enumeration of chemical space. https:\/\/doi.org\/10.1002\/wcms.1104 10.1002\/wcms.1104","DOI":"10.1002\/wcms.1104"},{"key":"#cr-split#-e_1_3_2_1_21_1.2","doi-asserted-by":"crossref","unstructured":"Jean Louis Reymond Lars Ruddigkeit Lorenz Blum and Ruud van Deursen. 2012. The enumeration of chemical space. https:\/\/doi.org\/10.1002\/wcms.1104","DOI":"10.1002\/wcms.1104"},{"key":"e_1_3_2_1_22_1","volume-title":"Extended-connectivity fingerprints. Journal of Chemical Information and Modeling","author":"Rogers David","year":"2010","unstructured":"David Rogers and Mathew Hahn . 2010. Extended-connectivity fingerprints. Journal of Chemical Information and Modeling ( 2010 ). https:\/\/doi.org\/10.1021\/ci100050t 10.1021\/ci100050t David Rogers and Mathew Hahn. 2010. Extended-connectivity fingerprints. Journal of Chemical Information and Modeling (2010). https:\/\/doi.org\/10.1021\/ci100050t"},{"key":"e_1_3_2_1_23_1","volume-title":"Detlev Suelzle, Ursula Ganzer, Nikolaus Heinrich, and Klaus Robert M\u00fcller.","author":"Schroeter Timon Sebastian","year":"2007","unstructured":"Timon Sebastian Schroeter , Anton Schwaighofer , Sebastian Mika , Antonius Ter Laak , Detlev Suelzle, Ursula Ganzer, Nikolaus Heinrich, and Klaus Robert M\u00fcller. 2007 . Estimating the domain of applicability for machine learning QSAR models: A study on aqueous solubility of drug discovery molecules. Journal of Computer-Aided Molecular Design ( 2007). https:\/\/doi.org\/10.1007\/s10822-007-9160-9 10.1007\/s10822-007-9160-9 Timon Sebastian Schroeter, Anton Schwaighofer, Sebastian Mika, Antonius Ter Laak, Detlev Suelzle, Ursula Ganzer, Nikolaus Heinrich, and Klaus Robert M\u00fcller. 2007. Estimating the domain of applicability for machine learning QSAR models: A study on aqueous solubility of drug discovery molecules. Journal of Computer-Aided Molecular Design (2007). https:\/\/doi.org\/10.1007\/s10822-007-9160-9"},{"key":"e_1_3_2_1_24_1","volume-title":"Waller","author":"Segler Marwin H.S.","year":"2018","unstructured":"Marwin H.S. Segler , Thierry Kogej , Christian Tyrchan , and Mark P . Waller . 2018 . Generating focused molecule libraries for drug discovery with recurrent neural networks. ACS Central Science ( 2018). https:\/\/doi.org\/10.1021\/acscentsci.7b00512 arXiv:1701.01329 10.1021\/acscentsci.7b00512 Marwin H.S. Segler, Thierry Kogej, Christian Tyrchan, and Mark P.Waller. 2018. Generating focused molecule libraries for drug discovery with recurrent neural networks. ACS Central Science (2018). https:\/\/doi.org\/10.1021\/acscentsci.7b00512 arXiv:1701.01329"},{"key":"e_1_3_2_1_25_1","volume-title":"Opioid receptors: Structural and mechanistic insights into pharmacology and signaling. European Journal of Pharmacology","author":"Shang Yi","year":"2015","unstructured":"Yi Shang and Marta Filizola . 2015. Opioid receptors: Structural and mechanistic insights into pharmacology and signaling. European Journal of Pharmacology ( 2015 ). https:\/\/doi.org\/10.1016\/j.ejphar.2015.05.012 10.1016\/j.ejphar.2015.05.012 Yi Shang and Marta Filizola. 2015. Opioid receptors: Structural and mechanistic insights into pharmacology and signaling. European Journal of Pharmacology (2015). https:\/\/doi.org\/10.1016\/j.ejphar.2015.05.012"},{"key":"#cr-split#-e_1_3_2_1_26_1.1","doi-asserted-by":"crossref","unstructured":"Dagmar Stumpfe and J\u00fcrgen Bajorath. 2011. Similarity searching. https:\/\/doi.org\/10.1002\/wcms.23 10.1002\/wcms.23","DOI":"10.1002\/wcms.23"},{"key":"#cr-split#-e_1_3_2_1_26_1.2","doi-asserted-by":"crossref","unstructured":"Dagmar Stumpfe and J\u00fcrgen Bajorath. 2011. Similarity searching. https:\/\/doi.org\/10.1002\/wcms.23","DOI":"10.1002\/wcms.23"},{"key":"e_1_3_2_1_27_1","volume-title":"Barto","author":"Sutton Richard S.","year":"2018","unstructured":"Richard S. Sutton and Andrew G . Barto . 2018 . Reinforcement Learning : An Introduction (second ed.). The MIT Press . http:\/\/incompleteideas.net\/book\/the-book-2nd.html Richard S. Sutton and Andrew G. Barto. 2018. Reinforcement Learning: An Introduction (second ed.). The MIT Press. http:\/\/incompleteideas.net\/book\/the-book-2nd.html"},{"volume-title":"Statistical Learning Theory: Models, Concepts, and Results","author":"von Luxburg Ulrike","key":"e_1_3_2_1_28_1","unstructured":"Ulrike von Luxburg and Bernhard Sch\u00f6lkopf . 2011. Statistical Learning Theory: Models, Concepts, and Results . Elsevier . https:\/\/doi.org\/10.1016\/B978-0-444-52936-7.50016-1 arXiv:0810.4752 10.1016\/B978-0-444-52936-7.50016-1 Ulrike von Luxburg and Bernhard Sch\u00f6lkopf. 2011. Statistical Learning Theory: Models, Concepts, and Results. Elsevier. https:\/\/doi.org\/10.1016\/B978-0-444-52936-7.50016-1 arXiv:0810.4752"},{"key":"e_1_3_2_1_29_1","volume-title":"Yi Min Tao, Zhi Qiang Chi, and Jing Gen Liu.","author":"Wang Yu Hua","year":"2010","unstructured":"Yu Hua Wang , Jian Feng Sun , Yi Min Tao, Zhi Qiang Chi, and Jing Gen Liu. 2010 . The role of K-opioid receptor activation in mediating antinociception and addiction. https:\/\/doi.org\/10.1038\/aps.2010.138 10.1038\/aps.2010.138 Yu Hua Wang, Jian Feng Sun, Yi Min Tao, Zhi Qiang Chi, and Jing Gen Liu. 2010. The role of K-opioid receptor activation in mediating antinociception and addiction. https:\/\/doi.org\/10.1038\/aps.2010.138"}],"event":{"name":"ICCBB '20: 2020 4th International Conference on Computational Biology and Bioinformatics","acronym":"ICCBB '20","location":"Bali Island Indonesia"},"container-title":["2020 4th International Conference on Computational Biology and Bioinformatics"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449258.3449260","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449258.3449260","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:22Z","timestamp":1750195702000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449258.3449260"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,27]]},"references-count":31,"alternative-id":["10.1145\/3449258.3449260","10.1145\/3449258"],"URL":"https:\/\/doi.org\/10.1145\/3449258.3449260","relation":{},"subject":[],"published":{"date-parts":[[2020,12,27]]},"assertion":[{"value":"2021-06-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}