{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T03:32:57Z","timestamp":1773804777858,"version":"3.50.1"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,2,26]],"date-time":"2023-02-26T00:00:00Z","timestamp":1677369600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,2,26]],"date-time":"2023-02-26T00:00:00Z","timestamp":1677369600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Cystic Fibrosis Canada Research Grant"},{"DOI":"10.13039\/501100000024","name":"Canadian Institutes of Health Research","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100008795","name":"Manitoba Medical Service Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008795","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Canada Research Chairs Tier II Program"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cheminform"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Graph convolutional neural networks (GCNs) have been repeatedly shown to have robust capacities for modeling graph data such as small molecules. Message-passing neural networks (MPNNs), a group of GCN variants that can learn and aggregate local information of molecules through iterative message-passing iterations, have exhibited advancements in molecular modeling and property prediction. Moreover, given the merits of Transformers in multiple artificial intelligence domains, it is desirable to combine the self-attention mechanism with MPNNs for better molecular representation. We propose an atom-bond transformer-based message-passing neural network (ABT-MPNN), to improve the molecular representation embedding process for molecular property predictions. By designing corresponding attention mechanisms in the message-passing and readout phases of the MPNN, our method provides a novel architecture that integrates molecular representations at the bond, atom and molecule levels in an end-to-end way. The experimental results across nine datasets show that the proposed ABT-MPNN outperforms or is comparable to the state-of-the-art baseline models in quantitative structure\u2013property relationship tasks. We provide case examples of <jats:italic>Mycobacterium tuberculosis<\/jats:italic> growth inhibitors and demonstrate that our model's visualization modality of attention at the atomic level could be an insightful way to investigate molecular atoms or functional groups associated with desired biological properties. The new model provides an innovative way to investigate the effect of self-attention on chemical substructures and functional groups in molecular representation learning, which increases the interpretability of the traditional MPNN and can serve as a valuable way to investigate the mechanism of action of drugs.<\/jats:p>","DOI":"10.1186\/s13321-023-00698-9","type":"journal-article","created":{"date-parts":[[2023,2,26]],"date-time":"2023-02-26T17:02:38Z","timestamp":1677430958000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["ABT-MPNN: an atom-bond transformer-based message-passing neural network for molecular property prediction"],"prefix":"10.1186","volume":"15","author":[{"given":"Chengyou","family":"Liu","sequence":"first","affiliation":[]},{"given":"Yan","family":"Sun","sequence":"additional","affiliation":[]},{"given":"Rebecca","family":"Davis","sequence":"additional","affiliation":[]},{"given":"Silvia T.","family":"Cardona","sequence":"additional","affiliation":[]},{"given":"Pingzhao","family":"Hu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,2,26]]},"reference":[{"key":"698_CR1","doi-asserted-by":"publisher","first-page":"1191","DOI":"10.1007\/s11427-018-9342-2","volume":"61","author":"F Zhong","year":"2018","unstructured":"Zhong F, Xing J, Li X et al (2018) Artificial intelligence in drug design. Sci China Life Sci 61:1191\u20131204. https:\/\/doi.org\/10.1007\/s11427-018-9342-2","journal-title":"Sci China Life Sci"},{"key":"698_CR2","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1016\/j.drudis.2018.11.014","volume":"24","author":"K-K Mak","year":"2019","unstructured":"Mak K-K, Pichika MR (2019) Artificial intelligence in drug development: present status and future prospects. Drug Discov Today 24:773\u2013780. https:\/\/doi.org\/10.1016\/j.drudis.2018.11.014","journal-title":"Drug Discov Today"},{"key":"698_CR3","doi-asserted-by":"publisher","first-page":"688","DOI":"10.1016\/j.cell.2020.01.021","volume":"180","author":"JM Stokes","year":"2020","unstructured":"Stokes JM, Yang K, Swanson K et al (2020) A deep learning approach to antibiotic discovery. Cell 180:688-702.e13. https:\/\/doi.org\/10.1016\/j.cell.2020.01.021","journal-title":"Cell"},{"key":"698_CR4","unstructured":"Duvenaud D, Maclaurin D, Aguilera-Iparraguirre J, et al (2015) Convolutional Networks on Graphs for Learning Molecular Fingerprints. arXiv:150909292 [cs, stat]"},{"key":"698_CR5","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1007\/s10822-016-9938-8","volume":"30","author":"S Kearnes","year":"2016","unstructured":"Kearnes S, McCloskey K, Berndl M et al (2016) Molecular graph convolutions: moving beyond fingerprints. J Comput Aided Mol Des 30:595\u2013608. https:\/\/doi.org\/10.1007\/s10822-016-9938-8","journal-title":"J Comput Aided Mol Des"},{"key":"698_CR6","unstructured":"Zhou J, Cui G, Zhang Z, et al. (2019). Graph Neural Networks: A Review of Methods and Applications. arXiv:181208434 [cs, stat]"},{"key":"698_CR7","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/TNNLS.2020.2978386","volume":"32","author":"Z Wu","year":"2021","unstructured":"Wu Z, Pan S, Chen F et al (2021) A comprehensive survey on graph neural networks. IEEE Trans Neural Netw Learning Syst 32:4\u201324. https:\/\/doi.org\/10.1109\/TNNLS.2020.2978386","journal-title":"IEEE Trans Neural Netw Learning Syst"},{"key":"698_CR8","unstructured":"Gilmer J, Schoenholz SS, Riley PF, et al (2017) Neural Message Passing for Quantum Chemistry. arXiv:170401212 [cs]"},{"key":"698_CR9","unstructured":"Vaswani A, Shazeer N, Parmar N, et al (2017) Attention is all you need. In: Advances in neural information processing systems. pp 5998\u20136008"},{"key":"698_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13321-020-0414-z","volume":"12","author":"B Tang","year":"2020","unstructured":"Tang B, Kramer ST, Fang M et al (2020) A self-attention based message passing neural network for predicting molecular lipophilicity and aqueous solubility. J Cheminform 12:1\u20139","journal-title":"J Cheminform"},{"key":"698_CR11","unstructured":"Maziarka \u0141, Danel T, Mucha S, et al (2020) Molecule attention transformer. arXiv preprint arXiv:200208264"},{"key":"698_CR12","unstructured":"Ying C, Cai T, Luo S, et al (2021) Do Transformers Really Perform Bad for Graph Representation? arXiv preprint arXiv:210605234"},{"key":"698_CR13","doi-asserted-by":"publisher","first-page":"8749","DOI":"10.1021\/acs.jmedchem.9b00959","volume":"63","author":"Z Xiong","year":"2019","unstructured":"Xiong Z, Wang D, Liu X et al (2019) Pushing the boundaries of molecular representation for drug discovery with the graph attention mechanism. J Med Chem 63:8749\u20138760","journal-title":"J Med Chem"},{"key":"698_CR14","unstructured":"Chuang KV, Keiser MJ (2020) Attention-Based Learning on Molecular Ensembles. arXiv preprint arXiv:201112820"},{"key":"698_CR15","unstructured":"Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:14090473"},{"key":"698_CR16","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1186\/1758-2946-5-43","volume":"5","author":"S Riniker","year":"2013","unstructured":"Riniker S, Landrum GA (2013) Similarity maps\u2014a visualization strategy for molecular fingerprints and machine-learning methods. J Cheminform 5:43. https:\/\/doi.org\/10.1186\/1758-2946-5-43","journal-title":"J Cheminform"},{"key":"698_CR17","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1186\/s13321-020-00460-5","volume":"12","author":"L David","year":"2020","unstructured":"David L, Thakkar A, Mercado R, Engkvist O (2020) Molecular representations in AI-driven drug discovery: a review and practical guide. J Cheminform 12:56. https:\/\/doi.org\/10.1186\/s13321-020-00460-5","journal-title":"J Cheminform"},{"key":"698_CR18","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.108.058301","volume":"108","author":"M Rupp","year":"2012","unstructured":"Rupp M, Tkatchenko A, M\u00fcller K-R, Von Lilienfeld OA (2012) Fast and accurate modeling of molecular atomization energies with machine learning. Phys Rev Lett 108:058301","journal-title":"Phys Rev Lett"},{"key":"698_CR19","doi-asserted-by":"publisher","first-page":"3370","DOI":"10.1021\/acs.jcim.9b00237","volume":"59","author":"K Yang","year":"2019","unstructured":"Yang K, Swanson K, Jin W et al (2019) Analyzing learned molecular representations for property prediction. J Chem Inf Model 59:3370\u20133388. https:\/\/doi.org\/10.1021\/acs.jcim.9b00237","journal-title":"J Chem Inf Model"},{"key":"698_CR20","unstructured":"Dosovitskiy A, Beyer L, Kolesnikov A, et al (2020) An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:201011929"},{"key":"698_CR21","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","volume":"596","author":"J Jumper","year":"2021","unstructured":"Jumper J, Evans R, Pritzel A et al (2021) Highly accurate protein structure prediction with AlphaFold. Nature 596:583\u2013589. https:\/\/doi.org\/10.1038\/s41586-021-03819-2","journal-title":"Nature"},{"key":"698_CR22","unstructured":"Wu C, Wu F, Qi T, et al (2021) Fastformer: Additive Attention Can Be All You Need. arXiv preprint arXiv:210809084"},{"key":"698_CR23","unstructured":"Ba JL, Kiros JR, Hinton GE (2016) Layer normalization. arXiv preprint arXiv:160706450"},{"key":"698_CR24","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1038\/s41586-019-1315-z","volume":"571","author":"EO Johnson","year":"2019","unstructured":"Johnson EO, LaVerriere E, Office E et al (2019) Large-scale chemical\u2013genetics yields new M. tuberculosis inhibitor classes. Nature 571:72\u201378. https:\/\/doi.org\/10.1038\/s41586-019-1315-z","journal-title":"Nature"},{"key":"698_CR25","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1186\/s13321-022-00596-6","volume":"14","author":"C Liu","year":"2022","unstructured":"Liu C, Hogan AM, Sturm H et al (2022) Deep learning-driven prediction of drug mechanism of action from large-scale chemical-genetic interaction profiles. J Cheminform 14:12. https:\/\/doi.org\/10.1186\/s13321-022-00596-6","journal-title":"J Cheminform"},{"key":"698_CR26","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1039\/C7SC02664A","volume":"9","author":"Z Wu","year":"2018","unstructured":"Wu Z, Ramsundar B, Feinberg EN et al (2018) MoleculeNet: a benchmark for molecular machine learning. Chem Sci 9:513\u2013530","journal-title":"Chem Sci"},{"key":"698_CR27","unstructured":"Ho TK (1995) Random decision forests. In: Proceedings of 3rd international conference on document analysis and recognition. IEEE, pp 278\u2013282"},{"key":"698_CR28","unstructured":"Li G, Xiong C, Thabet A, Ghanem B (2020) Deepergcn: All you need to train deeper gcns. arXiv preprint arXiv:200607739"},{"key":"698_CR29","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1038\/s42256-021-00438-4","volume":"4","author":"X Fang","year":"2022","unstructured":"Fang X, Liu L, Lei J et al (2022) Geometry-enhanced molecular representation learning for property prediction. Nat Mach Intell 4:127\u2013134","journal-title":"Nat Mach Intell"},{"key":"698_CR30","unstructured":"Snoek J, Larochelle H, Adams RP (2012) Practical bayesian optimization of machine learning algorithms. Advances in neural information processing systems 25:"},{"key":"698_CR31","unstructured":"Paszke A, Gross S, Chintala S, et al (2017) Automatic differentiation in PyTorch"},{"key":"698_CR32","unstructured":"Yang K, Swanson K, Jin W, et al (2019) chemprop: Message Passing Neural Networks for Molecule Property Prediction"},{"key":"698_CR33","doi-asserted-by":"publisher","DOI":"10.1063\/1.4928757","volume":"143","author":"R Ramakrishnan","year":"2015","unstructured":"Ramakrishnan R, Hartmann M, Tapavicza E, Von Lilienfeld OA (2015) Electronic spectra from TDDFT and machine learning in chemical space. J Chem Phys 143:084111","journal-title":"J Chem Phys"},{"key":"698_CR34","doi-asserted-by":"publisher","first-page":"1000","DOI":"10.1021\/ci034243x","volume":"44","author":"JS Delaney","year":"2004","unstructured":"Delaney JS (2004) ESOL: estimating aqueous solubility directly from molecular structure. J Chem Inf Comput Sci 44:1000\u20131005","journal-title":"J Chem Inf Comput Sci"},{"key":"698_CR35","doi-asserted-by":"publisher","first-page":"D1100","DOI":"10.1093\/nar\/gkr777","volume":"40","author":"A Gaulton","year":"2012","unstructured":"Gaulton A, Bellis LJ, Bento AP et al (2012) ChEMBL: a large-scale bioactivity database for drug discovery. Nucleic Acids Res 40:D1100\u2013D1107","journal-title":"Nucleic Acids Res"},{"key":"698_CR36","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1007\/s10822-014-9747-x","volume":"28","author":"DL Mobley","year":"2014","unstructured":"Mobley DL, Guthrie JP (2014) FreeSolv: a database of experimental and calculated hydration free energies, with input files. J Comput Aided Mol Des 28:711\u2013720","journal-title":"J Comput Aided Mol Des"},{"key":"698_CR37","doi-asserted-by":"publisher","first-page":"85","DOI":"10.3389\/fenvs.2015.00085","volume":"3","author":"R Huang","year":"2016","unstructured":"Huang R, Xia M, Nguyen D-T et al (2016) Tox21Challenge to build predictive models of nuclear receptor and stress response pathways as mediated by exposure to environmental chemicals and drugs. Front Environ Sci 3:85","journal-title":"Front Environ Sci"},{"key":"698_CR38","doi-asserted-by":"publisher","first-page":"1294","DOI":"10.1016\/j.chembiol.2016.07.023","volume":"23","author":"KM Gayvert","year":"2016","unstructured":"Gayvert KM, Madhukar NS, Elemento O (2016) A data-driven approach to predicting successes and failures of clinical trials. Cell Chem Biol 23:1294\u20131301","journal-title":"Cell Chem Biol"},{"key":"698_CR39","doi-asserted-by":"publisher","first-page":"1225","DOI":"10.1021\/acs.chemrestox.6b00135","volume":"29","author":"AM Richard","year":"2016","unstructured":"Richard AM, Judson RS, Houck KA et al (2016) ToxCast chemical landscape: paving the road to 21st century toxicology. Chem Res Toxicol 29:1225\u20131251","journal-title":"Chem Res Toxicol"},{"key":"698_CR40","doi-asserted-by":"publisher","first-page":"2347","DOI":"10.1093\/jac\/dkq311","volume":"65","author":"S Nisa","year":"2010","unstructured":"Nisa S, Blokpoel MCJ, Robertson BD et al (2010) Targeting the chromosome partitioning protein ParA in tuberculosis drug discovery. J Antimicrob Chemother 65:2347\u20132358. https:\/\/doi.org\/10.1093\/jac\/dkq311","journal-title":"J Antimicrob Chemother"},{"key":"698_CR41","doi-asserted-by":"publisher","first-page":"1592","DOI":"10.3389\/fmicb.2018.01592","volume":"9","author":"MJ Szafran","year":"2018","unstructured":"Szafran MJ, Ko\u0142odziej M, Skut P et al (2018) Amsacrine derivatives selectively inhibit mycobacterial topoisomerase I (TopA). impair M. smegmatis growth and disturb chromosome replication. Front Microbiol 9:1592","journal-title":"Front Microbiol"},{"key":"698_CR42","doi-asserted-by":"publisher","first-page":"6271","DOI":"10.1128\/AAC.01339-16","volume":"60","author":"A Palencia","year":"2016","unstructured":"Palencia A, Li X, Bu W et al (2016) Discovery of novel oral protein synthesis inhibitors of Mycobacterium tuberculosis that target leucyl-tRNA synthetase. Antimicrob Agents Chemother 60:6271\u20136280. https:\/\/doi.org\/10.1128\/AAC.01339-16","journal-title":"Antimicrob Agents Chemother"}],"container-title":["Journal of Cheminformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13321-023-00698-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13321-023-00698-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13321-023-00698-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,26]],"date-time":"2023-02-26T17:02:55Z","timestamp":1677430975000},"score":1,"resource":{"primary":{"URL":"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-023-00698-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,26]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["698"],"URL":"https:\/\/doi.org\/10.1186\/s13321-023-00698-9","relation":{},"ISSN":["1758-2946"],"issn-type":[{"value":"1758-2946","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,26]]},"assertion":[{"value":"8 November 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 February 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"29"}}