{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T15:47:50Z","timestamp":1753890470477,"version":"3.41.2"},"reference-count":46,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,10,18]],"date-time":"2024-10-18T00:00:00Z","timestamp":1729209600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Bioinform."],"abstract":"<jats:p>The dihedral angle of the protein backbone can describe the main structure of the protein, which is of great significance for determining the protein structure. Many computational methods have been proposed to predict this critically important protein structure, including deep learning. However, these heavyweight methods require more computational resources, and the training time becomes intolerable. In this article, we introduce a novel lightweight method, named dilated convolution and multi-head attention (DCMA), that predicts protein backbone torsion dihedral angles <jats:inline-formula><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" id=\"m1\"><mml:mrow><mml:mo stretchy=\"false\">(<\/mml:mo><mml:mrow><mml:mi>\u03d5<\/mml:mi><mml:mo>,<\/mml:mo><mml:mi>\u03c8<\/mml:mi><\/mml:mrow><mml:mo stretchy=\"false\">)<\/mml:mo><\/mml:mrow><\/mml:math><\/jats:inline-formula>. DCMA is stacked by five layers of two hybrid inception blocks and one multi-head attention block (I2A1) module. The hybrid inception blocks consisting of multi-scale convolutional neural networks and dilated convolutional neural networks are designed for capturing local and long-range sequence-based features. The multi-head attention block supplementally strengthens this operation. The proposed DCMA is validated on public critical assessment of protein structure prediction (CASP) benchmark datasets. Experimental results show that DCMA obtains better or comparable generalization performance. Compared to best-so-far methods, which are mostly ensemble models and constructed of recurrent neural networks, DCMA is an individual model that is more lightweight and has a shorter training time. The proposed model could be applied as an alternative method for predicting other protein structural features.<\/jats:p>","DOI":"10.3389\/fbinf.2024.1477909","type":"journal-article","created":{"date-parts":[[2024,10,18]],"date-time":"2024-10-18T05:10:31Z","timestamp":1729228231000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["DCMA: faster protein backbone dihedral angle prediction using a dilated convolutional attention-based neural network"],"prefix":"10.3389","volume":"4","author":[{"given":"Buzhong","family":"Zhang","sequence":"first","affiliation":[]},{"given":"Meili","family":"Zheng","sequence":"additional","affiliation":[]},{"given":"Yuzhou","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Lijun","family":"Quan","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2024,10,18]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"3389","DOI":"10.1093\/nar\/25.17.3389","article-title":"Gapped blast and psi-blast: a new generation of protein database search programs","volume":"25","author":"Altschul","year":"1997","journal-title":"Nucleic acids Res."},{"volume-title":"Rethinking atrous convolution for semantic image segmentation","year":"2017","author":"Chen","key":"B2"},{"key":"B3","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1016\/j.jmr.2009.11.008","article-title":"Dangle: a bayesian inferential method for predicting protein backbone dihedral angles and secondary structure","volume":"202","author":"Cheung","year":"2010","journal-title":"J. magnetic Reson."},{"key":"B4","doi-asserted-by":"publisher","first-page":"5634","DOI":"10.1038\/s41596-021-00628-9","article-title":"The trrosetta server for fast and accurate protein structure prediction","volume":"16","author":"Du","year":"2021","journal-title":"Nat. Protoc."},{"key":"B5","doi-asserted-by":"publisher","first-page":"592","DOI":"10.1002\/prot.25487","article-title":"Mufold-ss:new deep inception-inside-inception networks for protein secondary structure prediction","volume":"86","author":"Fang","year":"","journal-title":"Proteins Struct. Funct. Bioinforma."},{"key":"B6","doi-asserted-by":"publisher","first-page":"1020","DOI":"10.1109\/tcbb.2018.2814586","article-title":"Prediction of protein backbone torsion angles using deep residual inception neural networks","volume":"16","author":"Fang","year":"","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinforma."},{"key":"B7","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1186\/s12859-018-2065-x","article-title":"Raptorx-angle: real-value prediction of protein backbone dihedral angles through a hybrid method of clustering and deep learning","volume":"19","author":"Gao","year":"2018","journal-title":"BMC Bioinforma."},{"key":"B8","first-page":"273","article-title":"Hybrid speech recognition with deep bidirectional lstm","volume-title":"Automatic speech recognition and understanding","author":"Graves","year":"2014"},{"key":"B9","doi-asserted-by":"publisher","first-page":"944","DOI":"10.1093\/nar\/gkg189","article-title":"Improving the performance of domainparser for structural domain partition using neural network","volume":"31","author":"Guo","year":"2003","journal-title":"Nucleic Acids Res."},{"key":"B10","doi-asserted-by":"publisher","first-page":"2403","DOI":"10.1093\/bioinformatics\/bty1006","article-title":"Improving prediction of protein secondary structure, backbone angles, solvent accessibility and contact numbers by using predicted contact maps and an ensemble of recurrent and residual convolutional neural networks","volume":"35","author":"Hanson","year":"2019","journal-title":"Bioinformatics"},{"key":"B11","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1109\/CVPR.2016.90","article-title":"Deep residual learning for image recognition","volume-title":"2016 IEEE conference on computer vision and pattern recognition (CVPR)","author":"He","year":"2016"},{"key":"B12","doi-asserted-by":"publisher","first-page":"2842","DOI":"10.1093\/bioinformatics\/btx218","article-title":"Capturing non-local interactions by long short-term memory bidirectional recurrent neural networks for improving prediction of protein secondary structure, backbone angles, contact numbers and solvent accessibility","volume":"33","author":"Heffernan","year":"2017","journal-title":"Bioinformatics"},{"key":"B13","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"B14","doi-asserted-by":"publisher","first-page":"6271","DOI":"10.1016\/j.csbj.2022.11.012","article-title":"Deep learning for protein secondary structure prediction: pre and post-alphafold","volume":"20","author":"Ismi","year":"2022","journal-title":"Comput. Struct. Biotechnol. J."},{"key":"B15","first-page":"171","article-title":"An empirical exploration of recurrent network architectures","volume-title":"Proceedings of the 32nd international converenfe on machine learning (ICML)","author":"Jozefowicz","year":"2015"},{"key":"B16","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","article-title":"Highly accurate protein structure prediction with alphafold","volume":"596","author":"Jumper","year":"2021","journal-title":"Nature"},{"key":"B17","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1006\/jmbi.1993.1045","article-title":"Estimation and use of protein backbone angle probabilities","volume":"229","author":"Kang","year":"1993","journal-title":"J. Mol. Biol."},{"key":"B18","doi-asserted-by":"publisher","first-page":"520","DOI":"10.1002\/prot.25674","article-title":"Netsurfp-2.0: improved prediction of protein structural features by integrated deep learning","volume":"87","author":"Klausen","year":"2019","journal-title":"Proteins Struct. Funct. Bioinforma."},{"key":"B19","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1186\/s12859-017-1834-2","article-title":"Deep learning methods for protein torsion angle prediction","volume":"18","author":"Li","year":"2017","journal-title":"BMC Bioinforma."},{"key":"B20","doi-asserted-by":"publisher","first-page":"2673","DOI":"10.1109\/78.650093","article-title":"Bidirectional recurrent neural networks","volume":"45","author":"Schuster","year":"1997","journal-title":"IEEE Trans. Signal Process."},{"key":"B21","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1007\/s10858-009-9333-z","article-title":"Talos+: a hybrid method for predicting protein backbone torsion angles from nmr chemical shifts","volume":"44","author":"Shen","year":"2009","journal-title":"J. Biomol. NMR"},{"key":"B22","doi-asserted-by":"publisher","first-page":"e105667","DOI":"10.1371\/journal.pone.0105667","article-title":"Evaluation of protein dihedral angle prediction methods","volume":"9","author":"Singh","year":"2014","journal-title":"PLOS ONE"},{"key":"B23","doi-asserted-by":"publisher","first-page":"3464","DOI":"10.1093\/bioinformatics\/btab316","article-title":"Spot-1d-single: improving the single-sequence-based prediction of protein secondary structure, backbone angles, solvent accessibility and half-sphere exposures using a large training set and ensembled deep learning","volume":"37","author":"Singh","year":"","journal-title":"Bioinformatics"},{"key":"B24","doi-asserted-by":"publisher","first-page":"2610","DOI":"10.1021\/acs.jcim.1c00153","article-title":"Rna backbone torsion and pseudotorsion angle prediction using dilated convolutional neural networks","volume":"61","author":"Singh","year":"","journal-title":"J. Chem. Inf. Model."},{"key":"B25","doi-asserted-by":"publisher","first-page":"e30361","DOI":"10.1371\/journal.pone.0030361","article-title":"Tangle: two-level support vector regression approach for protein backbone torsion angle prediction from primary sequences","volume":"7","author":"Song","year":"2012","journal-title":"PloS one"},{"key":"B26","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1186\/s12859-019-3019-7","article-title":"HH-suite3 for fast remote homology detection and deep protein annotation","volume":"20","author":"Steinegger","year":"2019","journal-title":"BMC Bioinforma."},{"key":"B27","first-page":"2670","article-title":"Fast and accurate entity recognition with iterated dilated convolutions","volume-title":"Proceedings of the 2017 conference on empirical methods in natural language processing (EMNLP)","author":"Strubell","year":"2017"},{"key":"B28","doi-asserted-by":"publisher","first-page":"218","DOI":"10.4172\/jpb.1000190","article-title":"Validity of protein structure alignment method based on backbone torsion angles","volume":"4","author":"Sunghoon","year":"2011","journal-title":"J. Proteomics Bioinforma."},{"key":"B29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/CVPR.2015.7298594","article-title":"Going deeper with convolutions","volume-title":"2015 IEEE conference on computer vision and pattern recognition (CVPR)","author":"Szegedy","year":"2015"},{"key":"B30","doi-asserted-by":"crossref","first-page":"2818","DOI":"10.1109\/CVPR.2016.308","article-title":"Rethinking the inception architecture for computer vision","volume-title":"2016 IEEE conference on computer vision and pattern recognition (CVPR)","author":"Szegedy","year":"2016"},{"volume-title":"Efficient transformers: a survey","year":"2020","author":"Tay","key":"B31"},{"key":"B32","doi-asserted-by":"publisher","first-page":"4599","DOI":"10.1093\/bioinformatics\/btaa531","article-title":"SAINT: self-attention augmented inception-inside-inception network improves protein secondary structure prediction","volume":"36","author":"Uddin","year":"2020","journal-title":"Bioinformatics"},{"volume-title":"Attention is all you need","year":"2017","author":"Vaswani","key":"B33"},{"key":"B34","doi-asserted-by":"publisher","first-page":"1589","DOI":"10.1093\/bioinformatics\/btg224","article-title":"Pisces: a protein sequence culling server","volume":"19","author":"Wang","year":"2003","journal-title":"Bioinformatics"},{"key":"B35","doi-asserted-by":"crossref","first-page":"1451","DOI":"10.1109\/WACV.2018.00163","article-title":"Understanding convolution for semantic segmentation","volume-title":"2018 IEEE winter conference on applications of computer vision (WACV)","author":"Wang","year":"2018"},{"key":"B36","doi-asserted-by":"publisher","first-page":"476","DOI":"10.1002\/prot.20435","article-title":"Protein secondary structure prediction with dihedral angles","volume":"59","author":"Wood","year":"2005","journal-title":"PROTEINS Struct. Funct. Bioinforma."},{"key":"B37","doi-asserted-by":"publisher","first-page":"e3400","DOI":"10.1371\/journal.pone.0003400","article-title":"Anglor: a composite machine-learning algorithm for protein backbone torsion angle prediction","volume":"3","author":"Wu","year":"2008","journal-title":"PloS one"},{"volume-title":"Bridging category-level and instance-level semantic image segmentation","year":"2016","author":"Wu","key":"B38"},{"key":"B39","doi-asserted-by":"publisher","first-page":"5021","DOI":"10.1093\/bioinformatics\/btaa629","article-title":"Opus-tass: a protein backbone torsion angles and secondary structure predictor based on ensemble neural networks","volume":"36","author":"Xu","year":"2020","journal-title":"Bioinformatics"},{"key":"B40","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1093\/bioinformatics\/btab633","article-title":"OPUS-X: an open-source toolkit for protein torsion angles, secondary structure, solvent accessibility, contact map predictions and 3D folding","volume":"38","author":"Xu","year":"2022","journal-title":"Bioinformatics"},{"article-title":"Multi-scale context aggregation by dilated convolutions","year":"2016","author":"Yu","key":"B41"},{"key":"B42","doi-asserted-by":"publisher","first-page":"912","DOI":"10.1109\/TCBB.2022.3175905","article-title":"Dombpred: protein domain boundary prediction based on domain-residue clustering using inter-residue distance","volume":"20","author":"Yu","year":"2023","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinforma."},{"key":"B43","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1186\/s12859-018-2280-5","article-title":"Prediction of 8-state protein secondary structures by a novel deep learning architecture","volume":"19","author":"Zhang","year":"2018","journal-title":"BMC Bioinforma."},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1101\/2021.02.04.429840","article-title":"Multi-task deep learning for concurrent prediction of protein structural properties","author":"Zhang","year":"2021","journal-title":"bioRxiv"},{"key":"B45","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1007\/s11515-013-1261-3","article-title":"Accurate prediction of protein dihedral angles through conditional random field","volume":"8","author":"Zhang","year":"2013","journal-title":"Front. Biol."},{"key":"B46","doi-asserted-by":"publisher","first-page":"nwad259","DOI":"10.1093\/nsr\/nwad259","article-title":"3 = 1 + 2: how the divide conquered de novo protein structure prediction and what is next?","volume":"10","author":"Zhou","year":"2023","journal-title":"Natl. Sci. Rev."}],"container-title":["Frontiers in Bioinformatics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbinf.2024.1477909\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,18]],"date-time":"2024-10-18T05:10:36Z","timestamp":1729228236000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbinf.2024.1477909\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,18]]},"references-count":46,"alternative-id":["10.3389\/fbinf.2024.1477909"],"URL":"https:\/\/doi.org\/10.3389\/fbinf.2024.1477909","relation":{},"ISSN":["2673-7647"],"issn-type":[{"type":"electronic","value":"2673-7647"}],"subject":[],"published":{"date-parts":[[2024,10,18]]},"article-number":"1477909"}}