{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T20:32:57Z","timestamp":1780605177964,"version":"3.54.1"},"reference-count":25,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T00:00:00Z","timestamp":1597104000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61772362"],"award-info":[{"award-number":["61772362"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972280"],"award-info":[{"award-number":["61972280"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program","doi-asserted-by":"publisher","award":["2018YFC0910405"],"award-info":[{"award-number":["2018YFC0910405"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program","doi-asserted-by":"publisher","award":["2017YFC0908400"],"award-info":[{"award-number":["2017YFC0908400"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,5,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Quantifying DNA properties is a challenging task in the broad field of human genomics. Since the vast majority of non-coding DNA is still poorly understood in terms of function, this task is particularly important to have enormous benefit for biology research. Various DNA sequences should have a great variety of representations, and specific functions may focus on corresponding features in the front part of learning model. Currently, however, for multi-class prediction of non-coding DNA regulatory functions, most powerful predictive models do not have appropriate feature extraction and selection approaches for specific functional effects, so that it is difficult to gain a better insight into their internal correlations. Hence, we design a category attention layer and category dense layer in order to select efficient features and distinguish different DNA functions. In this study, we propose a hybrid deep neural network method, called DeepATT, for identifying $919$ regulatory functions on nearly $5$ million DNA sequences. Our model has four built-in neural network constructions: convolution layer captures regulatory motifs, recurrent layer captures a regulatory grammar, category attention layer selects corresponding valid features for different functions and category dense layer classifies predictive labels with selected features of regulatory functions. Importantly, we compare our novel method, DeepATT, with existing outstanding prediction tools, DeepSEA and DanQ. DeepATT performs significantly better than other existing tools for identifying DNA functions, at least increasing $1.6\\%$ area under precision recall. Furthermore, we can mine the important correlation among different DNA functions according to the category attention module. Moreover, our novel model can greatly reduce the number of parameters by the mechanism of attention and locally connected, on the basis of ensuring accuracy.<\/jats:p>","DOI":"10.1093\/bib\/bbaa159","type":"journal-article","created":{"date-parts":[[2020,6,23]],"date-time":"2020-06-23T11:14:44Z","timestamp":1592910884000},"source":"Crossref","is-referenced-by-count":58,"title":["DeepATT: a hybrid category attention neural network for identifying functional effects of DNA sequences"],"prefix":"10.1093","volume":"22","author":[{"given":"Jiawei","family":"Li","sequence":"first","affiliation":[{"name":"Tianjin University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuqian","family":"Pu","sequence":"additional","affiliation":[{"name":"Tianjin University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jijun","family":"Tang","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Quan","family":"Zou","sequence":"additional","affiliation":[{"name":"University of Electronic Science and Technology of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fei","family":"Guo","sequence":"additional","affiliation":[{"name":"Tianjin University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,8,11]]},"reference":[{"key":"2021052110393267600_ref1","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.tibs.2014.07.002","article-title":"Absence of a simple code: how transcription factors read the genome","volume":"39","author":"Slattery","year":"2014","journal-title":"Trends Biochem Sci"},{"issue":"37","key":"2021052110393267600_ref2","doi-asserted-by":"crossref","first-page":"13367","DOI":"10.1073\/pnas.1412081111","article-title":"Transcription factor binding predicts histone modifications in human cell lines","volume":"111","author":"Benveniste","year":"2014","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2021052110393267600_ref3","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1038\/nmeth.3065","article-title":"Predicting the human epigenome from DNA motifs","volume":"12","author":"Whitaker","year":"2015","journal-title":"Nat Methods"},{"issue":"10","key":"2021052110393267600_ref4","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1038\/nmeth.3547","article-title":"Predicting effects of noncoding variants with deep learning-based sequence model","volume":"12","author":"Zhou","year":"2015","journal-title":"Nat Methods"},{"issue":"11","key":"2021052110393267600_ref5","doi-asserted-by":"crossref","first-page":"e107","DOI":"10.1093\/nar\/gkw226","article-title":"DanQ: a hybrid convolutional and recurrent deep neural network for quantifying the function of DNA sequences","volume":"44","author":"Quang","year":"2016","journal-title":"Nucleic Acids Res"},{"issue":"7553","key":"2021052110393267600_ref6","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"issue":"8","key":"2021052110393267600_ref7","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1038\/nbt.3300","article-title":"Predicting the sequence specificities of DNA-and RNA-binding proteins by deep learning","volume":"33","author":"Alipanahi","year":"2015","journal-title":"Nat Biotechnol"},{"issue":"5","key":"2021052110393267600_ref8","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1093\/bioinformatics\/btu703","article-title":"DANN: a deep learning approach for annotating the pathogenicity of genetic variants","volume":"31","author":"Quang","year":"2014","journal-title":"Bioinformatics"},{"issue":"12","key":"2021052110393267600_ref9","doi-asserted-by":"crossref","first-page":"1832","DOI":"10.1093\/bioinformatics\/btw074","article-title":"Gene expression inference with deep learning","volume":"32","author":"Chen","year":"2016","journal-title":"Bioinformatics"},{"issue":"14","key":"2021052110393267600_ref10","doi-asserted-by":"crossref","first-page":"i269","DOI":"10.1093\/bioinformatics\/btz339","article-title":"Comprehensive evaluation of deep learning architectures for prediction of DNA\/RNA sequence binding specificities","volume":"35","author":"Trabelsi","year":"2019","journal-title":"Bioinformatics"},{"issue":"22","key":"2021052110393267600_ref11","doi-asserted-by":"crossref","first-page":"4586","DOI":"10.1093\/bioinformatics\/btz276","article-title":"DeepSignal: detecting DNA methylation state from Nanopore sequencing reads using deep-learning","volume":"35","author":"Ni","year":"2019","journal-title":"Bioinformatics"},{"issue":"13","key":"2021052110393267600_ref12","doi-asserted-by":"crossref","first-page":"1930","DOI":"10.1093\/bioinformatics\/btx105","article-title":"BiRen: predicting enhancers with a deep-learning-based model using the DNA sequence alone","volume":"33","author":"Yang","year":"2017","journal-title":"Bioinformatics"},{"issue":"14","key":"2021052110393267600_ref13","doi-asserted-by":"crossref","first-page":"i333","DOI":"10.1093\/bioinformatics\/btz337","article-title":"Prediction of mRNA subcellular localization using deep recurrent neural networks","volume":"35","author":"Yan","year":"2019","journal-title":"Bioinformatics"},{"issue":"11","key":"2021052110393267600_ref14","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc IEEE"},{"key":"2021052110393267600_ref15","first-page":"549","article-title":"Multi-dimensional recurrent neural networks","volume-title":"International Conference on Artificial Neural Networks","author":"Graves","year":"2007"},{"issue":"8","key":"2021052110393267600_ref16","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"key":"2021052110393267600_ref17","article-title":"Neural machine translation by jointly learning to align and translate","author":"Bahdanau","year":"2014"},{"key":"2021052110393267600_ref18","first-page":"5998","article-title":"Attention is all you need","volume-title":"Advances in Neural Information Processing Systems","author":"Vaswani","year":"2017"},{"issue":"7414","key":"2021052110393267600_ref19","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1038\/nature11247","article-title":"An integrated encyclopedia of DNA elements in the human genome","volume":"489","author":"The ENCODE Project Consortium.","year":"2012","journal-title":"Nature"},{"issue":"7539","key":"2021052110393267600_ref20","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1038\/nature14248","article-title":"Integrative analysis of 111 reference human epigenomes","volume":"518","author":"Kundaje","year":"2015","journal-title":"Nature"},{"issue":"D1","key":"2021052110393267600_ref21","doi-asserted-by":"crossref","first-page":"D110","DOI":"10.1093\/nar\/gkv1176","article-title":"JASPAR 2016: a major expansion and update of the open-access database of transcription factor binding profiles","volume":"44","author":"Mathelier","year":"2015","journal-title":"Nucleic Acids Res"},{"key":"2021052110393267600_ref22","article-title":"Tensorflow: large-scale machine learning on heterogeneous distributed systems","author":"Abadi","year":"2016"},{"key":"2021052110393267600_ref23","article-title":"Adam: a method for stochastic optimization","author":"Kingma","year":"2014","journal-title":"ICLR 2015"},{"issue":"2","key":"2021052110393267600_ref24","doi-asserted-by":"crossref","first-page":"R24","DOI":"10.1186\/gb-2007-8-2-r24","article-title":"Quantifying similarity between motifs","volume":"8","author":"Gupta","year":"2007","journal-title":"Genome Biol"},{"key":"2021052110393267600_ref25","article-title":"Efficient estimation of word representations in vector space","author":"Mikolov","year":"2013"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bib\/article-pdf\/22\/3\/bbaa159\/37965738\/bbaa159.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/bib\/article-pdf\/22\/3\/bbaa159\/37965738\/bbaa159.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,21]],"date-time":"2021-05-21T10:40:11Z","timestamp":1621593611000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbaa159\/5890498"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,11]]},"references-count":25,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,5,20]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbaa159","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,5]]},"published":{"date-parts":[[2020,8,11]]},"article-number":"bbaa159"}}