{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T08:23:05Z","timestamp":1778055785124,"version":"3.51.4"},"reference-count":57,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2022,11,27]],"date-time":"2022-11-27T00:00:00Z","timestamp":1669507200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["2021\u00a0M693090"],"award-info":[{"award-number":["2021\u00a0M693090"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32070659"],"award-info":[{"award-number":["32070659"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,1,19]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>MicroRNA (miRNA)\u2013target interaction (MTI) plays a substantial role in various cell activities, molecular regulations and physiological processes. Published biomedical literature is the carrier of high-confidence MTI knowledge. However, digging out this knowledge in an efficient manner from large-scale published articles remains challenging. To address this issue, we were motivated to construct a deep learning-based model. We applied the pre-trained language models to biomedical text to obtain the representation, and subsequently fed them into a deep neural network with gate mechanism layers and a fully connected layer for the extraction of MTI information sentences. Performances of the proposed models were evaluated using two datasets constructed on the basis of text data obtained from miRTarBase. The validation and test results revealed that incorporating both PubMedBERT and SciBERT for sentence level encoding with the long short-term memory (LSTM)-based deep neural network can yield an outstanding performance, with both F1 and accuracy being higher than 80% on validation data and test data. Additionally, the proposed deep learning method outperformed the following machine learning methods: random forest, support vector machine, logistic regression and bidirectional LSTM. This work would greatly facilitate studies on MTI analysis and regulations. It is anticipated that this work can assist in large-scale screening of miRNAs, thereby revealing their functional roles in various diseases, which is important for the development of highly specific drugs with fewer side effects. Source code and corpus are publicly available at https:\/\/github.com\/qi29.<\/jats:p>","DOI":"10.1093\/bib\/bbac497","type":"journal-article","created":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T15:14:57Z","timestamp":1669648497000},"source":"Crossref","is-referenced-by-count":4,"title":["Extraction of microRNA\u2013target interaction sentences from biomedical literature by deep learning approach"],"prefix":"10.1093","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6762-6249","authenticated-orcid":false,"given":"Mengqi","family":"Luo","sequence":"first","affiliation":[{"name":"Warshel Institute for Computational Biology, The Chinese University of Hong Kong, Shenzhen, China; School of Life Sciences, University of Science and Technology of China , Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shangfu","family":"Li","sequence":"additional","affiliation":[{"name":"Warshel Institute for Computational Biology, The Chinese University of Hong Kong , Shenzhen"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuxuan","family":"Pang","sequence":"additional","affiliation":[{"name":"Warshel Institute for Computational Biology, The Chinese University of Hong Kong, Shenzhen, PR China, and also in the School of Science and Engineering, The Chinese University of Hong Kong , Shenzhen, PR China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lantian","family":"Yao","sequence":"additional","affiliation":[{"name":"Warshel Institute for Computational Biology, The Chinese University of Hong Kong, Shenzhen, PR China, and also in the School of Science and Engineering, The Chinese University of Hong Kong , Shenzhen, PR China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2495-4787","authenticated-orcid":false,"given":"Renfei","family":"Ma","sequence":"additional","affiliation":[{"name":"Warshel Institute for Computational Biology, Chinese University of Hong Kong, Shenzhen; School of Life Sciences, University of Science and Technology of China , Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8453-4939","authenticated-orcid":false,"given":"Hsi-Yuan","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Medicine and the Warshel Institute of Computational Biology, The Chinese University of Hong Kong , Shenzhen"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2857-7023","authenticated-orcid":false,"given":"Hsien-Da","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Medicine, and the executive director of Warshel Institute for Computational Biology, The Chinese University of Hong Kong , Shenzhen"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8475-7868","authenticated-orcid":false,"given":"Tzong-Yi","family":"Lee","sequence":"additional","affiliation":[{"name":"Warshel Institute for Computational Biology, The Chinese University of Hong Kong , Shenzhen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2022,11,27]]},"reference":[{"key":"2023011917141826800_ref1","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.bbrc.2019.10.117","article-title":"Hsa_circ_0001546 acts as a miRNA-421 sponge to inhibit the chemoresistance of gastric cancer cells via ATM\/Chk2\/p53-dependent pathway","volume":"521","author":"Wu","year":"2020","journal-title":"Biochem Biophys Res Commun"},{"key":"2023011917141826800_ref2","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1007\/s00011-021-01441-6","article-title":"Activated M1 macrophages suppress c-kit expression via TNF-\u03b1-mediated upregulation of miR-222 in Neonatal Necrotizing Enterocolitis","volume":"70","author":"Xia","year":"2021","journal-title":"Inflamm Res"},{"key":"2023011917141826800_ref3","first-page":"1","article-title":"Exosomal microRNA-22-3p alleviates cerebral ischemic injury by modulating KDM6B\/BMP2\/BMF axis","volume":"12","author":"Zhang","year":"2021","journal-title":"Stem Cell Res Ther"},{"key":"2023011917141826800_ref4","doi-asserted-by":"crossref","DOI":"10.1038\/s41586-022-04667-4","article-title":"Selective inhibition of miRNA processing by a herpesvirus-encoded miRNA","volume":"605","author":"Hennig","year":"2022","journal-title":"Nature"},{"key":"2023011917141826800_ref5","doi-asserted-by":"crossref","first-page":"1999","DOI":"10.1093\/bib\/bbz111","article-title":"What\u2019s the target: understanding two decades of in silico microRNA-target prediction","volume":"21","author":"Kern","year":"2020","journal-title":"Brief Bioinform"},{"key":"2023011917141826800_ref6","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1038\/s41586-018-0253-5","article-title":"Induction of innate immune memory via microRNA targeting of chromatin remodelling factors","volume":"559","author":"Seeley","year":"2018","journal-title":"Nature"},{"key":"2023011917141826800_ref7","doi-asserted-by":"crossref","first-page":"11898","DOI":"10.1093\/nar\/gky1066","article-title":"Integration of genetics and miRNA\u2013target gene network identified disease biology implicated in tissue specificity","volume":"46","author":"Sakaue","year":"2018","journal-title":"Nucleic Acids Res"},{"key":"2023011917141826800_ref8","doi-asserted-by":"crossref","first-page":"D239","DOI":"10.1093\/nar\/gkx1141","article-title":"DIANA-TarBase v8: a decade-long collection of experimentally supported miRNA\u2013gene interactions","volume":"46","author":"Karagkouni","year":"2018","journal-title":"Nucleic Acids Res"},{"key":"2023011917141826800_ref9","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1093\/bib\/bbx137","article-title":"Systematic review of computational methods for identifying miRNA-mediated RNA-RNA crosstalk","volume":"20","author":"Li","year":"2019","journal-title":"Brief Bioinform"},{"key":"2023011917141826800_ref10","doi-asserted-by":"crossref","first-page":"bbab451","DOI":"10.1093\/bib\/bbab451","article-title":"EGFI: drug\u2013drug interaction extraction and generation with fusion of enriched entity and sentence information","volume":"23","author":"Huang","year":"2022","journal-title":"Brief Bioinform"},{"key":"2023011917141826800_ref11","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1093\/bib\/bbaa296","article-title":"Text mining approaches for dealing with the rapidly expanding literature on COVID-19","volume":"22","author":"Wang","year":"2021","journal-title":"Brief Bioinform"},{"key":"2023011917141826800_ref12","first-page":"84","volume-title":"Biomedical relation extraction with pre-trained language representations and minimal task-specific architecture. Proc. 5th Work. BioNLP Open Shar. Tasks","author":"Thillaisundaram","year":"2019"},{"key":"2023011917141826800_ref13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12859-018-2496-4","article-title":"Fast and scalable neural embedding models for biomedical sentence classification","volume":"19","author":"Agibetov","year":"2018","journal-title":"BMC Bioinformatics"},{"key":"2023011917141826800_ref14","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baaa041","article-title":"Identifying main finding sentences in clinical case reports","volume":"2020","author":"Luo","year":"2020","journal-title":"Database"},{"key":"2023011917141826800_ref15","doi-asserted-by":"crossref","first-page":"1592","DOI":"10.1093\/bib\/bbab016","article-title":"Unsupervised and self-supervised deep learning approaches for biomedical text mining","volume":"22","author":"Nadif","year":"2021","journal-title":"Brief Bioinform"},{"key":"2023011917141826800_ref16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-020-01330-8","article-title":"CERC: an interactive content extraction, recognition, and construction tool for clinical and biomedical text","volume":"20","author":"Lee","year":"2020","journal-title":"BMC Med Inform Decis Mak"},{"key":"2023011917141826800_ref17","doi-asserted-by":"crossref","first-page":"3499","DOI":"10.1093\/bioinformatics\/btaa111","article-title":"DL4papers: a deep learning approach for the automatic interpretation of scientific articles","volume":"36","author":"Bugnon","year":"2020","journal-title":"Bioinformatics"},{"key":"2023011917141826800_ref18","first-page":"169","article-title":"Deep learning in biomedical text mining: contributions and challenges","volume":"539","author":"Alam","year":"2021","journal-title":"Mult Perspect Artif Intell Healthc"},{"key":"2023011917141826800_ref19","doi-asserted-by":"crossref","first-page":"bbaa057","DOI":"10.1093\/bib\/bbaa057","article-title":"Recent advances in biomedical literature mining","volume":"22","author":"Zhao","year":"2021","journal-title":"Brief Bioinform"},{"key":"2023011917141826800_ref20","first-page":"1","article-title":"TermInformer: unsupervised term mining and analysis in biomedical literature","volume":"1824","author":"Tiwari","year":"2020","journal-title":"Neural Comput Appl"},{"key":"2023011917141826800_ref21","doi-asserted-by":"crossref","DOI":"10.1016\/j.jbi.2020.103384","article-title":"A neural network-based joint learning approach for biomedical entity and relation extraction from biomedical literature","volume":"103","author":"Luo","year":"2020","journal-title":"J Biomed Inform"},{"key":"2023011917141826800_ref22","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.ymeth.2019.02.021","article-title":"Exploring semi-supervised variational autoencoders for biomedical relation extraction","volume":"166","author":"Zhang","year":"2019","journal-title":"Methods"},{"key":"2023011917141826800_ref23","doi-asserted-by":"crossref","DOI":"10.1016\/j.cmpb.2019.105117","article-title":"Deep contextualized embeddings for quantifying the informative content in biomedical text summarization","volume":"184","author":"Moradi","year":"2020","journal-title":"Comput Methods Prog Biomed"},{"key":"2023011917141826800_ref24","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.artmed.2017.11.004","article-title":"Different approaches for identifying important concepts in probabilistic biomedical text summarization","volume":"84","author":"Moradi","year":"2018","journal-title":"Artif Intell Med"},{"key":"2023011917141826800_ref25","doi-asserted-by":"crossref","first-page":"1356","DOI":"10.1016\/j.ipm.2019.04.003","article-title":"SRL-ESA-TextSum: a text summarization approach based on semantic role labeling and explicit semantic analysis","volume":"56","author":"Mohamed","year":"2019","journal-title":"Inf Process Manag"},{"key":"2023011917141826800_ref26","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.jbi.2018.06.005","article-title":"Graph-based biomedical text summarization: an itemset mining and sentence clustering approach","volume":"84","author":"Azadani","year":"2018","journal-title":"J Biomed Inform"},{"key":"2023011917141826800_ref27","doi-asserted-by":"crossref","DOI":"10.1016\/j.is.2020.101615","article-title":"Knowledge-guided unsupervised rhetorical parsing for text summarization","volume":"94","author":"Hou","year":"2020","journal-title":"Inf Syst"},{"key":"2023011917141826800_ref28","first-page":"206","article-title":"Identifying comparative structures in biomedical text","volume":"2017","author":"Gupta","year":"2017","journal-title":"BioNLP"},{"key":"2023011917141826800_ref29","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1007\/978-3-319-96136-1_12","article-title":"Automated contradiction detection in biomedical literature","volume":"1","author":"Tawfik","year":"2018","journal-title":"Int Conf Mach Learn Data Min Pattern Recognit"},{"key":"2023011917141826800_ref30","doi-asserted-by":"crossref","DOI":"10.1016\/j.knosys.2021.106869","article-title":"Sentence representation with manifold learning for biomedical texts","volume":"218","author":"Zhao","year":"2021","journal-title":"Knowl Based Syst"},{"key":"2023011917141826800_ref31","first-page":"503","article-title":"Self-supervised extractive text summarization for biomedical literatures","volume":"2021","author":"Xie","journal-title":"2021 IEEE 9th Int Conf Healthc Informatics"},{"key":"2023011917141826800_ref32","doi-asserted-by":"crossref","DOI":"10.1016\/j.knosys.2020.105964","article-title":"Biomedical-domain pre-trained language model for extractive summarization","volume":"199","author":"Du","year":"2020","journal-title":"Knowl Based Syst"},{"key":"2023011917141826800_ref33","doi-asserted-by":"crossref","DOI":"10.1016\/j.jbi.2020.103452","article-title":"Summarization of biomedical articles using domain-specific word embeddings and graph ranking","volume":"107","author":"Moradi","year":"2020","journal-title":"J Biomed Inform"},{"key":"2023011917141826800_ref34","doi-asserted-by":"crossref","DOI":"10.1016\/j.jbi.2020.103396","article-title":"Evaluating sentence representations for biomedical text: methods and experimental results","volume":"104","author":"Tawfik","year":"2020","journal-title":"J Biomed Inform"},{"key":"2023011917141826800_ref35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3458754","article-title":"Domain-specific language model pretraining for biomedical natural language processing","volume":"3","author":"Gu","year":"2021","journal-title":"ACM Trans Comput Healthc"},{"key":"2023011917141826800_ref36","doi-asserted-by":"crossref","first-page":"bbaa110","DOI":"10.1093\/bib\/bbaa110","article-title":"Enriching contextualized language model from knowledge graph for biomedical information extraction","volume":"22","author":"Fei","year":"2021","journal-title":"Brief Bioinform"},{"key":"2023011917141826800_ref37","doi-asserted-by":"crossref","first-page":"38767","DOI":"10.1109\/ACCESS.2021.3064000","article-title":"Active learning for biomedical text classification based on automatically generated regular expressions","volume":"9","author":"Flores","year":"2021","journal-title":"IEEE Access"},{"key":"2023011917141826800_ref38","first-page":"87","article-title":"Automatic text classification for label imputation of medical diagnosis notes based on random forest","author":"Yang","year":"2018","journal-title":"Int Conf Heal Inf Sci"},{"key":"2023011917141826800_ref39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-020-1044-0","article-title":"Deep learning with sentence embeddings pre-trained on biomedical corpora improves the performance of finding similar sentences in electronic medical records","volume":"20","author":"Chen","year":"2020","journal-title":"BMC Med Inform Decis Mak"},{"key":"2023011917141826800_ref40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12859-021-04435-7","article-title":"A representation and deep learning model for annotating ubiquitylation sentences stating E3 ligase-substrate interaction","volume":"22","author":"Luo","year":"2021","journal-title":"BMC Bioinform"},{"key":"2023011917141826800_ref41","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1186\/s12859-018-2192-4","article-title":"Semi-supervised recurrent neural network for adverse drug reaction mention extraction","volume":"19","author":"Gupta","year":"2018","journal-title":"BMC Bioinform"},{"key":"2023011917141826800_ref42","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1186\/s12859-017-1868-5","article-title":"Long short-term memory RNN for biomedical named entity recognition","volume":"18","author":"Lyu","year":"2017","journal-title":"BMC Bioinform"},{"key":"2023011917141826800_ref43","doi-asserted-by":"crossref","DOI":"10.1186\/s12859-022-04763-2","article-title":"3DGT-DDI: 3D graph and text based neural network for drug\u2013drug interaction prediction","author":"He","year":"2022","journal-title":"Brief Bioinform"},{"key":"2023011917141826800_ref44","doi-asserted-by":"crossref","first-page":"1\u201311","DOI":"10.1002\/cpe.5005","article-title":"A novel deep learning method for extracting unspecific biomedical relation","volume":"32","author":"Bai","year":"2020","journal-title":"Concurr Comput Pract Exp"},{"key":"2023011917141826800_ref45","doi-asserted-by":"crossref","first-page":"5929","DOI":"10.1007\/s10462-020-09838-1","article-title":"A review on the long short-term memory model","volume":"53","author":"Van Houdt","year":"2020","journal-title":"Artif Intell Rev"},{"key":"2023011917141826800_ref46","first-page":"2020","volume-title":"Proc. 56th Annu. Meet. Assoc. Comput. Linguist","author":"Narayan","year":"2018"},{"key":"2023011917141826800_ref47","doi-asserted-by":"crossref","first-page":"D296","DOI":"10.1093\/nar\/gkx1067","article-title":"miRTarBase update 2018: a resource for experimentally validated microRNA-target interactions","volume":"46","author":"Chou","year":"2018","journal-title":"Nucleic Acids Res"},{"issue":"50","key":"2023011917141826800_ref48","doi-asserted-by":"crossref","first-page":"D222","DOI":"10.1093\/nar\/gkab1079","article-title":"an informative resource for experimentally validated miRNA\u2013target interactions","volume":"2022","author":"Huang","year":"2022","journal-title":"Nucleic Acids Res"},{"key":"2023011917141826800_ref49","first-page":"3615","article-title":"SciBERT: a pretrained language model for scientific text. Proc. 2019 Conf. Empir. Methods Nat. Lang. Process. 9th Int","volume":"2019","author":"Beltagy","year":"2019","journal-title":"Jt Conf Nat Lang Process"},{"key":"2023011917141826800_ref50","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/978-3-642-24797-2_4","volume-title":"Long short-term memory. Supervised Sequence Labelling with Recurrent Neural Networks","author":"Graves","year":"2012"},{"key":"2023011917141826800_ref51","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/s10479-005-5724-z","article-title":"A tutorial on the cross-entropy method","volume":"134","author":"De Boer","year":"2005","journal-title":"Ann Oper Res"},{"key":"2023011917141826800_ref52","volume-title":"Adam: A Method for Stochastic Optimization","author":"Kingma","year":"2015"},{"key":"2023011917141826800_ref53","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee","year":"2020","journal-title":"Bioinformatics"},{"key":"2023011917141826800_ref54","first-page":"58","volume-title":"Proc. 18th BioNLP Work","author":"Peng","year":"2019"},{"key":"2023011917141826800_ref55","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.ins.2017.06.021","article-title":"Drug\u2013drug interaction extraction from biomedical literature using support vector machine and long short term memory networks","volume":"415","author":"Huang","year":"2017","journal-title":"Inf Sci (Ny)"},{"key":"2023011917141826800_ref56","first-page":"3285","article-title":"The performance of LSTM and BiLSTM in forecasting time series. 2019 IEEE Int","volume":"2019","author":"Siami-Namini","journal-title":"Conf Big Data (Big Data)"},{"key":"2023011917141826800_ref57","first-page":"189","article-title":"NLP at IEST 2018: BiLSTM-attention and LSTM-attention via soft voting in emotion classification. Proc. 9th Work. Comput. approaches to Subj","author":"Zhou","year":"2018","journal-title":"Sentim Soc Media Anal"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/24\/1\/bbac497\/48782448\/bbac497.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/24\/1\/bbac497\/48782448\/bbac497.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,10]],"date-time":"2023-03-10T13:35:54Z","timestamp":1678455354000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbac497\/6847797"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,27]]},"references-count":57,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1,19]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbac497","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,1]]},"published":{"date-parts":[[2022,11,27]]},"article-number":"bbac497"}}