{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,19]],"date-time":"2025-03-19T12:36:00Z","timestamp":1742387760043,"version":"3.37.3"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"S11","license":[{"start":{"date-parts":[[2021,10,1]],"date-time":"2021-10-01T00:00:00Z","timestamp":1633046400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T00:00:00Z","timestamp":1634774400000},"content-version":"vor","delay-in-days":20,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2021,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Extraction of adverse drug events from biomedical literature and other textual data is an important component to monitor drug-safety and this has attracted attention of many researchers in healthcare. Existing works are more pivoted around entity-relation extraction using bidirectional long short term memory networks (Bi-LSTM) which does not attain the best feature representations.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>In this paper, we introduce a question answering framework that exploits the robustness, masking and dynamic attention capabilities of RoBERTa by a technique of domain adaptation and attempt to overcome the aforementioned limitations. With formulation of an end-to-end pipeline, our model outperforms the prior work by 9.53% F1-Score.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>An end-to-end pipeline that leverages state of the art transformer architecture in conjunction with QA approach can bolster the performances of entity-relation extraction tasks in the biomedical domain. In particular, we believe our research would be helpful in identification of potential adverse drug reactions in mono as well as combination therapy related textual data.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12859-021-04249-7","type":"journal-article","created":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T09:02:42Z","timestamp":1634806962000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A sui generis QA approach using RoBERTa for adverse drug event identification"],"prefix":"10.1186","volume":"22","author":[{"given":"Harshit","family":"Jain","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7294-9026","authenticated-orcid":false,"given":"Nishant","family":"Raj","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Suyash","family":"Mishra","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,10,21]]},"reference":[{"issue":"1","key":"4249_CR1","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1001\/jama.1995.03530010043033","volume":"274","author":"DW Bates","year":"1995","unstructured":"Bates DW, Cullen DJ, Laird N, Petersen LA, Small SD, Servi D, Laffel G, Sweitzer BJ, Shea BF, Hallisey R, Vander Vliet M, Nemeskal R, Leape LL, Bates D, Hojnowski-Diaz P, Petrycki S, Cotugno M, Patterson H, Hickey M, Kleefield S, Cooper J, Kinneally E, Demonaco HJ, Clapp MD, Gallivan T, Ives J, Porter K, Thompson BT, Hackman JR, Edmondson A. Incidence of adverse drug events and potential adverse drug events: implications for prevention. JAMA. 1995;274(1):29\u201334. https:\/\/doi.org\/10.1001\/jama.1995.03530010043033.","journal-title":"JAMA"},{"issue":"7","key":"4249_CR2","doi-asserted-by":"publisher","first-page":"19","DOI":"10.3928\/00989134-20070701-04","volume":"33","author":"JT Rocchiccioli","year":"2007","unstructured":"Rocchiccioli JT, Sanford J, Caplinger B. Polymedicine and aging. Enhancing older adult care through advanced practitioners. GNPs and elder care pharmacists can help provide optimal pharmaceutical care. J Gerontol Nurs. 2007;33(7):19\u201324. https:\/\/doi.org\/10.3928\/00989134-20070701-04.","journal-title":"J Gerontol Nurs"},{"issue":"9","key":"4249_CR3","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1007\/BF03261973","volume":"35","author":"C Wu","year":"2012","unstructured":"Wu C, Bell CM, Wodchis WP. Incidence and economic burden of adverse drug reactions among elderly patients in ontario emergency departments. Drug Saf. 2012;35(9):769\u201381.","journal-title":"Drug Saf"},{"issue":"1","key":"4249_CR4","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/BF03319105","volume":"35","author":"C Chiatti","year":"2012","unstructured":"Chiatti C, Bustacchini S, Furneri G, Mantovani L, Cristiani M, Misuraca C, Lattanzio F. The economic burden of inappropriate drug prescribing, lack of adherence and compliance, adverse drug events in older people. Drug Saf. 2012;35(1):73\u201387.","journal-title":"Drug Saf"},{"issue":"1","key":"4249_CR5","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1007\/s40264-018-0762-z","volume":"42","author":"A Jagannatha","year":"2019","unstructured":"Jagannatha A, Liu F, Liu W, Yu H. Overview of the first natural language processing challenge for extracting medication, indication, and adverse drug events from electronic health record notes (made 1.0). Drug safety. 2019;42(1):99\u2013111.","journal-title":"Drug safety"},{"issue":"1","key":"4249_CR6","doi-asserted-by":"publisher","first-page":"39","DOI":"10.18553\/jmcp.1996.2.1.39","volume":"2","author":"J Johnson","year":"1996","unstructured":"Johnson J, Booman L. Drug-related morbidity and mortality. J Managed Care Pharmacy. 1996;2(1):39\u201347.","journal-title":"J Managed Care Pharmacy"},{"issue":"7","key":"4249_CR7","doi-asserted-by":"publisher","first-page":"1499","DOI":"10.1001\/archinte.1988.00380070017005","volume":"148","author":"SA Edlavitch","year":"1988","unstructured":"Edlavitch SA. Adverse drug event reporting: improving the low us reporting rates. Arch Intern Med. 1988;148(7):1499\u2013503.","journal-title":"Arch Intern Med"},{"issue":"Feb","key":"4249_CR8","first-page":"1083","volume":"3","author":"D Zelenko","year":"2003","unstructured":"Zelenko D, Aone C, Richardella A. Kernel methods for relation extraction. J Mach Learn Res. 2003;3(Feb):1083\u2013106.","journal-title":"J Mach Learn Res"},{"key":"4249_CR9","doi-asserted-by":"crossref","unstructured":"Miwa M, Bansal M. End-to-end relation extraction using LSTMs on sequences and tree structures. arXiv preprint arXiv:1601.00770 (2016)","DOI":"10.18653\/v1\/P16-1105"},{"issue":"1","key":"4249_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12859-016-1414-x","volume":"18","author":"F Li","year":"2017","unstructured":"Li F, Zhang M, Fu G, Ji D. A neural joint model for entity and relation extraction from biomedical text. BMC Bioinform. 2017;18(1):1\u201311.","journal-title":"BMC Bioinform"},{"key":"4249_CR11","doi-asserted-by":"crossref","unstructured":"Li X, Yin F, Sun Z, Li X, Yuan A, Chai D, Zhou M, Li J. Entity-relation extraction as multi-turn question answering. arXiv preprint arXiv:1905.05529 (2019)","DOI":"10.18653\/v1\/P19-1129"},{"key":"4249_CR12","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)"},{"issue":"8","key":"4249_CR13","first-page":"9","volume":"1","author":"A Radford","year":"2019","unstructured":"Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I. Language models are unsupervised multitask learners. OpenAI Blog. 2019;1(8):9.","journal-title":"OpenAI Blog"},{"key":"4249_CR14","unstructured":"Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019)"},{"key":"4249_CR15","unstructured":"Eberts M, Ulges A. Span-based joint entity and relation extraction with transformer pre-training. arXiv preprint arXiv:1909.07755 (2019)"},{"key":"4249_CR16","doi-asserted-by":"crossref","unstructured":"Kormilitzin A, Vaci N, Liu Q, Nevado-Holgado A. Med7: a transferable clinical natural language processing model for electronic health records. arXiv preprint arXiv:2003.01271 (2020)","DOI":"10.1016\/j.artmed.2021.102086"},{"issue":"11","key":"4249_CR17","doi-asserted-by":"publisher","first-page":"2673","DOI":"10.1109\/78.650093","volume":"45","author":"M Schuster","year":"1997","unstructured":"Schuster M, Paliwal KK. Bidirectional recurrent neural networks. IEEE Trans Signal Process. 1997;45(11):2673\u201381.","journal-title":"IEEE Trans Signal Process"},{"key":"4249_CR18","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A.N., Kaiser, \u0141., Polosukhin, I. Attention is all you need. In: Advances in neural information processing systems, pp. 5998\u20136008 (2017)"},{"key":"4249_CR19","doi-asserted-by":"crossref","unstructured":"Ott M, Edunov S, Baevski A, Fan A, Gross S, Ng N, Grangier D, Auli M. fairseq: A fast, extensible toolkit for sequence modeling. arXiv preprint arXiv:1904.01038 (2019)","DOI":"10.18653\/v1\/N19-4009"},{"issue":"5","key":"4249_CR20","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1016\/j.jbi.2012.04.008","volume":"45","author":"H Gurulingappa","year":"2012","unstructured":"Gurulingappa H, Rajput AM, Roberts A, Fluck J, Hofmann-Apitius M, Toldo L. Development of a benchmark corpus to support the automatic extraction of drug-related adverse effects from medical case reports. J Biomed Inform. 2012;45(5):885\u201392.","journal-title":"J Biomed Inform"},{"key":"4249_CR21","unstructured":"Kingma DP, Ba J. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)"},{"key":"4249_CR22","first-page":"2838","volume":"2016","author":"F Li","year":"2016","unstructured":"Li F, Zhang Y, Zhang M, Ji D. Joint models for extracting adverse drug events from biomedical text. IJCAI. 2016;2016:2838\u201344.","journal-title":"IJCAI"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-021-04249-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-021-04249-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-021-04249-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T09:06:49Z","timestamp":1634807209000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-021-04249-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10]]},"references-count":22,"journal-issue":{"issue":"S11","published-print":{"date-parts":[[2021,10]]}},"alternative-id":["4249"],"URL":"https:\/\/doi.org\/10.1186\/s12859-021-04249-7","relation":{},"ISSN":["1471-2105"],"issn-type":[{"type":"electronic","value":"1471-2105"}],"subject":[],"published":{"date-parts":[[2021,10]]},"assertion":[{"value":"6 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"330"}}