{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T15:30:13Z","timestamp":1772119813117,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":45,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T00:00:00Z","timestamp":1628899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2008208, 1934600, 1938167 and 1955151"],"award-info":[{"award-number":["2008208, 1934600, 1938167 and 1955151"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,14]]},"DOI":"10.1145\/3447548.3467118","type":"proceedings-article","created":{"date-parts":[[2021,8,13]],"date-time":"2021-08-13T18:33:08Z","timestamp":1628879588000},"page":"3077-3085","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Knowledge-Guided Efficient Representation Learning for Biomedical Domain"],"prefix":"10.1145","author":[{"given":"Kishlay","family":"Jha","sequence":"first","affiliation":[{"name":"University of Virginia, Charlottesville, VA, USA"}]},{"given":"Guangxu","family":"Xun","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, VA, USA"}]},{"given":"Nan","family":"Du","sequence":"additional","affiliation":[{"name":"Dawnlight Inc, Palo Alto, CA, USA"}]},{"given":"Aidong","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, VA, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,8,14]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-1909"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1371"},{"key":"e_1_3_2_2_3_1","volume-title":"The unified medical language system (UMLS): integrating biomedical terminology. Nucleic acids research 32, suppl_1","author":"Bodenreider Olivier","year":"2004","unstructured":"Olivier Bodenreider . 2004. The unified medical language system (UMLS): integrating biomedical terminology. Nucleic acids research 32, suppl_1 ( 2004 ), D267--D270. Olivier Bodenreider. 2004. The unified medical language system (UMLS): integrating biomedical terminology. Nucleic acids research 32, suppl_1 (2004), D267--D270."},{"key":"e_1_3_2_2_4_1","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Burdick Laura","year":"2018","unstructured":"Laura Burdick , Jonathan K Kummerfeld , and Rada Mihalcea . 2018 . Factors Influencing the Surprising Instability of Word Embeddings . In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long Papers). 2092--2102. Laura Burdick, Jonathan K Kummerfeld, and Rada Mihalcea. 2018. Factors Influencing the Surprising Instability of Word Embeddings. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). 2092--2102."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1136\/jamia.2001.0080317"},{"key":"e_1_3_2_2_6_1","volume-title":"A neural network multi-task learning approach to biomedical named entity recognition. BMC bioinformatics 18, 1","author":"Crichton Gamal","year":"2017","unstructured":"Gamal Crichton , Sampo Pyysalo , Billy Chiu , and Anna Korhonen . 2017. A neural network multi-task learning approach to biomedical named entity recognition. BMC bioinformatics 18, 1 ( 2017 ), 368. Gamal Crichton, Sampo Pyysalo, Billy Chiu, and Anna Korhonen. 2017. A neural network multi-task learning approach to biomedical named entity recognition. BMC bioinformatics 18, 1 (2017), 368."},{"key":"e_1_3_2_2_7_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171--4186. https:\/\/doi.org\/10. 18653\/v1\/N19--1423 10.18653\/v1 Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171--4186. https:\/\/doi.org\/10.18653\/v1\/N19--1423"},{"key":"e_1_3_2_2_8_1","volume-title":"NCBI disease corpus: a resource for disease name recognition and concept normalization. Journal of biomedical informatics47","author":"Leaman Robert","year":"2014","unstructured":"Robert Leaman , and Zhiyong Lu. 2014. NCBI disease corpus: a resource for disease name recognition and concept normalization. Journal of biomedical informatics47 ( 2014 ), 1--10. Robert Leaman, and Zhiyong Lu. 2014. NCBI disease corpus: a resource for disease name recognition and concept normalization. Journal of biomedical informatics47 (2014), 1--10."},{"key":"e_1_3_2_2_9_1","volume-title":"Reducing Transformer Depth on Demand with Structured Dropout. In International Conference on Learning Representations.","author":"Fan Angela","year":"2019","unstructured":"Angela Fan , Edouard Grave , and Armand Joulin . 2019 . Reducing Transformer Depth on Demand with Structured Dropout. In International Conference on Learning Representations. Angela Fan, Edouard Grave, and Armand Joulin. 2019. Reducing Transformer Depth on Demand with Structured Dropout. In International Conference on Learning Representations."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISIT.2004.1365067"},{"key":"e_1_3_2_2_11_1","unstructured":"Yu Gu Robert Tinn Hao Cheng Michael Lucas Naoto Usuyama XiaodongLiu Tristan Naumann Jianfeng Gao and Hoifung Poon. 2020. Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing. arXivpreprint arXiv:2007.15779(2020). Yu Gu Robert Tinn Hao Cheng Michael Lucas Naoto Usuyama XiaodongLiu Tristan Naumann Jianfeng Gao and Hoifung Poon. 2020. Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing. arXivpreprint arXiv:2007.15779(2020)."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.3390\/nano9060813"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2013.07.011"},{"key":"e_1_3_2_2_14_1","unstructured":"Neil Houlsby Andrei Giurgiu Stanislaw Jastrzebski Bruna Morrone QuentinDe Laroussilhe Andrea Gesmundo Mona Attariyan and Sylvain Gelly. 2019. Parameter-efficient transfer learning for NLP. arXiv preprint arXiv:1902.00751(2019). Neil Houlsby Andrei Giurgiu Stanislaw Jastrzebski Bruna Morrone QuentinDe Laroussilhe Andrea Gesmundo Mona Attariyan and Sylvain Gelly. 2019. Parameter-efficient transfer learning for NLP. arXiv preprint arXiv:1902.00751(2019)."},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553431"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2017.8258142"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220071"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330977"},{"key":"e_1_3_2_2_19_1","unstructured":"Kishlay Jha Guangxu Xun and Aidong Zhang. 2021. Continual representation learning for evolving biomedical bipartite networks. Bioinformatics(2021). Kishlay Jha Guangxu Xun and Aidong Zhang. 2021. Continual representation learning for evolving biomedical bipartite networks. Bioinformatics(2021)."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1259"},{"key":"e_1_3_2_2_21_1","volume-title":"A survey of word embeddings for clinical text. Journal of Biomedical Informatics: X4","author":"Khattak Faiza Khan","year":"2019","unstructured":"Faiza Khan Khattak , Serena Jeblee , Chlo\u00e9 Pou-Prom , Mohamed Abdalla , Christopher Meaney , and Frank Rudzicz . 2019. A survey of word embeddings for clinical text. Journal of Biomedical Informatics: X4 ( 2019 ), 100057. Faiza Khan Khattak, Serena Jeblee, Chlo\u00e9 Pou-Prom, Mohamed Abdalla, Christopher Meaney, and Frank Rudzicz. 2019. A survey of word embeddings for clinical text. Journal of Biomedical Informatics: X4 (2019), 100057."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1611835114"},{"key":"e_1_3_2_2_23_1","volume-title":"Proceedings of the sixth BioCreative challenge evaluation workshop","volume":"1","author":"Krallinger Martin","year":"2017","unstructured":"Martin Krallinger , Obdulia Rabal , Saber A Akhondi , Mart?n P\u00e9rez P\u00e9rez , Jesus Santamar\u00eda , GP Rodr\u00edguez , 2017 . Overview of the BioCreative VI chemical-protein interaction Track . In Proceedings of the sixth BioCreative challenge evaluation workshop , Vol. 1 . 141--146. Martin Krallinger, Obdulia Rabal, Saber A Akhondi, Mart?n P\u00e9rez P\u00e9rez, Jesus Santamar\u00eda, GP Rodr\u00edguez, et al. 2017. Overview of the BioCreative VI chemical-protein interaction Track. In Proceedings of the sixth BioCreative challenge evaluation workshop, Vol. 1. 141--146."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee Jinhyuk","year":"2020","unstructured":"Jinhyuk Lee , Wonjin Yoon , Sungdong Kim , Donghyeon Kim , Sunkyu Kim , Chan Ho So , and Jaewoo Kang . 2020 . BioBERT: a pre-trained biomedical language representation model for biomedical text mining . Bioinformatics 36 , 4 (2020), 1234 -- 1240 . Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, Donghyeon Kim, Sunkyu Kim, Chan Ho So, and Jaewoo Kang. 2020. BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics 36, 4 (2020), 1234--1240.","journal-title":"Bioinformatics"},{"key":"e_1_3_2_2_25_1","unstructured":"Bingbing Li Zhenglun Kong Tianyun Zhang Ji Li Zhengang Li Hang Liu and Caiwen Ding. 2020. Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning. arXiv preprint arXiv:2009.08065(2020). Bingbing Li Zhenglun Kong Tianyun Zhang Ji Li Zhengang Li Hang Liu and Caiwen Ding. 2020. Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning. arXiv preprint arXiv:2009.08065(2020)."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/18.61115"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.537"},{"key":"e_1_3_2_2_28_1","volume-title":"Rethinking the Value of Network Pruning. In International Conference on Learning Representations.","author":"Liu Zhuang","year":"2018","unstructured":"Zhuang Liu , Mingjie Sun , Tinghui Zhou , Gao Huang , and Trevor Darrell . 2018 . Rethinking the Value of Network Pruning. In International Conference on Learning Representations. Zhuang Liu, Mingjie Sun, Tinghui Zhou, Gao Huang, and Trevor Darrell. 2018. Rethinking the Value of Network Pruning. In International Conference on Learning Representations."},{"key":"e_1_3_2_2_29_1","volume-title":"PubMed and beyond: a survey of web tools for searching biomedical literature.Database2011","author":"Zhiyong Lu.","year":"2011","unstructured":"Zhiyong Lu. 2011. PubMed and beyond: a survey of web tools for searching biomedical literature.Database2011 ( 2011 ), baq036. Zhiyong Lu. 2011. PubMed and beyond: a survey of web tools for searching biomedical literature.Database2011 (2011), baq036."},{"key":"e_1_3_2_2_30_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg S Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems. 3111--3119. Tomas Mikolov Ilya Sutskever Kai Chen Greg S Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems. 3111--3119."},{"key":"e_1_3_2_2_31_1","volume-title":"Results of the Seventh Edition of the BioASQ Challenge. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 553--568","author":"Nentidis Anastasios","year":"2019","unstructured":"Anastasios Nentidis , Konstantinos Bougiatiotis , Anastasia Krithara , and Georgios Paliouras . 2019 . Results of the Seventh Edition of the BioASQ Challenge. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 553--568 . Anastasios Nentidis, Konstantinos Bougiatiotis, Anastasia Krithara, and Georgios Paliouras. 2019. Results of the Seventh Edition of the BioASQ Challenge. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 553--568."},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-5006"},{"key":"e_1_3_2_2_33_1","first-page":"1532","article-title":"Glove: Global Vectors for Word Representation","volume":"14","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington , Richard Socher , and Christopher D Manning . 2014 . Glove: Global Vectors for Word Representation . In EMNLP , Vol. 14. 1532 -- 1543 . Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global Vectors for Word Representation. In EMNLP, Vol. 14. 1532--1543.","journal-title":"EMNLP"},{"key":"e_1_3_2_2_34_1","unstructured":"Andrei A Rusu Neil C Rabinowitz Guillaume Desjardins Hubert Soyer James Kirkpatrick Koray Kavukcuoglu Razvan Pascanu and Raia Hadsell. 2016. Progressive neural networks. arXiv preprint arXiv:1606.04671(2016). Andrei A Rusu Neil C Rabinowitz Guillaume Desjardins Hubert Soyer James Kirkpatrick Koray Kavukcuoglu Razvan Pascanu and Raia Hadsell. 2016. Progressive neural networks. arXiv preprint arXiv:1606.04671(2016)."},{"key":"e_1_3_2_2_35_1","volume-title":"International Conference on Machine Learning. 507--515","author":"Ruvolo Paul","year":"2013","unstructured":"Paul Ruvolo and Eric Eaton . 2013 . ELLA: An efficient lifelong learning algorithm . In International Conference on Machine Learning. 507--515 . Paul Ruvolo and Eric Eaton. 2013. ELLA: An efficient lifelong learning algorithm. In International Conference on Machine Learning. 507--515."},{"key":"e_1_3_2_2_36_1","volume-title":"a distilled version of BERT: smaller, faster, cheaper and lighter. arXivpreprint arXiv","author":"Sanh Victor","year":"1910","unstructured":"Victor Sanh , Lysandre Debut , Julien Chaumond , and Thomas Wolf . 2019. DistilBERT , a distilled version of BERT: smaller, faster, cheaper and lighter. arXivpreprint arXiv : 1910 .01108(2019). Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXivpreprint arXiv: 1910.01108(2019)."},{"key":"e_1_3_2_2_37_1","unstructured":"Jainisha Sankhavara and Prasenjit Majumder. 2017. Biomedical Information Retrieval. In FIRE (Working Notes). 154--157. Jainisha Sankhavara and Prasenjit Majumder. 2017. Biomedical Information Retrieval. In FIRE (Working Notes). 154--157."},{"key":"e_1_3_2_2_38_1","volume-title":"Cheng-Ju Kuo, I-Fang Chung, Chun-Nan Hsu, Yu-Shi Lin, Roman Klinger, Christoph M Friedrich, Kuzman Ganchev, et al.","author":"Smith Larry","year":"2008","unstructured":"Larry Smith , Lorraine K Tanabe , Rie Johnson nee Ando , Cheng-Ju Kuo, I-Fang Chung, Chun-Nan Hsu, Yu-Shi Lin, Roman Klinger, Christoph M Friedrich, Kuzman Ganchev, et al. 2008 . Overview of BioCreative II gene mention recognition. Genome biology 9, S2 (2008), S2. Larry Smith, Lorraine K Tanabe, Rie Johnson nee Ando, Cheng-Ju Kuo, I-Fang Chung, Chun-Nan Hsu, Yu-Shi Lin, Roman Klinger, Christoph M Friedrich, Kuzman Ganchev, et al. 2008. Overview of BioCreative II gene mention recognition. Genome biology 9, S2 (2008), S2."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btx238"},{"key":"e_1_3_2_2_40_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is allyou need. In Advances in neural information processing systems. 5998--6008. Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is allyou need. In Advances in neural information processing systems. 5998--6008."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-018-9431-1"},{"key":"e_1_3_2_2_42_1","volume-title":"Lifelong Learning with Dynamically Expandable Networks. International Conference on Learning Representations.","author":"Yoon Jaehong","year":"2018","unstructured":"Jaehong Yoon , Eunho Yang , Jeongtae Lee , and Sung Ju Hwang . 2018 . Lifelong Learning with Dynamically Expandable Networks. International Conference on Learning Representations. Jaehong Yoon, Eunho Yang, Jeongtae Lee, and Sung Ju Hwang. 2018. Lifelong Learning with Dynamically Expandable Networks. International Conference on Learning Representations."},{"key":"e_1_3_2_2_43_1","volume-title":"improving biomedical word embeddings with subword information and MeSH. Scientific data 6, 1","author":"Zhang Yijia","year":"2019","unstructured":"Yijia Zhang , Qingyu Chen , Zhihao Yang , Hongfei Lin , and Zhiyong Lu. 2019. BioWordVec , improving biomedical word embeddings with subword information and MeSH. Scientific data 6, 1 ( 2019 ), 52. Yijia Zhang, Qingyu Chen, Zhihao Yang, Hongfei Lin, and Zhiyong Lu. 2019. BioWordVec, improving biomedical word embeddings with subword information and MeSH. Scientific data 6, 1 (2019), 52."},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btx659"},{"key":"e_1_3_2_2_45_1","unstructured":"Guanyu Zhou Kihyuk Sohn and Honglak Lee. 2012. Online incremental feature learning with denoising autoencoders. In Artificial intelligence and statistics.1453--1461. Guanyu Zhou Kihyuk Sohn and Honglak Lee. 2012. Online incremental feature learning with denoising autoencoders. In Artificial intelligence and statistics.1453--1461."}],"event":{"name":"KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Virtual Event Singapore","acronym":"KDD '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467118","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/abs\/10.1145\/3447548.3467118","content-type":"text\/html","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447548.3467118","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447548.3467118","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:05Z","timestamp":1750195685000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467118"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,14]]},"references-count":45,"alternative-id":["10.1145\/3447548.3467118","10.1145\/3447548"],"URL":"https:\/\/doi.org\/10.1145\/3447548.3467118","relation":{},"subject":[],"published":{"date-parts":[[2021,8,14]]},"assertion":[{"value":"2021-08-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}