{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T16:48:10Z","timestamp":1773852490556,"version":"3.50.1"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2018,10,24]],"date-time":"2018-10-24T00:00:00Z","timestamp":1540339200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2018,10,24]],"date-time":"2018-10-24T00:00:00Z","timestamp":1540339200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digital Med"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Large scale veterinary clinical records can become a powerful resource for patient care and research. However, clinicians lack the time and resource to annotate patient records with standard medical diagnostic codes and most veterinary visits are captured in free-text notes. The lack of standard coding makes it challenging to use the clinical data to improve patient care. It is also a major impediment to cross-species translational research, which relies on the ability to accurately identify patient cohorts with specific diagnostic criteria in humans and animals. In order to reduce the coding burden for veterinary clinical practice and aid translational research, we have developed a deep learning algorithm, DeepTag, which automatically infers diagnostic codes from veterinary free-text notes. DeepTag is trained on a newly curated dataset of 112,558 veterinary notes manually annotated by experts. DeepTag extends multitask LSTM with an improved hierarchical objective that captures the semantic structures between diseases. To foster human-machine collaboration, DeepTag also learns to abstain in examples when it is uncertain and defers them to human experts, resulting in improved performance. DeepTag accurately infers disease codes from free-text even in challenging cross-hospital settings where the text comes from different clinical settings than the ones used for training. It enables automated disease annotation across a broad range of clinical diagnoses with minimal preprocessing. The technical framework in this work can be applied in other medical domains that currently lack medical coding resources.<\/jats:p>","DOI":"10.1038\/s41746-018-0067-8","type":"journal-article","created":{"date-parts":[[2018,10,18]],"date-time":"2018-10-18T11:54:09Z","timestamp":1539863649000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["DeepTag: inferring diagnoses from veterinary clinical notes"],"prefix":"10.1038","volume":"1","author":[{"given":"Allen","family":"Nie","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9436-0637","authenticated-orcid":false,"given":"Ashley","family":"Zehnder","sequence":"additional","affiliation":[]},{"given":"Rodney L.","family":"Page","sequence":"additional","affiliation":[]},{"given":"Yuhui","family":"Zhang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3409-1815","authenticated-orcid":false,"given":"Arturo Lopez","family":"Pineda","sequence":"additional","affiliation":[]},{"given":"Manuel A.","family":"Rivas","sequence":"additional","affiliation":[]},{"given":"Carlos D.","family":"Bustamante","sequence":"additional","affiliation":[]},{"given":"James","family":"Zou","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2018,10,24]]},"reference":[{"key":"67_CR1","doi-asserted-by":"publisher","DOI":"10.1186\/2052-6687-1-2","volume":"1","author":"DG O\u2019Neill","year":"2014","unstructured":"O\u2019Neill, D. G., Church, D. B., McGreevy, P. D., Thomson, P. C. & Brodbelt, D. C. Approaches to canine health surveillance. Canine Genet. Epidemiol. 1, 2 (2014).","journal-title":"Canine Genet. Epidemiol."},{"key":"67_CR2","doi-asserted-by":"publisher","first-page":"308ps21","DOI":"10.1126\/scitranslmed.aaa9116","volume":"7","author":"A Kol","year":"2015","unstructured":"Kol, A. et al. Companion animals: Translational scientist\u2019s new best friends. Sci. Transl. Med. 7, 308ps21\u2013308ps21 (2015).","journal-title":"Sci. Transl. Med."},{"key":"67_CR3","doi-asserted-by":"publisher","first-page":"2133","DOI":"10.1158\/1078-0432.CCR-15-2347","volume":"22","author":"AK LeBlanc","year":"2016","unstructured":"LeBlanc, A. K., Mazcko, C. N. & Khanna, C. Defining the value of a comparative approach to cancer drug development. Clin. Cancer Res. 22, 2133\u20132138 (2016).","journal-title":"Clin. Cancer Res."},{"key":"67_CR4","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1007\/978-94-017-8914-1_23","volume":"813","author":"SC Baraban","year":"2014","unstructured":"Baraban, S. C. & L\u00f6scher, W. What new modeling approaches will help us identify promising drug treatments? Adv. Exp. Med. Biol. 813, 283\u2013294 (2014).","journal-title":"Adv. Exp. Med. Biol."},{"key":"67_CR5","first-page":"638","volume":"353","author":"D Grimm","year":"2016","unstructured":"Grimm, D. From bark to bedside. Am. Assoc. Adv. Sci. 353, 638\u2013640 (2016).","journal-title":"Am. Assoc. Adv. Sci."},{"key":"67_CR6","doi-asserted-by":"publisher","first-page":"394","DOI":"10.3390\/ijms19020394","volume":"19","author":"B Hernandez","year":"2018","unstructured":"Hernandez, B. et al. Naturally occurring canine melanoma as a predictive comparative oncology model for human mucosal and other triple wild-type melanomas. Int. J. Mol. Sci. 19, 394 (2018).","journal-title":"Int. J. Mol. Sci."},{"key":"67_CR7","doi-asserted-by":"publisher","first-page":"1633","DOI":"10.1097\/j.pain.0000000000000978","volume":"158","author":"MP Klinck","year":"2017","unstructured":"Klinck, M. P. et al. Translational pain assessment: Could natural animal models be the missing link? Pain 158, 1633\u20131646 (2017).","journal-title":"Pain"},{"key":"67_CR8","volume-title":"Speech and Language Processing","author":"D Jurafsky","year":"2014","unstructured":"Jurafsky, D. & Martin, J. H. Speech and Language Processing 3 (Pearson, London, 2014)."},{"key":"67_CR9","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9, 1735\u20131780 (1997).","journal-title":"Neural Comput."},{"key":"67_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2200\/S00762ED1V01Y201703HLT037","volume":"10","author":"Y Goldberg","year":"2017","unstructured":"Goldberg, Y. Neural network methods for natural language processing. Synth. Lect. Human Lang. Technol. 10, 1\u2013309 (2017).","journal-title":"Synth. Lect. Human Lang. Technol."},{"key":"67_CR11","doi-asserted-by":"publisher","first-page":"183","DOI":"10.15265\/IY-2015-009","volume":"10","author":"S Velupillai","year":"2015","unstructured":"Velupillai, S., Mowery, D., South, B. R., Kvist, M. & Dalianis, H. Recent advances in clinical natural language processing in support of semantic analysis. Yearb. Med. Inform. 10, 183 (2015).","journal-title":"Yearb. Med. Inform."},{"key":"67_CR12","doi-asserted-by":"publisher","first-page":"224","DOI":"10.15265\/IY-2016-017","volume":"1","author":"D Demner-Fushman","year":"2016","unstructured":"Demner-Fushman, D. & Elhadad, N. Aspiring to unintended consequences of natural language processing: A review of recent developments in clinical and consumer-generated text processing. Yearb. Med. Inform. 1, 224 (2016).","journal-title":"Yearb. Med. Inform."},{"key":"67_CR13","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/j.jbi.2015.10.001","volume":"58","author":"R Pivovarov","year":"2015","unstructured":"Pivovarov, R. et al. Learning probabilistic phenotypes from heterogeneous ehr data. J. Biomed. Inform. 58, 156\u2013165 (2015).","journal-title":"J. Biomed. Inform."},{"key":"67_CR14","unstructured":"Lipton, Z. C., Kale, D. C., Elkan, C. & Wetzel, R. Learning to diagnose with lstm recurrent neural networks. International Conference on Learning Representations (2016)."},{"key":"67_CR15","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1136\/amiajnl-2013-002544","volume":"22","author":"S Pradhan","year":"2014","unstructured":"Pradhan, S. et al. Evaluating the state of the art in disorder recognition and normalization of the clinical narrative. J. Am. Med. Inform. Assoc. 22, 143\u2013154 (2014).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"67_CR16","doi-asserted-by":"crossref","unstructured":"Jagannatha, A. N. & Yu, H. Bidirectional rnn for medical event detection in electronic health records. Proceedings of the Conference. Association for Computational Linguistics. North American Chapter. Meeting 473 (2016).","DOI":"10.18653\/v1\/N16-1056"},{"key":"67_CR17","doi-asserted-by":"crossref","unstructured":"Elhadad, N.et al. Semeval-2015 task 14: analysis of clinical text. Proceedings of the 8th International Workshop On Semantic Evaluation (Semeval 2014). 303\u2013310 (2015).","DOI":"10.18653\/v1\/S15-2051"},{"key":"67_CR18","doi-asserted-by":"crossref","unstructured":"Pradhan, S., Elhadad, N., Chapman, W., Manandhar, S. & Savova, G. Semeval-2014 task 7: analysis of clinical text. Proceedings of the 8th International Workshop on Semantic Evaluation (Semeval 2014). 54\u201362 (2014).","DOI":"10.3115\/v1\/S14-2007"},{"key":"67_CR19","unstructured":"Baumel, T., Nassour-Kassis, J., Cohen, R., Elhadad, M. & Elhadad, N. Multi-label classification of patient notes: case study on ICD code assignment. AAAI Workshops (2018)."},{"key":"67_CR20","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-018-0029-1","volume":"1","author":"A Rajkomar","year":"2018","unstructured":"Rajkomar, A. et al. Scalable and accurate deep learning with electronic health records. Digit. Med. 1, 18 (2018).","journal-title":"Digit. Med."},{"key":"67_CR21","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/j.artmed.2015.04.007","volume":"65","author":"R Kavuluru","year":"2015","unstructured":"Kavuluru, R., Rios, A. & Lu, Y. An empirical evaluation of supervised learning approaches in assigning diagnosis codes to electronic medical records. Artif. Intell. Med. 65, 155\u2013166 (2015).","journal-title":"Artif. Intell. Med."},{"key":"67_CR22","doi-asserted-by":"publisher","first-page":"866","DOI":"10.1093\/jamia\/ocv201","volume":"23","author":"M Subotin","year":"2016","unstructured":"Subotin, M. & Davis, A. R. A method for modeling co-occurrence propensity of clinical codes with application to ICD-10-PCS auto-coding. J. Am. Med. Inform. Assoc. 23, 866\u2013871 (2016).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"67_CR23","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1136\/amiajnl-2013-002159","volume":"21","author":"A Perotte","year":"2013","unstructured":"Perotte, A. et al. Diagnosis code assignment: Models and evaluation metrics. J. Am. Med. Inform. Assoc. 21, 231\u2013237 (2013).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"67_CR24","unstructured":"Li, Q. Literature survey: domain adaptation algorithms for natural language processing, Department of Computer Science The Graduate Center, The City University of New York. 8\u201310 (2012)."},{"key":"67_CR25","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1136\/jamia.2009.002733","volume":"17","author":"AR Aronson","year":"2010","unstructured":"Aronson, A. R. & Lang, F.-M. An overview of metamap: Historical perspective and recent advances. J. Am. Med. Inform. Assoc. 17, 229\u2013236 (2010).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"67_CR26","doi-asserted-by":"crossref","unstructured":"Graves, A., Fern\u00e1ndez, S. & Schmidhuber, J. Bidirectional lSTM networks for improved phoneme classification and recognition. Int. Conf. Artif. Neural Netw. 3697, 799\u2013804 (2005).","DOI":"10.1007\/11550907_126"},{"key":"67_CR27","unstructured":"Jacob, L., Vert, J. -P. & Bach, F. R. Clustered multi-task learning: A convex formulation. Adv. Neural. Inf. Process. Syst. 21, 745\u2013752 (2009)."},{"key":"67_CR28","doi-asserted-by":"crossref","unstructured":"Kim, Y. Convolutional neural networks for sentence classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 1746\u20131751 (2014).","DOI":"10.3115\/v1\/D14-1181"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0067-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0067-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0067-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,21]],"date-time":"2022-12-21T12:43:42Z","timestamp":1671626622000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0067-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,24]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,12]]}},"alternative-id":["67"],"URL":"https:\/\/doi.org\/10.1038\/s41746-018-0067-8","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,24]]},"assertion":[{"value":"27 June 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 October 2018","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 October 2018","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 October 2018","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"60"}}