{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T12:47:19Z","timestamp":1773146839761,"version":"3.50.1"},"reference-count":20,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T00:00:00Z","timestamp":1645574400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T00:00:00Z","timestamp":1645574400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100011621","name":"Winship Cancer Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100011621","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Biomed Semant"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Transfer learning is a common practice in image classification with deep learning where the available data is often limited for training a complex model with millions of parameters. However, transferring language models requires special attention since cross-domain vocabularies (e.g. between two different modalities MR and US) do not always overlap as the pixel intensity range overlaps mostly for images.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method<\/jats:title>\n                    <jats:p>We present a concept of similar domain adaptation where we transfer inter-institutional language models (context-dependent and context-independent) between two different modalities (ultrasound and MRI) to capture liver abnormalities.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We use MR and US screening exam reports for hepatocellular carcinoma as the use-case and apply the transfer language space strategy to automatically label imaging exams with and without structured template with &gt;\u20090.9 average f1-score.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>We conclude that transfer learning along with fine-tuning the discriminative model is often more effective for performing shared targeted tasks than the training for a language space from scratch.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13326-022-00262-8","type":"journal-article","created":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T08:03:20Z","timestamp":1645603400000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Transfer language space with similar domain adaptation: a case study with hepatocellular carcinoma"],"prefix":"10.1186","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5932-2491","authenticated-orcid":false,"given":"Amara","family":"Tariq","sequence":"first","affiliation":[]},{"given":"Omar","family":"Kallas","sequence":"additional","affiliation":[]},{"given":"Patricia","family":"Balthazar","sequence":"additional","affiliation":[]},{"given":"Scott Jeffery","family":"Lee","sequence":"additional","affiliation":[]},{"given":"Terry","family":"Desser","sequence":"additional","affiliation":[]},{"given":"Daniel","family":"Rubin","sequence":"additional","affiliation":[]},{"given":"Judy Wawira","family":"Gichoya","sequence":"additional","affiliation":[]},{"given":"Imon","family":"Banerjee","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,2,23]]},"reference":[{"issue":"2","key":"262_CR1","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1053\/j.gastro.2018.08.065","volume":"156","author":"L Kulik","year":"2019","unstructured":"Kulik L, El-Serag HB. Epidemiology and management of hepatocellular carcinoma. Gastroenterology. 2019; 156(2):477\u201391.","journal-title":"Gastroenterology"},{"issue":"1","key":"262_CR2","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1007\/s00261-017-1209-1","volume":"43","author":"A Tang","year":"2018","unstructured":"Tang A, Hallouch O, Chernyak V, Kamaya A, Sirlin CB. Epidemiology of hepatocellular carcinoma: target population for surveillance and diagnosis. Abdom Radiol. 2018; 43(1):13\u201325.","journal-title":"Abdom Radiol"},{"issue":"2","key":"262_CR3","doi-asserted-by":"publisher","first-page":"723","DOI":"10.1002\/hep.29913","volume":"68","author":"JA Marrero","year":"2018","unstructured":"Marrero JA, Kulik LM, Sirlin CB, Zhu AX, Finn RS, Abecassis MM, Roberts LR, Heimbach JK. Diagnosis, staging, and management of hepatocellular carcinoma: 2018 practice guidance by the american association for the study of liver diseases. Hepatology. 2018; 68(2):723\u201350.","journal-title":"Hepatology"},{"issue":"7","key":"262_CR4","doi-asserted-by":"publisher","first-page":"1994","DOI":"10.1148\/rg.2017170098","volume":"37","author":"KM Elsayes","year":"2017","unstructured":"Elsayes KM, Hooker JC, Agrons MM, Kielar AZ, Tang A, Fowler KJ, Chernyak V, Bashir MR, Kono Y, Do RK, et al. 2017 version of li-rads for ct and mr imaging: an update. Radiographics. 2017; 37(7):1994\u20132017.","journal-title":"Radiographics"},{"key":"262_CR5","doi-asserted-by":"publisher","first-page":"101770","DOI":"10.1016\/j.artmed.2019.101770","volume":"102","author":"DM Rocha","year":"2019","unstructured":"Rocha DM, Brasil LM, Lamas JM, Luz GV, Bacelar SS. Evidence of the benefits, advantages and potentialities of the structured radiological report: an integrative review. Artif Intell Med. 2019; 102:101770.","journal-title":"Artif Intell Med"},{"issue":"e1","key":"262_CR6","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1136\/amiajnl-2014-003009","volume":"22","author":"S Bozkurt","year":"2015","unstructured":"Bozkurt S, Lipson JA, Senol U, Rubin DL. Automatic abstraction of imaging observations with their characteristics from mammography reports. J Am Med Inform Assoc. 2015; 22(e1):81\u201392.","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"262_CR7","doi-asserted-by":"publisher","first-page":"742","DOI":"10.1007\/s10278-016-9889-6","volume":"29","author":"C Morioka","year":"2016","unstructured":"Morioka C, Meng F, Taira R, Sayre J, Zimmerman P, Ishimitsu D, Huang J, Shen L, El-Saden S. Automatic classification of ultrasound screening examinations of the abdominal aorta. J Digit Imaging. 2016; 29(6):742\u201348.","journal-title":"J Digit Imaging"},{"issue":"4","key":"262_CR8","doi-asserted-by":"publisher","first-page":"936","DOI":"10.1007\/s10620-012-2433-8","volume":"58","author":"JK Hou","year":"2013","unstructured":"Hou JK, Chang M, Nguyen T, Kramer JR, Richardson P, Sansgiry S, D\u2019Avolio LW, El-Serag HB. Automated identification of surveillance colonoscopy in inflammatory bowel disease using natural language processing. Dig Dis Sci. 2013; 58(4):936\u201341.","journal-title":"Dig Dis Sci"},{"issue":"10","key":"262_CR9","doi-asserted-by":"publisher","first-page":"2713","DOI":"10.1007\/s10620-017-4721-9","volume":"62","author":"JS Redman","year":"2017","unstructured":"Redman JS, Natarajan Y, Hou JK, Wang J, Hanif M, Feng H, Kramer JR, Desiderio R, Xu H, El-Serag HB, et al. Accurate identification of fatty liver disease in data warehouse utilizing natural language processing. Dig Dis Sci. 2017; 62(10):2713\u201318.","journal-title":"Dig Dis Sci"},{"issue":"10","key":"262_CR10","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1097\/MCG.0000000000000583","volume":"50","author":"EK Chang","year":"2016","unstructured":"Chang EK, Yu CY, Clarke R, Hackbarth A, Sanders T, Esrailian E, Hommes DW, Runyon BA. Defining a patient population with cirrhosis. J Clin Gastroenterol. 2016; 50(10):889\u201394.","journal-title":"J Clin Gastroenterol"},{"key":"262_CR11","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J. Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems: 2013. p. 3111\u201319."},{"key":"262_CR12","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"J Pennington","year":"2014","unstructured":"Pennington J, Socher R, Manning CD. Glove: Global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Stroudsburg: Association for Computational Linguistics: 2014. p. 1532\u201343."},{"key":"262_CR13","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. 2018."},{"key":"262_CR14","doi-asserted-by":"crossref","unstructured":"Peters ME, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L. Deep contextualized word representations. arXiv preprint arXiv:1802.05365. 2018.","DOI":"10.18653\/v1\/N18-1202"},{"key":"262_CR15","unstructured":"Banerjee I, Choi HH, Desser T, Rubin DL. A scalable machine learning approach for inferring probabilistic us-li-rads categorization. In: AMIA Annual Symposium Proceedings, vol. 2018. American Medical Informatics Association: 2018. p. 215."},{"issue":"6","key":"262_CR16","doi-asserted-by":"publisher","first-page":"478","DOI":"10.1016\/j.jbi.2003.11.007","volume":"36","author":"C Rosse","year":"2003","unstructured":"Rosse C, Mejino Jr JL. A reference ontology for biomedical informatics: the foundational model of anatomy. J Biomed Inform. 2003; 36(6):478\u2013500.","journal-title":"J Biomed Inform"},{"key":"262_CR17","unstructured":"Bird S, Klein E, Loper E. Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit: O\u2019Reilly Media, Inc.; 2009."},{"key":"262_CR18","unstructured":"Ancona M, Ceolini E, \u00d6ztireli C, Gross M. Towards better understanding of gradient-based attribution methods for deep neural networks. In: International Conference on Learning Representations: 2018. https:\/\/openreview.net\/forum?id=Sy21R9JAW. Accessed Jan 2022."},{"issue":"4","key":"262_CR19","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","volume":"36","author":"J Lee","year":"2020","unstructured":"Lee J, Yoon W, Kim S, Kim D, Kim S, So CH, Kang J. Biobert: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics. 2020; 36(4):1234\u201340.","journal-title":"Bioinformatics"},{"key":"262_CR20","doi-asserted-by":"crossref","unstructured":"Alsentzer E, Murphy JR, Boag W, Weng W-H, Jin D, Naumann T, McDermott M. Publicly available clinical bert embeddings. arXiv preprint arXiv:1904.03323. 2019.","DOI":"10.18653\/v1\/W19-1909"}],"container-title":["Journal of Biomedical Semantics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-022-00262-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13326-022-00262-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-022-00262-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,17]],"date-time":"2023-11-17T18:48:11Z","timestamp":1700246891000},"score":1,"resource":{"primary":{"URL":"https:\/\/jbiomedsem.biomedcentral.com\/articles\/10.1186\/s13326-022-00262-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,23]]},"references-count":20,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["262"],"URL":"https:\/\/doi.org\/10.1186\/s13326-022-00262-8","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.08.26.20182659","asserted-by":"object"}]},"ISSN":["2041-1480"],"issn-type":[{"value":"2041-1480","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,23]]},"assertion":[{"value":"18 November 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 February 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The Stanford and Emory Institutional Review Board approved the study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Authors declare no financial and non-financial competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"8"}}