{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T04:20:10Z","timestamp":1772166010886,"version":"3.50.1"},"reference-count":18,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T00:00:00Z","timestamp":1700092800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T00:00:00Z","timestamp":1700092800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["72261032"],"award-info":[{"award-number":["72261032"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>A large collection of dialogues between patients and doctors must be annotated for medical named entities to build intelligence for telemedicine. However, since most patients involved in telemedicine deliver related named entities in informal and long multiword expressions, it is challenging to tag their telemedicine dialogue data. This study aims to address this issue.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>With the telemedicine dialogue dataset for obstetrics and gynecology taken from haodf.com, we developed guidelines and followed a two-round procedure to tag six types of named entities, including disease, symptom, time, pharmaceutical, operation, and examination. Additionally, we developed four deep-learning models based on this dataset to establish a benchmark for named-entity recognition (NER).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The distilled obstetrics and gynecology dataset contains 2,383 consultations between doctors and patients, of which 13,411 sentences were from doctors, and 17,929 were from patients. With 63,560 named entities in total, the average number of characters per named entity is 4.33. The experimental results suggest that LatticeLSTM performs best on our dataset in terms of accuracy, precision, recall, and F score.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Compared with other datasets, this dataset offers three novel facets. This study offers intricately tagged long multiword expressions for medical named entities. Second, this study is one of the first attempts to mark temporal entities in a medical dataset. Third, this annotated dataset is balanced across the six types of labels, which we believe will play a considerable role in expanding telemedicine artificial intelligence.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12911-023-02365-3","type":"journal-article","created":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T12:02:33Z","timestamp":1700136153000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Chinese telemedicine-dialogue dataset annotated for named entities"],"prefix":"10.1186","volume":"23","author":[{"given":"Shanshan","family":"Wang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yajing","family":"Yan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rong","family":"Yan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ting","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kaijie","family":"Ma","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yani","family":"Yan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,11,16]]},"reference":[{"key":"2365_CR1","doi-asserted-by":"publisher","unstructured":"Ramshaw LA, Marcus MP. Text Chunking Using Transformation-Based Learning. In: Armstrong S, Church K, Isabelle P, Manzi S, Tzoukermann E, Yarowsky D, editors. Natural Language Processing Using Very Large Corpora. Text, Speech and Language Technology, vol. 11. Dordrecht: Springer; https:\/\/doi.org\/10.1007\/978-94-017-2390-9_10.","DOI":"10.1007\/978-94-017-2390-9_10"},{"key":"2365_CR2","doi-asserted-by":"publisher","unstructured":"Chen W, Li Z, Fang H, Yao Q, Zhong C, Hao J, et al. A benchmark for automatic medical consultation system: frameworks, tasks and datasets. Bioinformatics. 2023;39(1):btac817. https:\/\/doi.org\/10.1093\/bioinformatics\/btac817.","DOI":"10.1093\/bioinformatics\/btac817"},{"key":"2365_CR3","doi-asserted-by":"publisher","unstructured":"Zhou Y, Yan Y, Han R, Caufield JH, Chang K-W, Sun Y, et al. Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global Inference. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, issue no. 16. 2021 p. 14647\u201314655. https:\/\/doi.org\/10.1609\/aaai.v35i16.17721.","DOI":"10.1609\/aaai.v35i16.17721"},{"key":"2365_CR4","doi-asserted-by":"crossref","unstructured":"Yang J, Zhang Y, Li L, Li X. YEDDA: A Lightweight Collaborative Text Span Annotation Tool. In Proceedings of ACL 2018, System Demonstrations. Melbourne: Association for Computational Linguistics;\u00a02018.\u00a0p. 31\u201336.","DOI":"10.18653\/v1\/P18-4006"},{"issue":"suppl 1","key":"2365_CR5","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1093\/nar\/gkh061","volume":"32","author":"O Bodenreider","year":"2004","unstructured":"Bodenreider O. The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res. 2004;32(suppl 1):267\u201370. https:\/\/doi.org\/10.1093\/nar\/gkh061.","journal-title":"Nucleic Acids Res."},{"key":"2365_CR6","doi-asserted-by":"crossref","unstructured":"Hongying Z, Wenxin L, Kunli Z, Yajuan Y, Baobao C, Zhifang S. Building a Pediatric Medical Corpus: Word Segmentation and Named Entity Annotation. CLSW. 2020. p. 652\u2013664.","DOI":"10.1007\/978-3-030-81197-6_55"},{"issue":"2","key":"2365_CR7","first-page":"302","volume":"31","author":"L Cai","year":"2020","unstructured":"Cai L, Wang ST, Liu J-H, Zhu Y-Y. Survey of data annotation. J Softw. 2020;31(2):302\u201320.","journal-title":"J Softw."},{"key":"2365_CR8","unstructured":"Carletta J. Assessing Agreement on Classification Tasks: The Kappa Statistic. Comput. Linguist. 1996;22(2):249\u201354."},{"issue":"3","key":"2365_CR9","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1197\/jamia.M1733","volume":"12","author":"G Hripcsak","year":"2005","unstructured":"Hripcsak G, Rothschild AS. Agreement, the f-measure, and reliability in information retrieval. J Am Med Inf Assoc. 2005;12(3):296\u20138.","journal-title":"J Am Med Inf Assoc."},{"issue":"11","key":"2365_CR10","first-page":"2725","volume":"27","author":"J Yang","year":"2016","unstructured":"Yang J, Guan Y, He B, Qu C-Y, Yu Q-B, Liu Y-X, Zhao Y-J. Corpus construction for named entities and entity relations on chinese electronic medical records. J Softw. 2016;27(11):2725\u201346.","journal-title":"J Softw."},{"issue":"5","key":"2365_CR11","doi-asserted-by":"publisher","first-page":"922","DOI":"10.1136\/amiajnl-2012-001317","volume":"20","author":"D Albright","year":"2013","unstructured":"Albright D, Lanfranchi A, Fredriksen A, Styler WF, Warner C, Hwang JD, Choi JD, Dligach D, Nielsen RD, Martin J. Towards comprehensive syntactic and semantic annotations of the clinical narrative. J Am Med Inform Assoc Jamia. 2013;20(5):922\u201330.","journal-title":"J Am Med Inform Assoc Jamia."},{"key":"2365_CR12","unstructured":"Huang Z, Xu W, Yu K. Bidirectional LSTM-CRF Models for Sequence Tagging. CoRR abs\/1508.01991. 2015. p. 1\u20139."},{"key":"2365_CR13","doi-asserted-by":"crossref","unstructured":"Zhang Y, Yang J. Chinese NER Using Lattice LSTM. ACL.\u00a02018;(1):1554\u201364.","DOI":"10.18653\/v1\/P18-1144"},{"key":"2365_CR14","unstructured":"Huang K, Altosaar J, Ranganath R. ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission. CoRR abs\/1904.05342. 2019. p. 1\u20136."},{"key":"2365_CR15","doi-asserted-by":"crossref","unstructured":"Liu W, Fu X, Zhang Y, Xiao W. Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter, issue no. 1. ACL\/IJCNLP. 2021. p. 5847\u20135858.","DOI":"10.18653\/v1\/2021.acl-long.454"},{"issue":"2","key":"2365_CR16","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1017\/S135132490400364X","volume":"11","author":"N Xue","year":"2005","unstructured":"Xue N, Xia F, Chiou FD, Palmer M. The penn chinese treebank: Phrase structure annotation of a large corpus. Nat Lang Eng. 2005;11(2):207\u201338.","journal-title":"Nat Lang Eng."},{"key":"2365_CR17","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J. Distributed Representations of Words and Phrases and their Compositionality. NIPS. 2013. p. 3111\u20133119."},{"key":"2365_CR18","doi-asserted-by":"crossref","unstructured":"Zeng G, Yang W, Ju Z, Yang Y, Wang S, Zhang R, et al. MedDialog: Large-scale Medical Dialogue Datasets. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics.\u00a02020. p.\u00a09241\u20139250.","DOI":"10.18653\/v1\/2020.emnlp-main.743"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02365-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-023-02365-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02365-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T12:03:45Z","timestamp":1700136225000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-023-02365-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,16]]},"references-count":18,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2365"],"URL":"https:\/\/doi.org\/10.1186\/s12911-023-02365-3","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2788131\/v1","asserted-by":"object"}]},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,16]]},"assertion":[{"value":"7 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 November 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"264"}}