{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T04:23:44Z","timestamp":1783571024861,"version":"3.55.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,11,21]],"date-time":"2023-11-21T00:00:00Z","timestamp":1700524800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,21]],"date-time":"2023-11-21T00:00:00Z","timestamp":1700524800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2022ZD0160704"],"award-info":[{"award-number":["2022ZD0160704"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Key Scientific Research Project of Higher Education Institutions in Henan Province","award":["23B330003"],"award-info":[{"award-number":["23B330003"]}]},{"name":"Key Science and Technology Program in Henan Province","award":["201400210400"],"award-info":[{"award-number":["201400210400"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>The widespread adoption of telehealth services necessitates accurate online department selection based on patient medical records, a task requiring significant medical knowledge. Incorrect triage results in considerable time wastage for both patients and medical professionals. To address this, we propose an intelligent triage model based on a Bidirectional Long Short-Term Memory (Bi-LSTM) neural network with character embedding to enhance the efficiency and capacity of telehealth services.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We gathered a 1.3 GB medical dataset comprising 200,000 records, each including medical history, physical examination data, and other pertinent information found on the electronic medical record homepage. Following data preprocessing, a clinical corpus was established to train character embeddings with a medical context.<\/jats:p><jats:p>These character embeddings were then utilized to extract features from patient chief \u00a0complaints, and a 2-layer Bi-LSTM neural network was trained to categorize these complaints, enabling intelligent triage for telehealth services.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>60,000 chief complaint-department data pairs were extracted from clinical corpus and divided into the training, validation, and test sets of 42,000, 9,000, and 9,000, respectively. The character embedding based Bi-LSTM neural network achieved a macro-precision of 85.50% and an F1 score of 85.45%.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>The telehealth triage model developed in this study demonstrates strong implementation outcomes and significantly improves the efficiency and capacity of telehealth services. Character embedding outperforms word embedding, and future work will incorporate additional features such as patient age and gender into the chief complaint feature to future enhance model performance.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12911-023-02367-1","type":"journal-article","created":{"date-parts":[[2023,11,21]],"date-time":"2023-11-21T16:03:40Z","timestamp":1700582620000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Enhancing efficiency and capacity of telehealth services with intelligent triage: a bidirectional LSTM neural network model employing character embedding"],"prefix":"10.1186","volume":"23","author":[{"given":"Jinming","family":"Shi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Ye","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haotian","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yaoen","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhongke","family":"Tan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaohan","family":"Fan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,11,21]]},"reference":[{"issue":"10","key":"2367_CR1","first-page":"739","volume":"31","author":"Zhao","year":"2014","unstructured":"Zhao, Jie, et al. Discussing the status of development of telemedicine and its trend.[J]. Chin Health Service Manage. 2014;31(10):739\u201340.","journal-title":"Chin Health Service Manage"},{"issue":"10","key":"2367_CR2","doi-asserted-by":"publisher","first-page":"1180","DOI":"10.1089\/tmj.2020.0381","volume":"27","author":"S Aydemir","year":"2021","unstructured":"Aydemir S, Ocak S, Sayg\u0131l\u0131 S, et al. Telemedicine applications in a tertiary pediatric hospital in Turkey during COVID-19 pandemic[J]. Telemedicine and e-Health. 2021;27(10):1180\u20137.","journal-title":"Telemedicine and e-Health"},{"issue":"7","key":"2367_CR3","doi-asserted-by":"publisher","first-page":"724","DOI":"10.1089\/tmj.2020.0369","volume":"27","author":"HY Park","year":"2021","unstructured":"Park HY, Kwon YM, Jun HR, et al. Satisfaction survey of patients and medical staff for telephone-based telemedicine during hospital closing due to COVID-19 transmission[J]. Telemedicine and e-Health. 2021;27(7):724\u201332.","journal-title":"Telemedicine and e-Health"},{"key":"2367_CR4","doi-asserted-by":"publisher","first-page":"101109","DOI":"10.1016\/j.ienj.2021.101109","volume":"60","author":"R S\u00e1nchez-Salmer\u00f3n","year":"2022","unstructured":"S\u00e1nchez-Salmer\u00f3n R, G\u00f3mez-Urquiza JL, Albend\u00edn-Garc\u00eda L, Correa-Rodr\u00edguez M, Martos-Cabrera MB, Velando-Soriano A, Suleiman-Martos N. Machine learning methods applied to triage in emergency services: a systematic review. Int Emerg Nurs. 2022;60:101109. https:\/\/doi.org\/10.1016\/j.ienj.2021.101109.","journal-title":"Int Emerg Nurs"},{"key":"2367_CR5","doi-asserted-by":"publisher","first-page":"106357","DOI":"10.1016\/j.cmpb.2021.106357","volume":"209","author":"OH Salman","year":"2021","unstructured":"Salman OH, Taha Z, Alsabah MQ, Hussein YS, Mohammed AS, Aal-Nouman M. A review on utilizing machine learning technology in the fields of electronic emergency triage and patient priority systems in telemedicine: coherent taxonomy, motivations, open research challenges and recommendations for intelligent future work. Comput Methods Programs Biomed. 2021;209:106357. https:\/\/doi.org\/10.1016\/j.cmpb.2021.106357.","journal-title":"Comput Methods Programs Biomed"},{"issue":"9","key":"2367_CR6","doi-asserted-by":"publisher","first-page":"1910","DOI":"10.1093\/jamia\/ocab092","volume":"28","author":"L Uscher-Pines","year":"2021","unstructured":"Uscher-Pines L, Sousa J, Mehrotra A, Schwamm LH, Zachrison KS. Rising to the challenges of the pandemic: telehealth innovations in U.S. emergency departments. J Am Med Inform Assoc. 2021;28(9):1910\u20138. https:\/\/doi.org\/10.1093\/jamia\/ocab092.","journal-title":"J Am Med Inform Assoc"},{"key":"2367_CR7","doi-asserted-by":"crossref","unstructured":"Ray S. A quick review of machine learning algorithms. In 2019 International conference on machine learning, big data, cloud and parallel computing (COMITCon). IEEE; 2019. p. 35-39.","DOI":"10.1109\/COMITCon.2019.8862451"},{"key":"2367_CR8","first-page":"88","volume":"09","author":"Z Wang","year":"2019","unstructured":"Wang Z, Wang. Research on intelligent triage of online inquiry platform based on machine learning. Data Anal Knowl Discovery. 2019;09:88\u201397.","journal-title":"Data Anal Knowl Discovery"},{"key":"2367_CR9","volume-title":"Research on intelligent medical diagnosis auxiliary method based on machine learning [ D ]","author":"Chen Qinjie","year":"2017","unstructured":"Chen Qinjie. Research on intelligent medical diagnosis auxiliary method based on machine learning [ D ]. Hunan: National University of Defense Technology; 2017."},{"issue":"10","key":"2367_CR10","first-page":"3","volume":"12","author":"Dong","year":"2017","unstructured":"Dong, Tianshu. Zhang Meikui, & Ai Xuewei. Research on Automated Triage Technology in Remote Consultation System. China Digit Med. 2017;12(10):3.","journal-title":"China Digit Med"},{"key":"2367_CR11","volume-title":"INTELLIGENT MEDICAL GUIDE SYSTEM BASED ON VSM WEIGHT IMPROVEMENT ALGORITHM[J]","author":"Y Lin","year":"2015","unstructured":"Lin Y, Liang L, Cui Y, et al. INTELLIGENT MEDICAL GUIDE SYSTEM BASED ON VSM WEIGHT IMPROVEMENT ALGORITHM[J]. Computer Applications & Software; 2015."},{"key":"2367_CR12","unstructured":"Mikolov T, Sutskever I, Chen K. Distributed representations of words and phrases and their compositionality. In: Proceedings of the 27th Conference on Neural Information Processing Systems 2013 (NIPS 2013). 2013 Presented at: 27th Conference on Neural Information Processing Systems 2013 (NIPS 2013); December 5\u201310, 2013; Lake Tahoe, NV p.\u00a03111\u20133119."},{"key":"2367_CR13","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning CD. Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 2014. p. 1532-1543.","DOI":"10.3115\/v1\/D14-1162"},{"issue":"3","key":"2367_CR14","first-page":"1","volume":"20","author":"Z Zhang","year":"2020","unstructured":"Zhang Z, et al. Enhanced character-level deep convolutional neural networks for Cardiovascular Disease prediction. BMC medical informatics and decision making. 2020;20(3):1\u201310.","journal-title":"BMC medical informatics and decision making"},{"key":"2367_CR15","first-page":"3","volume-title":"MedNLU: natural language understander for medical texts. Deep Learning Techniques for Biomedical and Health Informatics","author":"HB Barathi Ganesh","year":"2020","unstructured":"Barathi Ganesh HB, et al. MedNLU: natural language understander for medical texts. Deep Learning Techniques for Biomedical and Health Informatics. Cham: Springer; 2020. pp. 3\u201321."},{"key":"2367_CR16","unstructured":"Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. arXiv preprint. 2013. arXiv:1301.3781."},{"key":"2367_CR17","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1162\/tacl_a_00134","volume":"3","author":"O Levy","year":"2015","unstructured":"Levy O, Goldberg Y, Dagan I. Improving distributional similarity with lessons learned from word embeddings. Trans Association Comput Linguistics. 2015;3:211\u201325.","journal-title":"Trans Association Comput Linguistics"},{"issue":"17","key":"2367_CR18","first-page":"75","volume":"19","author":"S Chowdhury","year":"2018","unstructured":"Chowdhury S, et al. A multitask bi-directional RNN model for named entity recognition on Chinese electronic medical records. BMC Bioinformatics. 2018;19(17):75\u201384.","journal-title":"BMC Bioinformatics"},{"key":"2367_CR19","doi-asserted-by":"publisher","first-page":"2687","DOI":"10.3390\/ijerph17082687","volume":"17","author":"X Chen","year":"2020","unstructured":"Chen X, et al. Improving the named entity recognition of Chinese electronic medical records by combining domain dictionary and rules. Int J Environ Res Public Health. 2020;17:2687.","journal-title":"Int J Environ Res Public Health"},{"issue":"7","key":"2367_CR20","doi-asserted-by":"publisher","first-page":"1235","DOI":"10.1162\/neco_a_01199","volume":"31","author":"Y Yu","year":"2019","unstructured":"Yu Y, et al. A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput. 2019;31(7):1235\u201370.","journal-title":"Neural Comput"},{"key":"2367_CR21","doi-asserted-by":"crossref","unstructured":"Siami-Namini S, Tavakoli N, Namin AS. The performance of LSTM and BiLSTM in forecasting time series. In 2019 IEEE International conference on big data (Big Data). IEEE; 2019. p. 3285-3292.","DOI":"10.1109\/BigData47090.2019.9005997"},{"key":"2367_CR22","doi-asserted-by":"crossref","unstructured":"Jiang S, Zhao S, Hou K, Liu Y, Zhang L. A BERT-BiLSTM-CRF model for Chinese electronic medical records named entity recognition. In 2019 12th international conference on intelligent computation technology and automation (ICICTA). IEEE; 2019. p. 166-169.","DOI":"10.1109\/ICICTA49267.2019.00043"},{"issue":"2","key":"2367_CR23","first-page":"149","volume":"19","author":"B Ji","year":"2019","unstructured":"Ji B, et al. A hybrid approach for named entity recognition in Chinese electronic medical record. BMC medical informatics and decision making. 2019;19(2):149\u201358.","journal-title":"BMC medical informatics and decision making"},{"key":"2367_CR24","unstructured":"Eziz E. Kashgari. GitHub. 2019. https:\/\/github.com\/BrikerMan\/Kashgari."},{"issue":"5","key":"2367_CR25","first-page":"458","volume":"18","author":"FE Jr Masarie","year":"1985","unstructured":"Jr MF, Miller RA, Myers JD, Computers. Biomedical Res Int J. 1985;18(5):458\u201379.","journal-title":"Biomedical Res Int J"},{"key":"2367_CR26","volume-title":"Rule Based Expert Systems: The Mycin Experiments of the Stanford Heuristic Programming Project (The Addison-Wesley series in artificial intelligence)[M]","author":"BG Buchanan","year":"1984","unstructured":"Buchanan BG, Shortliffe EH. Rule based Expert systems: the mycin experiments of the Stanford Heuristic Programming Project (the Addison-Wesley series in artificial intelligence)[M]. Addison-Wesley; 1984."},{"key":"2367_CR27","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1186\/s12911-021-01585-9","volume":"21","author":"H Salem","year":"2021","unstructured":"Salem H, Soria D, Lund JN, et al. A systematic review of the applications of Expert systems (ES) and machine learning (ML) in clinical urology. BMC Med Inform Decis Mak. 2021;21:223. https:\/\/doi.org\/10.1186\/s12911-021-01585-9.","journal-title":"BMC Med Inform Decis Mak"},{"key":"2367_CR28","volume-title":"The design and implementation of the guidance system based on the reasoning algorithm","author":"H Ru","year":"2016","unstructured":"Ru H. In: FEI HE, editor. The design and implementation of the guidance system based on the reasoning algorithm. Anhui University; 2016."},{"key":"2367_CR29","volume-title":"Research on TF-IDF weight improvement algorithm in intelligent guidance system[J]","author":"XU Yifeng","year":"2017","unstructured":"Yifeng XU, Liu L, Huang Q, et al. Research on TF-IDF weight improvement algorithm in intelligent guidance system[J]. Computer Engineering & Applications; 2017."},{"key":"2367_CR30","volume-title":"Research on The Intelligent Medical Guide System Based on Multi-words TF-IDF Algorithm [D]","author":"Huang Lei","year":"2015","unstructured":"Huang Lei. Research on the Intelligent Medical Guide System based on multi-words TF-IDF algorithm [D]. Zhengzhou University; 2015."},{"issue":"6","key":"2367_CR31","first-page":"1","volume":"2018","author":"M Liefold","year":"2018","unstructured":"Liefold M, Wagner D, Pokraka A, et al. Low-cost medical infrastructure: triage as intelligent decision support[J]. Electron Imaging. 2018;2018(6):1\u20134.","journal-title":"Electron Imaging"},{"issue":"9","key":"2367_CR32","first-page":"88","volume":"3","author":"Z Wang Ruojia","year":"2019","unstructured":"Wang Ruojia Z, Lu, Wang, Jimin. Research on Intelligent Triage of Online Consultation platform based on machine learning. Data Anal Knowl Discovery. 2019;3(9):88\u201397.","journal-title":"Data Anal Knowl Discovery"},{"key":"2367_CR33","first-page":"572","volume-title":"Assisting e-patients in an Ask the Doctor Service. Digital Healthcare Empowering Europeans","author":"A Abdaoui","year":"2015","unstructured":"Abdaoui A, et al. Assisting e-patients in an ask the Doctor Service. Digital Healthcare empowering europeans. IOS Press; 2015. pp. 572\u20136."},{"key":"2367_CR34","unstructured":"Diao BS. Research on online doctor recommendation system based on online patient consultation data (Master's thesis). Beijing Institute of Technology. 2018. DOI: CNKI:CDMD: 2.1018.812266."}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02367-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-023-02367-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02367-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,2]],"date-time":"2024-11-02T12:57:56Z","timestamp":1730552276000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-023-02367-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,21]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2367"],"URL":"https:\/\/doi.org\/10.1186\/s12911-023-02367-1","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,21]]},"assertion":[{"value":"26 October 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 November 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"269"}}