{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T15:54:02Z","timestamp":1771948442296,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2020,5,23]],"date-time":"2020-05-23T00:00:00Z","timestamp":1590192000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U1811262"],"award-info":[{"award-number":["U1811262"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Patients\u2019 discharge summaries (documents) are health sensors that are used for measuring the quality of treatment in medical centers. However, extracting information automatically from discharge summaries with unstructured natural language is considered challenging. These kinds of documents include various aspects of patient information that could be used to test the treatment quality for improving medical-related decisions. One of the significant techniques in literature for discharge summaries classification is feature extraction techniques from the domain of natural language processing on text data. We propose a novel sentiment analysis method for discharge summaries classification that relies on vector space models, statistical methods, association rule, and extreme learning machine autoencoder (ELM-AE). Our novel hybrid model is based on statistical methods that build the lexicon in a domain related to health and medical records. Meanwhile, our method examines treatment quality based on an idea inspired by sentiment analysis. Experiments prove that our proposed method obtains a higher F1 value of 0.89 with good TPR (True Positive Rate) and FPR (False Positive Rate) values compared with various well-known state-of-the-art methods with different size of training and testing datasets. The results also prove that our method provides a flexible and effective technique to examine treatment quality based on positive, negative, and neutral terms for sentence-level in each discharge summary.<\/jats:p>","DOI":"10.3390\/info11050281","type":"journal-article","created":{"date-parts":[[2020,5,25]],"date-time":"2020-05-25T06:43:40Z","timestamp":1590389020000},"page":"281","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Machine Learning Based Sentiment Text Classification for Evaluating Treatment Quality of Discharge Summary"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2517-1522","authenticated-orcid":false,"given":"Samer Abdulateef","family":"Waheeb","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Northwestern Polytechnical University, Xi\u2019an 710072, China"}]},{"given":"Naseer","family":"Ahmed Khan","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Northwestern Polytechnical University, Xi\u2019an 710072, China"}]},{"given":"Bolin","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Northwestern Polytechnical University, Xi\u2019an 710072, China"}]},{"given":"Xuequn","family":"Shang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Northwestern Polytechnical University, Xi\u2019an 710072, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.diabres.2018.12.005","article-title":"Experiences of women, hospital clinicians and general practitioners with gestational diabetes mellitus postnatal follow-up: A mixed methods approach","volume":"148","author":"Kilgour","year":"2019","journal-title":"Diabetes Res. Clin. Pract."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1007\/s11845-018-1862-6","article-title":"An audit of discharge summaries from secondary to primary care","volume":"188","author":"McNamara","year":"2019","journal-title":"Ir. J. Med. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4302425","DOI":"10.1155\/2018\/4302425","article-title":"Data processing and text mining technologies on electronic medical records: A review","volume":"2018","author":"Sun","year":"2018","journal-title":"J. Healthc. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.jbi.2015.05.003","article-title":"Supporting information retrieval from electronic health records: A report of University of Michigan\u2019s nine-year experience in developing and using the Electronic Medical Record Search Engine (EMERSE)","volume":"55","author":"Hanauer","year":"2015","journal-title":"J. Biomed. Inform."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e921","DOI":"10.1038\/tp.2015.182","article-title":"Predicting early psychiatric readmission with natural language processing of narrative discharge summaries","volume":"6","author":"Rumshisky","year":"2016","journal-title":"Nat. Transl. Psychiatry"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1111\/jep.13020","article-title":"Level of accuracy of diagnoses recorded in discharge summaries: A cohort study in three respiratory wards","volume":"25","author":"Tsopra","year":"2019","journal-title":"J. Eval. Clin. Pract. Wiley Online Libr."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1136\/bmjqs-2018-008090","article-title":"Evaluation of an electronic health record structured discharge summary to provide real time adverse event reporting in thoracic surgery","volume":"28","author":"Graham","year":"2019","journal-title":"BMJ Qual. Saf."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/s10741-018-9754-4","article-title":"Updates in heart failure 30-day readmission prevention","volume":"24","author":"Goldgrab","year":"2019","journal-title":"Heart Fail. Rev."},{"key":"ref_9","first-page":"355","article-title":"An audit of medicines information quality in electronically generated discharge summaries\u2013evidence to meet the Australian National Safety and Quality Health Service Standards","volume":"47","author":"Gilbert","year":"2017","journal-title":"J. Pharm. Wiley Online Libr."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Schwarz, C.M., Hoffmann, M., Schwarz, P., Kamolz, L.P., Brunner, G., and Sendlhofer, G.J.B.H.S.R. (2019). A systematic literature review and narrative synthesis on the risks of medical discharge letters for patients\u2019 safety. BMC Health Servres, 19.","DOI":"10.1186\/s12913-019-3989-1"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1038\/s41591-018-0335-9","article-title":"Evaluation and accurate diagnoses of pediatric diseases using artificial intelligence","volume":"25","author":"Liang","year":"2019","journal-title":"Nat. Med."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Re\u00e1tegui, R., Ratt\u00e9, S.J.B.M.I., and Making, D. (2018). Comparison of MetaMap and cTAKES for entity extraction in clinical notes. BMC Med. Inform. Decis. Mak., 18.","DOI":"10.1186\/s12911-018-0654-2"},{"key":"ref_13","first-page":"565","article-title":"Clinical intentions of antibiotics prescribed upon discharge to hospice care","volume":"66","author":"Servid","year":"2018","journal-title":"J. Am. Heart Assoc. Wiley Online Libr."},{"key":"ref_14","first-page":"1","article-title":"Unsupervised medical entity recognition and linking in Chinese online medical text","volume":"2018","author":"Xu","year":"2018","journal-title":"J. Healthc. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.artmed.2018.03.007","article-title":"How do we talk about doctors and drugs? Sentiment analysis in forums expressing opinions for medical domain","volume":"93","year":"2019","journal-title":"Artif. Intell. Med."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Abualigah, L., Alfar, H.E., Shehab, M., and Hussein, A.M.A. (2020). Sentiment Analysis in Healthcare: A Brief Review. Recent Advances in NLP: The Case of Arabic Language, Springer.","DOI":"10.1007\/978-3-030-34614-0_7"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1002\/asi.24117","article-title":"10SENT: A stable sentiment analysis method based on the combination of off-the-shelf approaches","volume":"70","author":"Melo","year":"2019","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2163","DOI":"10.1007\/s13042-018-0799-4","article-title":"Using long short-term memory deep neural networks for aspect-based sentiment analysis of Arabic reviews","volume":"10","author":"Talafha","year":"2019","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_19","unstructured":"Ghasemaghaei, M., Eslami, S.P., Deal, K., and Hassanein, K. (2020, May 21). Consumers\u2019 attitude toward insurance companies: A sentiment analysis of online consumer reviews. Available online: https:\/\/aisel.aisnet.org\/amcis2016\/Decision\/Presentations\/10\/."},{"key":"ref_20","unstructured":"Rezaeinia, S.M., Ghodsi, A., and Rahmani, R.J.A.P.A. (2017). Improving the accuracy of pre-trained word embeddings for sentiment analysis. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sankar, H., Subramaniyaswamy, V., Vijayakumar, V., Arun Kumar, S., Logesh, R., and Umamakeswari, A.J.S.P. (2019). Intelligent sentiment analysis approach using edge computing-based deep learning technique. Softw. Pract. Exp. Wiley Online Libr.","DOI":"10.1002\/spe.2687"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, Y., and Youn, H.J.A.S. (2019). Feature Weighting Based on Inter-Category and Intra-Category Strength for Twitter Sentiment Analysis. Appl. Sci., 9.","DOI":"10.3390\/app9010092"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1007\/s10579-015-9307-6","article-title":"SentiTurkNet: A Turkish polarity lexicon for sentiment analysis","volume":"50","author":"Dehkharghani","year":"2016","journal-title":"Lang. Resour. Eval."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, Y., Rao, Y., and Wu, L. (2017, January 15\u201318). A review of sentiment semantic analysis technology and progress. Proceedings of the 2017 13th International Conference on Computational Intelligence and Security (CIS), Hong Kong, China.","DOI":"10.1109\/CIS.2017.00105"},{"key":"ref_25","unstructured":"Mohammad, S.M., Kiritchenko, S., and Zhu, X.J.A.P.A. (2019, January 6\u20137). NRC-Canada: Building the state-of-the-art in sentiment analysis of tweets. Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, Stroudsburg, PA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gilmore-Bykovskyi, A.L., Kennelty, K.A., DuGoff, E., and Kind, A.J.J.B.H.S.R. (2018). Hospital discharge documentation of a designated clinician for follow-up care and 30-day outcomes in hip fracture and stroke patients discharged to sub-acute care. BMC Health Servres, 18.","DOI":"10.1186\/s12913-018-2907-2"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Mehta, R.L., Baxendale, B., Roth, K., Caswell, V., Le Jeune, I., Hawkins, J., Zedan, H., and Avery, A.J.J.B.H.S.R. (2017). Assessing the impact of the introduction of an electronic hospital discharge system on the completeness and timeliness of discharge communication: A before and after study. BMC Health Servres, 17.","DOI":"10.1186\/s12913-017-2579-3"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1007\/s11096-017-0435-5","article-title":"Improving communication of medication changes using a pharmacist-prepared discharge medication management summary","volume":"39","author":"Ooi","year":"2017","journal-title":"Int. J. Clin. Pharm."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Pereira-Kohatsu, J.C., Quijano-S\u00e1nchez, L., Liberatore, F., and Camacho-Collados, M.J.S. (2019). Detecting and Monitoring Hate Speech in Twitter. Sensors, 19.","DOI":"10.3390\/s19214654"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Flores, A.C., Icoy, R.I., Pe\u00f1a, C.F., and Gorro, K.D. (2018, January 4\u20137). An Evaluation of SVM and Naive Bayes with SMOTE on Sentiment Analysis Data Set. Proceedings of the 2018 International Conference on Engineering, Applied Sciences, and Technology (ICEAST), Phuket, Thailand.","DOI":"10.1109\/ICEAST.2018.8434401"},{"key":"ref_31","first-page":"393","article-title":"SVM optimization for sentiment analysis","volume":"9","author":"Ahmad","year":"2018","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"180","DOI":"10.26483\/ijarcs.v9i2.5654","article-title":"Opinion Mining for Hotel Rating through Reviews Using Decision Tree Classification Method","volume":"9","author":"Gupta","year":"2018","journal-title":"Int. J. Adv. Res. Comput. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1007\/s12559-018-9549-x","article-title":"Sentic LSTM: A hybrid network for targeted aspect-based sentiment analysis","volume":"10","author":"Ma","year":"2018","journal-title":"Cogn. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1186\/s12938-018-0451-2","article-title":"Computer aided sentiment analysis of anorexia nervosa patients\u2019 vocabulary","volume":"17","author":"Spinczyk","year":"2018","journal-title":"Biomed. Eng. Online"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Jiang, K., Feng, S., Song, Q., Calix, R.A., Gupta, M., and Bernard, G.R.J.B.B. (2018). Identifying tweets of personal health experience through word embedding and LSTM neural network. BMC Bioinform., 19.","DOI":"10.1186\/s12859-018-2198-y"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1016\/j.neucom.2016.12.027","article-title":"Generalized extreme learning machine autoencoder and a new deep neural network","volume":"230","author":"Sun","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_38","first-page":"194","article-title":"Multi-Document Arabic Summarization Using Text Clustering to Reduce Redundancy","volume":"2","author":"Waheeb","year":"2014","journal-title":"Int. J. Adv. Sci. Technol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"59","DOI":"10.3390\/info11020059","article-title":"Multidocument Arabic Text Summarization Based on Clustering and Word2Vec to Reduce Redundancy","volume":"11","author":"Waheeb","year":"2020","journal-title":"Information"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/j.neucom.2005.12.126","article-title":"Extreme learning machine: Theory and applications","volume":"70","author":"Huang","year":"2006","journal-title":"Neurocomputing"},{"key":"ref_41","unstructured":"Reese, R.M. (2015). Natural Language Processing with Java, Packt Publishing Ltd."},{"key":"ref_42","unstructured":"Mikolov, T., Chen, K., Corrado, G., and Dean, J.J.A.P.A. (2013). Efficient estimation of word representations in vector space. arXiv."},{"key":"ref_43","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J. (2013, January 5\u20138). Distributed representations of words and phrases and their compositionality. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1490","DOI":"10.1109\/TIE.2017.2733448","article-title":"Deep learning of semisupervised process data with hierarchical extreme learning machine and soft sensor application","volume":"65","author":"Yao","year":"2017","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.neunet.2014.10.001","article-title":"Trends in extreme learning machines: A review","volume":"61","author":"Huang","year":"2015","journal-title":"Neural Netw."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/5\/281\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:31:53Z","timestamp":1760175113000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/5\/281"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,23]]},"references-count":45,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["info11050281"],"URL":"https:\/\/doi.org\/10.3390\/info11050281","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,23]]}}}