{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T09:26:30Z","timestamp":1769937990707,"version":"3.49.0"},"reference-count":37,"publisher":"SAGE Publications","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDT"],"published-print":{"date-parts":[[2024,9,16]]},"abstract":"<jats:p>BACKGROUND: Patient sentiment analysis aids in identifying issue areas, timely remediation, and improved patient care by the healthcare professional. The relationship between pain management and patient sentiment analysis is crucial to providing patients with high-quality medical care. Therefore, a self-reported pain level assessment is required for the smart healthcare framework to determine the best course of treatment. OBJECTIVE: An efficient method for a pain sentiment recognition system has been proposed based on the analysis of human facial emotion patterns of patients in the smart healthcare framework. METHODS: The proposed system has been implemented in four phases: (i) in the first phase, the facial regions of the observation patient have been detected using the computer vision-based face detection technique; (ii) in the second phase, the extracted facial regions are analyzed using deep learning based feature representation techniques to extract discriminant and crucial facial features to analyze the level of pain emotion of patient; (iii) the level of pain emotions belongs from macro to micro facial expressions, so, some advanced feature tunning and representation techniques are built along with deep learning based features such as to distinguish low to high pain emotions among the patients in the third phase of the implementation, (iv) finally, the performance of the proposed system is enhanced using the score fusion techniques applied on the obtained deep pain recognition models for the smart healthcare framework. RESULTS: The performance of the proposed system has been tested using two standard facial pain benchmark databases, the UNBC-McMaster shoulder pain expression archive dataset and the BioVid Heat Pain Dataset, and the results are compared with some existing state-of-the-art methods employed in this research area. CONCLUSIONS: From extensive experiments and comparative studies, it has been concluded that the proposed pain sentiment recognition system performs remarkably well compared to the other pain recognition systems for the smart healthcare framework.<\/jats:p>","DOI":"10.3233\/idt-240548","type":"journal-article","created":{"date-parts":[[2024,9,3]],"date-time":"2024-09-03T15:33:06Z","timestamp":1725377586000},"page":"1855-1877","source":"Crossref","is-referenced-by-count":1,"title":["Analyzing deep textual facial patterns for human pain sentiment recognition system in smart healthcare framework"],"prefix":"10.1177","volume":"18","author":[{"given":"Anay","family":"Ghosh","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, University of Engineering and Management, Kolkata, India"}]},{"given":"Saiyed","family":"Umer","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Aliah University, Kolkata, India"}]},{"given":"Bibhas Chandra","family":"Dhara","sequence":"additional","affiliation":[{"name":"Department of Information Technology, Jadavpur University, Kolkata, India"}]},{"given":"Ranjeet Kumar","family":"Rout","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, National Institute of Technology, Srinagar, J & K, India"}]}],"member":"179","reference":[{"issue":"3","key":"10.3233\/IDT-240548_ref1","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.glohj.2019.07.001","article-title":"Smart healthcare: Making medical care more intelligent","volume":"3","author":"Tian","year":"2019","journal-title":"Global Health Journal."},{"key":"10.3233\/IDT-240548_ref2","doi-asserted-by":"crossref","first-page":"10871","DOI":"10.1109\/ACCESS.2017.2712788","article-title":"A facial-expression monitoring system for improved healthcare in smart cities","volume":"5","author":"Muhammad","year":"2017","journal-title":"IEEE Access."},{"issue":"9245","key":"10.3233\/IDT-240548_ref3","doi-asserted-by":"crossref","first-page":"1867","DOI":"10.1016\/S0140-6736(00)03253-0","article-title":"Challenge of pain in the cognitively impaired","volume":"356","author":"Abu-Saad","year":"2000","journal-title":"Lancet (London, England)."},{"key":"10.3233\/IDT-240548_ref5","doi-asserted-by":"crossref","first-page":"63373","DOI":"10.1109\/ACCESS.2019.2916887","article-title":"Deep multimodal representation learning: A survey","volume":"7","author":"Guo","year":"2019","journal-title":"Ieee Access."},{"issue":"6","key":"10.3233\/IDT-240548_ref7","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/j.iccn.2010.08.007","article-title":"Facial expression and pain in the critically ill non-communicative patient: State of science review","volume":"26","author":"Arif-Rahu","year":"2010","journal-title":"Intensive and Critical Care Nursing."},{"issue":"2","key":"10.3233\/IDT-240548_ref8","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.pmn.2006.02.003","article-title":"Pain assessment in the nonverbal patient: Position statement with clinical practice recommendations","volume":"7","author":"Herr","year":"2006","journal-title":"Pain Management Nursing."},{"issue":"8","key":"10.3233\/IDT-240548_ref9","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1097\/AJP.0000000000000165","article-title":"A debate on the proposition that self-report is the gold standard in assessment of pediatric pain intensity","volume":"31","author":"Twycross","year":"2015","journal-title":"The Clinical Journal of Pain."},{"issue":"4","key":"10.3233\/IDT-240548_ref10","first-page":"439","article-title":"Facial expression of pain: An evolutionary account","volume":"25","author":"Williams","year":"2002","journal-title":"Behav Brain Sci."},{"issue":"3","key":"10.3233\/IDT-240548_ref11","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1111\/j.1365-2788.2010.01254.x","article-title":"Chronic pain in people with an intellectual disability: Under-recognised and under-treated","volume":"54","author":"McGuire","year":"2010","journal-title":"Journal of Intellectual Disability Research."},{"issue":"1","key":"10.3233\/IDT-240548_ref12","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/S0885-3924(02)00530-4","article-title":"Pain assessment in elderly patients with severe dementia","volume":"25","author":"Manfredi","year":"2003","journal-title":"Journal of Pain and Symptom Management."},{"key":"10.3233\/IDT-240548_ref13","doi-asserted-by":"crossref","first-page":"S1","DOI":"10.1097\/AJP.0b013e31802be869","article-title":"An interdisciplinary expert consensus statement on assessment of pain in older persons","volume":"23","author":"Hadjistavropoulos","year":"2007","journal-title":"The Clinical Journal of Pain."},{"issue":"2","key":"10.3233\/IDT-240548_ref14","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1097\/01.CCM.0000108875.35298.D2","article-title":"Pain behaviors observed during six common procedures: Results from Thunder Project II","volume":"32","author":"Puntillo","year":"2004","journal-title":"Critical Care Medicine."},{"issue":"12","key":"10.3233\/IDT-240548_ref15","doi-asserted-by":"crossref","first-page":"2258","DOI":"10.1097\/00003246-200112000-00004","article-title":"Assessing pain in critically ill sedated patients by using a behavioral pain scale","volume":"29","author":"Payen","year":"2001","journal-title":"Critical Care Medicine."},{"issue":"8","key":"10.3233\/IDT-240548_ref16","doi-asserted-by":"crossref","first-page":"5619","DOI":"10.1109\/TII.2022.3141400","article-title":"Impact of deep learning approaches on facial expression recognition in healthcare industries","volume":"18","author":"Bisogni","year":"2022","journal-title":"IEEE Transactions on Industrial Informatics."},{"key":"10.3233\/IDT-240548_ref17","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.measurement.2019.06.008","article-title":"Face recognition using fusion of feature learning techniques","volume":"146","author":"Umer","year":"2019","journal-title":"Measurement."},{"issue":"3","key":"10.3233\/IDT-240548_ref19","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1109\/TSMCB.2010.2082525","article-title":"Recognizing emotion with head pose variation: Identifying pain segments in video","volume":"41","author":"Lucey","year":"2011","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics-Part B."},{"issue":"12","key":"10.3233\/IDT-240548_ref20","doi-asserted-by":"crossref","first-page":"1788","DOI":"10.1016\/j.imavis.2009.05.007","article-title":"The painful face-pain expression recognition using active appearance models","volume":"27","author":"Ashraf","year":"2009","journal-title":"Image and Vision Computing."},{"issue":"11","key":"10.3233\/IDT-240548_ref23","doi-asserted-by":"crossref","first-page":"14680","DOI":"10.3390\/rs71114680","article-title":"Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery","volume":"7","author":"Hu","year":"2015","journal-title":"Remote Sensing."},{"key":"10.3233\/IDT-240548_ref24","unstructured":"Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems. 2012; 25: 1097-105."},{"issue":"12","key":"10.3233\/IDT-240548_ref27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10916-016-0627-x","article-title":"Patient state recognition system for healthcare using speech and facial expressions","volume":"40","author":"Hossain","year":"2016","journal-title":"Journal of Medical Systems."},{"key":"10.3233\/IDT-240548_ref32","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/j.jvcir.2019.03.023","article-title":"Visual data of facial expressions for automatic pain detection","volume":"61","author":"Virrey","year":"2019","journal-title":"Journal of Visual Communication and Image Representation."},{"key":"10.3233\/IDT-240548_ref33","doi-asserted-by":"crossref","first-page":"113305","DOI":"10.1016\/j.eswa.2020.113305","article-title":"Enhanced deep learning algorithm development to detect pain intensity from facial expression images","volume":"149","author":"Bargshady","year":"2020","journal-title":"Expert Systems with Applications."},{"issue":"17","key":"10.3233\/IDT-240548_ref34","doi-asserted-by":"crossref","first-page":"5984","DOI":"10.3390\/app10175984","article-title":"Deep-learning-based models for pain recognition: A systematic review","volume":"10","author":"M Al-Eidan","year":"2020","journal-title":"Applied Sciences."},{"issue":"4","key":"10.3233\/IDT-240548_ref35","doi-asserted-by":"crossref","first-page":"2901","DOI":"10.1007\/s10586-020-03055-9","article-title":"A new method of emotional analysis based on CNN-BiLSTM hybrid neural network","volume":"23","author":"Liu","year":"2020","journal-title":"Cluster Computing."},{"issue":"4","key":"10.3233\/IDT-240548_ref36","doi-asserted-by":"crossref","first-page":"2969","DOI":"10.1007\/s10586-020-03062-w","article-title":"A comparative study on bio-inspired algorithms for sentiment analysis","volume":"23","author":"Yadav","year":"2020","journal-title":"Cluster Computing."},{"issue":"14","key":"10.3233\/IDT-240548_ref38","doi-asserted-by":"crossref","first-page":"4838","DOI":"10.3390\/s21144838","article-title":"Comparison of feature extraction methods for physiological signals for heat-based pain recognition","volume":"21","author":"Gouverneur","year":"2021","journal-title":"Sensors."},{"issue":"6","key":"10.3233\/IDT-240548_ref39","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1159\/000526209","article-title":"Audio feature analysis for acoustic pain detection in term newborns","volume":"119","author":"Giordano","year":"2022","journal-title":"Neonatology."},{"issue":"4","key":"10.3233\/IDT-240548_ref42","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1145\/2951024","article-title":"Convolutional neural networks: An illustration in TensorFlow","volume":"22","author":"Saxena","year":"2016","journal-title":"XRDS: Crossroads, The ACM Magazine for Students."},{"issue":"2","key":"10.3233\/IDT-240548_ref43","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/34.908962","article-title":"Recognizing action units for facial expression analysis","volume":"23","author":"Tian","year":"2001","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence."},{"issue":"19","key":"10.3233\/IDT-240548_ref44","doi-asserted-by":"crossref","first-page":"9174","DOI":"10.3390\/app11199174","article-title":"A unified framework of deep learning-based facial expression recognition system for diversified applications","volume":"11","author":"Hossain","year":"2021","journal-title":"Applied Sciences."},{"issue":"10","key":"10.3233\/IDT-240548_ref48","doi-asserted-by":"crossref","first-page":"4291","DOI":"10.1109\/TNNLS.2020.3019893","article-title":"Attention in natural language processing","volume":"32","author":"Galassi","year":"2020","journal-title":"IEEE Transactions on Neural Networks and Learning Systems."},{"issue":"11","key":"10.3233\/IDT-240548_ref49","doi-asserted-by":"crossref","first-page":"1875","DOI":"10.1109\/TMM.2015.2477044","article-title":"Describing multimedia content using attention-based encoder-decoder networks","volume":"17","author":"Cho","year":"2015","journal-title":"IEEE Transactions on Multimedia."},{"issue":"1","key":"10.3233\/IDT-240548_ref51","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/72.554195","article-title":"Face recognition: A convolutional neural-network approach","volume":"8","author":"Lawrence","year":"1997","journal-title":"IEEE Transactions on Neural Networks."},{"issue":"2","key":"10.3233\/IDT-240548_ref57","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1080\/02564602.2016.1265904","article-title":"An iris recognition system based on analysis of textural edgeness descriptors","volume":"35","author":"Umer","year":"2018","journal-title":"IETE Technical Review."},{"key":"10.3233\/IDT-240548_ref60","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.cogsys.2019.10.004","article-title":"Inception and ResNet features are (almost) equivalent","volume":"59","author":"McNeely-White","year":"2020","journal-title":"Cognitive Systems Research."},{"issue":"3","key":"10.3233\/IDT-240548_ref61","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1109\/TAFFC.2016.2537327","article-title":"Automatic pain assessment with facial activity descriptors","volume":"8","author":"Werner","year":"2016","journal-title":"IEEE Transactions on Affective Computing."},{"key":"10.3233\/IDT-240548_ref63","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.patrec.2022.09.022","article-title":"Imbalanced regression for intensity series of pain expression from videos by regularizing spatio-temporal face nets","volume":"163","author":"Xiang","year":"2022","journal-title":"Pattern Recognition Letters."}],"container-title":["Intelligent Decision Technologies"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDT-240548","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,11]],"date-time":"2025-03-11T08:32:34Z","timestamp":1741681954000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDT-240548"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,16]]},"references-count":37,"journal-issue":{"issue":"3"},"URL":"https:\/\/doi.org\/10.3233\/idt-240548","relation":{},"ISSN":["1872-4981","1875-8843"],"issn-type":[{"value":"1872-4981","type":"print"},{"value":"1875-8843","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,16]]}}}