{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T20:27:21Z","timestamp":1777148841109,"version":"3.51.4"},"reference-count":38,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2024,4,25]],"date-time":"2024-04-25T00:00:00Z","timestamp":1714003200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"\u201cA way of making Europe\u201d European Regional Development Fund (ERDF)","award":["TED2021-130890B-C21"],"award-info":[{"award-number":["TED2021-130890B-C21"]}]},{"name":"\u201cA way of making Europe\u201d European Regional Development Fund (ERDF)","award":["CIACIF\/2022\/175"],"award-info":[{"award-number":["CIACIF\/2022\/175"]}]},{"name":"\u201cA way of making Europe\u201d European Regional Development Fund (ERDF)","award":["AII23-12"],"award-info":[{"award-number":["AII23-12"]}]},{"name":"Valencian government and International Center for Aging Research ICAR","award":["TED2021-130890B-C21"],"award-info":[{"award-number":["TED2021-130890B-C21"]}]},{"name":"Valencian government and International Center for Aging Research ICAR","award":["CIACIF\/2022\/175"],"award-info":[{"award-number":["CIACIF\/2022\/175"]}]},{"name":"Valencian government and International Center for Aging Research ICAR","award":["AII23-12"],"award-info":[{"award-number":["AII23-12"]}]},{"name":"Valencian government grant for PhD studies","award":["TED2021-130890B-C21"],"award-info":[{"award-number":["TED2021-130890B-C21"]}]},{"name":"Valencian government grant for PhD studies","award":["CIACIF\/2022\/175"],"award-info":[{"award-number":["CIACIF\/2022\/175"]}]},{"name":"Valencian government grant for PhD studies","award":["AII23-12"],"award-info":[{"award-number":["AII23-12"]}]},{"name":"University of Alicante","award":["TED2021-130890B-C21"],"award-info":[{"award-number":["TED2021-130890B-C21"]}]},{"name":"University of Alicante","award":["CIACIF\/2022\/175"],"award-info":[{"award-number":["CIACIF\/2022\/175"]}]},{"name":"University of Alicante","award":["AII23-12"],"award-info":[{"award-number":["AII23-12"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This study presents a pioneering approach that leverages advanced sensing technologies and data processing techniques to enhance the process of clinical documentation generation during medical consultations. By employing sophisticated sensors to capture and interpret various cues such as speech patterns, intonations, or pauses, the system aims to accurately perceive and understand patient\u2013doctor interactions in real time. This sensing capability allows for the automation of transcription and summarization tasks, facilitating the creation of concise and informative clinical documents. Through the integration of automatic speech recognition sensors, spoken dialogue is seamlessly converted into text, enabling efficient data capture. Additionally, deep models such as Transformer models are utilized to extract and analyze crucial information from the dialogue, ensuring that the generated summaries encapsulate the essence of the consultations accurately. Despite encountering challenges during development, experimentation with these sensing technologies has yielded promising results. The system achieved a maximum ROUGE-1 metric score of 0.57, demonstrating its effectiveness in summarizing complex medical discussions. This sensor-based approach aims to alleviate the administrative burden on healthcare professionals by automating documentation tasks and safeguarding important patient information. Ultimately, by enhancing the efficiency and reliability of clinical documentation, this innovative method contributes to improving overall healthcare outcomes.<\/jats:p>","DOI":"10.3390\/s24092751","type":"journal-article","created":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T03:23:47Z","timestamp":1714101827000},"page":"2751","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Automated Generation of Clinical Reports Using Sensing Technologies with Deep Learning Techniques"],"prefix":"10.3390","volume":"24","author":[{"given":"Celia","family":"Cabello-Collado","sequence":"first","affiliation":[{"name":"Department of Computer Technology, University of Alicante, 03080 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0241-5221","authenticated-orcid":false,"given":"Javier","family":"Rodriguez-Juan","sequence":"additional","affiliation":[{"name":"Department of Computer Technology, University of Alicante, 03080 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-4890-8217","authenticated-orcid":false,"given":"David","family":"Ortiz-Perez","sequence":"additional","affiliation":[{"name":"Department of Computer Technology, University of Alicante, 03080 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7798-3055","authenticated-orcid":false,"given":"Jose","family":"Garcia-Rodriguez","sequence":"additional","affiliation":[{"name":"Department of Computer Technology, University of Alicante, 03080 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3287-9366","authenticated-orcid":false,"given":"David","family":"Tom\u00e1s","sequence":"additional","affiliation":[{"name":"Department of Computer Languages, University of Alicante, 03080 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8826-9877","authenticated-orcid":false,"given":"Maria Flores","family":"Vizcaya-Moreno","sequence":"additional","affiliation":[{"name":"Unit of Clinical Nursing Research, Faculty of Health Sciences, University of Alicante, 03080 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,4,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"171","DOI":"10.2147\/LRA.S240564","article-title":"Burnout in Healthcare Workers: Prevalence, Impact and Preventative Strategies","volume":"13","author":"Hert","year":"2020","journal-title":"Local Reg. Anesth."},{"key":"ref_2","first-page":"1","article-title":"Burnout of healthcare providers during COVID-19","volume":"91","author":"Bradley","year":"2020","journal-title":"Clevel. Clin. J. Med."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1016\/j.rce.2020.02.002","article-title":"S\u00edndrome de quemarse por el trabajo (burnout) en los m\u00e9dicos de Espa\u00f1a","volume":"220","author":"Bouza","year":"2020","journal-title":"Rev. Cl\u00ednica Espa\u00f1ola"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3713","DOI":"10.1007\/s11042-022-13428-4","article-title":"Natural language processing: State of the art, current trends and challenges","volume":"82","author":"Khurana","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Srinivasan, S. (2018). Guide to Big Data Applications, Springer International Publishing.","DOI":"10.1007\/978-3-319-53817-4"},{"key":"ref_6","first-page":"2515","article-title":"The survey: Text generation models in deep learning","volume":"34","author":"Iqbal","year":"2022","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/s40537-022-00561-y","article-title":"Part of speech tagging: A systematic review of deep learning and machine learning approaches","volume":"9","author":"Chiche","year":"2022","journal-title":"J. Big Data"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/s13278-021-00776-6","article-title":"A review on sentiment analysis and emotion detection from text","volume":"11","author":"Nandwani","year":"2021","journal-title":"Soc. Netw. Anal. Min."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"113679","DOI":"10.1016\/j.eswa.2020.113679","article-title":"Automatic text summarization: A comprehensive survey","volume":"165","author":"Salama","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Iannizzotto, G., Bello, L.L., Nucita, A., and Grasso, G.M. (2018, January 4\u20136). A Vision and Speech Enabled, Customizable, Virtual Assistant for Smart Environments. Proceedings of the 2018 11th International Conference on Human System Interaction (HSI), Gdansk, Poland.","DOI":"10.1109\/HSI.2018.8431232"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1145\/3557894","article-title":"Improving Readability for Automatic Speech Recognition Transcription","volume":"22","author":"Liao","year":"2023","journal-title":"ACM Trans. Asian-Low-Resour. Lang. Inf. Process."},{"key":"ref_12","unstructured":"Jin, H., Zhang, Y., Meng, D., Wang, J., and Tan, J. (2024). A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Collins, E., Augenstein, I., and Riedel, S. (2017). A Supervised Approach to Extractive Summarisation of Scientific Papers. arXiv.","DOI":"10.18653\/v1\/K17-1021"},{"key":"ref_14","unstructured":"Fang, Y., Zhu, H., Muszy\u0144ska, E., Kuhnle, A., and Teufel, S. (2016, January 11\u201316). A Proposition-Based Abstractive Summariser. Proceedings of the 26th International Conference on Computational Linguistics (COLING 2016), Osaka, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wu, P., Zhou, Q., Lei, Z., Qiu, W., and Li, X. (2018, January 16\u201317). Template Oriented Text Summarization via Knowledge Graph. Proceedings of the 2018 International Conference on Audio, Language and Image Processing (ICALIP), Shanghai, China.","DOI":"10.1109\/ICALIP.2018.8455241"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3419106","article-title":"Neural Abstractive Text Summarization with Sequence-to-Sequence Models","volume":"2","author":"Shi","year":"2021","journal-title":"ACM\/IMS Trans. Data Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"18603","DOI":"10.1007\/s00521-023-08687-7","article-title":"An abstractive text summarization technique using transformer model with self-attention mechanism","volume":"35","author":"Kumar","year":"2023","journal-title":"Neural Comput. Appl."},{"key":"ref_18","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2023). Attention Is All You Need. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.pec.2013.04.019","article-title":"Data-to-text summarisation of patient records: Using computer-generated summaries to access patient histories","volume":"92","author":"Scott","year":"2013","journal-title":"Patient Educ. Couns."},{"key":"ref_20","unstructured":"Del-Agua, M., and Jancsary, J. (2024, March 22). Ambient Clinical Intelligence: Generating Medical Reports with PyTorch. Available online: https:\/\/pytorch.org\/blog\/ambient-clinical-intelligence-generating-medical-reports-with-pytorch\/."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ben Abacha, A., Yim, W.W., Fan, Y., and Lin, T. (2023, January 2\u20136). An Empirical Study of Clinical Note Generation from Doctor-Patient Encounters. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, Dubrovnik, Croatia.","DOI":"10.18653\/v1\/2023.eacl-main.168"},{"key":"ref_22","unstructured":"Grambow, C., Zhang, L., and Schaaf, T. (2022, January 18). In-Domain Pre-Training Improves Clinical Note Generation from Doctor-Patient Conversations. Proceedings of the First Workshop on Natural Language Generation in Healthcare, Waterville, ME, USA."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MSP.2012.2205597","article-title":"Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups","volume":"29","author":"Hinton","year":"2012","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.patrec.2017.05.027","article-title":"A robotic platform for customized and interactive rehabilitation of persons with disabilities","volume":"99","author":"Cazorla","year":"2017","journal-title":"Pattern Recognit. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Metallinou, A., Lee, S., and Narayanan, S. (2008, January 15\u201317). Audio-Visual Emotion Recognition Using Gaussian Mixture Models for Face and Voice. Proceedings of the 2008 Tenth IEEE International Symposium on Multimedia, Berkeley, CA, USA.","DOI":"10.1109\/ISM.2008.40"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Han, W., Zhang, Z., Zhang, Y., Yu, J., Chiu, C.C., Qin, J., Gulati, A., Pang, R., and Wu, Y. (2020). ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context. arXiv.","DOI":"10.21437\/Interspeech.2020-2059"},{"key":"ref_27","unstructured":"Radford, A., Kim, J.W., Xu, T., Brockman, G., McLeavey, C., and Sutskever, I. (2022). Robust Speech Recognition via Large-Scale Weak Supervision. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1109\/RBME.2020.3006860","article-title":"Speech Technology for Healthcare: Opportunities, Challenges, and State of the Art","volume":"14","author":"Latif","year":"2021","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_29","unstructured":"Latif, S., Rana, R., and Qadir, J. (2018). Adversarial Machine Learning And Speech Emotion Recognition: Utilizing Generative Adversarial Networks For Robustness. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., and Funtowicz, M. (2020). HuggingFace\u2019s Transformers: State-of-the-art Natural Language Processing. arXiv.","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"ref_31","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv."},{"key":"ref_32","unstructured":"Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., and Sutskever, I. (2024, March 22). Language Models are Unsupervised Multitask Learners; 2019. Available online: https:\/\/paperswithcode.com\/paper\/language-models-are-unsupervised-multitask."},{"key":"ref_33","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv."},{"key":"ref_34","unstructured":"Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., and Artzi, Y. (2020, January 30). BERTScore: Evaluating Text Generation with BERT. Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia."},{"key":"ref_35","unstructured":"Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., and Askell, A. (2020). Language Models are Few-Shot Learners. arXiv."},{"key":"ref_36","unstructured":"OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., and Altman, S. (2024). GPT-4 Technical Report. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., and Zettlemoyer, L. (2019). BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. arXiv.","DOI":"10.18653\/v1\/2020.acl-main.703"},{"key":"ref_38","unstructured":"Beltagy, I., Peters, M.E., and Cohan, A. (2020). Longformer: The Long-Document Transformer. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/9\/2751\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:33:22Z","timestamp":1760106802000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/9\/2751"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,25]]},"references-count":38,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["s24092751"],"URL":"https:\/\/doi.org\/10.3390\/s24092751","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,25]]}}}