{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T00:13:33Z","timestamp":1773101613044,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,4,12]],"date-time":"2021-04-12T00:00:00Z","timestamp":1618185600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"The Ministry of Trade, Industry &amp; Energy (MI, Korea)","award":["10077553"],"award-info":[{"award-number":["10077553"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Sentiment prediction remains a challenging and unresolved task in various research fields, including psychology, neuroscience, and computer science. This stems from its high degree of subjectivity and limited input sources that can effectively capture the actual sentiment. This can be even more challenging with only text-based input. Meanwhile, the rise of deep learning and an unprecedented large volume of data have paved the way for artificial intelligence to perform impressively accurate predictions or even human-level reasoning. Drawing inspiration from this, we propose a coverage-based sentiment and subsentence extraction system that estimates a span of input text and recursively feeds this information back to the networks. The predicted subsentence consists of auxiliary information expressing a sentiment. This is an important building block for enabling vivid and epic sentiment delivery (within the scope of this paper) and for other natural language processing tasks such as text summarisation and Q&amp;A. Our approach outperforms the state-of-the-art approaches by a large margin in subsentence prediction (i.e., Average Jaccard scores from 0.72 to 0.89). For the evaluation, we designed rigorous experiments consisting of 24 ablation studies. Finally, our learned lessons are returned to the community by sharing software packages and a public dataset that can reproduce the results presented in this paper.<\/jats:p>","DOI":"10.3390\/s21082712","type":"journal-article","created":{"date-parts":[[2021,4,12]],"date-time":"2021-04-12T11:05:06Z","timestamp":1618225506000},"page":"2712","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Subsentence Extraction from Text Using Coverage-Based Deep Learning Language Models"],"prefix":"10.3390","volume":"21","author":[{"given":"JongYoon","family":"Lim","sequence":"first","affiliation":[{"name":"CARES, Department of Electrical, Computer and Software Engineering, University of Auckland, Auckland 1142, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5429-0515","authenticated-orcid":false,"given":"Inkyu","family":"Sa","sequence":"additional","affiliation":[{"name":"CSIRO Data61, Robotics and Autonomous Systems Group, Perception Group, Pullenvale 4069, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ho Seok","family":"Ahn","sequence":"additional","affiliation":[{"name":"CARES, Department of Electrical, Computer and Software Engineering, University of Auckland, Auckland 1142, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7801-7417","authenticated-orcid":false,"given":"Norina","family":"Gasteiger","sequence":"additional","affiliation":[{"name":"CARES, Department of Electrical, Computer and Software Engineering, University of Auckland, Auckland 1142, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6714-0225","authenticated-orcid":false,"given":"Sanghyub John","family":"Lee","sequence":"additional","affiliation":[{"name":"CARES, Department of Electrical, Computer and Software Engineering, University of Auckland, Auckland 1142, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7602-8497","authenticated-orcid":false,"given":"Bruce","family":"MacDonald","sequence":"additional","affiliation":[{"name":"CARES, Department of Electrical, Computer and Software Engineering, University of Auckland, Auckland 1142, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Liu, B., and Zhang, L. (2012). A survey of opinion mining and sentiment analysis. Mining Text Data, Springer.","DOI":"10.1007\/978-1-4614-3223-4_13"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lee, M., Forlizzi, J., Kiesler, S., Rybski, P., Antanitis, J., and Savetsila, S. (2012, January 5\u20138). Personalization in HRI: A Longitudinal Field Experiment. Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction, Boston, MA, USA.","DOI":"10.1145\/2157689.2157804"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"110","DOI":"10.3389\/frobt.2019.00110","article-title":"Long-Term Personalization of an In-Home Socially Assistive Robot for Children With Autism Spectrum Disorders","volume":"6","author":"Clabaugh","year":"2019","journal-title":"Front. Robot. AI"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s11370-017-0237-6","article-title":"The multi-modal interface of Robot-Era multi-robot services tailored for the elderly","volume":"11","author":"Broz","year":"2018","journal-title":"Intell. Serv. Robot."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.pec.2013.04.012","article-title":"Using a robot to personalise health education for children with diabetes type 1: A pilot study","volume":"92","author":"Henkemans","year":"2013","journal-title":"Patient Educ. Couns."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/S0921-8890(02)00372-X","article-title":"A survey of socially interactive robots","volume":"42","author":"Fong","year":"2003","journal-title":"Robot. Auton. Syst."},{"key":"ref_7","first-page":"1","article-title":"Text-based emotion detection: Advances, challenges, and opportunities","volume":"2","author":"Acheampong","year":"2020","journal-title":"Eng. Rep."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ahn, H.S., Lee, D.W., Choi, D., Lee, D.Y., Hur, M., and Lee, H. (2012, January 14\u201317). Uses of facial expressions of android head system according to gender and age. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Seoul, Korea.","DOI":"10.1109\/ICSMC.2012.6378084"},{"key":"ref_9","unstructured":"Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., and Askell, A. (2020). Language models are few-shot learners. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Pennington, J., Socher, R., and Manning, C.D. (2014, January 25\u201329). Glove: Global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1162"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1162\/tacl_a_00065","article-title":"Google\u2019s multilingual neural machine translation system: Enabling zero-shot translation","volume":"5","author":"Johnson","year":"2017","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Cui, Y., Chen, Z., Wei, S., Wang, S., Liu, T., and Hu, G. (2016). Attention-over-attention neural networks for reading comprehension. arXiv.","DOI":"10.18653\/v1\/P17-1055"},{"key":"ref_13","first-page":"635","article-title":"A literature review on question answering techniques, paradigms and systems","volume":"32","author":"Soares","year":"2020","journal-title":"J. King Saud Univ. Comput. Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Rajpurkar, P., Jia, R., and Liang, P. (2018). Know what you do not know: Unanswerable questions for SQuAD. arXiv.","DOI":"10.18653\/v1\/P18-2124"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Rajpurkar, P., Zhang, J., Lopyrev, K., and Liang, P. (2016). Squad: 100,000+ questions for machine comprehension of text. arXiv.","DOI":"10.18653\/v1\/D16-1264"},{"key":"ref_16","unstructured":"Zhou, W., Zhang, X., and Jiang, H. (2019). Ensemble BERT with Data Augmentation and Linguistic Knowledge on SQuAD 2.0. Tech. Rep."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., and Bowman, S.R. (2018). GLUE: A multi-task benchmark and analysis platform for natural language understanding. arXiv.","DOI":"10.18653\/v1\/W18-5446"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lai, G., Xie, Q., Liu, H., Yang, Y., and Hovy, E. (2017). Race: Large-scale reading comprehension dataset from examinations. arXiv.","DOI":"10.18653\/v1\/D17-1082"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1108\/01435121111132365","article-title":"Introduction to Modern Information Retrieval","volume":"32","author":"Crnic","year":"2011","journal-title":"Libr. Manag."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Cambria, E., Das, D., Bandyopadhyay, S., and Feraco, A. (2017). Affective computing and sentiment analysis. A Practical Guide to Sentiment Analysis, Springer.","DOI":"10.1007\/978-3-319-55394-8"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kanakaraj, M., and Guddeti, R.M.R. (2015, January 7\u20139). Performance analysis of Ensemble methods on Twitter sentiment analysis using NLP techniques. Proceedings of the 2015 IEEE 9th International Conference on Semantic Computing (IEEE ICSC 2015), Anaheim, CA, USA.","DOI":"10.1109\/ICOSC.2015.7050801"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Guo, X., and Li, J. (2019, January 22\u201325). A novel twitter sentiment analysis model with baseline correlation for financial market prediction with improved efficiency. Proceedings of the Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS), Granada, Spain.","DOI":"10.1109\/SNAMS.2019.8931720"},{"key":"ref_23","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_24","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Szab\u00f3ov\u00e1, M., Sarnovsk\u00fd, M., Maslej Kre\u0161\u0148\u00e1kov\u00e1, V., and Machov\u00e1, K. (2020). Emotion Analysis in Human\u2013Robot Interaction. Electronics, 9.","DOI":"10.3390\/electronics9111761"},{"key":"ref_26","first-page":"3562","article-title":"SentiSense: An easily scalable concept-based affective lexicon for sentiment analysis","volume":"12","author":"Plaza","year":"2012","journal-title":"LREC"},{"key":"ref_27","first-page":"344","article-title":"Expression and the nature of emotion","volume":"3","author":"Ekman","year":"1984","journal-title":"Approaches Emot."},{"key":"ref_28","first-page":"117","article-title":"The concept of mood in psychology","volume":"19","author":"Donnet","year":"1993","journal-title":"L\u2019encephale"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/S1071-5819(03)00018-1","article-title":"Emotion and sociable humanoid robots","volume":"59","author":"Breazeal","year":"2003","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Striepe, H., and Lugrin, B. (2017). There once was a robot storyteller: Measuring the effects of emotion and non-verbal behaviour. International Conference on Social Robotics, Proceedings of the 9th International Conference, ICSR 2017, Tsukuba, Japan, 22\u201324 November 2017, Springer.","DOI":"10.1007\/978-3-319-70022-9_13"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shen, J., Rudovic, O., Cheng, S., and Pantic, M. (2015, January 21\u201324). Sentiment apprehension in human\u2013robot interaction with NAO. Proceedings of the International Conference on Affective Computing and Intelligent Interaction (ACII), Xi\u2019an, China.","DOI":"10.1109\/ACII.2015.7344676"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Bae, B.C., Brunete, A., Malik, U., Dimara, E., Jermsurawong, J., and Mavridis, N. (2012, January 8\u201312). Towards an empathizing and adaptive storyteller system. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Stanford, CA, USA.","DOI":"10.1609\/aiide.v8i2.12532"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Rodriguez, I., Mart\u00ednez-Otzeta, J.M., Lazkano, E., and Ruiz, T. (2017). Adaptive emotional chatting behavior to increase the sociability of robots. International Conference on Social Robotics, Proceedings of the 9th International Conference, ICSR 2017, Tsukuba, Japan, 22\u201324 November 2017, Springer.","DOI":"10.1007\/978-3-319-70022-9_66"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Paradeda, R., Ferreira, M.J., Martinho, C., and Paiva, A. (2018). Would You Follow the Suggestions of a Storyteller Robot?. International Conference on Interactive Digital Storytelling, Proceedings of the 11th International Conference on Interactive Digital Storytelling, ICIDS 2018, Dublin, Ireland, 5\u20138 December 2018, Springer.","DOI":"10.1007\/978-3-030-04028-4_57"},{"key":"ref_35","unstructured":"Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017). Attention is All you Need. Advances in Neural Information Processing Systems 30, Curran Associates, Inc."},{"key":"ref_36","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wallace, E., Wang, Y., Li, S., Singh, S., and Gardner, M. (2019). Do nlp models know numbers? probing numeracy in embeddings. arXiv.","DOI":"10.18653\/v1\/D19-1534"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sennrich, R., Haddow, B., and Birch, A. (2015). Neural machine translation of rare words with subword units. arXiv.","DOI":"10.18653\/v1\/P16-1162"},{"key":"ref_39","unstructured":"Goodfellow, I., Bengio, Y., Courville, A., and Bengio, Y. (2016). Deep Learning, MIT Press."},{"key":"ref_40","first-page":"85","article-title":"Visualizing data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"e1249","DOI":"10.1002\/widm.1249","article-title":"Ensemble learning: A survey","volume":"8","author":"Sagi","year":"2018","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/8\/2712\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:59:46Z","timestamp":1760363986000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/8\/2712"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,12]]},"references-count":41,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["s21082712"],"URL":"https:\/\/doi.org\/10.3390\/s21082712","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,12]]}}}