{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T20:58:19Z","timestamp":1776891499910,"version":"3.51.2"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,1,6]],"date-time":"2020-01-06T00:00:00Z","timestamp":1578268800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,1,6]],"date-time":"2020-01-06T00:00:00Z","timestamp":1578268800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Sentiment analysis is recognized as one of the most important sub-areas in Natural Language Processing (NLP) research, where understanding implicit or explicit sentiments expressed in social media contents is valuable to customers, business owners, and other stakeholders. Researchers have recognized that the generic sentiments extracted from the textual contents are inadequate, thus, Aspect Based Sentiment Analysis (ABSA) was coined to capture aspect sentiments expressed toward specific <jats:italic>review aspects<\/jats:italic>. Existing ABSA methods not only treat the analytical problem as single-label classification that requires a fairly large amount of labelled data for model training purposes, but also underestimate the <jats:italic>entity aspects<\/jats:italic> that are independent of certain sentiments. In this study, we propose a transfer learning based approach tackling the aforementioned shortcomings of existing ABSA methods. Firstly, the proposed approach extends the ABSA methods with multi-label classification capabilities. Secondly, we propose an advanced sentiment analysis method, namely Aspect Enhanced Sentiment Analysis (AESA) to classify text into sentiment classes with consideration of the entity aspects. Thirdly, we extend two state-of-the-art transfer learning models as the analytical vehicles of multi-label ABSA and AESA tasks. We design an experiment that includes data from different domains to extensively evaluate the proposed approach. The empirical results undoubtedly exhibit that the proposed approach outperform all the baseline approaches.<\/jats:p>","DOI":"10.1186\/s40537-019-0278-0","type":"journal-article","created":{"date-parts":[[2020,1,6]],"date-time":"2020-01-06T08:02:35Z","timestamp":1578297755000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":201,"title":["Toward multi-label sentiment analysis: a transfer learning based approach"],"prefix":"10.1186","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8958-561X","authenticated-orcid":false,"given":"Jie","family":"Tao","sequence":"first","affiliation":[]},{"given":"Xing","family":"Fang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,1,6]]},"reference":[{"issue":"1","key":"278_CR1","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1186\/s40537-015-0015-2","volume":"2","author":"X Fang","year":"2015","unstructured":"Fang X, Zhan J. Sentiment analysis using product review data. J Big Data. 2015;2(1):5.","journal-title":"J Big Data"},{"issue":"5","key":"278_CR2","doi-asserted-by":"publisher","first-page":"993","DOI":"10.1007\/s10796-017-9741-7","volume":"19","author":"Y Choi","year":"2017","unstructured":"Choi Y, Lee H. Data properties and the performance of sentiment classification for electronic commerce applications. Inf Syst Front. 2017;19(5):993\u20131012.","journal-title":"Inf Syst Front"},{"key":"278_CR3","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/j.dss.2016.11.001","volume":"94","author":"S Deng","year":"2017","unstructured":"Deng S, Sinha AP, Zhao H. Adapting sentiment lexicons to domain-specific social media texts. Decis Support Syst. 2017;94:65\u201376.","journal-title":"Decis Support Syst"},{"key":"278_CR4","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.knosys.2018.04.006","volume":"152","author":"G Lee","year":"2018","unstructured":"Lee G, Jeong J, Seo S, Kim C, Kang P. Sentiment classification with word localization based on weakly supervised learning with a convolutional neural network. Knowl Based Syst. 2018;152:70\u201382.","journal-title":"Knowl Based Syst"},{"key":"278_CR5","doi-asserted-by":"crossref","unstructured":"Tao J, Zhou L, Feeney C. I understand what you are saying: leveraging deep learning techniques for aspect based sentiment analysis. In: Proceedings of the 52nd Hawaii international conference on system sciences. IEEE, Maui, Hawaii, USA. University of Hawaii-Manoa. 2019.","DOI":"10.24251\/HICSS.2019.057"},{"key":"278_CR6","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.dss.2018.01.002","volume":"107","author":"M Siering","year":"2018","unstructured":"Siering M, Deokar AV, Janze C. Disentangling consumer recommendations: explaining and predicting airline recommendations based on online reviews. Decis Support Syst. 2018;107:52\u201363.","journal-title":"Decis Support Syst"},{"key":"278_CR7","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1016\/j.knosys.2017.03.020","volume":"125","author":"MS Akhtar","year":"2017","unstructured":"Akhtar MS, Gupta D, Ekbal A, Bhattacharyya P. Feature selection and ensemble construction: a two-step method for aspect based sentiment analysis. Knowl Based Syst. 2017;125:116\u201335.","journal-title":"Knowl Based Syst"},{"issue":"January 2017","key":"278_CR8","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1016\/j.datak.2017.06.001","volume":"114","author":"DH Pham","year":"2018","unstructured":"Pham DH, Le AC. Learning multiple layers of knowledge representation for aspect based sentiment analysis. Data Knowl Eng. 2018;114(January 2017):26\u201339.","journal-title":"Data Knowl Eng"},{"issue":"3","key":"278_CR9","doi-asserted-by":"publisher","first-page":"1083","DOI":"10.1016\/j.eswa.2014.08.036","volume":"42","author":"SM Liu","year":"2015","unstructured":"Liu SM, Chen JH. A multi-label classification based approach for sentiment classification. Expert Syst Appl. 2015;42(3):1083\u201393.","journal-title":"Expert Syst Appl"},{"issue":"2","key":"278_CR10","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1016\/j.im.2016.05.007","volume":"54","author":"Y Kang","year":"2017","unstructured":"Kang Y, Zhou L. RubE: Rule-based methods for extracting product features from online consumer reviews. Inf Manag. 2017;54(2):166\u201376.","journal-title":"Inf Manag"},{"issue":"9","key":"278_CR11","doi-asserted-by":"publisher","first-page":"1757","DOI":"10.1016\/j.patcog.2004.03.009","volume":"37","author":"MR Boutell","year":"2004","unstructured":"Boutell MR, Luo J, Shen X, Brown CM. Learning multi-label scene classification. Pattern Recogn. 2004;37(9):1757\u201371.","journal-title":"Pattern Recogn"},{"key":"278_CR12","unstructured":"Read J, Pfahringer B, Holmes G, Frank E. In: Proceedings of the 20th European conference on machine learning."},{"issue":"7","key":"278_CR13","doi-asserted-by":"publisher","first-page":"1079","DOI":"10.1109\/TKDE.2010.164","volume":"23","author":"G Tsoumakas","year":"2011","unstructured":"Tsoumakas G, Katakis I, Vlahavas I. Random k-labelsets for multilabel classification. IEEE Trans Knowl Data Eng. 2011;23(7):1079\u201389.","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"278_CR14","doi-asserted-by":"crossref","unstructured":"Spyromitros E, Tsoumakas G, Vlahavas I. An empirical study on several classification algorithms. In: Proceedings of the 5th Hellenic conference on artificial intelligence: theories, models, and applications. 2008. pp. 401\u20136.","DOI":"10.1007\/978-3-540-87881-0_40"},{"key":"278_CR15","doi-asserted-by":"publisher","first-page":"2038","DOI":"10.1016\/j.patcog.2006.12.019","volume":"40","author":"M-L Zhang","year":"2007","unstructured":"Zhang M-L, Zhou Z-H. ML-KNN: a lazy learning approach to multi-label learning. Pattern Recogn. 2007;40:2038\u201348.","journal-title":"Pattern Recogn"},{"key":"278_CR16","doi-asserted-by":"crossref","unstructured":"Benites F, Sapozhnikova E. HARAM: a hierarchical ARAM neural network for large-scale text classification. In: Proceedings-15th IEEE international conference on data mining workshop, ICDMW 2015, No. 7. 2016. pp. 847\u201354.","DOI":"10.1109\/ICDMW.2015.14"},{"issue":"9","key":"278_CR17","doi-asserted-by":"publisher","first-page":"3084","DOI":"10.1016\/j.patcog.2012.03.004","volume":"45","author":"G Madjarov","year":"2012","unstructured":"Madjarov G, Kocev D, Gjorgjevikj D, D\u017eeroski S. An extensive experimental comparison of methods for multi-label learning. Pattern Recogn. 2012;45(9):3084\u2013104.","journal-title":"Pattern Recogn"},{"key":"278_CR18","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, van\u00a0der Maaten L, Weinberger KQ. Densely connected convolutional networks. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), IEEE. 2017. pp. 2261\u20139.","DOI":"10.1109\/CVPR.2017.243"},{"key":"278_CR19","unstructured":"Long M, Cao Y, Wang J, Jordan MI. Learning transferable features with deep adaptation networks. In: Proceedings of the 32nd international conference on international conference on machine learning-Vol. 37. JMLR.org. 2015. pp. 97\u2013105."},{"key":"278_CR20","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J. Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems. 2013. pp. 3111\u20139."},{"key":"278_CR21","doi-asserted-by":"crossref","unstructured":"Howard J, Ruder S. Universal language model fine-tuning for text classification. In: Proceedings of the 56th annual meeting of the association for computational linguistics (Vol. 1: Long Papers). 2018. pp. 328\u201339.","DOI":"10.18653\/v1\/P18-1031"},{"key":"278_CR22","unstructured":"Merity S, Xiong C, Bradbury J, Socher R. Pointer sentinel mixture models. In: Proceedings of the international conference on learning representations. 2017."},{"key":"278_CR23","unstructured":"Radford A, Narasimhan K, Salimans T, Sutskever I. Improving language understanding by generative pre-training. Technical report, OpenAI."},{"key":"278_CR24","doi-asserted-by":"crossref","unstructured":"Wang A, Singh A, Michael J, Hill F, Levy O, Bowman SR. Glue: a multi-task benchmark and analysis platform for natural language understanding. arXiv preprint arXiv:1804.07461. 2018.","DOI":"10.18653\/v1\/W18-5446"},{"key":"278_CR25","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1016\/j.eswa.2018.10.003","volume":"118","author":"HH Do","year":"2019","unstructured":"Do HH, Prasad PWC, Maag A, Alsadoon A. Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst Appl. 2019;118:272\u201399.","journal-title":"Expert Syst Appl"},{"key":"278_CR26","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K. Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. 2018."},{"key":"278_CR27","unstructured":"Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov R, Le QV. Xlnet: generalized autoregressive pretraining for language understanding. arXiv preprint arXiv:1906.08237. 2019."},{"key":"278_CR28","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I. Attention is all you need. In: Advances in neural information processing systems. 2017. pp. 5998\u20136008."},{"key":"278_CR29","unstructured":"The Yelp restaurant reviews. https:\/\/www.yelp.com\/dataset\/."},{"key":"278_CR30","unstructured":"ABSA Labelling Schema. http:\/\/alt.qcri.org\/semeval2014\/task4\/data\/uploads\/semeval14_absa_annotationguidelines.pdf."},{"key":"278_CR31","unstructured":"Wine Reviews. https:\/\/www.kaggle.com\/zynicide\/wine-reviews."},{"key":"278_CR32","unstructured":"Movie Reviews. https:\/\/www.kaggle.com\/rpnuser8182\/rotten-tomatoes."},{"issue":"4","key":"278_CR33","doi-asserted-by":"publisher","first-page":"1253","DOI":"10.1002\/widm.1253","volume":"8","author":"L Zhang","year":"2018","unstructured":"Zhang L, Wang S, Liu B. Deep learning for sentiment analysis: a survey. Wiley Interdiscip Rev Data Mining Knowl Discov. 2018;8(4):1253.","journal-title":"Wiley Interdiscip Rev Data Mining Knowl Discov"},{"issue":"8","key":"278_CR34","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735\u201380.","journal-title":"Neural Comput"},{"issue":"1","key":"278_CR35","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1186\/s13635-019-0090-6","volume":"2019","author":"X Fang","year":"2019","unstructured":"Fang X, Xu M, Xu S, Zhao P. A deep learning framework for predicting cyber attacks rates. EURASIP J Inf Secur. 2019;2019(1):5.","journal-title":"EURASIP J Inf Secur"},{"key":"278_CR36","doi-asserted-by":"crossref","unstructured":"Althelaya KA, El-Alfy EM, Mohammed S. Evaluation of bidirectional lstm for short-and long-term stock market prediction. In: 2018 9th international conference on information and communication systems (ICICS). 2018. pp. 151\u20136.","DOI":"10.1109\/IACS.2018.8355458"},{"key":"278_CR37","unstructured":"Cui Z, Ke R, Wang Y. Deep bidirectional and unidirectional lstm recurrent neural network for network-wide traffic speed prediction. arXiv preprint arXiv:1801.02143. 2018."},{"key":"278_CR38","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1016\/j.engappai.2019.07.011","volume":"85","author":"X Fang","year":"2019","unstructured":"Fang X, Yuan Z. Performance enhancing techniques for deep learning models in time series forecasting. Eng Appl Artif Intell. 2019;85:533\u201342.","journal-title":"Eng Appl Artif Intell"},{"key":"278_CR39","doi-asserted-by":"crossref","unstructured":"Lin T, Guo T, Aberer K. Hybrid neural networks for learning the trend in time series. In: Proceedings of the 26th international joint conference on artificial intelligence. AAAI Press. 2017. pp. 2273\u20139.","DOI":"10.24963\/ijcai.2017\/316"},{"key":"278_CR40","unstructured":"Liu J, Zhao K, Kusy B, Wen J-R, Jurdak R. Temporal embedding in convolutional neural networks for robust learning of abstract snippets. arXiv preprint arXiv:1502.05113. 2015."},{"issue":"2","key":"278_CR41","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1080\/07421222.2018.1451956","volume":"35","author":"S Zhou","year":"2018","unstructured":"Zhou S, Qiao Z, Du Q, Wang GA, Fan W, Yan X. Measuring customer agility from online reviews using big data text analytics. J Manag Inf Syst. 2018;35(2):510\u201339.","journal-title":"J Manag Inf Syst"},{"issue":"December 2016","key":"278_CR42","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1016\/j.neucom.2017.01.026","volume":"237","author":"L Zhou","year":"2017","unstructured":"Zhou L, Pan S, Wang J, Vasilakos AV. Machine learning on big data: opportunities and challenges. Neurocomputing. 2017;237(December 2016):350\u201361.","journal-title":"Neurocomputing"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-019-0278-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s40537-019-0278-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-019-0278-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,5]],"date-time":"2021-01-05T00:14:02Z","timestamp":1609805642000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-019-0278-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,6]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["278"],"URL":"https:\/\/doi.org\/10.1186\/s40537-019-0278-0","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,6]]},"assertion":[{"value":"16 October 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 January 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"1"}}