{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:19:53Z","timestamp":1740122393680,"version":"3.37.3"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2020,7,27]],"date-time":"2020-07-27T00:00:00Z","timestamp":1595808000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,7,27]],"date-time":"2020-07-27T00:00:00Z","timestamp":1595808000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100008868","name":"Jiangsu Science and Technology Department","doi-asserted-by":"crossref","award":["Grant No.BE2017081"],"award-info":[{"award-number":["Grant No.BE2017081"]}],"id":[{"id":"10.13039\/501100008868","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cluster Comput"],"published-print":{"date-parts":[[2020,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Cluster computing technologies are rapidly advancing and user-generated online reviews are booming in the current Internet and e-commerce environment. The latest question\u2013answering (Q&amp;A)-style reviews are novel, abundant and easily digestible product reviews that also contain massive valuable information for customers. In this paper, we mine valuable aspect information of products contained in these reviews on GPU clusters. To achieve this goal, we utilize two subtasks of aspect-based sentiment analysis: aspect term extraction (ATE) and aspect category classification (ACC). Most previous works focused on only one task or solved these two tasks separately, even though they are highly interrelated, and they do not make full use of abundant training resources. To address this problem, we propose a novel multi-task neural learning model to jointly handle these two tasks and explore the performance of our model on GPU clusters. We conducted extensive comparative experiments on an annotated corpus and found that our proposed model outperforms several baseline models in ATE and ACC tasks on GPU clusters, yielding significant strides in data mining for these types of reviews.<\/jats:p>","DOI":"10.1007\/s10586-020-03160-9","type":"journal-article","created":{"date-parts":[[2020,7,27]],"date-time":"2020-07-27T08:02:30Z","timestamp":1595836950000},"page":"1973-1986","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Multi-task learning based on question\u2013answering style reviews for aspect category classification and aspect term extraction on GPU clusters"],"prefix":"10.1007","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1215-8919","authenticated-orcid":false,"given":"Hanqian","family":"Wu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siliang","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhike","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shangbin","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Feng","family":"Yuan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,7,27]]},"reference":[{"issue":"1","key":"3160_CR1","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1007\/s41019-019-0088-6","volume":"4","author":"M Alam","year":"2019","unstructured":"Alam, M., Perumalla, K.S., Sanders, P.: Novel parallel algorithms for fast multi-gpu-based generation of massive scale-free networks. Data Sci. Eng. 4(1), 61\u201375 (2019). https:\/\/doi.org\/10.1007\/s41019-019-0088-6","journal-title":"Data Sci. Eng."},{"key":"3160_CR2","doi-asserted-by":"crossref","unstructured":"Brychc\u00edn, T., Konkol, M., Steinberger, J.: Uwb: machine learning approach to aspect-based sentiment analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 817\u2013822 (2014)","DOI":"10.3115\/v1\/S14-2145"},{"key":"3160_CR3","unstructured":"Buck, I., Hanrahan, P.: Data parallel computation on graphics hardware. unpublished report, Jan (2003)"},{"key":"3160_CR4","unstructured":"Coates, A., Huval, B., Wang, T., Wu, D.J., Catanzaro, B., Ng, A.Y.: Deep learning with COTS HPC systems. In: Proceedings of the 30th International Conference on Machine Learning, ICML 2013, Atlanta, GA, USA, 16-21 June 2013, pp. 1337\u20131345 (2013). http:\/\/proceedings.mlr.press\/v28\/coates13.html"},{"key":"3160_CR5","unstructured":"Dean, J., Corrado, G., Monga, R., Chen, K., Devin, M., Le, Q.V., Mao, M.Z., Ranzato, M., Senior, A.W., Tucker, P.A., Yang, K., Ng, A.Y.: Large scale distributed deep networks. In: Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held December 3-6, 2012, Lake Tahoe, Nevada, United States, pp. 1232\u20131240 (2012). http:\/\/papers.nips.cc\/paper\/4687-large-scale-distributed-deep-networks"},{"key":"3160_CR6","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2019.2921821","author":"D Du","year":"2019","unstructured":"Du, D., Zhang, C., Song, Y., Zhou, H., Li, X., Fei, M., Li, W.: Real-time h control of networked inverted pendulum visual servo systems. IEEE Trans. Cybern. (2019). https:\/\/doi.org\/10.1109\/TCYB.2019.2921821","journal-title":"IEEE Trans. Cybern."},{"key":"3160_CR7","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-019-03037-6","author":"X Geng","year":"2020","unstructured":"Geng, X., Zhang, H., Zhao, Z., Ma, H.: Interference-aware parallelization for deep learning workload in gpu cluster. Clust. Comput. (2020). https:\/\/doi.org\/10.1007\/s10586-019-03037-6","journal-title":"Clust. Comput."},{"key":"3160_CR8","doi-asserted-by":"crossref","unstructured":"Gholami, A., Azad, A., Jin, P., Keutzer, K., Buluc, A.: Integrated model, batch, and domain parallelism in training neural networks. In: Proceedings of the 30th on Symposium on Parallelism in Algorithms and Architectures, pp. 77\u201386 (2018)","DOI":"10.1145\/3210377.3210394"},{"key":"3160_CR9","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2936847","author":"X Hong","year":"2019","unstructured":"Hong, X., Li, H., Miller, P., Zhou, J., Li, L., Crookes, D., Lu, Y., Li, X., Zhou, H.: Component-based feature saliency for clustering. IEEE Trans. Knowl. Data Eng. (2019). https:\/\/doi.org\/10.1109\/TKDE.2019.2936847","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"3160_CR10","doi-asserted-by":"publisher","unstructured":"Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, Washington, USA, August 22-25, 2004, pp. 168\u2013177 (2004). https:\/\/doi.org\/10.1145\/1014052.1014073","DOI":"10.1145\/1014052.1014073"},{"key":"3160_CR11","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-020-03144-9","author":"Y Kim","year":"2020","unstructured":"Kim, Y., Choi, H., Lee, J., Kim, J.S., Jei, H., Roh, H.: Towards an optimized distributed deep learning framework for a heterogeneous multi-gpu cluster. Clust. Comput. (2020). https:\/\/doi.org\/10.1007\/s10586-020-03144-9","journal-title":"Clust. Comput."},{"key":"3160_CR12","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-019-02974-6","author":"Y Kim","year":"2019","unstructured":"Kim, Y., Lee, J., Kim, J.S., Jei, H., Roh, H.: Comprehensive techniques of multi-gpu memory optimization for deep learning acceleration. Clust. Comput. (2019). https:\/\/doi.org\/10.1007\/s10586-019-02974-6","journal-title":"Clust. Comput."},{"key":"3160_CR13","doi-asserted-by":"crossref","unstructured":"Kiritchenko, S., Zhu, X., Cherry, C., Mohammad, S.: Nrc-canada-2014: detecting aspects and sentiment in customer reviews. In: Proceedings of the 8th International Workshop on Semantic Evaluation, SemEval@COLING 2014, Dublin, Ireland, August 23-24, 2014, pp. 437\u2013442 (2014). https:\/\/www.aclweb.org\/anthology\/S14-2076\/","DOI":"10.3115\/v1\/S14-2076"},{"key":"3160_CR14","unstructured":"Krizhevsky, A.: One weird trick for parallelizing convolutional neural networks. CoRR arXiv:1404.5997 (2014)"},{"key":"3160_CR15","unstructured":"Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held December 3-6, 2012, Lake Tahoe, Nevada, United States, pp. 1106\u20131114 (2012). http:\/\/papers.nips.cc\/paper\/4824-imagenet-classification-with-deep-convolutional-neural-networks"},{"key":"3160_CR16","unstructured":"Lafferty, J.D., McCallum, A., Pereira, F.C.N.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001), Williams College, Williamstown, MA, USA, June 28 - July 1, 2001, pp. 282\u2013289 (2001)"},{"key":"3160_CR17","unstructured":"Li, F., Han, C., Huang, M., Zhu, X., Xia, Y., Zhang, S., Yu, H.: Structure-aware review mining and summarization. In: COLING 2010, 23rd International Conference on Computational Linguistics, Proceedings of the Conference, 23-27 August 2010, Beijing, China, pp. 653\u2013661 (2010). https:\/\/www.aclweb.org\/anthology\/C10-1074\/"},{"key":"3160_CR18","doi-asserted-by":"crossref","unstructured":"Li, K., Chen, C., Quan, X., Ling, Q., Song, Y.: Conditional augmentation for aspect term extraction via masked sequence-to-sequence generation. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 7056\u20137066. Association for Computational Linguistics, Online (2020). https:\/\/www.aclweb.org\/anthology\/2020.acl-main.631","DOI":"10.18653\/v1\/2020.acl-main.631"},{"key":"3160_CR19","doi-asserted-by":"publisher","unstructured":"Li, X., Bing, L., Li, P., Lam, W., Yang, Z.: Aspect term extraction with history attention and selective transformation. In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI-18, pp. 4194\u20134200. International Joint Conferences on Artificial Intelligence Organization (2018). https:\/\/doi.org\/10.24963\/ijcai.2018\/583","DOI":"10.24963\/ijcai.2018\/583"},{"issue":"4","key":"3160_CR20","doi-asserted-by":"publisher","first-page":"528","DOI":"10.26599\/TST.2019.9010021","volume":"25","author":"B Liu","year":"2020","unstructured":"Liu, B., Tang, S., Sun, X., Chen, Q., Cao, J., Luo, J., Zhao, S.: Context-aware social media user sentiment analysis. Tsinghua Sci. Technol. 25(4), 528\u2013541 (2020)","journal-title":"Tsinghua Sci. Technol."},{"key":"3160_CR21","doi-asserted-by":"crossref","unstructured":"Liu, P., Joty, S.R., Meng, H.M.: Fine-grained opinion mining with recurrent neural networks and word embeddings. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015, Lisbon, Portugal, September 17\u201321, 2015, pp. 1433\u20131443 (2015). https:\/\/www.aclweb.org\/anthology\/D15-1168\/","DOI":"10.18653\/v1\/D15-1168"},{"key":"3160_CR22","doi-asserted-by":"publisher","unstructured":"Ma, D., Li, S., Wu, F., Xie, X., Wang, H.: Exploring sequence-to-sequence learning in aspect term extraction. In: Proceedings of the 57th Conference of the Association for Computational Linguistics, ACL 2019, Florence, Italy, July 28- August 2, 2019, Volume 1: Long Papers, pp. 3538\u20133547 (2019). https:\/\/doi.org\/10.18653\/v1\/p19-1344","DOI":"10.18653\/v1\/p19-1344"},{"key":"3160_CR23","doi-asserted-by":"publisher","unstructured":"Meyer, O., Bischl, B., Weihs, C.: Support vector machines on large data sets: simple parallel approaches. In: Data Analysis, Machine Learning and Knowledge Discovery - Proceedings of the 36th Annual Conference of the Gesellschaft f\u00fcr Klassifikation e. V., Hildesheim, Germany, August 2012, pp. 87\u201395 (2012). https:\/\/doi.org\/10.1007\/978-3-319-01595-8_10","DOI":"10.1007\/978-3-319-01595-8_10"},{"key":"3160_CR24","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held December 5\u20138, 2013, Lake Tahoe, Nevada, United States, pp. 3111\u20133119 (2013). http:\/\/papers.nips.cc\/paper\/5021-distributed-representations-of-words-and-phrases-and-their-compositionality"},{"key":"3160_CR25","doi-asserted-by":"publisher","unstructured":"Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., Manandhar, S., Al-Smadi, M., Al-Ayyoub, M., Zhao, Y., Qin, B., Clercq, O.D., Hoste, V., Apidianaki, M., Tannier, X., Loukachevitch, N.V., Kotelnikov, E.V., Bel, N., Zafra, S.M.J., Eryigit, G.: Semeval-2016 task 5: aspect based sentiment analysis. In: Proceedings of the 10th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2016, San Diego, CA, USA, June 16\u201317, 2016, pp. 19\u201330 (2016). https:\/\/doi.org\/10.18653\/v1\/s16-1002","DOI":"10.18653\/v1\/s16-1002"},{"issue":"3","key":"3160_CR26","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1007\/s10766-018-0615-5","volume":"47","author":"L Qin","year":"2019","unstructured":"Qin, L., Gong, Y., Tang, T., Wang, Y., Jin, J.: Training deep nets with progressive batch normalization on multi-gpus. Int. J. Parallel Program. 47(3), 373\u2013387 (2019). https:\/\/doi.org\/10.1007\/s10766-018-0615-5","journal-title":"Int. J. Parallel Program."},{"key":"3160_CR27","doi-asserted-by":"publisher","unstructured":"Shu, L., Xu, H., Liu, B.: Lifelong learning CRF for supervised aspect extraction. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, July 30\u2013August 4, Volume 2: Short Papers, pp. 148\u2013154 (2017). https:\/\/doi.org\/10.18653\/v1\/P17-2023","DOI":"10.18653\/v1\/P17-2023"},{"key":"3160_CR28","doi-asserted-by":"crossref","unstructured":"Toh, Z., Su, J.: NLANGP: supervised machine learning system for aspect category classification and opinion target extraction. In: Proceedings of the 9th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2015, Denver, Colorado, USA, June 4\u20135, 2015, pp. 496\u2013501 (2015). https:\/\/www.aclweb.org\/anthology\/S15-2083\/","DOI":"10.18653\/v1\/S15-2083"},{"key":"3160_CR29","doi-asserted-by":"crossref","unstructured":"Wang, W., Pan, S.J., Dahlmeier, D., Xiao, X.: Recursive neural conditional random fields for aspect-based sentiment analysis. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, Austin, Texas, USA, November 1\u20134, 2016, pp. 616\u2013626 (2016). https:\/\/www.aclweb.org\/anthology\/D16-1059\/","DOI":"10.18653\/v1\/D16-1059"},{"key":"3160_CR30","unstructured":"Wang, W., Pan, S.J., Dahlmeier, D., Xiao, X.: Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, February 4\u20139, 2017, San Francisco, California, USA, pp. 3316\u20133322 (2017). http:\/\/aaai.org\/ocs\/index.php\/AAAI\/AAAI17\/paper\/view\/14441"},{"key":"3160_CR31","doi-asserted-by":"publisher","unstructured":"Wu, H., Liu, M., Wang, J., Xie, J., Li, S.: Question\u2013answering aspect classification with multi-attention representation. In: Information Retrieval - 24th China Conference, CCIR 2018, Guilin, China, September 27\u201329, 2018, Proceedings, pp. 78\u201389 (2018). https:\/\/doi.org\/10.1007\/978-3-030-01012-6_7","DOI":"10.1007\/978-3-030-01012-6_7"},{"key":"3160_CR32","doi-asserted-by":"publisher","unstructured":"Wu, H., Liu, M., Wang, J., Xie, J., Shen, C.: Question\u2013answering aspect classification with hierarchical attention network. In: Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data - 17th China National Conference, CCL 2018, and 6th International Symposium, NLP-NABD 2018, Changsha, China, October 19\u201321, 2018, Proceedings, pp. 225\u2013237 (2018). https:\/\/doi.org\/10.1007\/978-3-030-01716-3_19","DOI":"10.1007\/978-3-030-01716-3_19"},{"key":"3160_CR33","doi-asserted-by":"publisher","unstructured":"Wu, H., Liu, M., Zhang, S., Wang, Z., Cheng, S.: Big data management and analytics in scientific programming: adeep learning-based method for aspect category classification of question\u2013answering-style reviews. Scientific Programming 2020, 4690974:1\u20134690974:10 (2020). https:\/\/doi.org\/10.1155\/2020\/4690974","DOI":"10.1155\/2020\/4690974"},{"key":"3160_CR34","unstructured":"Xue, W., Zhou, W., Li, T., Wang, Q.: MTNA: a neural multi-task model for aspect category classification and aspect term extraction on restaurant reviews. In: Proceedings of the Eighth International Joint Conference on Natural Language Processing, IJCNLP 2017, Taipei, Taiwan, November 27\u2013December 1, 2017, Volume 2: Short Papers, pp. 151\u2013156 (2017)"},{"key":"3160_CR35","unstructured":"Yin, Y., Wei, F., Dong, L., Xu, K., Zhang, M., Zhou, M.: Unsupervised word and dependency path embeddings for aspect term extraction. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI 2016, New York, NY, USA, 9\u201315 July 2016, pp. 2979\u20132985 (2016). http:\/\/www.ijcai.org\/Abstract\/16\/423"},{"key":"3160_CR36","doi-asserted-by":"publisher","unstructured":"Zou, Y., Jin, X., Li, Y., Guo, Z., Wang, E., Xiao, B.: Mariana: tencent deep learning platform and its applications. PVLDB 7(13), 1772\u20131777 (2014). https:\/\/doi.org\/10.14778\/2733004.2733082. http:\/\/www.vldb.org\/pvldb\/vol7\/p1772-tencent.pdf","DOI":"10.14778\/2733004.2733082"}],"container-title":["Cluster Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-020-03160-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10586-020-03160-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-020-03160-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,27]],"date-time":"2021-07-27T00:11:58Z","timestamp":1627344718000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10586-020-03160-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,27]]},"references-count":36,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["3160"],"URL":"https:\/\/doi.org\/10.1007\/s10586-020-03160-9","relation":{},"ISSN":["1386-7857","1573-7543"],"issn-type":[{"type":"print","value":"1386-7857"},{"type":"electronic","value":"1573-7543"}],"subject":[],"published":{"date-parts":[[2020,7,27]]},"assertion":[{"value":"23 February 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 July 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 July 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 July 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}