{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T04:51:27Z","timestamp":1782881487675,"version":"3.54.5"},"reference-count":72,"publisher":"Cambridge University Press (CUP)","issue":"4","license":[{"start":{"date-parts":[[2018,4,22]],"date-time":"2018-04-22T00:00:00Z","timestamp":1524355200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2018,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper, we study the problem of aspect-based sentiment analysis. Our model simultaneously extracts aspect-specific opinion expressions and determines the rating for each aspect in reviews. Previous works have mainly focused on the problem of opinion phrase extraction and aspect rating prediction in a pipelined manner and are not able to capture the dependencies of aspect opinion expression on aspect rating and vice-versa. They are also unable to discover aspect-specific opinion expressions and their associated rating scores. We present a joint modelling approach to extract aspect-specific sentiment expression and aspect rating prediction simultaneously. This paper proposes a novel LDA\u2013CRF hybrid model which employs discriminative conditional random field component for phrase extraction, a regression component for rating prediction and a generative component for grouping aspect\u2013sentiment expressions (aspect-specific opinion expressions) into coherent topics. To show the effectiveness of our approach, we evaluate the performance of the model on both task: (i) aspect-specific opinion expressions and (ii) rating prediction on the dataset of hotel and restaurant reviews from TripAdvisor.com. Experimental results show that both task potentially reinforce each other and joint modeling outperformed state-of-the-art baselines for each individual tasks.<\/jats:p>","DOI":"10.1017\/s135132491800013x","type":"journal-article","created":{"date-parts":[[2018,4,22]],"date-time":"2018-04-22T09:01:46Z","timestamp":1524387706000},"page":"611-639","source":"Crossref","is-referenced-by-count":16,"title":["Aspect opinion expression and rating prediction via LDA\u2013CRF hybrid"],"prefix":"10.1017","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3607-8366","authenticated-orcid":false,"given":"ABHISHEK","family":"LADDHA","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"ARJUN","family":"MUKHERJEE","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"56","published-online":{"date-parts":[[2018,4,22]]},"reference":[{"key":"S135132491800013X_ref072","doi-asserted-by":"crossref","unstructured":"Zhuang L. , Jing F. , and Zhu X.-Y. 2006. Movie review mining and summarization. In Proceedings of the 15th ACM International Conference on Information and Knowledge Management, ACM, pp. 43\u201350.","DOI":"10.1145\/1183614.1183625"},{"key":"S135132491800013X_ref071","first-page":"2237","article-title":"Medlda: maximum margin supervised topic models","volume":"13","author":"Zhu","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"S135132491800013X_ref070","unstructured":"Zhao W. X. , Jiang J. , Yan H. , and Li X. 2010. Jointly modeling aspects and opinions with a maxent-lda hybrid. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, pp. 56\u201365."},{"key":"S135132491800013X_ref068","unstructured":"Yin Y. , Wei F. , Dong L. , Xu K. , Zhang M. , and Zhou M. 2016. Unsupervised word and dependency path embeddings for aspect term extraction. arXiv preprint, arXiv:1605.07843."},{"key":"S135132491800013X_ref067","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1162\/tacl_a_00199","article-title":"Joint modeling of opinion expression extraction and attribute classification","volume":"2","author":"Yang","year":"2014","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"S135132491800013X_ref066","unstructured":"Yang B. , and Cardie C. 2013. Joint inference for fine-grained opinion extraction. In ACL (1), pp. 1640\u20139."},{"key":"S135132491800013X_ref065","unstructured":"Yang B. , and Cardie C. 2012. Extracting opinion expressions with semi-markov conditional random fields. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Association for Computational Linguistics, pp. 1335\u201345."},{"key":"S135132491800013X_ref064","doi-asserted-by":"crossref","unstructured":"Xu Y. , Lin T. , Lam W. , Zhou Z. , Cheng H. , and So A. M.-C. 2014. Latent aspect mining via exploring sparsity and intrinsic information. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, ACM, pp. 879\u201388.","DOI":"10.1145\/2661829.2662062"},{"key":"S135132491800013X_ref063","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2012.08.003"},{"key":"S135132491800013X_ref062","first-page":"1533","volume-title":"Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing","author":"Wu","year":"2009"},{"key":"S135132491800013X_ref059","doi-asserted-by":"crossref","unstructured":"Wang X. , McCallum A. , and Wei X. 2007. Topical n-grams: phrase and topic discovery, with an application to information retrieval. In Proceedings of the 7th IEEE International Conference on Data Mining, ICDM 2007, pp. 697\u2013702.","DOI":"10.1109\/ICDM.2007.86"},{"key":"S135132491800013X_ref058","unstructured":"Wang W. , Pan S. J. , Dahlmeier D. , and Xiao X. 2016. Recursive neural conditional random fields for aspect-based sentiment analysis. arXiv preprint, arXiv:1603.06679."},{"key":"S135132491800013X_ref057","doi-asserted-by":"crossref","unstructured":"Wang H. , Lu Y. , and Zhai C. 2011. Latent aspect rating analysis without aspect keyword supervision. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, pp. 618\u201326.","DOI":"10.1145\/2020408.2020505"},{"key":"S135132491800013X_ref056","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835903"},{"key":"S135132491800013X_ref053","unstructured":"Tang D. , Qin B. , and Liu T. 2016. Aspect level sentiment classification with deep memory network. arXiv preprint, arXiv:1605.08900."},{"key":"S135132491800013X_ref050","unstructured":"Snyder B. , and Barzilay R. 2007. Multiple aspect ranking using the good grief algorithm. In HLT-NAACL, pp. 300\u20137."},{"key":"S135132491800013X_ref049","first-page":"350","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies","author":"Sauper","year":"2011"},{"key":"S135132491800013X_ref045","doi-asserted-by":"crossref","unstructured":"Popescu A.-M. , and Etzioni O. 2007. Extracting product features and opinions from reviews. In Natural Language Processing and Text Mining, Springer, pp. 9\u201328.","DOI":"10.1007\/978-1-84628-754-1_2"},{"key":"S135132491800013X_ref044","doi-asserted-by":"crossref","unstructured":"Pontiki M. , et al. 2016. Semeval-2016 task 5: aspect based sentiment analysis. In ProWorkshop on Semantic Evaluation (SemEval-2016), Association for Computational Linguistics, pp. 19\u201330.","DOI":"10.18653\/v1\/S16-1002"},{"key":"S135132491800013X_ref043","doi-asserted-by":"crossref","unstructured":"Pennington J. , Socher R. , and Manning C. D. 2014. Glove: global vectors for word representation. In EMNLP, vol. 14, pp. 1532\u201343.","DOI":"10.3115\/v1\/D14-1162"},{"key":"S135132491800013X_ref042","doi-asserted-by":"crossref","unstructured":"Nguyen T. H. , and Shirai K. 2015. Phrasernn: phrase recursive neural network for aspect-based sentiment analysis. In EMNLP, pp. 2509\u201314.","DOI":"10.18653\/v1\/D15-1298"},{"key":"S135132491800013X_ref047","doi-asserted-by":"crossref","unstructured":"Poria S. , Chaturvedi I. , Cambria E. , and Bisio F. 2016. Sentic lda: improving on lda with semantic similarity for aspect-based sentiment analysis. In Proceedings of the International Joint Conference on Neural Networks (IJCNN), pp. 4465\u201373.","DOI":"10.1109\/IJCNN.2016.7727784"},{"key":"S135132491800013X_ref040","doi-asserted-by":"crossref","unstructured":"Moghaddam S. , and Ester M. 2013. The flda model for aspect-based opinion mining: addressing the cold start problem. In Proceedings of the 22nd International Conference on World Wide Web, International World Wide Web Conferences Steering Committee, pp. 909\u201318.","DOI":"10.1145\/2488388.2488467"},{"key":"S135132491800013X_ref038","unstructured":"Mimno D. , Wallach H. M. , Talley E. , Leenders M. , and McCallum A. 2011. Optimizing semantic coherence in topic models. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, pp. 262\u201372."},{"key":"S135132491800013X_ref037","unstructured":"Mimno D. and McCallum A. 2012. Topic models conditioned on arbitrary features with dirichlet-multinomial regression. arXiv preprint, arXiv:1206.3278."},{"key":"S135132491800013X_ref036","doi-asserted-by":"crossref","unstructured":"Mei Q. , Ling X. , Wondra M. , Su H. , and Zhai C. 2007. Topic sentiment mixture: modeling facets and opinions in weblogs. In Proceedings of the 16th International Conference on World Wide Web, ACM, pp. 171\u201380.","DOI":"10.1145\/1242572.1242596"},{"key":"S135132491800013X_ref035","unstructured":"Mcauliffe J. D. , and Blei D. M. 2008. Supervised topic models. In Advances in Neural Information Processing Systems, pp. 121\u20138."},{"key":"S135132491800013X_ref034","doi-asserted-by":"publisher","DOI":"10.1201\/9781420059847"},{"key":"S135132491800013X_ref032","doi-asserted-by":"crossref","unstructured":"Lu B. , Ott M. , Cardie C. , and Tsou B. K. 2011. Multi-aspect sentiment analysis with topic models. In Proceedings of the IEEE 11th International Conference on Data Mining Workshops, IEEE, pp. 81\u20138.","DOI":"10.1109\/ICDMW.2011.125"},{"key":"S135132491800013X_ref031","doi-asserted-by":"crossref","unstructured":"Liu P. , Joty S. R. , and Meng H. M. 2015. Fine-grained opinion mining with recurrent neural networks and word embeddings. In EMNLP, pp. 1433\u201343.","DOI":"10.18653\/v1\/D15-1168"},{"key":"S135132491800013X_ref029","doi-asserted-by":"crossref","unstructured":"Liu B. and Zhang L. 2012. A survey of opinion mining and sentiment analysis. In Mining Text Data, pp. 415\u201363. Springer, pp. 415\u201363.","DOI":"10.1007\/978-1-4614-3223-4_13"},{"key":"S135132491800013X_ref024","doi-asserted-by":"crossref","unstructured":"Lakkaraju H. , Bhattacharyya C. , Bhattacharya I. , and Merugu S. 2011. Exploiting coherence for the simultaneous discovery of latent facets and associated sentiments. In SDM, SIAM, pp. 498\u2013509.","DOI":"10.1137\/1.9781611972818.43"},{"key":"S135132491800013X_ref022","unstructured":"Kudo T. 2009. Crf++: Yet another crf toolkit [ol]."},{"key":"S135132491800013X_ref021","first-page":"1065","volume-title":"EMNLP-CoNLL","author":"Kobayashi","year":"2007"},{"key":"S135132491800013X_ref048","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1613\/jair.3647","article-title":"Automatic aggregation by joint modeling of aspects and values","volume":"46","author":"Sauper","year":"2013","journal-title":"Journal of Artificial Intelligence Research"},{"key":"S135132491800013X_ref020","doi-asserted-by":"crossref","unstructured":"Kim S.-M. , and Hovy E. 2006. Extracting opinions, opinion holders, and topics expressed in online news media text. In Proceedings of the Workshop on Sentiment and Subjectivity in Text, Association for Computational Linguistics, pp. 1\u20138.","DOI":"10.3115\/1654641.1654642"},{"key":"S135132491800013X_ref019","first-page":"101","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers","author":"Johansson","year":"2011"},{"key":"S135132491800013X_ref018","doi-asserted-by":"crossref","unstructured":"Jo Y. and Oh A. H. 2011. Aspect and sentiment unification model for online review analysis. In Proceedings of the 4th ACM International Conference on Web Search and Data Mining, ACM, pp. 815\u201324.","DOI":"10.1145\/1935826.1935932"},{"key":"S135132491800013X_ref016","doi-asserted-by":"crossref","unstructured":"Irsoy O. , and Cardie C. 2014. Opinion mining with deep recurrent neural networks. In EMNLP, pp. 720\u20138.","DOI":"10.3115\/v1\/D14-1080"},{"key":"S135132491800013X_ref028","unstructured":"Lindsey R. V. , Headden W. P. III , and Stipicevic M. J. 2012. A phrase-discovering topic model using hierarchical pitman-yor processes. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Association for Computational Linguistics, pp. 214\u201322."},{"key":"S135132491800013X_ref060","doi-asserted-by":"crossref","unstructured":"Wang Y. , Huang M. , Zhao L. , and Zhu X. 2016. Attention-based lstm for aspect-level sentiment classification. In EMNLP, pp. 606\u201315.","DOI":"10.18653\/v1\/D16-1058"},{"key":"S135132491800013X_ref023","unstructured":"Lafferty J. , McCallum A. , and Pereira F. 2001. Conditional random fields: probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conference on Machine Learning, ICML, vol. 1, pp. 282\u20139."},{"key":"S135132491800013X_ref039","doi-asserted-by":"crossref","unstructured":"Moghaddam S. , and Ester M. 2011. Ilda: interdependent lda model for learning latent aspects and their ratings from online product reviews. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, pp. 665\u201374.","DOI":"10.1145\/2009916.2010006"},{"key":"S135132491800013X_ref004","doi-asserted-by":"crossref","unstructured":"Chang C.-C. , and Lin C.-J. 2011. LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2. http:\/\/www.csie.ntu.edu.tw\/~cjlin\/libsvm.","DOI":"10.1145\/1961189.1961199"},{"key":"S135132491800013X_ref030","doi-asserted-by":"crossref","unstructured":"Liu J. , Shang J. , Wang C. , Ren X. , and Han J. 2015. Mining quality phrases from massive text corpora. In Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, ACM, pp. 1729\u201344.","DOI":"10.1145\/2723372.2751523"},{"key":"S135132491800013X_ref008","doi-asserted-by":"crossref","unstructured":"Diao Q. , Qiu M. , Wu C.-Y. , Smola A. J. , Jiang J. , and Wang C. 2014. Jointly modeling aspects, ratings and sentiments for movie recommendation (jmars). In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, pp. 193\u2013202.","DOI":"10.1145\/2623330.2623758"},{"key":"S135132491800013X_ref025","unstructured":"Lakkaraju H. , Socher R. , and Manning C. 2014. Aspect specific sentiment analysis using hierarchical deep learning. In NIPS Workshop on Deep Learning and Representation Learning."},{"key":"S135132491800013X_ref052","unstructured":"Tang D. , Qin B. , Feng X. , and Liu T. 2015. Effective lstms for target-dependent sentiment classification. arXiv preprint, arXiv:1512.01100."},{"key":"S135132491800013X_ref061","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-005-7880-9"},{"key":"S135132491800013X_ref011","unstructured":"Fei G. , Chen Z. , and Liu B. 2014. Review topic discovery with phrases using the p\u00f3lya urn model. In COLING, pp. 667\u201376."},{"key":"S135132491800013X_ref010","doi-asserted-by":"publisher","DOI":"10.14778\/2735508.2735519"},{"key":"S135132491800013X_ref069","first-page":"379","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies","author":"Zhao","year":"2011"},{"key":"S135132491800013X_ref054","first-page":"308","volume-title":"ACL","author":"Titov","year":"2008"},{"key":"S135132491800013X_ref001","unstructured":"Bengio S. , Vinyals O. , Jaitly N. , and Shazeer N. 2015. Scheduled sampling for sequence prediction with recurrent neural networks. In Proceedings of the 28th International Conference on Advances in Neural Information Processing Systems, pp. 1171\u20139."},{"key":"S135132491800013X_ref012","unstructured":"Fu X. , Wu H. , and Cui L. 2016. Topic sentiment joint model with word embeddings. In DMNLP@ PKDD\/ECML, pp. 41\u20138."},{"key":"S135132491800013X_ref027","doi-asserted-by":"crossref","unstructured":"Lin C. , and He Y. 2009. Joint sentiment\/topic model for sentiment analysis. In Proceedings of the 18th ACM Conference on Information and Lnowledge Management, ACM, pp. 375\u201384.","DOI":"10.1145\/1645953.1646003"},{"key":"S135132491800013X_ref014","doi-asserted-by":"crossref","unstructured":"Hu M. , and Liu B. 2004. Mining and summarizing customer reviews. In Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, pp. 168\u201377.","DOI":"10.1145\/1014052.1014073"},{"key":"S135132491800013X_ref015","unstructured":"Huang Z. , Xu W. , and Yu K. 2015. Bidirectional lstm-crf models for sequence tagging. arXiv preprint, arXiv:1508.01991."},{"key":"S135132491800013X_ref033","doi-asserted-by":"crossref","unstructured":"Lu Y. , Zhai C. , and Sundaresan N. 2009. Rated aspect summarization of short comments. In Proceedings of the 18th International Conference on World Wide Web, ACM, pp. 131\u201340.","DOI":"10.1145\/1526709.1526728"},{"key":"S135132491800013X_ref051","first-page":"170","volume-title":"Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing","author":"Somasundaran","year":"2009"},{"key":"S135132491800013X_ref055","doi-asserted-by":"crossref","unstructured":"Wang H. 2015. Sentiment-Aligned Topic Models for Product Aspect Rating Prediction. Ph D Thesis, Applied Sciences, School of Computing Science.","DOI":"10.3115\/v1\/D14-1126"},{"key":"S135132491800013X_ref002","unstructured":"Breck E. , Choi Y. , and Cardie C. 2007. Identifying expressions of opinion in context. In IJCAI, vol. 7, pp. 2683\u20138."},{"key":"S135132491800013X_ref026","unstructured":"Li F. , Huang M. , and Zhu X. 2010. Sentiment analysis with global topics and local dependency. In AAAI, vol. 10, pp. 1371\u20136."},{"key":"S135132491800013X_ref003","unstructured":"Brody S. , and Elhadad N. 2010. An unsupervised aspect-sentiment model for online reviews. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Association for Computational Linguistics, pp. 804\u201312."},{"key":"S135132491800013X_ref017","unstructured":"Jakob N. , and Gurevych I. 2010. Extracting opinion targets in a single-and cross-domain setting with conditional random fields. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, pp. 1035\u201345."},{"key":"S135132491800013X_ref005","doi-asserted-by":"crossref","unstructured":"Choi Y. , Breck E. , and Cardie C. 2006. Joint extraction of entities and relations for opinion recognition. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, pp. 431\u20139.","DOI":"10.3115\/1610075.1610136"},{"key":"S135132491800013X_ref006","doi-asserted-by":"crossref","unstructured":"Choi Y. , Cardie C. , Riloff E. , and Patwardhan S. 2005. Identifying sources of opinions with conditional random fields and extraction patterns. In Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, Association for Computational Linguistics, pp. 355\u201362.","DOI":"10.3115\/1220575.1220620"},{"key":"S135132491800013X_ref007","doi-asserted-by":"crossref","unstructured":"Dave K. , Lawrence S. , and Pennock D. M. 2003. Mining the peanut gallery: opinion extraction and semantic classification of product reviews. In Proceedings of the 12th International Conference on World Wide Web, ACM, pp. 519\u201328.","DOI":"10.1145\/775152.775226"},{"key":"S135132491800013X_ref046","doi-asserted-by":"crossref","unstructured":"Poria S. , Cambria E. , and Gelbukh A. 2016. Aspect extraction for opinion mining with a deep convolutional neural network. Knowledge-Based Systems 108, 42\u20139.","DOI":"10.1016\/j.knosys.2016.06.009"},{"key":"S135132491800013X_ref009","unstructured":"Diebolt J. , and Ip E. 1996. Markov chain monte carlo in practice."},{"key":"S135132491800013X_ref041","first-page":"339","volume-title":"Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers","author":"Mukherjee","year":"2012"},{"key":"S135132491800013X_ref013","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2015.02.021"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S135132491800013X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,10,16]],"date-time":"2019-10-16T16:21:01Z","timestamp":1571242861000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S135132491800013X\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,22]]},"references-count":72,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,7]]}},"alternative-id":["S135132491800013X"],"URL":"https:\/\/doi.org\/10.1017\/s135132491800013x","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,22]]}}}