{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T16:07:36Z","timestamp":1747238856937,"version":"3.37.3"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,9,20]],"date-time":"2022-09-20T00:00:00Z","timestamp":1663632000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,9,20]],"date-time":"2022-09-20T00:00:00Z","timestamp":1663632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100013003","name":"Universit\u00e0 degli Studi di Cagliari","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100013003","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Stat"],"published-print":{"date-parts":[[2024,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper proposes a new methodology called TOpic modeling Based Index Assessment through Sentiment (TOBIAS). This method aims at modeling the effects of the topics, moods, and sentiments of the comments describing a phenomenon upon its overall rating. TOBIAS is built combining different techniques and methodologies. Firstly, Sentiment Analysis identifies sentiments, emotions, and moods, and Topic Modeling finds the main relevant topics inside comments. Then, Partial Least Square Path Modeling estimates how they affect an overall rating that summarizes the performance of the analyzed phenomenon. We carried out TOBIAS on a real case study on the university courses\u2019 quality evaluated by the University of Cagliari (Italy) students. We found TOBIAS able to provide interpretable results on the impact of discussed topics by students with their expressed sentiments, emotions, and moods and with the overall rating.<\/jats:p>","DOI":"10.1007\/s00180-022-01284-7","type":"journal-article","created":{"date-parts":[[2022,9,20]],"date-time":"2022-09-20T09:04:03Z","timestamp":1663664643000},"page":"289-311","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Topic based quality indexes assessment through sentiment"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4191-5058","authenticated-orcid":false,"given":"Marco","family":"Ortu","sequence":"first","affiliation":[]},{"given":"Luca","family":"Frigau","sequence":"additional","affiliation":[]},{"given":"Giulia","family":"Contu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,9,20]]},"reference":[{"key":"1284_CR1","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1007\/978-1-62703-059-5_23","volume-title":"Computational toxicology","author":"H Abdi","year":"2013","unstructured":"Abdi H, Williams LJ (2013) Partial least squares methods: partial least squares correlation and partial least square regression. Computational toxicology. Springer, Berlin, pp 549\u2013579"},{"issue":"2","key":"1284_CR2","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1007\/s11135-016-0421-3","volume":"51","author":"A Amendola","year":"2017","unstructured":"Amendola A, Restaino M (2017) An evaluation study on students\u2019 international mobility experience. Qual Quant 51(2):525\u2013544","journal-title":"Qual Quant"},{"issue":"3","key":"1284_CR3","first-page":"1","volume":"13","author":"S Baddam","year":"2019","unstructured":"Baddam S, Bingi P, Shuva S (2019) Student evaluation of teaching in business education: Discovering student sentiments using text mining techniques. e-J Bus Educ Scholarsh Teach 13(3):1\u201313","journal-title":"e-J Bus Educ Scholarsh Teach"},{"issue":"3","key":"1284_CR4","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1007\/s10734-021-00680-0","volume":"83","author":"A Becher","year":"2022","unstructured":"Becher A (2022) When context meets knowledge in university professional education: organizational factors influencing coherence in teaching and social work. High Educ 83(3):577\u2013595","journal-title":"High Educ"},{"key":"1284_CR5","unstructured":"Bianchi F, Nozza D, Hovy D (2021) Feel-it: emotion and sentiment classification for the italian language. In: Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp 76\u201383"},{"issue":"4","key":"1284_CR6","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1145\/2133806.2133826","volume":"55","author":"DM Blei","year":"2012","unstructured":"Blei DM (2012) Probabilistic topic models. Commun ACM 55(4):77\u201384","journal-title":"Commun ACM"},{"key":"1284_CR7","first-page":"993","volume":"3","author":"DM Blei","year":"2003","unstructured":"Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3:993\u20131022","journal-title":"J Mach Learn Res"},{"key":"1284_CR8","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/B978-0-12-411519-4.00006-9","volume-title":"The art and science of analyzing software data","author":"JC Campbell","year":"2015","unstructured":"Campbell JC, Hindle A, Stroulia E (2015) Latent dirichlet allocation: extracting topics from software engineering data. The art and science of analyzing software data. Elsevier, Amsterdam, pp 139\u2013159"},{"issue":"2","key":"1284_CR9","first-page":"474","volume":"13","author":"G Contu","year":"2020","unstructured":"Contu G, Frigau L, Mola F et al (2020) University student achievements and international mobility: The case of university of cagliari. Electr J Appl Stat Anal 13(2):474\u2013497","journal-title":"Electr J Appl Stat Anal"},{"issue":"4","key":"1284_CR10","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1109\/TE.2019.2924385","volume":"62","author":"S Cunningham-Nelson","year":"2019","unstructured":"Cunningham-Nelson S, Baktashmotlagh M, Boles W (2019) Visualizing student opinion through text analysis. IEEE Trans Educ 62(4):305\u2013311","journal-title":"IEEE Trans Educ"},{"issue":"5","key":"1284_CR11","first-page":"296","volume":"17","author":"M Darwich","year":"2019","unstructured":"Darwich M, Mohd SA, Omar N et al (2019) Corpus-based techniques for sentiment lexicon generation: a review. J Digit Inf Manag 17(5):296","journal-title":"J Digit Inf Manag"},{"key":"1284_CR12","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/978-3-540-32827-8_2","volume-title":"Handbook of partial least squares","author":"TK Dijkstra","year":"2010","unstructured":"Dijkstra TK (2010) Latent variables and indices: Herman wold\u2019s basic design and partial least squares. Handbook of partial least squares. Springer, Berlin, pp 23\u201346"},{"key":"1284_CR13","unstructured":"Frigau L, Wu Q, Banks D (2021) Optimizing the jsm program. J Am Stat Assoc, pp 1\u201310"},{"key":"1284_CR14","doi-asserted-by":"crossref","unstructured":"Guo J, Yu S (2020) Evaluation model of college english teaching quality based on big data analysis. In: IOP conference series: materials science and engineering, p 012077. IOP Publishing","DOI":"10.1088\/1757-899X\/750\/1\/012077"},{"key":"1284_CR15","doi-asserted-by":"crossref","unstructured":"Henseler J, Ringle CM, Sinkovics RR (2009) The use of partial least squares path modeling in international marketing. In: New challenges to international marketing. Emerald Group Publishing Limited","DOI":"10.1108\/S1474-7979(2009)0000020014"},{"key":"1284_CR16","doi-asserted-by":"crossref","unstructured":"Hu X, Tang J, Gao H, et\u00a0al (2013) Unsupervised sentiment analysis with emotional signals. In: Proceedings of the 22nd international conference on World Wide Web, pp 607\u2013618","DOI":"10.1145\/2488388.2488442"},{"issue":"103","key":"1284_CR17","first-page":"965","volume":"157","author":"M Hujala","year":"2020","unstructured":"Hujala M, Knutas A, Hynninen T et al (2020) Improving the quality of teaching by utilising written student feedback: A streamlined process. Comput Educ 157(103):965","journal-title":"Comput Educ"},{"issue":"11","key":"1284_CR18","doi-asserted-by":"publisher","first-page":"15,169","DOI":"10.1007\/s11042-018-6894-4","volume":"78","author":"H Jelodar","year":"2019","unstructured":"Jelodar H, Wang Y, Yuan C et al (2019) Latent dirichlet allocation (lda) and topic modeling: models, applications, a survey. Multim Tools Appl 78(11):15,169-15,211","journal-title":"Multim Tools Appl"},{"key":"1284_CR19","doi-asserted-by":"crossref","unstructured":"Kaur H, Mangat V et al (2017) A survey of sentiment analysis techniques. In: 2017 international conference on I-SMAC (IoT in social. Mobile, Analytics and Cloud)(I-SMAC), IEEE, pp 921\u2013925","DOI":"10.1109\/I-SMAC.2017.8058315"},{"key":"1284_CR20","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1016\/j.procs.2017.12.069","volume":"125","author":"A Kumar","year":"2018","unstructured":"Kumar A, Jain R (2018) Faculty evaluation system. Proc Comput Sci 125:533\u2013541","journal-title":"Proc Comput Sci"},{"issue":"100","key":"1284_CR21","first-page":"884","volume":"46","author":"L Law","year":"2020","unstructured":"Law L, Fong N (2020) Applying partial least squares structural equation modeling (pls-sem) in an investigation of undergraduate students\u2019 learning transfer of academic english. J Engl Acad Purp 46(100):884","journal-title":"J Engl Acad Purp"},{"issue":"1","key":"1284_CR22","first-page":"1","volume":"5","author":"B Liu","year":"2012","unstructured":"Liu B (2012) Sentiment analysis and opinion mining. Synth Lect Hum Lang Technol 5(1):1\u2013167","journal-title":"Synth Lect Hum Lang Technol"},{"key":"1284_CR23","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1007\/978-3-642-52512-4_5","volume-title":"Latent variable path modeling with partial least squares","author":"JB Lohm\u00f6ller","year":"1989","unstructured":"Lohm\u00f6ller JB (1989) Predictive versus structural modeling: Pls versus ml. Latent variable path modeling with partial least squares. Springer, Berlin, pp 199\u2013226"},{"key":"1284_CR24","doi-asserted-by":"crossref","unstructured":"Lu B, Ott M, Cardie C, et\u00a0al (2011) Multi-aspect sentiment analysis with topic models. In: 2011 IEEE 11th international conference on data mining workshops, IEEE, pp 81\u201388","DOI":"10.1109\/ICDMW.2011.125"},{"key":"1284_CR25","doi-asserted-by":"crossref","unstructured":"Madhoushi Z, Hamdan AR, Zainudin S (2015) Sentiment analysis techniques in recent works. In: 2015 science and information conference (SAI), IEEE, pp 288\u2013291","DOI":"10.1109\/SAI.2015.7237157"},{"key":"1284_CR26","doi-asserted-by":"crossref","unstructured":"Miao N, Xue F, Hong R (2021) Multi-modal semantics-based supervised latent dirichlet allocation for event classication. IEEE MultiMedia","DOI":"10.1109\/MMUL.2021.3077915"},{"issue":"18","key":"1284_CR27","doi-asserted-by":"publisher","first-page":"8438","DOI":"10.3390\/app11188438","volume":"11","author":"M Mujahid","year":"2021","unstructured":"Mujahid M, Lee E, Rustam F et al (2021) Sentiment analysis and topic modeling on tweets about online education during covid-19. Appl Sci 11(18):8438","journal-title":"Appl Sci"},{"issue":"1","key":"1284_CR28","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1016\/j.ejor.2014.03.018","volume":"238","author":"Y Nikolaidis","year":"2014","unstructured":"Nikolaidis Y, Dimitriadis SG (2014) On the student evaluation of university courses and faculty members\u2019 teaching performance. Eur J Oper Res 238(1):199\u2013207","journal-title":"Eur J Oper Res"},{"issue":"1","key":"1284_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41239-020-00224-z","volume":"17","author":"K Okoye","year":"2020","unstructured":"Okoye K, Arrona-Palacios A, Camacho-Zu\u00f1iga C et al (2020) Impact of students evaluation of teaching: a text analysis of the teachers qualities by gender. Int J Educ Technol High Educ 17(1):1\u201327","journal-title":"Int J Educ Technol High Educ"},{"issue":"1","key":"1284_CR30","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1007\/s10734-017-0199-9","volume":"76","author":"HS Park","year":"2018","unstructured":"Park HS, Cheong YF (2018) Correlates of monotonic response patterns in online ratings of a university course. High Educ 76(1):101\u2013113","journal-title":"High Educ"},{"key":"1284_CR31","doi-asserted-by":"crossref","unstructured":"Rahmadan MC, Hidayanto AN, Ekasari DS et al (2020) Sentiment analysis and topic modelling using the lda method related to the flood disaster in jakarta on twitter. In: 2020 international conference on informatics. Multimedia, cyber and information system (ICIMCIS), IEEE, pp 126\u2013130","DOI":"10.1109\/ICIMCIS51567.2020.9354320"},{"key":"1284_CR32","doi-asserted-by":"crossref","unstructured":"Rajput Q, Haider S, Ghani S (2016) Lexicon-based sentiment analysis of teachers\u2019 evaluation. Applied computational intelligence and soft computing 2016","DOI":"10.1155\/2016\/2385429"},{"issue":"1","key":"1284_CR33","first-page":"8","volume":"20","author":"D Sharpe","year":"2015","unstructured":"Sharpe D (2015) Chi-square test is statistically significant: Now what? Pract Assess Res Eval 20(1):8","journal-title":"Pract Assess Res Eval"},{"key":"1284_CR34","doi-asserted-by":"crossref","unstructured":"Shen W, Zhang S (2018) Emotional tendency dictionary construction for college teaching evaluation. Int J Emerg Technol Learn 13(11)","DOI":"10.3991\/ijet.v13i11.9605"},{"key":"1284_CR35","doi-asserted-by":"crossref","unstructured":"Sodanil M (2016) Multi-language sentiment analysis for hotel reviews. In: MATEC Web of Conferences, EDP Sciences, p 03002","DOI":"10.1051\/matecconf\/20167503002"},{"issue":"4","key":"1284_CR36","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1002\/sam.11197","volume":"6","author":"J Soriano","year":"2013","unstructured":"Soriano J, Au T, Banks D (2013) Text mining in computational advertising. Stat Anal Data Min ASA Data Sci J 6(4):273\u2013285","journal-title":"Stat Anal Data Min ASA Data Sci J"},{"key":"1284_CR37","unstructured":"SpaCy (2022) version 3.2. URL https:\/\/spacy.io\/usage\/projects, accessed Mar. 18, 2022"},{"key":"1284_CR38","doi-asserted-by":"crossref","unstructured":"Staiano J, Guerini M (2014) Depechemood: a lexicon for emotion analysis from crowd-annotated news. arXiv preprint arXiv:1405.1605","DOI":"10.3115\/v1\/P14-2070"},{"key":"1284_CR39","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1007\/978-4-431-66996-8_4","volume-title":"New developments in psychometrics","author":"Y Takane","year":"2003","unstructured":"Takane Y (2003) Relationships among various kinds of eigenvalue and singular value decompositions. New developments in psychometrics. Springer, Berlin, pp 45\u201356"},{"issue":"1","key":"1284_CR40","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/j.csda.2004.03.005","volume":"48","author":"M Tenenhaus","year":"2005","unstructured":"Tenenhaus M, Vinzi VE, Chatelin YM et al (2005) Pls path modeling. Comput Stat Data Anal 48(1):159\u2013205","journal-title":"Comput Stat Data Anal"},{"issue":"10","key":"1284_CR41","first-page":"320","volume":"11","author":"A Trisihnyo","year":"2021","unstructured":"Trisihnyo A, Harun A (2021) Service quality, university image, student satisfaction and student retention: Issues and challenges met by private universities in indonesia. Rev Int Geograph Educ Online 11(10):320\u2013325","journal-title":"Rev Int Geograph Educ Online"},{"issue":"112","key":"1284_CR42","first-page":"834","volume":"138","author":"S Vashishtha","year":"2019","unstructured":"Vashishtha S, Susan S (2019) Fuzzy rule based unsupervised sentiment analysis from social media posts. Expert Syst Appl 138(112):834","journal-title":"Expert Syst Appl"},{"key":"1284_CR43","doi-asserted-by":"crossref","unstructured":"Wang L, Wang T (2021) Research on the scientific research efficiency of provincial universities based on the dea model. Mobile Information Systems 2021","DOI":"10.1155\/2021\/7929084"},{"issue":"1","key":"1284_CR44","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1080\/1540496X.2019.1636227","volume":"58","author":"T Wang","year":"2022","unstructured":"Wang T, Pan SC, Zhu XY et al (2022) Research on the influence of innovation ability on the level of university scientific research: A case study of the nine-university alliance in china. Emerg Mark Financ Trade 58(1):134\u2013144","journal-title":"Emerg Mark Financ Trade"},{"key":"1284_CR45","doi-asserted-by":"crossref","unstructured":"Wang X, McCallum A (2006) Topics over time: a non-markov continuous-time model of topical trends. In: Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 424\u2013433","DOI":"10.1145\/1150402.1150450"},{"issue":"100","key":"1284_CR46","first-page":"810","volume":"50","author":"X Wang","year":"2021","unstructured":"Wang X, Lee Y, Lin L et al (2021) Analyzing instructional design quality and students\u2019 reviews of 18 courses out of the class central top 20 moocs through systematic and sentiment analyses. Int Higher Educ 50(100):810","journal-title":"Int Higher Educ"},{"key":"1284_CR47","unstructured":"Wen M, Yang D, Rose C (2014) Sentiment analysis in mooc discussion forums: What does it tell us? In: Educational data mining 2014, Citeseer"},{"key":"1284_CR48","unstructured":"Wold H (1966) Estimation of principal components and related models by iterative least squares. Multivar Anal, pp 391\u2013420"},{"key":"1284_CR49","unstructured":"Wold S (1995) Pls for multivariate linear modelling. van de waterbeemd h, editor chemometric methods in molecular design vch publishers"}],"container-title":["Computational Statistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-022-01284-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00180-022-01284-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-022-01284-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,31]],"date-time":"2024-01-31T18:03:04Z","timestamp":1706724184000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00180-022-01284-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,20]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,2]]}},"alternative-id":["1284"],"URL":"https:\/\/doi.org\/10.1007\/s00180-022-01284-7","relation":{},"ISSN":["0943-4062","1613-9658"],"issn-type":[{"type":"print","value":"0943-4062"},{"type":"electronic","value":"1613-9658"}],"subject":[],"published":{"date-parts":[[2022,9,20]]},"assertion":[{"value":"5 April 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 September 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}