{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T04:53:56Z","timestamp":1772772836041,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,1,26]],"date-time":"2021-01-26T00:00:00Z","timestamp":1611619200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["71671125"],"award-info":[{"award-number":["71671125"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Evaluation of online teaching quality has become an important issue because many universities are turning to online classes due to the Corona Virus Disease 2019 (COVID-19) pandemic. In this paper, online teaching quality evaluation is considered as a linguistic multi-attribute group decision-making (MAGDM) problem. Generally, the evaluation sematic information can be symmetrically or asymmetrically distributed in linguistic term sets. Thus, an extended linguistic MAGDM framework is proposed for evaluating online teaching quality. As the main contribution, the proposed method takes into account the risk preferences of assessment experts (AEs) and unknown weight information of attributes and sub-attributes. To be specific, the Delphi method is employed to establish a multi-level evaluation indicator system (EIS) of online teaching quality. Then, by introducing the group generalized linguistic term set (GLTS) with two risk preference parameters, a two-stage optimization model is developed to calculate the weights of attributes and sub-attributes objectively. Subsequently, the linguistic MAGDM framework was divided into two stages. The first stage maximizes the group comprehensive rating values of teachers on different attributes to obtain partial ranking results for teachers on each attribute. The latter stage maximizes the group comprehensive rating values of teachers to evaluate the overall quality. Finally, a case study is provided to illustrate how to apply the framework to evaluate online teaching quality.<\/jats:p>","DOI":"10.3390\/sym13020192","type":"journal-article","created":{"date-parts":[[2021,1,26]],"date-time":"2021-01-26T08:29:16Z","timestamp":1611649756000},"page":"192","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Evaluation of Online Teaching Quality: An Extended Linguistic MAGDM Framework Based on Risk Preferences and Unknown Weight Information"],"prefix":"10.3390","volume":"13","author":[{"given":"Hui","family":"Lin","sequence":"first","affiliation":[{"name":"School of Economics and Management, Tongji University, Shanghai 200092, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianxin","family":"You","sequence":"additional","affiliation":[{"name":"School of Economics and Management, Tongji University, Shanghai 200092, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0834-2211","authenticated-orcid":false,"given":"Tao","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Economics and Management, Tongji University, Shanghai 200092, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,26]]},"reference":[{"key":"ref_1","unstructured":"Huang, R., Liu, D., and Zhan, T. (2020). Guidance on Flexible Learning during Campus Closures: Ensuring Course Quality of Higher Education in COVID-19 Outbreak, Beijing Smart Learning Institute of Beijing Normal University."},{"key":"ref_2","unstructured":"Wang, X. (2020, May 21). Online Teaching Launched on a Massive Scale, this Year may Usher in the First Year of a New Wave of Change in Higher Education. Available online: http:\/\/www.whb.cn\/zhuzhan\/xue\/20200521\/349052.html."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4929","DOI":"10.12973\/eurasia.2017.00966a","article-title":"A Heterogeneous Linguistic MAGDM Framework to Classroom Teaching Quality Evaluation","volume":"13","author":"Zhang","year":"2017","journal-title":"Eurasia J. Math. Sci. Technol. Educ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"42","DOI":"10.3991\/ijet.v10i8.5219","article-title":"The Application of Grey-TOPSIS Method on Teaching Quality Evaluation of the Higher Education","volume":"10","author":"Song","year":"2015","journal-title":"Int. J. Emerg. Technol. Learn."},{"key":"ref_5","first-page":"2603","article-title":"Research on Fuzzy Comprehensive Evaluation of Teaching Quality of College Public Physical Education based on Grey System Theory","volume":"28","author":"Ma","year":"2017","journal-title":"Agro Food Ind. Hi-Tech"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Faizi, S., Sa\u0142abun, W., Rashid, T., Watrobski, J., and Zafar, S. (2017). Group decision-making for hesitant fuzzy sets based on Characteristic Objects Method. Symmetry, 9.","DOI":"10.3390\/sym9080136"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Faizi, S., Sa\u0142abun, W., Rashid, T., Zafar, S., and Watrobski, J. (2020). Intuitionistic fuzzy sets in multi-criteria group decision making problems using the Characteristic Objects Method. Symmetry, 12.","DOI":"10.3390\/sym12091382"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.asoc.2014.11.050","article-title":"Evaluating teaching performance based on fuzzy AHP and comprehensive evaluation approach","volume":"28","author":"Chen","year":"2015","journal-title":"Appl. Soft. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.12973\/eurasia.2016.1510a","article-title":"A Multi Criteria Group Decision-making Model for Teacher Evaluation in Higher Education Based on Cloud Model and Decision Tree","volume":"12","author":"Chang","year":"2016","journal-title":"Eurasia J. Math. Sci. Technol. Educ."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1057\/s41274-016-0165-4","article-title":"Evaluating higher education teaching performance using combined analytic hierarchy process and data envelopment analysis","volume":"68","author":"Thanassoulis","year":"2017","journal-title":"J. Oper. Res. Soc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3065","DOI":"10.3233\/JIFS-169661","article-title":"Fuzzy comprehensive evaluation of physical education based on high dimensional data mining","volume":"35","author":"Wang","year":"2018","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.nedt.2018.09.021","article-title":"Based on Delphi method and Analytic Hierarchy Process to construct the Evaluation Index system of nursing simulation teaching quality","volume":"79","author":"Shen","year":"2019","journal-title":"Nurse Educ. Today"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.nedt.2019.03.012","article-title":"Evaluating the quality of simulation teaching in Fundamental Nursing Curriculum: AHP-Fuzzy comprehensive evaluation","volume":"77","author":"Yang","year":"2019","journal-title":"Nurse Educ. Today"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3091","DOI":"10.3233\/JIFS-169663","article-title":"Design of teaching quality evaluation model based on fuzzy mathematics and SVM algorithm","volume":"35","author":"Kong","year":"2018","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1588","DOI":"10.1002\/int.22109","article-title":"Research on the assessment of classroom teaching quality with q-rung orthopair fuzzy information based on multiparametric similarity measure and combinative distance-based assessment","volume":"34","author":"Peng","year":"2019","journal-title":"Int. J. Intell. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1109\/91.890332","article-title":"A 2-tuple fuzzy linguistic representation model for computing with words","volume":"8","author":"Herrera","year":"2000","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1109\/TFUZZ.2006.876337","article-title":"A new version of 2-tuple. fuzzy linguistic, representation model for computing with words","volume":"14","author":"Wang","year":"2006","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1366","DOI":"10.1109\/TFUZZ.2009.2032172","article-title":"Computing the Numerical Scale of the Linguistic Term Set for the 2-Tuple Fuzzy Linguistic Representation Model","volume":"17","author":"Dong","year":"2009","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1109\/TFUZZ.2011.2170076","article-title":"Hesitant Fuzzy Linguistic Term Sets for Decision Making","volume":"20","author":"Rodriguez","year":"2012","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.ins.2016.06.003","article-title":"Connecting the linguistic hierarchy and the numerical scale for the 2-tuple linguistic model and its use to deal with hesitant unbalanced linguistic information","volume":"367","author":"Dong","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.inffus.2016.04.005","article-title":"Personalized individual semantics in computing with words for supporting linguistic group decision making. An application on consensus reaching","volume":"33","author":"Li","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2312","DOI":"10.1109\/TFUZZ.2019.2898155","article-title":"Type-2 Fuzzy Envelope of Hesitant Fuzzy Linguistic Term Set: A New Representation Model of Comparative Linguistic Expression","volume":"27","author":"Liu","year":"2019","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1775","DOI":"10.3233\/JIFS-17145","article-title":"Linguistic multi-attribute decision making with considering decision makers\u2019 risk preferences","volume":"33","author":"Lin","year":"2017","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1016\/j.ejor.2016.04.001","article-title":"Generalized asymmetric linguistic term set and its application to qualitative decision making involving risk appetites","volume":"254","author":"Zhou","year":"2016","journal-title":"Eur. J. Oper. Res."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lin, H., and Wang, Z.J. (2017). Linguistic Multi-Attribute Group Decision Making with Risk Preferences and Its Use in Low-Carbon Tourism Destination Selection. Int. J. Environ. Res. Public Health, 14.","DOI":"10.3390\/ijerph14091078"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"5351","DOI":"10.3233\/JIFS-190509","article-title":"Multi-attribute decision making method based on single-valued neutrosophic linguistic variables and prospect theory","volume":"37","author":"Guo","year":"2019","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ma, Z.Z., Zhu, J.J., and Zhang, S.T. (2020). Probabilistic-based expressions in behavioral multi-attribute decision making considering pre-evaluation. Fuzzy Optim. Decis. Mak.","DOI":"10.1007\/s10700-020-09335-8"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.inffus.2020.05.003","article-title":"A Choquet integral-based hesitant fuzzy gained and lost dominance score method for multi-criteria group decision making considering the risk preferences of experts: Case study of higher business education evaluation","volume":"62","author":"Liao","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bashir, Z., Rashid, T., Watrobski, J., Sa\u0142abun, W., and Malik, A. (2018). Hesitant probabilistic multiplicative preference relations in group decision making. Appl. Sci., 8.","DOI":"10.3390\/app8030398"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2319","DOI":"10.1007\/s40815-020-00944-4","article-title":"Multiplicative consistency adjustment model and data envelopment analysis-driven decision-making process with probabilistic hesitant fuzzy preference relations","volume":"22","author":"Jin","year":"2020","journal-title":"Int. J. Fuzzy Syst."},{"key":"ref_31","first-page":"392","article-title":"Fuzzy Multi-Attribute Group Decision Making Method Based on Interval Type-2 Fuzzy Sets and Applications to Global Supplier Selection","volume":"15","author":"Gong","year":"2013","journal-title":"Int. J. Fuzzy Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.ins.2016.07.058","article-title":"Intuitionistic fuzzy multi-attribute group decision-making with an application to plant location selection based on a new extended VIKOR method","volume":"370","author":"Gupta","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1007\/s40815-018-0527-y","article-title":"Multiple attribute group decision making with linguistic variables and complete unknown weight information","volume":"16","author":"Wang","year":"2019","journal-title":"Iran J. Fuzzy Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"5979","DOI":"10.3233\/JIFS-179684","article-title":"Multi-attribute decision making using grey relational projection method based on interval type-2 trapezoidal fuzzy numbers","volume":"38","author":"Touqeer","year":"2020","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.omega.2004.04.008","article-title":"Deviation measures of linguistic preference relations in group decision making","volume":"33","author":"Xu","year":"2005","journal-title":"Omega Int. J. Manag. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0165-0114(97)00377-1","article-title":"Extensions of the TOPSIS for group decision-making under fuzzy environment","volume":"114","author":"Chen","year":"2000","journal-title":"Fuzzy Sets Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/0165-0114(92)90223-Q","article-title":"Ranking Fuzzy Numbers with Integral Value","volume":"50","author":"Liou","year":"1992","journal-title":"Fuzzy Sets Syst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sa\u0142abun, W., Watrobski, J., and Shekhovtsov, A. (2020). Are MCDA methods benchmarkable? A comparative study of TOPSIS, VIKOR, COPRAS, and PROMETHEE II methods. Symmetry, 12.","DOI":"10.3390\/sym12091549"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/2\/192\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:15:26Z","timestamp":1760159726000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/2\/192"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,26]]},"references-count":38,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["sym13020192"],"URL":"https:\/\/doi.org\/10.3390\/sym13020192","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,26]]}}}