{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T16:01:44Z","timestamp":1781107304613,"version":"3.54.1"},"reference-count":23,"publisher":"IGI Global Scientific Publishing","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2011,10,1]]},"abstract":"<p>This paper analyses and presents the new scientific models and methods for the expert evaluation of quality of learning objects (LOs) paying special attention to LOs reusability level. Currently all existing approaches in the area are quite subjective and depend only on the experience of the decision-makers. The authors analyse several scientific methods and principles to minimise the subjectivity level in the expert evaluation of LOs quality. They are: (a) the principles of multi-criteria decision analysis for identification of quality criteria, (b) technological quality criteria classification principle, (c) fuzzy group decision making theory to obtain evaluation measures, (d) normalisation of the weights of criteria, and (e) scalarisation method for LOs quality optimisation. The authors demonstrate that the complex application of these approaches could significantly improve the quality of the expert evaluation of LOs and noticeably reduce the level of the expert evaluation subjectivity. The paper also presents the example of practical application of these approaches for evaluation of LOs for Mathematics subject.<\/p>","DOI":"10.4018\/ijopcd.2011100105","type":"journal-article","created":{"date-parts":[[2011,10,19]],"date-time":"2011-10-19T12:43:48Z","timestamp":1319028228000},"page":"62-76","source":"Crossref","is-referenced-by-count":7,"title":["Application of Multiple Criteria Decision Analysis and Optimisation Methods in Evaluation of Quality of Learning Objects"],"prefix":"10.4018","volume":"1","author":[{"given":"Eugenijus","family":"Kurilovas","sequence":"first","affiliation":[{"name":"Vilnius University, Vilnius Gediminas Technical University, Lithuania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Irina","family":"Vinogradova","sequence":"additional","affiliation":[{"name":"Vilnius University, Vilnius Gediminas Technical University, Lithuania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Silvija","family":"Serikoviene","sequence":"additional","affiliation":[{"name":"Vilnius University, Lithuania"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"ijopcd.2011100105-0","unstructured":"Q4R. (2008). Quality for Reuse (Q4R). Retrieved from http:\/\/www.q4r.org"},{"key":"ijopcd.2011100105-1","unstructured":"Becta. (2007). Quality principles for digital learning resources. Retrieved from http:\/\/www.bee-it.co.uk\/downloads\/guidance-and-research\/doc_details\/140-quality-principles-for-digital-learning-resources.html"},{"key":"ijopcd.2011100105-2","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4615-1495-4","author":"V.Belton","year":"2002","journal-title":"Multiple criteria decision analysis: An integrated approach"},{"key":"ijopcd.2011100105-3","unstructured":"CALIBRATE. (2008). Learning resources for schools. Retrieved from http:\/\/calibrate.eun.org"},{"key":"ijopcd.2011100105-4","unstructured":"eQNet. (2010). Quality network for a European learning resource exchange. Retrieved from http:\/\/eqnet.eun.org"},{"key":"ijopcd.2011100105-5","unstructured":"European Schoolnet (EUN). A network of 31 ministries of education in Europe. Retrieved from http:\/\/eun.org"},{"issue":"3","key":"ijopcd.2011100105-6","doi-asserted-by":"crossref","first-page":"325","DOI":"10.15388\/Informatica.2006.141","article-title":"Methodology to evaluate the functionality of specification languages.","volume":"17","author":"J.Gasperovic","year":"2006","journal-title":"Informatica"},{"key":"ijopcd.2011100105-7","unstructured":"Haughey, M., & Muirhead, B. (2005). Evaluating learning objects for schools. Retrieved from http:\/\/www.ascilite.org.au\/ajet\/e-jist\/docs\/vol8_no1\/fullpapers\/eval_learnobjects_school.htm"},{"key":"ijopcd.2011100105-8","unstructured":"International Organization for Standardization. (1999). ISO\/IEC 14598-1:1999 Information technology \u2013 Software product evaluation \u2013 Part 1: General overview. Retrieved from http:\/\/www.iso.org\/iso\/iso_catalogue\/catalogue_tc\/catalogue_detail.htm?csnumber=24902"},{"key":"ijopcd.2011100105-9","first-page":"69","article-title":"Digital library of educational resources and services: Evaluation of components.","volume":"42-43","author":"E.Kurilovas","year":"2007","journal-title":"Informacijos Mokslai"},{"key":"ijopcd.2011100105-10","doi-asserted-by":"crossref","unstructured":"Kurilovas, E. (2009). Evaluation and optimisation of e-learning software packages: Learning object repositories. In Proceedings of the 4th International Conference on Software Engineering Advances (pp. 477-483).","DOI":"10.1109\/ICSEA.2009.93"},{"key":"ijopcd.2011100105-11","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03214-1_12"},{"key":"ijopcd.2011100105-12","doi-asserted-by":"crossref","unstructured":"Kurilovas, E. (2009). Learning objects reusability and their adaptation for blended learning. In Proceedings of the 5th International Conference on Networking and Services (pp. 542-547).","DOI":"10.1109\/ICNS.2009.49"},{"key":"ijopcd.2011100105-13","unstructured":"Kurilovas, E., & Dagiene, V. (2009). Learning objects and virtual learning environments technical evaluation criteria. Electronic Journal of e-Learning, 7(2), 127-136."},{"issue":"4","key":"ijopcd.2011100105-14","doi-asserted-by":"crossref","first-page":"499","DOI":"10.15388\/Informatica.2009.263","article-title":"Multiple criteria comparative evaluation of e-learning systems and components.","volume":"20","author":"E.Kurilovas","year":"2009","journal-title":"Informatica"},{"key":"ijopcd.2011100105-15","unstructured":"Kurilovas, E., & Dagiene, V. (2009). Quality evaluation and optimisation of e-learning system components. In Proceedings of the 8th European Conference on e-Learning (pp. 315-324)."},{"issue":"2","key":"ijopcd.2011100105-16","first-page":"44","article-title":"A framework for evaluating the quality of multimedia learning resources.","volume":"10","author":"T. L.Leacock","year":"2007","journal-title":"Journal of Educational Technology & Society"},{"key":"ijopcd.2011100105-17","unstructured":"LRE. (2010). European learning resource exchange service for schools. Retrieved from http:\/\/lreforschools.eun.org\/LRE-Portal\/Index.iface"},{"key":"ijopcd.2011100105-18","unstructured":"McCormick, R., Scrimshaw, P., Li, N., & Clifford, C. (2004). CELEBRATE evaluation report. Retrieved from http:\/\/celebrate.eun.org\/eun.org2\/eun\/Include_to_content\/celebrate\/file\/Deliverable7_2EvaluationReport02Dec04.pdf"},{"key":"ijopcd.2011100105-19","unstructured":"MELT. (2008). EU eContentplus programme\u2019s MELT: Metadata Ecology for Learning and Teaching. Retrieved from http:\/\/melt-project.eun.org"},{"issue":"1","key":"ijopcd.2011100105-20","first-page":"49","article-title":"Evaluation framework based on fuzzy measured method in adaptive learning system.","volume":"1","author":"H. Z.Ounaies","year":"2009","journal-title":"Themes in Science and Technology Education"},{"key":"ijopcd.2011100105-21","unstructured":"Paulsson, F., & Naeve, A. (2006). Establishing technical quality criteria for learning objects. Retrieved from http:\/\/www.frepa.org\/wp\/wp-content\/files\/Paulsson-Establ-Tech-Qual_finalv1.pdf"},{"issue":"3","key":"ijopcd.2011100105-22","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1080\/1206212X.2003.11441703","article-title":"Learning object evaluation: Computer mediated collaboration and inter\u2013rater reliability.","volume":"25","author":"J.Vargo","year":"2003","journal-title":"International Journal of Computers and Applications"}],"container-title":["International Journal of Online Pedagogy and Course Design"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=58663","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,1]],"date-time":"2022-06-01T19:22:20Z","timestamp":1654111340000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/ijopcd.2011100105"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2011,10,1]]},"references-count":23,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2011,10]]}},"URL":"https:\/\/doi.org\/10.4018\/ijopcd.2011100105","relation":{},"ISSN":["2155-6873","2155-6881"],"issn-type":[{"value":"2155-6873","type":"print"},{"value":"2155-6881","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,10,1]]}}}