{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:15:45Z","timestamp":1754158545844,"version":"3.41.2"},"reference-count":29,"publisher":"Emerald","issue":"5","license":[{"start":{"date-parts":[[2017,10,2]],"date-time":"2017-10-02T00:00:00Z","timestamp":1506902400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["EL"],"published-print":{"date-parts":[[2017,10,2]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>This paper aims to address the need to ensure the quality of metadata records describing learning resources. We propose improvements to a metadata-quality model, specifically for the compliance sub-feature of the functionality feature. Compliance is defined as adherence level of the learning object metadata content to the metadata standard used for its specification. The paper proposes metrics to assess the compliance, which are applied to a set of learning objects, showing their applicability and usefulness in activities related to resources management.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>The methodology considers a first stage of metrics refinement to obtain the indicator of the sub-feature compliance. The next stage is the proposal evaluation, where it is determined if metrics can be used as a conformity indicator of learning object metadata with a standard (metadata compliance). The usefulness of this indicator in the information retrieval area is approached through an assessment of learning objects where the quality level of its metadata and the ranking in which they are retrieved by a repository are correlated.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>This study confirmed that the best results for metrics of standardization, completeness, congruence, coherence, correctness and understandability, which determine the compliance indicator, were obtained for learning objects whose metadata were better labelled. Moreover, it was found that the learning objects with the highest level of compliance indicator have better positions in the ranking when a repository retrieves them through an exact search based on metadata.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Research limitations\/implications<\/jats:title>\n<jats:p>In this study, only a sub-feature of the quality model is detailed, specifically the compliance of learning object standard. Another limitation was the size of the learning objects set used in the experiment.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Practical implications<\/jats:title>\n<jats:p>This proposal is independent from any metadata standard and can be applied to improve processes associated with the management of learning objects in a repository-like retrieval and recommendation.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>The originality and value of this proposal are related to quality of learning object metadata considered from a holistic point of view through six metrics. These metrics quantify both technical and pedagogical aspects through automatic evaluation and supported by experts. In addition, the applicability of the indicator in recovery systems is shown, by example to be incorporated as an additional criterion in the learning object ranking.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/el-10-2015-0202","type":"journal-article","created":{"date-parts":[[2017,8,11]],"date-time":"2017-08-11T07:13:48Z","timestamp":1502435628000},"page":"953-976","source":"Crossref","is-referenced-by-count":1,"title":["Towards a holistic model for quality of learning object repositories"],"prefix":"10.1108","volume":"35","author":[{"given":"Christian","family":"Vidal-Castro","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alejandra Andrea","family":"Segura Navarrete","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Victor","family":"Menendez-Dominguez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Claudia","family":"Martinez-Araneda","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"first-page":"69","article-title":"The evolution of metadata from standards to semantics in e-learning applications","year":"2006","key":"key2020120502581275900_ref001"},{"key":"key2020120502581275900_ref002","unstructured":"Asociaci\u00f3n Espa\u00f1ola de Normalizaci\u00f3n (AENOR) (2016), \u201cPerfil de aplicaci\u00f3n LOM\u201d, Espa\u00f1a, available at: www.aenor.es (accessed 5 September 2015) (in Spanish)."},{"volume-title":"Evaluation of Educational Environments: The TUP Model","year":"2002","key":"key2020120502581275900_ref003"},{"key":"key2020120502581275900_ref004","first-page":"118","article-title":"Learning object reusability metrics: some ideas from software engineering","volume-title":"International Conference on Internet Technologies and Applications ITA","year":"2005"},{"issue":"1\/2","key":"key2020120502581275900_ref005","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1108\/03055720510588533","article-title":"Evaluating 5\/99 content for reusability as learning objects","volume":"35","year":"2005","journal-title":"Vine"},{"year":"2010","key":"key2020120502581275900_ref006","article-title":"Factors affecting re-usability of learning objects across national boundaries: an exploratory study of information organization and knowledge management"},{"key":"key2020120502581275900_ref008","unstructured":"IMS GLC (2007), \u201cIMS content packaging specification version 1.2 public draft v2.0\u201d, available at: www.imsglobal.org\/content\/packaging\/index.html (accessed 15 September 2015)."},{"volume-title":"ISO\/IEC Standard 9126: Software Product Evaluation-Quality Characteristics and Guidelines for their Use","year":"2001","author":"International Standards Organization (ISO)","key":"key2020120502581275900_ref007"},{"issue":"1","key":"key2020120502581275900_ref009","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","year":"1977","journal-title":"Biometrics"},{"issue":"2","key":"key2020120502581275900_ref010","first-page":"44","article-title":"A framework for evaluating the quality of multimedia learning resources","volume":"10","year":"2007","journal-title":"Educational Technology & Society"},{"volume-title":"IEEE Learning Object Metadata","year":"2002","author":"Learning Technology Standards Committee (LTSC)","key":"key2020120502581275900_ref011"},{"issue":"9","key":"key2020120502581275900_ref012","first-page":"21","article-title":"Learning objects: a practical definition","volume":"1","year":"2004","journal-title":"International Journal of Instructional Technology and Distance Learning"},{"key":"key2020120502581275900_ref013","first-page":"31","article-title":"Evaluaci\u00f3n y selecci\u00f3n de software educativo","volume":"185","year":"2000","journal-title":"Comunicaci\u00f3n y Pedagog\u00eda"},{"article-title":"Un modelo de calidad de objetos de aprendizaje basado en la sem\u00e1ntica de sus metadatos","volume-title":"7a Conferencia Latinoamericana de Objetos Y Tecnolog\u00edas de Aprendizaje (LACLO\u201912)","year":"2012","key":"key2020120502581275900_ref014"},{"issue":"2","key":"key2020120502581275900_ref015","first-page":"56","article-title":"Sistemas de gesti\u00f3n integral de objetos de aprendizaje","volume":"5","year":"2010","journal-title":"IEEE-RITA"},{"issue":"3","key":"key2020120502581275900_ref016","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1504\/IJTEL.2009.024866","article-title":"Learning objects quality management for e-learning systems","volume":"1","year":"2009","journal-title":"International Journal of Technology Enhanced Learning"},{"key":"key2020120502581275900_ref017","first-page":"961","article-title":"A metrics suite for measuring reusability of learning objects","volume-title":"ISDA 2009 - 9th International Conference on Intelligent Systems Design and Applications","year":"2009"},{"key":"key2020120502581275900_ref018","first-page":"1004","article-title":"Quality metrics for learning object metadata","volume-title":"Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications","year":"2006"},{"key":"key2020120502581275900_ref019","first-page":"1585","article-title":"Metadata quality in learning repositories: Issues and considerations","volume-title":"Proceedings of ED-MEDIA 2011 \u2013 World Conference on Educational Multimedia, Hypermedia & Telecommunications","year":"2011"},{"issue":"1","key":"key2020120502581275900_ref020","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1108\/EL-12-2011-0175","article-title":"Metadata quality in learning object repositories: a case study","volume":"32","year":"2014","journal-title":"The Electronic Library"},{"key":"key2020120502581275900_ref021","first-page":"314","article-title":"A recommender system architecture for instructional engineering","volume-title":"Emerging Technologies and Information Systems for the Knowledge Society","year":"2008"},{"first-page":"362","article-title":"Quality assessment for collections of learning resources","year":"2003","key":"key2020120502581275900_ref022"},{"issue":"0","key":"key2020120502581275900_ref023","first-page":"30","article-title":"A preliminary analysis of software engineering metrics-based criteria for the evaluation of learning objects reusability","volume":"4","year":"2009","journal-title":"International Journal of Emerging Technologies in Learning (iJET)"},{"key":"key2020120502581275900_ref024","first-page":"219","article-title":"Evaluaci\u00f3n aprior\u00edstica de la reusabilidad de los objetos de aprendizaje","volume-title":"V Simposio Pluridisciplinar Sobre Dise\u00f1o Y Evaluaci\u00f3n de Contenidos Educativos Reutilizables (SPDECE 2008)","year":"2010"},{"first-page":"59","article-title":"Evaluaci\u00f3n de la calidad del software para el aprendizaje","year":"2008","key":"key2020120502581275900_ref025"},{"issue":"3","key":"key2020120502581275900_ref026","first-page":"183","article-title":"Evaluaci\u00f3n de la calidad de metadatos en repositorios digitales de objetos de aprendizaje","volume":"36","year":"2013","journal-title":"Revista Interamericana de Bibliotecolog\u00eda"},{"key":"key2020120502581275900_ref027","first-page":"2","article-title":"Likert scales: dispelling the confusion","volume":"2010","year":"2006","journal-title":"Statistical Methods for Rater Agreement Website"},{"article-title":"Calidad en objetos de aprendizaje","volume-title":"V Simposio Pluridisciplinar Sobre Dise\u00f1o Y Evaluaci\u00f3n de Contenidos Educativos Reutilizables","year":"2008","key":"key2020120502581275900_ref028"},{"key":"key2020120502581275900_ref029","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1007\/978-3-642-16552-8_31","article-title":"Quality in learning objects: evaluating compliance with metadata standards","volume":"108","year":"2010","journal-title":"Communications in Computer and Information Science"}],"container-title":["The Electronic Library"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/EL-10-2015-0202\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/EL-10-2015-0202\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T01:08:11Z","timestamp":1753405691000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/el\/article\/35\/5\/953-976\/97426"}},"subtitle":["A practical application to the indicator of metadata compliance"],"short-title":[],"issued":{"date-parts":[[2017,10,2]]},"references-count":29,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2017,10,2]]}},"alternative-id":["10.1108\/EL-10-2015-0202"],"URL":"https:\/\/doi.org\/10.1108\/el-10-2015-0202","relation":{},"ISSN":["0264-0473"],"issn-type":[{"type":"print","value":"0264-0473"}],"subject":[],"published":{"date-parts":[[2017,10,2]]}}}