{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T22:00:57Z","timestamp":1780783257759,"version":"3.54.1"},"reference-count":54,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2010,8,15]],"date-time":"2010-08-15T00:00:00Z","timestamp":1281830400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Software Qual J"],"published-print":{"date-parts":[[2011,3]]},"DOI":"10.1007\/s11219-010-9108-5","type":"journal-article","created":{"date-parts":[[2010,8,14]],"date-time":"2010-08-14T07:57:56Z","timestamp":1281772676000},"page":"121-140","source":"Crossref","is-referenced-by-count":18,"title":["Metrics-based evaluation of learning object reusability"],"prefix":"10.1007","volume":"19","author":[{"given":"Javier","family":"Sanz-Rodriguez","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan Manuel","family":"Dodero","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Salvador","family":"Sanchez-Alonso","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2010,8,15]]},"reference":[{"key":"9108_CR1","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1023\/B:SQJO.0000042058.34876.c8","volume":"7","author":"J Barnard","year":"1998","unstructured":"Barnard, J. (1998). A new reusability metric for object-oriented software. Software Quality Journal, 7, 35\u201350.","journal-title":"Software Quality Journal"},{"issue":"12","key":"9108_CR2","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1057\/palgrave.jors.2600474","volume":"48","author":"J Barzilai","year":"1997","unstructured":"Barzilai, J. (1997). Deriving weights from pairwise comparison matrices. The Journal of the Operational Research Society, 48(12), 1226\u20131232.","journal-title":"The Journal of the Operational Research Society"},{"key":"9108_CR3","unstructured":"Benneker, F. (2006). A quick scan on possibilities for automatic metadata generation. Technical report, Utrecht, The Netherlands: Stichting Digitale Universiteit. http:\/\/hdl.handle.net\/1820\/802 . Accessed 14 May 2010."},{"issue":"1","key":"9108_CR4","first-page":"46","volume":"19","author":"T Boyle","year":"2003","unstructured":"Boyle, T. (2003). Design principles for authoring dynamic, reusable learning objects. Australian Journal of Educational Technology, 19(1), 46\u201358.","journal-title":"Australian Journal of Educational Technology"},{"issue":"2","key":"9108_CR5","first-page":"313","volume":"14","author":"R Cafolla","year":"2006","unstructured":"Cafolla, R. (2006). Project Merlot: Bringing Peer Review to Web-based Educational Resources. Journal of Technology and Teacher Education, 14(2), 313\u2013323.","journal-title":"Journal of Technology and Teacher Education"},{"key":"9108_CR6","first-page":"35","volume-title":"Reusing online resources: A sustainable approach to e-learning","author":"L Campbell","year":"2003","unstructured":"Campbell, L. (2003). Engaging with the learning object economy. In A. Littlejohn (Ed.), Reusing online resources: A sustainable approach to e-learning (pp. 35\u201345). London: Kogan Page."},{"key":"9108_CR7","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1007\/978-0-387-77745-0_13","volume-title":"Metadata and semantics research","author":"JF Cervera","year":"2009","unstructured":"Cervera, J. F., Lopez, M. G., Fernandez, C., & Sanchez-Alonso, S. (2009). Quality metrics in learning objects. In F. Sartori, M. A. Sicilia, & N. Manouselis (Eds.), Metadata and semantics research (pp. 135\u2013141). Berlin, Heidelberg: Springer."},{"key":"9108_CR8","unstructured":"Chang, K. (2006). Learning objects: Draft quality criteria and quality assurance approach for learnalberta.ca and the society of advancement of excellence in education, futured consulting education futurists. Inc. Technical report, http:\/\/www.futured.com\/QualityStandardsforLearningObjects.pdf.pdf . Accessed 14 May 2010."},{"key":"9108_CR9","volume-title":"Software engineering metrics and models","author":"SD Conte","year":"1989","unstructured":"Conte, S. D., Dunsmore, H. E., & Shen, V. Y. (1989). Software engineering metrics and models. San Francisco: Benjamin Cummings."},{"key":"9108_CR10","unstructured":"Cuadrado-Gallego, J. J., & Sicilia, M. A. (2005). Learning objects reusability metrics: Some ideas from software engineering, In Proceedings of the international conference on internet technologies and applications. Wreham, UK: North East Wales Institute."},{"key":"9108_CR11","unstructured":"Currier, S., & Campbell, L. (2002). Evaluating learning resources for reusability: The dner and learning objects study. In Proceeding of the Australasian society for computers in learning in tertiary education, Auckland, New Zeland."},{"key":"9108_CR12","doi-asserted-by":"crossref","unstructured":"Daniel, B., & Mohan, P. (2004). A model for evaluating learning objects. In Proceedings of the IEEE international conference on advanced learning technologies (pp. 50\u201360).","DOI":"10.1109\/ICALT.2004.1357374"},{"key":"9108_CR13","doi-asserted-by":"crossref","unstructured":"Downes, S. (2001). Learning objects: Resources for distance education worldwide. International Review of Research in Open and Distance Learning, 2(1).","DOI":"10.19173\/irrodl.v2i1.32"},{"issue":"1","key":"9108_CR14","doi-asserted-by":"crossref","first-page":"33","DOI":"10.2298\/CSIS0401033D","volume":"1","author":"E Duval","year":"2004","unstructured":"Duval, E. (2004). Learning technology standardization: Making sense of it all. International Journal on Computer Science and Information Systems, 1(1), 33\u201343.","journal-title":"International Journal on Computer Science and Information Systems"},{"issue":"5","key":"9108_CR15","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1145\/374308.374346","volume":"44","author":"E Duval","year":"2001","unstructured":"Duval, E., Warkentyne, K., Haenni, F., Forte, E., Cardinaels, K., Verhoeven, B., et al. (2001). The ariadne knowledge pool system. Communications of the ACM, 44(5), 72\u201378.","journal-title":"Communications of the ACM"},{"issue":"5","key":"9108_CR16","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/S0950-5849(00)00169-5","volume":"43","author":"LH Etzkorn","year":"2001","unstructured":"Etzkorn, L. H., Hughes, W. E., & Davis, C. G. (2001). Automated reusability quality analysis. Information and Software Technology, 43(5), 295\u2013308.","journal-title":"Information and Software Technology"},{"key":"9108_CR17","volume-title":"Software metrics","author":"NE Fenton","year":"1997","unstructured":"Fenton, N. E., & Pfleeger, S. L. (1997). Software metrics (3rd ed.). Boston, Massachusetts: International Thompson Publishing.","edition":"3"},{"key":"9108_CR18","doi-asserted-by":"crossref","unstructured":"Friesen, N. (2009). Open educational resources: New possibilities for change and sustainability. International Review of Research in Open and Distance Learning, 10(5).","DOI":"10.19173\/irrodl.v10i5.664"},{"key":"9108_CR19","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1007\/978-3-642-04590-5_10","volume-title":"Metadata and semantics research","author":"E Garcia","year":"2009","unstructured":"Garcia, E., & Sicilia, M. A. (2009). Preliminary explorations on the statistical profiles of highly-rated learning objects. In F. Sartori, M. A. Sicilia, & N. Manouselis (Eds.), Metadata and semantics research (pp. 108\u2013117). Berlin, Heidelberg: Springer."},{"issue":"1","key":"9108_CR20","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/0164-1212(94)00077-Z","volume":"28","author":"RL Glass","year":"1995","unstructured":"Glass, R. L. (1995). A structure-based critique of contemporary computing research. Journal of Systems and Software, 28(1), 3\u20137.","journal-title":"Journal of Systems and Software"},{"key":"9108_CR21","doi-asserted-by":"crossref","unstructured":"Huddlestone, J., & Pike, J. (2005). Learning object reuse\u2014A four tier model. In the IEE and MOD HFI DTC symposium on people and systems\u2014who are we designing for, London.","DOI":"10.1049\/ic:20050447"},{"key":"9108_CR22","volume-title":"Std. 610.12\u20131990. Standard glossary of software engineering terminology","author":"IEEE","year":"1993","unstructured":"IEEE. (1993). Std. 610.12\u20131990. Standard glossary of software engineering terminology. Los Alamitos,CA, USA: IEEE Computer Society Press."},{"key":"9108_CR23","unstructured":"IEEE learning technology standards committee. (2002). Standard for learning object metadata, http:\/\/ltsc.ieee.org\/wg12 . Accessed 1 October 2009."},{"issue":"1","key":"9108_CR24","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/02680510601100135","volume":"22","author":"R Kay","year":"2007","unstructured":"Kay, R., & Knaack, L. (2007). Evaluating the learning in learning objects, open learning. The Journal of Open and Distance Learning, 22(1), 5\u201328.","journal-title":"The Journal of Open and Distance Learning"},{"issue":"6","key":"9108_CR25","first-page":"1000","volume":"96","author":"CM Kelty","year":"2008","unstructured":"Kelty, C. M., Burrus, C. S., & Baraniuk, R. G. (2008). Peer review anew: Three principles and a case study in postpublication quality assurance. Proceedings of the IEEE Special Issue on Educational Technology, 96(6), 1000\u20131011.","journal-title":"Proceedings of the IEEE Special Issue on Educational Technology"},{"key":"9108_CR26","first-page":"46","volume-title":"Reusing online resources: A sustainable approach to elearning","author":"R Koper","year":"2003","unstructured":"Koper, R. (2003). Combining reusable learning resources and services to pedagogical purposeful units of learning. In A. Littlejohn (Ed.), Reusing online resources: A sustainable approach to elearning (pp. 46\u201359). London: Kogan Page."},{"key":"9108_CR27","doi-asserted-by":"crossref","unstructured":"Kumar, V., Nesbit, J. C., & Han, K. (2005). Rating learning object quality with distributed bayesian belief networks: The why and the how. In Fifth IEEE international conference on advanced learning technologies (pp. 685\u2013687).","DOI":"10.1109\/ICALT.2005.230"},{"key":"9108_CR28","doi-asserted-by":"crossref","unstructured":"Margaritopoulos, T., Margaritopoulos, M., Mavridis, I., & Manitsaris, A. (2009). A fine grained metric system for the completeness of metadata. In Proceedings of third international conference metadata and semantic research, MTSR (pp. 83\u201394). Milan, Italy.","DOI":"10.1007\/978-3-642-04590-5_8"},{"issue":"6","key":"9108_CR29","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1109\/91.890347","volume":"8","author":"JL Marichal","year":"2000","unstructured":"Marichal, J. L. (2000). An axiomatic approach of the discrete choquet integral as a tool to aggregate interacting criteria. IEEE Transactions on Fuzzy Systems, 8(6), 800\u2013807.","journal-title":"IEEE Transactions on Fuzzy Systems"},{"key":"9108_CR30","unstructured":"Massart, D. (2009). Adopting standards and specifications for educational content. Technical report, European Commission\u2019s eContentplus programme, http:\/\/aspect-project.org\/ ."},{"key":"9108_CR31","volume-title":"Online education using learning objects","author":"JC Nesbit","year":"2004","unstructured":"Nesbit, J. C., & Belfer, K. (2004). Collaborative evaluation of learning objects. In R. McGreal (Ed.), Online education using learning objects. London: Routledge\/Falmer."},{"issue":"5","key":"9108_CR32","first-page":"102","volume":"3","author":"JC Nesbit","year":"2006","unstructured":"Nesbit, J. C., Li, J., & Leacock, T. (2006). Web-based tools for collaborative evaluation of learning resources. Journal on Systemics, Cybernetics and Informatics, 3(5), 102\u2013112.","journal-title":"Journal on Systemics, Cybernetics and Informatics"},{"key":"9108_CR33","doi-asserted-by":"crossref","unstructured":"Ochoa, X., & Duval, E. (2007). Relevance ranking metrics for learning objects. In Proceedings of the second European conference on technology enhanced learning (Vol. 4753, pp. 262\u2013276). Springer.","DOI":"10.1007\/978-3-540-75195-3_19"},{"key":"9108_CR34","doi-asserted-by":"crossref","unstructured":"Ochoa, X., & Duval, E. (2008). Measuring learning object reuse, In Proceedings of the 3rd European conference on technology enhanced learning: Times of convergence, Springer-Verlag, Vol. 5192, Lecture Notes in Computer Science, pp. 322\u2013325.","DOI":"10.1007\/978-3-540-87605-2_36"},{"issue":"3","key":"9108_CR35","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1109\/TLT.2009.28","volume":"2","author":"X Ochoa","year":"2009","unstructured":"Ochoa, X., & Duval, E. (2009). Quantitative analysis of learning object repositories. IEEE Transactions on Learning Technologies, 2(3), 226\u2013238.","journal-title":"IEEE Transactions on Learning Technologies"},{"key":"9108_CR36","doi-asserted-by":"crossref","unstructured":"Omosule, S., Shoniregun, C., & Preston, D. (2008).A framework for culture influence virtual learning environments trust. Third international conference on digital information management, ICDIM (pp. 411\u2013416). London, UK.","DOI":"10.1109\/ICDIM.2008.4746777"},{"key":"9108_CR37","unstructured":"Palmer, K., & Richardson, P. (2004). Learning object reusability\u2014motivation, production and use. In 11th international conference of the association for learning technology. Devon, England:University of Exeter."},{"key":"9108_CR38","doi-asserted-by":"crossref","unstructured":"Pitkanen, S. H., & Silander, P. (2004). Criteria for pedagogical reusability of learning objects enabling adaptation and individualised learning processes. In Proceedings of the IEEE international conference on advanced learning technologies (pp. 246\u2013250). Joensuu, Finland.","DOI":"10.1109\/ICALT.2004.1357412"},{"key":"9108_CR39","unstructured":"Polsani, P. R. (2003). Use and abuse of reusable learning objects. Journal of Digital Information, 3(4)."},{"key":"9108_CR40","volume-title":"Measuring software reuse: Principles, practices, and economic models","author":"J Poulin","year":"1996","unstructured":"Poulin, J. (1996). Measuring software reuse: Principles, practices, and economic models. Boston, Massachusetts: Addison-Wesley Longman Publishing."},{"key":"9108_CR41","doi-asserted-by":"crossref","unstructured":"Riaz, M., Mendes, E., & Tempero, E. D. (2009). A systematic review of software maintainability prediction and metrics. In Proceedings of the third international symposium on empirical software engineering and measurement, ESEM (pp. 367\u2013377). Florida, USA.","DOI":"10.1109\/ESEM.2009.5314233"},{"key":"9108_CR42","unstructured":"Richards, G. (2007). Writing to be read: Readability indices for open educational resources. In First international workshop on learning object discovery and exchange. http:\/\/fire.eun.org\/lode2007\/lode12.pdf . Accessed 14 May 2010."},{"issue":"4","key":"9108_CR43","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1504\/IJTEL.2009.030779","volume":"1","author":"I Rodr\u00edguez-Ardura","year":"2009","unstructured":"Rodr\u00edguez-Ardura, I., Jim\u00e9nez-Zarco, A. I., Ammetller-Montes, G., & Pacheco-Berna, M. C. (2009). Improving hypermedia teaching resources\u2013new designs for e-learning environments. International Journal of Technology Enhanced Learning, 1(4), 286\u2013296.","journal-title":"International Journal of Technology Enhanced Learning"},{"key":"9108_CR44","unstructured":"Sicilia, M. A. (2004). Reusability and reuse of learning objects, myths, realities and possibilities. In Proceedings of the first pluri-disciplinary symposium on design, evaluation and description of reusable learning contents."},{"key":"9108_CR45","doi-asserted-by":"crossref","unstructured":"Sicilia, M.A., & Garcia, E. (2003). On the concepts of usability and reusability of learning objects. International Review of Research in Open and Distance Learning, 4(2).","DOI":"10.19173\/irrodl.v4i2.155"},{"key":"9108_CR46","doi-asserted-by":"crossref","unstructured":"Sosteric, M., & Hesemeier, S. (2002). When is a learning object not an object. The International Review of Research in Open and Distance Learning, 3(2).","DOI":"10.19173\/irrodl.v3i2.106"},{"key":"9108_CR47","volume-title":"Using multivariate statistics","author":"BG Tabachnick","year":"1996","unstructured":"Tabachnick, B. G., & Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). New York: HarperCollins.","edition":"3"},{"key":"9108_CR48","unstructured":"Tzikopoulos, A., Manouselis, N., & Vuorikari, R. (2007). An overview of learning object repositories, in idea group publishing. Learning Objects for Instruction: Design and Evaluation, pp. 44\u201364."},{"key":"9108_CR49","unstructured":"Van Assche, F., Ayre, J., Baumgartner, P., Duval, E., Hartinger, S., Mesdom, F., et al. (2009). Melt final report. Technical report, eContentplus, http:\/\/info.melt-project.eu\/shared\/data\/melt\/MELT_1_3_Final_Project_Report.pdf . Accessed 14 May 2010."},{"key":"9108_CR50","doi-asserted-by":"crossref","unstructured":"Vargo, J., Nesbit J. C., Belfer, K., & Archambault, A. (2003). Learning object evaluation: Computer-mediated collaboration and inter-rater reliability. International Journal of Computers and Applications, 25(3).","DOI":"10.1080\/1206212X.2003.11441703"},{"issue":"6","key":"9108_CR51","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1109\/MIC.2005.131","volume":"9","author":"S Vinoski","year":"2005","unstructured":"Vinoski, S. (2005). Old measures for new services. IEEE Internet Computing, 9(6), 72\u201374.","journal-title":"IEEE Internet Computing"},{"key":"9108_CR52","first-page":"3","volume-title":"The instructional use of learning objects","author":"DA Wiley","year":"2002","unstructured":"Wiley, D. A. (2002). Connecting learning objects to instructional design theory: A definition, a metaphor and a taxonomy. In D. A. Wiley (Ed.), The instructional use of learning objects (pp. 3\u201324). Bloomington, Indiana: Agency for Instructional Technology and Association for Educational Communications and Technology."},{"key":"9108_CR53","doi-asserted-by":"crossref","unstructured":"Yang, D., & Yang, Q. (2005). Customizable distance learning: Criteria for developing learning objects and learning model templates. In Proceedings of the 7th international conference on electronic commerce, Xi\u2019an (China) (pp. 765\u2013770). ACM.","DOI":"10.1145\/1089551.1089691"},{"key":"9108_CR54","first-page":"46","volume":"311","author":"B Zimmermann","year":"2007","unstructured":"Zimmermann, B., Meyer, M., Rensing, C., & Steinmetz, R. (2007). Improving retrieval of reusable learning resources by estimating adaptation effort. In Proceedings of the first international workshop on learning object discovery and exchange, Vol. 311, pp. 46\u201353.","journal-title":"Proceedings of the First International Workshop on Learning Object Discovery and Exchange"}],"container-title":["Software Quality Journal"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-010-9108-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11219-010-9108-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-010-9108-5","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,1]],"date-time":"2019-06-01T18:14:16Z","timestamp":1559412856000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11219-010-9108-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,8,15]]},"references-count":54,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2011,3]]}},"alternative-id":["9108"],"URL":"https:\/\/doi.org\/10.1007\/s11219-010-9108-5","relation":{},"ISSN":["0963-9314","1573-1367"],"issn-type":[{"value":"0963-9314","type":"print"},{"value":"1573-1367","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,8,15]]}}}