{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:18:45Z","timestamp":1750220325745,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":26,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,26]],"date-time":"2021-10-26T00:00:00Z","timestamp":1635206400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,26]]},"DOI":"10.1145\/3486011.3486531","type":"proceedings-article","created":{"date-parts":[[2021,12,21]],"date-time":"2021-12-21T02:09:47Z","timestamp":1640052587000},"page":"640-646","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Methods for the evaluation of social learning (2017-2021): systematic literature review"],"prefix":"10.1145","author":[{"given":"Ruth-Elizabeth","family":"Minga-Vallejo","sequence":"first","affiliation":[{"name":"Universidad T\u00e9cnica Particular de Loja, Ecuador"}]},{"given":"Mar\u00eda-Soledad","family":"Ram\u00edrez-Montoya","sequence":"additional","affiliation":[{"name":"Tecnologico de Monterrey, Mexico"}]},{"given":"Mar\u00eda-Jos\u00e9","family":"Rodr\u00edguez-Conde","sequence":"additional","affiliation":[{"name":"Universidad de Salamanca, Spain"}]}],"member":"320","published-online":{"date-parts":[[2021,12,20]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proceedings of the 2019 ICDE World Conference on Online Learning","volume":"1","author":"Sanchez Damien","year":"2020","unstructured":"Damien Sanchez , Nick Flor , Charlotte N. Gunawardena . 2020 . Employing Social Learning Analytic Methods (SLAMs) to Reimagine the Social Dynamic of Online Learning Collaborations. In M. Brown, M. Nic Giolla Mhichil, E. Beirne, & E. Costello (Eds.) , Proceedings of the 2019 ICDE World Conference on Online Learning , Volume 1 , Dublin City University, Dublin. DOI: http:\/\/dx.doi.org\/10.5281\/zenodo.3804014 Damien Sanchez, Nick Flor, Charlotte N. Gunawardena. 2020. Employing Social Learning Analytic Methods (SLAMs) to Reimagine the Social Dynamic of Online Learning Collaborations. In M. Brown, M. Nic Giolla Mhichil, E. Beirne, & E. Costello (Eds.), Proceedings of the 2019 ICDE World Conference on Online Learning, Volume 1, Dublin City University, Dublin. DOI: http:\/\/dx.doi.org\/10.5281\/zenodo.3804014"},{"key":"e_1_3_2_1_2_1","unstructured":"Mirna E. Sanabria Zotelo. 2020. Aprendizaje informal con las comunidades de pr\u00e1ctica en la educaci\u00f3n superior. Revista Argentina de Investigaci\u00f3n en Negocios 6(1) 141-148. Retrieved from https:\/\/bit.ly\/3qyFPuW  Mirna E. Sanabria Zotelo. 2020. Aprendizaje informal con las comunidades de pr\u00e1ctica en la educaci\u00f3n superior. Revista Argentina de Investigaci\u00f3n en Negocios 6(1) 141-148. Retrieved from https:\/\/bit.ly\/3qyFPuW"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Mar\u00eda S. Ibarra-Saiz Gregorio Rodr\u00edguez-G\u00f3mez D. Boud T. Rotsaert S. Brown M. L. Salinas and H. M. Rodr\u00edguez G\u00f3mez. 2020. The future of assessment in Higher Education. DOI: https:\/\/doi.org\/10.7203\/relieve.26.1.17323  Mar\u00eda S. Ibarra-Saiz Gregorio Rodr\u00edguez-G\u00f3mez D. Boud T. Rotsaert S. Brown M. L. Salinas and H. M. Rodr\u00edguez G\u00f3mez. 2020. The future of assessment in Higher Education. DOI: https:\/\/doi.org\/10.7203\/relieve.26.1.17323","DOI":"10.7203\/relieve.26.1.17323"},{"key":"e_1_3_2_1_4_1","unstructured":"Etienne Wenger Beverly Trayner and Maarten De Laat. 2011. Promoting and assessing value creation in communities and networks: A conceptual framework. Retrieved from https:\/\/bit.ly\/3xArTmA  Etienne Wenger Beverly Trayner and Maarten De Laat. 2011. Promoting and assessing value creation in communities and networks: A conceptual framework. Retrieved from https:\/\/bit.ly\/3xArTmA"},{"issue":"6","key":"e_1_3_2_1_5_1","first-page":"89","article-title":"The effects of online interactions on the relationship between learning-related anxiety and intention to persist among e-learning students with visual impairment","volume":"17","author":"Yunjin Oh","year":"2016","unstructured":"Oh Yunjin , and Min L. Soon . 2016 . The effects of online interactions on the relationship between learning-related anxiety and intention to persist among e-learning students with visual impairment . International Review of Research in Open and Distributed Learning: IRRODL , 17 ( 6 ), 89 - 107 . DOI: https:\/\/doi.org\/10.19173\/irrodl.v17i6.2581 Oh Yunjin, and Min L. Soon. 2016. The effects of online interactions on the relationship between learning-related anxiety and intention to persist among e-learning students with visual impairment. International Review of Research in Open and Distributed Learning: IRRODL, 17(6), 89-107. DOI: https:\/\/doi.org\/10.19173\/irrodl.v17i6.2581","journal-title":"International Review of Research in Open and Distributed Learning: IRRODL"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11412-017-9268-4"},{"issue":"3","key":"e_1_3_2_1_7_1","first-page":"35","article-title":"Analyzing social construction of knowledge online by employing interaction analysis, learning analytics, and social network analysis","volume":"17","author":"Gunawardena Charlotte N.","year":"2016","unstructured":"Charlotte N. Gunawardena , Nick V. Flor , David Gomez , and Damien Sanchez . 2016 . Analyzing social construction of knowledge online by employing interaction analysis, learning analytics, and social network analysis . The Quarterly Review of Distance Education , 17 ( 3 ), 35 . Retrieved from https:\/\/bit.ly\/3yx1DtV Charlotte N. Gunawardena, Nick V. Flor, David Gomez, and Damien Sanchez. 2016. Analyzing social construction of knowledge online by employing interaction analysis, learning analytics, and social network analysis. The Quarterly Review of Distance Education, 17(3), 35. Retrieved from https:\/\/bit.ly\/3yx1DtV","journal-title":"The Quarterly Review of Distance Education"},{"key":"e_1_3_2_1_8_1","unstructured":"Luis Radford. 2017. Aprendizaje desde la perspectiva de la teor\u00eda de la objetivaci\u00f3n. Retrieved from https:\/\/bit.ly\/3ykjl3o  Luis Radford. 2017. Aprendizaje desde la perspectiva de la teor\u00eda de la objetivaci\u00f3n. Retrieved from https:\/\/bit.ly\/3ykjl3o"},{"key":"e_1_3_2_1_9_1","volume-title":"Guth","author":"Schuttenberg H. Z","year":"2015","unstructured":"H. Z Schuttenberg , and Heidi K . Guth . 2015 . Seeking our shared wisdom: A framework for understanding knowledge coproduction and coproductive capacities. Ecology and Society , 20(1). DOI: http:\/\/dx.doi.org\/10.5751\/ES-07038-200115 H. Z Schuttenberg, and Heidi K. Guth. 2015. Seeking our shared wisdom: A framework for understanding knowledge coproduction and coproductive capacities. Ecology and Society, 20(1). DOI: http:\/\/dx.doi.org\/10.5751\/ES-07038-200115"},{"key":"e_1_3_2_1_10_1","volume-title":"Tecnolog\u00edas para una evaluaci\u00f3n participativa. La experiencia de uso de EvalCOMIX\u00ae en Ciencias Econ\u00f3micas y Empresariales. Investigar con y para la sociedad, 3","author":"Ibarra-S\u00e1iz Mar\u00eda S.","year":"1889","unstructured":"Mar\u00eda S. Ibarra-S\u00e1iz , and Gregorio Rodr\u00edguez-G\u00f3mez . 2015. Tecnolog\u00edas para una evaluaci\u00f3n participativa. La experiencia de uso de EvalCOMIX\u00ae en Ciencias Econ\u00f3micas y Empresariales. Investigar con y para la sociedad, 3 , 1889 -1895. Retrieved from http:\/\/aidipe2015.aidipe.org Mar\u00eda S. Ibarra-S\u00e1iz, and Gregorio Rodr\u00edguez-G\u00f3mez. 2015. Tecnolog\u00edas para una evaluaci\u00f3n participativa. La experiencia de uso de EvalCOMIX\u00ae en Ciencias Econ\u00f3micas y Empresariales. Investigar con y para la sociedad, 3, 1889-1895. Retrieved from http:\/\/aidipe2015.aidipe.org"},{"issue":"6","key":"e_1_3_2_1_11_1","first-page":"44","article-title":"Open assessment of learning: A meta-Synthesis","volume":"17","author":"Chiappe Andr\u00e9s","year":"2016","unstructured":"Andr\u00e9s Chiappe , Ricardo Pinto , and Vivian Arias . 2016 . Open assessment of learning: A meta-Synthesis . International Review of Research in Open and Distributed Learning: IRRODL , 17 ( 6 ), 44 - 61 . DOI: https:\/\/doi.org\/10.19173\/irrodl.v17i6.2846 Andr\u00e9s Chiappe, Ricardo Pinto, and Vivian Arias. 2016. Open assessment of learning: A meta-Synthesis. International Review of Research in Open and Distributed Learning: IRRODL, 17(6), 44-61. DOI: https:\/\/doi.org\/10.19173\/irrodl.v17i6.2846","journal-title":"International Review of Research in Open and Distributed Learning: IRRODL"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Aparecida M. Zem-Lopes La\u00eds Z. Pedro Seiji Isotani and I. I. Bittencourt. 2015. Quality evaluation of web-based educational software: A systematic mapping. 250-252. DOI: https:\/\/doi.org\/10.1109\/ICALT.2015.88  Aparecida M. Zem-Lopes La\u00eds Z. Pedro Seiji Isotani and I. I. Bittencourt. 2015. Quality evaluation of web-based educational software: A systematic mapping. 250-252. DOI: https:\/\/doi.org\/10.1109\/ICALT.2015.88","DOI":"10.1109\/ICALT.2015.88"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.7821\/naer.2017.7.232"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1080\/13678868.2020.1721982"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1080\/13540602.2015.1058588"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2015.23.7"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Carolyn P. Ros\u00e9. 2017. Discourse analytics. Handbook of learning analytics 105-114. DOI: http:\/\/dx.doi.org\/10.18608\/hla17.009  Carolyn P. Ros\u00e9. 2017. Discourse analytics. Handbook of learning analytics 105-114. DOI: http:\/\/dx.doi.org\/10.18608\/hla17.009","DOI":"10.18608\/hla17.009"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Elaine Doyle and Patrick Buckley. 2020. The impact of co-creation: An analysis of the effectiveness of student authored multiple choice questions on achievement of learning outcomes. Interactive Learning Environments 1-10 DOI: https:\/\/doi.org\/10.1080\/10494820.2020.1777166  Elaine Doyle and Patrick Buckley. 2020. The impact of co-creation: An analysis of the effectiveness of student authored multiple choice questions on achievement of learning outcomes. Interactive Learning Environments 1-10 DOI: https:\/\/doi.org\/10.1080\/10494820.2020.1777166","DOI":"10.1080\/10494820.2020.1777166"},{"key":"e_1_3_2_1_19_1","unstructured":"Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing systematic literature reviews in software engineering. Retrieved from https:\/\/bit.ly\/3dE6xgF  Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing systematic literature reviews in software engineering. Retrieved from https:\/\/bit.ly\/3dE6xgF"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Barbara Kitchenham Rialette Pretorius David Budgen O. P. Brereton Mark Turner Mahmood Niazi and Stephen Linkman. 2010. Systematic literature reviews in software engineering\u2013a tertiary study. Information and software technology 52(8) 792-805. DOI: https:\/\/doi.org\/10.1016\/j.infsof.2010.03.006  Barbara Kitchenham Rialette Pretorius David Budgen O. P. Brereton Mark Turner Mahmood Niazi and Stephen Linkman. 2010. Systematic literature reviews in software engineering\u2013a tertiary study. Information and software technology 52(8) 792-805. DOI: https:\/\/doi.org\/10.1016\/j.infsof.2010.03.006","DOI":"10.1016\/j.infsof.2010.03.006"},{"issue":"17","key":"e_1_3_2_1_21_1","first-page":"7053","article-title":"Challenges for Open Education with Educational Innovation","volume":"12","author":"Ram\u00edrez-Montoya Mar\u00eda-Soledad","year":"2020","unstructured":"Mar\u00eda-Soledad Ram\u00edrez-Montoya . 2020 . Challenges for Open Education with Educational Innovation : A Systematic Literature Review. Sustainability , 12 ( 17 ), 7053 . DOI: https:\/\/doi.org\/10.3390\/su12177053 Mar\u00eda-Soledad Ram\u00edrez-Montoya. 2020. Challenges for Open Education with Educational Innovation: A Systematic Literature Review. Sustainability, 12(17), 7053. DOI: https:\/\/doi.org\/10.3390\/su12177053","journal-title":"A Systematic Literature Review. Sustainability"},{"key":"e_1_3_2_1_22_1","unstructured":"Francisco Garc\u00eda-Pe\u00f1alvo. 2017. Mapeos sistem\u00e1ticos de literatura revisiones sistem\u00e1ticas de literatura y benchmarking de programas formativos. Retrieved from http:\/\/repositorio.grial.eu\/handle\/grial\/1056  Francisco Garc\u00eda-Pe\u00f1alvo. 2017. Mapeos sistem\u00e1ticos de literatura revisiones sistem\u00e1ticas de literatura y benchmarking de programas formativos. Retrieved from http:\/\/repositorio.grial.eu\/handle\/grial\/1056"},{"key":"e_1_3_2_1_23_1","unstructured":"Llu\u00eds Codina. 2015. No lo llame an\u00e1lisis bibliogr\u00e1fico ll\u00e1melo revisi\u00f3n sistematizada Y c\u00f3mo llevarla a cabo con garant\u00edas: Systematized reviews+ SALSA framwork. Llu\u00eds codina. Cultura acad\u00e9mica comunicaci\u00f3n y documentaci\u00f3n. Retrieved from https:\/\/bit.ly\/3jEll2o  Llu\u00eds Codina. 2015. No lo llame an\u00e1lisis bibliogr\u00e1fico ll\u00e1melo revisi\u00f3n sistematizada Y c\u00f3mo llevarla a cabo con garant\u00edas: Systematized reviews+ SALSA framwork. Llu\u00eds codina. Cultura acad\u00e9mica comunicaci\u00f3n y documentaci\u00f3n. Retrieved from https:\/\/bit.ly\/3jEll2o"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3916\/C65-2020-01"},{"key":"e_1_3_2_1_25_1","unstructured":"Laura-Icela Gonz\u00e1lez-P\u00e9rez Mar\u00eda-Soledad Ram\u00edrez-Montoya & Francisco Garc\u00eda-Pe\u00f1alvo. 2019. Innovaci\u00f3n educativa en estudios sobre el desarrollo y uso de la tecnolog\u00eda: Un mapeo sistem\u00e1tico. Retrieved from http:\/\/repositorio.grial.eu\/handle\/grial\/1816  Laura-Icela Gonz\u00e1lez-P\u00e9rez Mar\u00eda-Soledad Ram\u00edrez-Montoya & Francisco Garc\u00eda-Pe\u00f1alvo. 2019. Innovaci\u00f3n educativa en estudios sobre el desarrollo y uso de la tecnolog\u00eda: Un mapeo sistem\u00e1tico. Retrieved from http:\/\/repositorio.grial.eu\/handle\/grial\/1816"},{"key":"e_1_3_2_1_26_1","volume-title":"Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS medicine, 6(7), e1000097. DOI: https:\/\/doi.org\/10.1371\/journal.pmed.1000097","author":"Moher David","year":"2009","unstructured":"David Moher , Alessandro Liberati , Jennifer Tetzlaff , Douglas Altman , & Prisma Group . ( 2009 ). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS medicine, 6(7), e1000097. DOI: https:\/\/doi.org\/10.1371\/journal.pmed.1000097 David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas Altman, & Prisma Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS medicine, 6(7), e1000097. DOI: https:\/\/doi.org\/10.1371\/journal.pmed.1000097"}],"event":{"name":"TEEM'21: Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality","acronym":"TEEM'21","location":"Barcelona Spain"},"container-title":["Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'21)"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486011.3486531","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3486011.3486531","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:07Z","timestamp":1750191127000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486011.3486531"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,26]]},"references-count":26,"alternative-id":["10.1145\/3486011.3486531","10.1145\/3486011"],"URL":"https:\/\/doi.org\/10.1145\/3486011.3486531","relation":{},"subject":[],"published":{"date-parts":[[2021,10,26]]},"assertion":[{"value":"2021-12-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}