{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T09:57:15Z","timestamp":1780394235766,"version":"3.54.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,12,19]],"date-time":"2019-12-19T00:00:00Z","timestamp":1576713600000},"content-version":"vor","delay-in-days":18,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Scienc","doi-asserted-by":"crossref","award":["JP16H06304, JP16H03080, JP19H01716"],"award-info":[{"award-number":["JP16H06304, JP16H03080, JP19H01716"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Cross-Ministerial Strategic Innovation Promotion Program from Cabinet Office","award":["None"],"award-info":[{"award-number":["None"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["RPTEL"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The purpose of this study was to explore the factors that might affect learning performance and collaborative problem solving (CPS) awareness in science, technology, engineering, and mathematics (STEM) education. We collected and analyzed data on important factors in STEM education, including learning strategy and learning behaviors, and examined their interrelationships with learning performance and CPS awareness, respectively. Multiple data sources, including learning tests, questionnaire feedback, and learning logs, were collected and examined following a learning analytics approach. Significant positive correlations were found for the learning behavior of using markers with learning performance and CPS awareness in group discussion, while significant negative correlations were found for some factors of STEM learning strategy and learning behaviors in pre-learning with some factors of CPS awareness. The results imply the importance of an efficient approach to using learning strategies and functional tools in STEM education.<\/jats:p>","DOI":"10.1186\/s41039-019-0119-y","type":"journal-article","created":{"date-parts":[[2019,12,19]],"date-time":"2019-12-19T18:03:25Z","timestamp":1576778605000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":39,"title":["Direction of collaborative problem solving-based STEM learning by learning analytics approach"],"prefix":"10.1186","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0063-8744","authenticated-orcid":false,"given":"Li","family":"Chen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nobuyuki","family":"Yoshimatsu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoshiko","family":"Goda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fumiya","family":"Okubo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuta","family":"Taniguchi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Misato","family":"Oi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shin\u2019ichi","family":"Konomi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atsushi","family":"Shimada","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hiroaki","family":"Ogata","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Masanori","family":"Yamada","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,12,19]]},"reference":[{"issue":"3","key":"119_CR1","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1016\/j.iheduc.2012.01.006","volume":"15","author":"R Artino Jr","year":"2012","unstructured":"Artino Jr., R., & Jones II, K. D. (2012). Exploring the complex relations between achievement emotions and self-regulated learning behaviors in online learning. The Internet and Higher Education, 15(3), 170\u2013175.","journal-title":"The Internet and Higher Education"},{"key":"119_CR2","unstructured":"Baker, R., & Siemens, G. (2014). Educational data mining and learning analytics. In R. Sawyer (Ed.), The Cambridge Handbook of the Learning Sciences (Cambridge Handbooks in Psychology, pp. 253\u2013272). Cambridge: Cambridge University Press."},{"key":"119_CR3","doi-asserted-by":"crossref","unstructured":"Bazelais, P., Lemay, D. J., & Doleck, T. (2018). Examining the link between prior achievement in secondary education and performance in college: using data from pre-university physics Courses. Journal of Formative Design in Learning, 1\u20137.","DOI":"10.1007\/s41686-018-0020-x"},{"issue":"1","key":"119_CR4","doi-asserted-by":"publisher","first-page":"32","DOI":"10.3102\/0013189X018001032","volume":"18","author":"JS Brown","year":"1989","unstructured":"Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32\u201342.","journal-title":"Educational Researcher"},{"issue":"4","key":"119_CR5","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1080\/08957347.2016.1209204","volume":"29","author":"E Care","year":"2016","unstructured":"Care, E., Scoular, C., & Griffin, P. (2016). Assessment of collaborative problem solving in education environments. Applied Measurement in Education, 29(4), 250\u2013264.","journal-title":"Applied Measurement in Education"},{"key":"119_CR6","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1111\/jcal.12208","volume":"33","author":"CJ Chang","year":"2017","unstructured":"Chang, C. J., Chang, M. H., Liu, C. C., Chiu, B. C., Fan Chiang, S. H., Wen, C. T., et al. (2017). An analysis of collaborative problem-solving activities mediated by individual-based and collaborative computer simulations. Journal of Computer Assisted Learning, 33, 649\u2013662.","journal-title":"Journal of Computer Assisted Learning"},{"key":"119_CR7","unstructured":"Chen, L., Uemura, H., Goda, Y., Okubo, F., Taniguchi, Y., Oi, M., Konomi, S., Ogata, H., & Yamada, M. (2018). Instructional Design and Evaluation of Science Education to Improve Collaborative Problem Solving Skills. Proceedings of Society for Information Technology & Teacher Education International Conference (pp. 1306-1311). Washington, D.C., United States: Association for the Advancement of Computing in Education (AACE)."},{"key":"119_CR8","doi-asserted-by":"crossref","unstructured":"Chen, L., Uemura, H., Hao, H., Goda, Y., Okubo, F., Taniguchi, Y.,\u2026, Yamada, M. (2018). Relationships between collaborative problem solving, learning performance and learning behavior in science education. Proceedings of 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE) (pp. 17\u201324). Wollongong, NSW, Australia.","DOI":"10.1109\/TALE.2018.8615254"},{"issue":"3","key":"119_CR9","doi-asserted-by":"publisher","first-page":"223","DOI":"10.18608\/jla.2014.13.26","volume":"1","author":"RL Dunbar","year":"2014","unstructured":"Dunbar, R. L., Dingel, M. J., & Prat-Resina, X. (2014). Connecting analytics and curriculum design: process and outcomes of building a tool to browse data relevant to course designers. Journal of Learning Analytics, 1(3), 223\u2013243.","journal-title":"Journal of Learning Analytics"},{"issue":"1","key":"119_CR10","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1177\/1529100612453266","volume":"14","author":"J Dunlosky","year":"2013","unstructured":"Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students\u2019 learning with effective learning techniques: promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4\u201358.","journal-title":"Psychological Science in the Public Interest"},{"issue":"2","key":"119_CR11","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1007\/s11422-014-9590-3","volume":"10","author":"A Gough","year":"2015","unstructured":"Gough, A. (2015). STEM policy and science education: Scientistic curriculum and sociopolitical silences. Cultural Studies of Science Education, 10(2), 445\u2013458.","journal-title":"Cultural Studies of Science Education"},{"key":"119_CR12","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1186\/s40594-015-0025-9","volume":"2","author":"B Griese","year":"2015","unstructured":"Griese, B., Lehmann, M., & Roesken-Winter, B. (2015). Refining questionnaire-based assessment of STEM students\u2019 learning strategies. International Journal of STEM Education, 2, 12.","journal-title":"International Journal of STEM Education"},{"issue":"1","key":"119_CR13","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1186\/s40594-017-0094-z","volume":"4","author":"D Herro","year":"2017","unstructured":"Herro, D., Quigley, C., Andrews, J., & Delacruz, G. (2017). Co-measure: developing an assessment for student collaboration in STEAM activities. International Journal of STEM Education, 4(1), 26.","journal-title":"International Journal of STEM Education"},{"key":"119_CR14","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/978-94-017-9395-7_2","volume-title":"Assessment and teaching of 21st century skills","author":"F Hesse","year":"2015","unstructured":"Hesse, F., Care, E., Buder, J., Sassenberg, K., & Griffin, P. (2015). A framework for teachable collaborative problem solving skills. In P. Griffin, B. McGaw, & E. Care (Eds.), Assessment and teaching of 21st century skills (pp. 37\u201356). New York: Springer."},{"issue":"10","key":"119_CR15","doi-asserted-by":"publisher","first-page":"1085","DOI":"10.1002\/(SICI)1098-2736(199912)36:10<1085::AID-TEA3>3.0.CO;2-D","volume":"36","author":"K Hogan","year":"1999","unstructured":"Hogan, K. (1999). Thinking aloud together: a test of an intervention to foster students\u2019 collaborative scientific reasoning. Journal of Research in Science Teaching, 36(10), 1085\u20131109.","journal-title":"Journal of Research in Science Teaching"},{"issue":"1","key":"119_CR16","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1186\/s40594-018-0127-2","volume":"5","author":"TD Holmlund","year":"2018","unstructured":"Holmlund, T. D., Lesseig, K., & Slavit, D. (2018). Making sense of \u201cSTEM education\u201d in K-12 contexts. International journal of STEM education, 5(1), 32.","journal-title":"International journal of STEM education"},{"issue":"4","key":"119_CR17","doi-asserted-by":"publisher","first-page":"1267","DOI":"10.1016\/j.compedu.2011.12.009","volume":"58","author":"WY Hwang","year":"2012","unstructured":"Hwang, W. Y., Shadiev, R., Wang, C. Y., & Huang, Z. H. (2012). A pilot study of cooperative programming learning behavior and its relationship with students\u2019 learning performance. Computers & Education, 58(4), 1267\u20131281.","journal-title":"Computers & Education"},{"issue":"1","key":"119_CR18","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1186\/s40594-016-0046-z","volume":"3","author":"TR Kelley","year":"2016","unstructured":"Kelley, T. R., & Knowles, J. G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM Education, 3(1), 11.","journal-title":"International Journal of STEM Education"},{"issue":"3","key":"119_CR19","first-page":"246","volume":"25","author":"TJ Kennedy","year":"2014","unstructured":"Kennedy, T. J., & Odell, M. R. L. (2014). Engaging students in STEM education. Science Education International, 25(3), 246\u2013258.","journal-title":"Science Education International"},{"key":"119_CR20","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511815355","volume-title":"Situated learning: Legitimate peripheral participation","author":"J Lave","year":"1991","unstructured":"Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Cambridge: Cambridge University Press."},{"key":"119_CR21","unstructured":"Lin, K. Y., Yu, K. C., Hsiao, H. S., Chang, Y. S., & Chien, Y. H. (2018). Effects of web-based versus classroom-based STEM learning environments on the development of collaborative problem-solving skills in junior high school students. International Journal of Technology and Design Education, 1\u201314."},{"issue":"3","key":"119_CR22","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1007\/s40692-015-0038-x","volume":"2","author":"KY Lin","year":"2015","unstructured":"Lin, K. Y., Yu, K. C., Hsiao, H. S., Chu, Y. H., Chang, Y. S., & Chien, Y. H. (2015). Design of an assessment system for collaborative problem solving in STEM education. Journal of Computers in Education, 2(3), 301\u2013322.","journal-title":"Journal of Computers in Education"},{"issue":"3","key":"119_CR23","first-page":"98","volume":"12","author":"LC Li\u00f1\u00e1n","year":"2015","unstructured":"Li\u00f1\u00e1n, L. C., & P\u00e9rez, \u00c1. A. J. (2015). Educational data mining and learning analytics: differences, similarities, and time evolution. International Journal of Educational Technology in Higher Education, 12(3), 98\u2013112.","journal-title":"International Journal of Educational Technology in Higher Education"},{"issue":"1","key":"119_CR24","first-page":"37","volume":"12","author":"F Liu","year":"2011","unstructured":"Liu, F., & Cavanaugh, C. (2011). Success in online high school biology: factors influencing student academic performance. Quarterly Review of Distance Education, 12(1), 37\u201355.","journal-title":"Quarterly Review of Distance Education"},{"issue":"2","key":"119_CR25","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1007\/s10798-010-9112-x","volume":"21","author":"SJ Lou","year":"2011","unstructured":"Lou, S. J., Liu, Y. H., Shih, R. C., & Tseng, K. H. (2011). The senior high school students\u2019 learning behavioral model of STEM in PBL. International Journal of Technology and Design Education, 21(2), 161\u2013183.","journal-title":"International Journal of Technology and Design Education"},{"issue":"2","key":"119_CR26","doi-asserted-by":"publisher","first-page":"169","DOI":"10.18608\/jla.2015.22.13","volume":"2","author":"S Lowes","year":"2015","unstructured":"Lowes, S., Lin, P., & Kinghorn, B. (2015). Exploring the link between online behaviours and course performance in asynchronous online high school courses. Journal of Learning Analytics, 2(2), 169\u2013194.","journal-title":"Journal of Learning Analytics"},{"issue":"2","key":"119_CR27","doi-asserted-by":"publisher","first-page":"94","DOI":"10.18608\/jla.2014.12.6","volume":"1","author":"C Monroy","year":"2014","unstructured":"Monroy, C., Rangel, V. S., & Whitaker, R. (2014). A strategy for incorporating learning analytics into the design and evaluation of a K-12 science curriculum. Journal of Learning Analytics, 1(2), 94\u2013125.","journal-title":"Journal of Learning Analytics"},{"key":"119_CR28","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1016\/j.iheduc.2005.06.009","volume":"8","author":"LV Morris","year":"2005","unstructured":"Morris, L. V., Finnegan, C., & Wu, S.-S. (2005). Tracking student behavior, persistence, and achievement in online courses. Internet and Higher Education, 8, 221\u2013231.","journal-title":"Internet and Higher Education"},{"issue":"6","key":"119_CR29","doi-asserted-by":"publisher","first-page":"1159","DOI":"10.1177\/0956797614524581","volume":"25","author":"PA Mueller","year":"2014","unstructured":"Mueller, P. A., & Oppenheimer, D. M. (2014). The pen is mightier than the keyboard: Advantages of longhand over laptop note taking. Psychological Science, 25(6), 1159\u20131168.","journal-title":"Psychological Science"},{"issue":"1","key":"119_CR30","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1007\/s10956-016-9650-4","volume":"26","author":"CP Newhouse","year":"2016","unstructured":"Newhouse, C. P. (2016). STEM the boredom: engage students in the Australian curriculum using ICT with problem-based learning and assessment. Journal of Science Education and Technology, 26(1), 44\u201357.","journal-title":"Journal of Science Education and Technology"},{"key":"119_CR31","unstructured":"Ogata, H., Taniguchi, Y., Suehiro, D., Shimada, A., Oi, M., Okubo, F., \u2026, Kojima, K. (2017). M2B System: A digital learning platform for traditional classrooms in university. Practitioner Track Proceedings of the Seventh International Learning Analytics & Knowledge Conference (LAK 2017), paper presented at Simon Fraser University, Vancouver, Canada (pp. 155\u2013162)."},{"key":"119_CR32","unstructured":"Ogata, H., Yin, C., Oi, M., Okubo, F., Shimada, A., Kojima, K., & Yamada, M. (2015). E book based learning analytics in university education. In the 23rd International Conference on Computer in Education (ICCE 2015), paper presented at Hangzhou, China (pp. 401\u2013406)."},{"key":"119_CR33","unstructured":"Oi, M., Okubo, F., Shimada, A., Yin, C., & Ogata, H. (2015). Analysis of preview and review patterns in undergraduates\u2019 e-book logs. In the 23rd International Conference on Computer in Education (ICCE 2015), paper presented at Hangzhou, China (pp. 166\u2013171)."},{"key":"119_CR34","unstructured":"Organisation for Economic Cooperation and Development. (2017). PISA 2015: collaborative problem-solving framework. https:\/\/www.oecd.org\/pisa\/pisaproducts\/Draft%20PISA%202015%20Collaborative%20Problem%20Solving%20Framework%20.pdf"},{"issue":"4","key":"119_CR35","doi-asserted-by":"publisher","first-page":"1174","DOI":"10.1016\/j.compedu.2006.11.003","volume":"50","author":"C Ramos","year":"2008","unstructured":"Ramos, C., & Yudko, E. (2008). \u201cHits\u201d (not \u201cDiscussion Posts\u201d) predict student success in online courses: a double cross-validation study. Computers & Education, 50(4), 1174\u20131182.","journal-title":"Computers & Education"},{"key":"119_CR36","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.ijedudev.2015.08.002","volume":"45","author":"B Thomas","year":"2015","unstructured":"Thomas, B., & Watters, J. (2015). Perspectives on Australian, Indian and Malaysian approaches to STEM education. International Journal of Educational Development, 45, 42\u201353.","journal-title":"International Journal of Educational Development"},{"issue":"1","key":"119_CR37","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1037\/0022-0663.92.1.137","volume":"92","author":"AY Wang","year":"2000","unstructured":"Wang, A. Y., & Newlin, M. H. (2000). Characteristics of students who enroll and succeed in psychology web-based classes. Journal of Educational Psychology, 92(1), 137\u2013143.","journal-title":"Journal of Educational Psychology"},{"key":"119_CR38","unstructured":"Yamada, M., Okubo, F., Oi, M., Shimada, A., Kojima, K., & Ogata, H. (2016). Learning analytics in ubiquitous learning environments: Self-regulated learning perspective. In the 24th International Conference on Computers in Education (ICCE2016), paper presented at IIT Bombay, Mumbai India (pp. 306\u2013314)."},{"key":"119_CR39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41039-017-0053-9","volume":"12","author":"M Yamada","year":"2017","unstructured":"Yamada, M., Shimada, A., Okubo, F., Oi, M., Kojima, K., & Ogata, H. (2017). Learning analytics of the relationships among self-regulated learning, learning behaviors, and learning performance. Research and Practice in Technology Enhanced Learning, 12, 1\u201317.","journal-title":"Research and Practice in Technology Enhanced Learning"},{"key":"119_CR40","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1007\/s10648-014-9277-z","volume":"27","author":"CL Yue","year":"2015","unstructured":"Yue, C. L., Storm, B. C., Kornell, N., & Bjork, E. L. (2015). Highlighting and its relation to distributed study and students\u2019 metacognitive beliefs. Educational Psychology Review, 27, 69\u201378.","journal-title":"Educational Psychology Review"}],"container-title":["Research and Practice in Technology Enhanced Learning"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s41039-019-0119-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s41039-019-0119-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s41039-019-0119-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,24]],"date-time":"2023-09-24T07:04:23Z","timestamp":1695539063000},"score":1,"resource":{"primary":{"URL":"https:\/\/telrp.springeropen.com\/articles\/10.1186\/s41039-019-0119-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["119"],"URL":"https:\/\/doi.org\/10.1186\/s41039-019-0119-y","relation":{},"ISSN":["1793-7078"],"issn-type":[{"value":"1793-7078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12]]},"assertion":[{"value":"1 April 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 November 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 December 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Drs. Ogata and Yamada received research grants from JSPS for this research project. Drs. Goda, Okubo, Taniguchi, Oi, Konomi, Shimada, and Yamada received research grants from JSPS for other research project. Drs. Ogata and Shimada received research grants from Cross-Ministerial Strategic Innovation Promotion Program from Cabinet Office. Ms. Li Chen and Mr. Yoshimatsu do not have any conflict on this research.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"24"}}