{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T22:07:01Z","timestamp":1778969221590,"version":"3.51.4"},"reference-count":44,"publisher":"National Library of Serbia","issue":"1","license":[{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ComSIS","COMPUT SCI INF SYST","COMPUT SCI INFORM SY","COMPUTER SCI INFORM","COMSIS J"],"published-print":{"date-parts":[[2026]]},"abstract":"<jats:p>Teaching programming presents numerous challenges, one of which is selecting the most effective notation to introduce programming concepts to beginners. This study explores different notation approaches for learning fundamental programming concepts, with the objective of assessing how notation choice influences beginners\u2019 performance. To investigate this, we conducted a controlled experiment during short-term visits aimed at promoting programming in primary schools. Our multinational study divided participants into three groups: one using blockbased notation (Poligot), one using text-based notation (Python), and one using both simultaneously (Poliglot). After completing a training session, the participants engaged in practical programming tasks to assess their performance in Python or the multiple-representation environment Poliglot. The results indicate that the choice of notation did not impact the performance of the participants significantly, as no statistically significant differences were found between the three groups. These findings were consistent across two different countries. Our study suggests that educators can use different notations (Python, Poliglot, or a combination) confidently when introducing programming to beginners. However, the performance results may improve when training sessions are extended over a longer period.<\/jats:p>","DOI":"10.2298\/csis250401002k","type":"journal-article","created":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T10:44:04Z","timestamp":1768905844000},"page":"33-59","source":"Crossref","is-referenced-by-count":0,"title":["Comparing novice programmers performance with block-based, text-based, and both notations: A study from two countries"],"prefix":"10.2298","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8714-9649","authenticated-orcid":false,"given":"Tomaz","family":"Kosar","sequence":"first","affiliation":[{"name":"University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6404-3497","authenticated-orcid":false,"given":"Srdja","family":"Bjeladinovic","sequence":"additional","affiliation":[{"name":"University of Belgrade, Faculty of Organizational Sciences, Beograd, Belgrade, Serbia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-7804-9248","authenticated-orcid":false,"given":"Dragana","family":"Ostojic","sequence":"additional","affiliation":[{"name":"University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0649-3005","authenticated-orcid":false,"suffix":"S.","given":"Milica","family":"Skembarevic","sequence":"additional","affiliation":[{"name":"University of Belgrade, Faculty of Organizational Sciences, Beograd, Belgrade, Serbia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ziga","family":"Leber","sequence":"additional","affiliation":[{"name":"University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6594-6388","authenticated-orcid":false,"suffix":"A.","given":"Olga","family":"Jejic","sequence":"additional","affiliation":[{"name":"University of Belgrade, Faculty of Organizational Sciences, Beograd, Belgrade, Serbia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0756-3300","authenticated-orcid":false,"given":"Matej","family":"Moravec","sequence":"additional","affiliation":[{"name":"University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Filip","family":"Furtula","sequence":"additional","affiliation":[{"name":"University of Belgrade, Faculty of Organizational Sciences, Beograd, Belgrade, Serbia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3708-6648","authenticated-orcid":false,"suffix":"D.","given":"Milos","family":"Ljubisavljevic","sequence":"additional","affiliation":[{"name":"University of Belgrade, Faculty of Organizational Sciences, Beograd, Belgrade, Serbia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1319-488X","authenticated-orcid":false,"suffix":"S.","given":"Ivan","family":"Lukovic","sequence":"additional","affiliation":[{"name":"University of Belgrade, Faculty of Organizational Sciences, Beograd, Belgrade, Serbia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marjan","family":"Mernik","sequence":"additional","affiliation":[{"name":"University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2802-316X","authenticated-orcid":false,"given":"Matej","family":"Crepinsek","sequence":"additional","affiliation":[{"name":"University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1078","reference":[{"key":"ref1","doi-asserted-by":"crossref","unstructured":"Bubni\u010d, B., Mernik, M., Kosar, T.: Exploring the predictive potential of complex problemsolving in computing education: A case study in the introductory programming course. Mathematics 12(11) (2024), https:\/\/www.mdpi.com\/2227-7390\/12\/11\/1655","DOI":"10.3390\/math12111655"},{"key":"ref2","doi-asserted-by":"crossref","unstructured":"Flannery, L.P., Silverman, B., Kazakoff, E.R., Bers, M.U., Bonta, P., Resnick, M.: Designing ScratchJr: Support for early childhood learning through computer programming. In: Proceedings of the 12th international conference on interaction design and children. pp. 1-10 (2013)","DOI":"10.1145\/2485760.2485785"},{"key":"ref3","doi-asserted-by":"crossref","unstructured":"Dagien\u0117, V., Jevsikova, T., Stupurien\u0117, G., Ju\u0161kevi\u02c7cien\u0117, A.: Teaching computational thinking in primary schools: Worldwide trends and teachers\u2019 attitudes. Computer Science and Information Systems 19(1), 1-24 (2022)","DOI":"10.2298\/CSIS201215033D"},{"key":"ref4","doi-asserted-by":"crossref","unstructured":"Oda, M., Noborimoto, Y., Horita, T.: International trends in k-12 computer science curricula through comparative analysis: Implications for the primary curricula. International Journal of Computer Science Education in Schools 4(4), 24-58 (2021)","DOI":"10.21585\/ijcses.v4i4.102"},{"key":"ref5","doi-asserted-by":"crossref","unstructured":"Szabo, C., Sheard, J., Luxton-Reilly, A., Simon, Becker, B.A., Ott, L.: Fifteen years of introductory programming in schools: a global overview of k-12 initiatives. In: Proceedings of the 19th Koli Calling International Conference on Computing Education Research. pp. 1-9 (2019)","DOI":"10.1145\/3364510.3364513"},{"key":"ref6","doi-asserted-by":"crossref","unstructured":"Funke, A., Geldreich, K., Hubwieser, P.: Analysis of scratch projects of an introductory programming course for primary school students. In: 2017 IEEE global engineering education conference (EDUCON). pp. 1229-1236. IEEE (2017)","DOI":"10.1109\/EDUCON.2017.7943005"},{"key":"ref7","doi-asserted-by":"crossref","unstructured":"Mladenovi\u0107, M., \u017danko, \u017d., Zaharija, G.: From blocks to text: Bridging programming misconceptions. Journal of educational computing research 62(5), 1302-1326 (2024)","DOI":"10.1177\/07356331241240047"},{"key":"ref8","doi-asserted-by":"crossref","unstructured":"Weintrop, D., Wilensky, U.: How block-based, text-based, and hybrid block\/text modalities shape novice programming practices. International Journal of Child-Computer Interaction 17, 83-92 (2018), https:\/\/www.sciencedirect.com\/science\/article\/pii\/S2212868917300314","DOI":"10.1016\/j.ijcci.2018.04.005"},{"key":"ref9","doi-asserted-by":"crossref","unstructured":"Resnick, M., Maloney, J., Monroy-Hernandez, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., et al.: Scratch: programming for all. Communications of the ACM 52(11), 60-67 (2009)","DOI":"10.1145\/1592761.1592779"},{"key":"ref10","doi-asserted-by":"crossref","unstructured":"Videnovik, M., Vlahu-Gjorgievska, E., Trajkovik, V.: To code or not to code: Introducing coding in primary schools. Computer Applications in Engineering Education 29(5), 1132-1145 (2021)","DOI":"10.1002\/cae.22369"},{"key":"ref11","unstructured":"Wolber, D., Abelson, H., Spertus, E., Looney, L.: App inventor. O\u2019Reilly Media, Inc. (2011)"},{"key":"ref12","unstructured":"Wilson, A., Hainey, T., Connolly, T.: Evaluation of computer games developed by primary school children to gauge understanding of programming concepts. In: European Conference on Games Based Learning. p. 549. Academic Conferences InternationalLimited (2012)"},{"key":"ref13","doi-asserted-by":"crossref","unstructured":"Saez-Lopez, J.M., Roman-Gonzalez, M., Vazquez-Cano, E.: Visual programming languages integrated across the curriculum in elementary school: A two year case study using \u201cscratch\u201d in five schools. Computers & Education 97, 129-141 (2016), https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0360131516300549","DOI":"10.1016\/j.compedu.2016.03.003"},{"key":"ref14","doi-asserted-by":"crossref","unstructured":"Tsukamoto, H., Takemura, Y., Nagumo, H., Ikeda, I., Monden, A., Matsumoto, K.: Programming education for primary school children using a textual programming language. In: 2015 IEEE Frontiers in Education Conference (FIE). pp. 1-7 (2015)","DOI":"10.1109\/FIE.2015.7344187"},{"key":"ref15","doi-asserted-by":"crossref","unstructured":"Moors, L., Luxton-Reilly, A., Denny, P.: Transitioning from block-based to text-based programming languages. In: 2018 International Conference on Learning and Teaching in Computing and Engineering (LaTICE). pp. 57-64. IEEE (2018)","DOI":"10.1109\/LaTICE.2018.000-5"},{"key":"ref16","doi-asserted-by":"crossref","unstructured":"Homer, M., Noble, J.: A tile-based editor for a textual programming language. In: IEEE Working Conference on Software Visualisation (VISSOFT). pp. 1-4 (2013)","DOI":"10.1109\/VISSOFT.2013.6650546"},{"key":"ref17","doi-asserted-by":"crossref","unstructured":"Bau, D., Bau, D.A., Dawson, M., Pickens, C.S.: Pencil code: block code for a text world. In: Proceedings of the 14th International Conference on Interaction Design and Children. pp. 445- 448 (2015)","DOI":"10.1145\/2771839.2771875"},{"key":"ref18","doi-asserted-by":"crossref","unstructured":"Leber, \u017d., \u010crepinek, M., Kosar, T.: Simultaneous multiple representation editing environment for primary school education. In: 2019 IEEE Symposium on Visual Languages and Human- Centric Computing (VL\/HCC). pp. 175-179. IEEE (2019)","DOI":"10.1109\/VLHCC.2019.8818927"},{"key":"ref19","doi-asserted-by":"crossref","unstructured":"Alves, L., Gaji\u0107, D., Rangel Henriques, P., Ivan\u010devi\u0107, V., Ivkovi\u0107, V., Lali\u0107, M., Lukovi\u0107, I., Varanda Pereira, M.J., Popov, S., Correia Tavares, P.: C tutor usage in relation to student achievement and progress: A study of introductory programming courses in Portugal and Serbia. Computer Applications in Engineering Education 28, 1058-1071 (2020)","DOI":"10.1002\/cae.22278"},{"key":"ref20","doi-asserted-by":"crossref","unstructured":"Kosar, T., Mernik, M., Carver, J.C.: Program comprehension of domain-specific and generalpurpose languages: comparison using a family of experiments. Empirical software engineering 17, 276-304 (2012)","DOI":"10.1007\/s10664-011-9172-x"},{"key":"ref21","doi-asserted-by":"crossref","unstructured":"Wohlin, C., Runeson, P., Host, M., Ohlsson, M.C., Regnell, B., Wesslen, A.: Experimentation in software engineering. Springer Science & Business Media (2012)","DOI":"10.1007\/978-3-642-29044-2"},{"key":"ref22","doi-asserted-by":"crossref","unstructured":"Kosar, T., Bjeladinovi\u0107 S., Ostoji\u0107, D., \u0160kembarevi\u0107, M.S., Leber, \u017d., Jeji\u0107, O.A., Furtula, F., Ljubisavljevi\u0107, M.D., Lukovi\u0107, I.S., Mernik, M.: Teaching beginners to program: should we start with block-based, text-based, or both notations? In: 2024 19th Conference on Computer Science and Intelligence Systems (FedCSIS). pp. 395-403. IEEE (2024)","DOI":"10.15439\/2024F448"},{"key":"ref23","doi-asserted-by":"crossref","unstructured":"Zaharija, G., Mladenovi\u0107, S., Boljat, I.: Introducing basic programming concepts to elementary school children. Procedia-social and behavioral sciences 106, 1576-1584 (2013)","DOI":"10.1016\/j.sbspro.2013.12.178"},{"key":"ref24","doi-asserted-by":"crossref","unstructured":"Maloney, J., Resnick, M., Rusk, N., Silverman, B., Eastmond, E.: The Scratch programming language and environment. ACM Transactions on Computing Education (TOCE) 10(4), 138- 144 (2010)","DOI":"10.1145\/1868358.1868363"},{"key":"ref25","doi-asserted-by":"crossref","unstructured":"Handur, V., Kalwad, P.D., Patil, M.S., Garagad, V.G., Yeligar, Nagaratna andPattar, P., Mehta, D., Baligar, P., H., J.: Integrating class and laboratory with hands-on programming: Its benefits and challenges. In: IEEE 4th International Conference on MOOCs, Innovation and Technology in Education (MITE). pp. 163-168 (2016)","DOI":"10.1109\/MITE.2016.041"},{"key":"ref26","doi-asserted-by":"crossref","unstructured":"Salant, O.M., Armoni, M., Ben-Ari, M.: Habits of programming in Scratch. In: ITiCSE \u201911: Proceedings of the 16th annual joint conference on Innovation and technology in computer science education. pp. 168-172 (2011)","DOI":"10.1145\/1999747.1999796"},{"key":"ref27","unstructured":"Cooper, S., Dann, W., Pausch, R.: Alice: a 3-D tool for introductory programming concepts. Journal of Computing Sciences in Colleges 15(5), 107-116 (2000)"},{"key":"ref28","doi-asserted-by":"crossref","unstructured":"Maloney, J.H., Peppler, K., Kafai, Y., Resnick, M., Rusk, N.: Programming by choice: urban youth learning programming with scratch. In: Proceedings of the 39th SIGCSE technical symposium on Computer science education. pp. 367-371 (2008)","DOI":"10.1145\/1352135.1352260"},{"key":"ref29","unstructured":"Martelli, A., Ravenscroft, A.M., Holden, S., McGuire, P.: Python in a Nutshell. \" O\u2019Reilly Media, Inc.\" (2023)"},{"key":"ref30","unstructured":"PYPL: PYPL - popularity of programming language. https:\/\/pypl.github.io\/PYPL.html, accessed: 22.05.2024."},{"key":"ref31","doi-asserted-by":"crossref","unstructured":"Bart, A.C., Tibau, J., Tilevich, E., Shaffer, C.A., Kafura, D.: BlockPy: An open access datascience environment for introductory programmers. Computer 50(5), 18-26 (2017)","DOI":"10.1109\/MC.2017.132"},{"key":"ref32","unstructured":"Bau, D.: Droplet, a blocks-based editor for text code. Journal of Computing Sciences in Colleges 30(6), 138-144 (2015)"},{"key":"ref33","doi-asserted-by":"crossref","unstructured":"Kolling, M.: The Greenfoot Programming Environment. ACM Transactions on Computing Education (TOCE) 10(4), 1-21 (2010)","DOI":"10.1145\/1868358.1868361"},{"key":"ref34","unstructured":"Fowler, M.: LanguageWorkbenches: The Killer-App for Domain Specific Languages? http: \/\/www.martinfowler.com (2005)"},{"key":"ref35","doi-asserted-by":"crossref","unstructured":"Voelter, M., Pech, V.: Language modularity with the MPS language workbench. In: 2012 34th International Conference on Software Engineering (ICSE). pp. 1449-1450. IEEE (2012)","DOI":"10.1109\/ICSE.2012.6227070"},{"key":"ref36","doi-asserted-by":"crossref","unstructured":"Weintrop, D., Wilensky, U.: Comparing block-based and text-based programming in high school computer science classrooms. ACM Transactions on Computing Education (TOCE) 18(1) (oct 2017), https:\/\/doi.org\/10.1145\/3089799","DOI":"10.1145\/3089799"},{"key":"ref37","doi-asserted-by":"crossref","unstructured":"Weintrop, D., Wilensky, U.: Transitioning from introductory block-based and text-based environments to professional programming languages in high school computer science classrooms. Computers & Education 142, 103646 (2019)","DOI":"10.1016\/j.compedu.2019.103646"},{"key":"ref38","doi-asserted-by":"crossref","unstructured":"Zhen Xu, Albert D. Ritzhaupt, F.T., Umapathy, K.: Block-based versus text-based programming environments on novice student learning outcomes: a meta-analysis study. Computer Science Education 29(2-3), 177-204 (2019), https:\/\/doi.org\/10.1080\/08993408.2019.1565233","DOI":"10.1080\/08993408.2019.1565233"},{"key":"ref39","doi-asserted-by":"crossref","unstructured":"Espinal, A., Vieira, C., Guerrero-Bequis, V.: Student ability and difficulties with transfer from a block-based programming language into other programming languages: a case study in Colombia. Computer Science Education 33(4), 567-599 (2023), https:\/\/doi.org\/10.1080\/08993408.2022.2079867","DOI":"10.1080\/08993408.2022.2079867"},{"key":"ref40","doi-asserted-by":"crossref","unstructured":"Lin, Y., Weintrop, D.: The landscape of block-based programming: Characteristics of blockbased environments and how they support the transition to text-based programming. Journal of Computer Languages 67, 101075 (2021), https:\/\/www.sciencedirect.com\/science\/article\/pii\/S259011842100054X","DOI":"10.1016\/j.cola.2021.101075"},{"key":"ref41","doi-asserted-by":"crossref","unstructured":"Kosar, T., Bohra, S., Mernik, M.: A Systematic Mapping Study driven by the margin of error. Journal of Systems and Software 144, 439-449 (2018)","DOI":"10.1016\/j.jss.2018.06.078"},{"key":"ref42","unstructured":"Fayyad, U.M., Piatetsky-Shapiro, G., Smyth, P., Uthurusamy, R.: Advances in knowledge discovery and data mining. American Association for Artificial Intelligence (1996)"},{"key":"ref43","unstructured":"Feldt, R., Magazinius, A.: Validity threats in empirical software engineering research - an initial survey. In: 22nd International Conference on Software Engineering & Knowledge Engineering (SEKE\u20192010), Redwood City, San Francisco Bay, CA, USA, July 1 - July 3, 2010. pp. 374-379. Knowledge Systems Institute Graduate School (2010)"},{"key":"ref44","doi-asserted-by":"crossref","unstructured":"Kosar, T., Gaberc, S., Carver, J.C., Mernik, M.: Program comprehension of domain-specific and general-purpose languages: replication of a family of experiments using integrated development environments. Empirical Software Engineering 23, 2734-2763 (2018)","DOI":"10.1007\/s10664-017-9593-2"}],"container-title":["Computer Science and Information Systems"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T21:32:46Z","timestamp":1778967166000},"score":1,"resource":{"primary":{"URL":"https:\/\/doiserbia.nb.rs\/Article.aspx?ID=1820-02142600002K"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026]]},"references-count":44,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026]]}},"URL":"https:\/\/doi.org\/10.2298\/csis250401002k","relation":{},"ISSN":["1820-0214","2406-1018"],"issn-type":[{"value":"1820-0214","type":"print"},{"value":"2406-1018","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026]]}}}