{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:19:40Z","timestamp":1740122380093,"version":"3.37.3"},"reference-count":73,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,8,9]],"date-time":"2024-08-09T00:00:00Z","timestamp":1723161600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,8,9]],"date-time":"2024-08-09T00:00:00Z","timestamp":1723161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100008349","name":"Universit\u00e4t Duisburg-Essen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100008349","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2024,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Indentation is an old technique that emphasizes elements in source code using white spaces or tabs. But while this technique has been taught and applied for decades, evidence for its effectiveness is weak: up to 2022 relatively few experiments can be found \u2013 the present authors are only aware of one single experiment that revealed an effect of indentation and reported the effect size, but even in that experiment the effect of indentation was found to be weak. The situation changed recently, where an experiment was published that suddenly revealed a strong and large effect of indentation in control flows on reaction time. However, although the experiment provided an initial indication of a possible cause for the difference between indented and non-indented code (the length of the code that can be skipped in indented code), the evidence for this indicator was rather weak. The present paper presents a formal model on the differences in reading times (measured in terms of reaction times) between indented and non-indented code. Based on that model a controlled experiment on generated tasks was designed and executed on 27 participants (undergraduate students, PhD students, professionals). The experiment (again) confirms a strong (p &lt; .001) and large (<jats:inline-formula><jats:alternatives><jats:tex-math>$$\\eta _{p}^{2}$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:msubsup><mml:mi>\u03b7<\/mml:mi><mml:mrow><mml:mi>p<\/mml:mi><\/mml:mrow><mml:mn>2<\/mml:mn><\/mml:msubsup><\/mml:math><\/jats:alternatives><\/jats:inline-formula>= .198,<jats:inline-formula><jats:alternatives><jats:tex-math>$$\\frac{M_{Non-Indented}}{M_{Indented}}$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:mfrac><mml:msub><mml:mi>M<\/mml:mi><mml:mrow><mml:mi>N<\/mml:mi><mml:mi>o<\/mml:mi><mml:mi>n<\/mml:mi><mml:mo>-<\/mml:mo><mml:mi>I<\/mml:mi><mml:mi>n<\/mml:mi><mml:mi>d<\/mml:mi><mml:mi>e<\/mml:mi><mml:mi>n<\/mml:mi><mml:mi>t<\/mml:mi><mml:mi>e<\/mml:mi><mml:mi>d<\/mml:mi><\/mml:mrow><\/mml:msub><mml:msub><mml:mi>M<\/mml:mi><mml:mrow><mml:mi>Indented<\/mml:mi><\/mml:mrow><\/mml:msub><\/mml:mfrac><\/mml:math><\/jats:alternatives><\/jats:inline-formula>= 2.13) effect of indentation. Furthermore, it confirms that the larger the skippable code is, the larger is the difference between reading time of indented and non-indented code (p = .001,<jats:inline-formula><jats:alternatives><jats:tex-math>$$\\eta _{p}^{2}$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:msubsup><mml:mi>\u03b7<\/mml:mi><mml:mrow><mml:mi>p<\/mml:mi><\/mml:mrow><mml:mn>2<\/mml:mn><\/mml:msubsup><\/mml:math><\/jats:alternatives><\/jats:inline-formula>= .072). I.e., the experiment goes beyond the point \u201c<jats:italic>indented vs non-indented code<\/jats:italic>\u201d and explains the difference by revealing a factor that controls this difference. However, although the previous statements holds true for the whole sample in the experiment, this effect could only be shown for a subset of individual participants.<\/jats:p>","DOI":"10.1007\/s10664-024-10531-y","type":"journal-article","created":{"date-parts":[[2024,8,9]],"date-time":"2024-08-09T10:02:47Z","timestamp":1723197767000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Indentation and reading time: a randomized control trial on the differences between generated indented and non-indented if-statements"],"prefix":"10.1007","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5936-2143","authenticated-orcid":false,"given":"Stefan","family":"Hanenberg","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johannes","family":"Morzeck","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Volker","family":"Gruhn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,8,9]]},"reference":[{"issue":"1","key":"10531_CR1","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1007\/s10664-018-9628-3","volume":"24","author":"S Ajami","year":"2019","unstructured":"Ajami S, Woodbridge Y, Feitelson DG (2019) Syntax, predicates, idioms - what really affects code complexity? Empir Softw Eng 24(1):287\u2013328","journal-title":"Empir Softw Eng"},{"key":"10531_CR2","doi-asserted-by":"crossref","unstructured":"Albayrak \u00d6, Davenport D (2010) Impact of maintainability defects on code inspections. In: Proceedings of the 2010 ACM-IEEE international symposium on empirical software engineering and measurement, ESEM \u201910, New York, USA. Association for Computing Machinery","DOI":"10.1145\/1852786.1852850"},{"key":"10531_CR3","first-page":"73:3","volume":"01","author":"M Appelbaum","year":"2018","unstructured":"Appelbaum M, Cooper H, Kline R, Mayo-Wilson E, Nezu A, Rao S (2018) Journal article reporting standards for quantitative research in psychology: The apa publications and communications board task force report. Am Psychol 01:73:3\u201325","journal-title":"Am Psychol"},{"key":"10531_CR4","unstructured":"Association for Computer\u00a0Machinery (2016) People of ACM \u2013 Margaret Burnett. https:\/\/www.acm.org\/articles\/people-of-acm\/2016\/margaret-burnett"},{"key":"10531_CR5","doi-asserted-by":"crossref","unstructured":"Bauer J, Siegmund J, Peitek N, Hofmeister JC, Apel S (2019) Indentation: simply a matter of style or support for program comprehension? In: Proceedings of the 27th international conference on program comprehension, ICPC \u201919, pp 154\u2013164. IEEE Press","DOI":"10.1109\/ICPC.2019.00033"},{"issue":"4","key":"10531_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3340571","volume":"41","author":"ED Berger","year":"2019","unstructured":"Berger ED, Hollenbeck C, Maj P, Vitek O, Vitek J (2019) On the impact of programming languages on code quality: a reproduction study. ACM Trans Program Lang Syst 41(4):1","journal-title":"ACM Trans Program Lang Syst"},{"issue":"2","key":"10531_CR7","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1007\/s10664-012-9201-4","volume":"18","author":"Dave W Binkley","year":"2013","unstructured":"Binkley Dave W, Davis Marcia, Lawrie Dawn J, Maletic Jonathan I, Morrell Christopher, Sharif Bonita (2013) The impact of identifier style on effort and comprehension. Empir Softw Eng 18(2):219\u2013276","journal-title":"Empir Softw Eng"},{"key":"10531_CR8","doi-asserted-by":"crossref","unstructured":"Binkley D, Davis M, Lawrie D, Morrell C (2009) To camelcase or under_score. In: The 17th IEEE international conference on program comprehension, ICPC 2009, Vancouver, British Columbia, Canada, May 17-19, 2009, pp 158\u2013167","DOI":"10.1109\/ICPC.2009.5090039"},{"key":"10531_CR9","doi-asserted-by":"crossref","unstructured":"Buse RPL, Sadowski C, Weimer W (2011) Benefits and barriers of user evaluation in software engineering research. In: Proceedings of the 2011 ACM international conference on object oriented programming systems languages and applications, OOPSLA \u201911, pp 643\u2013656, New York, USA. Association for Computing Machinery","DOI":"10.1145\/2048066.2048117"},{"issue":"4","key":"10531_CR10","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1109\/TSE.2009.70","volume":"36","author":"RPL Buse","year":"2010","unstructured":"Buse RPL, Weimer WR (2010) Learning a metric for code readability. IEEE Trans Softw Eng 36(4):546\u2013558","journal-title":"IEEE Trans Softw Eng"},{"key":"10531_CR11","doi-asserted-by":"crossref","unstructured":"Busjahn T, Bednarik R, Begel A, Crosby M, Paterson JH, Schulte C, Sharif B, Tamm S (2015) Eye movements in code reading: relaxing the linear order. In Proceedings of the 2015 IEEE 23rd international conference on program comprehension, ICPC \u201915, pp 255\u2013265. IEEE Press","DOI":"10.1109\/ICPC.2015.36"},{"key":"10531_CR12","doi-asserted-by":"crossref","unstructured":"Devanbu PT, Zimmermann T, Bird C (2016) Belief & evidence in empirical software engineering. In: Proceedings of the 38th international conference on software engineering, ICSE 2016, Austin, TX, USA, May 14-22, 2016, pp 108\u2013119","DOI":"10.1145\/2884781.2884812"},{"issue":"6","key":"10531_CR13","doi-asserted-by":"publisher","first-page":"3283","DOI":"10.1007\/s10270-019-00720-5","volume":"18","author":"M El-Attar","year":"2019","unstructured":"El-Attar M (2019) A comparative study of students and professionals in syntactical model comprehension experiments. Softw Syst Model 18(6):3283\u20133329","journal-title":"Softw Syst Model"},{"key":"10531_CR14","doi-asserted-by":"crossref","unstructured":"Endrikat S, Hanenberg S, Robbes R, Stefik A (2014) How do api documentation and static typing affect api usability? In: Proceedings of the 36th international conference on software engineering, ICSE 2014, pp 632\u2013642, New York, USA, 2014. ACM","DOI":"10.1145\/2568225.2568299"},{"issue":"1","key":"10531_CR15","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1007\/s10664-017-9523-3","volume":"23","author":"D Falessi","year":"2018","unstructured":"Falessi D, Juristo N, Wohlin C, Turhan B, M\u00fcnch J, Jedlitschka Andreas, Oivo Markku (2018) Empirical software engineering experts on the use of students and professionals in experiments. Empir Softw Eng 23(1):452\u2013489","journal-title":"Empir Softw Eng"},{"key":"10531_CR16","doi-asserted-by":"crossref","unstructured":"Feigenspan J, K\u00e4stner C, Liebig J, Apel S, Hanenberg S (2012) Measuring programming experience. In: Beyer D, van Deursen A, Godfrey MW (eds) IEEE 20th international conference on program comprehension, ICPC 2012, Passau, Germany, June 11-13, 2012, pp 73\u201382. IEEE Computer Society","DOI":"10.1109\/ICPC.2012.6240511"},{"key":"10531_CR17","unstructured":"Feitelson DG (2015) Using students as experimental subjects in software engineering research - a review and discussion of the evidence. arXiv:1512.08409"},{"issue":"6","key":"10531_CR18","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1007\/s10664-022-10160-3","volume":"27","author":"DG Feitelson","year":"2022","unstructured":"Feitelson DG (2022) Considerations and pitfalls for reducing threats to the validity of controlled experiments on code comprehension. Empir Softw Eng 27(6):123","journal-title":"Empir Softw Eng"},{"issue":"6","key":"10531_CR19","doi-asserted-by":"publisher","first-page":"3801","DOI":"10.1007\/s10664-018-9655-0","volume":"23","author":"R Feldt","year":"2018","unstructured":"Feldt R, Zimmermann T, Bergersen GR, Falessi D, Jedlitschka A, Juristo N, M\u00fcnch J, Oivo M, Runeson P, Shepperd M, Sj\u00f8berg DIK, Turhan B (2018) Four commentaries on the use of students and professionals in empirical software engineering experiments. Empir Softw Eng 23(6):3801\u20133820","journal-title":"Empir Softw Eng"},{"issue":"2","key":"10531_CR20","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1145\/2936313.2816720","volume":"51","author":"Lars Fischer","year":"2015","unstructured":"Fischer Lars, Hanenberg Stefan (2015) An empirical investigation of the effects of type systems and code completion on api usability using typescript and javascript in ms visual studio. SIGPLAN Not 51(2):154\u2013167","journal-title":"SIGPLAN Not"},{"key":"10531_CR21","volume-title":"Refactoring: Improving the Design of Existing Code","author":"M Fowler","year":"1999","unstructured":"Fowler M (1999) Refactoring: Improving the Design of Existing Code. Addison-Wesley Longman Publishing Co., Inc, USA"},{"key":"10531_CR22","volume-title":"Smalltalk-80: The Language and Its Implementation","author":"Adele Goldberg","year":"1983","unstructured":"Goldberg Adele, Robson David (1983) Smalltalk-80: The Language and Its Implementation. Addison-Wesley Longman Publishing Co., Inc, USA"},{"key":"10531_CR23","unstructured":"Grogono P (1984) Programming in Pascal. Addison-Wesley series in computer science. Addison-Wesley"},{"issue":"2","key":"10531_CR24","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/s10664-021-10077-3","volume":"27","author":"Stefan Hanenberg","year":"2021","unstructured":"Hanenberg Stefan, Mehlhorn Nils (2021) Two n-of-1 self-trials on readability differences between anonymous inner classes (aics) and lambda expressions (les) on java code snippets. Empir Softw Eng 27(2):33","journal-title":"Empir Softw Eng"},{"issue":"5","key":"10531_CR25","doi-asserted-by":"publisher","first-page":"2795","DOI":"10.1007\/s10664-017-9579-0","volume":"23","author":"Christoph Hannebauer","year":"2018","unstructured":"Hannebauer Christoph, Hesenius Marc, Gruhn Volker (2018) Does syntax highlighting help programming novices? Empir Softw Eng 23(5):2795\u20132828","journal-title":"Empir Softw Eng"},{"key":"10531_CR26","doi-asserted-by":"crossref","unstructured":"Hart SG, Staveland LE (1988) Development of nasa-tlx (task load index): results of empirical and theoretical research. In: Hancock PA, Meshkati N (eds) Human mental workload, vol\u00a052 of advances in psychology, pp 139\u2013183. North-Holland","DOI":"10.1016\/S0166-4115(08)62386-9"},{"issue":"1","key":"10531_CR27","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1007\/s10664-018-9621-x","volume":"24","author":"Johannes C Hofmeister","year":"2019","unstructured":"Hofmeister Johannes C, Siegmund Janet, Holt Daniel V (2019) Shorter identifier names take longer to comprehend. Empir Softw Eng 24(1):417\u2013443","journal-title":"Empir Softw Eng"},{"issue":"3","key":"10531_CR28","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1023\/A:1026586415054","volume":"5","author":"Martin H\u00f6st","year":"2000","unstructured":"H\u00f6st Martin, Regnell Bj\u00f6rn, Wohlin Claes (2000) Using students as subjects-a comparative study of students and professionals in lead-time impact assessment. Empir Softw Eng 5(3):201\u2013214","journal-title":"Empir Softw Eng"},{"key":"10531_CR29","unstructured":"Kaijanaho A-J (2015) Evidence-based programming language design: a philosophical and methodological exploration. University of Jyv\u00e4skyl\u00e4, Finnland, 11"},{"key":"10531_CR30","volume-title":"The Elements of Programming Style","author":"BW Kernighan","year":"1982","unstructured":"Kernighan BW, Plauger PJ (1982) The Elements of Programming Style, 2nd edn. McGraw-Hill Inc, USA","edition":"2"},{"issue":"5","key":"10531_CR31","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1016\/S0020-7373(84)80068-1","volume":"21","author":"TE Kesler","year":"1984","unstructured":"Kesler TE, Uram RB, Magareh-Abed F, Fritzsche A, Amport C, Dunsmore HE (1984) The effect of indentation on program comprehension. Int J Man-Mach Stud 21(5):415\u2013428","journal-title":"Int J Man-Mach Stud"},{"key":"10531_CR32","doi-asserted-by":"crossref","unstructured":"Kitchenham B, Fry J, Linkman S (2003) The case against cross-over designs in software engineering. In Eleventh annual international workshop on software technology and engineering practice, pp 65\u201367","DOI":"10.1109\/STEP.2003.32"},{"issue":"1","key":"10531_CR33","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1007\/s10664-013-9279-3","volume":"20","author":"AJ Ko","year":"2015","unstructured":"Ko AJ, Latoza TD, Burnett MM (2015) A practical guide to controlled experiments of software engineering tools with human participants. Empir Softw Eng 20(1):110\u2013141","journal-title":"Empir Softw Eng"},{"issue":"1","key":"10531_CR34","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1186\/s13104-015-1020-4","volume":"8","author":"A K\u00fchberger","year":"2015","unstructured":"K\u00fchberger A, Fritz A, Lermer E, Scherndl T (2015) The significance fallacy in inferential statistics. BMC Res Notes 8(1):84","journal-title":"BMC Res Notes"},{"key":"10531_CR35","doi-asserted-by":"crossref","unstructured":"Lappi V, Tirronen V, Itkonen J (2023) A replication study on the intuitiveness of programming language syntax. Softw Qual J","DOI":"10.1007\/s11219-023-09631-7"},{"key":"10531_CR36","doi-asserted-by":"crossref","unstructured":"Lawrie DJ, Morrell C, Feild H, Binkley DW (2006) What\u2019s in a name? A study of identifiers. In: 14th International conference on program comprehension (ICPC 2006), 14-16 June 2006, Athens, Greece, pp 3\u201312. IEEE Computer Society","DOI":"10.1109\/ICPC.2006.51"},{"issue":"12","key":"10531_CR37","doi-asserted-by":"publisher","first-page":"720","DOI":"10.3928\/0048-5713-19951201-07","volume":"25","author":"EF Loftus","year":"1995","unstructured":"Loftus EF, Pickrell JE (1995) The formation of false memories. Psychiat Ann 25(12):720\u2013725","journal-title":"Psychiat Ann"},{"key":"10531_CR38","unstructured":"Love LT (1977) Relating individual differences in computer programming performance to human information processing abilities. PhD thesis"},{"issue":"4","key":"10531_CR39","doi-asserted-by":"publisher","first-page":"1982","DOI":"10.1007\/s10664-017-9574-5","volume":"23","author":"Lech Madeyski","year":"2018","unstructured":"Madeyski Lech, Kitchenham Barbara A (2018) Effect sizes and their variance for AB\/BA crossover design studies. Empir Softw Eng 23(4):1982\u20132017","journal-title":"Empir Softw Eng"},{"issue":"4","key":"10531_CR40","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1109\/TSE.1976.233837","volume":"SE\u20132","author":"TJ McCabe","year":"1976","unstructured":"McCabe TJ (1976) A complexity measure. IEEE Tran Softw Eng SE\u20132(4):308\u2013320","journal-title":"IEEE Tran Softw Eng"},{"key":"10531_CR41","doi-asserted-by":"crossref","unstructured":"Mehlhorn N, Hanenberg S (2022) Imperative versus declarative collection processing: an RCT on the understandability of traditional loops versus the stream API in java. In 44th IEEE\/ACM 44th international conference on software engineering, ICSE 2022, Pittsburgh, PA, USA, May 25-27, 2022, pp 1157\u20131168. ACM","DOI":"10.1145\/3510003.3519016"},{"issue":"11","key":"10531_CR42","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1145\/182.358437","volume":"26","author":"RJ Miara","year":"1983","unstructured":"Miara RJ, Musselman JA, Navarro JA, Shneiderman B (1983) Program indentation and comprehensibility. Commun ACM 26(11):861\u2013867","journal-title":"Commun ACM"},{"key":"10531_CR43","doi-asserted-by":"crossref","unstructured":"Minelli R, Mocci A, Lanza M (2015) I know what you did last summer: an investigation of how developers spend their time. In: Proceedings of the 2015 IEEE 23rd international conference on program comprehension, ICPC \u201915, pp 25\u201335. IEEE Press","DOI":"10.1109\/ICPC.2015.12"},{"key":"10531_CR44","doi-asserted-by":"publisher","first-page":"2010","DOI":"10.1136\/bmj.c869","volume":"340","author":"D Moher","year":"2010","unstructured":"Moher D, Hopewell S, Schulz KF, Montori V, G\u00f8tzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG (2010) Consort, explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 340:2010","journal-title":"BMJ"},{"key":"10531_CR45","doi-asserted-by":"crossref","unstructured":"Morzeck J, Hanenberg S, Werger O, Gruhn V (2023) Indentation in source code: a randomized control trial on the readability of control flows in java code with large effects. In: Proceedings of the 18th international conference on software technologies (ICSOFT 2023). SITEPRESS","DOI":"10.5220\/0012087500003538"},{"issue":"4","key":"10531_CR46","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1109\/MS.2006.105","volume":"23","author":"GC Murphy","year":"2006","unstructured":"Murphy GC, Kersten M, Findlater L (2006) How are java software developers using the eclipse ide? IEEE Softw 23(4):76\u201383","journal-title":"IEEE Softw"},{"key":"10531_CR47","doi-asserted-by":"crossref","unstructured":"Norcio AF (1982) Indentation, documentation and programmer comprehension. In: Proceedings of the 1982 conference on human factors in computing systems, CHI \u201982, pp 118\u2013120, New York, USA. Association for Computing Machinery","DOI":"10.1145\/800049.801766"},{"issue":"2","key":"10531_CR48","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1002\/asi.4630340203","volume":"34","author":"AF Norcio","year":"1983","unstructured":"Norcio AF, Kerst SM (1983) Human memory organization for computer programs. J Am Soc Inf Sci 34(2):109\u2013114","journal-title":"J Am Soc Inf Sci"},{"issue":"4","key":"10531_CR49","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1177\/001316446002000401","volume":"20","author":"J Nunnally","year":"1960","unstructured":"Nunnally J (1960) The place of statistics in psychology. Educ Psychol Meas 20(4):641\u2013650","journal-title":"Educ Psychol Meas"},{"key":"10531_CR50","unstructured":"Patton MQ (2014) Qualitative Research & Evaluation Methods: Integrating Theory and Practice. SAGE Publications"},{"key":"10531_CR51","volume-title":"The Logic of Scientific Discovery","author":"KR Popper","year":"1934","unstructured":"Popper KR (1934) The Logic of Scientific Discovery. Hutchinson, London"},{"issue":"2","key":"10531_CR52","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1111\/1467-9280.t01-1-01427","volume":"14","author":"DR Proffitt","year":"2003","unstructured":"Proffitt DR, Stefanucci J, Banton T, Epstein W (2003) The role of effort in perceiving distance. Psychol Sci 14(2):106\u2013112","journal-title":"Psychol Sci"},{"issue":"10","key":"10531_CR53","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1145\/3126905","volume":"60","author":"B Ray","year":"2017","unstructured":"Ray B, Posnett D, Devanbu P, Filkov V (2017) A large-scale study of programming languages and code quality in github. Commun ACM 60(10):91\u2013100","journal-title":"Commun ACM"},{"key":"10531_CR54","doi-asserted-by":"crossref","unstructured":"Ray B, Posnett D, Filkov V, Devanbu P (2014) A large scale study of programming languages and code quality in github. In: Proceedings of the 22nd ACM SIGSOFT international symposium on foundations of software engineering, FSE 2014, pp 155\u2013165, New York, USA. Association for Computing Machinery","DOI":"10.1145\/2635868.2635922"},{"key":"10531_CR55","doi-asserted-by":"crossref","unstructured":"Salman I, Misirli AT, Juristo N (2015) Are students representatives of professionals in software engineering experiments? In: 2015 IEEE\/ACM 37th IEEE international conference on software engineering, vol 1, pp 666\u2013676","DOI":"10.1109\/ICSE.2015.82"},{"key":"10531_CR56","doi-asserted-by":"crossref","unstructured":"Scalabrino S, Linares-V\u00e1squez M, Oliveto R, Poshyvanyk D (2018) A comprehensive model for code readability. J Softw Evol Process 30(6)","DOI":"10.1002\/smr.1958"},{"key":"10531_CR57","doi-asserted-by":"crossref","unstructured":"Scalabrino S, V\u00e1squez ML, Poshyvanyk D, Oliveto R (2016) Improving code readability models with textual features. In 24th IEEE international conference on program comprehension, ICPC 2016, Austin, TX, USA, May 16-17, 2016, pp 1\u201310. IEEE Computer Society","DOI":"10.1109\/ICPC.2016.7503707"},{"key":"10531_CR58","doi-asserted-by":"crossref","unstructured":"Senn SS (2002) Cross-over Trials in Clinical Research. Statistics in Practice. Wiley","DOI":"10.1002\/0470854596"},{"key":"10531_CR59","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1016\/j.jss.2017.12.034","volume":"138","author":"T Sharma","year":"2018","unstructured":"Sharma T, Spinellis D (2018) A survey on software smells. J Syst Softw 138:158\u2013173","journal-title":"J Syst Softw"},{"issue":"24","key":"10531_CR60","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1177\/154193127602002401","volume":"20","author":"B Shneiderman","year":"1976","unstructured":"Shneiderman B, McKay D (1976) Experimental investigations of computer program debugging and modification. roc Hum Factors Ergon Soc Annu Meet 20(24):557\u2013563","journal-title":"roc Hum Factors Ergon Soc Annu Meet"},{"issue":"5","key":"10531_CR61","doi-asserted-by":"publisher","first-page":"1299","DOI":"10.1007\/s10664-013-9286-4","volume":"19","author":"Janet Siegmund","year":"2014","unstructured":"Siegmund Janet, K\u00e4stner Christian, Liebig J\u00f6rg, Apel Sven, Hanenberg Stefan (2014) Measuring and modeling programming experience. Empir Softw Eng 19(5):1299\u20131334","journal-title":"Empir Softw Eng"},{"issue":"1","key":"10531_CR62","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/S0020-7373(77)80045-X","volume":"9","author":"ME Sime","year":"1977","unstructured":"Sime ME, Green TRG, Guest DJ (1977) Scope marking in computer conditionals-a psychological evaluation. Int J Man-Mach Stud 9(1):107\u2013118","journal-title":"Int J Man-Mach Stud"},{"issue":"2","key":"10531_CR63","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1006\/ijhc.1972.0302","volume":"51","author":"ME Sime","year":"1999","unstructured":"Sime ME, Green TRG, Guest DJ (1999) Psychological evaluation of two conditional constructions used in computer languages. Int J Hum Comput Stud 51(2):125\u2013133","journal-title":"Int J Hum Comput Stud"},{"key":"10531_CR64","doi-asserted-by":"crossref","unstructured":"Stefik A, Hanenberg S, McKenney M, Andrews A, Yellanki SK, Siebert S (2014) What is the foundation of evidence of human factors decisions in language design? an empirical study on programming language workshops. In: Proceedings of the 22nd international conference on program comprehension, ICPC 2014, pp 223\u2013231, New York, USA. Association for Computing Machinery","DOI":"10.1145\/2597008.2597154"},{"key":"10531_CR65","doi-asserted-by":"crossref","unstructured":"Stefik Andreas, Siebert Susanna (2013) An empirical investigation into programming language syntax. ACM Trans Comput Educ 13(4)","DOI":"10.1145\/2534973"},{"key":"10531_CR66","doi-asserted-by":"crossref","unstructured":"Stuchlik A, Hanenberg S (2011) Static vs. dynamic type systems: an empirical study about the relationship between type casts and development time. In: Proceedings of the 7th symposium on dynamic languages, DLS \u201911, pp 97\u2013106, New York, USA. Association for Computing Machinery","DOI":"10.1145\/2047849.2047861"},{"key":"10531_CR67","doi-asserted-by":"crossref","unstructured":"Svahnberg M, Aurum A, Wohlin C (2008) Using students as subjects - an empirical evaluation. In Rombach HD, Elbaum SG, M\u00fcnch J (eds) Proceedings of the second international symposium on empirical software engineering and measurement, ESEM 2008, October 9-10, 2008, Kaiserslautern, Germany, pp 288\u2013290. ACM","DOI":"10.1145\/1414004.1414055"},{"issue":"1","key":"10531_CR68","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/0164-1212(94)00111-Y","volume":"28","author":"WF Tichy","year":"1995","unstructured":"Tichy WF, Lukowicz P, Prechelt L, Heinz EA (1995) Experimental evaluation in computer science: A quantitative study. J Syst Softw 28(1):9\u201318","journal-title":"J Syst Softw"},{"key":"10531_CR69","doi-asserted-by":"crossref","unstructured":"Uesbeck PM, Stefik A, Hanenberg S, Pedersen J, Daleiden P (2016) An empirical study on the impact of c++ lambdas and programmer experience. In: Proceedings of the 38th international conference on software engineering, ICSE 2016, Austin, TX, USA, May 14-22, 2016, pp 760\u2013771","DOI":"10.1145\/2884781.2884849"},{"issue":"4","key":"10531_CR70","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1109\/TSE.1984.5010252","volume":"SE\u201310","author":"I Vessey","year":"1984","unstructured":"Vessey I, Weber R (1984) Research on structured programming: an empiricist\u2019s evaluation. IEEE Trans Softw Eng SE\u201310(4):397\u2013407","journal-title":"IEEE Trans Softw Eng"},{"key":"10531_CR71","unstructured":"Weissman LM (1974) A Methodology for Studying the Psychological Complexity of Computer Programs. PhD thesis. AAI0510378"},{"key":"10531_CR72","doi-asserted-by":"crossref","unstructured":"Wiese E, Rafferty AN, Pyper J (2022) Readable vs. writable code: a survey of intermediate students\u2019 structure choices. In: Proceedings of the 53rd ACM technical symposium on computer science education - volume 1, SIGCSE 2022, pp 321\u2013327, New York, USA. Association for Computing Machinery","DOI":"10.1145\/3478431.3499413"},{"issue":"1","key":"10531_CR73","doi-asserted-by":"publisher","first-page":"185","DOI":"10.2466\/pr0.1983.52.1.185","volume":"52","author":"ME Woolfolk","year":"1983","unstructured":"Woolfolk ME, Castellan W, Brooks CI (1983) Pepsi versus coke: labels, not tastes, prevail. Psychol Rep 52(1):185\u2013186","journal-title":"Psychol Rep"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10531-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-024-10531-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10531-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T14:30:30Z","timestamp":1732631430000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-024-10531-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,9]]},"references-count":73,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,9]]}},"alternative-id":["10531"],"URL":"https:\/\/doi.org\/10.1007\/s10664-024-10531-y","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"type":"print","value":"1382-3256"},{"type":"electronic","value":"1573-7616"}],"subject":[],"published":{"date-parts":[[2024,8,9]]},"assertion":[{"value":"22 July 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 August 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of Interest"}}],"article-number":"134"}}