{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:20:03Z","timestamp":1740122403717,"version":"3.37.3"},"reference-count":73,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T00:00:00Z","timestamp":1639958400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T00:00:00Z","timestamp":1639958400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100008349","name":"Universit\u00e4t Duisburg-Essen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100008349","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2022,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In Java, lambda expressions (LEs) were introduced at a time where the similar language construct anonymous inner class (AIC) already existed for years. But while LEs became quite popular in mainstream programming languages in general, their usability is hardly studied. From the Java perspective the need to study the relationship between LEs and AICs was and is quite obvious, because both language constructs co-exist. However, it is quite usual that new language constructs are introduced although they are not or hardly studied using scientific methods \u2013 and an often heard argument from programming language designers is that the effort or the costs for the application of the scientific method on language constructs is too high. The present paper contributes in two different ways. First, with respect to LEs in comparison to AICs, this paper presents two N-of-1 studies (i.e. randomized control trials executed on a single subject) where LEs and AICs are used as listeners in Java code. Both experiments had two similar and rather simple tasks (\u201ccount the number of parameters\u201d, respectively \u201ccount the number of used parameters\u201d) with the dependent variable being reaction time. The first experiment used the number of parameters, the second the number of used parameters as the controlled, independent variable (in addition to the technique LE and AIC). Other variables (LOC, etc.) were randomly generated within given boundaries. The main result of both experiments is that LEs without type annotations require less reading time (<jats:italic>p<\/jats:italic>hs .2, reduction of reaction time of at most 35%). The results are based on 9,600 observations (one N-of-1 trial with eight replications). This gives evidence that the readability of LEs without type annotations improves the readability of code. However, the effect seems to be so small, that we do not expect this to have a larger impact on daily programming. Second, we see the contribution of this paper in the application of N-of-1 trials. Such experiments require relatively low effort in the data selection but still permit to analyze results in a non-subjective way using commonly accepted analysis techniques. Additionally, they permit to increase the number of selected data points in comparison to traditional multi\u2013subject experiments. We think that researchers should take such experiments into account before planning and executing larger experiments.<\/jats:p>","DOI":"10.1007\/s10664-021-10077-3","type":"journal-article","created":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T11:03:50Z","timestamp":1639998230000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Two N-of-1 self-trials on readability differences between anonymous inner classes (AICs) and lambda expressions (LEs) on Java code snippets"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5936-2143","authenticated-orcid":false,"given":"Stefan","family":"Hanenberg","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nils","family":"Mehlhorn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,12,20]]},"reference":[{"issue":"3","key":"10077_CR1","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1177\/2515245918773742","volume":"1","author":"B Aczel","year":"2018","unstructured":"Aczel B, Palfi B, Szollosi A, Kovacs M, Szaszi B, Szecsi P, Zrubka M, Gronau QF, van den Bergh D, Wagenmakers E-J (2018) Quantifying support for the null hypothesis in psychology: An empirical investigation. Adv Methods Pract Psychol Sci 1(3):357\u2013366","journal-title":"Adv Methods Pract Psychol Sci"},{"key":"10077_CR2","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1037\/amp0000191","volume":"73","author":"M Appelbaum","year":"2018","unstructured":"Appelbaum M, Cooper H, Kline R, Mayo-Wilson E, Nezu A, Rao S (2018) Journal article reporting standards for quantitative research in psychology: The apa publications and communications board task force report. Am Psychol 73:3\u201325","journal-title":"Am Psychol"},{"key":"10077_CR3","unstructured":"Baltes S, Ralph P (2020) Sampling in software engineering research: A critical review and guidelines. arXiv:2002.07764"},{"key":"10077_CR4","doi-asserted-by":"crossref","unstructured":"Binkley D, Davis M, Lawrie D, Morrell C (2009) To camelcase or under_score. In: The 17th IEEE international conference on program comprehension, ICPC 2009, Vancouver, British Columbia, Canada, May 17-19, 2009. pp 158\u2013167","DOI":"10.1109\/ICPC.2009.5090039"},{"key":"10077_CR5","unstructured":"Bossavit L (2015) The Leprechauns of software engineering. Laurent Bossavit"},{"key":"10077_CR6","doi-asserted-by":"crossref","unstructured":"Buse RPL, Sadowski C, Weimer W (2011) Benefits and barriers of user evaluation in software engineering research. In: Proceedings of the 2011 ACM international conference on object oriented programming systems languages and applications, OOPSLA \u201911. Association for Computing Machinery, New York, pp 643\u2013656","DOI":"10.1145\/2048066.2048117"},{"key":"10077_CR7","unstructured":"Microsoft C. (2007) C# Language Specification Version 3.0"},{"key":"10077_CR8","doi-asserted-by":"crossref","unstructured":"Dantas R, Carvalho A, Marc\u00edlio D, Fantin L, Silva U, Lucas W, Bonif\u00e1cio R (2018) Reconciling the past and the present: An empirical study on the application of source code transformations to automatically rejuvenate java programs. In: 2018 IEEE 25th international conference on software analysis, evolution and reengineering (SANER). pp 497\u2013501","DOI":"10.1109\/SANER.2018.8330247"},{"key":"10077_CR9","doi-asserted-by":"crossref","unstructured":"Dony C, Malenfant J, Cointe P (1992) Prototype-based languages: From a new taxonomy to constructive proposals and their validation. In: Conference proceedings on object-oriented programming systems, languages, and applications, OOPSLA \u201992. Association for Computing Machinery, New York, pp 201\u2013217","DOI":"10.1145\/141936.141954"},{"key":"10077_CR10","doi-asserted-by":"crossref","unstructured":"Endrikat S, Hanenberg S, Robbes R, Stefik A (2014) How do api documentation and static typing affect api usability?. In: Proceedings of the 36th international conference on software engineering, ICSE 2014. ACM, New York, pp 632\u2013642","DOI":"10.1145\/2568225.2568299"},{"issue":"1","key":"10077_CR11","doi-asserted-by":"publisher","first-page":"8","DOI":"10.6030\/1939-067X-3.1.8","volume":"3","author":"SR Evans","year":"2010","unstructured":"Evans SR (2010) Clinical trial structures. J Exper Stroke Transl Med 3(1):8\u201318","journal-title":"J Exper Stroke Transl Med"},{"key":"10077_CR12","doi-asserted-by":"crossref","unstructured":"Fakhoury S, Roy D, Hassan SK, Arnaoudova V (2019) Improving source code readability: Theory and practice. In: Proceedings of the 27th international conference on program comprehension, ICPC \u201919. IEEE Press, pp 2\u201312","DOI":"10.1109\/ICPC.2019.00014"},{"issue":"2","key":"10077_CR13","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1145\/2936313.2816720","volume":"51","author":"L Fischer","year":"2015","unstructured":"Fischer L, Hanenberg S (2015) An empirical investigation of the effects of type systems and code completion on api usability using typescript and javascript in ms visual studio. SIGPLAN Not 51(2):154\u2013167","journal-title":"SIGPLAN Not"},{"issue":"3","key":"10077_CR14","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1136\/eb-2013-101382","volume":"16","author":"D Forbes","year":"2013","unstructured":"Forbes D (2013) Blinding: an essential component in decreasing risk of bias in experimental designs. Evid Based Nurs 16(3):70\u201371","journal-title":"Evid Based Nurs"},{"key":"10077_CR15","doi-asserted-by":"crossref","unstructured":"Franklin L, Gyori A, Lahoda J, Dig D (2013) Lambdaficator: From imperative to functional programming through automated refactoring. In: 2013 35th international conference on software engineering (ICSE), pages 1287\u20131290. IEEE","DOI":"10.1109\/ICSE.2013.6606699"},{"key":"10077_CR16","unstructured":"Gamma E, Helm R, Johnson RE (1994) Design patterns. Elements of reusable object-oriented software, 1st edn., Addison-Wesley Longman Amsterdam, Reading. reprint edition"},{"issue":"8","key":"10077_CR17","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1016\/S0950-5849(02)00049-6","volume":"44","author":"RL Glass","year":"2002","unstructured":"Glass RL, Vessey I, Ramesh V (2002) Research in software engineering: an analysis of the literature. Inf Softw Technol 44(8):491\u2013506","journal-title":"Inf Softw Technol"},{"issue":"3","key":"10077_CR18","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1053\/j.seminhematol.2008.04.003","volume":"45","author":"S Goodman","year":"2008","unstructured":"Goodman S (2008) A dirty dozen: twelve p-value misconceptions. Semin Hematol 45(3):135\u201340","journal-title":"Semin Hematol"},{"key":"10077_CR19","volume-title":"Java language specification, second edition: the java series","author":"J Gosling","year":"2000","unstructured":"Gosling J, Joy B, Steele G, Bracha G (2000) Java language specification, second edition: the java series, 2nd edn. Addison-Wesley Longman Publishing Co., Inc., Boston","edition":"2nd edn."},{"key":"10077_CR20","unstructured":"Gosling J, Joy B, Steele GL, Bracha G, Buckley A (2014) The Java language specification, Java SE 8 Edition, 1st edn., Addison-Wesley Professional, Boston"},{"key":"10077_CR21","volume-title":"The Java language specification","author":"J Gosling","year":"1996","unstructured":"Gosling J, Joy WN, Steele GL Jr (1996) The Java language specification, 1st edn. Addison-Wesley, Boston","edition":"1st edn."},{"issue":"2","key":"10077_CR22","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1177\/001872088602800205","volume":"28","author":"JD Gould","year":"1986","unstructured":"Gould JD, Grischkowsky N (1986) Does visual angle of a line of characters affect reading speed? Hum Factors 28(2):165\u2013173","journal-title":"Hum Factors"},{"key":"10077_CR23","doi-asserted-by":"crossref","unstructured":"Hanenberg S (2010) Faith, hope, and love: An essay on software science?s neglect of human factors. In: Proceedings of the ACM international conference on object oriented programming systems languages and applications, OOPSLA \u201910. ACM, New York, pp 933\u2013946","DOI":"10.1145\/1932682.1869536"},{"issue":"1","key":"10077_CR24","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1007\/s10664-018-9621-x","volume":"24","author":"JC Hofmeister","year":"2019","unstructured":"Hofmeister JC, Siegmund J, Holt DV (2019) Shorter identifier names take longer to comprehend. Empir Softw Eng 24(1):417\u2013443","journal-title":"Empir Softw Eng"},{"key":"10077_CR25","doi-asserted-by":"crossref","unstructured":"Hollmann N, Hanenberg S (2017) An empirical study on the readability of regular expressions Textual versus graphical. In: IEEE working conference on software visualization, VISSOFT 2017, Shanghai, China, September 18-19, 2017. IEEE, pp 74\u201384","DOI":"10.1109\/VISSOFT.2017.27"},{"key":"10077_CR26","doi-asserted-by":"crossref","unstructured":"Hoppe M, Hanenberg S (2013) Do developers benefit from generic types? an empirical comparison of generic and raw types in java. In: Proceedings of the 2013 ACM SIGPLAN International Conference on Object Oriented Programming Systems Languages and Applications, OOPSLA \u201913. Association for Computing Machinery, New York, pp 457\u2013474","DOI":"10.1145\/2509136.2509528"},{"key":"10077_CR27","unstructured":"Institute of E. S. (2020) What works clearinghouse: standards handbook. U.S. Department of Education version 4.1 edition"},{"issue":"1","key":"10077_CR28","doi-asserted-by":"publisher","first-page":"e11429","DOI":"10.2196\/11429","volume":"21","author":"D Jemielniak","year":"2019","unstructured":"Jemielniak D, Masukume G, Wilamowski M (2019) The most influential medical journals according to wikipedia: Quantitative analysis. J Med Internet Res 21(1):e11429\u2013e11429","journal-title":"J Med Internet Res"},{"key":"10077_CR29","unstructured":"Kaijanaho A-J (2015) Evidence-based programming language design: a philosophical and methodological exploration. University of Jyv\u00e4skyl\u00e4, innland"},{"key":"10077_CR30","doi-asserted-by":"publisher","first-page":"218ra5","DOI":"10.1126\/scitranslmed.3006175","volume":"6","author":"S Kam-Hansen","year":"2014","unstructured":"Kam-Hansen S, Jakubowski M, Kelley JM, Kirsch I, Hoaglin D, Kaptchuk TJ, Burstein R (2014) Altered placebo and drug labeling changes the outcome of episodic migraine attacks. Sci Transl Med 6:218ra5","journal-title":"Sci Transl Med"},{"issue":"9117","key":"10077_CR31","doi-asserted-by":"publisher","first-page":"1722","DOI":"10.1016\/S0140-6736(97)10111-8","volume":"351","author":"TJ Kaptchuk","year":"1998","unstructured":"Kaptchuk TJ (1998) Powerful placebo: the dark side of the randomised controlled trial. Lancet 351(9117):1722\u20131725","journal-title":"Lancet"},{"key":"10077_CR32","doi-asserted-by":"crossref","unstructured":"Katzmarski B, Koschke R (2012) Program complexity metrics and programmer opinions. In: 2012 20th IEEE international conference on program comprehension (ICPC). pp 17\u201326","DOI":"10.1109\/ICPC.2012.6240486"},{"key":"10077_CR33","doi-asserted-by":"crossref","unstructured":"Kitchenham B, Fry J, Linkman S (2003) The case against cross-over designs in software engineering. In: Eleventh annual international workshop on software technology and engineering practice. pp 65\u201367","DOI":"10.1109\/STEP.2003.32"},{"issue":"1","key":"10077_CR34","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1007\/s10664-013-9279-3","volume":"20","author":"A Ko","year":"2015","unstructured":"Ko A, Latoza TD, Burnett MM (2015) A practical guide to controlled experiments of software engineering tools with human participants. Empir Softw Eng 20(1):110\u2013141","journal-title":"Empir Softw Eng"},{"key":"10077_CR35","unstructured":"Kratochwill T, Hitchcock J, Horner R, Rl Levin J, Odom SL, Rindskopf DM, Shadish W (2010) Single-case designs technical documentation. What works clearinghouse"},{"key":"10077_CR36","volume-title":"Fundamentals of behavioral research","author":"WJ Lammers","year":"2004","unstructured":"Lammers WJ, Badia P (2004) Fundamentals of behavioral research. Thomson\/Wadsworth, Belmont"},{"key":"10077_CR37","doi-asserted-by":"crossref","unstructured":"Lawrie DJ, Morrell C, Feild H, Binkley DW (2006) What\u2019s in a name? A study of identifiers. In: 14th international conference on program comprehension (ICPC 2006), 14-16 June 2006, Athens, Greece. IEEE Computer Society, pp 3\u201312","DOI":"10.1109\/ICPC.2006.51"},{"key":"10077_CR38","doi-asserted-by":"crossref","unstructured":"Lucas W, Bonif\u00e1cio R, Canedo ED, Marc\u00edlio D, Lima F (2019) Does the introduction of lambda expressions improve the comprehension of java programs?. In: Proceedings of the XXXIII Brazilian symposium on software engineering, SBES 2019. Association for Computing Machinery, New York, pp 187\u2013196","DOI":"10.1145\/3350768.3350791"},{"issue":"4","key":"10077_CR39","doi-asserted-by":"publisher","first-page":"1982","DOI":"10.1007\/s10664-017-9574-5","volume":"23","author":"L Madeyski","year":"2018","unstructured":"Madeyski L, Kitchenham B (2018) Effect sizes and their variance for AB\/BA crossover design studies. Empir Softw Eng 23(4):1982\u20132017","journal-title":"Empir Softw Eng"},{"issue":"OOPSLA","key":"10077_CR40","doi-asserted-by":"publisher","first-page":"85:1","DOI":"10.1145\/3133909","volume":"1","author":"D Mazinanian","year":"2017","unstructured":"Mazinanian D, Ketkar A, Tsantalis N, Dig D (2017) Understanding the use of lambda expressions in java. Proc ACM Program Lang 1 (OOPSLA):85:1\u201385:31","journal-title":"Proc ACM Program Lang"},{"key":"10077_CR41","unstructured":"McConnell S (2011) What does 10x mean? measuring variations in programmer productivity. In: Oram A, Wilson G (eds) Making software - what really works, and why we believe it, theory in practice. O\u2019Reilly, pp 567\u2013574"},{"issue":"8","key":"10077_CR42","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1177\/0141076817721131","volume":"110","author":"RD Mirza","year":"2017","unstructured":"Mirza RD, Punja S, Vohra S, Guyatt G (2017) The history and development of n-of-1 trials. J R Soc Med 110(8):330\u2013340","journal-title":"J R Soc Med"},{"issue":"1","key":"10077_CR43","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1007\/s10664-018-9622-9","volume":"24","author":"S Nielebock","year":"2019","unstructured":"Nielebock S, Heum\u00fcller R, Ortmeier F (2019) Programmers do not favor lambda expressions for concurrent object-oriented code. Empir Softw Eng 24(1):103\u2013138","journal-title":"Empir Softw Eng"},{"key":"10077_CR44","doi-asserted-by":"crossref","unstructured":"Okon S, Hanenberg S (2016) Can we enforce a benefit for dynamically typed languages in comparison to statically typed ones? a controlled experiment. In: 2016 IEEE 24th international conference on program comprehension (ICPC). pp 1\u201310","DOI":"10.1109\/ICPC.2016.7503719"},{"key":"10077_CR45","unstructured":"ACM Transactions on C. E. (2021) Available at https:\/\/dl.acm.org\/journal\/toce\/author-guidelines, last access: 07\/31\/2021"},{"issue":"4","key":"10077_CR46","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1109\/MS.2013.46","volume":"31","author":"F Ortin","year":"2014","unstructured":"Ortin F, Conde P, Fernandez-Lanvin D, Izquierdo R (2014) The runtime performance of invokedynamic: An evaluation with a java library. IEEE Softw 31(4):82\u201390","journal-title":"IEEE Softw"},{"issue":"6","key":"10077_CR47","doi-asserted-by":"publisher","first-page":"1047","DOI":"10.1007\/s10664-012-9236-6","volume":"18","author":"C Parnin","year":"2013","unstructured":"Parnin C, Bird C, Murphy-Hill ER (2013) Adoption and use of java generics. Empir Softw Eng 18(6):1047\u20131089","journal-title":"Empir Softw Eng"},{"key":"10077_CR48","volume-title":"Qualitative research & evaluation methods: integrating theory and practice","author":"MQ Patton","year":"2014","unstructured":"Patton MQ (2014) Qualitative research & evaluation methods: integrating theory and practice. SAGE Publications, Philadelphia"},{"key":"10077_CR49","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1375\/brim.7.2.119","volume":"7","author":"M Perdices","year":"2006","unstructured":"Perdices M, Schultz R, Tate R, Mcdonald S, Togher L, Savage S, Winders K, Smith K (2006) The evidence base of neuropsychological rehabilitation in acquired brain impairment (abi): How good is the research? Brain Impair 7:119\u2013132","journal-title":"Brain Impair"},{"key":"10077_CR50","doi-asserted-by":"crossref","unstructured":"Petersen P, Hanenberg S, Robbes R (2014) An empirical comparison of static and dynamic type systems on api usage in the presence of an ide: Java vs. groovy with eclipse. In: Proceedings of the 22nd International Conference on Program Comprehension, ICPC 2014. Association for Computing Machinery, New York, pp 212\u2013222","DOI":"10.1145\/2597008.2597152"},{"key":"10077_CR51","volume-title":"Types and programming languages","author":"BC Pierce","year":"2002","unstructured":"Pierce BC (2002) Types and programming languages, 1st edn. MIT Press, Cambridge","edition":"1st edn."},{"key":"10077_CR52","doi-asserted-by":"publisher","first-page":"1359","DOI":"10.1001\/jama.292.11.1359","volume":"292","author":"D Rennie","year":"2004","unstructured":"Rennie D (2004) Trial registration: a great idea switches from ignored to irresistible. JAMA 292:1359\u201362","journal-title":"JAMA"},{"issue":"3","key":"10077_CR53","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1016\/j.ijpsycho.2010.03.006","volume":"76","author":"AP Rudell","year":"2010","unstructured":"Rudell AP, Hu B (2010) Effects of long-time reading experience on reaction time and the recognition potential. Int J Psychophysiol 76(3):158\u2013168","journal-title":"Int J Psychophysiol"},{"key":"10077_CR54","doi-asserted-by":"crossref","unstructured":"Scalabrino S, Bavota G, Vendome C, Linares-V\u00e1squez M, Poshyvanyk D, Oliveto R (2017) Automatically assessing code understandability: How far are we?. In: 2017 32nd IEEE\/ACM international conference on automated software engineering (ASE). pp 417\u2013427","DOI":"10.1109\/ASE.2017.8115654"},{"key":"10077_CR55","doi-asserted-by":"publisher","DOI":"10.1002\/0470854596","volume-title":"Cross-over trials in clinical research. Statistics in Practice","author":"SS Senn","year":"2002","unstructured":"Senn SS (2002) Cross-over trials in clinical research. Statistics in Practice. Wiley, Hoboken"},{"issue":"4","key":"10077_CR56","doi-asserted-by":"publisher","first-page":"971","DOI":"10.3758\/s13428-011-0111-y","volume":"43","author":"W Shadish","year":"2011","unstructured":"Shadish W, Sullivan KJ (2011) Characteristics of single-case designs used to assess intervention effects in 2008. Behav Res Methods 43(4):971\u2013980","journal-title":"Behav Res Methods"},{"key":"10077_CR57","doi-asserted-by":"crossref","unstructured":"Sj\u00f8berg DIK, Anda B, Arisholm E, Dyb\u00e5 T, J\u00f8rgensen M, Karahasanovic A, Koren EF, Vok\u00e1c M (2002) Conducting realistic experiments in software engineering. In: Proceedings of the 2002 international symposium on empirical software engineering, ISESE \u201902. IEEE Computer Society, p 17","DOI":"10.1109\/ISESE.2002.1166921"},{"issue":"8","key":"10077_CR58","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1109\/MC.2017.3001257","volume":"50","author":"A Stefik","year":"2017","unstructured":"Stefik A, Hanenberg S (2017) Methodological irregularities in programming-language research. IEEE Comput 50(8):60\u201363","journal-title":"IEEE Comput"},{"key":"10077_CR59","doi-asserted-by":"crossref","unstructured":"Stefik A, Hanenberg S (2014) The programming language wars: Questions and responsibilities for the programming language community. In: Proceedings of the 2014 ACM international symposium on new ideas, new paradigms, and reflections on programming & software, Onward! 2014. ACM, New York, pp 283\u2013299","DOI":"10.1145\/2661136.2661156"},{"key":"10077_CR60","volume-title":"The C++ programming language","author":"B Stroustrup","year":"2013","unstructured":"Stroustrup B (2013) The C++ programming language, 4th edn. Addison-Wesley Professional, Boston","edition":"4th edn."},{"key":"10077_CR61","doi-asserted-by":"crossref","unstructured":"Stuchlik A (2011) Static vs. dynamic type systems: An empirical study about the relationship between type casts and development time. In: Proceedings of the 7th symposium on dynamic languages, DLS ?11. Association for Computing Machinery, New York, pp 97-?106","DOI":"10.1145\/2047849.2047861"},{"issue":"2","key":"10077_CR62","first-page":"119","volume":"25","author":"RL Tate","year":"2019","unstructured":"Tate RL, Perdices M, Rosenkoetter U, McDonald S, Togher L, Shadish W, Horner R, Kratochwill T, Barlow DH, Kazdin A, Sampson M, Shamseer L, Vohra S (2019) The single-case reporting guideline in behavioural interventions (scribe) 2016: Explanation and elaboration. Prat Psychol 25(2):119\u2013151","journal-title":"Prat Psychol"},{"key":"10077_CR63","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1109\/2.675631","volume":"31","author":"WF Tichy","year":"1998","unstructured":"Tichy WF (1998) Should computer scientists experiment more. IEEE Computer 31:32\u201340","journal-title":"IEEE Computer"},{"issue":"1","key":"10077_CR64","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/0164-1212(94)00111-Y","volume":"28","author":"WF Tichy","year":"1995","unstructured":"Tichy WF, Lukowicz P, Prechelt L, Heinz EA (1995) Experimental evaluation in computer science: A quantitative study. J Syst Softw 28 (1):9\u201318","journal-title":"J Syst Softw"},{"key":"10077_CR65","doi-asserted-by":"crossref","unstructured":"Tsantalis N, Mazinanian D, Rostami S (2017) Clone refactoring with lambda expressions. In: Proceedings of the 39th international conference on software engineering, ICSE \u201917. IEEE Press, pp 60\u201370","DOI":"10.1109\/ICSE.2017.14"},{"key":"10077_CR66","doi-asserted-by":"crossref","unstructured":"Uesbeck PM, Stefik A, Hanenberg S, Pedersen J, Daleiden P (2016) An empirical study on the impact of c++ lambdas and programmer experience. In: Proceedings of the 38th international conference on software engineering, ICSE 2016, Austin, TX, USA, May 14-22, 2016. pp 760\u2013771","DOI":"10.1145\/2884781.2884849"},{"key":"10077_CR67","unstructured":"Van Rossum G (1991) Documentation of the Python Programming Language 0.9"},{"issue":"2","key":"10077_CR68","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1109\/TSE.2015.2467378","volume":"42","author":"S Vegas","year":"2016","unstructured":"Vegas S, Apa C, Juristo N (2016) Crossover designs in software engineering experiments Benefits and perils. IEEE Trans Softw Eng 42(2):120\u2013135","journal-title":"IEEE Trans Softw Eng"},{"issue":"3","key":"10077_CR69","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1080\/17437199.2017.1343680","volume":"11","author":"R Vieira","year":"2017","unstructured":"Vieira R, McDonald S, Ara\u00fajo-Soares V, Sniehotta FF, Henderson R (2017) Dynamic modelling of n-of-1 data: powerful and flexible data analytics applied to individualised studies. Health Psychol Rev 11(3):222\u2013234","journal-title":"Health Psychol Rev"},{"key":"10077_CR70","doi-asserted-by":"crossref","unstructured":"Vohra S, Shamseer L, Sampson M, Bukutu C, Schmid CH, Tate R, Nikles J, Zucker DR, Kravitz R, Guyatt G, Altman DG, Moher D (2015) Consort extension for reporting n-of-1 trials (cent) 2015 statement. BMJ: 350","DOI":"10.1136\/bmj.h1738"},{"key":"10077_CR71","first-page":"276","volume":"109","author":"S Wellek","year":"2012","unstructured":"Wellek S, Blettner M (2012) On the proper use of the crossover design in clinical trials part 18 of a series on evaluation of scientific publications. Deutsches \u00c4rzteblatt Int 109:276\u201381","journal-title":"Deutsches \u00c4rzteblatt Int"},{"issue":"3","key":"10077_CR72","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1016\/j.jss.2008.06.040","volume":"82","author":"MV Zelkowitz","year":"2009","unstructured":"Zelkowitz MV (2009) An update to experimental models for validating computer technology. J Syst Softw 82(3):373\u2013376","journal-title":"J Syst Softw"},{"issue":"5","key":"10077_CR73","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1109\/2.675630","volume":"31","author":"MV Zelkowitz","year":"1998","unstructured":"Zelkowitz MV, Wallace DR (1998) Experimental models for validating technology. Computer 31(5):23\u201331","journal-title":"Computer"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-10077-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-021-10077-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-10077-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,14]],"date-time":"2023-11-14T10:15:03Z","timestamp":1699956903000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-021-10077-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,20]]},"references-count":73,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,3]]}},"alternative-id":["10077"],"URL":"https:\/\/doi.org\/10.1007\/s10664-021-10077-3","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"type":"print","value":"1382-3256"},{"type":"electronic","value":"1573-7616"}],"subject":[],"published":{"date-parts":[[2021,12,20]]},"assertion":[{"value":"28 October 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 December 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"33"}}