{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T04:29:54Z","timestamp":1792038594909,"version":"4.4.0"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2021,3,7]],"date-time":"2021-03-07T00:00:00Z","timestamp":1615075200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2021,3,7]],"date-time":"2021-03-07T00:00:00Z","timestamp":1615075200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"}],"funder":[{"DOI":"10.13039\/501100006245","name":"Ministry of Science and Technology, Israel","doi-asserted-by":"publisher","award":["1800\/14"],"award-info":[{"award-number":["1800\/14"]}],"id":[{"id":"10.13039\/501100006245","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2021,5]]},"DOI":"10.1007\/s11192-021-03914-1","type":"journal-article","created":{"date-parts":[[2021,3,7]],"date-time":"2021-03-07T07:02:30Z","timestamp":1615100550000},"page":"4137-4151","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Generalizing research findings for enhanced reproducibility: an approach based on verbal alternative representations"],"prefix":"10.1007","volume":"126","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2315-0477","authenticated-orcid":false,"given":"Ron S.","family":"Kenett","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abraham","family":"Rubinstein","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,3,7]]},"reference":[{"key":"3914_CR1","unstructured":"Arzarello, F., Kenett, R. S., Robutti, O et al. (2015). Teaching and assessing with new methodological tools (MERLO): A new pedagogy?. In: Hersh, M. A., Kotecha, M. (Eds.), Proceedings of the IMA International Conference on Barriers and Enablers to Learning Maths: Enhancing Learning and Teaching for All Learners, Glasgow, UK"},{"issue":"7604","key":"3914_CR2","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1038\/533452a","volume":"533","author":"M Baker","year":"2016","unstructured":"Baker, M. (2016). 1500 scientists lift the lid on reproducibility. Nature, 533(7604), 452\u2013454.","journal-title":"Nature"},{"key":"3914_CR3","doi-asserted-by":"publisher","unstructured":"Baribault, B., Donkin, C., Little, D et al. (2018). Metastudies for robust tests of theory. In: Proceedings of the National Academy of Science. 115(11), 201708285 doi: https:\/\/doi.org\/10.1073\/pnas.1708285114","DOI":"10.1073\/pnas.1708285114"},{"key":"3914_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.jconrel.2016.06.038","author":"M Bloch","year":"2015","unstructured":"Bloch, M., Yavin, E., Nissan, A., et al. (2015a). The effect of linker type and recognition peptide conjugation chemistry on tissue affinity and cytotoxicity of charged polyacrylamide. Journal of Controled Release. https:\/\/doi.org\/10.1016\/j.jconrel.2016.06.038.","journal-title":"Journal of Controled Release"},{"key":"3914_CR5","doi-asserted-by":"publisher","first-page":"898","DOI":"10.1002\/pat.3531","volume":"26","author":"M Bloch","year":"2015","unstructured":"Bloch, M., Kenett, R. S., Jablonowski, L., et al. (2015b). A multifactorial analysis of complex pharmaceutical platforms: An application of design of experiments to targetable polyacrylamide and ultrasound contrast agents. Polymer Advamced Technology, 26, 898\u2013905.","journal-title":"Polymer Advamced Technology"},{"key":"3914_CR6","unstructured":"Botvinik-Nezer, R. et al. (2019). Variability in the analysis of a single neuroimaging dataset by many teams, bioRchiv, https:\/\/www.biorxiv.org\/content\/10.1101\/843193v1"},{"key":"3914_CR7","unstructured":"Chu, W. (2019). EFSA defends negative opinion of kidney bean\u2019s weight-managing ability, NUTRA ingredients.com https:\/\/www.nutraingredients.com\/Article\/2019\/11\/18\/EFSA-defends-negative-kidney-bean-opinion-on-weight-loss"},{"key":"3914_CR8","doi-asserted-by":"crossref","unstructured":"Cinelli, C., Pearl, J. (2020). Generalizing experimental results by leveraging knowledge of mechanisms, UCLA Cognitive Systems Laboratory, Technical Report (R-492).","DOI":"10.1007\/s10654-020-00687-4"},{"key":"3914_CR9","volume-title":"The planning of experiments","author":"DR Cox","year":"1958","unstructured":"Cox, D. R. (1958). The planning of experiments. New York: John Wiley."},{"key":"3914_CR10","unstructured":"Drummond, C. (2009). Replicability is not reproducibility: Nor is it good science. In: 26th ICML, Proceeding of the Evaluation Methods for Machine Learning Workshop, Montreal, Canada"},{"key":"3914_CR11","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1016\/j.jpeds.2018.07.091","volume":"203","author":"A Efron","year":"2018","unstructured":"Efron, A., Zeldin, Y., Gotesdyner, L. A., et al. (2018). Structured gradual exposure protocol to baked and heated milk in the treatment of milk allergy. The Journal of Pediatrics, 203, 204\u2013209. https:\/\/doi.org\/10.1016\/j.jpeds.2018.07.091.","journal-title":"The Journal of Pediatrics"},{"key":"3914_CR12","doi-asserted-by":"crossref","unstructured":"Etkind, M., Shafrir, U., Kenett, R. et al. (2016) Pedagogy for conceptual thinking in the digital age: Enhancing learning outcomes with meaning equivalence reusable learning objects (MERLO) formative assessments in 2nd International Conference on Higher Education Advances, Universitat Politecnica de Valencia, Spain 105\u2013113.","DOI":"10.4995\/HEAD16.2016.2581"},{"key":"3914_CR13","volume-title":"The design of experiments","author":"RA Fisher","year":"1935","unstructured":"Fisher, R. A. (1935). The design of experiments. UK: Oliver and Boyd."},{"key":"3914_CR14","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1177\/1745691614551642","volume":"9","author":"A Gelman","year":"2014","unstructured":"Gelman, A., & Carlin, J. (2014). Beyond power calculations: Assessing type S (sign) and type M (magnitude) errors. Perspectives on Psychological Science, 9, 641\u2013651.","journal-title":"Perspectives on Psychological Science"},{"key":"3914_CR15","doi-asserted-by":"publisher","first-page":"875","DOI":"10.1002\/sim.4780110705","volume":"11","author":"SN Goodman","year":"1992","unstructured":"Goodman, S. N. (1992). A comment on replication, p values and evidence. Statistics in Medicine, 11, 875\u2013879.","journal-title":"Statistics in Medicine"},{"issue":"6","key":"3914_CR16","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1093\/aje\/kwx259","volume":"186","author":"S Greenland","year":"2017","unstructured":"Greenland, S. (2017). Invited commentary: The need for cognitive science in methodology. American Journal of Epidemiology, 186(6), 639\u2013645.","journal-title":"American Journal of Epidemiology"},{"key":"3914_CR17","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1007\/s10654-016-0149-3","volume":"31","author":"S Greenland","year":"2016","unstructured":"Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., et al. (2016). Statistical tests, P values, confidence intervals, and power: A guide to misinterpretations. European Journal of Epidemiology, 31, 337\u2013350.","journal-title":"European Journal of Epidemiology"},{"issue":"1","key":"3914_CR18","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1214\/13-AOAS697","volume":"8","author":"R Heller","year":"2014","unstructured":"Heller, R., & Yekutieli, D. (2014). Replicability analysis for genome-wide association studies. The Annals of Applied Statistics, 8(1), 481\u2013498.","journal-title":"The Annals of Applied Statistics"},{"key":"3914_CR19","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1177\/003591576505800503","volume":"58","author":"AB Hill","year":"1965","unstructured":"Hill, A. B. (1965). The environment and disease: Association or causation? Proceedings of the Royal Society of Medicine, 58, 295\u2013300.","journal-title":"Proceedings of the Royal Society of Medicine"},{"key":"3914_CR20","unstructured":"Kenett, R. S., Nguyen, N-K. (2017). Experimental learning generate high information quality by comparing alternative experimental designs. Quality Progress 40\u201347"},{"key":"3914_CR21","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1111\/rssa.12007","volume":"177","author":"RS Kenett","year":"2014","unstructured":"Kenett, R. S., & Shmueli, G. (2014). On information quality. Journal of the Royal Statistical Society Series A, 177, 3\u201338.","journal-title":"Journal of the Royal Statistical Society Series A"},{"key":"3914_CR22","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1038\/nmeth.3489","volume":"12","author":"RS Kenett","year":"2015","unstructured":"Kenett, R. S., & Shmueli, G. (2015). Clarifying the terminology that describes scientific reproducibility. Nature Methods, 12, 699.","journal-title":"Nature Methods"},{"key":"3914_CR23","doi-asserted-by":"publisher","DOI":"10.1002\/9781118890622","volume-title":"Information quality (InfoQ): The potential of data and analysis to generate knowledge, Chichester","author":"RS Kenett","year":"2016","unstructured":"Kenett, R. S., & Shmueli, G. (2016). Information quality (InfoQ): The potential of data and analysis to generate knowledge, Chichester. UK: John Wiley."},{"key":"3914_CR24","volume-title":"Modern industrial statistics with applications in R, minitab and JMP, Chichester","author":"RS Kenett","year":"2014","unstructured":"Kenett, R. S., Zacks, S., with contributions by Amberti, D. (2014). Modern industrial statistics with applications in R, minitab and JMP, Chichester. UK: John Wiley."},{"issue":"5","key":"3914_CR25","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1111\/pai.12915","volume":"29","author":"M Kidon","year":"2018","unstructured":"Kidon, M., Blanca-Lopez, N., Gomes, E., et al. (2018). Diagnosis and management of hypersensitivity reactions to non-steroidal anti-inflammatory drugs (NSAIDs) in children and adolescents. Pediatric Allergy Immunology, 29(5), 469\u2013480. https:\/\/doi.org\/10.1111\/pai.12915.","journal-title":"Pediatric Allergy Immunology"},{"issue":"1","key":"3914_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/00031305.2016.1277161","volume":"72","author":"TA Kuffner","year":"2019","unstructured":"Kuffner, T. A., & Walker, S. G. (2019). Why are p values controversial? The American Statistician, 72(1), 1\u20138. https:\/\/doi.org\/10.1080\/00031305.2016.1277161.","journal-title":"The American Statistician"},{"issue":"4 Suppl","key":"3914_CR27","doi-asserted-by":"publisher","first-page":"151S","DOI":"10.1016\/0197-2456(89)90054-8","volume":"10","author":"J Lubsen","year":"1989","unstructured":"Lubsen, J., & Tijssen, J. G. (1989). Large trials with simple protocols: Indications and contraindications. Controlled Clinical Trials, 10(4 Suppl), 151S-160S.","journal-title":"Controlled Clinical Trials"},{"key":"3914_CR28","doi-asserted-by":"publisher","DOI":"10.1017\/9781107286184","volume-title":"Statistical inference as severe testing: How to get beyond the statistics wars","author":"D Mayo","year":"2018","unstructured":"Mayo, D. (2018). Statistical inference as severe testing: How to get beyond the statistics wars. Cambridge: Cambridge University Press."},{"key":"3914_CR29","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1126\/science.1250475","volume":"343","author":"M McNutt","year":"2014","unstructured":"McNutt, M. (2014). Reproducibility. Science, 343, 229.","journal-title":"Science"},{"key":"3914_CR30","unstructured":"Neath, A. (2018). Type S error control in hypothesis testing. In: Proceeding of the 2018 JSM Conference, Vancouver, Canada"},{"issue":"2","key":"3914_CR31","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1515\/jci-2015-0025","volume":"3","author":"J Pearl","year":"2015","unstructured":"Pearl, J. (2015). Generalizing experimental findings. Journal of Causal Inference, 3(2), 259\u2013266.","journal-title":"Journal of Causal Inference"},{"key":"3914_CR32","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1038\/nmeth0310-167","volume":"7","author":"SH Richter","year":"2010","unstructured":"Richter, S. H., Garner, J. P., Auer, C., et al. (2010). Systematic variation improves reproducibility of animal experiments. Nature Methods, 7, 167\u2013168.","journal-title":"Nature Methods"},{"key":"3914_CR33","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1038\/nmeth.1312","volume":"6","author":"SH Richter","year":"2009","unstructured":"Richter, S. H., Garner, J. P., & Wurbel, H. (2009). Environmental standardization: Cure or cause of poor reproducibility in animal experiments? Nature Methods, 6, 257\u2013261.","journal-title":"Nature Methods"},{"key":"3914_CR34","unstructured":"Roettger, B., Winter, B., Baayen, H. (2018). Emergent data analysis in phonetic sciences: Towards pluralism and reproducibility in phonetic sciences. https:\/\/www.semanticscholar.org\/paper\/Emergent-data-analysis-in-phonetic-sciences-%3A-and-Roettger-Winter\/48f729bd2de15ebe71cdf04e68c14c85958a7d30"},{"key":"3914_CR35","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1037\/0033-2909.105.2.309","volume":"105","author":"P Sedlmeier","year":"1989","unstructured":"Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309\u2013316.","journal-title":"Psychological Bulletin"},{"key":"3914_CR36","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1080\/135952201753172953","volume":"6","author":"SJ Senn","year":"2001","unstructured":"Senn, S. J. (2001). Two cheers for p values. Journal of Epidemiology and Biostatistics, 6, 193\u2013204.","journal-title":"Journal of Epidemiology and Biostatistics"},{"issue":"16","key":"3914_CR37","doi-asserted-by":"publisher","first-page":"2437","DOI":"10.1002\/sim.1072","volume":"21","author":"SJ Senn","year":"2002","unstructured":"Senn, S. J. (2002). A comment on replication, p values and evidence S. N. Goodman, statistics in medicine 1992; 11: 875\u2013879. Statistics in Medicine, 21(16), 2437\u20132444.","journal-title":"Statistics in Medicine"},{"key":"3914_CR38","doi-asserted-by":"crossref","unstructured":"Shafrir, U., Kenett, R. S. (2015). Concept science evidence-based MERLO learning analytics, in handbook of applied learning theory and design in modern education, IGI Global, University of Toronto, Canada","DOI":"10.4018\/978-1-4666-9634-1.ch016"},{"issue":"2","key":"3914_CR39","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1080\/00031305.2016.1154108","volume":"70","author":"RL Wasserstein","year":"2016","unstructured":"Wasserstein, R. L., & Lazar, N. A. (2016). The ASA\u2019s statement on p values: Context, process and purpose. The American Statistician, 70(2), 129\u2013133.","journal-title":"The American Statistician"},{"issue":"5","key":"3914_CR40","doi-asserted-by":"publisher","first-page":"854","DOI":"10.1002\/bimj.201700001","volume":"59","author":"S Wellek","year":"2017","unstructured":"Wellek, S. (2017). A critical evaluation of the current p value controversy. Biometrical Journal, 59(5), 854\u2013872. https:\/\/doi.org\/10.1002\/bimj.201700001.","journal-title":"Biometrical Journal"},{"key":"3914_CR41","doi-asserted-by":"crossref","unstructured":"Yarkoni, T. (2019) The generalizability crisis, PsyArXiv, https:\/\/psyarxiv.com\/jqw35)","DOI":"10.31234\/osf.io\/jqw35"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-021-03914-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-021-03914-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-021-03914-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,20]],"date-time":"2022-12-20T13:28:07Z","timestamp":1671542887000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-021-03914-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,7]]},"references-count":41,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,5]]}},"alternative-id":["3914"],"URL":"https:\/\/doi.org\/10.1007\/s11192-021-03914-1","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,7]]},"assertion":[{"value":"22 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 February 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}