{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T17:55:52Z","timestamp":1775584552542,"version":"3.50.1"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2022,2,8]],"date-time":"2022-02-08T00:00:00Z","timestamp":1644278400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2022,6,30]]},"abstract":"<jats:p>This article presents a discussion of the importance of power analyses, providing an overview of when power analyses should be run in the context of the field of Human-Robot Interaction, as well as some examples of how to perform a power analysis. This work was motivated by the observation that the majority of papers published in the proceedings of recent HRI conferences did not report conducting a power analysis; an observation that has concerning implications for many conclusions drawn by these studies. This work is intended to raise awareness and encourage researchers to conduct power analyses when designing research studies using human participants.<\/jats:p>","DOI":"10.1145\/3495246","type":"journal-article","created":{"date-parts":[[2022,2,8]],"date-time":"2022-02-08T13:04:39Z","timestamp":1644325479000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Have I Got the Power? Analysing and Reporting Statistical Power in HRI"],"prefix":"10.1145","volume":"11","author":[{"given":"Madeleine E.","family":"Bartlett","sequence":"first","affiliation":[{"name":"University of Waterloo, Canada and CRNS, University of Plymouth, Plymouth, United Kingdom"}]},{"given":"C. E. R.","family":"Edmunds","sequence":"additional","affiliation":[{"name":"Queen Mary, University of London, London, United Kingdom"}]},{"given":"Tony","family":"Belpaeme","sequence":"additional","affiliation":[{"name":"IDLab \u2013 imec, Ghent University, Ghent, Belgium"}]},{"given":"Serge","family":"Thill","sequence":"additional","affiliation":[{"name":"Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen, The Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2022,2,8]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.4103\/picr.PICR_154_18"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2017.09.004"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1177\/0956797617723724"},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","unstructured":"M. Baker. 2016. Dutch agency launches first grants programme dedicated to replication. Retrieved from https:\/\/www.nature.com\/news\/dutch-agency-launches-first-grants-programme-dedicated-to-replication-1.20287.","DOI":"10.1038\/nature.2016.20287"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.5555\/2906831.2906897"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1093\/pan\/mpr057"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.5555\/2906831.2906837"},{"issue":"1","key":"e_1_3_2_9_2","article-title":"How many participants do we have to include in properly powered experiments? A tutorial of power analysis with reference tables.","volume":"2","author":"Brysbaert Marc","year":"2019","unstructured":"Marc Brysbaert. 2019. How many participants do we have to include in properly powered experiments? A tutorial of power analysis with reference tables. J. Cogn. 2, 1, Article 16 (2019). https:\/\/doi.org\/10.5334\/joc.72","journal-title":"J. Cogn."},{"key":"e_1_3_2_10_2","volume-title":"Methodological Issues and Strategies in Clinical Research","author":"Buhrmester M.","year":"2016","unstructured":"M. Buhrmester, T. Kwang, and S. D. Gosling. 2016. Amazon\u2019s mechanical turk: A new source of inexpensive, yet high-quality data? In Methodological Issues and Strategies in Clinical Research, A. E. Kazdin (Ed.). American Psychological Association, 133\u2013139. https:\/\/doi.org\/10.1037\/14805-009"},{"key":"e_1_3_2_11_2","unstructured":"Center for Open Science. 2015. What is statistical power. Retrieved from https:\/\/www.youtube.com\/watch?v=-ZU7fbvSJ60&ab_channel=CenterforOpenScience."},{"key":"e_1_3_2_12_2","unstructured":"S. Champely C. Ekstrom P. Dalgaard J. Gill S. Weibelzahl A. Anandkumar C. Ford R. Volcic and H. De Rosario. 2020. Basic Functions for Power Analysis. Retrieved from https:\/\/github.com\/heliosdrm\/pwr."},{"key":"e_1_3_2_13_2","first-page":"14","volume-title":"British Educational Research Association Annual Conference","volume":"12","author":"Coe R.","year":"2002","unstructured":"R. Coe. 2002. It\u2019s the effect size, stupid. In British Educational Research Association Annual Conference. Vol. 12. 14."},{"key":"e_1_3_2_14_2","article-title":"Statistical Power Analysis for the Behavioral Sciences.","author":"Cohen J.","year":"1988","unstructured":"J. Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences. Academic, New York, NY.","journal-title":"Academic"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.112.1.155"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2019.12.009"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.3758\/BF03193146"},{"key":"e_1_3_2_18_2","volume-title":"Methodological Issues and Strategies in Clinical Research","author":"Ferguson C. J.","year":"2016","unstructured":"C. J. Ferguson. 2016. An effect size primer: A guide for clinicians and researchers. In Methodological Issues and Strategies in Clinical Research. American Psychological Association, 301\u2013310. https:\/\/doi.org\/10.1037\/14805-020"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1590\/S1806-37132015000000215"},{"key":"e_1_3_2_20_2","volume-title":"An Adventure in Statistics: The Reality Enigma","author":"Field A.","year":"2016","unstructured":"A. Field. 2016. An Adventure in Statistics: The Reality Enigma. Sage."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1511\/2009.79.310"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1080\/19466315.2020.1724560"},{"key":"e_1_3_2_23_2","unstructured":"GraphPad Software. 2020. Calculating Sample Size with Power Analysis. Retrieved from https:\/\/www.youtube.com\/watch?v=KIRwsYTR62A&ab_channel=GraphPadSoftware."},{"key":"e_1_3_2_24_2","volume-title":"Introduction to Power Analysis: Two-group Studies","author":"Hedberg E. C.","year":"2017","unstructured":"E. C. Hedberg. 2017. Introduction to Power Analysis: Two-group Studies. Vol. 176. Sage Publications."},{"issue":"2","key":"e_1_3_2_25_2","first-page":"108","article-title":"The power of \u201cp\u201d: On overpowered clinical trials and \u201cpositive\u201d results","volume":"2","author":"Hochster Howard S.","year":"2008","unstructured":"Howard S. Hochster. 2008. The power of \u201cp\u201d: On overpowered clinical trials and \u201cpositive\u201d results. Gastroint. Cancer Res. 2, 2 (2008), 108.","journal-title":"Gastroint. Cancer Res."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1198\/000313001300339897"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3412374"},{"key":"e_1_3_2_28_2","unstructured":"HyLown Consulting LLC. Power and Sample size. 2013\u20132021 Retrieved from http:\/\/powerandsamplesize.com\/."},{"key":"e_1_3_2_29_2","volume-title":"Research Methods in Psychology-2nd Canadian Edition","author":"Jhangiani R. S.","year":"2015","unstructured":"R. S. Jhangiani, I. A. Chiang, and P. C. Price. 2015. Research Methods in Psychology-2nd Canadian Edition. BC Campus."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.2196\/13667"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1136\/emj.20.5.453"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-42307-0"},{"key":"e_1_3_2_33_2","unstructured":"Kaysville UT: NCSS.2018. Power Analysis and Sample Size Software. Retrieved from https:\/\/www.ncss.com\/software\/pass\/."},{"key":"e_1_3_2_34_2","unstructured":"Khan Academy. 2018. Introduction to power in significance tests | AP Statistics | Khan Academy. Retrieved from https:\/\/www.youtube.com\/watch?v=6_Cuz0QqRWc&ab_channel=KhanAcademy."},{"key":"e_1_3_2_35_2","volume-title":"How Many subjects?: Statistical Power Analysis in Research","author":"Kraemer H. C.","year":"2015","unstructured":"H. C. Kraemer and C. Blasey. 2015. How Many subjects?: Statistical Power Analysis in Research. Sage Publications."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1592\/phco.21.5.405.34503"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1002\/jor.1100080221"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2017.00523"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.12968\/ijtr.2010.17.1.45988"},{"key":"e_1_3_2_40_2","volume-title":"Annual Meeting of the American Educational Research Association, New Orleans, LA.","author":"McMillan J. H.","year":"2002","unstructured":"J. H. McMillan, S. Lawson, K. Lewis, and A. Snyder. 2002. Reporting effect size: The road less traveled. In Annual Meeting of the American Educational Research Association, New Orleans, LA."},{"key":"e_1_3_2_41_2","first-page":"175","article-title":"On the use and interpretation of certain test criteria for purposes of statistical inference: Part I","author":"Neyman J.","year":"1928","unstructured":"J. Neyman and E. S. Pearson. 1928. On the use and interpretation of certain test criteria for purposes of statistical inference: Part I. Biometrika (1928), 175\u2013240.","journal-title":"Biometrika"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1080\/19312450701641375"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.12688\/f1000research.6963.1"},{"issue":"7","key":"e_1_3_2_44_2","first-page":"10","article-title":"Sample size estimation and statistical power analyses","volume":"16","author":"Prajapati B.","year":"2010","unstructured":"B. Prajapati, M. Dunne, and R. Armstrong. 2010. Sample size estimation and statistical power analyses. Optom. Today 16, 7 (2010), 10\u201318.","journal-title":"Optom. Today"},{"key":"e_1_3_2_45_2","unstructured":"SAS Institute. 2004. Getting Started with the SAS Power and Sample Size Application. (2004)."},{"key":"e_1_3_2_46_2","unstructured":"H. Sebyhed and E. Gunnarsson. 2020. The Impotency of Post Hoc Power . Dissertation. Retrieved from http:\/\/urn.kb.se\/resolve?urn=urn:nbn:se:uu:diva-433274."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1198\/000313001300339950"},{"key":"e_1_3_2_48_2","unstructured":"StatQuest with Josh Starmer. 2020. Power Analysis Clearly Explained!!! (2020). Retrieved from https:\/\/www.youtube.com\/watch?v=VX_M3tIyiYk&ab_channel=StatQuestwithJoshStarmer."},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1046\/j.1523-1739.1997.96102.x"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.5555\/3378680.3378762"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3284432.3284433"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3434074.3446910"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3495246","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3495246","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:23Z","timestamp":1750182563000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3495246"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,8]]},"references-count":51,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,6,30]]}},"alternative-id":["10.1145\/3495246"],"URL":"https:\/\/doi.org\/10.1145\/3495246","relation":{},"ISSN":["2573-9522","2573-9522"],"issn-type":[{"value":"2573-9522","type":"print"},{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,8]]},"assertion":[{"value":"2020-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-02-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}