{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T12:58:34Z","timestamp":1790168314785,"version":"4.1.0"},"reference-count":73,"publisher":"Wiley","issue":"4","license":[{"start":{"date-parts":[[2022,6,27]],"date-time":"2022-06-27T00:00:00Z","timestamp":1656288000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J of App Behav Analysis"],"published-print":{"date-parts":[[2022,10]]},"abstract":"<jats:p>This article describes the use of statistical significance tests and distance\u2010based effect sizes with behavioral data from single case experimental designs (SCEDs). Such data often are interpreted only with visual analysis. However, a growing movement in the field is to quantify results to improve decision\u2010making and communication across studies and sciences. The goal of the present study was to assess the agreement between visual analysis and various statistical tests. We recruited visual analysts to judge 160 pairwise data sets from published articles and compared these analyses to significance tests and effect sizes. One\u2010tailed significance testing of Tau z and the percentage of pairwise differences in the predicted direction (PWD) generally agreed with each other, and complemented the effect sizes of Ratio of Distances (RD) and <jats:italic>g<\/jats:italic>. Visual analysis was somewhat unreliable and should be combined with statistical complements to maximize decision accuracy.<\/jats:p>","DOI":"10.1002\/jaba.938","type":"journal-article","created":{"date-parts":[[2022,6,27]],"date-time":"2022-06-27T09:10:07Z","timestamp":1656321007000},"page":"1068-1082","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Quantification of behavioral data with effect sizes and statistical significance tests"],"prefix":"10.1002","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9613-7647","authenticated-orcid":false,"given":"Mack S.","family":"Costello","sequence":"first","affiliation":[{"name":"Department of Psychology Rider University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"suffix":"II","given":"Raymond F.","family":"Bagley","sequence":"additional","affiliation":[{"name":"Department of Psychology Rider University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Fern\u00e1ndez Bustamante","sequence":"additional","affiliation":[{"name":"Department of Psychology Rider University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8163-2285","authenticated-orcid":false,"given":"Neil","family":"Deochand","sequence":"additional","affiliation":[{"name":"Behavior Analysis Program, University of Cincinnati"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2022,6,27]]},"reference":[{"key":"e_1_2_5_2_1","doi-asserted-by":"crossref","unstructured":"American Psychological Association(2020).Publication manual of the American Psychological Association(7thed.).https:\/\/doi.org\/10.1037\/0000165-000","DOI":"10.1037\/0000165-000"},{"key":"e_1_2_5_3_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1977.10-167"},{"key":"e_1_2_5_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.698"},{"key":"e_1_2_5_5_1","doi-asserted-by":"publisher","DOI":"10.1037\/13937-009"},{"key":"e_1_2_5_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF03391984"},{"key":"e_1_2_5_7_1","doi-asserted-by":"publisher","DOI":"10.1177\/0959354314525282"},{"key":"e_1_2_5_8_1","first-page":"187","volume-title":"Single\u2010case research design and analysis: New directions for psychology and education","author":"Busk P. L.","year":"1992"},{"key":"e_1_2_5_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2018.02.005"},{"key":"e_1_2_5_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40614-021-00317-8"},{"key":"e_1_2_5_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104"},{"key":"e_1_2_5_12_1","volume-title":"Statistical power analysis for the behavioral sciences","author":"Cohen J.","year":"1988"},{"key":"e_1_2_5_13_1","doi-asserted-by":"publisher","DOI":"10.1901\/jeab.1993.60-495"},{"key":"e_1_2_5_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797613504966"},{"key":"e_1_2_5_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.198"},{"key":"e_1_2_5_16_1","doi-asserted-by":"publisher","DOI":"10.1037\/bar0000065"},{"key":"e_1_2_5_17_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1979.12-573"},{"key":"e_1_2_5_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.325"},{"key":"e_1_2_5_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.899"},{"key":"e_1_2_5_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.862"},{"key":"e_1_2_5_21_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145445516673998"},{"key":"e_1_2_5_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.710"},{"key":"e_1_2_5_23_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.2003.36-387"},{"key":"e_1_2_5_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/jeab.257"},{"key":"e_1_2_5_25_1","volume-title":"Signal detection theory and psychophysics","author":"Green D. M.","year":"1966"},{"key":"e_1_2_5_26_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.691"},{"key":"e_1_2_5_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1052"},{"key":"e_1_2_5_28_1","doi-asserted-by":"publisher","DOI":"10.1353\/etc.2012.0011"},{"key":"e_1_2_5_29_1","doi-asserted-by":"publisher","DOI":"10.1177\/00131640021970358"},{"key":"e_1_2_5_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.aap.2014.05.025"},{"key":"e_1_2_5_31_1","doi-asserted-by":"publisher","DOI":"10.1080\/15021149.2018.1463123"},{"key":"e_1_2_5_32_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.436"},{"key":"e_1_2_5_33_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.1977.10-151"},{"key":"e_1_2_5_34_1","volume-title":"Single\u2010case research designs: Methods for clinical and applied settings","author":"Kazdin A. E.","year":"2020"},{"key":"e_1_2_5_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.789"},{"key":"e_1_2_5_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40614-018-0167-4"},{"key":"e_1_2_5_37_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2013.00863"},{"key":"e_1_2_5_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40614-020-00244-0"},{"key":"e_1_2_5_39_1","doi-asserted-by":"publisher","DOI":"10.1901\/jaba.2010.43-195"},{"key":"e_1_2_5_40_1","doi-asserted-by":"publisher","DOI":"10.1177\/0741932517726143"},{"key":"e_1_2_5_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145445508318866"},{"key":"e_1_2_5_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40614-021-00289-9"},{"key":"e_1_2_5_43_1","doi-asserted-by":"publisher","DOI":"10.11613\/BM.2012.031"},{"key":"e_1_2_5_44_1","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.5.1.87"},{"key":"e_1_2_5_45_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-006X.46.4.806"},{"key":"e_1_2_5_46_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327965pli0102_1"},{"key":"e_1_2_5_47_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.56.2.119"},{"key":"e_1_2_5_48_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.150.3699.1057"},{"key":"e_1_2_5_49_1","doi-asserted-by":"publisher","DOI":"10.1901\/jeab.1969.12-475"},{"key":"e_1_2_5_50_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145445515581327"},{"key":"e_1_2_5_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2006.01.007"},{"key":"e_1_2_5_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2006.05.002"},{"key":"e_1_2_5_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2010.08.006"},{"key":"e_1_2_5_54_1","doi-asserted-by":"publisher","DOI":"10.3102\/1076998614547577"},{"key":"e_1_2_5_55_1","unstructured":"Rohatgi A.(2018).WebPlotDigitizer (Version 4.1 January 2018) [Computer software]. Retrieved fromhttps:\/\/automeris.io\/WebPlotDigitizer\/"},{"key":"e_1_2_5_56_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.424"},{"key":"e_1_2_5_57_1","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.1.2.115"},{"key":"e_1_2_5_58_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963721414524773"},{"key":"e_1_2_5_59_1","doi-asserted-by":"publisher","DOI":"10.1080\/17489530802581603"},{"key":"e_1_2_5_60_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-011-0111-y"},{"key":"e_1_2_5_61_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.308"},{"key":"e_1_2_5_62_1","volume-title":"Tactics of scientific research: Evaluating experimental data in psychology","author":"Sidman M.","year":"1960"},{"key":"e_1_2_5_63_1","volume-title":"The behavior of organisms: An experimental analysis","author":"Skinner B. F.","year":"1938"},{"key":"e_1_2_5_64_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.QMH.0000316989.48673.49"},{"key":"e_1_2_5_65_1","unstructured":"Tarlow K. R.(2016).Baseline corrected Tau calculator. Retrieved Wednesday 20thJanuary 2021 fromhttp:\/\/ktarlow.com\/stats\/tau."},{"key":"e_1_2_5_66_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145445516676750"},{"key":"e_1_2_5_67_1","volume-title":"Single Case Research: Web based calculators for SCR analysis (Version 2.0) [Web\u2010based application]","author":"Vannest K. J.","year":"2016"},{"key":"e_1_2_5_68_1","doi-asserted-by":"publisher","DOI":"10.1080\/17489539.2021.1886412"},{"key":"e_1_2_5_69_1","doi-asserted-by":"publisher","DOI":"10.1177\/0022466908328009"},{"key":"e_1_2_5_70_1","doi-asserted-by":"publisher","DOI":"10.1177\/0145445516644699"},{"key":"e_1_2_5_71_1","doi-asserted-by":"publisher","DOI":"10.1002\/jaba.453"},{"key":"e_1_2_5_72_1","doi-asserted-by":"publisher","DOI":"10.1037\/bar0000099"},{"key":"e_1_2_5_73_1","doi-asserted-by":"publisher","DOI":"10.1002\/jeab.511"},{"key":"e_1_2_5_74_1","doi-asserted-by":"publisher","DOI":"10.3109\/17518423.2015.1100690"}],"container-title":["Journal of Applied Behavior Analysis"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/jaba.938","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/jaba.938","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/jaba.938","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T16:38:59Z","timestamp":1692635939000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jaba.938"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,27]]},"references-count":73,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,10]]}},"alternative-id":["10.1002\/jaba.938"],"URL":"https:\/\/doi.org\/10.1002\/jaba.938","archive":["Portico"],"relation":{},"ISSN":["0021-8855","1938-3703"],"issn-type":[{"value":"0021-8855","type":"print"},{"value":"1938-3703","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,27]]},"assertion":[{"value":"2021-02-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-20","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-06-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}