{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T05:23:46Z","timestamp":1777440226583,"version":"3.51.4"},"reference-count":31,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2020,7,13]],"date-time":"2020-07-13T00:00:00Z","timestamp":1594598400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/100001502","name":"Blue Cross Blue Shield of Michigan Foundation","doi-asserted-by":"publisher","award":["002725.SAP"],"award-info":[{"award-number":["002725.SAP"]}],"id":[{"id":"10.13039\/100001502","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100005290","name":"Psi Chi","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005290","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006710","name":"wayne state university","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006710","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Assessment"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>\n                    Online platforms represent a cost-effective option for data collection; however, it is unclear whether online administration of certain kinds of tasks (e.g., behavioral measures of aggression) poses validity threats. The present study provided a preliminary examination of effort (as indexed by total number of presses), differential drop-out, and believability of an online version of the single-session point subtraction aggression paradigm (PSAP). Two subsamples of participants were recruited; a sample recruited through Amazon\u2019s Mechanical Turk (\n                    <jats:italic toggle=\"yes\">n<\/jats:italic>\n                    = 758) and an in-person undergraduate sample (\n                    <jats:italic toggle=\"yes\">n<\/jats:italic>\n                    = 88). All participants completed the PSAP, along with measures of trait hostility and state anger. The online sample did not differ from the in-person sample on effort (i.e., total number of presses), and did not find the task less believable. Higher scores on state anger were associated with lower likelihood of beginning the online PSAP, but were not associated with prematurely closing the task. State anger was related to aggressive responding on the PSAP. Limitations of the online PSAP and considerations for future research are discussed.\n                  <\/jats:p>","DOI":"10.1177\/1073191120940042","type":"journal-article","created":{"date-parts":[[2020,7,13]],"date-time":"2020-07-13T17:15:57Z","timestamp":1594660557000},"page":"310-321","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["Using an Online Platform to Administer the Single-Session Point Subtraction Aggression Paradigm: An Initial Examination of Feasibility and Validity"],"prefix":"10.1177","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8156-6772","authenticated-orcid":false,"given":"Jennifer D.","family":"Ellis","sequence":"first","affiliation":[{"name":"Wayne State University, Detroit, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emily R.","family":"Grekin","sequence":"additional","affiliation":[{"name":"Wayne State University, Detroit, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Donald","family":"Dekeyser","sequence":"additional","affiliation":[{"name":"Wayne State University, Detroit, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ty","family":"Partridge","sequence":"additional","affiliation":[{"name":"Wayne State University, Detroit, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2020,7,13]]},"reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"crossref","unstructured":"Anderson C. A. Bushman B. J. (1997). External validity of \u201ctrivial\u201d experiments: The case of laboratory aggression. Review of General Psychology 1(1) 19-41. https:\/\/doi.org\/10.1037\/1089-2680.1.1.19","DOI":"10.1037\/\/1089-2680.1.1.19"},{"key":"e_1_3_2_3_1","doi-asserted-by":"crossref","unstructured":"Black G. Forrester A. Wilks M. Riaz M. Maguire H. Carlin P. (2011). Using initiative to provide clinical intervention groups in prison: A process evaluation. International Review of Psychiatry 23(1) 70-76. https:\/\/doi.org\/10.3109\/09540261.2010.544293","DOI":"10.3109\/09540261.2010.544293"},{"key":"e_1_3_2_4_1","doi-asserted-by":"crossref","unstructured":"Buhrmester M. Kwang T. Gosling S. D. (2011). Amazon\u2019s Mechanical Turk: A new source of inexpensive yet high-quality data? Perspectives on Psychological Science 6(1) 3-5. https:\/\/doi.org\/10.1037\/e527772014-223","DOI":"10.1177\/1745691610393980"},{"key":"e_1_3_2_5_1","doi-asserted-by":"crossref","unstructured":"Cherek D. R. Moeller F. G. Schnapp W. Dougherty D. M. (1997). Studies of violent and nonviolent male parolees: I. Laboratory and psychometric measurements of aggression. Biological Psychiatry 41(5) 514-522. https:\/\/doi.org\/10.1016\/S0006-3223(96)00059-5","DOI":"10.1016\/S0006-3223(96)00059-5"},{"key":"e_1_3_2_6_1","doi-asserted-by":"crossref","unstructured":"Cota-McKinley A. L. Woody W. D. Bell P. A. (2001). Vengeance: Effects of gender age and religious background. Aggressive Behavior 27(5) 343-350. https:\/\/doi.org\/10.1002\/ab.1019","DOI":"10.1002\/ab.1019"},{"key":"e_1_3_2_7_1","doi-asserted-by":"crossref","unstructured":"Dennis S. A. Goodson B. M. Pearson C. (2018). MTurk workers\u2019 use of low-cost \u201cvirtual private servers\u201d to circumvent screening methods: A research note. Behavioral Research in Accounting 2(3). https:\/\/doi.org\/10.2139\/ssrn.3233954","DOI":"10.2139\/ssrn.3233954"},{"key":"e_1_3_2_8_1","doi-asserted-by":"crossref","unstructured":"DeWall C. N. Finkel E. J. Lambert N. M. Slotter E. B. Bodenhausen G. V. Pond R. S.Jr. Renzetti C. M. Fincham F. D. (2013). The voodoo doll task: Introducing and validating a novel method for studying aggressive inclinations. Aggressive behavior 39(6) 419-439. https:\/\/doi.org\/10.1002\/ab.21496","DOI":"10.1002\/ab.21496"},{"key":"e_1_3_2_9_1","doi-asserted-by":"crossref","unstructured":"Geniole S. N. MacDonell E. T. McCormick C. M. (2017). The Point Subtraction Aggression Paradigm as a laboratory tool for investigating the neuroendocrinology of aggression and competition. Hormones and Behavior 92 103-116. https:\/\/doi.org\/10.1016\/j.yhbeh.2016.04.006","DOI":"10.1016\/j.yhbeh.2016.04.006"},{"key":"e_1_3_2_10_1","doi-asserted-by":"crossref","unstructured":"Giancola P. R. Chermack S. T. (1998). Construct validity of laboratory aggression paradigms: A response to Tedeschi and Quigley (1996). Aggression and Violent Behavior 3(3) 237-253. https:\/\/doi.org\/10.1016\/S1359-1789(97)00004-9","DOI":"10.1016\/S1359-1789(97)00004-9"},{"key":"e_1_3_2_11_1","doi-asserted-by":"crossref","unstructured":"Glickman M. E. van Dyk D. A. (2007). Basic Bayesian methods. Methods in Molecular Biology 404 319-338. https:\/\/doi.org\/10.1007\/978-1-59745-530-5_16","DOI":"10.1007\/978-1-59745-530-5_16"},{"key":"e_1_3_2_12_1","doi-asserted-by":"crossref","unstructured":"Golomb B. A. Cortez-Perez M. Jaworski B. A. Mednick S. Dimsdale J. (2007). Point subtraction aggression paradigm: Validity of a brief schedule of use. Violence and Victims 22(1) 95-103. https:\/\/doi.org\/10.1891\/vv-v22i1a006","DOI":"10.1891\/088667007780482829"},{"key":"e_1_3_2_13_1","doi-asserted-by":"crossref","unstructured":"Greitemeyer T. Sagioglou C. (2016). Subjective socioeconomic status causes aggression: A test of the theory of social deprivation. Journal of Personality and Social Psychology 111(2) 178-194. https:\/\/doi.org\/10.1037\/pspi0000058","DOI":"10.1037\/pspi0000058"},{"key":"e_1_3_2_14_1","doi-asserted-by":"crossref","unstructured":"Hauser D. J. Schwarz N. (2016). Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behavior Research Methods 48(1) 400-407. https:\/\/doi.org\/10.3758\/s13428-015-0578-z","DOI":"10.3758\/s13428-015-0578-z"},{"key":"e_1_3_2_15_1","unstructured":"JASP Team. (2019). JASP (Version 0.11.1) [Computer software]. Author."},{"key":"e_1_3_2_16_1","doi-asserted-by":"crossref","unstructured":"Kennedy R. Clifford S. Burleigh T. Waggoner P. Jewell R. (2020). The shape of and solutions to the MTurk quality crisis. Political Science Research and Method 8(4) 614-629. https:\/\/doi.org\/10.1017\/psrm.2020.6","DOI":"10.1017\/psrm.2020.6"},{"key":"e_1_3_2_17_1","doi-asserted-by":"crossref","unstructured":"Krueger R. F. Derringer J. Markon K. E. Watson D. Skodol A. E. (2012). Initial construction of a maladaptive personality trait model and inventory for DSM-5. Psychological Medicine 42(9) 1879-1890. https:\/\/doi.org\/10.1017\/S0033291711002674","DOI":"10.1017\/S0033291711002674"},{"key":"#cr-split#-e_1_3_2_18_1.1","doi-asserted-by":"crossref","unstructured":"Lieberman J. D. Solomon S. Greenberg J. McGregor H. A. (1999). A hot new way to measure aggression: Hot sauce allocation. Aggressive Behavior: Official Journal of the International Society for Research on Aggression 25","DOI":"10.1002\/(SICI)1098-2337(1999)25:5<331::AID-AB2>3.3.CO;2-T"},{"key":"#cr-split#-e_1_3_2_18_1.2","doi-asserted-by":"crossref","unstructured":"(5) 331-348. https:\/\/doi.org\/10.1002\/(SICI)1098-2337(1999)25:5<331::AID-AB2>3.0.CO;2-1","DOI":"10.1002\/(SICI)1098-2337(1999)25:5<331::AID-AB2>3.0.CO;2-1"},{"key":"e_1_3_2_19_1","doi-asserted-by":"crossref","unstructured":"Lutz J. (2016). The validity of crowdsourcing data in studying anger and aggressive behavior. Social Psychology 41(1) 38-51. https:\/\/doi.org\/10.1027\/1864-9335\/a000256","DOI":"10.1027\/1864-9335\/a000256"},{"key":"e_1_3_2_20_1","doi-asserted-by":"crossref","unstructured":"McKee M. Roring S. Winterowd C. Porras C. (2012). The relationship of negative self-schemas and insecure partner attachment styles with anger experience and expression among male batterers. Journal of Interpersonal Violence 27(13) 2685-2702. https:\/\/doi.org\/10.1177\/0886260512436395","DOI":"10.1177\/0886260512436395"},{"key":"e_1_3_2_21_1","doi-asserted-by":"crossref","unstructured":"New A. S. Hazlett E. A. Newmark R. E. Zhang J. Triebwasser J. Meyerson D. Lazarus S. Trisdorfer R. Goldstein K. E. Goodman M. Koenigsberg H. W. Flory J. D. Siever L. J. Koenigsberg H. W. (2009). Laboratory induced aggression: A positron emission tomography study of aggressive individuals with borderline personality disorder. Biological Psychiatry 66(12) 1107-1114. https:\/\/doi.org\/10.1016\/j.biopsych.2009.07.015","DOI":"10.1016\/j.biopsych.2009.07.015"},{"key":"e_1_3_2_22_1","doi-asserted-by":"crossref","unstructured":"Peduzzi P. Concato J. Kemper E. Holford T. R. Feinstein A. R. (1996). A simulation study of the number of events per variable in logistic regression analysis. Journal of Clinical Epidemiology 49(12) 1373-1379. https:\/\/doi.org\/10.1016\/S0895-4356(96)00236-3","DOI":"10.1016\/S0895-4356(96)00236-3"},{"key":"e_1_3_2_23_1","doi-asserted-by":"crossref","unstructured":"Perez-Rodriguez M. M. Hazlett E. A. Rich E. L. Ripoll L. H. Weiner D. M. Spence N. Goodman M. Koenigsberga H. W. Siever L. J. New A. S. (2012). Striatal activity in borderline personality disorder with comorbid intermittent explosive disorder: Sex differences. Journal of Psychiatric Research 46(6) 797-804. https:\/\/doi.org\/10.1016\/j.jpsychires.2012.02.014","DOI":"10.1016\/j.jpsychires.2012.02.014"},{"key":"e_1_3_2_24_1","volume-title":"State-Trait Anger Expression Inventory-II (STAXI-II)","author":"Spielberger C. D.","year":"1999","unstructured":"Spielberger C. D. (1999). State-Trait Anger Expression Inventory-II (STAXI-II). PAR."},{"key":"e_1_3_2_25_1","unstructured":"Stokel-Walker C. (2018). Bots on Amazon\u2019s Mechanical Turk are ruining psychology studies. https:\/\/www.newscientist.com\/article\/2176436-bots-on-amazons-mechanical-turk-are-ruining-psychology-studies\/"},{"key":"e_1_3_2_26_1","doi-asserted-by":"crossref","unstructured":"Taylor S. P. (1967). Aggressive behavior and physiological arousal as a function of provocation and the tendency to inhibit aggression 1. Journal of Personality 35(2) 297-310. https:\/\/doi.org\/10.1111\/j.1467-6494.1967.tb01430.x","DOI":"10.1111\/j.1467-6494.1967.tb01430.x"},{"key":"e_1_3_2_27_1","doi-asserted-by":"crossref","unstructured":"Vaidya J. G. Gray E. K. Haig J. Watson D. (2002). On the temporal stability of personality: Evidence for differential stability and the role of life experiences. Journal of Personality and Social Psychology 83(6) 1469-1484. https:\/\/doi.org\/10.1037\/0022-3514.83.6.1469","DOI":"10.1037\/\/0022-3514.83.6.1469"},{"key":"e_1_3_2_28_1","doi-asserted-by":"crossref","unstructured":"Wagenmakers E. J. Morey R. D. Lee M. D. (2016). Bayesian benefits for the pragmatic researcher. Current Directions in Psychological Science 25(3) 169-176. https:\/\/doi.org\/10.1177\/0963721416643289","DOI":"10.1177\/0963721416643289"},{"key":"e_1_3_2_29_1","doi-asserted-by":"crossref","unstructured":"Williamson V. (2016). On the ethics of crowdsourced research. PS: Political Science & Politics 49(1) 77-81. https:\/\/doi.org\/10.1017\/S104909651500116X","DOI":"10.1017\/S104909651500116X"},{"key":"e_1_3_2_30_1","doi-asserted-by":"crossref","unstructured":"Zeichner A. Frey F. C. Parrott D. J. Butryn M. F. (1999). Measurement of laboratory aggression: A new response-choice paradigm. Psychological Reports 85(3_suppl.) 1229-1237. https:\/\/doi.org\/10.2466\/pr0.1999.85.3f.1229","DOI":"10.2466\/pr0.1999.85.3f.1229"},{"key":"e_1_3_2_31_1","doi-asserted-by":"crossref","unstructured":"Zhou H. Fishbach A. (2016). The pitfall of experimenting on the web: How unattended selective attrition leads to surprising (yet false) research conclusions. Journal of Personality and Social Psychology 111(4) 493-504. https:\/\/doi.org\/10.1037\/pspa0000056","DOI":"10.1037\/pspa0000056"}],"container-title":["Assessment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1073191120940042","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1073191120940042","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1073191120940042","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T12:10:50Z","timestamp":1777378250000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1073191120940042"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,13]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1177\/1073191120940042"],"URL":"https:\/\/doi.org\/10.1177\/1073191120940042","relation":{},"ISSN":["1073-1911","1552-3489"],"issn-type":[{"value":"1073-1911","type":"print"},{"value":"1552-3489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,13]]}}}