{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T15:16:52Z","timestamp":1787843812502,"version":"build-2784847793"},"reference-count":84,"publisher":"Wiley","issue":"8","license":[{"start":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T00:00:00Z","timestamp":1787443200000},"content-version":"vor","delay-in-days":22,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:00:00Z","timestamp":1785542400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01MH128208"],"award-info":[{"award-number":["R01MH128208"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Psychophysiology"],"published-print":{"date-parts":[[2026,8]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:p>The effort\u2010doors task was developed to advance the study of individual differences in effort\u2010reward dynamics by eliciting neural indices across multiple stages of outcome monitoring. The task's suitability for between\u2010person inferences depends on the psychometric reliability of the scores it produces. Generalizability theory was used to evaluate the psychometric properties of the raw event\u2010related brain potential (ERP) scores and their subtraction\u2010based composites that are obtained from an extended version of the effort\u2010doors task. An equation for estimating the reliability of a difference\u2010of\u2010differences score was derived and applied to estimate reliability and trial\u2010count requirements at prespecified thresholds in a sample of 160 participants. The raw scores of cue\u2010P3, reward positivity (RewP), and feedback\u2010P3 (fb\u2010P3) all achieved the recommended reliability threshold for between\u2010person analyses. However, an effect of effort was observed only for cue\u2010P3 (i.e., cue reactivity). The stimulus\u2010preceding negativity (SPN) showed inadequate reliability; improved data quality or additional trials may increase reliability, although the projected trial requirement should be weighed against feasibility. Most raw scores from the 120\u2010trial task were sufficiently reliable for between\u2010person analyses. However, SPN reliability was inadequate, effort effects were not credible for SPN, RewP, or fb\u2010P3, and fb\u2010P3 did not vary by feedback valence. These limitations should be considered in relation to theory and alternative paradigms. Overall, the 120\u2010trial version of the effort\u2010doors task can support individual\u2010differences research focused on raw ERP indices across most stages of outcome monitoring, whereas individual differences in effort\u2010related, valence\u2010related, or effort\u2010by\u2010valence modulation should not be inferred from subtraction\u2010based scores without further optimization and demonstrated reliability.<\/jats:p>","DOI":"10.1111\/psyp.70372","type":"journal-article","created":{"date-parts":[[2026,8,24]],"date-time":"2026-08-24T04:38:53Z","timestamp":1787546333000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Reliability of Outcome Monitoring Indices After Effort Exertion: A Psychometric Evaluation of the Effort\u2010Doors Task for the Study of Individual Differences"],"prefix":"10.1111","volume":"63","author":[{"given":"Gavin","family":"Heindorf","sequence":"first","affiliation":[{"name":"Department of Psychology University of South Florida  Tampa Florida USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2555-0968","authenticated-orcid":false,"given":"Harold A.","family":"Rocha","sequence":"additional","affiliation":[{"name":"Department of Psychology University of South Florida  Tampa Florida USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tingting","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Psychological and Quantitative Foundations University of Iowa  Iowa City Iowa USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9415-251X","authenticated-orcid":false,"given":"Walter P.","family":"Vispoel","sequence":"additional","affiliation":[{"name":"Department of Psychological and Quantitative Foundations University of Iowa  Iowa City Iowa USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4437-6598","authenticated-orcid":false,"given":"Peter E.","family":"Clayson","sequence":"additional","affiliation":[{"name":"Department of Psychology University of South Florida  Tampa Florida USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,8,23]]},"reference":[{"key":"e_1_2_12_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11055\u2010026\u201001941\u20100"},{"key":"e_1_2_12_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.12401"},{"key":"e_1_2_12_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.coph.2008.12.014"},{"key":"e_1_2_12_5_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13415\u2010025\u201001353\u20106"},{"key":"e_1_2_12_6_1","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhab480"},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.13049"},{"key":"e_1_2_12_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bpsgos.2022.08.002"},{"key":"e_1_2_12_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2020.117656"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2019.07.002"},{"key":"e_1_2_12_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745\u20103992.1992.tb00260.x"},{"key":"e_1_2_12_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2025.113255"},{"key":"e_1_2_12_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.13583"},{"key":"e_1_2_12_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.14522"},{"key":"e_1_2_12_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2024.112311"},{"key":"e_1_2_12_16_1","doi-asserted-by":"publisher","DOI":"10.1037\/amp0001620"},{"key":"e_1_2_12_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.12001"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.13762"},{"key":"e_1_2_12_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.14731"},{"key":"e_1_2_12_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2021.118712"},{"key":"e_1_2_12_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2021.04.004"},{"key":"e_1_2_12_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.13437"},{"key":"e_1_2_12_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.12138"},{"key":"e_1_2_12_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2016.10.012"},{"key":"e_1_2_12_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2016.09.005"},{"key":"e_1_2_12_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bpsc.2021.10.016"},{"key":"e_1_2_12_27_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.14426"},{"key":"e_1_2_12_28_1","doi-asserted-by":"publisher","DOI":"10.1037\/abn0000469"},{"key":"e_1_2_12_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/ejn.12234"},{"key":"e_1_2_12_30_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.176.4036.785"},{"key":"e_1_2_12_31_1","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4515\u201008.2009"},{"key":"e_1_2_12_32_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291717002525"},{"key":"e_1_2_12_33_1","doi-asserted-by":"publisher","DOI":"10.1093\/schbul\/sbad155"},{"key":"e_1_2_12_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2003.10.009"},{"key":"e_1_2_12_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2009.12.009"},{"key":"e_1_2_12_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2018.01.011"},{"key":"e_1_2_12_37_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.12863"},{"key":"e_1_2_12_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/1745691614551642"},{"key":"e_1_2_12_39_1","doi-asserted-by":"publisher","DOI":"10.3390\/brainsci10050283"},{"key":"e_1_2_12_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2018.02.002"},{"key":"e_1_2_12_41_1","doi-asserted-by":"publisher","DOI":"10.1037\/abn0000274"},{"key":"e_1_2_12_42_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428\u2010017\u20100935\u20101"},{"key":"e_1_2_12_43_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.14758"},{"key":"e_1_2_12_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2016.02.003"},{"key":"e_1_2_12_45_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.70042"},{"key":"e_1_2_12_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.physbeh.2014.03.008"},{"key":"e_1_2_12_47_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13415\u2010023\u201001131\u20102"},{"key":"e_1_2_12_48_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469\u20108986.2010.01009.x"},{"key":"e_1_2_12_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2022.03.051"},{"key":"e_1_2_12_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2018.01.005"},{"key":"e_1_2_12_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dcn.2025.101559"},{"key":"e_1_2_12_52_1","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4777\u201012.2013"},{"key":"e_1_2_12_53_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.12813"},{"key":"e_1_2_12_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2010.12.012"},{"key":"e_1_2_12_55_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2014.00213"},{"key":"e_1_2_12_56_1","volume-title":"An Introduction to the Event\u2010Related Potential Technique","author":"Luck S. J.","year":"2014"},{"key":"e_1_2_12_57_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.12639"},{"key":"e_1_2_12_58_1","volume-title":"The Oxford Handbook of Event\u2010Related Potential Components","author":"Luck S. J.","year":"2013"},{"key":"e_1_2_12_59_1","unstructured":"MathWorks Inc.2024.\u201cMATLAB.\u201d(Version 24.2) [Computer Software].https:\/\/www.mathworks.com."},{"key":"e_1_2_12_60_1","doi-asserted-by":"publisher","DOI":"10.1037\/abn0000240"},{"key":"e_1_2_12_61_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03193270"},{"key":"e_1_2_12_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsycho.2016.07.008"},{"key":"e_1_2_12_63_1","volume-title":"Psychometric Theory","author":"Nunnally J. C.","year":"1994"},{"key":"e_1_2_12_64_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2024.112409"},{"key":"e_1_2_12_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.schres.2025.06.010"},{"key":"e_1_2_12_66_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598\u2010018\u201037802\u20101"},{"key":"e_1_2_12_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/0013\u20104694(89)90180\u20106"},{"key":"e_1_2_12_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bandc.2015.09.002"},{"key":"e_1_2_12_69_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.12370"},{"key":"e_1_2_12_70_1","unstructured":"Psychology Software Tools.2016.\u201cE\u2010Prime.\u201d(Version 3.0) [Computer Software].https:\/\/support.pstnet.com\/."},{"key":"e_1_2_12_71_1","unstructured":"R Core Team.2024.\u201cR: A Language and Environment for Statistical Computing (Version 4.4.0) [Computer Software].\u201dR Foundation for Statistical Computing.https:\/\/www.R\u2010project.org\/."},{"key":"e_1_2_12_72_1","doi-asserted-by":"publisher","DOI":"10.1111\/bmsp.70026"},{"key":"e_1_2_12_73_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropharm.2013.05.040"},{"key":"e_1_2_12_74_1","unstructured":"Rocha H. A.2025.\u201cAnhedonic Features in Effort\u2010Related Reward Processing [Masters Thesis University of South Florida].\u201dProQuest.https:\/\/www.proquest.com\/dissertations\u2010theses\/anhedonic\u2010features\u2010effort\u2010%09related\u2010reward\/docview\/3196740387\/se\u20102."},{"key":"e_1_2_12_75_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2026.113321"},{"key":"e_1_2_12_76_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jrp.2013.05.009"},{"key":"e_1_2_12_77_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003\u2010066X.44.6.922"},{"key":"e_1_2_12_78_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cortex.2026.04.006"},{"key":"e_1_2_12_79_1","doi-asserted-by":"crossref","unstructured":"Tan J. X. Y. andP.Liu.2025.\u201cThe Influence of Effort Expenditure on the Neurophysiological Substrates of Reward Processing in Early Adolescence [Preprint].\u201dAuthorea.https:\/\/doi.org\/10.22541\/au.174720560.05015066\/v1.","DOI":"10.22541\/au.174720560.05015066\/v1"},{"key":"e_1_2_12_80_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0006598"},{"key":"e_1_2_12_81_1","doi-asserted-by":"publisher","DOI":"10.1037\/met0000107"},{"key":"e_1_2_12_82_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.13044"},{"key":"e_1_2_12_83_1","doi-asserted-by":"publisher","DOI":"10.1080\/00273171.2018.1449628"},{"key":"e_1_2_12_84_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropsychologia.2019.107311"},{"key":"e_1_2_12_85_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.14070"}],"container-title":["Psychophysiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/psyp.70372","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/psyp.70372","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/psyp.70372","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T14:16:54Z","timestamp":1787840214000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/psyp.70372"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8]]},"references-count":84,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2026,8]]}},"alternative-id":["10.1111\/psyp.70372"],"URL":"https:\/\/doi.org\/10.1111\/psyp.70372","archive":["Portico"],"relation":{},"ISSN":["0048-5772","1469-8986"],"issn-type":[{"value":"0048-5772","type":"print"},{"value":"1469-8986","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8]]},"assertion":[{"value":"2026-05-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-24","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-08-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70372"}}