{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,28]],"date-time":"2026-10-28T08:00:34Z","timestamp":1793174434645,"version":"4.5.0"},"reference-count":78,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T00:00:00Z","timestamp":1718236800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01 MH121617"],"award-info":[{"award-number":["R01 MH121617"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Clinical Psychological Science"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:p>The emotional dot-probe task is a widely used measure of attentional bias to threat. Recent work suggests, however, that subtraction-based behavioral measures of emotional dot-probe performance may not be appropriate for measuring such attentional biases because of poor reliability. In the two current studies, we systematically tested 36 versions of the emotional dot-probe task that varied in stimuli (faces, scenes, snakes\/spiders), timing (stimulus onset asynchrony of 100 ms, 500 ms, 900 ms), stimulus orientation (horizontal, vertical), and trial types (e.g., threat congruent and threat incongruent). Across 9,600 participants, none of the 36 versions demonstrated internal reliability greater than zero. Reliability was similarly poor in anxious participants (based on Generalized Anxiety Disorder 7 items or Brief Hypervigilance Scale). We conclude that the standard behavioral scores (difference scores based on reaction time or accuracy) derived from the emotional dot-probe task are not adequately reliable measures of attentional biases to threat in anxious or nonanxious populations.<\/jats:p>","DOI":"10.1177\/21677026241253826","type":"journal-article","created":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T03:43:42Z","timestamp":1718250222000},"page":"261-277","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":40,"title":["No Evidence of Reliability Across 36 Variations of the Emotional Dot-Probe Task in 9,600 Participants"],"prefix":"10.1177","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5018-0837","authenticated-orcid":false,"given":"Irene","family":"Xu","sequence":"first","affiliation":[{"name":"Department of Psychology, University of Notre Dame"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eliza","family":"Passell","sequence":"additional","affiliation":[{"name":"Institute for Technology in Psychiatry, McLean Hospital, Belmont, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roger W.","family":"Strong","sequence":"additional","affiliation":[{"name":"Institute for Technology in Psychiatry, McLean Hospital, Belmont, Massachusetts"},{"name":"Department of Psychiatry, Harvard Medical School"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth","family":"Grinspoon","sequence":"additional","affiliation":[{"name":"Institute for Technology in Psychiatry, McLean Hospital, Belmont, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lane\u00e9","family":"Jung","sequence":"additional","affiliation":[{"name":"Institute for Technology in Psychiatry, McLean Hospital, Belmont, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeremy B.","family":"Wilmer","sequence":"additional","affiliation":[{"name":"Department of Psychology, Wellesley College"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura T.","family":"Germine","sequence":"additional","affiliation":[{"name":"Institute for Technology in Psychiatry, McLean Hospital, Belmont, Massachusetts"},{"name":"Department of Psychiatry, Harvard Medical School"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2024,6,13]]},"reference":[{"key":"e_1_3_4_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/0887-6185(94)90009-4"},{"key":"e_1_3_4_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbtep.2015.04.009"},{"key":"e_1_3_4_4_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.133.1.1"},{"key":"e_1_3_4_5_1","doi-asserted-by":"publisher","DOI":"10.1037\/tra0000070"},{"key":"e_1_3_4_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00426-017-0947-6"},{"key":"e_1_3_4_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/0887-6185(88)90006-0"},{"key":"e_1_3_4_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0005-7967(01)00086-9"},{"key":"e_1_3_4_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpr.2009.11.003"},{"key":"e_1_3_4_10_1","doi-asserted-by":"publisher","DOI":"10.4324\/9781410606266"},{"key":"e_1_3_4_11_1","doi-asserted-by":"crossref","unstructured":"Coleshill M. J. Sharpe L. Colagiuri B. (2021). No evidence that attentional bias towards pain-related words is associated with verbally induced nocebo hyperalgesia: A dot-probe study. Pain Reports 6(1) Article e921. https:\/\/doi.org\/10.1097\/PR9.0000000000000921","DOI":"10.1097\/PR9.0000000000000921"},{"key":"e_1_3_4_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.brat.2005.10.004"},{"key":"e_1_3_4_13_1","doi-asserted-by":"crossref","unstructured":"Correa K. A. Carrillo V. Funkhouser C. J. Shenberger E. R. Shankman S. A. (2022). Ethnic differences in behavioral and physiological indicators of sensitivity to threat. Journal of Anxiety Disorders 85 Article 102508. https:\/\/doi.org\/10.1016\/j.janxdis.2021.102508","DOI":"10.1016\/j.janxdis.2021.102508"},{"key":"e_1_3_4_14_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-011-0064-1"},{"key":"e_1_3_4_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpain.2011.07.003"},{"key":"e_1_3_4_16_1","volume-title":"Scale development: Theory and applications","author":"DeVellis R. F.","year":"2003","unstructured":"DeVellis R. F. (2003). Scale development: Theory and applications. Sage."},{"key":"e_1_3_4_17_1","doi-asserted-by":"publisher","DOI":"10.1017\/S003329171800404X"},{"key":"e_1_3_4_18_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1818430116"},{"key":"e_1_3_4_19_1","unstructured":"Enock P. M. Robinaugh D. J. Reese H. E. McNally R. J. (2012 November). Improved reliability estimation and psychometrics of the dot-probe paradigm on smartphones and PC [Poster presentation]. Association of Behavioral and Cognitive Therapies National Harbor MD USA."},{"key":"e_1_3_4_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbtep.2018.01.009"},{"key":"e_1_3_4_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpr.2007.05.006"},{"key":"e_1_3_4_22_1","doi-asserted-by":"crossref","unstructured":"Germine L. Dunn E. C. McLaughlin K. A. Smoller J. W. (2015). Childhood adversity is associated with adult theory of mind and social affiliation but not face processing. PLOS ONE 10(6) Article e0129612. https:\/\/doi.org\/10.1371\/journal.pone.0129612","DOI":"10.1371\/journal.pone.0129612"},{"key":"e_1_3_4_23_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-012-0296-9"},{"key":"e_1_3_4_24_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41386-020-0757-1"},{"key":"e_1_3_4_25_1","doi-asserted-by":"crossref","unstructured":"Germine L. T. Joormann J. Passell E. Rutter L. A. Scheuer L. Martini P. Hwang I. Lee S. Sampson N. Barch D. M. House S. L. Beaudoin F. L. An X. Stevens J. S. Zeng D. Linnstaedt S. D. Jovanovic T. Clifford G. D. Neylan T. C. . . . Kessler R. C. (2022). Neurocognition after motor vehicle collision and adverse post-traumatic neuropsychiatric sequelae within 8 weeks: Initial findings from the AURORA study. Journal of Affective Disorders 298(Pt B) 57\u201367. https:\/\/doi.org\/10.1016\/j.jad.2021.10.104","DOI":"10.1016\/j.jad.2021.10.104"},{"key":"e_1_3_4_26_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1200196109"},{"key":"e_1_3_4_27_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-017-0935-1"},{"key":"e_1_3_4_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/15299732.2021.1989108"},{"key":"e_1_3_4_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-8986.2008.00750.x"},{"key":"e_1_3_4_30_1","doi-asserted-by":"crossref","unstructured":"Johnson S. U. Ulvenes P. G. \u00d8ktedalen T. Hoffart A. (2019). Psychometric properties of the General Anxiety Disorder 7-item (GAD-7) scale in a heterogeneous psychiatric sample. Frontiers in Psychology 10 Article 1713. https:\/\/doi.org\/10.3389\/fpsyg.2019.01713","DOI":"10.3389\/fpsyg.2019.01713"},{"key":"e_1_3_4_31_1","volume-title":"Psychological testing: Principles, applications, and issues","author":"Kaplan R. M.","year":"2017","unstructured":"Kaplan R. M., Saccuzzo D. P. (2017). Psychological testing: Principles, applications, and issues. Cengage Learning."},{"key":"e_1_3_4_32_1","doi-asserted-by":"crossref","unstructured":"Kappenman E. S. Farrens J. L. Luck S. J. Proudfit G. H. (2014). Behavioral and ERP measures of attentional bias to threat in the dot-probe task: Poor reliability and lack of correlation with anxiety. Frontiers in Psychology 5 Article 1368. https:\/\/doi.org\/10.3389\/fpsyg.2014.01368","DOI":"10.3389\/fpsyg.2014.01368"},{"key":"e_1_3_4_33_1","doi-asserted-by":"publisher","DOI":"10.1177\/2167702620961074"},{"key":"e_1_3_4_34_1","doi-asserted-by":"publisher","DOI":"10.1093\/scan\/nsu098"},{"key":"e_1_3_4_35_1","doi-asserted-by":"crossref","unstructured":"Kim H. Kaduthodil J. Strong R. W. Germine L. Cohan S. Wilmer J. B. (2024). Multiracial Reading the Mind in the Eyes Test (MRMET): An inclusive version of an influential measure. Behavior Research Methods. Advance online publication. https:\/\/doi.org\/10.3758\/s13428-023-02323-x","DOI":"10.3758\/s13428-023-02323-x"},{"key":"e_1_3_4_36_1","doi-asserted-by":"publisher","DOI":"10.1037\/abn0000406"},{"key":"e_1_3_4_37_1","volume-title":"The emotional brain: The mysterious underpinnings of emotional life","author":"LeDoux J. E.","year":"1996","unstructured":"LeDoux J. E. (1996). The emotional brain: The mysterious underpinnings of emotional life. Simon & Schuster."},{"key":"e_1_3_4_38_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1400335111"},{"key":"e_1_3_4_39_1","doi-asserted-by":"publisher","DOI":"10.1037\/1528-3542.5.3.365"},{"key":"e_1_3_4_40_1","doi-asserted-by":"crossref","unstructured":"L\u00f6we B. Decker O. M\u00fcller S. Br\u00e4hler E. Schellberg D. Herzog W. Herzberg P. Y. (2008). Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Medical Care 46(3) 266\u2013274. https:\/\/doi.org\/10.1097\/MLR.0b013e318160d093","DOI":"10.1097\/MLR.0b013e318160d093"},{"key":"e_1_3_4_41_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-843X.95.1.15"},{"key":"e_1_3_4_42_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203080719-13"},{"key":"e_1_3_4_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/0005-7967(90)90132-3"},{"key":"e_1_3_4_44_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.clinpsy.1.102803.143916"},{"key":"e_1_3_4_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpr.2018.05.005"},{"key":"e_1_3_4_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.1992.tb00260.x"},{"key":"e_1_3_4_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0005-7967(98)00158-2"},{"key":"e_1_3_4_48_1","doi-asserted-by":"crossref","unstructured":"Nebe S. Reutter M. Baker D. H. B\u00f6lte J. Domes G. Gamer M. G\u00e4rtner A. Gie\u00dfing C. Gurr C. Hilger K. Jawinski P. Kulke L. Lischke A. Markett S. Meier M. Merz C. J. Popov T. Puhlmann L. M. C. Quintana D. S. . . . Feld G. B. (2023). Enhancing precision in human neuroscience. eLife 12 Article e85980. https:\/\/doi.org\/10.7554\/eLife.85980","DOI":"10.7554\/eLife.85980"},{"key":"e_1_3_4_49_1","volume-title":"Psychometric theory","author":"Nunally J. C.","year":"1978","unstructured":"Nunally J. C. (1978). Psychometric theory (2nd ed.). McGraw-Hill.","edition":"2"},{"key":"e_1_3_4_50_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.130.3.466"},{"key":"e_1_3_4_51_1","doi-asserted-by":"crossref","unstructured":"Parsons S. (2021). splithalf: Robust estimates of split half reliability. Journal of Open Source Software 6(60) Article 3041. https:\/\/doi.org\/10.21105\/joss.03041","DOI":"10.21105\/joss.03041"},{"key":"e_1_3_4_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/2515245919879695"},{"key":"e_1_3_4_53_1","doi-asserted-by":"crossref","unstructured":"Passell E. Dillon D. G. Baker J. T. Vogel S. C. Scheuer L. S. Mirin N. L. Rutter L. A. Pizzagalli D. A. Germine L. (2019). Digital cognitive assessment: Results from the TestMyBrain NIMH Research Domain Criteria (RDoC) field test battery report. PsyArXiv. https:\/\/doi.org\/10.31234\/osf.io\/dcszr","DOI":"10.31234\/osf.io\/dcszr"},{"key":"e_1_3_4_54_1","doi-asserted-by":"crossref","unstructured":"Passell E. Strong R. W. Rutter L. A. Kim H. Scheuer L. Martini P. Grinspoon L. Germine L. (2021). Cognitive test scores vary with choice of personal digital device. Behavior Research Methods 536(6) 2544\u20132557. https:\/\/doi.org\/10.3758\/s13428-021-01597-3","DOI":"10.3758\/s13428-021-01597-3"},{"key":"e_1_3_4_55_1","doi-asserted-by":"publisher","DOI":"10.1038\/nn1201-1153"},{"key":"e_1_3_4_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsych.2018.09.022"},{"key":"e_1_3_4_57_1","doi-asserted-by":"crossref","unstructured":"Price R. B. Kuckertz J. M. Siegle G. J. Ladouceur C. D. Silk J. S. Ryan N. D. Dahl R. E. Amir N. (2015). Empirical recommendations for improving the stability of the dot-probe task in clinical research. Psychological Assessment 272(2) 365\u2013376. https:\/\/doi.org\/10.1037\/pas0000036","DOI":"10.1037\/pas0000036"},{"key":"e_1_3_4_58_1","doi-asserted-by":"crossref","unstructured":"Pronk T. Molenaar D. Wiers R. W. Murre J. (2022). Methods to split cognitive task data for estimating split-half reliability: A comprehensive review and systematic assessment. Psychonomic Bulletin & Review 29(1) 44\u201354. https:\/\/doi.org\/10.3758\/s13423-021-01948-3","DOI":"10.3758\/s13423-021-01948-3"},{"key":"e_1_3_4_59_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699930801993973"},{"key":"e_1_3_4_60_1","volume-title":"R: A language and environment for statistical computing","author":"R Core Team","year":"2023","unstructured":"R Core Team. (2023). R: A language and environment for statistical computing. R Foundation for Statistical Computing."},{"key":"e_1_3_4_61_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-015-0867-8"},{"key":"e_1_3_4_62_1","doi-asserted-by":"crossref","unstructured":"Rodebaugh T. L. Scullin R. B. Langer J. K. Dixon D. J. Huppert J. D. Bernstein A. Zvielli A. Lenze E. J. (2016). Unreliability as a threat to understanding psychopathology: The cautionary tale of attentional bias. Journal of Abnormal Psychology 125(6) 840\u2013851. https:\/\/doi.org\/10.1037\/abn0000184","DOI":"10.1037\/abn0000184"},{"key":"e_1_3_4_63_1","doi-asserted-by":"publisher","DOI":"10.1002\/per.554"},{"key":"e_1_3_4_64_1","doi-asserted-by":"crossref","unstructured":"Singh S. Strong R. W. Jung L. Li F. H. Grinspoon L. Scheuer L. S. Passell E. J. Martini P. Chaytor N. Soble J. R. Germine L. (2021). The TestMyBrain digital neuropsychology toolkit: Development and psychometric characteristics. Journal of Clinical and Experimental Neuropsychology 43(8) 786\u2013795. https:\/\/doi.org\/10.1080\/13803395.2021.2002269","DOI":"10.1080\/13803395.2021.2002269"},{"key":"e_1_3_4_65_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.2019.00560"},{"key":"e_1_3_4_66_1","doi-asserted-by":"crossref","unstructured":"Soleymani A. Mazidi M. Neimeijer R. de Jong P. J. (2022). Eating disorder-specific rumination moderates the association between attentional bias to high-calorie foods and eating disorder symptoms: Evidence from a reliable free-viewing eye-tracking task. Appetite 171 Article 105934. https:\/\/doi.org\/10.1016\/j.appet.2022.105934","DOI":"10.1016\/j.appet.2022.105934"},{"key":"e_1_3_4_67_1","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.166.10.1092"},{"key":"e_1_3_4_68_1","doi-asserted-by":"crossref","unstructured":"Staffaroni A. M. Taylor J. C. Clark A. L. Heuer H. W. Forsberg L. K. Bahl R. Manoochehri M. Vento S. Bajorek L. P. Ong E. You M. Boeve B. F. Kramer J. H. Rosen H. J. Boxer A. L. (2021). A remote smartphone cognitive testing battery for frontotemporal dementia: Completion rate reliability and validity. Alzheimer\u2019s & Dementia 17 Article e056136. https:\/\/doi.org\/10.1002\/alz.056136","DOI":"10.1002\/alz.056136"},{"issue":"3","key":"e_1_3_4_69_1","first-page":"339","article-title":"Reliability of two versions of the dot-probe task using photographic faces","volume":"51","author":"Staugaard S. R.","year":"2009","unstructured":"Staugaard S. R. (2009). Reliability of two versions of the dot-probe task using photographic faces. Psychology Science Quarterly, 51(3), 339\u2013350.","journal-title":"Psychology Science Quarterly"},{"key":"e_1_3_4_70_1","doi-asserted-by":"crossref","unstructured":"Steinke A. Kopp B. Lange F. (2021). The Wisconsin card sorting test: Split-half reliability estimates for a self-administered computerized variant. Brain Sciences 11(5) Article 529. https:\/\/doi.org\/10.3390\/brainsci11050529","DOI":"10.3390\/brainsci11050529"},{"key":"e_1_3_4_71_1","doi-asserted-by":"crossref","unstructured":"Torrence R. D. Troup L. J. (2018). Event-related potentials of attentional bias toward faces in the dot-probe task: A systematic review. Psychophysiology 55(6) Article e13051. https:\/\/doi.org\/10.1111\/psyp.13051","DOI":"10.1111\/psyp.13051"},{"key":"e_1_3_4_72_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10919-016-0247-7"},{"key":"e_1_3_4_73_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-016-1224-1"},{"key":"e_1_3_4_74_1","doi-asserted-by":"crossref","unstructured":"Vogt J. Dodd H. F. Parker A. Duffield F. Sakaki M. (2022). Now you see it now you don\u2019t: Relevance of threat enhances social anxiety-linked attentional bias to angry faces but relevance of neutral information attenuates it. PLOS ONE 17(7) Article e0271752. https:\/\/doi.org\/10.1371\/journal.pone.0271752","DOI":"10.1371\/journal.pone.0271752"},{"key":"e_1_3_4_75_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2005.10.011"},{"key":"e_1_3_4_76_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10608-013-9588-2"},{"key":"e_1_3_4_77_1","doi-asserted-by":"crossref","unstructured":"White L. K. Britton J. C. Sequeira S. Ronkin E. G. Chen G. Bar-Haim Y. Shechner T. Ernst M. Fox N. A. Leibenluft E. Pine D. S. (2016). Behavioral and neural stability of attention bias to threat in healthy adolescents. NeuroImage 136 84\u201393. https:\/\/doi.org\/10.1016\/j.neuroimage.2016.04.058","DOI":"10.1016\/j.neuroimage.2016.04.058"},{"key":"e_1_3_4_78_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.120.1.3"},{"key":"e_1_3_4_79_1","doi-asserted-by":"publisher","DOI":"10.1080\/02643294.2012.753433"}],"container-title":["Clinical Psychological Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/21677026241253826","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/21677026241253826","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/21677026241253826","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T16:42:15Z","timestamp":1777394535000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/21677026241253826"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,13]]},"references-count":78,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["10.1177\/21677026241253826"],"URL":"https:\/\/doi.org\/10.1177\/21677026241253826","relation":{},"ISSN":["2167-7026","2167-7034"],"issn-type":[{"value":"2167-7026","type":"print"},{"value":"2167-7034","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,13]]}}}