{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T17:06:43Z","timestamp":1783962403757,"version":"3.55.0"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T00:00:00Z","timestamp":1780012800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T00:00:00Z","timestamp":1780012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100009873","name":"Claremont Graduate University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100009873","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Behav Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Interest in implicit processes, such as attitudes and identities, has grown in behavioral sciences since Greenwald and colleagues (1998) developed and introduced the Implicit Association Test (IAT). The IAT was developed to measure these processes, which has become more accessible with the popularity of Qualtrics as a data collection tool, especially through methods and code provided by Carpenter et al. (2019). They demonstrated how to construct a single IAT for use on the Qualtrics platform, providing research resources for creating IATs to examine concept-pair associations. However, there is no guidance on constructing multiple IATs on survey software platforms for research that requires two or more IATs in a single study. This paper extends Carpenter et al.\u2019s (2019) work by outlining the process of developing, implementing, and utilizing multiple IATs within a single Qualtrics survey. We provide a tutorial using examples from our research using the Balanced Identity Design (BID) framework, including step-by-step written and visual instructions and templates, instructions for planning and building multiple IATs and dynamically presenting them in a single Qualtrics survey and code for processing IAT data. We also demonstrate the utility of the multiple IAT approach by reporting a short study utilizing BID theory wherein we measure implicit racial\/ethnic identity, STEM identity, and race\/ethnicity-STEM associations in a single study via three IATs.<\/jats:p>","DOI":"10.3758\/s13428-026-03047-4","type":"journal-article","created":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T16:00:52Z","timestamp":1780070452000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Implementing multiple implicit association tests in Qualtrics: A guide and demonstration using balanced identity design theory"],"prefix":"10.3758","volume":"58","author":[{"given":"Alyssa","family":"Ream","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Woodcock","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Zlatkovic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rachelle M.","family":"Pedersen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ashley","family":"Bonilla","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hannah","family":"Middleton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul R.","family":"Hernandez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"P. Wesley","family":"Schultz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,5,29]]},"reference":[{"issue":"6","key":"3047_CR1","doi-asserted-by":"publisher","first-page":"2512","DOI":"10.3758\/s13428-021-01592-8","volume":"53","author":"JR Axt","year":"2021","unstructured":"Axt, J. R., Feng, T. Y., & Bar-Anan, Y. (2021). The good and the bad: Are some attribute words better than others in the Implicit Association Test? Behavior Research Methods, 53(6), 2512\u20132527. https:\/\/doi.org\/10.3758\/s13428-021-01592-8","journal-title":"Behavior Research Methods"},{"issue":"15","key":"3047_CR2","volume":"13","author":"CM Bruni","year":"2021","unstructured":"Bruni, C. M., Schultz, P. W., & Woodcock, A. (2021). The balanced structure of environmental identity. Sustainability (Basel, Switzerland), 13(15), Article 8168.","journal-title":"Sustainability (Basel, Switzerland)"},{"key":"3047_CR3","doi-asserted-by":"publisher","first-page":"2194","DOI":"10.3758\/s13428-019-01293-3","volume":"51","author":"TP Carpenter","year":"2019","unstructured":"Carpenter, T. P., Pogacar, R., Pullig, C., Kouril, M., Aguilar, S., LaBouff, J., ..., & Chakroff, A. (2019). Survey-software Implicit Association Tests: A methodological and empirical analysis. Behavior Research Methods, 51, 2194\u20132208. https:\/\/doi.org\/10.3758\/s13428-019-01293-3","journal-title":"Behavior Research Methods"},{"key":"3047_CR4","unstructured":"Chang, W., Cheng, J., Allaire, J., Sievert, C., Schloerke, B., Aden-Buie, G., Xie, Y., Allen, J., McPherson, J., Dipert, A., & Borges, B. (2026). Shiny: Web application framework for R.\u00a0(Version 1.13.0.9000) [Computer software].\u00a0https:\/\/shiny.posit.co\/"},{"issue":"3","key":"3047_CR5","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1111\/j.1540-4560.2011.01710.x","volume":"67","author":"MM Chemers","year":"2011","unstructured":"Chemers, M. M., Zurbriggen, E. L., Syed, M., Goza, B. K., & Bearman, S. (2011). The role of efficacy and identity in science career commitment among underrepresented minority students. Journal of Social Issues, 67(3), 469\u2013491. https:\/\/doi.org\/10.1111\/j.1540-4560.2011.01710.x","journal-title":"Journal of Social Issues"},{"key":"3047_CR6","doi-asserted-by":"publisher","unstructured":"Cui, Y., Robinson, J. D., Kim, S., Kypriotakis, G., Green, C. E., Shete, S. S., & Cinciripini, P. M. (2021). An open-source web app for creating and scoring Qualtrics-based Implicit Association Test. arXiv preprint arXiv:2111.02267. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2111.02267","DOI":"10.48550\/arXiv.2111.02267"},{"key":"3047_CR7","volume-title":"Cognitive consistency: A unifying concept in social psychology","author":"D Cvencek","year":"2012","unstructured":"Cvencek, D., Greenwald, A. G., & Meltzoff, A. N. (2012). Balanced Identity Theory: Review of evidence for implicit consistency in social cognition. In B. Gawronski & F. Strack (Eds.), Cognitive consistency: A unifying concept in social psychology. Guilford Press."},{"issue":"1","key":"3047_CR8","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1037\/0033-295X.109.1.3","volume":"109","author":"AG Greenwald","year":"2002","unstructured":"Greenwald, A. G., Banaji, M. R., Rudman, L. A., Farnham, S. D., Nosek, B. A., & Mellott, D. S. (2002). A unified theory of implicit attitudes, stereotypes, self-esteem, and self-concept. Psychological Review, 109(1), 3\u201325. https:\/\/doi.org\/10.1037\/0033-295X.109.1.3","journal-title":"Psychological Review"},{"issue":"2","key":"3047_CR9","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1037\/0022-3514.85.2.197","volume":"85","author":"AG Greenwald","year":"2003","unstructured":"Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003). Understanding and using the Implicit Association Test: I. An improved scoring algorithm. Journal of Personality and Social Psychology, 85(2), 197\u2013216. https:\/\/doi.org\/10.1037\/0022-3514.85.2.197","journal-title":"Journal of Personality and Social Psychology"},{"issue":"3","key":"3047_CR10","doi-asserted-by":"publisher","first-page":"1161","DOI":"10.3758\/s13428-021-01624-3","volume":"54","author":"AG Greenwald","year":"2022","unstructured":"Greenwald, A. G., Brendl, M., Cai, H., Cvencek, D., Dovidio, J. F., Friese, M., ..., Hughes, S. (2022). Best research practices for using the Implicit Association Test. Behavior Research Methods, 54(3), 1161\u20131180. https:\/\/doi.org\/10.3758\/s13428-021-01624-3","journal-title":"Behavior Research Methods"},{"issue":"6","key":"3047_CR11","doi-asserted-by":"publisher","first-page":"1464","DOI":"10.1037\/0022-3514.74.6.1464","volume":"74","author":"AG Greenwald","year":"1998","unstructured":"Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998). Measuring individual differences in implicit cognition: The Implicit Association Test. Journal of Personality and Social Psychology, 74(6), 1464\u20131480. https:\/\/doi.org\/10.1037\/0022-3514.74.6.1464","journal-title":"Journal of Personality and Social Psychology"},{"issue":"10","key":"3047_CR12","doi-asserted-by":"publisher","first-page":"1369","DOI":"10.1177\/0146167205275613","volume":"31","author":"W Hofmann","year":"2005","unstructured":"Hofmann, W., Gawronski, B., Gschwendner, T., Le, H., & Schmitt, M. (2005a). A meta-analysis on the correlation between the Implicit Association Test and explicit self-report measures. Personality and Social Psychology Bulletin, 31(10), 1369\u20131385. https:\/\/doi.org\/10.1177\/0146167205275613","journal-title":"Personality and Social Psychology Bulletin"},{"issue":"1","key":"3047_CR13","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1080\/10463280500443228","volume":"16","author":"W Hofmann","year":"2005","unstructured":"Hofmann, W., Gschwendner, T., Nosek, B. A., & Schmitt, M. (2005b). What moderates implicit\u2013explicit consistency? European Review of Social Psychology, 16(1), 335\u2013390. https:\/\/doi.org\/10.1080\/10463280500443228","journal-title":"European Review of Social Psychology"},{"issue":"1","key":"3047_CR14","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1017\/S1742058X05050058","volume":"2","author":"DS Massey","year":"2005","unstructured":"Massey, D. S., & Fischer, M. J. (2005). Stereotype threat and academic performance: New findings from a racially diverse sample of college freshmen. Du Bois Review: Social Science Research on Race, 2(1), 45\u201367. https:\/\/doi.org\/10.1017\/S1742058X05050058","journal-title":"Du Bois Review: Social Science Research on Race"},{"key":"3047_CR15","first-page":"38","volume-title":"Advances in consumer research","author":"CM Messner","year":"2009","unstructured":"Messner, C. M., & Vosgerau, J. (2009). Order effects in the IAT. In A. L. McGill & S. Shavitt (Eds.), Advances in consumer research (Vol. Vol. 36, pp. 38\u201340). Association for Consumer Research."},{"issue":"3","key":"3047_CR16","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1037\/0022-0167.54.3.271","volume":"54","author":"JS Phinney","year":"2007","unstructured":"Phinney, J. S., & Ong, A. D. (2007). Conceptualization and measurement of ethnic identity: Current status and future directions. Journal of Counseling Psychology, 54(3), 271\u2013281. https:\/\/doi.org\/10.1037\/0022-0167.54.3.271","journal-title":"Journal of Counseling Psychology"},{"key":"3047_CR17","unstructured":"Qualtrics. (2023). Qualtrics XM: The Leading Experience Management Software Retrieved 30 May 2024, from www.qualtrics.com\/support\/survey-platform\/survey-module\/survey-flow\/standard-elements\/embedded-data\/."},{"key":"3047_CR18","unstructured":"Qualtrics. (2024). Provo, Utah. Retrieved from https:\/\/www.qualtrics.com."},{"key":"3047_CR19","volume-title":"R: A language and environment for statistical computing","author":"R Core Team","year":"2023","unstructured":"R Core Team. (2023). R: A language and environment for statistical computing. R Foundation for Statistical Computing."},{"key":"3047_CR20","volume-title":"RStudio: Integrated Development for R","author":"RStudio Team","year":"2020","unstructured":"RStudio Team. (2020). RStudio: Integrated Development for R. RStudio."},{"key":"3047_CR21","doi-asserted-by":"publisher","unstructured":"Schmader, T., Johns, M., & Barquissau, M. (2004). The costs of accepting gender differences: The role of stereotype endorsement in women's experience in the math domain.\u00a0Sex Roles, 50(11-12), 835\u2013850. https:\/\/doi.org\/10.1023\/B:SERS.0000029101.74557.a0","DOI":"10.1023\/B:SERS.0000029101.74557.a0"},{"issue":"4","key":"3047_CR22","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1037\/a0029120","volume":"103","author":"A Woodcock","year":"2012","unstructured":"Woodcock, A., Hernandez, P. R., Estrada, M., & Schultz, P. W. (2012). The consequences of chronic stereotype threat: Domain disidentification and abandonment. Journal of Personality and Social Psychology, 103(4), 635\u2013646. https:\/\/doi.org\/10.1037\/a0029120","journal-title":"Journal of Personality and Social Psychology"},{"key":"3047_CR23","doi-asserted-by":"publisher","unstructured":"Woodcock, A., Pedersen, B., Hernandez, P. R., & Schultz, P. W. (2025). Balancing stereotypically compatible and incompatible identities. Personality and Social Psychology Bulletin. https:\/\/doi.org\/10.1177\/01461672251322088","DOI":"10.1177\/01461672251322088"}],"container-title":["Behavior Research Methods"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-026-03047-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.3758\/s13428-026-03047-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-026-03047-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T16:17:31Z","timestamp":1783959451000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.3758\/s13428-026-03047-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,29]]},"references-count":23,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2026,7]]}},"alternative-id":["3047"],"URL":"https:\/\/doi.org\/10.3758\/s13428-026-03047-4","relation":{},"ISSN":["1554-3528"],"issn-type":[{"value":"1554-3528","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,29]]},"assertion":[{"value":"3 September 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 April 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The study presented in the empirical example section was approved by the California State University San Marcos IRB (1102805).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"The participants in the study presented in the empirical example section consented to participate in the study by reading and clicking \u201cI agree\u201d to an online consent for approved by the California State University San Marcos IRB (1102805).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All authors of the paper have consented to its publication in this journal.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"There are no conflicts of interest.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}}],"article-number":"180"}}