{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T19:47:56Z","timestamp":1792698476511,"version":"4.5.0"},"reference-count":40,"publisher":"National Academy of Sciences","issue":"19","license":[{"start":{"date-parts":[[2020,4,27]],"date-time":"2020-04-27T00:00:00Z","timestamp":1587945600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2020,5,12]]},"abstract":"<jats:p>People can use abstract rules to flexibly configure and select actions for specific situations, yet how exactly rules shape actions toward specific sensory and\/or motor requirements remains unclear. Both research from animal models and human-level theories of action control point to the role of highly integrated, conjunctive representations, sometimes referred to as event files. These representations are thought to combine rules with other, goal-relevant sensory and motor features in a nonlinear manner and represent a necessary condition for action selection. However, so far, no methods exist to track such representations in humans during action selection with adequate temporal resolution. Here, we applied time-resolved representational similarity analysis to the spectral-temporal profiles of electroencephalography signals while participants performed a cued, rule-based action selection task. In two experiments, we found that conjunctive representations were active throughout the entire selection period and were functionally dissociable from the representation of constituent features. Specifically, the strength of conjunctions was a highly robust predictor of trial-by-trial variability in response times and was selectively related to an important behavioral indicator of conjunctive representations, the so-called partial-overlap priming pattern. These results provide direct evidence for conjunctive representations as critical precursors of action selection in humans.<\/jats:p>","DOI":"10.1073\/pnas.1922166117","type":"journal-article","created":{"date-parts":[[2020,4,27]],"date-time":"2020-04-27T20:25:45Z","timestamp":1588019145000},"page":"10603-10608","update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":126,"title":["Conjunctive representations that integrate stimuli, responses, and rules are critical for action selection"],"prefix":"10.1073","volume":"117","author":[{"given":"Atsushi","family":"Kikumoto","sequence":"first","affiliation":[{"name":"Department of Psychology, University of Oregon, Eugene, OR 97403"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7512-4556","authenticated-orcid":false,"given":"Ulrich","family":"Mayr","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Oregon, Eugene, OR 97403"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"341","published-online":{"date-parts":[[2020,4,27]]},"reference":[{"key":"e_1_3_4_1_2","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/0001-6918(69)90065-1","article-title":"On the speed of mental processes","volume":"30","author":"Donders F. C.","year":"1969","unstructured":"F. C. Donders, On the speed of mental processes. Acta Psychol. (Amst.) 30, 412\u2013431 (1969).","journal-title":"Acta Psychol. (Amst.)"},{"key":"e_1_3_4_2_2","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1016\/0001-6918(69)90055-9","article-title":"The discovery of processing stages: Extensions of Donders\u2019 method","volume":"30","author":"Sternberg S.","year":"1969","unstructured":"S. Sternberg, The discovery of processing stages: Extensions of Donders\u2019 method. Acta Psychol. (Amst.) 30, 276\u2013315 (1969).","journal-title":"Acta Psychol. (Amst.)"},{"key":"e_1_3_4_3_2","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1037\/0033-295X.97.2.253","article-title":"Dimensional overlap: Cognitive basis for stimulus-response compatibility\u2014a model and taxonomy","volume":"97","author":"Kornblum S.","year":"1990","unstructured":"S. Kornblum, T. Hasbroucq, A. Osman, Dimensional overlap: Cognitive basis for stimulus-response compatibility\u2014a model and taxonomy. Psychol. Rev. 97, 253\u2013270 (1990).","journal-title":"Psychol. Rev."},{"key":"e_1_3_4_4_2","doi-asserted-by":"crossref","DOI":"10.4324\/9780203774250","volume-title":"Elements of Human Performance: Reaction Processes and Attention in Human Skill","author":"Sanders A. F.","year":"2013","unstructured":"A. F. Sanders, A. Sanders, Elements of Human Performance: Reaction Processes and Attention in Human Skill (Psychology Press, 2013)."},{"key":"e_1_3_4_5_2","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1037\/h0024913","article-title":"Chronometric analysis of classification","volume":"74","author":"Posner M. I.","year":"1967","unstructured":"M. I. Posner, R. F. Mitchell, Chronometric analysis of classification. Psychol. Rev. 74, 392\u2013409 (1967).","journal-title":"Psychol. Rev."},{"key":"e_1_3_4_6_2","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1038\/nature12160","article-title":"The importance of mixed selectivity in complex cognitive tasks","volume":"497","author":"Rigotti M.","year":"2013","unstructured":"M. Rigotti ., The importance of mixed selectivity in complex cognitive tasks. Nature 497, 585\u2013590 (2013).","journal-title":"Nature"},{"key":"e_1_3_4_7_2","doi-asserted-by":"crossref","first-page":"1770","DOI":"10.1038\/s41593-017-0003-2","article-title":"Mixed selectivity morphs population codes in prefrontal cortex","volume":"20","author":"Parthasarathy A.","year":"2017","unstructured":"A. Parthasarathy ., Mixed selectivity morphs population codes in prefrontal cortex. Nat. Neurosci. 20, 1770\u20131779 (2017).","journal-title":"Nat. Neurosci."},{"key":"e_1_3_4_8_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3758\/s13414-019-01779-4","article-title":"Theory of Event Coding (TEC) V2. 0: Representing and controlling perception and action","volume":"81","author":"Hommel B.","year":"2019","unstructured":"B. Hommel, Theory of Event Coding (TEC) V2. 0: Representing and controlling perception and action. Atten. Percep. Psychophys. 81, 1\u201316 (2019).","journal-title":"Atten. Percep. Psychophys."},{"key":"e_1_3_4_9_2","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1017\/S0140525X01000103","article-title":"The theory of event coding (TEC): A framework for perception and action planning","volume":"24","author":"Hommel B.","unstructured":"B. Hommel, J. M\u00fcsseler, G. Aschersleben, W. Prinz, The theory of event coding (TEC): A framework for perception and action planning. Behav. Brain Sci. 24, 849\u2013878, discussion 878\u2013937 (2001).","journal-title":"Behav. Brain Sci."},{"key":"e_1_3_4_10_2","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1177\/0963721416665085","article-title":"Hierarchical task representation: Task files and response selection","volume":"25","author":"Schumacher E. H.","year":"2016","unstructured":"E. H. Schumacher, E. Hazeltine, Hierarchical task representation: Task files and response selection. Curr. Dir. Psychol. Sci. 25, 449\u2013454 (2016).","journal-title":"Curr. Dir. Psychol. Sci."},{"key":"e_1_3_4_11_2","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1037\/0278-7393.31.2.337","article-title":"Sticky rules: Integration between abstract rules and specific actions","volume":"31","author":"Mayr U.","year":"2005","unstructured":"U. Mayr, R. L. Bryck, Sticky rules: Integration between abstract rules and specific actions. J. Exp. Psychol. Learn. Mem. Cogn. 31, 337\u2013350 (2005).","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn."},{"key":"e_1_3_4_12_2","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1186\/1744-9081-4-50","article-title":"When moving faces activate the house area: An fMRI study of object-file retrieval","volume":"4","author":"Keizer A. W.","year":"2008","unstructured":"A. W. Keizer ., When moving faces activate the house area: An fMRI study of object-file retrieval. Behav. Brain Funct. 4, 50 (2008).","journal-title":"Behav. Brain Funct."},{"key":"e_1_3_4_13_2","doi-asserted-by":"crossref","first-page":"896","DOI":"10.1162\/jocn.2010.21485","article-title":"The neural underpinnings of event-file management: Evidence for stimulus-induced activation of and competition among stimulus-response bindings","volume":"23","author":"K\u00fchn S.","year":"2011","unstructured":"S. K\u00fchn, A. W. Keizer, L. S. Colzato, S. A. Rombouts, B. Hommel, The neural underpinnings of event-file management: Evidence for stimulus-induced activation of and competition among stimulus-response bindings. J. Cogn. Neurosci. 23, 896\u2013904 (2011).","journal-title":"J. Cogn. Neurosci."},{"key":"e_1_3_4_14_2","doi-asserted-by":"crossref","first-page":"116524","DOI":"10.1016\/j.neuroimage.2020.116524","article-title":"Using temporal EEG signal decomposition to identify specific neurophysiological correlates of distractor-response bindings proposed by the theory of event coding","volume":"209","author":"Opitz A.","year":"2020","unstructured":"A. Opitz, C. Beste, A.-K. Stock, Using temporal EEG signal decomposition to identify specific neurophysiological correlates of distractor-response bindings proposed by the theory of event coding. Neuroimage 209, 116524 (2020).","journal-title":"Neuroimage"},{"key":"e_1_3_4_15_2","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1007\/s004260050060","article-title":"Hierarchical switching in a multi-dimensional task space","volume":"62","author":"Kleinsorge T.","year":"1999","unstructured":"T. Kleinsorge, H. Heuer, Hierarchical switching in a multi-dimensional task space. Psychol. Res. 62, 300\u2013312 (1999).","journal-title":"Psychol. Res."},{"key":"e_1_3_4_16_2","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1037\/a0028477","article-title":"Excessive response-repetition costs under task switching: How response inhibition amplifies response conflict","volume":"39","author":"Grzyb K. R.","year":"2013","unstructured":"K. R. Grzyb, R. H\u00fcbner, Excessive response-repetition costs under task switching: How response inhibition amplifies response conflict. J. Exp. Psychol. Learn. Mem. Cogn. 39, 126\u2013139 (2013).","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn."},{"key":"e_1_3_4_17_2","doi-asserted-by":"crossref","first-page":"9051","DOI":"10.1038\/s41598-019-45333-6","article-title":"EEG decoding reveals the strength and temporal dynamics of goal-relevant representations","volume":"9","author":"Hubbard J.","year":"2019","unstructured":"J. Hubbard, A. Kikumoto, U. Mayr, EEG decoding reveals the strength and temporal dynamics of goal-relevant representations. Sci. Rep. 9, 9051 (2019).","journal-title":"Sci. Rep."},{"key":"e_1_3_4_18_2","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1016\/j.cub.2013.02.013","article-title":"Near-real-time feature-selective modulations in human cortex","volume":"23","author":"Garcia J. O.","year":"2013","unstructured":"J. O. Garcia, R. Srinivasan, J. T. Serences, Near-real-time feature-selective modulations in human cortex. Curr. Biol. 23, 515\u2013522 (2013).","journal-title":"Curr. Biol."},{"key":"e_1_3_4_19_2","doi-asserted-by":"crossref","first-page":"8549","DOI":"10.1523\/JNEUROSCI.0631-19.2019","article-title":"Reward boosts neural coding of task rules to optimize cognitive flexibility","volume":"39","author":"Hall-McMaster S.","year":"2019","unstructured":"S. Hall-McMaster, P. S. Muhle-Karbe, N. E. Myers, M. G. Stokes, Reward boosts neural coding of task rules to optimize cognitive flexibility. J. Neurosci. 39, 8549\u20138561 (2019).","journal-title":"J. Neurosci."},{"key":"e_1_3_4_20_2","first-page":"4","article-title":"Representational similarity analysis\u2014 connecting the branches of systems neuroscience","volume":"2","author":"Kriegeskorte N.","year":"2008","unstructured":"N. Kriegeskorte, M. Mur, P. Bandettini, Representational similarity analysis\u2014 connecting the branches of systems neuroscience. Front. Syst. Neurosci. 2, 4 (2008).","journal-title":"Front. Syst. Neurosci."},{"key":"e_1_3_4_21_2","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1162\/jocn_a_01068","article-title":"Decoding dynamic brain patterns from evoked responses: A tutorial on multivariate pattern analysis applied to time series neuroimaging data","volume":"29","author":"Grootswagers T.","year":"2017","unstructured":"T. Grootswagers, S. G. Wardle, T. A. Carlson, Decoding dynamic brain patterns from evoked responses: A tutorial on multivariate pattern analysis applied to time series neuroimaging data. J. Cognit. Neurosci. 29, 677\u2013697 (2017).","journal-title":"J. Cognit. Neurosci."},{"key":"e_1_3_4_22_2","doi-asserted-by":"crossref","first-page":"7893","DOI":"10.1523\/JNEUROSCI.3289-16.2017","article-title":"Hierarchically organized medial frontal cortex-basal ganglia loops selectively control task-and response-selection","volume":"37","author":"Korb F. M.","year":"2017","unstructured":"F. M. Korb, J. Jiang, J. A. King, T. Egner, Hierarchically organized medial frontal cortex-basal ganglia loops selectively control task-and response-selection. J. Neurosci. 37, 7893\u20137905 (2017).","journal-title":"J. Neurosci."},{"key":"e_1_3_4_23_2","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1037\/a0030852","article-title":"Cognitive control over learning: Creating, clustering, and generalizing task-set structure","volume":"120","author":"Collins A. G.","year":"2013","unstructured":"A. G. Collins, M. J. Frank, Cognitive control over learning: Creating, clustering, and generalizing task-set structure. Psychol. Rev. 120, 190\u2013229 (2013).","journal-title":"Psychol. Rev."},{"key":"e_1_3_4_24_2","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1080\/713756773","article-title":"Event files: Evidence for automatic integration of stimulus-response episodes","volume":"5","author":"Hommel B.","year":"1998","unstructured":"B. Hommel, Event files: Evidence for automatic integration of stimulus-response episodes. Vis. Cogn. 5, 183\u2013216 (1998).","journal-title":"Vis. Cogn."},{"key":"e_1_3_4_25_2","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1016\/j.neuron.2012.09.015","article-title":"Rhythmic fluctuations in evidence accumulation during decision making in the human brain","volume":"76","author":"Wyart V.","year":"2012","unstructured":"V. Wyart, V. de Gardelle, J. Scholl, C. Summerfield, Rhythmic fluctuations in evidence accumulation during decision making in the human brain. Neuron 76, 847\u2013858 (2012).","journal-title":"Neuron"},{"key":"e_1_3_4_26_2","doi-asserted-by":"crossref","first-page":"2909","DOI":"10.1016\/j.celrep.2019.05.021","article-title":"A network activity reconfiguration underlies the transition from goal to action","volume":"27","author":"Marcos E.","year":"2019","unstructured":"E. Marcos, S. Tsujimoto, M. Mattia, A. Genovesio, A network activity reconfiguration underlies the transition from goal to action. Cell Rep. 27, 2909\u20132920.e4 (2019).","journal-title":"Cell Rep."},{"key":"e_1_3_4_27_2","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1016\/j.neuron.2018.03.042","article-title":"More than the sum of its parts: A role for the hippocampus in configural reinforcement learning","volume":"98","author":"Duncan K.","year":"2018","unstructured":"K. Duncan, B. B. Doll, N. D. Daw, D. Shohamy, More than the sum of its parts: A role for the hippocampus in configural reinforcement learning. Neuron 98, 645\u2013657.e6 (2018).","journal-title":"Neuron"},{"key":"e_1_3_4_28_2","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1038\/s41467-019-08998-1","article-title":"Hippocampal pattern separation supports reinforcement learning","volume":"10","author":"Ballard I. C.","year":"2019","unstructured":"I. C. Ballard, A. D. Wagner, S. M. McClure, Hippocampal pattern separation supports reinforcement learning. Nat. Commun. 10, 1073 (2019).","journal-title":"Nat. Commun."},{"key":"e_1_3_4_29_2","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1006\/nimg.2002.1162","article-title":"Linking actions and their perceivable consequences in the human brain","volume":"17","author":"Elsner B.","year":"2002","unstructured":"B. Elsner ., Linking actions and their perceivable consequences in the human brain. Neuroimage 17, 364\u2013372 (2002).","journal-title":"Neuroimage"},{"key":"e_1_3_4_30_2","doi-asserted-by":"crossref","first-page":"1274","DOI":"10.1016\/j.neuroimage.2007.09.049","article-title":"The neural substrate of the ideomotor principle: An event-related fMRI analysis","volume":"39","author":"Melcher T.","year":"2008","unstructured":"T. Melcher, M. Weidema, R. M. Eenshuistra, B. Hommel, O. Gruber, The neural substrate of the ideomotor principle: An event-related fMRI analysis. Neuroimage 39, 1274\u20131288 (2008).","journal-title":"Neuroimage"},{"key":"e_1_3_4_31_2","doi-asserted-by":"crossref","first-page":"1352","DOI":"10.1126\/science.aab0551","article-title":"Cortical information flow during flexible sensorimotor decisions","volume":"348","author":"Siegel M.","year":"2015","unstructured":"M. Siegel, T. J. Buschman, E. K. Miller, Cortical information flow during flexible sensorimotor decisions. Science 348, 1352\u20131355 (2015).","journal-title":"Science"},{"key":"e_1_3_4_32_2","doi-asserted-by":"crossref","first-page":"1433","DOI":"10.1162\/jocn_a_00981","article-title":"Coding of visual, auditory, rule, and response information in the brain: 10 years of multivoxel pattern analysis","volume":"28","author":"Woolgar A.","year":"2016","unstructured":"A. Woolgar, J. Jackson, J. Duncan, Coding of visual, auditory, rule, and response information in the brain: 10 years of multivoxel pattern analysis. J. Cogn. Neurosci. 28, 1433\u20131454 (2016).","journal-title":"J. Cogn. Neurosci."},{"key":"e_1_3_4_33_2","doi-asserted-by":"crossref","first-page":"24","DOI":"10.3389\/fncom.2010.00024","article-title":"Internal representation of task rules by recurrent dynamics: The importance of the diversity of neural responses","volume":"4","author":"Rigotti M.","year":"2010","unstructured":"M. Rigotti, D. Ben Dayan Rubin, X.-J. Wang, S. Fusi, Internal representation of task rules by recurrent dynamics: The importance of the diversity of neural responses. Front. Comput. Neurosci. 4, 24 (2010).","journal-title":"Front. Comput. Neurosci."},{"key":"e_1_3_4_34_2","doi-asserted-by":"crossref","first-page":"3844","DOI":"10.1523\/JNEUROSCI.2753-12.2013","article-title":"The sparseness of mixed selectivity neurons controls the generalization-discrimination trade-off","volume":"33","author":"Barak O.","year":"2013","unstructured":"O. Barak, M. Rigotti, S. Fusi, The sparseness of mixed selectivity neurons controls the generalization-discrimination trade-off. J. Neurosci. 33, 3844\u20133856 (2013).","journal-title":"J. Neurosci."},{"key":"e_1_3_4_35_2","doi-asserted-by":"crossref","first-page":"1473","DOI":"10.1162\/jocn_a_01291","article-title":"Just above chance: Is it harder to decode information from prefrontal cortex hemodynamic activity patterns?","volume":"30","author":"Bhandari A.","year":"2018","unstructured":"A. Bhandari, C. Gagne, D. Badre, Just above chance: Is it harder to decode information from prefrontal cortex hemodynamic activity patterns? J. Cogn. Neurosci. 30, 1473\u20131498 (2018).","journal-title":"J. Cogn. Neurosci."},{"key":"e_1_3_4_36_2","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.conb.2016.01.010","article-title":"Why neurons mix: High dimensionality for higher cognition","volume":"37","author":"Fusi S.","year":"2016","unstructured":"S. Fusi, E. K. Miller, M. Rigotti, Why neurons mix: High dimensionality for higher cognition. Curr. Opin. Neurobiol. 37, 66\u201374 (2016).","journal-title":"Curr. Opin. Neurobiol."},{"key":"e_1_3_4_37_2","doi-asserted-by":"crossref","first-page":"4596","DOI":"10.1523\/JNEUROSCI.1923-05.2006","article-title":"Working memory for conjunctions relies on the medial temporal lobe","volume":"26","author":"Olson I. R.","year":"2006","unstructured":"I. R. Olson, K. Page, K. S. Moore, A. Chatterjee, M. Verfaellie, Working memory for conjunctions relies on the medial temporal lobe. J. Neurosci. 26, 4596\u20134601 (2006).","journal-title":"J. Neurosci."},{"key":"e_1_3_4_38_2","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1037\/0096-1523.27.1.229","article-title":"Effect anticipation and action control","volume":"27","author":"Elsner B.","year":"2001","unstructured":"B. Elsner, B. Hommel, Effect anticipation and action control. J. Exp. Psychol. Hum. Percept. Perform. 27, 229\u2013240 (2001).","journal-title":"J. Exp. Psychol. Hum. Percept. Perform."},{"key":"e_1_3_4_39_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9609.001.0001","volume-title":"Analyzing Neural Time Series Data: Theory and Practice","author":"Cohen M. X.","year":"2014","unstructured":"M. X. Cohen, Analyzing Neural Time Series Data: Theory and Practice, (MIT Press, 2014)."},{"key":"e_1_3_4_40_2","doi-asserted-by":"crossref","unstructured":"A. Kikumoto U. Mayr Conjunctive representations that integrate stimuli responses and rules are critical for action selection. Open Science Framework. https:\/\/osf.io\/24uwd. Deposited 24 February 2020.","DOI":"10.1101\/835652"}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.1922166117","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,7]],"date-time":"2022-06-07T17:28:23Z","timestamp":1654622903000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/full\/10.1073\/pnas.1922166117"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,27]]},"references-count":40,"journal-issue":{"issue":"19","published-print":{"date-parts":[[2020,5,12]]}},"alternative-id":["10.1073\/pnas.1922166117"],"URL":"https:\/\/doi.org\/10.1073\/pnas.1922166117","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/835652","asserted-by":"object"}]},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"value":"0027-8424","type":"print"},{"value":"1091-6490","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,27]]},"assertion":[{"value":"2020-04-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}