{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T21:16:42Z","timestamp":1778275002177,"version":"3.51.4"},"reference-count":61,"publisher":"MIT Press","issue":"2","license":[{"start":{"date-parts":[[2022,10,28]],"date-time":"2022-10-28T00:00:00Z","timestamp":1666915200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Attention to the relevant object and space is the brain's strategy to effectively process the information of interest in complex environments with limited neural resources. Numerous studies have documented how attention is allocated in the visual domain, whereas the nature of attention in the auditory domain has been much less explored. Here, we show that the pupillary light response can serve as a physiological index of auditory attentional shift and can be used to probe the relationship between space-based and object-based attention as well. Experiments demonstrated that the pupillary response corresponds to the luminance condition where the attended auditory object (e.g., spoken sentence) was located, regardless of whether attention was directed by a spatial (left or right) or nonspatial (e.g., the gender of the talker) cue and regardless of whether the sound was presented via headphones or loudspeakers. These effects on the pupillary light response could not be accounted for as a consequence of small (although observable) biases in gaze position drifting. The overall results imply a unified audiovisual representation of spatial attention. Auditory object-based attention contains the space representation of the attended auditory object, even when the object is oriented without explicit spatial guidance.<\/jats:p>","DOI":"10.1162\/jocn_a_01935","type":"journal-article","created":{"date-parts":[[2022,10,28]],"date-time":"2022-10-28T16:54:05Z","timestamp":1666976045000},"page":"276-290","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":5,"title":["Seeing an Auditory Object: Pupillary Light Response Reflects Covert Attention to Auditory Space and Object"],"prefix":"10.1162","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4740-7380","authenticated-orcid":true,"given":"Hsin-I","family":"Liao","sequence":"first","affiliation":[{"name":"NTT Communication Science Laboratories, Japan"}]},{"given":"Haruna","family":"Fujihira","sequence":"additional","affiliation":[{"name":"NTT Communication Science Laboratories, Japan"},{"name":"Japan Society for the Promotion of Science"}]},{"given":"Shimpei","family":"Yamagishi","sequence":"additional","affiliation":[{"name":"NTT Communication Science Laboratories, Japan"}]},{"given":"Yung-Hao","family":"Yang","sequence":"additional","affiliation":[{"name":"NTT Communication Science Laboratories, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5833-7891","authenticated-orcid":true,"given":"Shigeto","family":"Furukawa","sequence":"additional","affiliation":[{"name":"NTT Communication Science Laboratories, Japan"}]}],"member":"281","published-online":{"date-parts":[[2023,2,1]]},"reference":[{"key":"2023011718094866500_bib1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting linear mixed-effects models using lme4","volume":"67","author":"Bates","year":"2015","journal-title":"Journal of Statistical Software"},{"key":"2023011718094866500_bib2","doi-asserted-by":"publisher","first-page":"13174","DOI":"10.1073\/pnas.0803718105","article-title":"Object continuity enhances selective auditory attention","volume":"105","author":"Best","year":"2008","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023011718094866500_bib3","doi-asserted-by":"publisher","first-page":"EL258","DOI":"10.1121\/1.3431093","article-title":"Exploring the benefit of auditory spatial continuity","volume":"127","author":"Best","year":"2010","journal-title":"Journal of the Acoustical Society of America"},{"key":"2023011718094866500_bib4","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1016\/j.tins.2017.06.007","article-title":"Renewed attention on the pupil light reflex","volume":"40","author":"Binda","year":"2017","journal-title":"Trends in Neurosciences"},{"key":"2023011718094866500_bib5","doi-asserted-by":"publisher","first-page":"2199","DOI":"10.1523\/jneurosci.3440-12.2013","article-title":"Attention to bright surfaces enhances the pupillary light reflex","volume":"33","author":"Binda","year":"2013","journal-title":"Journal of Neuroscience"},{"key":"2023011718094866500_bib6","doi-asserted-by":"publisher","first-page":"3046","DOI":"10.1152\/jn.00502.2014","article-title":"Pupil size reflects the focus of feature-based attention","volume-title":"Journal of Neurophysiology","author":"Binda","year":"2014"},{"key":"2023011718094866500_bib7","doi-asserted-by":"publisher","first-page":"1065","DOI":"10.1121\/1.428288","article-title":"A speech corpus for multitalker communications research","volume":"107","author":"Bolia","year":"2000","journal-title":"Journal of the Acoustical Society of America"},{"key":"2023011718094866500_bib8","doi-asserted-by":"publisher","first-page":"164","DOI":"10.3389\/fnhum.2016.00164","article-title":"Eye movements during auditory attention predict individual differences in dorsal attention network activity","volume":"10","author":"Braga","year":"2016","journal-title":"Frontiers in Human Neuroscience"},{"key":"2023011718094866500_bib9","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1163\/156856897X00357","article-title":"The Psychophysics Toolbox","volume":"10","author":"Brainard","year":"1997","journal-title":"Spatial Vision"},{"key":"2023011718094866500_bib10","doi-asserted-by":"publisher","first-page":"759","DOI":"10.1038\/11239","article-title":"Modality-specific frontal and parietal areas for auditory and visual spatial localization in humans","volume":"2","author":"Bushara","year":"1999","journal-title":"Nature Neuroscience"},{"key":"2023011718094866500_bib11","doi-asserted-by":"publisher","first-page":"204","DOI":"10.3758\/BF03212327","article-title":"Visuospatial attention: Beyond a spotlight model","volume":"6","author":"Cave","year":"1999","journal-title":"Psychonomic Bulletin & Review"},{"key":"2023011718094866500_bib12","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1016\/S0166-2236(98)01295-8","article-title":"Maps versus clusters: Different representations of auditory space in the midbrain and forebrain","volume":"22","author":"Cohen","year":"1999","journal-title":"Trends in Neurosciences"},{"key":"2023011718094866500_bib13","doi-asserted-by":"publisher","first-page":"831","DOI":"10.1073\/pnas.95.3.831","article-title":"Frontoparietal cortical networks for directing attention and the eye to visual locations: Identical, independent, or overlapping neural systems?","volume":"95","author":"Corbetta","year":"1998","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023011718094866500_bib14","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1037\/0096-1523.14.2.188","article-title":"Expectancy and visual\u2013spatial attention: Effects on perceptual quality","volume":"14","author":"Downing","year":"1988","journal-title":"Journal of Experimental Psychology: Human Perception and Performance"},{"key":"2023011718094866500_bib15","doi-asserted-by":"publisher","first-page":"5008","DOI":"10.1523\/jneurosci.2433-16.2017","article-title":"Selective modulation of the pupil light reflex by microstimulation of prefrontal cortex","volume":"37","author":"Ebitz","year":"2017","journal-title":"Journal of Neuroscience"},{"key":"2023011718094866500_bib16","doi-asserted-by":"publisher","first-page":"225","DOI":"10.3758\/BF03211502","article-title":"Visual attention within and around the field of focal attention: A zoom lens model","volume":"40","author":"Eriksen","year":"1986","journal-title":"Perception & Psychophysics"},{"key":"2023011718094866500_bib17","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1016\/j.conb.2007.07.011","article-title":"Auditory attention\u2014Focusing the searchlight on sound","volume":"17","author":"Fritz","year":"2007","journal-title":"Current Opinion in Neurobiology"},{"key":"2023011718094866500_bib18","first-page":"153","article-title":"Vortrag gesellschaft der \u00e4rzte in z\u00fcrich am 21. November 1885","volume":"16","author":"Haab","year":"1886","journal-title":"Korrespondenzblatt f\u00fcr Schweizer \u00c4rzte"},{"key":"2023011718094866500_bib19","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1093\/cercor\/bhp124","article-title":"Auditory attentional control and selection during cocktail party listening","volume":"20","author":"Hill","year":"2009","journal-title":"Cerebral Cortex"},{"key":"2023011718094866500_bib20","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1002\/cne.902530402","article-title":"Frontal Intracortical eye field as defined by microstimulation in squirrel monkeys, owl monkeys, and macaque monkeys: I. subcortical connections","volume":"253","author":"Huerta","year":"1986","journal-title":"Journal of Comparative Neurology"},{"key":"2023011718094866500_bib21","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1016\/0165-0173(90)90005-9","article-title":"The descending auditory pathway and acousticomotor systems: Connections with the inferior colliculus","volume":"15","author":"Huffman","year":"1990","journal-title":"Brain Research Reviews"},{"key":"2023011718094866500_bib22","doi-asserted-by":"publisher","first-page":"466","DOI":"10.1016\/j.tics.2020.03.005","article-title":"Pupil size as a window on neural substrates of cognition","volume":"24","author":"Joshi","year":"2020","journal-title":"Trends in Cognitive Sciences"},{"key":"2023011718094866500_bib23","doi-asserted-by":"publisher","first-page":"788","DOI":"10.1038\/s41593-020-0660-4","article-title":"Using Bayes factor hypothesis testing in neuroscience to establish evidence of absence","volume":"23","author":"Keysers","year":"2020","journal-title":"Nature Neuroscience"},{"key":"2023011718094866500_bib24","first-page":"1","article-title":"What's new in Psychtoolbox-3?","volume":"36","author":"Kleiner","year":"2007","journal-title":"Perception"},{"key":"2023011718094866500_bib25","doi-asserted-by":"publisher","first-page":"1961","DOI":"10.1111\/j.1460-9568.2011.07696.x","article-title":"Control from below: The role of a midbrain network in spatial attention","volume":"33","author":"Knudsen","year":"2011","journal-title":"European Journal of Neuroscience"},{"key":"2023011718094866500_bib26","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1016\/j.visres.2016.03.006","article-title":"Eye movements between saccades: Measuring ocular drift and tremor","volume":"122","author":"Ko","year":"2016","journal-title":"Vision Research"},{"key":"2023011718094866500_bib27","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1002\/cne.901730108","article-title":"Efferent connections of cortical, area 8 (frontal eye field) in Macaca fascicularis. A reinvestigation using the autoradiographic technique","volume":"173","author":"K\u00fcnzle","year":"1977","journal-title":"Journal of Comparative Neurology"},{"key":"2023011718094866500_bib28","doi-asserted-by":"publisher","first-page":"2162","DOI":"10.1073\/pnas.1118298109","article-title":"Bright illusions reduce the eye's pupil","volume":"109","author":"Laeng","year":"2012","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023011718094866500_bib29","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1177\/0956797613503556","article-title":"The eye pupil adjusts to imaginary light","volume":"25","author":"Laeng","year":"2014","journal-title":"Psychological Science"},{"key":"2023011718094866500_bib30","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1016\/j.neuroimage.2013.09.061","article-title":"Switching auditory attention using spatial and non-spatial features recruits different cortical networks","volume":"84","author":"Larson","year":"2014","journal-title":"Neuroimage"},{"key":"2023011718094866500_bib31","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1017\/S095252380000016X","article-title":"Preoccipital cortex receives a differential input from the frontal eye field and projects to the pretectal olivary nucleus and other visuomotor-related structures in the rhesus monkey","volume":"5","author":"Leichnetz","year":"1990","journal-title":"Visual Neuroscience"},{"key":"2023011718094866500_bib101","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1162\/jocn_a_01649","article-title":"Attractiveness in the eyes: A possibility of positive loop between transient pupil constriction and facial attraction","volume":"33","author":"Liao","year":"2021","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023011718094866500_bib100","doi-asserted-by":"publisher","first-page":"412","DOI":"10.3758\/s13423-015-0898-0","article-title":"Correspondences among pupillary dilation response, subjective salience of sounds, and loudness","volume":"23","author":"Liao","year":"2016","journal-title":"Psychonomic Bulletin & Review"},{"key":"2023011718094866500_bib32","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1016\/j.jneumeth.2007.03.024","article-title":"Nonparametric statistical testing of EEG- and MEG-data","volume":"164","author":"Maris","year":"2007","journal-title":"Journal of Neuroscience Methods"},{"key":"2023011718094866500_bib33","doi-asserted-by":"publisher","first-page":"16","DOI":"10.5334\/joc.18","article-title":"Pupillometry: Psychology, physiology, and function","volume":"1","author":"Math\u00f4t","year":"2018","journal-title":"Journal of Cognition"},{"key":"2023011718094866500_bib34","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1167\/14.14.7","article-title":"The pupillary light response reflects exogenous attention and inhibition of return","volume":"14","author":"Math\u00f4t","year":"2014","journal-title":"Journal of Vision"},{"key":"2023011718094866500_bib35","doi-asserted-by":"publisher","first-page":"e78168","DOI":"10.1371\/journal.pone.0078168","article-title":"The pupillary light response reveals the focus of covert visual attention","volume":"8","author":"Math\u00f4t","year":"2013","journal-title":"PLoS One"},{"key":"2023011718094866500_bib36","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1177\/0963721415593725","article-title":"New light on the mind's eye: The pupillary light response as active vision","volume":"24","author":"Math\u00f4t","year":"2015","journal-title":"Current Directions in Psychological Science"},{"key":"2023011718094866500_bib37","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1146\/annurev-vision-082114-035431","article-title":"Neuronal mechanisms of visual attention","volume":"1","author":"Maunsell","year":"2015","journal-title":"Annual Review of Vision Science"},{"key":"2023011718094866500_bib38","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1002\/cphy.c140014","article-title":"Autonomic control of the eye","volume":"5","author":"McDougal","year":"2015","journal-title":"Comprehensive Physiology"},{"key":"2023011718094866500_bib39","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1037\/\/0096-1523.21.2.387","article-title":"Shifting and focusing auditory spatial attention","volume":"21","author":"Mondor","year":"1995","journal-title":"Journal of Experimental Psychology: Human Perception and Performance"},{"key":"2023011718094866500_bib40","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0020910","article-title":"Perceptual rivalry: Reflexes reveal the gradual nature of visual awareness","volume":"6","author":"Naber","year":"2011","journal-title":"PLoS One"},{"key":"2023011718094866500_bib41","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1167\/13.6.7","article-title":"Pupil responses to high-level image content","volume":"13","author":"Naber","year":"2013","journal-title":"Journal of Vision"},{"key":"2023011718094866500_bib42","doi-asserted-by":"publisher","first-page":"e1610","DOI":"10.1002\/wcs.1610","article-title":"Defining attention from an auditory perspective","author":"Noyce","year":"2022","journal-title":"WIREs Cognitive Science"},{"key":"2023011718094866500_bib43","doi-asserted-by":"publisher","first-page":"156869","DOI":"10.1155\/2011\/156869","article-title":"FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data","volume":"2011","author":"Oostenveld","year":"2011","journal-title":"Computational Intelligence and Neuroscience"},{"key":"2023011718094866500_bib44","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1163\/156856897X00366","article-title":"The VideoToolbox software for visual psychophysics: Transforming numbers into movies","volume":"10","author":"Pelli","year":"1997","journal-title":"Spatial Vision"},{"key":"2023011718094866500_bib45","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1037\/0096-3445.109.2.160","article-title":"Attention and the detection of signals","volume":"109","author":"Posner","year":"1980","journal-title":"Journal of Experimental Psychology: General"},{"key":"2023011718094866500_bib46","doi-asserted-by":"publisher","first-page":"614","DOI":"10.3758\/BF03213267","article-title":"An examination of attentional control in the auditory modality: Further evidence for auditory orienting","volume":"57","author":"Quinlan","year":"1995","journal-title":"Perception & Psychophysics"},{"key":"2023011718094866500_bib47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3758\/BF03211508","article-title":"Auditory attention and the representation of spatial information","volume":"42","author":"Rhodes","year":"1987","journal-title":"Perception & Psychophysics"},{"key":"2023011718094866500_bib48","doi-asserted-by":"publisher","first-page":"1844","DOI":"10.3758\/s13423-022-02094-0","article-title":"Pupil size variations reveal covert shifts of attention induced by numbers","volume":"29","author":"Salvaggio","year":"2022","journal-title":"Psychonomic Bulletin & Review"},{"key":"2023011718094866500_bib49","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1016\/j.tics.2008.02.003","article-title":"Object-based auditory and visual attention","volume":"12","author":"Shinn-Cunningham","year":"2008","journal-title":"Trends in Cognitive Sciences"},{"key":"2023011718094866500_bib50","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1162\/jocn.2009.21241","article-title":"Spatial attention evokes similar activation patterns for visual and auditory stimuli","volume":"22","author":"Smith","year":"2010","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023011718094866500_bib51","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1037\/0096-1523.20.3.555","article-title":"Covert spatial orienting in audition: Exogenous and endogenous mechanisms","volume":"20","author":"Spence","year":"1994","journal-title":"Journal of Experimental Psychology: Human Perception and Performance"},{"key":"2023011718094866500_bib52","doi-asserted-by":"publisher","first-page":"1005","DOI":"10.1037\/0096-1523.22.4.1005","article-title":"Audiovisual links in endogenous covert spatial attention","volume":"22","author":"Spence","year":"1996","journal-title":"Journal of Experimental Psychology: Human Perception and Performance"},{"key":"2023011718094866500_bib53","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1016\/j.cortex.2022.03.006","article-title":"The orienting response drives pseudoneglect\u2014Evidence from an objective pupillometric method","volume":"151","author":"Strauch","year":"2022","journal-title":"Cortex"},{"key":"2023011718094866500_bib54","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1016\/j.tins.2022.05.003","article-title":"Pupillometry as an integrated readout of distinct attentional networks","volume":"45","author":"Strauch","year":"2022","journal-title":"Trends in Neurosciences"},{"key":"2023011718094866500_bib55","doi-asserted-by":"publisher","first-page":"102882","DOI":"10.1016\/j.actpsy.2019.102882","article-title":"Colorful glares: Effects of colors on brightness illusions measured with pupillometry","volume":"198","author":"Suzuki","year":"2019","journal-title":"Acta Psychologica"},{"key":"2023011718094866500_bib56","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/0010-0285(80)90005-5","article-title":"A feature-integration theory of attention","volume":"12","author":"Treisman","year":"1980","journal-title":"Cognitive Psychology"},{"key":"2023011718094866500_bib57","doi-asserted-by":"publisher","first-page":"3629","DOI":"10.1523\/jneurosci.5512-11.2012","article-title":"Microstimulation of the monkey superior colliculus induces pupil dilation without evoking saccades","volume":"32","author":"Wang","year":"2012","journal-title":"Journal of Neuroscience"},{"key":"2023011718094866500_bib58","doi-asserted-by":"publisher","first-page":"10446","DOI":"10.1073\/pnas.1809668115","article-title":"Neural basis of location-specific pupil luminance modulation","volume":"115","author":"Wang","year":"2018","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023011718094866500_bib59","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1006\/nimg.1999.0491","article-title":"Auditory attention to space and frequency activates similar cerebral systems","volume":"10","author":"Zatorre","year":"1999","journal-title":"Neuroimage"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/35\/2\/276\/2067018\/jocn_a_01935.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/35\/2\/276\/2067018\/jocn_a_01935.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,17]],"date-time":"2023-01-17T18:10:06Z","timestamp":1673979006000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/35\/2\/276\/113584\/Seeing-an-Auditory-Object-Pupillary-Light-Response"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":61,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,2,1]]},"published-print":{"date-parts":[[2023,2,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_01935","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023]]},"published":{"date-parts":[[2023]]}}}