{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,6]],"date-time":"2025-12-06T15:11:19Z","timestamp":1765033879355,"version":"3.46.0"},"reference-count":40,"publisher":"IOP Publishing","issue":"3","license":[{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/publishingsupport.iopscience.iop.org\/iop-standard\/v1"},{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Compagnia di San Paolo Foundation, Italy","award":["CSTO164044"],"award-info":[{"award-number":["CSTO164044"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["J. Neural Eng."],"published-print":{"date-parts":[[2021,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    <jats:italic>Objective<\/jats:italic>\n                    . We have recently developed a prototype of a novel human-computer interface for assistive communication based on voluntary shifts of attention (gaze) from a far target to a near target associated with a decrease of pupil size (Pupillary Accommodative Response, PAR), an automatic vegetative response that can be easily recorded. We report here an extension of that approach based on pupillary and cortical frequency tagging.\n                    <jats:italic>Approach<\/jats:italic>\n                    . In 18 healthy volunteers, we investigated the possibility of decoding attention shifts in depth by exploiting the evoked oscillatory responses of the pupil (Pupillary Oscillatory Response, POR, recorded through a low-cost device) and visual cortex (Steady-State Visual Evoked Potentials, SSVEP, recorded from 4 scalp electrodes). With a simple binary communication protocol (focusing on a far target meaning \u2018No\u2019, focusing on the near target meaning \u2018Yes\u2019), we aimed at discriminating when observer\u2019s overt attention (gaze) shifted from the far to the near target, which were flickering at different frequencies.\n                    <jats:italic>Main results<\/jats:italic>\n                    . By applying a binary linear classifier (Support Vector Machine, SVM, with leave-one-out cross validation) to POR and SSVEP signals, we found that, with only twenty trials and no subjects\u2019 behavioural training, the offline median decoding accuracy was 75% and 80% with POR and SSVEP signals, respectively. When the two signals were combined together, accuracy reached 83%. The number of observers for whom accuracy was higher than 70% was 11\/18, 12\/18 and 14\/18 with POR, SVVEP and combined features, respectively. A signal detection analysis confirmed these results.\n                    <jats:italic>Significance<\/jats:italic>\n                    . The present findings suggest that exploiting frequency tagging with pupillary or cortical responses during an attention shift in the depth plane, either separately or combined together, is a promising approach to realize a device for communicating with Complete Locked-In Syndrome (CLIS) patients when oculomotor control is unreliable and traditional assistive communication, even based on PAR, is unsuccessful.\n                  <\/jats:p>","DOI":"10.1088\/1741-2552\/ab8e8f","type":"journal-article","created":{"date-parts":[[2020,4,29]],"date-time":"2020-04-29T18:50:30Z","timestamp":1588186230000},"page":"036008","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Decoding overt shifts of attention in depth through pupillary and cortical frequency tagging"],"prefix":"10.1088","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7322-2240","authenticated-orcid":false,"given":"Claudio","family":"de\u2019Sperati","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Silvestro","family":"Roatta","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Niccol\u00f2","family":"Zovetti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tatiana","family":"Baroni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"266","published-online":{"date-parts":[[2021,3,8]]},"reference":[{"key":"jneab8e8fbib1","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1016\/j.clinph.2007.09.121","type":"journal-article","article-title":"Towards an independent brain\u2013computer interface using steady state visual evoked potentials","volume":"119","author":"Allison","year":"2008","journal-title":"Clin. Neurophysiol."},{"key":"jneab8e8fbib2","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1097\/01.wco.0000183114.76056.0e","type":"journal-article","article-title":"Autonomic impairment in amyotrophic lateral sclerosis","volume":"18","author":"Baltadzhieva","year":"2005","journal-title":"Curr. Opin. Neurol."},{"key":"jneab8e8fbib3","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1016\/j.jneumeth.2015.11.026","type":"journal-article","article-title":"Toward a reliable gaze-independent hybrid BCI combining visual and natural auditory stimuli","volume":"261","author":"Barbosa","year":"2016","journal-title":"J. Neurosci. Methods"},{"key":"jneab8e8fbib4","doi-asserted-by":"publisher","first-page":"2199","DOI":"10.1523\/JNEUROSCI.3440-12.2013","type":"journal-article","article-title":"Attention to bright surfaces enhances the pupillary light reflex","volume":"33","author":"Binda","year":"2013","journal-title":"J. Neurosci."},{"key":"jneab8e8fbib5","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1111\/j.1469-8986.2006.00456.x","type":"journal-article","article-title":"Breaking the silence: brain\u2013computer interfaces (BCI) for communication and motor control","volume":"43","author":"Birbaumer","year":"2006","journal-title":"Psychophysiology"},{"key":"jneab8e8fbib6","doi-asserted-by":"publisher","first-page":"1255","DOI":"10.3758\/s13428-012-0186-0","type":"journal-article","article-title":"MorePower 6.0 for ANOVA with relational confidence intervals and Bayesian analysis","volume":"44","author":"Campbell","year":"2012","journal-title":"Behav. Res. Methods"},{"key":"jneab8e8fbib7","doi-asserted-by":"publisher","first-page":"1047","DOI":"10.1109\/TNSRE.2017.2673242","type":"journal-article","article-title":"A ssvep-bci setup based on depth-of-field","volume":"25","author":"Cotrina","year":"2017","journal-title":"IEEE Trans. Neural. Syst. Rehabil. Eng."},{"key":"jneab8e8fbib8","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1590\/2446-4740.0752","type":"journal-article","article-title":"Statistical evaluation of a novel SSVEP-BCI stimulation setup based on depth-of-field","volume":"31","author":"Cotrina","year":"2015","journal-title":"Res. Biomed. Eng."},{"year":"2019","author":"de\u2019Sperati","article-title":"Exploiting pupil and cortical oscillatory responses to flickering stimuli for decoding shifts of attention in depth","key":"jneab8e8fbib9","type":"conference-proceedings"},{"key":"jneab8e8fbib10","doi-asserted-by":"publisher","first-page":"486","DOI":"10.1093\/cercor\/13.5.486","type":"journal-article","article-title":"Source analysis of event-related cortical activity during visuo-spatial attention","volume":"13","author":"Di Russo","year":"2003","journal-title":"Cereb. Cortex"},{"key":"jneab8e8fbib11","doi-asserted-by":"publisher","first-page":"742","DOI":"10.1109\/TBME.2006.889160","type":"journal-article","article-title":"Multiple channel detection of steady-state visual evoked potentials for brain-computer interfaces","volume":"54","author":"Friman","year":"2007","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"jneab8e8fbib12","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/j.cortex.2015.10.008","type":"journal-article","article-title":"Covert enaction at work: recording the continuous movements of visuospatial attention to visible or imagined targets by means of steady-state visual evoked potentials (SSVEPs)","volume":"74","author":"Gregori-Grgi\u010d","year":"2016","journal-title":"Cortex"},{"key":"jneab8e8fbib13","doi-asserted-by":"crossref","DOI":"10.16910\/jemr.9.6.3","type":"journal-article","article-title":"Covert Attention tracking: towards two-dimensional real-time recordings","volume":"9","author":"Gregori-Grgi\u010d","year":"2016","journal-title":"J. Eye Movement. Res."},{"key":"jneab8e8fbib14","doi-asserted-by":"publisher","first-page":"46","DOI":"10.3758\/BF03203619","type":"journal-article","article-title":"Corrections for extreme proportions and their biasing effects on estimated values ofd\u2032","volume":"27","author":"Hautus","year":"1995","journal-title":"Behav. Res. Meth. Instr. Comput."},{"key":"jneab8e8fbib15","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1007\/s002210100682","type":"journal-article","article-title":"Human EEG responses to 1\u2013100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena","volume":"137","author":"Herrmann","year":"2001","journal-title":"Exp. Brain Res."},{"key":"jneab8e8fbib16","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1073\/pnas.95.3.781","type":"journal-article","article-title":"Event-related brain potentials in the study of visual selective attention","volume":"95","author":"Hillyard","year":"1998","journal-title":"Proc. Natl. Acad. Sci."},{"key":"jneab8e8fbib17","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1016\/S1388-2457(02)00411-X","type":"journal-article","article-title":"A brain\u2013computer interface (BCI) for the locked-in: comparison of different EEG classifications for the thought translation device","volume":"114","author":"Hinterberger","year":"2003","journal-title":"Clin. Neurophysiol."},{"key":"jneab8e8fbib18","doi-asserted-by":"publisher","first-page":"S16","DOI":"10.1016\/j.apmr.2014.03.035","type":"journal-article","article-title":"Long-term independent brain-computer interface home use improves quality of life of a patient in the locked-in state: a case study","volume":"96","author":"Holz","year":"2015","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"jneab8e8fbib19","doi-asserted-by":"publisher","first-page":"2658","DOI":"10.1016\/j.clinph.2008.06.019","type":"journal-article","article-title":"Brain\u2013computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients?","volume":"119","author":"K\u00fcbler","year":"2008","journal-title":"Clin. Neurophysiol."},{"key":"jneab8e8fbib20","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1111\/j.1749-6632.2008.04122.x","type":"journal-article","article-title":"A brain\u2013computer interface controlled auditory event\u2010related potential (P300) spelling system for locked\u2010in patients","volume":"1157","author":"K\u00fcbler","year":"2009","journal-title":"Ann. N. Y. Acad. Sci."},{"key":"jneab8e8fbib21","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1016\/S0079-6123(05)50034-7","type":"journal-article","article-title":"The locked-in syndrome: what is it like to be conscious but paralyzed and voiceless?","volume":"150","author":"Laureys","year":"2005","journal-title":"Prog. Brain Res."},{"key":"jneab8e8fbib22","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1080\/02699050110119781","type":"journal-article","article-title":"The locked-in syndrome: a syndrome looking for a therapy","volume":"16","author":"Leon-carrion","year":"2002","journal-title":"Brain Injury"},{"key":"jneab8e8fbib23","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/11\/3\/035002","type":"journal-article","article-title":"An independent SSVEP-based brain\u2013computer interface in locked-in syndrome","volume":"11","author":"Lesenfants","year":"2014","journal-title":"J. Neural. Eng."},{"key":"jneab8e8fbib24","doi-asserted-by":"publisher","first-page":"1255","DOI":"10.1016\/j.clinph.2014.09.017","type":"journal-article","article-title":"Brain\u2013computer interfaces in amyotrophic lateral sclerosis: a metanalysis","volume":"126","author":"Marchetti","year":"2015","journal-title":"Clin. Neurophysiol."},{"key":"jneab8e8fbib25","doi-asserted-by":"publisher","first-page":"16","DOI":"10.5334\/joc.18","type":"journal-article","article-title":"Pupillometry: psychology, physiology, and function","volume":"1","author":"Math\u00f4t","year":"2018","journal-title":"J. Cogn."},{"key":"jneab8e8fbib26","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0148805","type":"journal-article","article-title":"The mind-writing pupil: a human-computer interface based on decoding of covert attention through pupillometry","volume":"11","author":"Math\u00f4t","year":"2016","journal-title":"PLoS One"},{"key":"jneab8e8fbib27","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0078168","type":"journal-article","article-title":"The pupillary light response reveals the focus of covert visual attention","volume":"8","author":"Math\u00f4t","year":"2013","journal-title":"PLoS One"},{"key":"jneab8e8fbib28","doi-asserted-by":"publisher","first-page":"1544","DOI":"10.1016\/S1388-2457(00)00371-0","type":"journal-article","article-title":"Concurrent recording of steady-state and transient event-related potentials as indices of visual-spatial selective attention","volume":"111","author":"M\u00fcller","year":"2000","journal-title":"Clin. Neurophysiol."},{"key":"jneab8e8fbib29","doi-asserted-by":"publisher","first-page":"919","DOI":"10.3389\/fpsyg.2013.00919","type":"journal-article","article-title":"Tracking the allocation of attention using human pupillary oscillations","volume":"4","author":"Naber","year":"2013","journal-title":"Frontiers Psychol."},{"key":"jneab8e8fbib30","doi-asserted-by":"publisher","first-page":"522","DOI":"10.3389\/fnins.2017.00522","type":"journal-article","article-title":"Affective stimuli for an auditory P300 brain-computer interface","volume":"11","author":"Onishi","year":"2017","journal-title":"Frontiers Neurosci"},{"key":"jneab8e8fbib31","doi-asserted-by":"crossref","first-page":"89","DOI":"10.3109\/17483107.2011.589486","type":"journal-article","article-title":"Toward functioning and usable brain\u2013computer interfaces (BCIs): a literature review","volume":"7","author":"Pasqualotto","year":"2012","journal-title":"Disabil. Rehabil. Assist. Technol."},{"key":"jneab8e8fbib32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TNSRE.2003.814454","type":"journal-article","article-title":"Graz-BCI: state of the art and clinical applications","volume":"11","author":"Pfurtscheller","year":"2003","journal-title":"IEEE Trans. Neural. Syst. Rehabil. Eng."},{"key":"jneab8e8fbib33","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/j.ijhcs.2019.02.002","type":"journal-article","article-title":"A human-computer interface based on the \u201cvoluntary\u201d pupil accommodative response","volume":"126","author":"Ponzio","year":"2019","journal-title":"Int. J. Hum. Comput. Stud."},{"year":"2019","author":"Roatta","article-title":"The pupil accommodative response as a communication tool in ALS patients","key":"jneab8e8fbib34","type":"conference-proceedings"},{"key":"jneab8e8fbib35","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1136\/bmj.330.7488.406","type":"journal-article","article-title":"Locked-in syndrome","volume":"330","author":"Smith","year":"2005","journal-title":"Br. Med. J."},{"key":"jneab8e8fbib36","doi-asserted-by":"publisher","first-page":"R647","DOI":"10.1016\/j.cub.2013.06.011","type":"journal-article","article-title":"Pupil responses allow communication in locked-in syndrome patients","volume":"23","author":"Stoll","year":"2013","journal-title":"Curr. Biol."},{"key":"jneab8e8fbib37","doi-asserted-by":"publisher","first-page":"2060","DOI":"10.1056\/NEJMoa1608085","type":"journal-article","article-title":"Fully implanted brain\u2013computer interface in a locked-in patient with ALS","volume":"375","author":"Vansteensel","year":"2016","journal-title":"N. Engl. J. Med."},{"key":"jneab8e8fbib38","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1016\/j.neuroimage.2016.10.038","type":"journal-article","article-title":"Assessing and tuning brain decoders: cross-validation, caveats, and guidelines","volume":"145","author":"Varoquaux","year":"2017","journal-title":"Neuroimage"},{"year":"1996","author":"Von Noorden","key":"jneab8e8fbib39","type":"book"},{"key":"jneab8e8fbib40","doi-asserted-by":"publisher","first-page":"171","DOI":"10.4103\/2152-7806.169561","type":"journal-article","article-title":"A comprehensive review of amyotrophic lateral sclerosis","volume":"6","author":"Zarei","year":"2015","journal-title":"Surg. Neurol. Int."}],"container-title":["Journal of Neural Engineering"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ab8e8f","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ab8e8f\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ab8e8f","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ab8e8f\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ab8e8f\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ab8e8f\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ab8e8f\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ab8e8f\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,6]],"date-time":"2025-12-06T15:06:34Z","timestamp":1765033594000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ab8e8f"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,8]]},"references-count":40,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,3,8]]},"published-print":{"date-parts":[[2021,6,1]]}},"URL":"https:\/\/doi.org\/10.1088\/1741-2552\/ab8e8f","relation":{},"ISSN":["1741-2560","1741-2552"],"issn-type":[{"type":"print","value":"1741-2560"},{"type":"electronic","value":"1741-2552"}],"subject":[],"published":{"date-parts":[[2021,3,8]]},"assertion":[{"value":"Decoding overt shifts of attention in depth through pupillary and cortical frequency tagging","name":"article_title","label":"Article Title"},{"value":"Journal of Neural Engineering","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2021 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.","name":"copyright_information","label":"Copyright Information"},{"value":"2019-12-17","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2020-04-29","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2021-03-08","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}