{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T13:49:51Z","timestamp":1765547391642,"version":"3.41.0"},"reference-count":62,"publisher":"MIT Press","issue":"8","funder":[{"DOI":"10.13039\/501100001691","name":"JSPS KAKENHI","doi-asserted-by":"publisher","award":["JP23K16669","JP22K21299"],"award-info":[{"award-number":["JP23K16669","JP22K21299"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Honda Research Institute Japan"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Understanding individuals' internal cognitive states during group interactions is crucial for enhancing group dynamics and communication. This study investigated internal states by analyzing physiological data\u2014EEG, electrocardiography, and pupil size\u2014collected from high school students during group discussions. Using a data-driven clustering method, we identified four distinct internal states, each corresponding to the different power distributions in the four frequency bands of EEG activity, heart rate variability, and pupil size. These states were not only associated with verbal behavior such as \u201cspeaking\u201d, they were also associated with nonverbal cues such as \u201cgazing at faces\u201d and other body languages. We also examined the influence of environmental factors on internal states, including the presence of a facilitator and the group size. The presence of a facilitator significantly increased the probability of participants remaining in the high alpha-power state, possibly reflecting a relaxed or moderately aroused state. This study provides insights into the physiological underpinnings of group interactions, which can be leveraged to improve educational settings and other group-based activities.<\/jats:p>","DOI":"10.1162\/jocn_a_02315","type":"journal-article","created":{"date-parts":[[2025,2,25]],"date-time":"2025-02-25T17:01:02Z","timestamp":1740502862000},"page":"1364-1380","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":1,"title":["Internal State Estimation via Physiological Data and Its Modulation by Environmental Context during Social Activity"],"prefix":"10.1162","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3825-2919","authenticated-orcid":true,"given":"Ayumu","family":"Yamashita","sequence":"first","affiliation":[{"name":"The University of Tokyo"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hiroki","family":"Maeda","sequence":"additional","affiliation":[{"name":"The University of Tokyo"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jouh Yeong","family":"Chew","sequence":"additional","affiliation":[{"name":"Honda Research Institute Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kaoru","family":"Amano","sequence":"additional","affiliation":[{"name":"The University of Tokyo"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2025,8,1]]},"reference":[{"key":"2025062011055598200_bib1","doi-asserted-by":"publisher","first-page":"2248","DOI":"10.1111\/ejn.16037","article-title":"Electrophysiological correlates of attentional capture in joint action","volume":"58","author":"Abbasi","year":"2023","journal-title":"European Journal of Neuroscience"},{"key":"2025062011055598200_bib2","doi-asserted-by":"publisher","first-page":"3657","DOI":"10.1038\/s41467-021-23890-7","article-title":"Predicting lapses of attention with sleep-like slow waves","volume":"12","author":"Andrillon","year":"2021","journal-title":"Nature Communications"},{"key":"2025062011055598200_bib3","doi-asserted-by":"publisher","first-page":"949","DOI":"10.3389\/fnins.2019.00949","article-title":"Does the mind wander when the brain takes a break? Local sleep in wakefulness, attentional lapses and mind-wandering","volume":"13","author":"Andrillon","year":"2019","journal-title":"Frontiers in Neuroscience"},{"key":"2025062011055598200_bib4","doi-asserted-by":"publisher","first-page":"598895","DOI":"10.3389\/fnbot.2021.598895","article-title":"Speech driven gaze in a face-to-face interaction","volume":"15","author":"Arslan Aydin","year":"2021","journal-title":"Frontiers in Neurorobotics"},{"key":"2025062011055598200_bib5","doi-asserted-by":"publisher","first-page":"112","DOI":"10.33140\/ijnn.07.02.01","article-title":"A review of mental stress and EEG band power","volume":"7","author":"Attar","year":"2022","journal-title":"International Journal of Nanotechnology & Nanomedicine"},{"key":"2025062011055598200_bib6","doi-asserted-by":"publisher","first-page":"e2312898121","DOI":"10.1073\/pnas.2312898121","article-title":"A disinhibitory circuit mechanism explains a general principle of peak performance during mid-level arousal","volume":"121","author":"Beerendonk","year":"2024","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2025062011055598200_bib7","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1007\/s11062-017-9675-1","article-title":"EEG activities and the sustained attention performance","volume":"49","author":"Behzadnia","year":"2017","journal-title":"Neurophysiology"},{"key":"2025062011055598200_bib8","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1002\/tl.37219831410","article-title":"Students in learning groups: Active learning through conversation","volume":"1983","author":"Bouton","year":"1983","journal-title":"New Directions for Teaching and Learning"},{"key":"2025062011055598200_bib9","doi-asserted-by":"publisher","first-page":"103223","DOI":"10.1016\/j.ergon.2021.103223","article-title":"Multi-modal approach to evaluate adaptive visual stimuli of remote operation system using gaze behavior","volume":"86","author":"Chew","year":"2021","journal-title":"International Journal of Industrial Ergonomics"},{"key":"2025062011055598200_bib10","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1145\/3568294.3580056","article-title":"Who to teach a robot to facilitate multi-party social interactions?","volume-title":"Companion of the 2023 ACM\/IEEE International Conference on Human\u2013Robot Interaction","author":"Chew","year":"2023"},{"key":"2025062011055598200_bib11","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1016\/j.apergo.2018.07.005","article-title":"Glance behavior as design indices of in-vehicle visual support system: A study using crane simulators","volume":"73","author":"Chew","year":"2018","journal-title":"Applied Ergonomics"},{"key":"2025062011055598200_bib12","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1145\/3610978.3640669","article-title":"Joint attention estimation during multi-party facilitation using multi-modal fusion","volume-title":"Companion of the 2024 ACM\/IEEE International Conference on Human\u2013Robot Interaction","author":"Chew","year":"2024"},{"key":"2025062011055598200_bib13","doi-asserted-by":"publisher","first-page":"108","DOI":"10.3389\/fneur.2019.00108","article-title":"Baseline pupil diameter is not a reliable biomarker of subjective sleepiness","volume":"10","author":"Daguet","year":"2019","journal-title":"Frontiers in Neurology"},{"key":"2025062011055598200_bib14","doi-asserted-by":"publisher","first-page":"1437","DOI":"10.1109\/ICCVW54120.2021.00165","article-title":"Masked Face Recognition challenge: The InsightFace track report","volume-title":"2021 IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW)","author":"Deng","year":"2021"},{"key":"2025062011055598200_bib15","doi-asserted-by":"publisher","first-page":"3414","DOI":"10.3390\/s21103414","article-title":"Predicting exact valence and arousal values from EEG","volume":"21","author":"Galv\u00e3o","year":"2021","journal-title":"Sensors"},{"key":"2025062011055598200_bib16","doi-asserted-by":"publisher","first-page":"648","DOI":"10.3389\/fnhum.2016.00648","article-title":"Association between attention and heart rate fluctuations in pathological worriers","volume":"10","author":"Gazzellini","year":"2016","journal-title":"Frontiers in Human Neuroscience"},{"key":"2025062011055598200_bib17","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1016\/j.tins.2023.04.001","article-title":"Why is everyone talking about brain state?","volume":"46","author":"Greene","year":"2023","journal-title":"Trends in Neurosciences"},{"key":"2025062011055598200_bib18","doi-asserted-by":"publisher","first-page":"117412","DOI":"10.1016\/j.neuroimage.2020.117412","article-title":"Probing the neural signature of mind wandering with simultaneous fMRI-EEG and pupillometry","volume":"224","author":"Groot","year":"2021","journal-title":"Neuroimage"},{"key":"2025062011055598200_bib19","doi-asserted-by":"publisher","first-page":"365","DOI":"10.3102\/0013189X09339057","article-title":"An educational psychology success story: Social interdependence theory and cooperative learning","volume":"38","author":"Johnson","year":"2009","journal-title":"Educational Researcher"},{"key":"2025062011055598200_bib20","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1109\/JBHI.2017.2688239","article-title":"DREAMER: A database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices","volume":"22","author":"Katsigiannis","year":"2018","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"key":"2025062011055598200_bib21","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/s0165-0173(98)00056-3","article-title":"EEG alpha and theta oscillations reflect cognitive and memory performance: A review and analysis","volume":"29","author":"Klimesch","year":"1999","journal-title":"Brain Research Reviews"},{"key":"2025062011055598200_bib22","doi-asserted-by":"publisher","first-page":"388","DOI":"10.3389\/fnhum.2017.00388","article-title":"Sustained attention in real classroom settings: An EEG study","volume":"11","author":"Ko","year":"2017","journal-title":"Frontiers in Human Neuroscience"},{"key":"2025062011055598200_bib23","doi-asserted-by":"publisher","first-page":"106104","DOI":"10.1016\/j.isci.2023.106104","article-title":"Interpersonal synchronization of spontaneously generated body movements","volume":"26","author":"Koul","year":"2023","journal-title":"iScience"},{"key":"2025062011055598200_bib24","doi-asserted-by":"publisher","first-page":"156","DOI":"10.3389\/fnhum.2012.00156","article-title":"Oscillatory brain correlates of live joint attention: A dual-EEG study","volume":"6","author":"Lachat","year":"2012","journal-title":"Frontiers in Human Neuroscience"},{"key":"2025062011055598200_bib25","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1080\/03091902.2019.1640306","article-title":"A robust algorithm for heart rate variability time series artefact correction using novel beat classification","volume":"43","author":"Lipponen","year":"2019","journal-title":"Journal of Medical Engineering & Technology"},{"key":"2025062011055598200_bib26","doi-asserted-by":"publisher","first-page":"1692","DOI":"10.1016\/j.neuron.2023.05.004","article-title":"Representation of intergroup conflict in the human brain","volume":"111","author":"Ma","year":"2023","journal-title":"Neuron"},{"key":"2025062011055598200_bib27","doi-asserted-by":"publisher","first-page":"1689","DOI":"10.3758\/s13428-020-01516-y","article-title":"NeuroKit2: A Python toolbox for neurophysiological signal processing","volume":"53","author":"Makowski","year":"2021","journal-title":"Behavior Research Methods"},{"key":"2025062011055598200_bib28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.csl.2014.12.001","article-title":"Four-participant group conversation: A facilitation robot controlling engagement density as the fourth participant","volume":"33","author":"Matsuyama","year":"2015","journal-title":"Computer Speech & Language"},{"key":"2025062011055598200_bib29","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1146\/annurev-neuro-100219-105424","article-title":"Neuromodulation of brain state and behavior","volume":"43","author":"McCormick","year":"2020","journal-title":"Annual Review of Neuroscience"},{"key":"2025062011055598200_bib30","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/j.neuron.2015.05.038","article-title":"Cortical membrane potential signature of optimal states for sensory signal detection","volume":"87","author":"McGinley","year":"2015","journal-title":"Neuron"},{"key":"2025062011055598200_bib31","doi-asserted-by":"publisher","first-page":"ENEURO.0060-21.2022","DOI":"10.1523\/ENEURO.0060-21.2022","article-title":"Alpha EEG activity and pupil diameter coupling during inactive wakefulness in humans","volume":"9","author":"Montefusco-Siegmund","year":"2022","journal-title":"eNeuro"},{"key":"2025062011055598200_bib32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3544549.3585602","article-title":"Improving multiparty interactions with a robot using large language models","volume-title":"Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems","author":"Murali","year":"2023"},{"key":"2025062011055598200_bib33","doi-asserted-by":"publisher","first-page":"2800711","DOI":"10.1109\/JTEHM.2018.2878000","article-title":"An open-source feature extraction tool for the analysis of peripheral physiological data","volume":"6","author":"Nabian","year":"2018","journal-title":"IEEE Journal of Translational Engineering in Health and Medicine"},{"key":"2025062011055598200_bib34","doi-asserted-by":"publisher","first-page":"521","DOI":"10.3389\/fnhum.2018.00521","article-title":"EEG frequency bands in psychiatric disorders: A review of resting state studies","volume":"12","author":"Newson","year":"2019","journal-title":"Frontiers in Human Neuroscience"},{"key":"2025062011055598200_bib35","doi-asserted-by":"publisher","first-page":"614479","DOI":"10.3389\/fphys.2021.614479","article-title":"Pupillometric complexity and symmetricity follow inverted-U curves against baseline diameter due to crossed locus coeruleus projections to the Edinger\u2013Westphal nucleus","volume":"12","author":"Nobukawa","year":"2021","journal-title":"Frontiers in Physiology"},{"key":"2025062011055598200_bib36","doi-asserted-by":"publisher","first-page":"3998","DOI":"10.3390\/s21123998","article-title":"Heart rate variability in psychology: A review of HRV indices and an analysis tutorial","volume":"21","author":"Pham","year":"2021","journal-title":"Sensors"},{"key":"2025062011055598200_bib37","doi-asserted-by":"publisher","first-page":"782","DOI":"10.3758\/s13415-013-0238-7","article-title":"EEG theta\/beta ratio as a potential biomarker for attentional control and resilience against deleterious effects of stress on attention","volume":"14","author":"Putman","year":"2014","journal-title":"Cognitive, Affective, & Behavioral Neuroscience"},{"key":"2025062011055598200_bib38","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.visres.2019.07.001","article-title":"Associations between accommodative dynamics, heart rate variability and behavioural performance during sustained attention: A test\u2013retest study","volume":"163","author":"Redondo","year":"2019","journal-title":"Vision Research"},{"key":"2025062011055598200_bib39","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1080\/08098131.2016.1276097","article-title":"Adolescents' musical relaxation: Understanding related affective processing","volume":"26","author":"Saarikallio","year":"2017","journal-title":"Nordic Journal of Music Therapy"},{"key":"2025062011055598200_bib40","doi-asserted-by":"publisher","first-page":"2911","DOI":"10.3389\/fpsyg.2019.02911","article-title":"Music listening for supporting adolescents' sense of agency in daily life","volume":"10","author":"Saarikallio","year":"2020","journal-title":"Frontiers in Psychology"},{"key":"2025062011055598200_bib41","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/s13612-014-0021-8","article-title":"Adolescents' expression and perception of emotion in music reflects their broader abilities of emotional communication","volume":"4","author":"Saarikallio","year":"2014","journal-title":"Psychology of Well-Being"},{"key":"2025062011055598200_bib42","doi-asserted-by":"publisher","first-page":"1040","DOI":"10.3389\/fpsyg.2014.01040","article-title":"A healthy heart is not a metronome: An integrative review of the heart's anatomy and heart rate variability","volume":"5","author":"Shaffer","year":"2014","journal-title":"Frontiers in Psychology"},{"key":"2025062011055598200_bib43","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1038\/s41398-018-0287-3","article-title":"Music improves social communication and auditory\u2013motor connectivity in children with autism","volume":"8","author":"Sharda","year":"2018","journal-title":"Translational Psychiatry"},{"key":"2025062011055598200_bib44","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1109\/NGCT.2015.7375171","article-title":"Assessing alpha activity in attention and relaxed state: An EEG analysis","volume-title":"2015 1st International Conference on Next Generation Computing Technologies (NGCT)","author":"Sharma","year":"2015"},{"key":"2025062011055598200_bib45","doi-asserted-by":"publisher","first-page":"1815","DOI":"10.1111\/ejn.16002","article-title":"Day-to-day individual alpha frequency variability measured by a mobile EEG device relates to anxiety","volume":"57","author":"Sidelinger","year":"2023","journal-title":"European Journal of Neuroscience"},{"key":"2025062011055598200_bib46","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1016\/j.ijpsycho.2019.06.017","article-title":"Resting heart rate variability, attention and attention maintenance in young adults","volume":"143","author":"Siennicka","year":"2019","journal-title":"International Journal of Psychophysiology"},{"key":"2025062011055598200_bib47","doi-asserted-by":"publisher","first-page":"315","DOI":"10.3102\/00346543050002315","article-title":"Cooperative learning","volume":"50","author":"Slavin","year":"1980","journal-title":"Review of Educational Research"},{"key":"2025062011055598200_bib48","doi-asserted-by":"publisher","first-page":"8569","DOI":"10.1523\/JNEUROSCI.1063-22.2022","article-title":"The theta paradox: 4\u20138 Hz EEG oscillations reflect both sleep pressure and cognitive control","volume":"42","author":"Snipes","year":"2022","journal-title":"Journal of Neuroscience"},{"key":"2025062011055598200_bib49","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2404.06611","article-title":"Modeling social interaction dynamics using temporal graph networks","author":"Taery Kim","year":"2024","journal-title":"arXiv"},{"key":"2025062011055598200_bib50","doi-asserted-by":"publisher","first-page":"638","DOI":"10.3758\/s13415-018-0594-4","article-title":"Tracking arousal state and mind wandering with pupillometry","volume":"18","author":"Unsworth","year":"2018","journal-title":"Cognitive, Affective, & Behavioral Neuroscience"},{"key":"2025062011055598200_bib51","doi-asserted-by":"publisher","first-page":"2005","DOI":"10.3758\/s13423-018-1432-y","article-title":"Pupil dilation as an index of effort in cognitive control tasks: A review","volume":"25","author":"van der Wel","year":"2018","journal-title":"Psychonomic Bulletin & Review"},{"key":"2025062011055598200_bib52","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1038\/s44159-022-00072-w","article-title":"Offline memory consolidation during waking rest","volume":"1","author":"Wamsley","year":"2022","journal-title":"Nature Reviews Psychology"},{"key":"2025062011055598200_bib53","doi-asserted-by":"publisher","first-page":"1617","DOI":"10.1162\/jocn_a_02035","article-title":"Memory consolidation during ultra-short offline states","volume":"35","author":"Wamsley","year":"2023","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2025062011055598200_bib54","doi-asserted-by":"publisher","first-page":"bhae022","DOI":"10.1093\/cercor\/bhae022","article-title":"Effect of cognitive load on time spent offline during wakefulness","volume":"34","author":"Wamsley","year":"2024","journal-title":"Cerebral Cortex"},{"key":"2025062011055598200_bib55","doi-asserted-by":"publisher","first-page":"1714","DOI":"10.1162\/jocn_a_01587","article-title":"Spontaneous entry into an \u201coffline\u201d state during wakefulness: A mechanism of memory consolidation?","volume":"32","author":"Wamsey","year":"2020","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2025062011055598200_bib56","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1038\/s41467-023-44571-7","article-title":"Ramping dynamics and theta oscillations reflect dissociable signatures during rule-guided human behavior","volume":"15","author":"Weber","year":"2024","journal-title":"Nature Communications"},{"key":"2025062011055598200_bib57","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1046\/j.1365-2869.2001.00239.x","article-title":"Daytime variations in central nervous system activation measured by a pupillographic sleepiness test","volume":"10","author":"Wilhelm","year":"2001","journal-title":"Journal of Sleep Research"},{"key":"2025062011055598200_bib58","doi-asserted-by":"publisher","first-page":"247","DOI":"10.55782\/ane-2000-1344","article-title":"Beta activity: A carrier for visual attention","volume":"60","author":"Wr\u00f3bel","year":"2000","journal-title":"Acta Neurobiologiae Experimentalis"},{"key":"2025062011055598200_bib59","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1038\/s41598-020-79816-8","article-title":"Decreased resting-state alpha-band activation and functional connectivity after sleep deprivation","volume":"11","author":"Wu","year":"2021","journal-title":"Scientific Reports"},{"key":"2025062011055598200_bib60","doi-asserted-by":"publisher","first-page":"118072","DOI":"10.1016\/j.neuroimage.2021.118072","article-title":"Brain state-based detection of attentional fluctuations and their modulation","volume":"236","author":"Yamashita","year":"2021","journal-title":"Neuroimage"},{"key":"2025062011055598200_bib61","doi-asserted-by":"publisher","first-page":"754","DOI":"10.1038\/s41593-020-0630-x","article-title":"Within-group synchronization in the prefrontal cortex associates with intergroup conflict","volume":"23","author":"Yang","year":"2020","journal-title":"Nature Neuroscience"},{"key":"2025062011055598200_bib62","doi-asserted-by":"publisher","first-page":"108757","DOI":"10.1016\/j.neuropsychologia.2023.108757","article-title":"Low-frequency variability in theta activity modulates the attention-fluctuation across task and resting states","volume":"193","author":"Yang","year":"2024","journal-title":"Neuropsychologia"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/37\/8\/1364\/2505259\/jocn_a_02315.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/37\/8\/1364\/2505259\/jocn_a_02315.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,20]],"date-time":"2025-06-20T15:06:02Z","timestamp":1750431962000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/37\/8\/1364\/128130\/Internal-State-Estimation-via-Physiological-Data"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025]]},"references-count":62,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2025,8,1]]},"published-print":{"date-parts":[[2025,8,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_02315","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"type":"print","value":"0898-929X"},{"type":"electronic","value":"1530-8898"}],"subject":[],"published-other":{"date-parts":[[2025]]},"published":{"date-parts":[[2025]]}}}