{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"bioRxiv"}],"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T05:52:42Z","timestamp":1782280362299,"version":"3.54.5"},"posted":{"date-parts":[[2025,6,3]]},"group-title":"Animal Behavior and Cognition","reference-count":37,"publisher":"openRxiv","license":[{"start":{"date-parts":[[2025,6,3]],"date-time":"2025-06-03T00:00:00Z","timestamp":1748908800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"crossref","award":["R01MH129641"],"award-info":[{"award-number":["R01MH129641"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2025,6,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                <jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Distractibility and attentiveness are cognitive states that are expressed through observable behavior. The effective use of behavior observed in videos to diagnose periods of distractibility and attentiveness is still not well understood. Video-based tools for classifying cognitive states from behavior have high potential to serve as versatile diagnostic indicators of maladaptive cognition.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>New method<\/jats:title>\n                  <jats:p>We describe an analysis pipeline that classifies cognitive states using a 2-camera set-up for video-based estimation of attentiveness and screen engagement in nonhuman primates performing cognitive tasks. The procedure reconstructs 3D poses from 2D labeled DeepLabCut videos, reconstructs the head\/yaw orientation relative to a task screen, and arm\/hand\/wrist engagements with task objects, to segment behavior into an attentiveness and engagement score.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Performance of different cognitive tasks were robustly classified from video within a few frames, reaching &gt;90% decoding accuracy with \u22643min time segments. The analysis procedure allows setting subject-specific thresholds for segmenting subject specific movements for a time-resolved scoring of attentiveness and screen engagement.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Comparison with existing methods<\/jats:title>\n                  <jats:p>Current methods also extract poses and segment action units; however, they haven\u2019t been combined into a framework that enables subject-adjusted thresholding for specific task contexts. This integration is needed for inferring cognitive state variables and differentiating performance across various tasks.<\/jats:p>\n                <\/jats:sec>\n                <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>The proposed method integrates video segmentation, scoring of attentiveness and screen engagement, and classification of task performance at high temporal resolution. This integrated framework provides a tool for assessing attention functions from video.<\/jats:p>\n                <\/jats:sec>","DOI":"10.1101\/2025.05.31.657183","type":"posted-content","created":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T05:25:20Z","timestamp":1749014720000},"source":"Crossref","is-referenced-by-count":0,"title":["Assessing Attentiveness and Cognitive Engagement across Tasks using Video-based Action Understanding in Non-Human Primates"],"prefix":"10.64898","author":[{"given":"Sin-Man","family":"Cheung","sequence":"first","affiliation":[{"name":"Dep. of Psychology, Vanderbilt University, Nashville, TN 37240"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam","family":"Neumann","sequence":"additional","affiliation":[{"name":"Dep. of Psychology, Vanderbilt University, Nashville, TN 37240"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6921-4187","authenticated-orcid":false,"given":"Thilo","family":"Womelsdorf","sequence":"additional","affiliation":[{"name":"Dep. of Psychology, Vanderbilt University, Nashville, TN 37240"},{"name":"Vanderbilt Brain Institute Vanderbilt University, Nashville, TN 37240"},{"name":"Dep. of Biomedical Engineering, Vanderbilt University, Nashville, TN 37240"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"54368","reference":[{"key":"2026041200540885000_2025.05.31.657183v1.1","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-019-05430-w"},{"key":"2026041200540885000_2025.05.31.657183v1.2","doi-asserted-by":"crossref","unstructured":"Bain M , Nagrani A , Schofield D , Berdugo S , Bessa J , Owen J , Hockings KJ , Matsuzawa T , Hayashi M , Biro D , Carvalho S , Zisserman A (2021) Automated audiovisual behavior recognition in wild primates. Science Advances 7.","DOI":"10.1126\/sciadv.abi4883"},{"key":"2026041200540885000_2025.05.31.657183v1.3","doi-asserted-by":"crossref","unstructured":"Bala PC , Eisenreich BR , Yoo SBM , Hayden BY , Park HS , Zimmermann J (2020) Automated markerless pose estimation in freely moving macaques with OpenMonkeyStudio. Nature Communications 11.","DOI":"10.1038\/s41467-020-18441-5"},{"key":"2026041200540885000_2025.05.31.657183v1.4","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-024-02319-1"},{"key":"2026041200540885000_2025.05.31.657183v1.5","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"2026041200540885000_2025.05.31.657183v1.6","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-024-02003-z"},{"key":"2026041200540885000_2025.05.31.657183v1.7","doi-asserted-by":"crossref","unstructured":"Fuermaier ABM , Tucha L , Guo N , Mette C , Muller BW , Scherbaum N , Tucha O (2022) It Takes Time: Vigilance and Sustained Attention Assessment in Adults with ADHD. Int J Environ Res Public Health 19.","DOI":"10.3390\/ijerph19095216"},{"key":"2026041200540885000_2025.05.31.657183v1.8","doi-asserted-by":"publisher","DOI":"10.1017\/S1092852922000785"},{"key":"2026041200540885000_2025.05.31.657183v1.9","doi-asserted-by":"publisher","DOI":"10.2307\/2346830"},{"key":"2026041200540885000_2025.05.31.657183v1.10","doi-asserted-by":"publisher","DOI":"10.1016\/j.bpsgos.2021.11.012"},{"key":"2026041200540885000_2025.05.31.657183v1.11","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46466-4_3"},{"key":"2026041200540885000_2025.05.31.657183v1.12","doi-asserted-by":"crossref","unstructured":"Kane GA , Lopes G , Saunders JL , Mathis A , Mathis MW (2020) Real-time, low-latency closed-loop feedback using markerless posture tracking. Elife 9.","DOI":"10.7554\/eLife.61909"},{"key":"2026041200540885000_2025.05.31.657183v1.13","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0059785"},{"key":"2026041200540885000_2025.05.31.657183v1.14","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2021.10.031"},{"key":"2026041200540885000_2025.05.31.657183v1.15","first-page":"581154","article-title":"MacaquePose: A Novel \u201cIn the Wild\u201d Macaque Monkey Pose Dataset for Markerless Motion Capture","volume":"14","year":"2020","journal-title":"Front Behav Neurosci"},{"key":"2026041200540885000_2025.05.31.657183v1.16","doi-asserted-by":"publisher","DOI":"10.24272\/j.issn.2095-8137.2022.449"},{"key":"2026041200540885000_2025.05.31.657183v1.17","doi-asserted-by":"crossref","unstructured":"Liu Y , Wang M , Hou S , Wang X , Shi B (2025) Deep Learning-Based Markerless Hand Tracking for Freely Moving Non-Human Primates in Brain\u2013Machine Interface Applications. Electronics 14.","DOI":"10.3390\/electronics14050920"},{"key":"2026041200540885000_2025.05.31.657183v1.18","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2022.02.002"},{"key":"2026041200540885000_2025.05.31.657183v1.19","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2020.11.016"},{"key":"2026041200540885000_2025.05.31.657183v1.20","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-018-0209-y"},{"key":"2026041200540885000_2025.05.31.657183v1.21","doi-asserted-by":"publisher","DOI":"10.1038\/nrd3628"},{"key":"2026041200540885000_2025.05.31.657183v1.22","doi-asserted-by":"crossref","unstructured":"North R , Wurr R , Macon R , Mannion C , Hyde J , Torres-Espin A , Rosenzweig ES , Ferguson AR , Tuszynski MH , Beattie MS , Bresnahan JC (2021) Quantifying the kinematic features of dexterous finger movements in nonhuman primates with markerless tracking. 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) 6110\u20136115.","DOI":"10.1109\/EMBC46164.2021.9630018"},{"key":"2026041200540885000_2025.05.31.657183v1.23","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-020-0688-5"},{"key":"2026041200540885000_2025.05.31.657183v1.24","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-022-01426-1"},{"key":"2026041200540885000_2025.05.31.657183v1.25","doi-asserted-by":"publisher","DOI":"10.1038\/nrn.2015.30"},{"key":"2026041200540885000_2025.05.31.657183v1.26","doi-asserted-by":"crossref","first-page":"39","DOI":"10.3389\/fnbeh.2019.00039","article-title":"Non-invasive Eye Tracking Methods for New World and Old World Monkeys","volume":"13","year":"2019","journal-title":"Front Behav Neurosci"},{"key":"2026041200540885000_2025.05.31.657183v1.27","doi-asserted-by":"publisher","DOI":"10.1038\/s42003-021-01654-9"},{"key":"2026041200540885000_2025.05.31.657183v1.28","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2412954122"},{"key":"2026041200540885000_2025.05.31.657183v1.29","doi-asserted-by":"crossref","unstructured":"Vogg R , Luddecke T , Henrich J , Dey S , Nuske M , Hassler V , Murphy D , Fischer J , Ostner J , Schulke O , Kappeler PM , Fichtel C , Gail A , Treue S , Scherberger H , Worgotter F , Ecker AS (2025) Computer vision for primate behavior analysis in the wild. Nat Methods.","DOI":"10.1038\/s41592-025-02653-y"},{"key":"2026041200540885000_2025.05.31.657183v1.30","doi-asserted-by":"crossref","unstructured":"Voloh B , Maisson DJN , Cervera RL , Conover I , Zambre M , Hayden B , Zimmermann J (2023) Hierarchical action encoding in prefrontal cortex of freely moving macaques. Cell Reports 42.","DOI":"10.1016\/j.celrep.2023.113091"},{"key":"2026041200540885000_2025.05.31.657183v1.31","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-018-1097-5"},{"key":"2026041200540885000_2025.05.31.657183v1.32","doi-asserted-by":"crossref","unstructured":"Watson MR , Traczewski N , Dunghana S , Boroujeni KB , Neumann A , Wen X , Womelsdorf T (2023) A Multi-task Platform for Profiling Cognitive and Motivational Constructs in Humans and Nonhuman Primates. bioRxiv.","DOI":"10.1101\/2023.11.09.566422"},{"key":"2026041200540885000_2025.05.31.657183v1.33","doi-asserted-by":"crossref","unstructured":"Wei SE , Ramakrishna V , Kanade T , Sheikh Y (2016) Convolutional Pose Machines. Proc Cvpr Ieee:4724\u20134732.","DOI":"10.1109\/CVPR.2016.511"},{"key":"2026041200540885000_2025.05.31.657183v1.34","doi-asserted-by":"publisher","DOI":"10.1101\/2024.11.24.625056"},{"key":"2026041200540885000_2025.05.31.657183v1.35","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-020-00706-3"},{"key":"2026041200540885000_2025.05.31.657183v1.36","doi-asserted-by":"publisher","DOI":"10.3389\/fnbeh.2021.721069"},{"key":"2026041200540885000_2025.05.31.657183v1.37","unstructured":"Xing F , Sheffield AG , Jadi MP , Chang SWC , Nandy AS (2024) Automated 3D analysis of social head-gaze behaviors in freely moving marmosets. BioRxiv."}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1101\/2025.05.31.657183","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T05:01:36Z","timestamp":1782277296000},"score":1,"resource":{"primary":{"URL":"http:\/\/biorxiv.org\/lookup\/doi\/10.1101\/2025.05.31.657183"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,3]]},"references-count":37,"URL":"https:\/\/doi.org\/10.1101\/2025.05.31.657183","relation":{"is-preprint-of":[{"id-type":"doi","id":"10.1016\/j.jneumeth.2025.110597","asserted-by":"subject"}]},"subject":[],"published":{"date-parts":[[2025,6,3]]},"subtype":"preprint"}}