{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T08:50:21Z","timestamp":1791881421937,"version":"4.3.4"},"reference-count":43,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T00:00:00Z","timestamp":1791417600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T00:00:00Z","timestamp":1791417600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Multimodal wearable sensing is increasingly used to quantify audience engagement with short-form video, yet it remains unclear which sensing channels actually carry stimulus-driven information at the exposure durations typical of this format. We recorded electrodermal activity, photoplethysmographic pulse, triaxial acceleration, video-based eye tracking, and automated facial expression analysis from 50 young adults while they viewed 20 short-form influencer clips (5.6\u201319.3 s) presented in individually randomized order, yielding 1000 participant \u00d7 clip trials and 12 primary indices spanning four modalities. Using crossed random-effects variance partitioning, split-half reliability with Spearman\u2013Brown projection, permutation-based multivariate testing, participant-wise decoding, and inter-subject correlation, we show that stimulus-driven variance is strongly channel-specific: it reaches 13.7% for fixation rate and 10.2% for facial engagement but only 0.11% for pulse rate and 0.23% for RMSSD. Clip-level estimates were highly reliable for facial and oculomotor indices (r=0.82\u20130.94) and poor for autonomic indices (r=0.34\u20130.58), which would require 134\u2013370 participants to reach \u03c1=0.80. Between-modality dependence was almost six times weaker than within-modality dependence, and five components were retained by parallel analysis. Oculomotor and facial features jointly identified individual clips at 16.8% balanced accuracy against a 5% chance level, whereas electrodermal and pulse features, taken separately, did not exceed chance. Electrodermal responses were nonetheless stimulus-locked in 18 of 20 clips. A per-second re-analysis of nine channels showed that the ordering partly reverses for within-clip dynamics: tonic electrodermal and pupil time courses were reliable across viewers (\u03c150=0.88 and 0.93), facial time courses were not (\u03c150\u22640.69), and pulse rate was unreliable under both treatments. We derive explicit design guidance for sensor selection and sample size in short-exposure multimodal engagement studies.<\/jats:p>","DOI":"10.3390\/s26196354","type":"journal-article","created":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T16:43:38Z","timestamp":1791564218000},"page":"6354","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Channel-Specific Stimulus Sensitivity, Reliability, and Complementarity of Multimodal Wearable Sensing During Short-Form Influencer Video Exposure"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0272-3275","authenticated-orcid":false,"given":"Carolina","family":"Del-Valle-Soto","sequence":"first","affiliation":[{"name":"Facultad de Ingenier\u00eda, Universidad Panamericana, \u00c1lvaro del Portillo 49, Zapopan 45010, Jalisco, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"resources","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"funding-acquisition","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3410-7693","authenticated-orcid":false,"given":"Violeta","family":"Corona","sequence":"additional","affiliation":[{"name":"Facultad de Ciencias Econ\u00f3micas y Empresariales, Universidad Panamericana, \u00c1lvaro del Portillo 49, Zapopan 45010, Jalisco, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"investigation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"}]},{"given":"Regina","family":"G\u00f3mez Padilla","sequence":"additional","affiliation":[{"name":"Facultad de Ingenier\u00eda, Universidad Panamericana, \u00c1lvaro del Portillo 49, Zapopan 45010, Jalisco, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"investigation","vocabulary":"credit"},{"role":"software","vocabulary":"credit"}]},{"given":"F\u00e1tima Sof\u00eda","family":"Walls Fern\u00e1ndez","sequence":"additional","affiliation":[{"name":"Facultad de Ingenier\u00eda, Universidad Panamericana, \u00c1lvaro del Portillo 49, Zapopan 45010, Jalisco, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"investigation","vocabulary":"credit"},{"role":"software","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7844-3261","authenticated-orcid":false,"given":"Juan-Carlos","family":"L\u00f3pez-Pimentel","sequence":"additional","affiliation":[{"name":"Facultad de Ingenier\u00eda, Universidad Panamericana, \u00c1lvaro del Portillo 49, Zapopan 45010, Jalisco, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8682-5983","authenticated-orcid":false,"given":"Carlos","family":"Mex-Perera","sequence":"additional","affiliation":[{"name":"College of Engineering Technology, Rochester Institute of Technology, One Lomb Memorial Drive, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4058-4042","authenticated-orcid":false,"given":"Paolo","family":"Visconti","sequence":"additional","affiliation":[{"name":"Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"methodology","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4084-1424","authenticated-orcid":false,"given":"Jos\u00e9","family":"Varela-Ald\u00e1s","sequence":"additional","affiliation":[{"name":"Centro de Investigaciones de Ciencias Humanas y de la Educaci\u00f3n (CICHE), Universidad Tecnol\u00f3gica Indoam\u00e9rica, Ambato 180103, Ecuador"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"validation","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"}]}],"member":"1968","published-online":{"date-parts":[[2026,10,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1080\/02650487.2020.1836925","article-title":"The commercialization of social media stars: A literature review and conceptual framework on the strategic use of social media influencers","volume":"40","author":"Hudders","year":"2021","journal-title":"Int. J. Advert."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1080\/15252019.2018.1533501","article-title":"Influencer marketing: How message value and credibility affect consumer trust of branded content on social media","volume":"19","author":"Lou","year":"2019","journal-title":"J. Interact. Advert."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1509\/jmr.13.0593","article-title":"Predicting advertising success beyond traditional measures: New insights from neurophysiological methods and market response modeling","volume":"52","author":"Venkatraman","year":"2015","journal-title":"J. Mark. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"18","DOI":"10.2501\/S0021849906060041","article-title":"How to capture the heart? Reviewing 20 years of emotion measurement in advertising","volume":"46","author":"Poels","year":"2006","journal-title":"J. Advert. Res."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X., and Yang, X. (2018). A review of emotion recognition using physiological signals. Sensors, 18.","DOI":"10.3390\/s18072074"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.entcs.2019.04.009","article-title":"Emotion recognition from physiological signal analysis: A review","volume":"343","author":"Egger","year":"2019","journal-title":"Electron. Notes Theor. Comput. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/T-AFFC.2011.15","article-title":"DEAP: A database for emotion analysis using physiological signals","volume":"3","author":"Koelstra","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/T-AFFC.2011.25","article-title":"A multimodal database for affect recognition and implicit tagging","volume":"3","author":"Soleymani","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Schmidt, P., Reiss, A., Duerichen, R., Marberger, C., and Van Laerhoven, K. (2018, January 16\u201320). Introducing WESAD, a multimodal dataset for wearable stress and affect detection. Proceedings of the 20th ACM International Conference on Multimodal Interaction, Boulder, CO, USA.","DOI":"10.1145\/3242969.3242985"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1364\/BOE.586279","article-title":"POF cardiorespiratory sensor combined with a thermal imaging temperature sensor for multimodal emotion recognition","volume":"17","author":"Bao","year":"2026","journal-title":"Biomed. Opt. Express"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"17263","DOI":"10.1038\/s41598-025-99858-0","article-title":"An ensemble deep learning framework for emotion recognition through wearable devices multi-modal physiological signals","volume":"15","author":"Nandini","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1844","DOI":"10.1038\/s41597-025-05812-0","article-title":"A multimodal stress detection dataset with facial expressions and physiological signals","volume":"12","author":"Hosseini","year":"2025","journal-title":"Sci. Data"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wu, Y., Mi, Q., and Gao, T. (2025). A comprehensive review of multimodal emotion recognition: Techniques, challenges, and future directions. Biomimetics, 10.","DOI":"10.3390\/biomimetics10070418"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Boucsein, W. (2012). Electrodermal Activity, Springer. [2nd ed.].","DOI":"10.1007\/978-1-4614-1126-0"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1017","DOI":"10.1111\/j.1469-8986.2012.01384.x","article-title":"Publication recommendations for electrodermal measurements","volume":"49","author":"Boucsein","year":"2012","journal-title":"Psychophysiology"},{"key":"ref_16","unstructured":"Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology (1996). Heart rate variability: Standards of measurement, physiological interpretation, and clinical use. Circulation, 93, 1043\u20131065."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Shaffer, F., and Ginsberg, J.P. (2017). An overview of heart rate variability metrics and norms. Front. Public Health, 5.","DOI":"10.3389\/fpubh.2017.00258"},{"key":"ref_18","unstructured":"Holmqvist, K., Nystr\u00f6m, M., Andersson, R., Dewhurst, R., Jarodzka, H., and van de Weijer, J. (2011). Eye Tracking: A Comprehensive Guide to Methods and Measures, Oxford University Press."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ekman, P., and Friesen, W.V. (1978). Facial Action Coding System: A Technique for the Measurement of Facial Movement, Consulting Psychologists Press.","DOI":"10.1037\/t27734-000"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.3758\/s13428-017-0935-1","article-title":"The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences","volume":"50","author":"Hedge","year":"2018","journal-title":"Behav. Res. Methods"},{"key":"ref_21","first-page":"378","article-title":"Psychological science needs a standard practice of reporting the reliability of cognitive-behavioral measurements","volume":"2","author":"Parsons","year":"2019","journal-title":"Adv. Methods Pract. Psychol. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1016\/S0022-5371(73)80014-3","article-title":"The language-as-fixed-effect fallacy: A critique of language statistics in psychological research","volume":"12","author":"Clark","year":"1973","journal-title":"J. Verbal Learn. Verbal Behav."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1037\/a0028347","article-title":"Treating stimuli as a random factor in social psychology: A new and comprehensive solution to a pervasive but largely ignored problem","volume":"103","author":"Judd","year":"2012","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1016\/j.jml.2007.12.005","article-title":"Mixed-effects modeling with crossed random effects for subjects and items","volume":"59","author":"Baayen","year":"2008","journal-title":"J. Mem. Lang."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.ijcard.2012.03.119","article-title":"How accurate is pulse rate variability as an estimate of heart rate variability? A review on studies comparing photoplethysmographic technology with an electrocardiogram","volume":"166","author":"Vagedes","year":"2013","journal-title":"Int. J. Cardiol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"07TR01","DOI":"10.1088\/1361-6579\/ab998c","article-title":"Pulse rate variability in cardiovascular health: A review on its applications and relationship with heart rate variability","volume":"41","author":"May","year":"2020","journal-title":"Physiol. Meas."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"McDuff, D., Mahmoud, A., Mavadati, M., Amr, M., Turcot, J., and el Kaliouby, R. (2016, January 7\u201312). AFFDEX SDK: A cross-platform real-time multi-face expression recognition toolkit. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, San Jose, CA, USA.","DOI":"10.1145\/2851581.2890247"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bishay, M., Preston, K., Strafuss, M., Page, G., Turcot, J., and Mavadati, M. (2023, January 5\u20138). AFFDEX 2.0: A real-time facial expression analysis toolkit. Proceedings of the 17th IEEE International Conference on Automatic Face and Gesture Recognition, Waikoloa Beach, HI, USA.","DOI":"10.1109\/FG57933.2023.10042673"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Salvucci, D.D., and Goldberg, J.H. (2000, January 6\u20138). Identifying fixations and saccades in eye-tracking protocols. Proceedings of the 2000 Symposium on Eye Tracking Research and Applications, Palm Beach Gardens, FL, USA.","DOI":"10.1145\/355017.355028"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"16","DOI":"10.5334\/joc.18","article-title":"Pupillometry: Psychology, physiology, and function","volume":"1","year":"2018","journal-title":"J. Cogn."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1111\/j.1469-8986.2008.00654.x","article-title":"The pupil as a measure of emotional arousal and autonomic activation","volume":"45","author":"Bradley","year":"2008","journal-title":"Psychophysiology"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1080\/01621459.1987.10478472","article-title":"Asymptotic properties of maximum likelihood estimators and likelihood ratio tests under nonstandard conditions","volume":"82","author":"Self","year":"1987","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc. B"},{"key":"ref_34","first-page":"32","article-title":"A new method for non-parametric multivariate analysis of variance","volume":"26","author":"Anderson","year":"2001","journal-title":"Austral Ecol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/BF02289447","article-title":"A rationale and test for the number of factors in factor analysis","volume":"30","author":"Horn","year":"1965","journal-title":"Psychometrika"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.neuroimage.2016.10.038","article-title":"Assessing and tuning brain decoders: Cross-validation, caveats, and guidelines","volume":"145","author":"Varoquaux","year":"2017","journal-title":"NeuroImage"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.jneumeth.2015.01.010","article-title":"Exceeding chance level by chance: The caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy","volume":"250","author":"Combrisson","year":"2015","journal-title":"J. Neurosci. Methods"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1634","DOI":"10.1126\/science.1089506","article-title":"Intersubject synchronization of cortical activity during natural vision","volume":"303","author":"Hasson","year":"2004","journal-title":"Science"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"4567","DOI":"10.1038\/ncomms5567","article-title":"Audience preferences are predicted by temporal reliability of neural processing","volume":"5","author":"Dmochowski","year":"2014","journal-title":"Nat. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1093\/jcr\/ucw083","article-title":"A ticket for your thoughts: Method for predicting content recall and sales using neural similarity of moviegoers","volume":"44","author":"Barnett","year":"2017","journal-title":"J. Consum. Res."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"3635","DOI":"10.1098\/rspb.2009.0828","article-title":"Synchronization of spontaneous eyeblinks while viewing video stories","volume":"276","author":"Nakano","year":"2009","journal-title":"Proc. R. Soc. B"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/1529100619832930","article-title":"Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements","volume":"20","author":"Barrett","year":"2019","journal-title":"Psychol. Sci. Public Interest"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Zannettou, S., Nemes-Nemeth, O., Ayalon, O., Goetzen, A., Gummadi, K.P., Redmiles, E.M., and Roesner, F. (2024, January 11\u201316). Analyzing user engagement with TikTok\u2019s short format video recommendations using data donations. Proceedings of the CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3613904.3642433"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/19\/6354\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T08:19:39Z","timestamp":1791879579000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/19\/6354"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,8]]},"references-count":43,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2026,10]]}},"alternative-id":["s26196354"],"URL":"https:\/\/doi.org\/10.3390\/s26196354","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,8]]}}}