{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T06:27:55Z","timestamp":1788848875449,"version":"build-2803163510"},"reference-count":35,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T00:00:00Z","timestamp":1776729600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"The Open Access Publication Fund of TU Berlin paid the APC for this article"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:p>Prior research has reported differential roles of valence and arousal in guiding memory and attention. However, few studies have systematically examined how these affective dimensions interact across their full spectrum in audiovisual contexts, particularly when multiple images varying in emotional content are simultaneously present. To address this, we used a recognition memory paradigm in which participants viewed arrays of images representing all combinations of positive\/negative valence and low\/high arousal. Slightly before and during image presentation, music conveying an emotional tone, also varying in valence and arousal, was played. Memory accuracy was assessed in a later recognition phase. We further employed simple eye-tracking measures to explore how visual attention is influenced by image and music valence and arousal. Results revealed that high image arousal increases fixation duration, whilst high music arousal decreases fixation duration. Memorisation likelihood was not influenced by a four-way interaction of image and music valence and arousal, but mainly by an interaction of image valence and arousal, differently depending on music arousal. In high music arousal, all images except low arousal positive images, were memorised regardless of valence. In low arousal music, we observed that memorisation likelihood was mainly driven by high image arousal, but only paired with negative image valence was memorisation significantly higher compared to other image types. Discrimination accuracy was not observed to be influenced by image valence and arousal, but positive high arousal music significantly improved memory discrimination. By systematically manipulating both valence and arousal of images and music, we highlight how the interaction of these unimodal affective qualities can facilitate or hinder memory.<\/jats:p>","DOI":"10.7717\/peerj.20781","type":"journal-article","created":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T08:04:20Z","timestamp":1776758660000},"page":"e20781","source":"Crossref","is-referenced-by-count":1,"title":["Valence\u2013arousal interactions between images and music: differential effects on memorisation, discrimination, and fixations"],"prefix":"10.7717","volume":"14","author":[{"given":"David","family":"Du Bruyn","sequence":"first","affiliation":[{"name":"Audio Communication Group, Technische Universit\u00e4t Berlin, Berlin, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lena Esther","family":"Ptasczynski","sequence":"additional","affiliation":[{"name":"Berlin School of Mind and Brain, Humboldt Universit\u00e4t Berlin, Berlin, Germany"},{"name":"Department of Psychiatry and Neurosciences, Charit\u00e9-Universit\u00e4tsmedizin, Corporate member of Freie Universit\u00e4t Berlin and Humboldt-Universit\u00e4t zu Berlin, Berlin, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jochen","family":"Steffens","sequence":"additional","affiliation":[{"name":"Audio Communication Group, Technische Universit\u00e4t Berlin, Berlin, Germany"},{"name":"Institute of Sound and Vibration Engineering, Hochschule D\u00fcsseldorf, D\u00fcsseldorf, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"4443","published-online":{"date-parts":[[2026,4,21]]},"reference":[{"issue":"3\u20134","key":"10.7717\/peerj.20781\/ref-1","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1080\/25742442.2022.2087451","article-title":"Cross-modal transfer of valence or arousal from music to word targets in affective priming?","volume":"5","author":"Armitage","year":"2022","journal-title":"Auditory Perception & Cognition"},{"issue":"1","key":"10.7717\/peerj.20781\/ref-2","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.jrp.2005.08.006","article-title":"Valence is a basic building block of emotional life","volume":"40","author":"Barrett","year":"2006","journal-title":"Journal of Research in Personality"},{"key":"10.7717\/peerj.20781\/ref-3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting linear mixed-effects models using lme4","volume":"67","author":"Bates","year":"2015","journal-title":"Journal of Statistical Software"},{"issue":"4","key":"10.7717\/peerj.20781\/ref-4","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1037\/1089-2680.5.4.323","article-title":"Bad is stronger than good","volume":"5","author":"Baumeister","year":"2001","journal-title":"Review of General Psychology"},{"issue":"2","key":"10.7717\/peerj.20781\/ref-5","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1037\/0278-7393.18.2.379","article-title":"Remembering pictures: pleasure and arousal in memory","volume":"18","author":"Bradley","year":"1992","journal-title":"Journal of Experimental Psychology: Learning, Memory, and Cognition"},{"issue":"6","key":"10.7717\/peerj.20781\/ref-6","doi-asserted-by":"publisher","first-page":"929","DOI":"10.1007\/s11031-019-09780-y","article-title":"EmoMadrid: an emotional pictures database for affect research","volume":"43","author":"Carreti\u00e9","year":"2019","journal-title":"Motivation and Emotion"},{"issue":"1","key":"10.7717\/peerj.20781\/ref-7","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1177\/0305735610362821","article-title":"A comparison of the discrete and dimensional models of emotion in music","volume":"39","author":"Eerola","year":"2011","journal-title":"Psychology of Music"},{"issue":"4","key":"10.7717\/peerj.20781\/ref-8","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1037\/a0012887","article-title":"Automatic vigilance for negative words is categorical and general","volume":"8","author":"Estes","year":"2008","journal-title":"Emotion"},{"key":"10.7717\/peerj.20781\/ref-9","doi-asserted-by":"publisher","DOI":"10.32614\/CRAN.package.PupillometryR","article-title":"PupillometryR: an R package for preparing and analysing pupillometry data","author":"Forbes","year":"2020"},{"key":"10.7717\/peerj.20781\/ref-10","doi-asserted-by":"publisher","DOI":"10.32614\/CRAN.package.eyetrackingR","article-title":"eyetrackingR (Version 0.2.1)","author":"Forbes","year":"2023"},{"key":"10.7717\/peerj.20781\/ref-11","article-title":"An R companion to applied regression, third edition","author":"Fox","year":"2019"},{"issue":"1","key":"10.7717\/peerj.20781\/ref-12","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1111\/1467-9280.00406","article-title":"Attending to the big picture: mood and global versus local processing of visual information","volume":"13","author":"Gasper","year":"2002","journal-title":"Psychological Science"},{"issue":"4","key":"10.7717\/peerj.20781\/ref-13","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1111\/2041-210X.12504","article-title":"SIMR: an R package for power analysis of generalized linear mixed models by simulation","volume":"7","author":"Green","year":"2016","journal-title":"Methods in Ecology and Evolution"},{"issue":"7","key":"10.7717\/peerj.20781\/ref-14","doi-asserted-by":"publisher","first-page":"e11739","DOI":"10.1371\/journal.pone.0011739","article-title":"Interplay between affect and arousal in recognition memory","volume":"5","author":"Greene","year":"2010","journal-title":"PLOS ONE"},{"issue":"5","key":"10.7717\/peerj.20781\/ref-15","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1037\/0033-2909.129.5.770","article-title":"Communication of emotions in vocal expression and music performance: different channels, same code?","volume":"129","author":"Juslin","year":"2003","journal-title":"Psychological Bulletin"},{"issue":"4","key":"10.7717\/peerj.20781\/ref-16","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1515\/REVNEURO.2004.15.4.241","article-title":"Remembering emotional experiences: the contribution of valence and arousal","volume":"15","author":"Kensinger","year":"2004","journal-title":"Reviews in the Neurosciences"},{"issue":"2","key":"10.7717\/peerj.20781\/ref-17","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1177\/1754073908100432","article-title":"Remembering the details: effects of emotion","volume":"1","author":"Kensinger","year":"2009","journal-title":"Emotion Review"},{"issue":"9","key":"10.7717\/peerj.20781\/ref-18","doi-asserted-by":"publisher","first-page":"3310","DOI":"10.1073\/pnas.0306408101","article-title":"Two routes to emotional memory: distinct neural processes for valence and arousal","volume":"101","author":"Kensinger","year":"2004","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"2","key":"10.7717\/peerj.20781\/ref-19","doi-asserted-by":"publisher","first-page":"457","DOI":"10.3758\/s13428-016-0715-3","article-title":"Introducing the open affective standardized image set (OASIS)","volume":"49","author":"Kurdi","year":"2017","journal-title":"Behavior Research Methods"},{"key":"10.7717\/peerj.20781\/ref-20","article-title":"International affective picture system (IAPS): affective ratings of pictures and instruction manual","author":"Lang","year":"2005","journal-title":"Technical report No. A-6"},{"key":"10.7717\/peerj.20781\/ref-21","doi-asserted-by":"publisher","DOI":"10.32614\/CRAN.package.emmeans","article-title":"emmeans: estimated marginal means, aka least-squares means (Version 1.8.3)","author":"Lenth","year":"2022"},{"issue":"3","key":"10.7717\/peerj.20781\/ref-22","doi-asserted-by":"publisher","first-page":"618","DOI":"10.1037\/a0025020","article-title":"Cross-modal transfer of arousal, but not pleasantness, from the musical to the visual domain","volume":"12","author":"Marin","year":"2012","journal-title":"Emotion"},{"issue":"1","key":"10.7717\/peerj.20781\/ref-23","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1016\/j.neuroimage.2010.06.015","article-title":"The effect of arousal on the emotional memory network depends on valence","volume":"53","author":"Mickley\u00a0Steinmetz","year":"2010","journal-title":"NeuroImage"},{"key":"10.7717\/peerj.20781\/ref-24","doi-asserted-by":"publisher","first-page":"S35","DOI":"10.1016\/j.paid.2013.07.081","article-title":"Measuring the facets of musicality: the Goldsmiths Musical Sophistication Index (Gold-MSI)","volume":"60","author":"M\u00fcllensiefen","year":"2014","journal-title":"Personality and Individual Differences"},{"key":"10.7717\/peerj.20781\/ref-25","article-title":"R: a language and environment for statistical computing","author":"R\u00a0Core\u00a0Team","year":"2022"},{"issue":"1","key":"10.7717\/peerj.20781\/ref-26","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1037\/a0022588","article-title":"Cross-modal evaluative priming: emotional sounds influence the processing of emotion words","volume":"11","author":"Scherer","year":"2011","journal-title":"Emotion"},{"issue":"3","key":"10.7717\/peerj.20781\/ref-27","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1162\/jocn.2009.21383","article-title":"Affective priming effects of musical sounds on the processing of word meaning","volume":"23","author":"Steinbeis","year":"2011","journal-title":"Journal of Cognitive Neuroscience"},{"issue":"5","key":"10.7717\/peerj.20781\/ref-28","doi-asserted-by":"publisher","first-page":"1824","DOI":"10.1111\/j.1751-9004.2008.00138.x","article-title":"Affective arousal as information: how affective arousal influences judgments, learning, and memory","volume":"2","author":"Storbeck","year":"2008","journal-title":"Social and Personality Psychology Compass"},{"issue":"3","key":"10.7717\/peerj.20781\/ref-29","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1177\/1029864912459046","article-title":"Music-enhanced recall: an effect of mood congruence, emotion arousal or emotion function?","volume":"16","author":"Tesoriero","year":"2012","journal-title":"Musicae Scientiae"},{"issue":"5","key":"10.7717\/peerj.20781\/ref-30","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1027\/1618-3169\/a000045","article-title":"The perceptual nature of the cross-modal priming effect: arguments in favor of a sensory-based conception of memory","volume":"57","author":"Vallet","year":"2010","journal-title":"Experimental Psychology"},{"key":"10.7717\/peerj.20781\/ref-31","article-title":"Saccades: an R package for detecting fixations in raw eye tracking data (Version 0.1)","author":"Von\u00a0der Malsburg","year":"2015"},{"issue":"4","key":"10.7717\/peerj.20781\/ref-32","doi-asserted-by":"publisher","first-page":"1415","DOI":"10.3758\/s13428-018-1027-6","article-title":"Affective auditory stimulus database: an expanded version of the International Affective Digitized Sounds (IADS-E)","volume":"50","author":"Yang","year":"2018","journal-title":"Behavior Research Methods"},{"key":"10.7717\/peerj.20781\/ref-33","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.ijpsycho.2019.03.011","article-title":"Effects of valence and arousal on affective priming vary with the degree of affective experience denoted by words","volume":"140","author":"Yao","year":"2019","journal-title":"International Journal of Psychophysiology"},{"key":"10.7717\/peerj.20781\/ref-34","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.brainres.2012.07.023","article-title":"The interaction of arousal and valence in affective priming: behavioral and electrophysiological evidence","volume":"1474","author":"Zhang","year":"2012","journal-title":"Brain Research"},{"issue":"4","key":"10.7717\/peerj.20781\/ref-35","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1016\/0022-1031(71)90075-8","article-title":"Excitation transfer in communication-mediated aggressive behavior","volume":"7","author":"Zillmann","year":"1971","journal-title":"Journal of Experimental Social Psychology"}],"container-title":["PeerJ"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/peerj.com\/articles\/20781.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/20781.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/20781.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/20781.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T08:04:24Z","timestamp":1776758664000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/articles\/20781"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,21]]},"references-count":35,"alternative-id":["10.7717\/peerj.20781"],"URL":"https:\/\/doi.org\/10.7717\/peerj.20781","archive":["CLOCKSS","LOCKSS","Portico"],"relation":{},"ISSN":["2167-8359"],"issn-type":[{"value":"2167-8359","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,21]]},"article-number":"e20781"}}