{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T06:14:02Z","timestamp":1775024042655,"version":"3.50.1"},"reference-count":57,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T00:00:00Z","timestamp":1774828800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Social Science Fund of China","award":["20ZD09-4"],"award-info":[{"award-number":["20ZD09-4"]}]},{"DOI":"10.13039\/501100019091","name":"Key Research and Development Program of Hunan Province of China","doi-asserted-by":"crossref","award":["2024JK2025"],"award-info":[{"award-number":["2024JK2025"]}],"id":[{"id":"10.13039\/501100019091","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Environmental noise may interfere with the reading experience by increasing cognitive load and psychophysiological arousal, yet these effects are difficult to perceive and communicate in real time. This study presents Reading Noise, an interactive installation that combines physiological sensing and sound-driven visualization to externalize perceived noise-related disturbance and psychophysiological strain during reading. In a controlled experiment, 46 participants completed reading tasks under four levels of background conversational noise (0\u201330, 31\u201360, 61\u201390, and &gt;90 dB) while ambient sound level, electrodermal activity (EDA), and electrocardiogram (ECG) were recorded in real time. Following data quality screening, inferential statistical analyses were performed on the analyzable physiological subset (n = 16). Based on these data, a hybrid mapping strategy combining rule-based assignment and LMM-informed exploratory calibration was developed to map acoustic and physiological changes onto dynamic text-based visual parameters, including deformation intensity, jitter, and motion instability, for real-time feedback. Within the analyzable subset, noise level was associated with significant changes in the recorded physiological indicators (all p &lt; 0.05): skin conductance level (SCL) and skin conductance responses per minute (SCRs\/min) increased (4.69 \u00b1 2.13 to 5.93 \u00b1 2.19 \u03bcS; 1.49 \u00b1 1.59 to 2.51 \u00b1 2.13), whereas the percentage of successive RR intervals differing by more than 50 ms (pNN50) and the root mean square of successive differences (RMSSD) decreased (15.84 \u00b1 16.52% to 10.57 \u00b1 11.35%; 36.63 \u00b1 17.62 to 29.67 \u00b1 16.66 ms). Subjective cognitive load also increased significantly (2.06 \u00b1 0.29 to 6.38 \u00b1 0.31). A follow-up installation study with 24 cross-disciplinary participants, with reported group interaction observations drawn from a 12-participant subset, suggested that the installation may facilitate shared interpretation of attention-related disruption and cognitive strain, indicating the potential of physiology-informed visual translation as a boundary object approach for empathetic, sound-mediated communication.<\/jats:p>","DOI":"10.3390\/mti10040035","type":"journal-article","created":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T12:11:44Z","timestamp":1774872704000},"page":"35","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Reading Noise: Integrating Physiological Sensing and Sound-Driven Visualization to Externalize Noise-Related Cognitive Disruption During Reading"],"prefix":"10.3390","volume":"10","author":[{"given":"Xueyi","family":"Li","sequence":"first","affiliation":[{"name":"School of Design, Hunan University, Yuelu Mountain, Changsha 410082, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yonghong","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Design, Hunan University, Yuelu Mountain, Changsha 410082, China"},{"name":"Innovation Institute of Industrial Design and Machine Intelligence, Hunan University, Quanzhou 362006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zihui","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Design, Hunan University, Yuelu Mountain, Changsha 410082, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yangcheng","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Design, Hunan University, Yuelu Mountain, Changsha 410082, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1044\/2020_JSLHR-20-00376","article-title":"Effects of background noise on speech and language in young adults","volume":"64","author":"Harmon","year":"2021","journal-title":"J. Speech Lang. Hear. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/20445911.2024.2314974","article-title":"Emerging perspectives on distraction and task interruptions: Metacognition, cognitive control and facilitation\u2014Part I","volume":"36","author":"Marsh","year":"2024","journal-title":"J. Cogn. Psychol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1080\/00140139.2020.1854352","article-title":"Effects of background noise and extraversion on reading comprehension performance","volume":"64","author":"Gheewalla","year":"2021","journal-title":"Ergonomics"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"103836","DOI":"10.1016\/j.autcon.2021.103836","article-title":"The effect of noise content and level on cognitive performance measured by electroencephalography (EEG)","volume":"130","author":"Ke","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1177\/0013916520950277","article-title":"Learning in noisy classrooms: Children\u2019s reports of annoyance and distraction from noise are associated with individual differences in mind-wandering and switching skills","volume":"54","author":"Frasseto","year":"2022","journal-title":"Environ. Behav."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"32635","DOI":"10.1038\/s41598-025-03052-1","article-title":"Using eye movements, electrodermal activities, and heart rates to predict different types of cognitive load during reading with background music","volume":"15","author":"Que","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zdorova, N., Malyutina, S., Laurinavichyute, A., Kaprielova, A., Ziubanova, A., and Lopukhina, A. (2023). Do we rely on good-enough processing in reading under auditory and visual noise?. PLoS ONE, 18.","DOI":"10.1371\/journal.pone.0277429"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1080\/14626268.2016.1250012","article-title":"Sonic boundary objects: Negotiating disability, technology and simulation","volume":"27","author":"Grond","year":"2016","journal-title":"Digit. Creat."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Delle Monache, S., Misdariis, N., and Ozcan, E. (2021, January 22\u201323). Conceptualising sound-driven design: An exploratory discourse analysis. Proceedings of the 13th Conference on Creativity and Cognition, Venice, Italy.","DOI":"10.1145\/3450741.3465258"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bostan, I., van Egmond, R., Gommers, D., and \u00d6zcan, E. (2024, January 23\u201328). ICU alarm management reimagined: Sound-driven design and the role of acoustic biotope. Proceedings of the DRS2024, Boston, MA, USA.","DOI":"10.21606\/drs.2024.553"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"109179","DOI":"10.1016\/j.apacoust.2022.109179","article-title":"An online survey on self-reported workplace design and personal factors concerning speech privacy satisfaction in open-plan office environment","volume":"202","author":"Lee","year":"2023","journal-title":"Appl. Acoust."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.specom.2017.02.001","article-title":"Effects of noise on arousal in a speech communication setting","volume":"88","author":"Kechichian","year":"2017","journal-title":"Speech Commun."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mattys, S.L., O\u2019Leary, R.M., McGarrigle, R.A., and Wingfield, A. (Trends Cogn. Sci., 2025). Reconceptualizing cognitive listening, Trends Cogn. Sci., in press.","DOI":"10.1016\/j.tics.2025.09.014"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"199","DOI":"10.4103\/nah.nah_34_22","article-title":"Quantifying the effect of noise on cognitive processes: A review of psychophysiological correlates of workload","volume":"24","author":"Grenzebach","year":"2022","journal-title":"Noise Health"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Orru, G., and Longo, L. (2018, January 20\u201321). The evolution of cognitive load theory and the measurement of its intrinsic, extraneous and germane loads: A review. Proceedings of the International Symposium on Human Mental Workload: Models and Applications, Rome, Italy.","DOI":"10.1007\/978-3-030-14273-5_3"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1080\/25742442.2023.2274270","article-title":"Psychophysiological markers of auditory distraction: A scoping review","volume":"7","author":"Marois","year":"2024","journal-title":"Aud. Percept. Cogn."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1080\/10447318.2025.2505778","article-title":"Examining the effect of background music on learners\u2019 attention and cognition in virtual reality environments: A psychophysiological study","volume":"42","author":"Que","year":"2026","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fan, Y., Liang, J., Cao, X., Pang, L., and Zhang, J. (2022). Effects of noise exposure and mental workload on physiological responses during task execution. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph191912434"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1080\/00140139.2022.2104381","article-title":"Mental workload variations during different cognitive office tasks with social media interruptions","volume":"66","author":"Zhang","year":"2023","journal-title":"Ergonomics"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Horvers, A., Tombeng, N., Bosse, T., Lazonder, A.W., and Molenaar, I. (2021). Detecting emotions through electrodermal activity in learning contexts: A systematic review. Sensors, 21.","DOI":"10.3390\/s21237869"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"103328","DOI":"10.1016\/j.aei.2025.103328","article-title":"Evaluation of cognitive load and user experience in alternative interaction modes under different noise degrees","volume":"65","author":"Xie","year":"2025","journal-title":"Adv. Eng. Inform."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"e37494","DOI":"10.1016\/j.heliyon.2024.e37494","article-title":"User interface design in mobile learning applications: Developing and evaluating a questionnaire for measuring learners\u2019 extraneous cognitive load","volume":"10","author":"Faudzi","year":"2024","journal-title":"Heliyon"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"101134","DOI":"10.1016\/j.destud.2022.101134","article-title":"Semantic models of sound-driven design: Designing with listening in mind","volume":"83","author":"Misdariis","year":"2022","journal-title":"Des. Stud."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/14626268.2024.2428920","article-title":"Soundscape fiction: Designing and situating sonic design fiction to stimulate the imagination","volume":"36","author":"Chung","year":"2025","journal-title":"Digit. Creat."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1177\/030631289019003001","article-title":"Institutional ecology, \u2018translations\u2019 and boundary objects: Amateurs and professionals in Berkeley\u2019s Museum of Vertebrate Zoology, 1907\u20131939","volume":"19","author":"Star","year":"1989","journal-title":"Soc. Stud. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Klein, J.T. (2021). Beyond Interdisciplinarity: Boundary Work, Communication, and Collaboration, Oxford University Press.","DOI":"10.1093\/oso\/9780197571149.001.0001"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yoo, M., Odom, W., Berger, A., Barnett, S., Kenny, S., and Lo, P. (2024, January 11\u201316). Remembering through sound: Co-creating sound-based mementos together with people with blindness. Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3613904.3641940"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e31167","DOI":"10.2196\/31167","article-title":"Boundary objects as dialogical learning accelerators for social change in design for health: Systematic review","volume":"9","author":"Terlouw","year":"2022","journal-title":"JMIR Hum. Factors"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1080\/08873631.2021.1999007","article-title":"Exploring Indigenization and decolonization in cross-cultural education through collaborative land-based boundary education","volume":"39","author":"Zurba","year":"2022","journal-title":"J. Cult. Geogr."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chen, X., and Ibrahim, Z. (2023). A comprehensive study of emotional responses in AI-enhanced interactive installation art. Sustainability, 15.","DOI":"10.3390\/su152215830"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Guastavino, C., Fraisse, V., D\u2019Ambrosio, S., Legast, E., and Lavoie, M. (2022). Designing sound installations in public spaces: A collaborative research-creation approach. Designing Interactions for Music and Sound, Focal Press.","DOI":"10.5040\/9780367691370.ch-005"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1080\/23748834.2019.1585133","article-title":"Acoustic sustainability in urban design: Lessons from the World Soundscape Project","volume":"5","author":"Truax","year":"2021","journal-title":"Cities Health"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/TMM.2016.2521348","article-title":"Predicting the performance in decision-making tasks: From individual cues to group interaction","volume":"18","author":"Avci","year":"2016","journal-title":"IEEE Trans. Multimed."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Stanley, M. (2023). Qualitative descriptive: A very good place to start. Qualitative Research Methodologies for Occupational Science and Occupational Therapy, Routledge.","DOI":"10.4324\/9781003456216-4"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Boffet, A., Arsac, L.-M., Ibanez, V., Sauvet, F., and Deschodt-Arsac, V. (2025). Detection of cognitive load modulation by EDA and HRV. Sensors, 25.","DOI":"10.3390\/s25082343"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Lin, Y.D., Tan, Y.K., Ku, T., and Tian, B. (2023). A frequency estimation scheme based on Gaussian average filtering decomposition and Hilbert transform: With estimation of respiratory rate as an example. Sensors, 23.","DOI":"10.3390\/s23083785"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Maduro, P.A., Maduro, L.A.R., Lima, P.E., Silva, A.C.C., Silva, R.D.C.M.D., Rocha, A.S.L., Ribeiro, M.J.S., Matoso, J.M.D., Gambassi, B.B., and Schwingel, P.A. (2025). Cardiac autonomic modulation and cognitive performance in community-dwelling older adults: A preliminary study. Neurol. Int., 17.","DOI":"10.3390\/neurolint17050074"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.enfie.2020.02.004","article-title":"Comparative analysis of environmental noise levels in two paediatric intensive care units","volume":"32","year":"2021","journal-title":"Enferm. Intensiva (Engl. Ed.)"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1080\/10400419.2022.2123139","article-title":"Scaling the creative self: An item response theory analysis of the short scale of creative self","volume":"34","author":"Lebuda","year":"2022","journal-title":"Creat. Res. J."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Tsirmpas, C., Konstantopoulos, S., Andrikopoulos, D., Kyriakouli, K., and Fatouros, P. (2025). Transformer-based decomposition of electrodermal activity for real-world mental health applications. Sensors, 25.","DOI":"10.3390\/s25144406"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1039","DOI":"10.1080\/02699931.2021.1906209","article-title":"Covariate effects of resting heart rate variability on affective ratings and startle reflex during cognitive reappraisal of negative emotions","volume":"35","author":"Jaen","year":"2021","journal-title":"Cogn. Emot."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhang, J., Pang, L., Yang, C., Fan, Y., Zhao, B., and Cao, X. (2024). Experimental evaluation of noise exposure effects on subjective perceptions and cognitive performance. Buildings, 14.","DOI":"10.3390\/buildings14041100"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1080\/00140139.2021.2003872","article-title":"Interactive effects of task load and music tempo on psychological, psychophysiological, and behavioural outcomes during simulated driving","volume":"65","author":"Karageorghis","year":"2022","journal-title":"Ergonomics"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"101819","DOI":"10.1016\/j.jenvp.2022.101819","article-title":"Acute stress effects of impulsive noise during mental work","volume":"81","author":"Radun","year":"2022","journal-title":"J. Environ. Psychol."},{"key":"ref_45","first-page":"139","article-title":"Distraction by auditory categorical deviations is unrelated to working memory capacity: Further evidence of a distinction between acoustic and categorical deviation effects","volume":"4","author":"Marsh","year":"2022","journal-title":"Aud. Percept. Cogn."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"102423","DOI":"10.1016\/j.lindif.2024.102423","article-title":"Cognitive load theory and individual differences","volume":"110","author":"Sweller","year":"2024","journal-title":"Learn. Individ. Differ."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1080\/14613808.2025.2484195","article-title":"Developing communicative competencies in children with functional diversity through music technology: A posthuman perspective","volume":"27","author":"Cheng","year":"2025","journal-title":"Music Educ. Res."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Che, M., Li, H., Chen, Z., Li, Q., and Kim, N. (2025). Voice-interactive 2D serious game with three-tier scaffolding for teaching acoustics in primary schools: A randomized comparison of knowledge, motivation, and cognitive load. Appl. Sci., 15.","DOI":"10.3390\/app152111761"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Liu, W., Dementyev, A., Schwarz, D., Flety, E., Mackay, W.E., Beaudouin-Lafon, M., and Bevilacqua, F. (2021, January 8\u201313). Sonichoop: Using interactive sonification to support aerial hoop practices. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445539"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Burns-O\u2019Connell, G., Stockdale, D., Cassidy, O., Knowles, V., and Hoare, D.J. (2021). Surrounded by sound: The impact of tinnitus on musicians. Int. J. Environ. Res. Public Health, 18.","DOI":"10.3390\/ijerph18179036"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Dolan, E.I., MacGregor, E., and Schwartz, A. (2025). Sonic Circulations: Music, Modernism, and the Politics of Knowledge, University of Pennsylvania Press.","DOI":"10.9783\/9781512828047"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Jing, A., Frederick, M., Sewell, M., Karlson, A., Simpson, B., and Smith, M. (2023, January 16\u201320). How visualising emotions affects interpersonal trust and task collaboration in a shared virtual space. Proceedings of the 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Sydney, NSW, Australia.","DOI":"10.1109\/ISMAR59233.2023.00100"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Arslan, E.E., Ak\u015fahin, M.F., Yilmaz, M., and Ilg\u0131n, H.E. (2024). Towards emotionally intelligent virtual environments: Classifying emotions through a biosignal-based approach. Appl. Sci., 14.","DOI":"10.3390\/app14198769"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1080\/02699931.2023.2229545","article-title":"How nervous am I? How computer vision succeeds and humans fail in interpreting state anxiety from dynamic facial behaviour","volume":"37","author":"Kuipers","year":"2023","journal-title":"Cogn. Emot."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Delle Monache, S., Moleman, R., and Ozcan, E. (2024, January 18\u201320). Soundstorm, a collaborative ideation game for sound-driven design. Proceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures, Milan, Italy.","DOI":"10.1145\/3678299.3678348"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Shen, H., Hao, M., Ren, J., Chen, K., and Gao, Y. (2025). Experimental study on the effects of cockpit noise on physiological indicators of pilots. Sensors, 25.","DOI":"10.3390\/s25134175"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/00140139.2025.2511877","article-title":"Recognising and explaining mental workload using low-interference method by fusing speech, ECG and eye tracking signals during simulated flight","volume":"6","author":"Xu","year":"2025","journal-title":"Ergonomics"}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/10\/4\/35\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T04:14:37Z","timestamp":1775016877000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/10\/4\/35"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,30]]},"references-count":57,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,4]]}},"alternative-id":["mti10040035"],"URL":"https:\/\/doi.org\/10.3390\/mti10040035","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,30]]}}}