{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T16:28:22Z","timestamp":1769272102641,"version":"3.49.0"},"reference-count":27,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T00:00:00Z","timestamp":1769126400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Interactive multimedia art installations in public spaces are evolving with the integration of real-time (RT) digital control and visualization technologies, enabling dynamic and immersive user experiences. These installations transform urban environments into responsive, participatory spaces through audiovisual interactivity. However, existing methods often face limitations such as inflexible architectures, latency in data processing, and challenges in real-time synchronizing multimodal inputs and outputs. These issues hinder scalability and reduce the creative possibilities of interactive systems in public settings.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This study proposes a Node-based Real-Time Multimedia Architecture using Max\/MSP and (TD) Touch Designer (MAX\/MSP-TD) to address these challenges. The framework leverages the strengths of visual programming environments, allowing seamless integration of real-time sensor data, audio analysis, and generative visuals through modular and reusable components. The proposed method is applied in an urban installation where sound and movement data from the public are captured and translated into interactive light and sound projections in real time. This encourages public engagement and offers a platform for creative expression within the built environment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Findings show that the MAX\/MSP-TD framework significantly improves system responsiveness, flexibility, and scalability while enhancing user interaction and artistic control in public multimedia installations.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.7717\/peerj-cs.3384","type":"journal-article","created":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T08:00:21Z","timestamp":1769155221000},"page":"e3384","source":"Crossref","is-referenced-by-count":0,"title":["Computational frameworks for interactive multimedia art installations in public spaces using real time digital control and visualization"],"prefix":"10.7717","volume":"12","author":[{"given":"Yeheng","family":"Liu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaxi","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"4443","published-online":{"date-parts":[[2026,1,23]]},"reference":[{"key":"10.7717\/peerj-cs.3384\/ref-1","first-page":"1","article-title":"Dynamic classification models for human\u2013machine improvisation and composition.","author":"Borg","year":"2020"},{"key":"10.7717\/peerj-cs.3384\/ref-2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2111.09931","article-title":"DawDreamer: bridging the gap between digital audio workstations and Python interfaces","author":"Braun","year":"2021"},{"key":"10.7717\/peerj-cs.3384\/ref-3","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.10825647","article-title":"Evolution of the web audio modules ecosystem","author":"Buffa","year":"2024"},{"issue":"24","key":"10.7717\/peerj-cs.3384\/ref-4","first-page":"12","article-title":"Spat~: a comprehensive toolbox for sound spatialization in Max","volume":"13","author":"Carpentier","year":"2021","journal-title":"Ideas S\u00f3nicas"},{"key":"10.7717\/peerj-cs.3384\/ref-5","article-title":"Rage against the glue: beyond run-time media frameworks with modern C++","author":"Celerier","year":"2022"},{"key":"10.7717\/peerj-cs.3384\/ref-6","article-title":"Developing a multimedia interface for electrical biosignal interpretation","author":"Cox","year":"2021"},{"key":"10.7717\/peerj-cs.3384\/ref-7","first-page":"5","article-title":"Collaborative music creation and performance with Soundcool online","author":"Dannenberg","year":"2021"},{"key":"10.7717\/peerj-cs.3384\/ref-8","article-title":"Scheduling musical events in Max\/MSP with scheme for Max","volume-title":"Scheme and Functional Programming Workshop 2021","author":"Duncan","year":"2021"},{"key":"10.7717\/peerj-cs.3384\/ref-9","volume-title":"PnP maxtools: autonomous parameter control in MaxMSP utilizing MIR algorithms","author":"Franklin","year":"2023"},{"key":"10.7717\/peerj-cs.3384\/ref-10","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.6767566","article-title":"Korypha\u00eeos: a patchworked compositional environment for distributed music systems","author":"Golvet","year":"2022"},{"key":"10.7717\/peerj-cs.3384\/ref-11","first-page":"1","article-title":"The binaural rendering toolbox. A virtual laboratory for reproducible research in psychoacoustics","volume-title":"Forum Acusticum","author":"Gonz\u00e1lez-Toledo","year":"2023"},{"key":"10.7717\/peerj-cs.3384\/ref-12","first-page":"379","article-title":"Jacdac-for-Max: plug-and-play physical prototyping of musical interfaces","author":"Hartley","year":"2023"},{"key":"10.7717\/peerj-cs.3384\/ref-13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3623509.3633356","article-title":"Innermost echoes: integrating real-time physiology into live music performances","author":"Hynds","year":"2024"},{"issue":"3","key":"10.7717\/peerj-cs.3384\/ref-14","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1007\/s12193-020-00334-y","article-title":"Multisensory instrumental dynamics as an emergent paradigm for digital musical creation: a retrospective and prospective of haptic-audio creation with physical models","volume":"14","author":"Leonard","year":"2020","journal-title":"Journal on Multimodal User Interfaces"},{"key":"10.7717\/peerj-cs.3384\/ref-15","doi-asserted-by":"publisher","first-page":"25","DOI":"10.5281\/zenodo.4278287","article-title":"WebAudioXML: proposing a new standard for structuring web audio","volume-title":"Proceedings of the Sound and Music Computing Conference (SMC 2020), Torino, Italy","author":"Lindetorp","year":"2020"},{"key":"10.7717\/peerj-cs.3384\/ref-16","first-page":"673","article-title":"MarsyasX: multimedia dataflow processing with implicit patching","volume-title":"Proceedings of the 22nd ACM International Conference on Multimedia (ACM MM), Orlando, FL, USA","author":"Martins","year":"2014"},{"key":"10.7717\/peerj-cs.3384\/ref-17","first-page":"598","article-title":"Sonic touch: a haptic toolkit for fast vibrotactile prototyping","author":"Ronen","year":"2024"},{"issue":"1","key":"10.7717\/peerj-cs.3384\/ref-18","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1080\/09298215.2020.1714666","article-title":"Concordia: a musical XR instrument for playing the solar system","volume":"49","author":"Snook","year":"2020","journal-title":"Journal of New Music Research"},{"key":"10.7717\/peerj-cs.3384\/ref-19","article-title":"Towards new analysis and visualization software for studying performance patterns in Hardanger fiddle music","author":"Tidemann","year":"2021"},{"key":"10.7717\/peerj-cs.3384\/ref-20","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2101.11691","article-title":"Art and science interaction lab\u2014a highly flexible and modular interaction science research facility","author":"Van Kets","year":"2021"},{"key":"10.7717\/peerj-cs.3384\/ref-21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.21428\/92fbeb44.3ce22588","article-title":"Feeling the effort of classical musicians: a pipeline from electromyography to smartphone vibration for live music performance","volume-title":"International Conference on New Interfaces for Musical Expression","author":"Verdugo","year":"2022"},{"key":"10.7717\/peerj-cs.3384\/ref-22","doi-asserted-by":"publisher","first-page":"1113078","DOI":"10.3389\/fcomp.2023.1113078","article-title":"The development of a Modular Accessible Musical Instrument Technology Toolkit using action research","volume":"5","author":"Ward","year":"2023","journal-title":"Frontiers in Computer Science"},{"key":"10.7717\/peerj-cs.3384\/ref-23","doi-asserted-by":"publisher","first-page":"271","DOI":"10.4324\/9781003219484-15","article-title":"Draft\/Patch\/Weave: interfacing the modular synthesizer with the floor loom","author":"Weinberg","year":"2024","journal-title":"Modular Synthesis: Patching Machines and People"},{"key":"10.7717\/peerj-cs.3384\/ref-24","first-page":"1","article-title":"REFLEX: the viable system model in the design of an interactive music system","author":"Weins","year":"2022"},{"key":"10.7717\/peerj-cs.3384\/ref-25","doi-asserted-by":"publisher","first-page":"266","DOI":"10.1057\/s41599-024-02718-x","article-title":"Digital art exhibitions and psychological well-being in Chinese Generation Z: an analysis based on the SOR framework","volume":"11","author":"Xia","year":"2024","journal-title":"Humanities and Social Sciences Communications"},{"issue":"11","key":"10.7717\/peerj-cs.3384\/ref-26","doi-asserted-by":"crossref","first-page":"738","DOI":"10.17743\/jaes.2022.0117","article-title":"Euterpe: a web framework for interactive music systems","volume":"71","author":"Zang","year":"2023","journal-title":"Journal of the Audio Engineering Society"},{"key":"10.7717\/peerj-cs.3384\/ref-27","article-title":"Art dataset for interactive system & sensor data","author":"Ziya","year":"2025"}],"container-title":["PeerJ Computer Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/peerj.com\/articles\/cs-3384.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-3384.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-3384.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-3384.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T08:00:26Z","timestamp":1769155226000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/articles\/cs-3384"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,23]]},"references-count":27,"alternative-id":["10.7717\/peerj-cs.3384"],"URL":"https:\/\/doi.org\/10.7717\/peerj-cs.3384","archive":["CLOCKSS","LOCKSS","Portico"],"relation":{},"ISSN":["2376-5992"],"issn-type":[{"value":"2376-5992","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,23]]},"article-number":"e3384"}}