{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,15]],"date-time":"2025-11-15T05:29:01Z","timestamp":1763184541043,"version":"3.45.0"},"reference-count":35,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T00:00:00Z","timestamp":1762992000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>In immersive digital devices, high environmental complexity can lead to rendering delays and loss of interactive details, resulting in a fragmented experience. This paper proposes a lightweight NeRF (Neural Radiance Fields) modeling and multimodal perception fusion method. First, a sparse hash code is constructed based on Instant-NGP (Instant Neural Graphics Primitives) to accelerate scene radiance field generation. Second, parameter distillation and channel pruning are used to reduce the model\u2019s size and reduce computational overheads. Next, multimodal data from a depth camera and an IMU (Inertial Measurement Unit) is fused, and Kalman filtering is used to improve pose tracking accuracy. Finally, the optimized NeRF model is integrated into the Unity engine, utilizing custom shaders and asynchronous rendering to achieve low-latency viewpoint responsiveness. Experiments show that the file size of this method in high-complexity scenes is only 79.5 MB \u00b1 5.3 MB, and the first loading time is only 2.9 s \u00b1 0.4 s, effectively reducing rendering latency. The SSIM is 0.951 \u00b1 0.016 at 1.5 m\/s, and the GME is 7.68 \u00b1 0.15 at 1.5 m\/s. It can stably restore texture details and edge sharpness under dynamic viewing angles. In scenarios that support 3\u20135 people interacting simultaneously, the average interaction response delay is only 16.3 ms, and the average jitter error is controlled at 0.12\u00b0, significantly improving spatial interaction performance. In conclusion, this study provides effective technical solutions for high-quality immersive interaction in complex public scenarios. Future work will explore the framework\u2019s adaptability in larger-scale dynamic environments and further optimize the network synchronization mechanism for multi-user concurrency.<\/jats:p>","DOI":"10.3390\/jimaging11110411","type":"journal-article","created":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T12:57:13Z","timestamp":1763038633000},"page":"411","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Neural Radiance Fields: Driven Exploration of Visual Communication and Spatial Interaction Design for Immersive Digital Installations"],"prefix":"10.3390","volume":"11","author":[{"given":"Wanshu","family":"Li","sequence":"first","affiliation":[{"name":"College of Fine Arts, Jiangxi Normal University, Nanchang 330022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuanhui","family":"Hu","sequence":"additional","affiliation":[{"name":"College of Fine Arts, Jiangxi Normal University, Nanchang 330022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3527620","article-title":"Digital Creativity and the Regional Museum: Experimental collaboration at the convergence of immersive media and exhibition design","volume":"15","author":"Beale","year":"2022","journal-title":"ACM J. Comput. Cult. Herit."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"90","DOI":"10.47745\/ausfm-2024-0012","article-title":"Affective Immersion in Large-Scale Moving Image Installations","volume":"26","author":"Gyenge","year":"2024","journal-title":"Acta Univ. Sapientiae Film. Media Stud."},{"key":"ref_3","first-page":"88","article-title":"Research on the application of immersive art in digital technology scene","volume":"5","author":"Wang","year":"2023","journal-title":"Adv. Educ. Humanit. Soc. Sci. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3465620","article-title":"Ming shan digital experience: Immersive technology for traditional taoist meditation","volume":"4","author":"Henchoz","year":"2021","journal-title":"Proc. ACM Comput. Graph. Interact. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1007\/s00779-022-01696-8","article-title":"Evaluation in scenarios of ubiquity of technology: A systematic literature review on interactive installations","volume":"27","author":"Mendoza","year":"2023","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1017","DOI":"10.1177\/10963480211030319","article-title":"Immersive digital tourism: The role of multisensory cues in digital museum experiences","volume":"47","author":"Guo","year":"2023","journal-title":"J. Hosp. Tour. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3439862","article-title":"We dare you: A lifecycle study of a substitutional reality installation in a museum space","volume":"14","author":"Ioannidis","year":"2021","journal-title":"J. Comput. Cult. Herit. (JOCCH)"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1080\/14735784.2021.1968306","article-title":"Play and manifestations of playfulness in interactive and immersive museum spaces","volume":"62","author":"Ntalla","year":"2021","journal-title":"Cult. Theory Crit."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"12379","DOI":"10.1007\/s11042-022-13680-8","article-title":"Using immersive technologies to facilitate location scouting in audiovisual media production: A user requirements study and proposed framework","volume":"82","author":"Bodini","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_10","first-page":"28","article-title":"Space in the mind of a machine: Immersive narratives","volume":"92","author":"Anadol","year":"2022","journal-title":"Archit. Des."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1080\/17538947.2022.2061619","article-title":"Literary placemaking and narrative immersion in extended reality virtual geographic environments","volume":"15","author":"Rzeszewski","year":"2022","journal-title":"Int. J. Digit. Earth"},{"key":"ref_12","first-page":"189","article-title":"Digital generative multimedia tool theory (DGMTT): A theoretical postulation in the era of artificial intelligence","volume":"14","author":"Onyejelem","year":"2024","journal-title":"Adv. Mach. Learn. Artif. Intell."},{"key":"ref_13","first-page":"730","article-title":"Interactive immersive experience: Digital technologies for reconstruction and experiencing temple of Bel using crowdsourced images and 3D photogrammetric processes","volume":"21","author":"Rihani","year":"2023","journal-title":"Int. J. Archit. Comput."},{"key":"ref_14","first-page":"60","article-title":"Immersive applications in museums: An analysis of the use of XR technologies and the provided functionality based on systematic literature review","volume":"6","author":"Komianos","year":"2022","journal-title":"JOIV Int. J. Inform. Vis."},{"key":"ref_15","first-page":"28","article-title":"The interactive creativity of the digital era: Exploring how media art redefines the relationship between audience and artwork","volume":"2","author":"Takala","year":"2023","journal-title":"Stud. Art Archit."},{"key":"ref_16","first-page":"78","article-title":"Public Engagement in Wetland Recreation through 3D Virtual Reality and Animated Simulation: A Case Study in Egypt","volume":"2","author":"Hassan","year":"2025","journal-title":"Int. J. Eng. Appl. Sci. Oct. 6 Univ."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1504\/IJART.2022.128467","article-title":"Design and development of an experimental prototype of Chinese Tang Dynasty tomb murals under the intervention of digital media technology","volume":"14","author":"Jie","year":"2022","journal-title":"Int. J. Arts Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1080\/13614568.2022.2150324","article-title":"The Sacra Infermeria\u2014A focus group evaluation of an augmented reality cultural heritage experience","volume":"28","author":"Barbara","year":"2022","journal-title":"New Rev. Hypermedia Multimed."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1038\/s43588-021-00142-8","article-title":"Democratizing interactive, immersive experiences for science education with WebXR","volume":"1","author":"Abriata","year":"2021","journal-title":"Nat. Comput. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1177\/00375497241229757","article-title":"Simulation in engineering education: The transition from physical experimentation to digital immersive simulated environments","volume":"100","author":"Negahban","year":"2024","journal-title":"Simulation"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1002\/rob.22248","article-title":"MVS-SLAM: Enhanced multiview geometry for improved semantic RGBD SLAM in dynamic environment","volume":"41","author":"Islam","year":"2024","journal-title":"J. Field Robot."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"7630","DOI":"10.1109\/TCSVT.2023.3276753","article-title":"Hybrid-MVS: Robust multi-view reconstruction with hybrid optimization of visual and depth cues","volume":"33","author":"Li","year":"2023","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"8962","DOI":"10.1109\/TPAMI.2021.3122874","article-title":"Handvoxnet++: 3d hand shape and pose estimation using voxel-based neural networks","volume":"44","author":"Malik","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1109\/TCSVT.2021.3056726","article-title":"RGB-D semantic segmentation and label-oriented voxelgrid fusion for accurate 3D semantic mapping","volume":"32","author":"Shi","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1007\/s41095-024-0436-y","article-title":"Recent advances in 3d gaussian splatting","volume":"10","author":"Wu","year":"2024","journal-title":"Comput. Vis. Media"},{"key":"ref_26","first-page":"1","article-title":"3DGSR: Implicit surface reconstruction with 3D gaussian splatting","volume":"43","author":"Lyu","year":"2024","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.5194\/isprs-archives-XLVIII-M-2-2023-1051-2023","article-title":"NeRF for heritage 3D reconstruction","volume":"48","author":"Mazzacca","year":"2023","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4983","DOI":"10.1109\/TVCG.2023.3283400","article-title":"Nerf-art: Text-driven neural radiance fields stylization","volume":"30","author":"Wang","year":"2023","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_29","first-page":"83","article-title":"Scene Generation of CNC Tools Utilizing Instant NGP and Rendering Performance Evaluation","volume":"19","author":"Jung","year":"2024","journal-title":"IEMEK J. Embed. Syst. Appl."},{"key":"ref_30","first-page":"171","article-title":"Three-demensional reconstruction of soybean plants in the field based on SfM and Instant-NGP","volume":"41","author":"Xin","year":"2025","journal-title":"Trans. Chin. Soc. Agric. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3571","DOI":"10.1109\/JBHI.2024.3365784","article-title":"Adaptive knowledge distillation for high-quality unsupervised mri reconstruction with model-driven priors","volume":"28","author":"Wu","year":"2024","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1007\/s11770-021-0894-2","article-title":"Research on fault recognition method combining 3D Res-UNet and knowledge distillation","volume":"18","author":"Wang","year":"2021","journal-title":"Appl. Geophys."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4890","DOI":"10.1109\/TFUZZ.2024.3363220","article-title":"Multidimensional dynamic pruning: Exploring spatial and channel fuzzy sparsity","volume":"32","author":"Shao","year":"2024","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.15701\/kcgs.2022.28.5.1","article-title":"A study on the comparison of the virtual reality development environment in unity and unreal engine 4","volume":"28","author":"Yunsik","year":"2022","journal-title":"J. Korea Comput. Graph. Soc."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1401","DOI":"10.1007\/s00542-019-04302-9","article-title":"Unity game engine: Interactive software design using digital glove for virtual reality baseball pitch training","volume":"27","author":"Tsai","year":"2021","journal-title":"Microsyst. Technol."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/11\/411\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,15]],"date-time":"2025-11-15T05:27:06Z","timestamp":1763184426000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/11\/411"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,13]]},"references-count":35,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["jimaging11110411"],"URL":"https:\/\/doi.org\/10.3390\/jimaging11110411","relation":{},"ISSN":["2313-433X"],"issn-type":[{"type":"electronic","value":"2313-433X"}],"subject":[],"published":{"date-parts":[[2025,11,13]]}}}