{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:54:50Z","timestamp":1754160890545,"version":"3.41.2"},"reference-count":43,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T00:00:00Z","timestamp":1753660800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>Traditional 3D content creation paradigms present significant barriers to meaningful creative expression in XR environments, limiting designers' ability to iterate fluidly between conceptual thinking and spatial implementation. Current tools often disconnect the designer's creative thought process from the immersive context where their work will be experienced, creating a gap between design intention and spatial realization. This disconnect particularly impacts the iterative cycles fundamental to effective design thinking, where creators need to rapidly externalize, test, and refine concepts within their intended spatial context. This research addresses the need for more intuitive, context-aware creation systems that support the iterative nature of creative cognition in immersive environments. We developed Dream Space, a spatial computing system that bridges this gap by enabling designers to think, create, and iterate directly within XR contexts. The system leverages generative AI for rapid prototyping of 3D content and environments, allowing designers to externalize and test creative concepts without breaking their cognitive flow. Through multimodal interaction design utilizing Vision Pro's spatial computing capabilities, creators can manipulate virtual artifacts through natural gestures and gaze, supporting the fluid iteration cycles characteristic of established design thinking frameworks. A mixed-methods evaluation with 20 participants from diverse creative backgrounds demonstrated that spatial computing-based creation paradigms significantly reduce cognitive load in the design process. The system enabled even novice users to complete complex creative tasks within 20-30 minutes, with real-time feedback mechanisms supporting rapid iteration between ideation and implementation. Participants reported enhanced creative flow and reduced technical barriers compared to traditional 3D creation tools. This research contributes to understanding how XR interfaces can better support creative cognition and iterative design processes, offering insights for developing tools that enhance rather than hinder the natural flow of creative thinking in immersive environments.<\/jats:p>","DOI":"10.3389\/fcomp.2025.1591289","type":"journal-article","created":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T05:31:56Z","timestamp":1753680716000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Interface design and interaction optimization for spatial computing 3D content creation and immersive environment generation using Apple Vision Pro"],"prefix":"10.3389","volume":"7","author":[{"given":"Jie","family":"Fu","sequence":"first","affiliation":[]},{"given":"Mick","family":"Grierson","sequence":"additional","affiliation":[]},{"given":"Renpeng","family":"Jiang","sequence":"additional","affiliation":[]},{"given":"Shun","family":"Fu","sequence":"additional","affiliation":[]},{"given":"Mengzhi","family":"He","sequence":"additional","affiliation":[]},{"given":"Muhan","family":"Xu","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,7,28]]},"reference":[{"key":"B1","unstructured":"Apple vision pro"},{"key":"B2","unstructured":"visionOS - technology - Apple developer"},{"key":"B3","first-page":"84","article-title":"Space augmented reality","volume":"287","author":"Billinghurst","year":"2002","journal-title":"Sci. Am"},{"key":"B4","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1145\/142413.996911","article-title":"Models of distortion","volume":"26","author":"Blinn","year":"1992","journal-title":"ACM Siggraph Comp. Graph"},{"key":"B5","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1109\/MC.2007.257","article-title":"Virtual reality: how much immersion is enough?","volume":"40","author":"Bowman","year":"2007","journal-title":"Computer"},{"key":"B6","first-page":"1","article-title":"\u201cThe state of 3D modeling in industry: a survey of professionals,\u201d","volume-title":"ACM SIGGRAPH 2022 Talks","author":"Burman","year":"2022"},{"volume-title":"The Psychology of Human-Computer Interaction","year":"1983","author":"Card","key":"B7"},{"key":"B8","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1145\/2480741.2480751","article-title":"3D virtual worlds and distance learning","volume":"52","author":"Dionisio","year":"2013","journal-title":"Comput. Educ"},{"key":"B9","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1037\/h0055392","article-title":"The information capacity of the human motor system","volume":"47","author":"Fitts","year":"1954","journal-title":"J. Exp. Psychol"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2409.02376","article-title":"Coral model generation from single images for virtual reality applications","author":"Fu","year":"2024","journal-title":"arXiv"},{"key":"B11","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1111\/1467-8659.00651","article-title":"Automatic 3d model simplification","volume":"22","author":"Fuhrmann","year":"2003","journal-title":"Comp. Graph Forum"},{"volume-title":"The Elements of User Experience: User-Centered Design for the Web and Beyond","year":"2010","author":"Garrett","key":"B12"},{"volume-title":"The Ecological Approach to Visual Perception","year":"1979","author":"Gibson","key":"B13"},{"key":"B14","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1111\/jade.12357","article-title":"Building 3D models with professional approaches versus tools aimed at novices","volume":"40","author":"Hammon","year":"2021","journal-title":"Int. J. Art. Des. Educ"},{"key":"B15","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"Development of NASA-TLX (Task Load Index): results of empirical and theoretical research","volume":"52","author":"Hart","year":"1988","journal-title":"Adv. Psychol"},{"key":"B16","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1016\/j.intell.2003.12.001","article-title":"dissociation between mental rotation and perspective-taking spatial abilities","volume":"32","author":"Hegarty","year":"2004","journal-title":"Intelligence"},{"key":"B17","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1108\/JBS-02-2022-0036","article-title":"Metaverse - the new reality?","volume":"43","author":"Hollensen","year":"2022","journal-title":"J. Bus. Strategy"},{"volume-title":"The VR Book: Human-Centered Design for Virtual Reality","year":"2016","author":"Jerald","key":"B18"},{"key":"B19","doi-asserted-by":"publisher","first-page":"1061","DOI":"10.1109\/JPROC.2019.2907277","article-title":"Natural interaction","volume":"107","author":"La Viola","year":"2019","journal-title":"Proc. IEEE"},{"key":"B20","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1186\/s13174-022-00151-z","article-title":"All one needs to know about metaverse: a complete survey on technological singularity, virtual ecosystem, and research agenda","volume":"13","author":"Lee","year":"2022","journal-title":"J. Internet Serv. Appl"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3414685.3417763","article-title":"Spatial understanding in architectural design analysis","volume":"39","author":"Li","year":"2020","journal-title":"ACM Trans. Graph"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10648-020-09586-2","article-title":"The cognitive affective model of immersive learning (CAMIL): a theoretical research-based model of learning in immersive virtual reality","volume":"33","author":"Makransky","year":"2021","journal-title":"Educ. Psychol. Rev"},{"key":"B23","first-page":"1","article-title":"\u201cWearable computing as means for personal empowerment,\u201d","volume-title":"2014 International Symposium on Technology and Society (ISTAS): social Implications of Wearable Computing and Ubiquitous Sensors","author":"Mann","year":"2014"},{"key":"B24","first-page":"318","article-title":"\u201cSpatial cognition and environmental behavior,\u201d","volume-title":"Handbook of Environmental Psychology","author":"Montello","year":"2001"},{"key":"B25","doi-asserted-by":"publisher","first-page":"486","DOI":"10.3390\/encyclopedia2010031","article-title":"Metaverse","volume":"2","author":"Mystakidis","year":"2022","journal-title":"Encyclopedia"},{"volume-title":"The Psychology of Everyday Things","year":"1988","author":"Norman","key":"B26"},{"volume-title":"The Design of Everyday Things: Revised and Expanded Edition","year":"2013","author":"Norman","key":"B27"},{"volume-title":"Learning Virtual Reality: Developing Immersive Experiences and Applications for Desktop, Web, and Mobile","year":"2015","author":"Parisi","key":"B28"},{"volume-title":"Interaction Design: Beyond Human-Computer Interaction","year":"2015","author":"Preece","key":"B29"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2204.06125","article-title":"Hierarchical text-conditional image generation with CLIP latents","author":"Ramesh","year":"2022","journal-title":"arXiv"},{"key":"B31","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1111\/j.1477-9730.2010.00599.x","article-title":"Reality-based 3D modeling and surface reconstruction from images","volume":"25","author":"Remondino","year":"2010","journal-title":"Photogramm Rec"},{"key":"B32","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1089\/109493101750527033","article-title":"Presence in mediated environments","volume":"4","author":"Riva","year":"2001","journal-title":"Cyberpsychol. Behav"},{"key":"B33","doi-asserted-by":"publisher","first-page":"103","DOI":"10.9781\/ijimai.2017.09.001","article-title":"Design and evaluation of a short version of the User Experience Questionnaire (UEQ-S)","volume":"4","author":"Schrepp","year":"2017","journal-title":"Int. J. Interact. Multimedia Artif. Intell"},{"key":"B34","doi-asserted-by":"publisher","first-page":"74","DOI":"10.3389\/frobt.2016.00074","article-title":"Enhancing our lives with immersive virtual reality","volume":"3","author":"Slater","year":"2016","journal-title":"Front. Robot. AI"},{"key":"B35","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1016\/j.cag.2010.03.006","article-title":"Rule-based procedural modelling of virtual city models","volume":"34","author":"Smelik","year":"2010","journal-title":"Comp. Graph"},{"key":"B36","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1111\/j.1460-2466.1992.tb00812.x","article-title":"Defining virtual reality: dimensions determining telepresence","volume":"42","author":"Steuer","year":"1992","journal-title":"J. Commun"},{"volume-title":"Plans and Situated Actions: The Problem of Human-Machine Communication","year":"1987","author":"Suchman","key":"B37"},{"key":"B38","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1207\/s15516709cog1202_4","article-title":"Cognitive load during problem solving","volume":"12","author":"Sweller","year":"1988","journal-title":"Cognit. Sci"},{"key":"B39","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/j.autcon.2012.10.012","article-title":"conceptual framework for integrating building information modeling with augmented reality","volume":"34","author":"Wang","year":"2013","journal-title":"Autom Constr"},{"key":"B40","doi-asserted-by":"publisher","first-page":"104425","DOI":"10.1016\/j.compedu.2022.104425","article-title":"A comparative study of online and offline 3D design platforms: an educational perspective","volume":"180","author":"Wu","year":"2022","journal-title":"Comput Educ"},{"key":"B41","first-page":"6527","article-title":"\u201cTripoSR: direct profile-guided single-image 3D mesh reconstruction,\u201d","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Yariv","year":"2023"},{"key":"B42","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1111\/cgf.14121","article-title":"Data-driven shape interpolation and morphing editing","volume":"39","author":"Yuan","year":"2020","journal-title":"Comp. Graph Forum"},{"key":"B43","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1145\/307710.307728","article-title":"User performance in relation to 3D input device design","volume":"32","author":"Zhai","year":"1998","journal-title":"ACM Siggraph Comp. Graphics"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1591289\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T05:31:59Z","timestamp":1753680719000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1591289\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,28]]},"references-count":43,"alternative-id":["10.3389\/fcomp.2025.1591289"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2025.1591289","relation":{},"ISSN":["2624-9898"],"issn-type":[{"type":"electronic","value":"2624-9898"}],"subject":[],"published":{"date-parts":[[2025,7,28]]},"article-number":"1591289"}}