[UIST 2024] VRCopilot: Authoring 3D Layouts with Generative AI Models in VR (Video)

Опубликовано: 18 Август 2024
на канале: Anhong Guo

196

VRCopilot: Authoring 3D Layouts with Generative AI Models in VR

UIST 2024, Video

Authors:
Lei Zhang, Jin Pan, Jacob Gettig, Steve Oney, Anhong Guo

Abstract:
Immersive authoring provides an intuitive medium for users to create 3D scenes via direct manipulation in Virtual Reality (VR). Recent advances in generative AI have enabled the automatic creation of realistic 3D layouts. However, it is unclear how capabilities of generative AI can be used in immersive authoring to support fluid interactions, user agency, and creativity. We introduce VRCopilot, a mixed-initiative system that integrates pre-trained generative AI models into immersive authoring to facilitate human-AI co-creation in VR. VRCopilot presents multimodal interactions to support rapid prototyping and iterations with AI, and intermediate representations such as wireframes to augment user controllability over the created content. Through a series of user studies, we evaluated the potential and challenges in manual, scaffolded, and automatic creation in immersive authoring. We found that scaffolded creation using wireframes enhanced the user agency compared to automatic creation. We also found that manual creation via multimodal specification offers the highest sense of creativity and agency.

The 30s video preview is available at: • [UIST 2024] VRCopilot: Authoring 3D L...
Paper available at: https://guoanhong.com/papers/UIST24-V...

Смотрите видео [UIST 2024] VRCopilot: Authoring 3D Layouts with Generative AI Models in VR (Video) онлайн, длительностью часов минут секунд в хорошем качестве, которое загружено на канал Anhong Guo 18 Август 2024. Делитесь ссылкой на видео в социальных сетях, чтобы ваши подписчики и друзья так же посмотрели это видео. Данный видеоклип посмотрели 196 раз и оно понравилось 3 посетителям.

256