Apple Vision Pro UI Interactions with Unity PolySpatial | Keyboard and Voice Inputs
Hi XR Developers! In this video we will look at how to use the visionOS system keyboard for our Unity UI and how to achieve speech to text input using AI (Whisper from OpenAI)!
Resources:
🔗 Unity PolySpatial 1.1 Documentation: https://docs.unity3d.com/Packages/com...
🔗 Play to Device: https://docs.unity3d.com/Packages/com...
🔗 Input Documentation: https://docs.unity3d.com/Packages/com...
🔗 Whisper for Unity: https://github.com/Macoron/whisper.un...
🔗 Whisper Models: https://huggingface.co/ggerganov/whis...
Other Videos:
📹 Create and Manage SwiftUI windows with Unity PolySpatial for Apple visionOS: • Create and Manage SwiftUI windows wit...
📹 Apple Vision Pro Input & Object Manipulation with Unity PolySpatial: • Apple Vision Pro Input & Object Manip...
📹 Develop for Apple Vision Pro with Unity’s PolySpatial: • Develop for Apple Vision Pro with Uni...
📹 How to become an Apple XR Developer with Unity for visionOS: • Apple Vision Pro - How to become an A...
Join the Discord!
👾 / discord
Support the Channel:
🫂 Patreon: / blackwhalestudio
🐦 Twitter: / xrdevrob
🤝 Join this channel to get access to perks:
/ @xrdevrob
Need professional XR & Multiplayer development for your project?
👨💻 Get in touch with us: https://bento.me/blackwhale
Chapters:
0:00 Intro
0:39 Setup Scene with TMP Input Field
2:03 Testing the Keyboard Input
2:25 Set up Whisper AI in Unity
4:06 Whisper Scene Setup
5:44 Whisper Voice Input Script
7:09 Testing Whisper AI
8:08 Outro
Смотрите видео Apple Vision Pro UI Interactions with Unity PolySpatial | Keyboard and Voice Inputs онлайн, длительностью часов минут секунд в хорошем качестве, которое загружено на канал XR Dev Rob - XR AI Tutorials 22 Апрель 2024. Делитесь ссылкой на видео в социальных сетях, чтобы ваши подписчики и друзья так же посмотрели это видео. Данный видеоклип посмотрели 3,178 раз и оно понравилось 51 посетителям.
