Apple Vision Pro UI Interactions with Unity PolySpatial | Keyboard and Voice Inputs
Hi XR Developers! In this video we will look at how to use the visionOS system keyboard for our Unity UI and how to achieve speech to text input using AI (Whisper from OpenAI)!
Resources:
🔗 Unity PolySpatial 1.1 Documentation: https://docs.unity3d.com/Packages/com...
🔗 Play to Device: https://docs.unity3d.com/Packages/com...
🔗 Input Documentation: https://docs.unity3d.com/Packages/com...
🔗 Whisper for Unity: https://github.com/Macoron/whisper.un...
🔗 Whisper Models: https://huggingface.co/ggerganov/whis...
Other Videos:
📹 Create and Manage SwiftUI windows with Unity PolySpatial for Apple visionOS: • Create and Manage SwiftUI windows wit...
📹 Apple Vision Pro Input & Object Manipulation with Unity PolySpatial: • Apple Vision Pro Input & Object Manip...
📹 Develop for Apple Vision Pro with Unity’s PolySpatial: • Develop for Apple Vision Pro with Uni...
📹 How to become an Apple XR Developer with Unity for visionOS: • Apple Vision Pro - How to become an A...
Join the Discord!
👾 / discord
Support the Channel:
🫂 Patreon: / blackwhalestudio
🐦 Twitter: / xrdevrob
🤝 Join this channel to get access to perks:
/ @xrdevrob
Need professional XR & Multiplayer development for your project?
👨💻 Get in touch with us: https://bento.me/blackwhale
Chapters:
0:00 Intro
0:39 Setup Scene with TMP Input Field
2:03 Testing the Keyboard Input
2:25 Set up Whisper AI in Unity
4:06 Whisper Scene Setup
5:44 Whisper Voice Input Script
7:09 Testing Whisper AI
8:08 Outro
Watch video Apple Vision Pro UI Interactions with Unity PolySpatial | Keyboard and Voice Inputs online, duration hours minute second in high quality that is uploaded to the channel XR Dev Rob - XR AI Tutorials 22 April 2024. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 3,178 times and liked it 51 visitors.
