Hi XR Developers! In the last video we learnt how to record a voice command using Meta’s Voice SDK and turn our speech into text. In this video we can finally take this text and send it as a prompt to different Large Language Models or LLMs for short. We can then get a response back and use Meta’s Voice SDK to speak the response out loud. This allows you to for example create natural conversations with NPCs or Assistants in your Unity game. Today I show you how to use Amazon Bedrock to access Meta’s Llama Model, but this will work very similarly with any other partner provider!
Resources:
🔗 Amazon Bedrock: https://aws.amazon.com/bedrock/
🔗 Amazon Bedrock Pricing: https://aws.amazon.com/bedrock/pricing/
🔗 NuGetForUnity: https://github.com/GlitchEnzo/NuGetFo...
🔗 Deploying Llama 3.1 405B Partner Guides: https://llama.meta.com/docs/getting-t...
🔗 Meta Llama in Amazon Bedrock: https://aws.amazon.com/bedrock/llama/
Other Videos:
📹 Mixed Reality Utility Kit: Build spatially-aware apps with Meta XR SDK: • Mixed Reality Utility Kit: Build spatially...
📹 Meta’s Building Blocks | Develop Mixed Reality Apps lightning fast: • Meta’s Building Blocks | Develop Mixed Rea...
📹 How to use Lights & Shadows in Passthrough Mode: • How to use Lights & Shadows in Passthrough...
📹 Get Started with Meta Quest Development in Unity: • Get Started with Meta Quest Development in...
📹 Meta Quest Scene API: • Meta Quest Scene API | Scene Understanding...
📹 Meta XR Simulator: • Meta XR Simulator | Synthetic Environments...
Join the Discord!
👾 / discord
Support the Channel:
🫂 Patreon: / blackwhalestudio
🐦 Twitter: / xrdevrob
🤝 Join this channel to get access to perks:
/ @xrdevrob
Need professional XR development for your project?
👨💻 Get in touch with us: https://bento.me/blackwhale
00:00 Intro
01:03 Get Amazon Credentials and Access to Llama Model
02:20 Amazon Bedrock Pricing
02:30 Setup NuGetForUnity and Amazon Bedrock Namespaces
03:35 AmazonBedrockConnection.cs
07:40 Scene & TTS Setup
08:48 Testing
09:10 Connect Wake Word
09:45 Testing
10:05 Outro
Watch video Use Meta’s Llama 3 Model in Unity with Amazon Bedrock & other partner services online, duration hours minute second in high quality that is uploaded to the channel XR Dev Rob - XR AI Tutorials 27 August 2024. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 2,637 times and liked it 72 visitors.