Use Meta’s Llama 3 Model in Unity with Amazon Bedrock & other partner services

Опубликовано: 27 Август 2024
на канале: XR Dev Rob - XR AI Tutorials
2,637
72

Hi XR Developers! In the last video we learnt how to record a voice command using Meta’s Voice SDK and turn our speech into text. In this video we can finally take this text and send it as a prompt to different Large Language Models or LLMs for short. We can then get a response back and use Meta’s Voice SDK to speak the response out loud. This allows you to for example create natural conversations with NPCs or Assistants in your Unity game. Today I show you how to use Amazon Bedrock to access Meta’s Llama Model, but this will work very similarly with any other partner provider!

Resources:
🔗 Amazon Bedrock: https://aws.amazon.com/bedrock/
🔗 Amazon Bedrock Pricing: https://aws.amazon.com/bedrock/pricing/
🔗 NuGetForUnity: https://github.com/GlitchEnzo/NuGetFo...
🔗 Deploying Llama 3.1 405B Partner Guides: https://llama.meta.com/docs/getting-t...
🔗 Meta Llama in Amazon Bedrock: https://aws.amazon.com/bedrock/llama/

Other Videos:
📹 Mixed Reality Utility Kit: Build spatially-aware apps with Meta XR SDK:    • Mixed Reality Utility Kit: Build spatially...  
📹 Meta’s Building Blocks | Develop Mixed Reality Apps lightning fast:    • Meta’s Building Blocks | Develop Mixed Rea...  
📹 How to use Lights & Shadows in Passthrough Mode:    • How to use Lights & Shadows in Passthrough...  
📹 Get Started with Meta Quest Development in Unity:    • Get Started with Meta Quest Development in...  
📹 Meta Quest Scene API:    • Meta Quest Scene API | Scene Understanding...  
📹 Meta XR Simulator:    • Meta XR Simulator | Synthetic Environments...  

Join the Discord!
👾   / discord  

Support the Channel:
🫂 Patreon:   / blackwhalestudio  
🐦 Twitter:   / xrdevrob  

🤝 Join this channel to get access to perks:
   / @xrdevrob  

Need professional XR development for your project?
👨‍💻 Get in touch with us: https://bento.me/blackwhale

00:00 Intro
01:03 Get Amazon Credentials and Access to Llama Model
02:20 Amazon Bedrock Pricing
02:30 Setup NuGetForUnity and Amazon Bedrock Namespaces
03:35 AmazonBedrockConnection.cs
07:40 Scene & TTS Setup
08:48 Testing
09:10 Connect Wake Word
09:45 Testing
10:05 Outro


Смотрите видео Use Meta’s Llama 3 Model in Unity with Amazon Bedrock & other partner services онлайн, длительностью часов минут секунд в хорошем качестве, которое загружено на канал XR Dev Rob - XR AI Tutorials 27 Август 2024. Делитесь ссылкой на видео в социальных сетях, чтобы ваши подписчики и друзья так же посмотрели это видео. Данный видеоклип посмотрели 2,637 раз и оно понравилось 72 посетителям.