Meta Quest Passthrough Camera Access - Color Picker, Object Detection, QR Code, Frosted Glass & more
Hi XR Developers! Today, we are looking at something you all have been waiting for: Access to the Meta Quest Passthrough Cameras, which just got enabled with Horizon OS v74. This API lets us tap into the raw camera feeds on Quest headsets, opening the door for features like real-time environment sampling, AR overlays, or even object detection.
Additionally to Meta’s Passthrough Camera Samples GitHub repo I also open sourced my experiments with the Passthrough Camera Access in a project called QuestCameraKit. If you are interested in exploring more use cases such as Color Picker, Object Detection, QR Code tracking, and visual effects such as frosted glass shader, feel free to check it out and leave a star!
✨ https://github.com/xrdevrob/QuestCame... ✨
Resources:
🔗 Meta Passthrough Camera Documentation: https://developers.meta.com/horizon/d...
🔗 Meta Passthrough Camera Samples: https://github.com/oculus-samples/Uni...
🔗 QuestCameraKit Samples: https://github.com/xrdevrob/QuestCame...
Other Videos:
📹 Colocation with Meta’s Shared Spatial Anchors & the new Colocation Discovery API: • Colocation with Meta’s Shared Spatial...
📹 Destructible Global Mesh, Instant Content Placement and MRUK Trackables: • Destructible Global Mesh, Instant Con...
📹 Create an MR Drawing app using Logitech’s MX Ink Stylus for Meta Quest: • Create an MR Drawing app using Logite...
📹 Use Meta’s Llama 3 Model in Unity with Amazon Bedrock & other partner services: • Use Meta’s Llama 3 Model in Unity wit...
📹 Use Meta's Voice SDK for Wake Word Detection & Speech To Text (STT): • Use Meta's Voice SDK for Wake Word De...
📹 Apple Vision Pro Input & Object Manipulation with Unity PolySpatial: • Apple Vision Pro Input & Object Manip...
📹 Meta Quest Spatial Anchors: • Meta Quest Spatial Anchors | Create, ...
Join the Discord!
👾 / discord
Support the Channel:
🫂 Patreon: / blackwhalestudio
🐦 Twitter: / xrdevrob
🤝 Join this channel to get access to perks:
/ @xrdevrob
Need professional XR development for your project?
👨💻 Get in touch with us: https://bento.me/blackwhale
00:00 Intro
00:56 Limitations & Requirements
01:58 Meta’s Passthrough Camera Samples
02:36 Camera Permissions class
03:38 Camera Utils class
05:08 WebCamTexture Manager class
06:20 Let’s build a Color Picker!
10:07 Color Picker Demo
10:23 Outro
Смотрите видео Meta Quest Passthrough Camera Access - Color Picker, Object Detection, QR Code, Frosted Glass & more онлайн, длительностью часов минут секунд в хорошем качестве, которое загружено на канал XR Dev Rob - XR AI Tutorials 14 Март 2025. Делитесь ссылкой на видео в социальных сетях, чтобы ваши подписчики и друзья так же посмотрели это видео. Данный видеоклип посмотрели 23,264 раз и оно понравилось 774 посетителям.
