Meta Quest Passthrough Camera Access - Color Picker, Object Detection, QR Code, Frosted Glass & more
Hi XR Developers! Today, we are looking at something you all have been waiting for: Access to the Meta Quest Passthrough Cameras, which just got enabled with Horizon OS v74. This API lets us tap into the raw camera feeds on Quest headsets, opening the door for features like real-time environment sampling, AR overlays, or even object detection.
Additionally to Meta’s Passthrough Camera Samples GitHub repo I also open sourced my experiments with the Passthrough Camera Access in a project called QuestCameraKit. If you are interested in exploring more use cases such as Color Picker, Object Detection, QR Code tracking, and visual effects such as frosted glass shader, feel free to check it out and leave a star!
✨ https://github.com/xrdevrob/QuestCame... ✨
Resources:
🔗 Meta Passthrough Camera Documentation: https://developers.meta.com/horizon/d...
🔗 Meta Passthrough Camera Samples: https://github.com/oculus-samples/Uni...
🔗 QuestCameraKit Samples: https://github.com/xrdevrob/QuestCame...
Other Videos:
📹 Colocation with Meta’s Shared Spatial Anchors & the new Colocation Discovery API: • Colocation with Meta’s Shared Spatial...
📹 Destructible Global Mesh, Instant Content Placement and MRUK Trackables: • Destructible Global Mesh, Instant Con...
📹 Create an MR Drawing app using Logitech’s MX Ink Stylus for Meta Quest: • Create an MR Drawing app using Logite...
📹 Use Meta’s Llama 3 Model in Unity with Amazon Bedrock & other partner services: • Use Meta’s Llama 3 Model in Unity wit...
📹 Use Meta's Voice SDK for Wake Word Detection & Speech To Text (STT): • Use Meta's Voice SDK for Wake Word De...
📹 Apple Vision Pro Input & Object Manipulation with Unity PolySpatial: • Apple Vision Pro Input & Object Manip...
📹 Meta Quest Spatial Anchors: • Meta Quest Spatial Anchors | Create, ...
Join the Discord!
👾 / discord
Support the Channel:
🫂 Patreon: / blackwhalestudio
🐦 Twitter: / xrdevrob
🤝 Join this channel to get access to perks:
/ @xrdevrob
Need professional XR development for your project?
👨💻 Get in touch with us: https://bento.me/blackwhale
00:00 Intro
00:56 Limitations & Requirements
01:58 Meta’s Passthrough Camera Samples
02:36 Camera Permissions class
03:38 Camera Utils class
05:08 WebCamTexture Manager class
06:20 Let’s build a Color Picker!
10:07 Color Picker Demo
10:23 Outro
Watch video Meta Quest Passthrough Camera Access - Color Picker, Object Detection, QR Code, Frosted Glass & more online, duration hours minute second in high quality that is uploaded to the channel XR Dev Rob - XR AI Tutorials 14 March 2025. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 23,264 times and liked it 774 visitors.
