Tutorial: How to create Passthrough VR video content for DeoVR

In this tutorial, we will explain how to record a passthrough mixed-reality VR video, using a homemade setup. We'll guide you through the equipment you need and share some tips to help you achieve the best results and explain how AI Passthrough can be a useful option. Prefer video? Watch the video tutorial by VR expert Diego Vega of VRO Films. 

AI Passthrough

DeoVR has introduced AI Passthrough, a feature that uses artificial intelligence to remove backgrounds from VR videos. 

Creators: You don't have to do anything. AI Passthrough is applied to all suitable videos behind the scenes. Suitable scenes will have the Passthrough AI VR tag. 

Viewers: Simply click the "AI Passthrough" button to activate the feature. Enjoy!

Important notes:

• AI Passthrough is currently in beta; some imperfections may occur.
• The feature is available in the DeoVR app, with browser and mobile support coming soon.
• Recommended headsets for the best experience include Meta Quest 3S (Quest 3 and Quest Pro are also good) thanks to stereoscopic color passthrough.

For more details, visit Guide: AI Passthrough at DeoVR.

​Video tutorial for creating AR Passthrough content:

| Video on Facebook | 

What is passthrough? 

Passthrough refers to how new VR headsets, such as the Quest 3 and Pico 4, can display 3D floating objects within your real-world surroundings. It is all made possible thanks to the cameras in these headsets and the DeoVR app. For example, imagine receiving a personalized salsa dancing lesson right in your living room. 

For more detailed information, we recommend our earlier blog about viewing passthrough content using DeoVR. 

How to film passthrough VR/AR content

Using a green or blue backdrop for passthrough

The concept of passthrough involves eliminating the background of the object you want to display. This can be achieved through chroma key backgrounds, which can be green or blue. These greenscreens (or bluescreens) are readily available on platforms like Amazon - but ensure it's a matte colour to avoid reflections. 

This backdrop must cover the entire object including all its movements. If for any reason the object goes beyond the background, it becomes challenging to edit, so make sure to cover both floor and ceiling, as well as the sides of the scene being recorded. 

Lighting for passthrough

The next crucial element is lighting. We need a lot of lighting both for the object and the chroma key backdrop. We don't want any shadows as they can interfere with and complicate the editing process. 

Tips on camera position for passthrough

The camera's position is also crucial. Each scene must be consistent with the point of view (POV) of the viewer, and should be at their eye level. For instance, if the object is sitting, position the camera at the level as if the POV were sitting. If the object or model is standing, the camera should be at the level of a standing person. 

Camera levelling is extremely important. It must be 100% level, both horizontally and vertically. 

The ideal distance from the camera is between one to two metres. 

Other tips for recording passthrough

• A key point to note is that the object should not have any accessory or clothing the same colour as the backdrop. If the model wears something green, it will be erased during editing, creating an unsightly hole in the image. 
• Also avoid any accessories that reflect light, so make sure no shiny objects are on view. 

Settings used by VRO Films: 

Add passthrough parameters to your uploaded VR video

Now, creators can add specific passthrough parameters to their videos when uploading content (or at a later date). This page is a new addition to the DeoVR Creator's panel. 

Simply add the accurate values for each settings: Hue, Saturation, Brightness, Color Range, Falloff, or leave at the default settings for green screen. (If you're using Alpha Channel passthrough you can also select that on this page.) 

To discover the correct settings, the creator will need to identify them offline. 

The DeoVR documentation has a more advanced technical explanation, including details about the new and advanced alpha channel function. 

Keep checking back for more advanced tips, plus information on editing passthrough content using VR video editing software such as Adobe Premiere Pro.