CGI backgrounds for mixed-reality passthrough scenes at DeoVR
The DeoVR team has been creating custom CGI backgrounds to use with AR passthrough scenes, as a way of providing great-looking fixed backdrops that don't require the use of live AR passthrough. Discover more about how this is done and see some of the incredible images to come.
Why use CGI backgrounds for passthrough content?
AR passthrough content is becoming increasingly popular at DeoVR, particularly since the launch of the Meta Quest 3 and its superb mixed-reality capabilities. But for various reasons, users might not want to use live AR passthrough, and would prefer a fixed background instead. This is where CGI backgrounds can make an impact.
How is it done?
Our lead designer on this project has created some incredible images, both static and dynamic. He has been using a technique called Photogrammetry. This is the art and science of extracting 3D information from photographs. The process involves taking overlapping photographs of an object, structure or space and converting them into 2D or 3D digital models.
Throughout this post you can see some of the images created using this method as well as images designed from the ground up. It requires CGI shading and lighting before rendering into beautiful images.
Other tools
A useful tool for making awe-inspiring renders is a LiDAR scanner. LiDAR technology uses the light from a laser to collect measurements. These are used to create 3D models and maps of objects and environments. Some of the images in this post have been based on LiDAR scans, with shading and lighting added afterwards, and sometimes 3D models.
Upcoming AR passthrough content at DeoVR
A lot more passthrough content is planned for DeoVR. One idea is for a passthrough video with a girl walking, while various moving backgrounds change. This will involve videos of moving landscapes and photogrammetry, but also switching from real-life imagery to CGI. Production on this scene is happening right now - keep checking back for updates.
Join the discussion on the DeoVR forum, Reddit and Facebook.
