Knowledge Base

15th September 2020

Mixed reality capture with Oculus Quest

user image Robin Fuller Creative Director

Share this article

The mixed reality capture works by setting up a DSLR camera on a tripod and recording a player against a green screen. The position of the physical camera is then matched to a virtual camera placed inside the game world. We combine the two streams in real-time to give us the feel of the player being in the virtual world.

The tools are relatively straightforward to use. The calibration to match the position of the physical camera with the virtual camera takes a bit of time to work out, but once that is done you've got a great representation of the player interacting with the virtual world.

Capturing footage of Robin in-headset

Today we're testing with some classic Oculus Quest VR games, however, one of the really exciting prospects is that there's a Software Development Kit. This allows us to use this method of capture within the experiences that both Immersive Studios and our sister company's create. We can record this real-time reaction between live-action footage and VR game experiences, which opens up a lot of different possibilities. Not just for showcasing the games, but for pushing the limits and capabilities of the software.

Robin Fuller Creative Director

Before joining We Are Immersive, Robin’s freelance career as a director and animator saw him work across music videos, ads, film, theatre and more. Robin became more and more interested in the storytelling potential of immersive media and joined Immersive studios to further explore an exciting new area of creativity. Outside of the office, Robin enjoys climbing, yoga, dance, the arts and generally gets excited by anything a bit weird.

More from the Knowledge Hub



Do you have a message you want to convey? A situation that needs simulating, or an audience that needs reaching? Whatever your challenge – we have the ideas, the experience, and the equipment to help.

What’s your challenge?

Get in touch

Contact Us

+44 (0)1603 620562
info@weareimmersive.co.uk

+44 (0)1603 620562
info@weareimmersive.co.uk