The mixed reality capture works by setting up a DSLR camera on a tripod and recording a player against a green screen. The position of the physical camera is then matched to a virtual camera placed inside the game world. We combine the two streams in real-time to give us the feel of the player being in the virtual world.
The tools are relatively straightforward to use. The calibration to match the position of the physical camera with the virtual camera takes a bit of time to work out, but once that is done you've got a great representation of the player interacting with the virtual world.
Capturing footage of Robin in-headset
Today we're testing with some classic Oculus Quest VR games, however, one of the really exciting prospects is that there's a Software Development Kit. This allows us to use this method of capture within the experiences that both Immersive Studios and our sister company's create. We can record this real-time reaction between live-action footage and VR game experiences, which opens up a lot of different possibilities. Not just for showcasing the games, but for pushing the limits and capabilities of the software.
Before joining We Are Immersive, Robin’s freelance career as a director and animator saw him work across music videos, ads, film, theatre and more. Robin became more and more interested in the storytelling potential of immersive media and joined Immersive studios to further explore an exciting new area of creativity. Outside of the office, Robin enjoys climbing, yoga, dance, the arts and generally gets excited by anything a bit weird.
More from the Knowledge Hub
Do you have a message you want to convey? A situation that needs simulating, or an audience that needs reaching? Whatever your challenge – we have the ideas, the experience, and the equipment to help.