Tools for 6-DoF Immersive Audiovisual Content Capture and Production

Tech Papers 2021: The report details new tools for broadcasters to capture and produce immersive 6-DoF audiovisual experiences by using light field video and spatial audio, which are then composited in a game engine.

Abstract

We present a set of tools that enable the production of immersive experiences with six degrees of freedom (6-DoF), starting from broadcast-centric audiovisual media. We use a moving 360° camera to record the light field of quasi-static backgrounds, and a camera-microphone array to capture light field video and spatial audio of foreground objects, such as actors. Audiovisual tracking produces dynamic spatial metadata for...

Latest Technical paper
Favourites:

Registered users only: Login

Share this:
Other themes: