Abstract
The integration of ultra-high-definition television (UHDTV) broadcasting and augmented reality (AR) content through broadband Internet presents an enhanced viewing experience that has evolved on a different axis than quantitative specifications.
Watch Video presentation of the Technical Paper
Therefore, we propose a new viewing style where viewers watch a UHDTV program on television while simultaneously experiencing free-viewpoint AR on their own mobile devices.
In this paper, we describe an object-based real-time streaming system of dynamic three-dimensional objects for AR played on mobile devices such as smartphones and tablets.
Each component object synchronized with a UHDTV program is transmitted along with a unique object identifier in transport packets over broadband Internet. Consequently, terminal devices or network nodes use the object identifier to filter required objects based on individual viewports.
Furthermore, an object is transmitted using multiple representations in different resolutions and bitrates to be selected according to the viewing distance from the object. We conducted a transmission experiment to evaluate the packet level filtering of required objects in appropriate resolution.
Introduction
4K/8K ultra-high-definition television (UHDTV) satellite broadcasting in Japan was commercialized in December 2018. It is the world’s first practical 8K broadcasting, which introduces viewers to the world of immersive video and audio.
8K broadcasting is regarded as the ultimate two-dimensional (2D) video medium. In other words, consumers will probably prefer qualitative diversification of viewing on television to having a television with quantitatively higher specifications.
From a technical perspective, one of the next challenges for future digital media technologies will be to deliver three-dimensional (3D) information.
No comments yet