Immersive Live Experiences (ILEs) enable audiences at remote sites to feel real-time highly realistic sensations, as if they are at the event site. This article provides a key feature of an implementation of ILE services, called Kirari! for Arena, as a use case of arena-style ILE, and its technical elements developed by NTT Labs. The major functionalities are object extraction from an arbitrary background, object tracking with depth sensors, low-latency synchronized data transport and four-sided pseudo-3D image presentation with depth expression. It also provides evaluations on the experience of Kirari! for Arena audiences, as well as its conformance to International Telecommunication Union, Telecommunication Standardization Sector (ITU-T) standards for ILE.
Keywords - AI, immersive live experience, MPEG media transport, pseudo-3D images, real-time image extraction, standardization. |