Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Split Rendering for Mixed Reality: Interactive Volumetric Video in Action

: Son, J.; Gül, S.; Bhullar, G.S.; Hege, G.; Morgenstern, W.; Hilsmann, A.; Ebner, T.; Bliedung, S.; Eisert, P.; Schierl, T.; Buchholz, T.; Hellge, C.


Association for Computing Machinery -ACM-; Association for Computing Machinery -ACM-, Special Interest Group on Graphics -SIGGRAPH-:
SA 2020, SIGGRAPH Asia : Virtual Event Republic of Korea, December 4 - 13, 2020
New York: ACM, 2020
ISBN: 978-1-4503-8111-6
Art. 8, 3 S.
Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH ASIA) <13, 2020, Online>
Fraunhofer HHI ()

This demo presents a mixed reality (MR) application that enables free-viewpoint rendering of interactive high-quality volumetric video (VV) content on Nreal Light MR glasses, web browsers via WebXR and Android devices via ARCore. The application uses a novel technique for animation of VV content of humans and a split rendering framework for real-time streaming of volumetric content over 5G edge-cloud servers. The presented interactive XR experience showcases photorealistic volumetric representations of two humans. As the user moves in the scene, one of the virtual humans follows the user with his head, conveying the impression of a true conversation.