A Webtransport-based System for Real-Time Game Streaming

Game streaming has gained significant traction in recent years, underscoring the necessity for effective and reliable streaming protocols. The introduction of WebTransport, which incorporates HTTP/3 and QUIC as its fundamental components, brings new capabilities that could improve media delivery services such as cloud gaming, video conferencing, and real-time remote rendering. WebTransport provides functionality to enable the utilization of HTTP/3 and QUIC for the purpose of reducing latency, which makes it particularly appealing to cloud gaming developers and game engines, which mainly rely on WebRTC for streaming cloud-rendered content. WebRTC has been instrumental in media streaming due to its wide availability and low-latency characteristics. Nevertheless, the rise of WebTransport offers the promise of scalable, low-latency solutions that may rival existing low-latency methods like WebRTC. In this paper, we implement a WebTransport-based system to stream the game view from the Unity game engine in real-time. The game view is captured and encoded with FFmpeg before being transferred to clients via WebTransport protocol. In addition, the client can also send a control signal to the server in order to start an action of an object in the game scene. Our WebTransport-based system can reach a reasonable end-to-end latency of as much as 115 ms.