Alaya Renderer bridges RGB video, game engines

Alaya Renderer is a major step toward practical generative world models by grounding diffusion models in traditional game engine primitives (G-buffers).

• –Decouples geometry from appearance by extracting albedo, normals, and depth, allowing for physically-consistent relighting that standard video models struggle with
• –The 4-million-frame dataset from AAA games provides a rare, high-quality bridge between cinematic gameplay and structured rendering data
• –Inverse rendering capabilities (RGB to G-buffer) enable developers to "ingest" real-world video into controllable 3D environments
• –Handles long-duration consistency up to 53 minutes, solving a critical stability bottleneck for current video generation architectures
• –Released as an open-source framework, it directly competes with proprietary world-building tools while offering a more modular, developer-friendly pipeline