Recursive Code World Models Enable Complex Environments Through Scene Programs
| Source: HF Papers | Original article
Researchers unveil Recursive Code World Models, a framework that reconstructs complex 3D worlds in code from a single reference image using recursive scene programs.
A new research paper introduces **Recursive Code World Models (RCWM)**, a framework that can rebuild intricate three‑dimensional environments from just one reference image. The approach, detailed in the arXiv pre‑print 2609.11499 by Zhiqi Li and two co‑authors, pairs a **Recursive Scene Program (RSP)** representation with a construction solver that invokes itself recursively. By treating a world as an executable program and letting the solver iteratively expand the scene, RCWM can generate code that describes complex spatial layouts without needing multiple views or manual modeling.
The development matters because code‑based world models have long promised a tighter link between perception and generation: a scene expressed as code can be edited, simulated, or queried directly by downstream AI systems. RCWM pushes that promise forward by showing how a single image can seed a full, manipulable 3D description, potentially lowering the barrier for creating virtual environments in gaming, simulation, and robotics. It also dovetails with recent work on memory‑grounded planning, where agents use internal world representations to guide actions, suggesting a path toward agents that can both perceive and construct their surroundings on the fly.
The next steps will likely focus on scaling the method to richer scenes, integrating it with large‑scale vision models, and testing its utility in downstream tasks such as embodied navigation or content creation. Watch for follow‑up experiments that benchmark RCWM against existing scene‑generation pipelines and for any open‑source releases that let developers experiment with recursive scene programs in their own projects.
Sources
Back to AIPULSEN