Fei-Fei Li's World Labs launches Frameboy: explore AI-generated worlds in real time, like a handheld gaming console

Beating AI News Flash: World Labs, founded by Fei-Fei Li, has released Frameboy, allowing users to control the camera with a keyboard like in a game and move freely through AI-generated virtual worlds. Wherever the camera turns, cloud GPUs generate the corresponding new visuals in real time, at up to 15 frames per second.

Atlas, released in September this year, can already complete the unseen space in an image based on a single picture, and also supports precise control of camera position and movement paths, generating videos of up to 1 minute in 1440p. This time, Frameboy uses a speed-optimized version of Atlas, turning a process that originally required planning camera shots in advance and waiting for video generation into real-time roaming in which users can turn at any time and explore freely.

Currently, the public version of Frameboy can only explore preset scenes provided by the official team. Users who want to create virtual worlds with their own images need to build them through Viewfinder, which is still in closed beta.

The entire system relies on high-performance cloud GPUs. The maximum 15 FPS frame rate is still somewhat laggy in actual use, and operating costs are also higher than local rendering.