Skip to content

Latest commit

 

History

History
143 lines (91 loc) · 6.81 KB

README.md

File metadata and controls

143 lines (91 loc) · 6.81 KB

Awesome World Model Games Awesome

World model games are awesome! We can now play fully generative (and hallucinated) games, where anything is possible.

Here we collect papers, open-source projects, and applications of such interactive video models.

Click the badges below the heading to visit the project's relevant links.

The badge X FPS on RTX 4090 indicates an estimate of the frames per second of the model when run on an NVIDIA RTX 4090 GPU at reasonable inference settings. Anything below 1 FPS will be highlighted in red <1 FPS on RTX 4090. In case of ??? FPS on RTX 4090, model performance on an RTX 4090 has not yet been reported.

Contributions are very welcome!

Contents

DIAMOND

Homepage arXiv Discord

Open-source training and inference, initially launched with 26 atari games and CS:GO.

Atari Games

??? FPS on RTX 4090 Open Source

100M models of 26 Atari games.

CS:GO

>10 FPS on RTX 4090 Open Source

Mario Kart 64

>10 FPS on RTX 4090 Open Source Demo Blog

Oasis

Minecraft

<1 FPS on RTX 4090 Open Source Homepage Demo Blog

A 500M model and original inference code are open-source.

9 FPS on RTX 4090 Open Source

Community Fork with adjustments to compiling has reported higher FPS, link above.

Lucid

Minecraft

20 FPS on RTX 4090 Open Source Demo Blog

One size of the model and inference code are open-source.

GameGAN

Homepage arXiv

The Great-Grandfather of the field. Running games on a generative adversarial network.

Doom

Open Source

GTA 5

Open Source

Fork of NVIDIA's research.

Other Games

Matrix

Homepage

2.7B model trained on data from Forza Horizon 5 and Cyberpunk 2077 as well as real-world footage.

GameNGen

Homepage arXiv

A transformer runs Doom! The grandfather paper of the field.

Watch the video

Genie

Homepage arXiv

Seminal paper generalising world models to different games (and pictures!), focused on 2D platformers.

Pokemon Overworld

Demo Blog

An early model trained on a 4th Generation Pokemon game.

Pokemon

Papers

Game Papers: