A super important topic in the release write-up (lolkek, not even a “work”) on Sora. If you keep it short, of course they didn’t say jack shit about how and what was done, as usual. BUT there’s this:
Simulating digital worlds. Sora is also able to simulate artificial processes–one example is video games. Sora can simultaneously control the player in Minecraft with a basic policy while also rendering the world and its dynamics in high fidelity. These capabilities can be elicited zero-shot by prompting Sora with captions mentioning “Minecraft.”
This finally brings us closer to real VR and full personalization of games.
Video available in the original Telegram post.
Original (RU)
Очень важная тема в релизе работы (лолкек, а не работа) по Sora. Если кратко там конечно же ничего даже не сказали как и что сделано. НО есть вот это
Simulating digital worlds. Sora is also able to simulate artificial processes–one example is video games. Sora can simultaneously control the player in Minecraft with a basic policy while also rendering the world and its dynamics in high fidelity. These capabilities can be elicited zero-shot by prompting Sora with captions mentioning “Minecraft.”
Это наконец-то приближает нас к реальному VR и полной персонализации игр.