Microsoft Research has created Muse, a first-of-its-kind generative AI model that can generate a game environment based on visuals or players’ controller actions. It understands a 3D game world and game physics and can react to how players interact with a game.

In a new blog post on Wednesday, Microsoft’s research department debuted a new generative AI model called Muse that it describes as a “breakthrough” for gameplay ideation.

Microsoft has developed an artificial intelligence model of a videogame which can help generate visuals and actions, the company announced on Wednesday.

Microsoft Corp. unveiled artificial intelligence tools that can create video-game scenes that would normally have to be programmed and animated by a human, a model it built using data collected from Xbox gamers and their controllers.

Using AI to produce footage of video games with a consistent world and rules could prove useful to game designers

Microsoft debuts Muse, a world and human action model that uses generative AI to put together gameplay snippets.