This talk will explore how large-scale self-supervised learning, combined with our latest multimodal neurotechnology—the newly released Muse integrating EEG and functional near-infrared spectroscopy (fNIRS)—and an open citizen science platform, accelerates the development of robust and…
The VidTok method can enable AI systems to process and generate videos more effectively. Compact tokenization reduces computational costs while maintaining video quality across a potentially diverse set of applications.
Supplementary Video 1 provided with the article “World and Human Action Models towards gameplay ideation” (Kanervisto et al. 2025, https://www.nature.com/articles/s41586-025-08600-3 (opens in new tab)). We show video case studies of WHAM-generated gameplay sequences that demonstrate…
Introducing Muse, our World and Human Action Model (WHAM). Muse is a generative AI model of a video game that can generate game visuals, controller actions, or both. It can predict how the game will…
Today Nature published Microsoft’s research detailing our WHAM, an AI model that generates video game visuals & controller actions. We are releasing the model weights, sample data, & WHAM Demonstrator on Azure AI Foundry, enabling…
Gaussian Splatting has changed the game for real-time photo-realistic rendering. One of the most popular applications of Gaussian Splatting is to create animatable avatars, known as Gaussian Avatars. Recent works have pushed the boundaries of…
