Speaking the world into existence

Real-time creation of virtual worlds

AI co-creation has the potential to transform the way we interact with virtual worlds and bring about the early VR hopes of speaking shared environments into existence, allowing for novel modes of communicating ideas.

Publications

View by:

Real-time Animation Generation and Control on Rigged Models via Large Language Models

Han Huang, Fernanda De La Torre, Cathy Mengying Fang, Andrzej Banburski-Fahey, Judith Amores, Jaron Lanier

NeurIPS 2023 | December 2023

Spotlight Paper

Publication

LLMR: Real-time Prompting of Interactive Worlds using Large Language Models

Fernanda De La Torre, Cathy Mengying Fang, Han Huang, Andrzej Banburski-Fahey, Judith Amores, Jaron Lanier

CHI 2024 | September 2023

Honorable Mention, CHI 2024

DOI Publication Publication Publication
Surreal VR Pong: LLM approach to Game Design

Jasmine Roberts, Andrzej Banburski-Fahey, Jaron Lanier

36th Conference on Neural Information Processing Systems (NeurIPS 2022) | December 2022

Publication

Steps towards prompt-based creation of virtual worlds

Jasmine Roberts, Andrzej Banburski-Fahey, Jaron Lanier

November 2022

Preprint

Real-time Animation Generation and Control on Rigged Models via Large Language Models

Han Huang, Fernanda De La Torre, Cathy Mengying Fang, Andrzej Banburski-Fahey, Judith Amores, Jaron Lanier

NeurIPS 2023 | December 2023

Spotlight Paper

Publication

LLMR: Real-time Prompting of Interactive Worlds using Large Language Models

Fernanda De La Torre, Cathy Mengying Fang, Han Huang, Andrzej Banburski-Fahey, Judith Amores, Jaron Lanier

CHI 2024 | September 2023

Honorable Mention, CHI 2024

DOI Publication Publication Publication

Surreal VR Pong: LLM approach to Game Design

Jasmine Roberts, Andrzej Banburski-Fahey, Jaron Lanier

36th Conference on Neural Information Processing Systems (NeurIPS 2022) | December 2022

Publication

Steps towards prompt-based creation of virtual worlds

Jasmine Roberts, Andrzej Banburski-Fahey, Jaron Lanier

November 2022

Preprint
LLMR: Real-time Prompting of Interactive Worlds using Large Language Models

Fernanda De La Torre, Cathy Mengying Fang, Han Huang, Andrzej Banburski-Fahey, Judith Amores, Jaron Lanier

CHI 2024 | September 2023

Honorable Mention, CHI 2024

DOI Publication Publication Publication

Steps towards prompt-based creation of virtual worlds

Jasmine Roberts, Andrzej Banburski-Fahey, Jaron Lanier

November 2022

Preprint
Real-time Animation Generation and Control on Rigged Models via Large Language Models

Han Huang, Fernanda De La Torre, Cathy Mengying Fang, Andrzej Banburski-Fahey, Judith Amores, Jaron Lanier

NeurIPS 2023 | December 2023

Spotlight Paper

Publication

Real-time Animation Generation and Control on Rigged Models via Large Language Models

Han Huang, Fernanda De La Torre, Cathy Mengying Fang, Andrzej Banburski-Fahey, Judith Amores, Jaron Lanier

NeurIPS 2023 | December 2023

Spotlight Paper

Publication

LLMR: Real-time Prompting of Interactive Worlds using Large Language Models

Fernanda De La Torre, Cathy Mengying Fang, Han Huang, Andrzej Banburski-Fahey, Judith Amores, Jaron Lanier

CHI 2024 | September 2023

Honorable Mention, CHI 2024

DOI Publication Publication Publication

Surreal VR Pong: LLM approach to Game Design

Jasmine Roberts, Andrzej Banburski-Fahey, Jaron Lanier

36th Conference on Neural Information Processing Systems (NeurIPS 2022) | December 2022

Publication
Steps towards prompt-based creation of virtual worlds

Jasmine Roberts, Andrzej Banburski-Fahey, Jaron Lanier

November 2022

Preprint