Graphics and multimedia - Microsoft Research

Publication

CMMD: Contrastive Multi-Modal Diffusion for Video-Audio Conditional Modeling

Ruihan Yang, Hannes Gamper, Sebastian Braun

AVGenL: Audio-Visual Generation and Learning (workshop at ECCV 2024) | September 2024

Career Opportunity

Researcher – Microsoft Research Asia

Posted: July 31, 2024

Location: Beijing, China; Shanghai, China

Research Area(s): Artificial intelligence, Computer vision, Graphics and multimedia, Systems and networking

Microsoft Research Asia (MSRA) is one of the world’s leading research institutions, driving innovations in various areas of computer science and technology. Now we are looking for Researchers in areas such as Deep Learning, Reinforcement…

Publication

Scribble: Auto-Generated 2D Avatars with Diverse and Inclusive Art-Direction

Lohit Petikam, Charlie Hewitt, Shideh Rezaeifar

SIGGRAPH | July 2024

Publication

GeoGen: Geometry-Aware Generative Modeling via Signed Distance Functions

Salvatore Esposito, Qingshan Xu, Kacper Kania, Charlie Hewitt, Octave Mariotti, Lohit Petikam, Julien Valentin, Arno Onken, Oisin Mac Aodha

Computer Vision and Pattern Recognition 2024 Workshops | June 2024

Download

Kahani

“Kahani” is a research prototype that allows the user to create stories with visually striking and culturally nuanced images (visuals/scenes) just by describing them in their local languages. This web-based tool will also allow users…

Download Video Project

Podcast

What’s Your Story: Ivan Tashev

February 1, 2024

Partner Software Architect Ivan Tashev talks about applying his expertise in audio signal processing to the design and study of audio components for Microsoft products such as Kinect and shares how a focus on what…

Dataset Source Code

LLMR

This repo contains the code described in LLMR, implementing the Large Language Model for Mixed Reality framework. This package serves as a prototype for “Speaking the world into existence”, which allows the real time creation of…

GitHub

Publication

COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Design

Peidong Jia, Chenxuan Li, Yuhui Yuan, Zeyu Liu, Yichao Shen, Bohan Chen, Xingru Chen, Yinglin Zheng, Dong Chen, Ji Li, Xiaodong Xie, Shanghang Zhang, Baining Guo

November 2023

Microsoft Research Blog

Research Focus: Week of November 22, 2023

November 22, 2023

A new deep-learning compiler for dynamic sparsity; Tongue Tap could make tongue gestures viable for VR/AR headsets; Ranking LLM-Generated Loop Invariants for Program Verification; Assessing the limits of zero-shot foundation models in single-cell biology.

Project

CCEdit

Creative and Controllable AI Video Editing Demo (opens in new tab) Paper (opens in new tab) CCEdit is a comprehensive generative video editing framework meticulously designed to strike a harmonious balance between controllability and creativity…