Evaluation and Understanding of Foundation Models

Microsoft Research Forum, January 30, 2024

Besmira Nushi, Principal Researcher at Microsoft Research AI Frontiers summarizes timely challenges and ongoing work on evaluating and in-depth understanding of large foundation models.

See more at https://aka.ms/ResearchForum-Jan2024 (opens in new tab)

Series:: Microsoft Research Forum
Date:: January 30, 2024
Speakers:: Besmira Nushi
Affiliation:: Microsoft Research

- Besmira Nushi
  
  Principal Researcher
Research Area
- Artificial intelligence
Research Lab
- AI Frontiers
Publication

Series: Microsoft Research Forum

AutoGen Update: Complex Tasks and Agents
June 4, 2024
Speakers:

Adam Fourney
MatterGen: A Generative Model for Materials Design
June 4, 2024
Speakers:

Tian Xie
Driving Industry Evolution: Exploring the Impact of Generative AI on Sector Transformation
June 4, 2024
Speakers:

Jiang Bian
Insights into the Challenges and Opportunities of Large Multi-Modal Models for Blind and Low Vision Users: CLIP
June 4, 2024
Speakers:

Daniela Massiceti
Research Forum 3 | Panel: Generative AI for Global Impact: Challenges and Opportunities
June 4, 2024
Speakers:

Jacki O'Neill,

Tanuja Ganu,

Sunayana Sitaram

, et. al.
Research Forum 3 | Keynote: Building Globally Equitable AI
June 4, 2024
Speakers:

Jacki O'Neill
Generative AI and Plural Governance: Mitigating Challenges and Surfacing Opportunities
March 5, 2024
Speakers:

Madeleine Daepp
GigaPath: Foundation Model for Digital Pathology
March 5, 2024
Speakers:

Naoto Usuyama
Getting Modular with Language Models: Building, Reusing a Library of Experts for Task Generalization
March 5, 2024
Speakers:

Alessandro Sordoni
The Metacognitive Demands and Opportunities of Generative AI
March 5, 2024
Speakers:

Lev Tankelevitch
What's new in AutoGen?
March 5, 2024
Speakers:

Chi Wang
Research Forum 2 | Panel Discussion: Transforming the Natural Sciences with AI
March 5, 2024
Speakers:

Bonnie Kruft,

Alex Lu,

Tristan Naumann

, et. al.
Research Forum 2 | Keynote: The Revolution in Scientific Discovery
March 5, 2024
Speakers:

Christopher Bishop
Generative AI meets Structural Biology: Equilibrium Distribution Prediction
January 30, 2024
Speakers:

Shuxin Zheng
Kahani: Visual Storytelling through Culturally Nuanced Images
January 30, 2024
Speakers:

Sameer Segal
Research Forum: Panel Discussion: AI Frontiers
January 30, 2024
Speakers:

Ashley Llorens,

Sébastien Bubeck,

Ahmed Awadallah

, et. al.
Research Forum: Closing Remarks and Announcements
January 30, 2024
Speakers:

Ashley Llorens
Evaluation and Understanding of Foundation Models
January 30, 2024
Speakers:

Besmira Nushi
Augmenting Human Cognition and Decision Making with AI
January 30, 2024
Speakers:

Jake Hofman
Improving Reasoning in Language Models with LASER: Layer-Selective Rank Reduction
January 30, 2024
Speakers:

Dipendra Misra
Research Forum Keynote: Research in the Era of AI
January 30, 2024
Speakers:

Peter Lee