Disaggregated model evaluation and comparison

This video is an introduction to disaggregated model evaluation and comparison in Machine Learning. Throughout this video we will describe the main concepts of disaggregated evaluation, how these concepts relate to Responsible AI approaches of scoring and evaluating a ML model, and how they can be used in practice.

Date:: January 23, 2023

- Besmira Nushi
  
  Principal Research Manager
Research Area
- Artificial intelligence
Research Lab
- Microsoft Research Lab - Redmond
Group
- Adaptive Systems and Interaction Group

Watch Next

Making Sentence Embeddings Robust to User-Generated Content
May 29, 2024
Speakers:

Lydia Nishimwe
Combining Machine Learning and Bayesian networks for Decision Support in Arrythmia Diagnosis
March 20, 2024
Speakers:

Tezira Wanyana
Using Archai to search for best Face Segmentation model on Azure ML
March 5, 2024
Speakers:

Chris Lovett
Evaluation and Understanding of Foundation Models
January 30, 2024
Speakers:

Besmira Nushi
MEGA: Multi-lingual Evaluation of Generative AI
June 29, 2023
Speakers:

Kabir Ahuja,

Millicent Ochieng
Multilingual Evaluation of Generative AI (MEGA)
June 28, 2023
Speakers:

Kabir Ahuja,

Stephanie Nyairo,

Millicent Ochieng
MARI Grand Seminar - Large Language Models and Low Resource Languages
April 26, 2023
Speakers:

Monojit Choudhury,

Edward Ombui,

Sunayana Sitaram

, et. al.
Foundation models and the next era of AI
March 23, 2023
Speakers:

Ahmed H. Awadallah
Synapse Espresso: Data Quality Checking with OpenAI GPT-3 in Azure Synapse Spark!
February 16, 2023
Speakers:

Thomas Costers,

Stijn Wynants
Synapse Espresso: Using OpenAI GPT-3 in Synapse!
February 2, 2023
Speakers:

Thomas Costers,

Stijn Wynants