The Human-AI eXperiences (HAX) Team

Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks

Adam Fourney, Gagan Bansal, Hussein Mozannar, Cheng Tan, Eduardo Salinas, Erkang (Eric) Zhu, Friederike Niedtner, Grace Proebsting, Griffin Bassman, Jack Gerrits, Jacob Alber, Peter Chang, Ricky Loynd, Robert West, Victor Dibia, Ahmed Awadallah, Ece Kamar, Rafah Hosn, Saleema Amershi

MSR-TR-2024-47 | November 2024

Published by Microsoft

Preprint

AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systems

Victor Dibia, Jingya Chen, Gagan Bansal, Suff Syed, Adam Fourney, Erkang (Eric) Zhu, Chi Wang, Saleema Amershi

Preprint | August 2024

Publication Video Video Project

AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation

Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang

COLM 2024 | August 2024

Best Paper, LLM Agents Workshop ICLR'24

Publication Video Video Project

Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions

Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan

ToCHI | August 2024

Publication

Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming

Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz

CHI 2024 | May 2024

Honorable Mention, CHI 2024

Publication

Axiomatic Preference Modeling for Longform Question Answering

Corby Rosset, Guoqing Zheng, Victor Dibia, Ahmed Awadallah, Paul Bennett

The 2023 Conference on Empirical Methods in Natural Language Processing | December 2023

Publication

Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations

Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, Gagan Bansal

Proc. ACM Hum.-Comput. Interact. | October 2023, Vol 7

Article 370

PDF Project

AHA! Facilitating AI Impact Assessment by Generating Examples of Harms

Zana Buçinca, Chau Minh Pham, Maurice Jakesch, Marco Tulio Ribeiro, Alexandra Olteanu, Saleema Amershi

June 2023

Publication

LIDA: Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Models

Victor Dibia

ACL 2023 Demonstrations | March 2023

Publication Github Project

Generation Probabilities are Not Enough: Improving Error Highlighting for AI Code Suggestions

Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan

NeurIPS Workshop on Human-Centered AI | October 2022

Publication

Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers

Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi

ACL 2023 | October 2022

Preprint

The Aleph & Other Metaphors for Image Generation

Gonzalo Ramos, Rick Barraza, Victor Dibia, Sharon Lo

NeurIPS 2022 Workshop on Human-Centered AI | October 2022

Publication

How Different Groups Prioritize Ethical Values for Responsible AI

Maurice Jakesch, Zana Buçinca, Saleema Amershi, Alexandra Olteanu

FAccT 2022 | May 2022

Publication DOI

REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Research

Jessie J. Smith, Saleema Amershi, Solon Barocas, Hanna Wallach, Jennifer Wortman Vaughan

FAccT 2022 | May 2022

DOI Project

Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction

Tianyi Li, Mihaela Vorvoreanu, Derek DeBellis, Saleema Amershi

ACM Transactions on Computer-Human Interaction | April 2022

Publication Project Project

HINT: Integration Testing for AI-based Features with Humans in the Loop

Quanze Chen, Tobias Schnabel, Besmira Nushi, Saleema Amershi

International Conference on Intelligent User Interfaces | March 2022

Publication Project

Planning for Natural Language Failures with the AI Playbook

Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi

2021 CHI Conference on Human Factors in Computing Systems | May 2021

Publication Video Project

Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance

Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld

CHI | May 2021

Publication

Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork

Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Dan Weld

AAAI 2021 | February 2021

Publication

The Impact of More Transparent Interfaces on Behavior in Personalized Recommendation

Tobias Schnabel, Saleema Amershi, Paul Bennett, Peter Bailey, Thorsten Joachims

Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2020

Publication

Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance

Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz

HCOMP 2019 | October 2019

PDF

Software Engineering for Machine Learning: A Case Study

Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann

International Conference on Software Engineering (ICSE 2019) – Software Engineering in Practice track | May 2019

ICSE 2019 Best Paper Award

PDF

People and AI See Things Different Implications of Mismatched Perception on HCI for AI Systems

Saleema Amershi, Ece Kamar, Emre Kiciman

Workshop on Human-Centered Machine Learning Perspectives at CHI 2019 | May 2019

Guidelines for Human-AI Interaction

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz

CHI 2019 | May 2019

CHI 2019 Honorable Mention Award

PDF Video Project Project

Sketching NLP: A Case Study of Exploring the Right Things To Design with Language Intelligence

Qian Yang, Justin Cranshaw, Saleema Amershi, Shamsi Iqbal, Jaime Teevan

CHI 2019 | May 2019

Publication Project

Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems

Rafal Kocielnik, Saleema Amershi, Paul Bennett

CHI 2019 | May 2019

Publication Project

Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff

Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz

AAAI Conference on Artificial Intelligence | January 2019

Publication Github Project

Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks

Adam Fourney, Gagan Bansal, Hussein Mozannar, Cheng Tan, Eduardo Salinas, Erkang (Eric) Zhu, Friederike Niedtner, Grace Proebsting, Griffin Bassman, Jack Gerrits, Jacob Alber, Peter Chang, Ricky Loynd, Robert West, Victor Dibia, Ahmed Awadallah, Ece Kamar, Rafah Hosn, Saleema Amershi

MSR-TR-2024-47 | November 2024

Published by Microsoft

Preprint

AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systems

Victor Dibia, Jingya Chen, Gagan Bansal, Suff Syed, Adam Fourney, Erkang (Eric) Zhu, Chi Wang, Saleema Amershi

Preprint | August 2024

Publication Video Video Project

AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation

Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang

COLM 2024 | August 2024

Best Paper, LLM Agents Workshop ICLR'24

Publication Video Video Project

Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions

Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan

ToCHI | August 2024

Publication

Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming

Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz

CHI 2024 | May 2024

Honorable Mention, CHI 2024

Publication

Axiomatic Preference Modeling for Longform Question Answering

Corby Rosset, Guoqing Zheng, Victor Dibia, Ahmed Awadallah, Paul Bennett

The 2023 Conference on Empirical Methods in Natural Language Processing | December 2023

Publication

Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations

Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, Gagan Bansal

Proc. ACM Hum.-Comput. Interact. | October 2023, Vol 7

Article 370

PDF Project

AHA! Facilitating AI Impact Assessment by Generating Examples of Harms

Zana Buçinca, Chau Minh Pham, Maurice Jakesch, Marco Tulio Ribeiro, Alexandra Olteanu, Saleema Amershi

June 2023

Publication

LIDA: Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Models

Victor Dibia

ACL 2023 Demonstrations | March 2023

Publication Github Project

Generation Probabilities are Not Enough: Improving Error Highlighting for AI Code Suggestions

Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan

NeurIPS Workshop on Human-Centered AI | October 2022

Publication

The Aleph & Other Metaphors for Image Generation

Gonzalo Ramos, Rick Barraza, Victor Dibia, Sharon Lo

NeurIPS 2022 Workshop on Human-Centered AI | October 2022

Publication

Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers

Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi

ACL 2023 | October 2022

Preprint

How Different Groups Prioritize Ethical Values for Responsible AI

Maurice Jakesch, Zana Buçinca, Saleema Amershi, Alexandra Olteanu

FAccT 2022 | May 2022

Publication DOI

REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Research

Jessie J. Smith, Saleema Amershi, Solon Barocas, Hanna Wallach, Jennifer Wortman Vaughan

FAccT 2022 | May 2022

DOI Project

Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction

Tianyi Li, Mihaela Vorvoreanu, Derek DeBellis, Saleema Amershi

ACM Transactions on Computer-Human Interaction | April 2022

Publication Project Project

HINT: Integration Testing for AI-based Features with Humans in the Loop

Quanze Chen, Tobias Schnabel, Besmira Nushi, Saleema Amershi

International Conference on Intelligent User Interfaces | March 2022

Publication Project

Planning for Natural Language Failures with the AI Playbook

Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi

2021 CHI Conference on Human Factors in Computing Systems | May 2021

Publication Video Project

Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance

Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld

CHI | May 2021

Publication

Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork

Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Dan Weld

AAAI 2021 | February 2021

Publication

The Impact of More Transparent Interfaces on Behavior in Personalized Recommendation

Tobias Schnabel, Saleema Amershi, Paul Bennett, Peter Bailey, Thorsten Joachims

Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2020

Publication

Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance

Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz

HCOMP 2019 | October 2019

PDF

Software Engineering for Machine Learning: A Case Study

Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann

International Conference on Software Engineering (ICSE 2019) – Software Engineering in Practice track | May 2019

ICSE 2019 Best Paper Award

PDF

People and AI See Things Different Implications of Mismatched Perception on HCI for AI Systems

Saleema Amershi, Ece Kamar, Emre Kiciman

Workshop on Human-Centered Machine Learning Perspectives at CHI 2019 | May 2019

Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems

Rafal Kocielnik, Saleema Amershi, Paul Bennett

CHI 2019 | May 2019

Publication Project

Guidelines for Human-AI Interaction

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz

CHI 2019 | May 2019

CHI 2019 Honorable Mention Award

PDF Video Project Project

Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff

Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz

AAAI Conference on Artificial Intelligence | January 2019

Publication Github Project

AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systems

Victor Dibia, Jingya Chen, Gagan Bansal, Suff Syed, Adam Fourney, Erkang (Eric) Zhu, Chi Wang, Saleema Amershi

Preprint | August 2024

Publication Video Video Project

AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation

Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang

COLM 2024 | August 2024

Best Paper, LLM Agents Workshop ICLR'24

Publication Video Video Project

Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions

Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan

ToCHI | August 2024

Publication

Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations

Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, Gagan Bansal

Proc. ACM Hum.-Comput. Interact. | October 2023, Vol 7

Article 370

PDF Project

AHA! Facilitating AI Impact Assessment by Generating Examples of Harms

Zana Buçinca, Chau Minh Pham, Maurice Jakesch, Marco Tulio Ribeiro, Alexandra Olteanu, Saleema Amershi

June 2023

Publication

LIDA: Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Models

Victor Dibia

ACL 2023 Demonstrations | March 2023

Publication Github Project

Generation Probabilities are Not Enough: Improving Error Highlighting for AI Code Suggestions

Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan

NeurIPS Workshop on Human-Centered AI | October 2022

Publication

The Aleph & Other Metaphors for Image Generation

Gonzalo Ramos, Rick Barraza, Victor Dibia, Sharon Lo

NeurIPS 2022 Workshop on Human-Centered AI | October 2022

Publication

Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers

Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi

ACL 2023 | October 2022

Preprint

How Different Groups Prioritize Ethical Values for Responsible AI

Maurice Jakesch, Zana Buçinca, Saleema Amershi, Alexandra Olteanu

FAccT 2022 | May 2022

Publication DOI

Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction

Tianyi Li, Mihaela Vorvoreanu, Derek DeBellis, Saleema Amershi

ACM Transactions on Computer-Human Interaction | April 2022

Publication Project Project

HINT: Integration Testing for AI-based Features with Humans in the Loop

Quanze Chen, Tobias Schnabel, Besmira Nushi, Saleema Amershi

International Conference on Intelligent User Interfaces | March 2022

Publication Project

Planning for Natural Language Failures with the AI Playbook

Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi

2021 CHI Conference on Human Factors in Computing Systems | May 2021

Publication Video Project

Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance

Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld

CHI | May 2021

Publication

The Impact of More Transparent Interfaces on Behavior in Personalized Recommendation

Tobias Schnabel, Saleema Amershi, Paul Bennett, Peter Bailey, Thorsten Joachims

Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2020

Publication

Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance

Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz

HCOMP 2019 | October 2019

PDF

Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems

Rafal Kocielnik, Saleema Amershi, Paul Bennett

CHI 2019 | May 2019

Publication Project

Guidelines for Human-AI Interaction

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz

CHI 2019 | May 2019

CHI 2019 Honorable Mention Award

PDF Video Project Project

Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff

Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz

AAAI Conference on Artificial Intelligence | January 2019

Publication Github Project

Axiomatic Preference Modeling for Longform Question Answering

Corby Rosset, Guoqing Zheng, Victor Dibia, Ahmed Awadallah, Paul Bennett

The 2023 Conference on Empirical Methods in Natural Language Processing | December 2023

Publication

Sketching NLP: A Case Study of Exploring the Right Things To Design with Language Intelligence

Qian Yang, Justin Cranshaw, Saleema Amershi, Shamsi Iqbal, Jaime Teevan

CHI 2019 | May 2019

Publication Project

Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers

Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi

ACL 2023 | October 2022

Preprint

Software Engineering for Machine Learning: A Case Study

Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann

International Conference on Software Engineering (ICSE 2019) – Software Engineering in Practice track | May 2019

ICSE 2019 Best Paper Award

PDF

The Impact of More Transparent Interfaces on Behavior in Personalized Recommendation

Tobias Schnabel, Saleema Amershi, Paul Bennett, Peter Bailey, Thorsten Joachims

Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2020

Publication

Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems

Rafal Kocielnik, Saleema Amershi, Paul Bennett

CHI 2019 | May 2019

Publication Project

Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks

Adam Fourney, Gagan Bansal, Hussein Mozannar, Cheng Tan, Eduardo Salinas, Erkang (Eric) Zhu, Friederike Niedtner, Grace Proebsting, Griffin Bassman, Jack Gerrits, Jacob Alber, Peter Chang, Ricky Loynd, Robert West, Victor Dibia, Ahmed Awadallah, Ece Kamar, Rafah Hosn, Saleema Amershi

MSR-TR-2024-47 | November 2024

Published by Microsoft

Preprint

AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systems

Victor Dibia, Jingya Chen, Gagan Bansal, Suff Syed, Adam Fourney, Erkang (Eric) Zhu, Chi Wang, Saleema Amershi

Preprint | August 2024

Publication Video Video Project

Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions

Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan

ToCHI | August 2024

Publication

Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations

Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, Gagan Bansal

Proc. ACM Hum.-Comput. Interact. | October 2023, Vol 7

Article 370

PDF Project

Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction

Tianyi Li, Mihaela Vorvoreanu, Derek DeBellis, Saleema Amershi

ACM Transactions on Computer-Human Interaction | April 2022

Publication Project Project

AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation

Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang

COLM 2024 | August 2024

Best Paper, LLM Agents Workshop ICLR'24

Publication Video Video Project

Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming

Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz

CHI 2024 | May 2024

Honorable Mention, CHI 2024

Publication

Axiomatic Preference Modeling for Longform Question Answering

Corby Rosset, Guoqing Zheng, Victor Dibia, Ahmed Awadallah, Paul Bennett

The 2023 Conference on Empirical Methods in Natural Language Processing | December 2023

Publication

LIDA: Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Models

Victor Dibia

ACL 2023 Demonstrations | March 2023

Publication Github Project

Generation Probabilities are Not Enough: Improving Error Highlighting for AI Code Suggestions

Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan

NeurIPS Workshop on Human-Centered AI | October 2022

Publication

The Aleph & Other Metaphors for Image Generation

Gonzalo Ramos, Rick Barraza, Victor Dibia, Sharon Lo

NeurIPS 2022 Workshop on Human-Centered AI | October 2022

Publication

Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers

Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi

ACL 2023 | October 2022

Preprint

How Different Groups Prioritize Ethical Values for Responsible AI

Maurice Jakesch, Zana Buçinca, Saleema Amershi, Alexandra Olteanu

FAccT 2022 | May 2022

Publication DOI

REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Research

Jessie J. Smith, Saleema Amershi, Solon Barocas, Hanna Wallach, Jennifer Wortman Vaughan

FAccT 2022 | May 2022

DOI Project

HINT: Integration Testing for AI-based Features with Humans in the Loop

Quanze Chen, Tobias Schnabel, Besmira Nushi, Saleema Amershi

International Conference on Intelligent User Interfaces | March 2022

Publication Project

Planning for Natural Language Failures with the AI Playbook

Matthew K. Hong, Adam Fourney, Derek DeBellis, Saleema Amershi

2021 CHI Conference on Human Factors in Computing Systems | May 2021

Publication Video Project

Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance

Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld

CHI | May 2021

Publication

Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork

Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Dan Weld

AAAI 2021 | February 2021

Publication

The Impact of More Transparent Interfaces on Behavior in Personalized Recommendation

Tobias Schnabel, Saleema Amershi, Paul Bennett, Peter Bailey, Thorsten Joachims

Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2020

Publication

Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance

Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz

HCOMP 2019 | October 2019

PDF

Software Engineering for Machine Learning: A Case Study

Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann

International Conference on Software Engineering (ICSE 2019) – Software Engineering in Practice track | May 2019

ICSE 2019 Best Paper Award

PDF

People and AI See Things Different Implications of Mismatched Perception on HCI for AI Systems

Saleema Amershi, Ece Kamar, Emre Kiciman

Workshop on Human-Centered Machine Learning Perspectives at CHI 2019 | May 2019

Sketching NLP: A Case Study of Exploring the Right Things To Design with Language Intelligence

Qian Yang, Justin Cranshaw, Saleema Amershi, Shamsi Iqbal, Jaime Teevan

CHI 2019 | May 2019

Publication Project

Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems

Rafal Kocielnik, Saleema Amershi, Paul Bennett

CHI 2019 | May 2019

Publication Project

Guidelines for Human-AI Interaction

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz

CHI 2019 | May 2019

CHI 2019 Honorable Mention Award

PDF Video Project Project

Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff

Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz

AAAI Conference on Artificial Intelligence | January 2019

Publication Github Project

AHA! Facilitating AI Impact Assessment by Generating Examples of Harms

Zana Buçinca, Chau Minh Pham, Maurice Jakesch, Marco Tulio Ribeiro, Alexandra Olteanu, Saleema Amershi

June 2023

Publication