Jianfeng Gao

A whole-slide foundation model for digital pathology from real-world data

Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier González, Yu Gu, Yanbo Xu, Mu-Hsin Wei, Wenhui Wang, Shuming Ma, Furu Wei, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Jaylen Rosemon, Tucker Bower, Soohee Lee, R. Weerasinghe, Bill Wright, Ari Robicsek, Brian Piening, Carlo Bifulco, Sheng Wang, Hoifung Poon

Nature | May 2024

Publication DOI Publication

Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs

Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao

ICLR 2024 (Oral) | May 2024

DOI Publication PDF

LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering

Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao

Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263

Publication Project Project

Agent AI Towards a Holistic Intelligence

Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao

arXiv: 2403.00833 | February 2024

Publication Publication Project

An Interactive Agent Foundation Model

Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang

February 2024

Publication Publication Project

BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs

Sheng Zhang, Yanbo Xu, Naoto Usuyama, Hanwen Xu, Jaspreet Bagga, Rob Tinn, Sam Preston, Rajesh Rao, Mu Wei, Naveen Valluri, Cliff Wong, Andrea Tupini, Yu Wang, Matt Mazzola, Swadheen Shukla, Lars Liden, Jianfeng Gao, Matthew P Lungren, Tristan Naumann, Sheng Wang, Hoifung Poon

January 2024

Publication

MindAgent: Emergent Gaming Interaction

Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao

Processings of NAACL 2024 | January 2024

Publication Project Project

TrustLLM: Trustworthiness in Large Language Models

Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao

ICML 2024 | January 2024

DOI Publication Publication

Agent AI: Surveying the Horizons of Multimodal Interaction

Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao

arXiv: 2401.03568 | January 2024

Publication Project

Bridging Discrete and Backpropagation: Straight-Through and Beyond

Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao

NeurIPS 2023 (Oral) | December 2023

Publication Github

Visual In-Context Prompting

Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Hu-Sheng Xu, Hongyang Li, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao

CVPR 2024 | November 2023

DOI Publication Publication

Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs

Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao

ICLR 2024 | November 2023

DOI Publication

Tree Prompting: Efficient Task Adaptation without Fine-Tuning

Chandan Singh, Jianfeng Gao

EMNLP | November 2023

Publication

BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys

Yu Gu, Jianwei Yang, Naoto Usuyama, Chunyuan Li, Sheng Zhang, Matthew P Lungren, Jianfeng Gao, Hoifung Poon

October 2023

Publication

Fast-ELECTRA for Efficient Pre-training

Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu

ICLR 2024 | October 2023

DOI Publication

MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts

Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao

ICLR 2024 | October 2023

Publication

Augmenting Language Models with Long-Term Memory

Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei

NeurIPS 2023 | October 2023

Publication

Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models

Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao

NeurIPS 2023 | October 2023

Publication

Multimodal Agent — Localized Symbolic Knowledge Distillation for Visual Commonsense Models

Jae Sung Park, Jack Hessel, Khyathi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi

Proceedings of NeurIPS 2023 | October 2023

Publication Project

Multimodal Foundation Models: From Specialists to General-Purpose Assistants

Chunyuan Li, Zhe Gan, Zhengyuan Yang, Jianwei Yang, Linjie Li, Lijuan Wang, Jianfeng Gao

September 2023

118-page book/survey on the literature review, evolution, trends and our position on multimodal foundation models. CVPR 2023 Tutorial: https://vlp-tutorial.github.io/2023/

Publication Project

Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering

Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao

ACL 2023 | July 2023

Publication

Is Self-Repair a Silver Bullet for Code Generation?

Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama

ICLR 2024 | June 2023

Publication

Self-Verification Improves Few-Shot Clinical Information Extraction

Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon

May 2023

Publication

Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models

Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao

Proceedings of ACL 2023 | May 2023

Publication Publication Project Project

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication Project

ArK: Augmented Reality with Knowledge Emergent Infrastructure

Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao

Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023

Publication Project Project

Instruction Tuning with GPT-4

Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao

MSR-TR-2023-35 | April 2023

Published by Microsoft

Project Page: https://instruction-tuning-with-gpt-4.github.io/

Publication Project

Check your facts and try again: Improving large language models with external knowledge and automated feedback

Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao

MSR-TR-2023-46 | March 2023

Published by Microsoft

Publication Project

Neural Approaches to Conversational Information Retrieval

Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell

Published by Springer | March 2023, Vol 44

ISBN: 978-3-031-23079-0

The Information Retrieval Series.

Preprint

Efficient Long Sequence Modeling via State Space Augmented Transformer

Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao

December 2022

Preprint

Publication Github

AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

EMNLP | December 2022

Publication Project

AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models

Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2022 | December 2022

Publication Publication Project Project

Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone

Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang

NeurIPS 2022 | November 2022

Publication Project

Fault-Aware Neural Code Rankers

Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao

NeurIPS 2022 | November 2022

Publication Publication Project

Explaining Patterns in Data with Language Models via Interpretable Autoprompting

Chandan Singh, Jyoti Aneja, Jianfeng Gao

October 2022

Publication Github Project

Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models

Chandan Singh, Jianfeng Gao

September 2022

Publication Github

Interactive Code Generation via Test-Driven User-Intent Formalization

Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao

August 2022

Publication Project

Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages

Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky

ArXiv | August 2022, Vol abs/2208.06061

DOI Publication

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

IJCAI 2022 | July 2022

human parity result on CommonsenseQA

Publication

RegionCLIP: Region-based Language-Image Pretraining

Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao

CVPR 2022 | June 2022

Publication

GLIPv2: Unifying Localization and Vision-Language Understanding

Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao

NeurIPS 2022 | June 2022

Preprint

Publication Project

Grounded Language-Image Pre-training

Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao

CVPR | June 2022

Publication Project

OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience

Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang

June 2022

Publication Project

Unified Contrastive Learning in Image-Text-Label Space

Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao

CVPR 2022 | June 2022

Publication

Knowledge-Rich Self-Supervision for Biomedical Entity Linking

Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon

EMNLP 2022 | May 2022

Publication

GODEL: Large-Scale Pre-Training for Goal-Directed Dialog

Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao

May 2022

Publication Github Project

VLC: Training Vision-Language Transformers from Captions

Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

Proceedings of Transactions on Machine Learning Research | May 2022

Publication Project Project

Neurocompositional computing in human and machine intelligence: A tutorial

Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao

MSR-TR-2022-5 | May 2022

Published by Microsoft

52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).

Project

Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems

Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao

AI Mag. | May 2022, Vol 43: pp. 308-322

Publication Project

Open Domain Question Answering with A Unified Knowledge Interface

Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao

ACL 2022 | May 2022

Publication

K-LITE: Learning Transferable Visual Models with External Knowledge

Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao

NeurIPS 2022 | April 2022

Oral Presentation (1%)

Publication Project

ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models

Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao

NeurIPS (Datasets and Benchmarks Track) | April 2022

Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/

Publication

Efficient Self-supervised Vision Transformers for Representation Learning

Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao

ICLR 2022 | April 2022

Publication Publication Github

LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners

Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

NAACL 2022 | April 2022

Publication Github Project Project

METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals

Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao

April 2022

arXiv:2204.06644

Publication

No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models

Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao

ICLR 2022 | April 2022

Publication Publication

Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners

Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao

ArXiv | April 2022

Publication

Taming Sparsely Activated Transformer with Stochastic Experts

Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao

ICLR 2022 | April 2022

Publication Project

FocalNet: Focal Modulation Networks

Jianwei Yang, Chunyuan Li, Jianfeng Gao

2022 Neural Information Processing Systems | March 2022

Publication

Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, David Farhi, Jakub Pachocki, Xiaodong Liu, Weizhu Chen, Jianfeng Gao

NeurIPS 2021 | March 2022

PDF Publication Github

KAT: A Knowledge Augmented Transformer for Vision-and-Language

Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

NAACL 2022. Long paper, Oral. | January 2022

No.1 of OK-VQA Leaderboard (2021).

Publication Project

Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation

Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao

NAACL 2022 | December 2021

Publication

ValueNet: A New Dataset for Human Value Driven Dialogue System

Liang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu, Baolin Peng, Jianfeng Gao, Song-Chun Zhu

AAAI 2022 | December 2021

Publication

RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling

Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan

AAAI 2022 | December 2021

Publication

Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models

Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Awadallah, Bo Li

35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021

Publication

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Github Project

Focal Attention for Long-Range Interactions in Vision Transformers

Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Preprint Github

Florence: A New Foundation Model for Computer Vision

Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang

arXiv preprint arXiv:2111.11432 | November 2021

Publication Project

NICE: Neural Image Commenting with Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao

EMNLP 2021 | October 2021

Publication Project

Taming Sparsely Activated Transformer with Stochastic Experts.

Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Tuo Zhao, Jianfeng Gao, Hany Hassan Awadalla

October 2021

Publication Publication

Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding

Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao

ICCV 2021 | October 2021

Publication Github

TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment

Jianwei Yang, Yonatan Bisk, Jianfeng Gao

ICCV 2021 | October 2021

Publication

Very Deep Transformers for Neural Machine Translation

Xiaodong Liu, Kevin Duh, Liyuan Liu, Jianfeng Gao

October 2021

Publication Github

ARCH: Efficient Adversarial Regularized Training with Caching

Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao

2021 Empirical Methods in Natural Language Processing | September 2021

Publication

Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach

Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao

2021 Empirical Methods in Natural Language Processing | September 2021

Publication

Data Augmentation for Spoken Language Understanding via Pretrained Models

Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao

INTERSPEECH | September 2021

Publication

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon

KDD 2021 | August 2021

Publication Publication Project

Go-Figure: A Meta Evaluation of Factuality in Summarization

Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Preprint Publication

RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems

Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Publication

KB-VLP: Knowledge Based Vision and Language Pretraining

Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao

Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021

Publication Project

VinVL: Revisiting Visual Representations in Vision-Language Models

Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao

CVPR 2021 | June 2021

Publication Project

Targeted Adversarial Training for Natural Language Understanding

Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi

NAACL | June 2021

Publication Github

Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization

Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao

North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021

Publication

M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training

Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Jianfeng Gao, Dongdong Zhang, Nan Duan

CVPR 2021 | June 2021

Publication Project

XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation

Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao

ArXiv | June 2021

arXiv:2106.04563

Publication Github Project Project

Compositional Processing Emerges in Neural Networks Solving Math Problems

Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao

CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773

Publication Publication Project

DeBERTa: Decoding-Enhanced BERT with Disentangled Attention

Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen

2021 International Conference on Learning Representations | May 2021

Under review

PDF Publication Github Project Project

Joint Retrieval and Generation Training for Grounded Text Generation

Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan

May 2021

Publication

Text Editing by Command

Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan

NAACL | April 2021

PDF Publication

Contrastive Multi-document Question Generation

Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan

European Chapter of the Association for Computational Linguistics (EACL) | April 2021

PDF Publication Project

SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching

Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao

Transactions of the Association for Computational Linguistics | April 2021

PDF Video Github

Data Augmentation for Abstractive Query-Focused Multi-Document Summarization

Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao

AAAI 2021 | April 2021

Publication

Token-wise Curriculum Learning for Neural Machine Translation

Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao, Tuo Zhao

2021 Empirical Methods in Natural Language Processing | March 2021

Publication

Multi-domain Task-oriented Dialog Challenge II at DSTC9

Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao

AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021

Publication

VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training

Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu

AAAI | February 2021

PDF Publication Video Project Project

A Controllable Model of Grounded Response Generation

Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, Bill Dolan

AAAI 2021 | January 2021

PDF Publication Publication

Reader-Guided Passage Reranking for Open-Domain Question Answering

Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen

ACL-IJCNLP 2021 | December 2020

Publication

UnitedQA: A Hybrid Approach for Open Domain Question Answering

Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao

ACL-IJCNLP 2021 | December 2020

Publication

Self-supervised Pre-training with Hard Examples Improves Visual Representations.

Chunyuan Li, Xiujun Li, Lei Zhang, Baolin Peng, Mingyuan Zhou, Jianfeng Gao

December 2020

Publication

Learning Inference Rules with Neural TP-Reasoner

Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, workshop | December 2020

Publication Project Project

MiniVLM: A Smaller and Faster Vision-Language Model

Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu

arXiv preprint arXiv:2012.06946 | December 2020

Publication Project

Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language

Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang

ArXiv | November 2020, Vol abs/2011.09530

Publication

CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search

Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett

MSR-TR-2020-49 | November 2020

Published by Microsoft

The participation report of our top non-manual entry in TREC COVID Round 2.

PDF Publication

Few-shot Natural Language Generation for Task-Oriented Dialog

Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication Project

Posterior Differential Regularization with f-divergence for Improving Model Robustness

Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao

October 2020

Publication

NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020

Publication Publication Project

Generation-Augmented Retrieval for Open-domain Question Answering

Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen

ACL-IJCNLP 2021 | September 2020

Publication

HittER: Hierarchical Transformers for Knowledge Graph Embeddings

Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji

EMNLP 2021 | August 2020

Publication Github

Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks

Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao

ECCV | August 2020

Publication Video Github Project Project Project

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon

August 2020

PDF Video Download

Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations

Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

ICML 2020 | July 2020

Publication Project Project

MIND: A Large-scale Dataset for News Recommendation

Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou

ACL 2020 | July 2020

Publication Download

Recent Advances in Conversational Information Retrieval

Jianfeng Gao, Chenyan Xiong, Paul Bennett

SIGIR 2020 | July 2020

Tutorial Slides

Publication

Few-Shot Generative Conversational Query Rewriting

Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu

SIGIR 2020 | June 2020

Best Short Paper Award

PDF

Novel Human-Object Interaction Detection via Adversarial Domain Generalization

Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang

May 2020

Publication

OPTIMUS: Organizing Sentences via Pre-trained Modeling of a Latent Space

Chunyuan Li, Xiang Gao, Yuan Li, Xiujun Li, Baolin Peng, Yizhe Zhang, Jianfeng Gao

April 2020

Publication Github

Feature Quantization Improves GAN Training

Yang Zhao, Chunyuan Li, Ping Yu, Jianfeng Gao, Changyou Chen

April 2020

Publication Github

Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training

Weituo Hao, Chunyuan Li, Xiujun Li, Lawrence Carin, Jianfeng Gao

CVPR 2020 | April 2020

Publication Github

Adversarial Training for Large Neural Language Models

Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao

April 2020

Publication Github Project

ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems

Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang

ACL 2020 Demo | April 2020

Publication Project

On the Variance of the Adaptive Learning Rate and Beyond

Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han

Eighth International Conference on Learning Representations (ICLR) | April 2020

Publication PDF Project

RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering

Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin

Eighth International Conference on Learning Representations (ICLR) | April 2020

Publication PDF Github

SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization

Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao

April 2020

Publication Project

Multi-domain Task-oriented Dialog Challenge II

Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao

The Ninth Dialog System Technology Challenge | March 2020

PDF Project

UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training

Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon

February 2020

Publication Github Project

Vision-Language Navigation Policy Learning and Adaptation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020

Publication Publication Project Project

Complementary Auxiliary Classifiers for Label-Conditional Text Generation

Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao

AAAI 2020 | February 2020

Publication

Results of the Multi-Domain Task-Completion Dialog Challenge

Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada

Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020

PDF Project

Unified Vision-Language Pre-Training for Image Captioning and VQA

Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao

AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020

Publication

Unified Vision-Language Pre-Training for Image Captioning and VQA

Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao

AAAI | February 2020

Publication Project Project

The Eighth Dialog System Technology Challenge

Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K. Kummerfeld, Walter S. Lasecki, Chiori Hori, Anoop Cherian, Tim K. Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta

Third NeurIPS workshop on Conversational AI: “Today's Practice and Tomorrow's Potential” | December 2019

Publication Publication

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving

Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao

Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019

Publication PDF

The Eighth Dialog System Technology Challenge

Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K Kummerfeld, Walter S Lasecki, Chiori Hori, Anoop Cherian, Tim K Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta

The third Conversational AI workshop, NeurIPS | December 2019

Publication

TP-N2F: Tensor Product Representation for Natural To Formal Language Generation

Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019

Best Paper Award at KR2ML Workshop in NeurIPS 2019.

Publication PDF Project Project

Unified Language Model Pre-training for Natural Language Understanding and Generation

Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon

33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019

Publication Github Project

TIGEr: Text-to-Image Grounding for Image Caption Evaluation

Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao

EMNLP 2019 | November 2019

Publication Project

REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning

Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao

EMNLP 2019 | November 2019

Publication Project

DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation

Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan

arXiv:1911.00536 | November 2019

PDF Project Project

HUBERT Untangles BERT to Improve Transfer across NLP Tasks

Mehrad Moradshahi, Hamid Palangi, Monica S. Lam, Paul Smolensky, Jianfeng Gao

arxiv | October 2019

https://arxiv.org/abs/1910.12647

Publication

Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators

Kuang-Huei Lee *, Hamid Palangi *, Xi Chen, Houdong Hu, Jianfeng Gao

September 2019

* Equal contributions

Publication

Structuring Latent Spaces for Stylized Response Generation

Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan

EMNLP-IJCNLP 2019 | September 2019

Publication Project Project

DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain.

Yichong Xu, Xiaodong Liu, Chunyuan Li, Hoifung Poon, Jianfeng Gao

BioNLP 2019 | August 2019

PDF

Efficient Navigation with Language Pre-training and Stochastic Sampling

xiujun li, Chunyuan Li, Qiaolin Xia, Asli Celikyilmaz, Jianfeng Gao, Noah A. Smith, Yejin Choi

EMNLP-IJCNLP | August 2019

DOI

Budgeted Policy Learning for Task-Oriented Dialogue Systems

Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen

ACL 2019 | July 2019

Publication Project

ConvLab: Multi-Domain End-to-End Dialog System Platform

Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Xiang Li, Yaoqin Zhang, Zheng Zhang, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao

ACL | July 2019

PDF Publication Github Project Project

ConvLab: Multi-Domain End-to-End Dialog System Platform

Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Zheng Zhang, Yaoqin Zhang, Xiang Li, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao

Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations | July 2019

Publication

Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling

Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan

Association for Computational Linguistics 2019 | July 2019

Publication Project

Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models

Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin

ACL 2019 | July 2019

Publication

Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation

Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa

CVPR 2019 | June 2019

Oral

Publication

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang

CVPR 2019 | June 2019

Best Student Paper Award in CVPR 2019.

Publication Video Project Project Project

Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading

Lianhui Qin, Michel Galley, Chris Brockett, Xiaodong Liu, Xiang Gao, Bill Dolan, Yejin Choi, Jianfeng Gao

Proc. of ACL | June 2019

PDF Project Project

Multi-Task Deep Neural Networks for Natural Language Understanding

Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

ACL 2019 | June 2019

Publication Project

Neural Approaches to Conversational AI – Tutorial at ICML 2018

Jianfeng Gao, Michel Galley

ICML 2019 Tutorial | June 2019

PDF

Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding

Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

April 2019

PDF Publication Github Project

StoryGAN: A Sequential Conditional GAN for Story Visualization

Yitong Li, Zhe Gan, Yelong Shen, JJ (Jingjing) Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson, Jianfeng Gao

CVPR 2019 | April 2019

PDF Publication

Consistent Dialogue Generation with Self-supervised Feature Learning

Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan

preprint | March 2019

Publication

Jointly Optimizing Diversity and Relevance in Neural Response Generation

Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan

NAACL-HLT 2019 | March 2019

Publication Project

Multi-Domain Task-Completion Dialog Challenge

Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li

Dialog System Technology Challenges 8 | March 2019

PDF Project Project

Object-driven Text-to-Image Synthesis via Adversarial Training

Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao

CVPR 2019 | February 2019

PDF Publication Project

Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing

Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin

NAACL 2019 | February 2019

PDF

Neural Approaches to Conversational AI

Jianfeng Gao, Michel Galley, Lihong Li

Foundations and Trends in Information Retrieval | February 2019

Publication Project Project Project Project Project

Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning

Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun

AAAI 2019 | January 2019

Publication Project

Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning

Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang

AAAI 2019 | January 2019

Publication Project

The Design and Implementation of XiaoIce, an Empathetic Social Chatbot

Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou

MSR-TR-2018-42 | December 2018

Published by Microsoft

Publication Project Project

Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization

Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan

NeurIPS 2018 | December 2018

Publication Project Project Project

M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search

Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao

NIPS 2018 | December 2018

Publication

Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models

Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He

NIPS 2018 | December 2018

Publication

Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning

Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Yun-Nung Chen, Kam-Fai Wong

2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | December 2018

Publication

Deep dyna-q: Integrating planning for task-completion dialogue policy learning

Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Kam-Fai Wong, Shang-Yu Su

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | December 2018

Publication

Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning

Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen

EMNLP 2018 | October 2018

Publication Publication Project Project

Subgoal Discovery for Hierarchical Dialogue Policy Learning

Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara

EMNLP 2018 | October 2018

Publication Project Project Project

Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems

Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao

SLT 2018 | July 2018

Publication Project

Neural Approaches to Conversational AI – Tutorial at ACL/SIGIR 2018

Jianfeng Gao, Michel Galley, Lihong Li

ACL and SIGIR tutorial | July 2018

ACL and SIGIR tutorial

Publication Project

Discourse-Aware Neural Rewards for Coherent Text Generation

Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi

2018 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2018) | July 2018

Publication

Systems and methods for automated query answer generation

Saurabh Kumar Tiwary, Mir Rosenberg, Jianfeng Gao, Xia Song, Rangan Majumder, Li Deng

June 2018

Publication Project Project

Link Prediction using Embedded Knowledge Graphs

Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao

arXiv | April 2018

Publication Publication Project

Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning

Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong

ICASSP 2018 | April 2018

Publication Project

Dynamic Fusion Networks for Machine Reading Comprehension

Yichong Xu, JJ (Jingjing) Liu, Jianfeng Gao, Yelong Shen, Xiaodong Liu

February 2018

PDF Github

M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search

Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao

February 2018

arXiv preprint

Publication

A Knowledge-Grounded Neural Conversation Model

Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Scott Wen-tau Yih, Michel Galley

AAAI | February 2018

Publication Project Project Project

BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems

Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng

AAAI 2018 | February 2018

Publication Publication Project

Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning

Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su

ACL 2018 | January 2018

Publication Publication Project

Language-Based Image Editing with Recurrent Attentive Models

Jianbo Chen, Yelong Shen, Jianfeng Gao, Xiaodong Liu, Jingjing Liu, Jianfeng Gao

MSR-TR-2017-50 | December 2017

The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Publication Project

Stochastic Answer Networks for Machine Reading Comprehension

Jianfeng Gao, Xiaodong Liu, Yelong Shen, Kevin Duh

MSR-TR-2017-51 | December 2017

Publication Project

The MSR-NLP System at Dialog System Technology Challenges 6

Michel Galley, Chris Brockett, Bill Dolan, Jianfeng Gao

Dialog System Technology Challenges (DSTC) | November 2017

Publication Project

Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation

Nasrin Mostafazadeh, Chris Brockett, Bill Dolan, Michel Galley, Jianfeng Gao, Georgios P. Spithourakis, Lucy Vanderwende

IJCNLP | November 2017

Publication Project Project Project

Multi-Task Learning of Speaker-Role-Based Neural Conversation Models

Yi Luan, Chris Brockett, Bill Dolan, Jianfeng Gao, Michel Galley

IJCNLP | November 2017

Publication Project

End-to-End Task-Completion Neural Dialogue Systems

Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz

the 8th International Joint Conference on Natural Language Processing | November 2017

Publication Project

Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning

Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong

Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017

Publication Publication Project

Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning

Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Li, Kam-Fai Wong

Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing | September 2017

Publication

ReasoNet: Learning to Stop Reading in Machine Comprehension

Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen

23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017

Publication Publication Project

Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access

Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng

Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017

Publication Publication Project

Introduction to Deep Learning for Natural Language Processing (Tutorial at DeepLearning2017 summer school in Bilbao)

Jianfeng Gao

MSR-TR-2017-36 | July 2017

Publication Project Project Project Project

Semantic Compositional Networks for Visual Captioning

Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng

Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017

Publication Publication

StyleNet: Generating Attractive Visual Captions with Styles

Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng

Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017

Publication

A Nested Attention Neural Hybrid Model for Grammatical Error Correction

Jianfeng Gao

ACL 2017 | July 2017

Publication

Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems

Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz

March 2017

Publication Project

End-To-End Joint Learning of Natural Language Understanding and Dialog Manager

Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng

The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017

Publication Project

Character-level Deep Conflation for Business Data Analytics

Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng

ICASSP 2017 | February 2017

Publication Publication Project

Learning for Efficient Supervised Query Expansion via Two-stage Feature Selection

Zhiwei Zhang, Qifan Wang, Luo Si, Jianfeng Gao

SIGIR 16 | January 2017

Publication

A User Simulator for Task-Completion Dialogues

Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen

December 2016, pp. 14

Publication Project

Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing

Yun-Nung (Vivian) Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng

December 2016

Publication

MS MARCO: A Human Generated MAchine Reading COmprehension Dataset

Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng

November 2016

Publication Publication Download Project Project Project

TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency

Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley

November 2016

Publication Publication

Bi-directional Attention with Agreement for Dependency Parsing

Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng

EMNLP | November 2016

Publication Publication

Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads

Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng

EMNLP 2016 | November 2016

Publication Publication

Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks

Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng

MSR-TR-2016-61 | September 2016

arXiv:1609.03286

Publication

End-to-End Reinforcement Learning of Dialogue Agents for Information Access

Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng

MSR-TR-2016-63 | September 2016

Publication Project

Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking

Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng

MSR-TR-2016-62 | August 2016

arXiv:1608.05081

Publication Project

Deep Reinforcement Learning with a Natural Language Action Space

Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016

Publication

MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition

Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao

ECCV 2016 | August 2016

Publication Publication

Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)

Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao

IJCAI 2016 | July 2016

Publication

A Proposal for Evaluating Answer Distillation from Web Data

Bhaskar Mitra, Grady Simon, Jianfeng Gao, Nick Craswell, Li Deng

Proceedings of the Second WebQA Workshop (SIGIR 2016) | July 2016

Publication

Stacked Attention Networks for Image Question Answering

Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola

CVPR 2016 | June 2016

Publication Publication Project

Deep Reinforcement Learning for Dialogue Generation

Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Dan Jurafsky

Proc. of EMNLP | June 2016

Publication Publication Project Project

End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding

Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng

Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016

Publication

Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM

Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang

Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016

Publication Project

A Persona-Based Neural Conversation Model

Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan

Proc. of ACL | June 2016

Publication Publication Project Project Project Project

Reasoning in Vector Space: An Exploratory Study of Question Answering

Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky

Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016

Publication

A Diversity-Promoting Objective Function for Neural Conversation Models

Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan

Proc. of NAACL-HLT | March 2016

Publication Publication Project Project Project Project

Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval

Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward

IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2016

Publication Publication

Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]

Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward

IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694

Publication Publication Project

Basic Reasoning with Tensor Product Representations

Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng

January 2016

Publication

End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation

Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng

NIPS | December 2015

Publication

Deep Reinforcement Learning with an Action Space Defined by Natural Language

Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf

ICML 2016 | November 2015

PDF Publication

Recurrent Reinforcement Learning: A Hybrid Approach

Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He

MSR-TR-2015-98 | September 2015

Proceedings of COLING-94, Kyoto, Japan

Publication

Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base

Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao

Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015

Outstanding Paper Award

Publication Publication Project Project

ˆ†BLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets

Michel Galley, Chris Brockett, Alessandro Sordoni, Yangfeng Ji, Michael Auli, Chris Quirk, Margaret Mitchell, Jianfeng Gao, Bill Dolan

Proc. of ACL | July 2015

Publication Publication Project Project

A Deep Embedding Model for Co-occurrence Learning

Yelong Shen, Ruoming Jin, Jianshu Chen, Xiaodong He, Jianfeng Gao, Li Deng

June 2015

Publication

A Neural Network Approach to Context-Sensitive Generation of Conversational Responses

Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Meg Mitchell, Jian-Yun Nie, Jianfeng Gao, Bill Dolan

Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT) | June 2015

Publication Publication Download Project Project Project

From Captions to Visual Concepts and Back

Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig

CVPR 2015 | June 2015

Tied for 1st Prize

Publication Project Project

Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)

Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao

May 2015

Publication

Embedding Entities and Relations for Learning and Inference in Knowledge Bases

Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng

Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015

Publication Publication Project

Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval

Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang

May 2015

Publication

Deep Learning for Web Search and Natural Language Processing

Jianfeng Gao, Xiaodong He, Li Deng

MSR-TR-2015-7 | January 2015

Publication

Learning Multi-Relational Semantics Using Neural-Embedding Models

Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng

NIPS 2014 workshop on Learning Semantics | December 2014

Publication Publication

A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval

Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil

CIKM | November 2014

Publication Project

Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)

Xiaodong He, Jianfeng Gao, Li Deng

CIKM | November 2014

Publication

Large-scale Expected BLEU Training of Phrase-based Reordering Models

Michael Auli, Michel Galley, Jianfeng Gao

Proc. of EMNLP | October 2014

Publication

Modeling Interestingness with Deep Neural Networks

Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng

MSR-TR-2014-56 | October 2014

Publication Project

Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model

Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng

MSR-TR-2014-109 | August 2014

Publication

Online Classification Using a Voted RDA Method

Tianbing Xu, Jianfeng Gao, Lin Xiao, Amelia C. Regan

Proceedings of the AAAI Conference on Artificial Intelligence | July 2014

Publication

Decoder Integration and Expected BLEU Training for Recurrent Neural Network Language Models

Michael Auli, Jianfeng Gao

June 2014

Publication

Learning Continuous Phrase Representations for Translation Modeling

Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng

Proceedings of ACL | June 2014

Publication

Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)

Xiaodong He, Jianfeng Gao, Li Deng

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014

Publication

A Convolutional Latent Semantic Model for Web Search

Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil

MSR-TR-2014-55 | April 2014

Publication Publication

Learning Semantic Representations Using Convolutional Neural Networks for Web Search

Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil

April 2014

Publication Project

Minimum Translation Modeling with Recurrent Neural Networks

Yuening Hu, Michael Auli, Qin Gao, Jianfeng Gao

April 2014

Publication

Learning Deep Structured Semantic Models for Web Search using Clickthrough Data

Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck

October 2013

Publication Publication Project

A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing

Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He

MSR-TR-2013-89 | September 2013

Publication

Learning Semantic Representations for the Phrase Translation Model

Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng

MSR-TR-2013-88 | September 2013

Publication

Modeling Click-through Based Word-pairs for Web Search

Jagadeesh Jagarlamudi, Jianfeng Gao

August 2013

Publication

Query Expansion Using Path-constrained Random Walks

Jianfeng Gao, Gu Xu, Jinxi Xu

SIGIR 2013, Dublin, Ireland. | August 2013

Publication

Beyond Left-to-Right: Multiple Decomposition Structures for SMT

Hui Zhang, Kristina Toutanova, Chris Quirk, Jianfeng Gao

NAACL | June 2013

Publication

Training MRF-Based Phrase Translation Models using Gradient Ascent

Jianfeng Gao, Xiaodong He

The North American Chapter of the Association for Computational Linguistics (NAACL) | June 2013

Publication

Deep Stacking Networks for Information Retrieval

Li Deng, Xiaodong He, Jianfeng Gao

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013

Publication

End-To-End Learning of Parsing Models for Information Retrieval

Jennifer Gillenwater, Xiaodong He, Jianfeng Gao, Li Deng

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013

Publication

Towards Concept-based Translation Models using Search Logs for Query Expansion

Jianfeng Gao, Jian-Yun Nie

November 2012

Publication

Combining Signals for Cross-Lingual Relevance Feedback

Katrina Parton, Jianfeng Gao

AIRS2012 | August 2012

Publication

Learning Lexicon Models from Search Logs for Query Expansion

Jianfeng Gao, Shasha Xie, Xiaodong He, Alnur Ali

Proceedings of EMNLP | July 2012

Publication

MSR SPLAT, A Language Analysis Toolkit

Chris Quirk, Pallavi Choudhury, Jianfeng Gao, Hisami Suzuki, Kristina Toutanova, Michael Gamon, Scott Wen-tau Yih, Lucy Vanderwende, Colin Cherry

Proceedings of NAACL-HLT 2012 | June 2012

Publication

A Unified Approach To Transliteration-based Text Input With Online Spelling Correction

Hisami Suzuki, Jianfeng Gao

Proceedings of EMNLP | May 2012

Publication

Statistical Translation and Web Search Ranking

Jianfeng Gao

ACL/SIGIR Summer School | August 2011

Publication

Clickthrough-Based Latent Semantic Models for Web Search

Jianfeng Gao, Kristina Toutanova, Scott Wen-tau Yih

Proceedings of the Thirty-Fourth Annual International ACM SIGIR Conference | July 2011

Publication

Domain Adaptation via Pseudo In-Domain Data Selection

Amittai Axelrod, Xiaodong He, Jianfeng Gao

EMNLP | July 2011

Publication

The MSRA Machine Translation System for IWSLT-2010

Henry Li, Nan Duan, Yinggong Zhao, Shujie Liu, Lei Cui, Mei-Yuh Hwang, Amittai Axelrod, Jianfeng Gao, Yaodong Zhang, Li Deng

Proc. the 7th International Workshop on Spoken Language Translation (IWSLT2010), Paris, France | December 2010

Publication

A Large Scale Ranker-Based System for Search Query Spelling Correction

Jianfeng Gao, Chris Quirk, Xiaolong(Shiao-Long) Li

The 23rd International Conference on Computational Linguistics | August 2010

Publication

A Comparison of Unsupervised Methods for Part-of-Speech Tagging in Chinese

Alex Cheng, Fei Xia, Jianfeng Gao

Coling 2010 Organizing Committee | August 2010

Publication

A Comparative Study of Bing Web N-gram Language Models for Web Search and Natural Language Processing

Jianfeng Gao, Patrick Nguyen, Xiaolong(Shiao-Long) Li, Chris Thrasher, Mu Li, Kuansan Wang

Proceeding of the 33rd Annual ACM SIGIR Conference | July 2010

Publication

Multi-Style Language Model for Web Scale Information Retrieval

Kuansan Wang, Xiaolong(Shiao-Long) Li, Jianfeng Gao

Proceedings of the 33rd Annual ACM SIGIR Conference (SIGIR'2010), 19-23 July 2010, Geneva, Switzerland | July 2010

Publication

Adapting Bboosting for Information Retrieval Measures

Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Jianfeng Gao

Information Retrieval | June 2010, Vol 13: pp. 254-270

Publication

Learning Phrase-Based Spelling Error Models from Clickthrough Data

Xu Sun, Jianfeng Gao, Daniel Micol, Chris Quirk

ACL 2010 | May 2010

Publication

Exploring Web Scale Language models for Search Query Processing

Jian Huang, Jianfeng Gao, Jiangbo Miao, Xiaolong(Shiao-Long) Li, Kuansan Wang, Fritz Behr

Proceedings of the 19th International World Wide Web Conference (WWW'2010), Raleigh, NC | April 2010

Publication

Clickthrough-Based Translation Models for Web Search: from Word Models to Phrase Models

Jianfeng Gao, Xiaodong He, Jian-Yun Nie

CIKM | January 2010

Publication

Discovery of Term Variation in Japanese Web Search Queries

Hisami Suzuki, Xiao Li, Jianfeng Gao

Proceedings of EMNLP | August 2009

Publication

Model Adaptation via Model Interpolation and Boosting for Web Search Ranking

Jianfeng Gao, Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Yi Su, Nazan Khan, Shalin Shah, Hongyan Zhou

EMNLP | August 2009

Publication

Smoothing Clickthrough Data for Web Search Ranking

Jianfeng Gao, Wei Yuan, Xiao Li, Kefeng Deng, Jian-Yun Nie

SIGIR | July 2009

Publication

Using Statistical Techniques and Web Search to Correct ESL Errors

Michael Gamon, Claudia Leacock, Chris Brockett, Bill Dolan, Dmitriy Belenko, Alexandre Klementiev, Jianfeng Gao

Calico Journal | June 2009, Vol 26(3)

Publication

Improved Monolingual Hypothesis Alignment for Machine Translation System Combination

Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore

ACM Transactions on Asian Language Information Processing -- special issue on Machine Translation of Asian Languages | January 2009

Publication

Ranking, Boosting, and Model Adaptation

Chris J. C. Burges, Krysta M. Svore, Qiang Wu, Jianfeng Gao

MSR-TR-2008-109 | October 2008

Publication

Selecting good expansion terms for pseudo-relevance feedback

Guihong Cao, Jian-Yun Nie, Jianfeng Gao, Stephen Robertson

SIGIR 2008: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval | August 2008

ISBN: 978-1-600558-164-4

Publication

A Web-based English Proofing System for English as a Second Language Users

Xing Yi, Jianfeng Gao, Bill Dolan

International Joint Conference on Natural Language Processing (IJCNLP) | January 2008

Publication

Bayesian Semi-supervised Chinese Word Segmentation for Statistical Machine Translation

Jia Xu, Jianfeng Gao, Kristina Toutanova, Hermann Ney

In Proceedings of Coling | January 2008

Publication

Indirect-HMM-based Hypothesis Alignment for Combining Outputs from Machine Translation Systems

Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore

EMNLP | January 2008

Publication

The MSR-MSRA MT System for NIST Open Machine Translation 2008 Evaluation

Xiaodong He, Jianfeng Gao, Chris Quirk, Patrick Nguyen, Arul Menezes, Robert Moore, Kristina Toutanova, Mei Yang, Bill Dolan, Mu Li, Chi-Ho Li, Dongdong Zhang, Long Jiang, Ming Zhou, Henry Li

The 2008 NIST Open Machine Translation Evaluation Workshop | January 2008

Publication

Using Contextual Speller Techniques and Language Modeling for ESL Error Correction

Michael Gamon, Jianfeng Gao, Chris Brockett, Alexander Klementiev, Bill Dolan, Dmitriy Belenko, Lucy Vanderwende

Proceedings of IJCNLP, Hyderabad, India | January 2008

Publication Publication Project

Microsoft Research Treelet Translation System: NIST MT Evaluation 06

Xiaodong He, Arul Menezes, Chris Quirk, Anthony Aue, Simon Corston-Oliver, Jianfeng Gao, Patrick Nguyen

MSR-TR-2007-144 | November 2007

Publication Publication

MSRLM: a Scalable Language Modeling Toolkit

Patrick Nguyen, Jianfeng Gao, Milind Mahajan

MSR-TR-2007-144 | November 2007

Publication

Foundations of Statistical Natural Language Processing: A Case Study of Text Input System

Jianfeng Gao, Hisami Suzuki

August 2007 | Tutorial slides at the MSR Weihai Summer School, August 2007 edition edition

Tutorial slides at the MSR Weihai Summer School, August 2007

Publication

A System to Mine Large-Scale Bilingual Dictionaries from Monolingual Web Pages

Guihong Cao, Jianfeng Gao, Jian-Yun Nie

July 2007

Publication

A Comparative Study of Parameter Estimation Methods for Statistical Natural Language Processing

Jianfeng Gao, Galen Andrew, Mark Johnson, Kristina Toutanova

Annual Meeting of the Association for Computational Linguistics (ACL) | January 2007

Publication

A Comparison of Bayesian Estimators for Unsupervised Hidden Markov Model POS Taggers

Jianfeng Gao, Mark Johnson

January 2007

Publication

Extending Query Translation to Cross-language Query Expansion with Markov Chain Models

Guihong Cao, Jianfeng Gao, Jian-Yun Nie, Jing Bai

CIKM | January 2007

Publication

Scalable Training of L1-Regularized Log-Linear Models

Galen Andrew, Jianfeng Gao

International Conference on Machine Learning | January 2007

Publication

Study of Statistical Models for Query Translation: Finding a Good Unit of Translation

Jianfeng Gao, Jian-Yun Nie

SIGIR | October 2006

Publication

A Comparative Study of Discriminative Methods for Reranking LVCSR N-Best Hypotheses in Domain Adaptation and Generalization

Zhengyu Zhou, Jianfeng Gao, Frank Soong, Helen Meng

ACL/SIGPARSE | April 2006

Publication

A Comparative Study on Language Model Adaptation Using New Evaluation Metrics

Jianfeng Gao, Hisami Suzuki, Wei Yuan

Proceedings of EMNLP | April 2006

Publication Publication

Statistical Query Translation Models for Cross- Language Information Retrieval

Jianfeng Gao, Jian-Yun Nie, Ming Zhou

ACM Trans on Asian Language Information Processing | February 2006, pp. 323-359

Publication

A Supervised Learning Approach to Entity Search

Guoping Hu, JJ (Jingjing) Liu, Hang Li, Yunbo Cao, Jian-Yun Nie, Jianfeng Gao

AIRS 2006 | January 2006

Publication

Approximation Lasso Methods for Language Modeling

Jianfeng Gao, Hisami Suzuki, Bin Yu

Proceedings of ACL | January 2006

Publication

Microsoft Research IME Corpus

Hisami Suzuki, Jianfeng Gao

MSR-TR-2005-168 | December 2005

Publication Download

Person Resolution in Person Search Results: WebHawk

Xiaojun Wan, Jianfeng Gao, Mu Li, Binggong Ding

CIKM'05, Bremen, Germany | October 2005

Publication

Minimum Sample Risk Methods for Language Modeling

Jianfeng Gao, Hao Yu, Wei Yuan, Peng Xu

HLT/EMNLP | October 2005

Publication

Automatic Acquisition of Chinese-English Parallel Corpus from the Web

Ying Zhang, Ke Wu, Jianfeng Gao, Phil Vines

October 2005

Publication

An Information-Theoretic Approach to Automatic Evaluation of Summaries

Chin-Yew Lin, Guihong Cao, Jianfeng Gao, Jian-Yun Nie

August 2005

Publication Publication

Chinese Word Segmentation and Named Entity Recognition: A Pragmatic Approach

Jianfeng Gao, Mu Li, Andi Wu, Chang-Ning Huang

Computational Linguistics | June 2005, Vol 31(4): pp. 44

Publication

An Empirical Study on Language Model Adaptation Using a Metric of Domain Similarity

Wei Yuan, Jianfeng Gao, Hisami Suzuki

IJCNLP 2005, LNAI 3651 | February 2005

Publication

A DOM Tree Alignment Model for Mining Parallel Data from the Web

Lei Shi, Cheng Niu, Ming Zhou, Jianfeng Gao

COLING-ACL | January 2005

Publication

Adaptive Chinese Word Segmentation

Jianfeng Gao, Andi Wu, Mu Li, Chang-Ning Huang, Hongqiao Li, Xinsong Xia, Haowei Qin

July 2004

Publication Download

Dependence Language Model for Information Retrieval

Jianfeng Gao, Jian-Yun Nie, Guangyuan Wu, Guihong Cao

July 2004

Publication

Introduction to the Special Issue on Statistical Language Modeling

Jianfeng Gao, Chin-Yew Lin

ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93

Publication Publication

Capturing Long Distance Dependency in Language Modeling: An Empirical Study

Jianfeng Gao, Hisami Suzuki

International Conference on Natural Language Processing | May 2004

Publication Publication

Mining Web Logs for Actionable Knowledge

Qiang Yang, Charles X. Ling, Jianfeng Gao

Intelligent Technologies for Information Analysis | Published by Springer | 2004

Publication

The Use of SVM for Chinese New Word Identification

Hongqiao Li, Chang-Ning Huang, Jianfeng Gao, Xiaozhong Fan

March 2004

Publication

Linear Discriminant Model for Information Retrieval

Jianfeng Gao, Haoliang Qi, Xinsong Xia, Jian-Yun Nie

January 2004

Publication Publication

Improved Source-Channel Models for Chinese Word Segmentation

Jianfeng Gao, Mu Li, Chang-Ning Huang

July 2003

Publication Publication

Unsupervised Learning of Dependency Structure for Language Modeling

Jianfeng Gao, Hisami Suzuki

July 2003

Publication Publication

Exploiting Headword Dependency and Predictive Clustering for Language Modeling

Jianfeng Gao, Hisami Suzuki, Yang Wen

Proceedings for EMNLP | July 2002

Publication

Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependency relations

Jianfeng Gao, Jian-Yun Nie, Hongzhao He, Weijun Chen, Ming Zhou

SIGIR | May 2002

Publication Publication

Exploring Asymmetric Clustering for Statistical Language Modeling

Jianfeng Gao, Joshua Goodman, Guihong Cao, Hang Li

ACL | May 2002

Publication

NTCIR-3 CLIR Experiments at MSRA

Hongzhao He, Jianfeng Gao

May 2002

Publication

Improving Encarta Search Engine Performance by Mining User Logs

Charles X. Ling, Jianfeng Gao, Huajie Zhang, Weining Qian, Hongjiang Zhang

International Journal of Pattern Recognition and Artificial Intelligence | April 2002, Vol 16(8)

Publication

Improving Query Translation for CLIR Using Statistical Models

Jianfeng Gao, Jian-Yun Nie, Endong Xun, Jian Zhang, Ming Zhou, Changning Huang

SIGIR'01, New Orleans, Lousiana, USA | September 2001

Publication

TREC-10 Web Track Experiments at MSRNCN

Jianfeng Gao, Guihong Cao, Hongzhao He, Min Zhang, Jian-Yun Nie, Stephen Walker, Stephen Robertson

TREC-10 | May 2001

Publication

Improving the Effectiveness of Information Retrieval with Clustering and Fusion

Jian Zhang, Jianfeng Gao, Ming Zhou, Jiaxing Wang

Computational Linguistics and Chinese Language Processing | April 2001, pp. 109-125

Publication

The Use of Clustering Techniques for Language Modeling – Application to Asian Languages

Jianfeng Gao, Joshua Goodman, Jiangbo Miao

Computational Linguistics and Chinese Language Processing | April 2001, pp. 27-60

Publication

Distribution-based Pruning of Backoff Language Models

Jianfeng Gao, Kai-Fu Lee

October 2000

Publication Publication

Extraction of Chinese Compound Words – An Experimental Study on a Very Large Corpus

Jian Zhang, Jianfeng Gao, Zhou Ming

October 2000

Publication Publication

Language Model Compression by Predictive Clustering

Joshua Goodman, Jianfeng Gao

October 2000

Publication

Language Model Size Reduction by Pruning and Clustering

Jianfeng Gao, Joshua Goodman

Proceedings International Conference on Spoken Language Processing | October 2000

Publication

Lexicon Optimization for Chinese Language Modeling

Jun Zhao, Jianfeng Gao, Eric Chang, Mingjing Li

October 2000

Publication

N-gram Distribution Based Language Model Adaptation

Jianfeng Gao, Mingjing Li, Kai-Fu Lee

October 2000

Publication

PENS: A Machine-aided English Writing System for Chinese Users

Ting Liu, Ming Zhou, Jianfeng Gao, Endong Xun, Changning Huang

October 2000

Publication Publication

On the Use of Words and N-grams for Chinese Information Retrieval

Jian Zhang, Jian-Yun Nie, Jianfeng Gao, Zhou Ming

September 2000

Publication

A Unified Approach to Statistical Language Modeling for Chinese

Jianfeng Gao, Hai-Feng Wang, Mingjing Li Li, Kai-Fu Lee

June 2000

Publication

TREC-9 CLIR experiments at MSRCN

Jianfeng Gao, Jian-Yun Nie, Jian Zhang, Endong Xun, Yi Su, Ming Zhou, Chang-Ning Huang

TREC-9 | April 2000

Publication

Case and Constraint: Research on Intelligent CAD Systems (In Chinese)

Joshua Goodman, Jianfeng Gao

April 1999

PhD Thesis: Shanghai Jiaotong University | April 1999

Publication

A whole-slide foundation model for digital pathology from real-world data

Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier González, Yu Gu, Yanbo Xu, Mu-Hsin Wei, Wenhui Wang, Shuming Ma, Furu Wei, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Jaylen Rosemon, Tucker Bower, Soohee Lee, R. Weerasinghe, Bill Wright, Ari Robicsek, Brian Piening, Carlo Bifulco, Sheng Wang, Hoifung Poon

Nature | May 2024

Publication DOI Publication

Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs

Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao

ICLR 2024 (Oral) | May 2024

DOI Publication PDF

LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering

Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao

Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263

Publication Project Project

Agent AI Towards a Holistic Intelligence

Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao

arXiv: 2403.00833 | February 2024

Publication Publication Project

An Interactive Agent Foundation Model

Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang

February 2024

Publication Publication Project

TrustLLM: Trustworthiness in Large Language Models

Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao

ICML 2024 | January 2024

DOI Publication Publication

MindAgent: Emergent Gaming Interaction

Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao

Processings of NAACL 2024 | January 2024

Publication Project Project

Agent AI: Surveying the Horizons of Multimodal Interaction

Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao

arXiv: 2401.03568 | January 2024

Publication Project

Bridging Discrete and Backpropagation: Straight-Through and Beyond

Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao

NeurIPS 2023 (Oral) | December 2023

Publication Github

Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs

Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao

ICLR 2024 | November 2023

DOI Publication

Tree Prompting: Efficient Task Adaptation without Fine-Tuning

Chandan Singh, Jianfeng Gao

EMNLP | November 2023

Publication

Fast-ELECTRA for Efficient Pre-training

Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu

ICLR 2024 | October 2023

DOI Publication

MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts

Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao

ICLR 2024 | October 2023

Publication

Multimodal Agent — Localized Symbolic Knowledge Distillation for Visual Commonsense Models

Jae Sung Park, Jack Hessel, Khyathi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi

Proceedings of NeurIPS 2023 | October 2023

Publication Project

Augmenting Language Models with Long-Term Memory

Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei

NeurIPS 2023 | October 2023

Publication

Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models

Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao

NeurIPS 2023 | October 2023

Publication

Multimodal Foundation Models: From Specialists to General-Purpose Assistants

Chunyuan Li, Zhe Gan, Zhengyuan Yang, Jianwei Yang, Linjie Li, Lijuan Wang, Jianfeng Gao

September 2023

118-page book/survey on the literature review, evolution, trends and our position on multimodal foundation models. CVPR 2023 Tutorial: https://vlp-tutorial.github.io/2023/

Publication Project

Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering

Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao

ACL 2023 | July 2023

Publication

Is Self-Repair a Silver Bullet for Code Generation?

Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama

ICLR 2024 | June 2023

Publication

Self-Verification Improves Few-Shot Clinical Information Extraction

Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon

May 2023

Publication

Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models

Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao

Proceedings of ACL 2023 | May 2023

Publication Publication Project Project

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication Project

ArK: Augmented Reality with Knowledge Emergent Infrastructure

Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao

Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023

Publication Project Project

Instruction Tuning with GPT-4

Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao

MSR-TR-2023-35 | April 2023

Published by Microsoft

Project Page: https://instruction-tuning-with-gpt-4.github.io/

Publication Project

Check your facts and try again: Improving large language models with external knowledge and automated feedback

Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao

MSR-TR-2023-46 | March 2023

Published by Microsoft

Publication Project

Efficient Long Sequence Modeling via State Space Augmented Transformer

Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao

December 2022

Preprint

Publication Github

AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

EMNLP | December 2022

Publication Project

AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models

Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2022 | December 2022

Publication Publication Project Project

Fault-Aware Neural Code Rankers

Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao

NeurIPS 2022 | November 2022

Publication Publication Project

Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone

Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang

NeurIPS 2022 | November 2022

Publication Project

Explaining Patterns in Data with Language Models via Interpretable Autoprompting

Chandan Singh, Jyoti Aneja, Jianfeng Gao

October 2022

Publication Github Project

Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models

Chandan Singh, Jianfeng Gao

September 2022

Publication Github

Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages

Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky

ArXiv | August 2022, Vol abs/2208.06061

DOI Publication

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

IJCAI 2022 | July 2022

human parity result on CommonsenseQA

Publication

RegionCLIP: Region-based Language-Image Pretraining

Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao

CVPR 2022 | June 2022

Publication

GLIPv2: Unifying Localization and Vision-Language Understanding

Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao

NeurIPS 2022 | June 2022

Preprint

Publication Project

Grounded Language-Image Pre-training

Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao

CVPR | June 2022

Publication Project

OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience

Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang

June 2022

Publication Project

Unified Contrastive Learning in Image-Text-Label Space

Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao

CVPR 2022 | June 2022

Publication

Knowledge-Rich Self-Supervision for Biomedical Entity Linking

Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon

EMNLP 2022 | May 2022

Publication

GODEL: Large-Scale Pre-Training for Goal-Directed Dialog

Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao

May 2022

Publication Github Project

VLC: Training Vision-Language Transformers from Captions

Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

Proceedings of Transactions on Machine Learning Research | May 2022

Publication Project Project

Neurocompositional computing in human and machine intelligence: A tutorial

Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao

MSR-TR-2022-5 | May 2022

Published by Microsoft

52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).

Project

Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems

Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao

AI Mag. | May 2022, Vol 43: pp. 308-322

Publication Project

K-LITE: Learning Transferable Visual Models with External Knowledge

Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao

NeurIPS 2022 | April 2022

Oral Presentation (1%)

Publication Project

ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models

Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao

NeurIPS (Datasets and Benchmarks Track) | April 2022

Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/

Publication

METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals

Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao

April 2022

arXiv:2204.06644

Publication

Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners

Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao

ArXiv | April 2022

Publication

No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models

Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao

ICLR 2022 | April 2022

Publication Publication

Taming Sparsely Activated Transformer with Stochastic Experts

Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao

ICLR 2022 | April 2022

Publication Project

Efficient Self-supervised Vision Transformers for Representation Learning

Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao

ICLR 2022 | April 2022

Publication Publication Github

LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners

Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

NAACL 2022 | April 2022

Publication Github Project Project

FocalNet: Focal Modulation Networks

Jianwei Yang, Chunyuan Li, Jianfeng Gao

2022 Neural Information Processing Systems | March 2022

Publication

Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, David Farhi, Jakub Pachocki, Xiaodong Liu, Weizhu Chen, Jianfeng Gao

NeurIPS 2021 | March 2022

PDF Publication Github

KAT: A Knowledge Augmented Transformer for Vision-and-Language

Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

NAACL 2022. Long paper, Oral. | January 2022

No.1 of OK-VQA Leaderboard (2021).

Publication Project

Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation

Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao

NAACL 2022 | December 2021

Publication

ValueNet: A New Dataset for Human Value Driven Dialogue System

Liang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu, Baolin Peng, Jianfeng Gao, Song-Chun Zhu

AAAI 2022 | December 2021

Publication

RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling

Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan

AAAI 2022 | December 2021

Publication

Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models

Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Awadallah, Bo Li

35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021

Publication

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Github Project

Focal Attention for Long-Range Interactions in Vision Transformers

Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Preprint Github

Florence: A New Foundation Model for Computer Vision

Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang

arXiv preprint arXiv:2111.11432 | November 2021

Publication Project

NICE: Neural Image Commenting with Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao

EMNLP 2021 | October 2021

Publication Project

Taming Sparsely Activated Transformer with Stochastic Experts.

Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Tuo Zhao, Jianfeng Gao, Hany Hassan Awadalla

October 2021

Publication Publication

Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding

Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao

ICCV 2021 | October 2021

Publication Github

Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach

Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao

2021 Empirical Methods in Natural Language Processing | September 2021

Publication

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon

KDD 2021 | August 2021

Publication Publication Project

Go-Figure: A Meta Evaluation of Factuality in Summarization

Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Preprint Publication

RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems

Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Publication

KB-VLP: Knowledge Based Vision and Language Pretraining

Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao

Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021

Publication Project

VinVL: Revisiting Visual Representations in Vision-Language Models

Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao

CVPR 2021 | June 2021

Publication Project

Targeted Adversarial Training for Natural Language Understanding

Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi

NAACL | June 2021

Publication Github

Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization

Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao

North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021

Publication

Compositional Processing Emerges in Neural Networks Solving Math Problems

Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao

CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773

Publication Publication Project

DeBERTa: Decoding-Enhanced BERT with Disentangled Attention

Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen

2021 International Conference on Learning Representations | May 2021

Under review

PDF Publication Github Project Project

Joint Retrieval and Generation Training for Grounded Text Generation

Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan

May 2021

Publication

Text Editing by Command

Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan

NAACL | April 2021

PDF Publication

Contrastive Multi-document Question Generation

Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan

European Chapter of the Association for Computational Linguistics (EACL) | April 2021

PDF Publication Project

SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching

Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao

Transactions of the Association for Computational Linguistics | April 2021

PDF Video Github

Data Augmentation for Abstractive Query-Focused Multi-Document Summarization

Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao

AAAI 2021 | April 2021

Publication

Multi-domain Task-oriented Dialog Challenge II at DSTC9

Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao

AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021

Publication

VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training

Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu

AAAI | February 2021

PDF Publication Video Project Project

A Controllable Model of Grounded Response Generation

Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, Bill Dolan

AAAI 2021 | January 2021

PDF Publication Publication

Reader-Guided Passage Reranking for Open-Domain Question Answering

Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen

ACL-IJCNLP 2021 | December 2020

Publication

UnitedQA: A Hybrid Approach for Open Domain Question Answering

Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao

ACL-IJCNLP 2021 | December 2020

Publication

Self-supervised Pre-training with Hard Examples Improves Visual Representations.

Chunyuan Li, Xiujun Li, Lei Zhang, Baolin Peng, Mingyuan Zhou, Jianfeng Gao

December 2020

Publication

Learning Inference Rules with Neural TP-Reasoner

Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, workshop | December 2020

Publication Project Project

MiniVLM: A Smaller and Faster Vision-Language Model

Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu

arXiv preprint arXiv:2012.06946 | December 2020

Publication Project

Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language

Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang

ArXiv | November 2020, Vol abs/2011.09530

Publication

CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search

Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett

MSR-TR-2020-49 | November 2020

Published by Microsoft

The participation report of our top non-manual entry in TREC COVID Round 2.

PDF Publication

Posterior Differential Regularization with f-divergence for Improving Model Robustness

Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao

October 2020

Publication

NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020

Publication Publication Project

HittER: Hierarchical Transformers for Knowledge Graph Embeddings

Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji

EMNLP 2021 | August 2020

Publication Github

Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks

Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao

ECCV | August 2020

Publication Video Github Project Project Project

MIND: A Large-scale Dataset for News Recommendation

Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou

ACL 2020 | July 2020

Publication Download

Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations

Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

ICML 2020 | July 2020

Publication Project Project

Few-Shot Generative Conversational Query Rewriting

Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu

SIGIR 2020 | June 2020

Best Short Paper Award

PDF

Novel Human-Object Interaction Detection via Adversarial Domain Generalization

Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang

May 2020

Publication

Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training

Weituo Hao, Chunyuan Li, Xiujun Li, Lawrence Carin, Jianfeng Gao

CVPR 2020 | April 2020

Publication Github

Feature Quantization Improves GAN Training

Yang Zhao, Chunyuan Li, Ping Yu, Jianfeng Gao, Changyou Chen

April 2020

Publication Github

SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization

Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao

April 2020

Publication Project

Adversarial Training for Large Neural Language Models

Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao

April 2020

Publication Github Project

RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering

Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin

Eighth International Conference on Learning Representations (ICLR) | April 2020

Publication PDF Github

On the Variance of the Adaptive Learning Rate and Beyond

Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han

Eighth International Conference on Learning Representations (ICLR) | April 2020

Publication PDF Project

ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems

Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang

ACL 2020 Demo | April 2020

Publication Project

Multi-domain Task-oriented Dialog Challenge II

Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao

The Ninth Dialog System Technology Challenge | March 2020

PDF Project

UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training

Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon

February 2020

Publication Github Project

Vision-Language Navigation Policy Learning and Adaptation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020

Publication Publication Project Project

Unified Vision-Language Pre-Training for Image Captioning and VQA

Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao

AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020

Publication

Results of the Multi-Domain Task-Completion Dialog Challenge

Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada

Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020

PDF Project

Complementary Auxiliary Classifiers for Label-Conditional Text Generation

Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao

AAAI 2020 | February 2020

Publication

Unified Vision-Language Pre-Training for Image Captioning and VQA

Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao

AAAI | February 2020

Publication Project Project

Unified Language Model Pre-training for Natural Language Understanding and Generation

Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon

33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019

Publication Github Project

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving

Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao

Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019

Publication PDF

TP-N2F: Tensor Product Representation for Natural To Formal Language Generation

Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019

Best Paper Award at KR2ML Workshop in NeurIPS 2019.

Publication PDF Project Project

DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation

Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan

arXiv:1911.00536 | November 2019

PDF Project Project

HUBERT Untangles BERT to Improve Transfer across NLP Tasks

Mehrad Moradshahi, Hamid Palangi, Monica S. Lam, Paul Smolensky, Jianfeng Gao

arxiv | October 2019

https://arxiv.org/abs/1910.12647

Publication

Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators

Kuang-Huei Lee *, Hamid Palangi *, Xi Chen, Houdong Hu, Jianfeng Gao

September 2019

* Equal contributions

Publication

Structuring Latent Spaces for Stylized Response Generation

Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan

EMNLP-IJCNLP 2019 | September 2019

Publication Project Project

DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain.

Yichong Xu, Xiaodong Liu, Chunyuan Li, Hoifung Poon, Jianfeng Gao

BioNLP 2019 | August 2019

PDF

Efficient Navigation with Language Pre-training and Stochastic Sampling

xiujun li, Chunyuan Li, Qiaolin Xia, Asli Celikyilmaz, Jianfeng Gao, Noah A. Smith, Yejin Choi

EMNLP-IJCNLP | August 2019

DOI

Budgeted Policy Learning for Task-Oriented Dialogue Systems

Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen

ACL 2019 | July 2019

Publication Project

ConvLab: Multi-Domain End-to-End Dialog System Platform

Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Xiang Li, Yaoqin Zhang, Zheng Zhang, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao

ACL | July 2019

PDF Publication Github Project Project

Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling

Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan

Association for Computational Linguistics 2019 | July 2019

Publication Project

Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models

Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin

ACL 2019 | July 2019

Publication

Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation

Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa

CVPR 2019 | June 2019

Oral

Publication

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang

CVPR 2019 | June 2019

Best Student Paper Award in CVPR 2019.

Publication Video Project Project Project

Multi-Task Deep Neural Networks for Natural Language Understanding

Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

ACL 2019 | June 2019

Publication Project

Consistent Dialogue Generation with Self-supervised Feature Learning

Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan

preprint | March 2019

Publication

Multi-Domain Task-Completion Dialog Challenge

Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li

Dialog System Technology Challenges 8 | March 2019

PDF Project Project

Jointly Optimizing Diversity and Relevance in Neural Response Generation

Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan

NAACL-HLT 2019 | March 2019

Publication Project

Object-driven Text-to-Image Synthesis via Adversarial Training

Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao

CVPR 2019 | February 2019

PDF Publication Project

Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing

Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin

NAACL 2019 | February 2019

PDF

Neural Approaches to Conversational AI

Jianfeng Gao, Michel Galley, Lihong Li

Foundations and Trends in Information Retrieval | February 2019

Publication Project Project Project Project Project

Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning

Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang

AAAI 2019 | January 2019

Publication Project

Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning

Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun

AAAI 2019 | January 2019

Publication Project

The Design and Implementation of XiaoIce, an Empathetic Social Chatbot

Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou

MSR-TR-2018-42 | December 2018

Published by Microsoft

Publication Project Project

Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization

Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan

NeurIPS 2018 | December 2018

Publication Project Project Project

Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models

Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He

NIPS 2018 | December 2018

Publication

M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search

Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao

NIPS 2018 | December 2018

Publication

Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning

Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen

EMNLP 2018 | October 2018

Publication Publication Project Project

Subgoal Discovery for Hierarchical Dialogue Policy Learning

Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara

EMNLP 2018 | October 2018

Publication Project Project Project

Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems

Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao

SLT 2018 | July 2018

Publication Project

Neural Approaches to Conversational AI – Tutorial at ACL/SIGIR 2018

Jianfeng Gao, Michel Galley, Lihong Li

ACL and SIGIR tutorial | July 2018

ACL and SIGIR tutorial

Publication Project

Discourse-Aware Neural Rewards for Coherent Text Generation

Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi

2018 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2018) | July 2018

Publication

Link Prediction using Embedded Knowledge Graphs

Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao

arXiv | April 2018

Publication Publication Project

Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning

Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong

ICASSP 2018 | April 2018

Publication Project

Dynamic Fusion Networks for Machine Reading Comprehension

Yichong Xu, JJ (Jingjing) Liu, Jianfeng Gao, Yelong Shen, Xiaodong Liu

February 2018

PDF Github

M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search

Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao

February 2018

arXiv preprint

Publication

BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems

Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng

AAAI 2018 | February 2018

Publication Publication Project

Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning

Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su

ACL 2018 | January 2018

Publication Publication Project

Language-Based Image Editing with Recurrent Attentive Models

Jianbo Chen, Yelong Shen, Jianfeng Gao, Xiaodong Liu, Jingjing Liu, Jianfeng Gao

MSR-TR-2017-50 | December 2017

The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Publication Project

Stochastic Answer Networks for Machine Reading Comprehension

Jianfeng Gao, Xiaodong Liu, Yelong Shen, Kevin Duh

MSR-TR-2017-51 | December 2017

Publication Project

The MSR-NLP System at Dialog System Technology Challenges 6

Michel Galley, Chris Brockett, Bill Dolan, Jianfeng Gao

Dialog System Technology Challenges (DSTC) | November 2017

Publication Project

End-to-End Task-Completion Neural Dialogue Systems

Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz

the 8th International Joint Conference on Natural Language Processing | November 2017

Publication Project

Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning

Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong

Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017

Publication Publication Project

ReasoNet: Learning to Stop Reading in Machine Comprehension

Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen

23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017

Publication Publication Project

Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access

Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng

Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017

Publication Publication Project

Introduction to Deep Learning for Natural Language Processing (Tutorial at DeepLearning2017 summer school in Bilbao)

Jianfeng Gao

MSR-TR-2017-36 | July 2017

Publication Project Project Project Project

StyleNet: Generating Attractive Visual Captions with Styles

Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng

Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017

Publication

Semantic Compositional Networks for Visual Captioning

Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng

Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017

Publication Publication

A Nested Attention Neural Hybrid Model for Grammatical Error Correction

Jianfeng Gao

ACL 2017 | July 2017

Publication

Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems

Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz

March 2017

Publication Project

End-To-End Joint Learning of Natural Language Understanding and Dialog Manager

Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng

The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017

Publication Project

Character-level Deep Conflation for Business Data Analytics

Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng

ICASSP 2017 | February 2017

Publication Publication Project

A User Simulator for Task-Completion Dialogues

Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen

December 2016, pp. 14

Publication Project

Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing

Yun-Nung (Vivian) Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng

December 2016

Publication

MS MARCO: A Human Generated MAchine Reading COmprehension Dataset

Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng

November 2016

Publication Publication Download Project Project Project

TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency

Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley

November 2016

Publication Publication

Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads

Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng

EMNLP 2016 | November 2016

Publication Publication

Bi-directional Attention with Agreement for Dependency Parsing

Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng

EMNLP | November 2016

Publication Publication

Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks

Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng

MSR-TR-2016-61 | September 2016

arXiv:1609.03286

Publication

End-to-End Reinforcement Learning of Dialogue Agents for Information Access

Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng

MSR-TR-2016-63 | September 2016

Publication Project

Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking

Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng

MSR-TR-2016-62 | August 2016

arXiv:1608.05081

Publication Project