Microsoft at EMNLP 2021

Injecting Entity Types into Entity-Guided Text Generation

Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang

Detecting Speaker Personas from Conversational Texts

Jia-Chen Gu, Zhen-Hua Ling, Yu Wu, Quan Liu, Zhigang Chen, Xiaodan Zhu

Reference-Centric Models for Grounded Collaborative Dialogue

Daniel Fried, Justin Chiu, Dan Klein

Less is More: Pre-train a Strong Text Encoder for Dense Retrieval Using a Weak Decoder

Shuqi Lu, Di He, Chenyan Xiong, Guolin Ke, Waleed Malik, Zhicheng Dou, Paul Bennett, Tieyan Liu, Arnold Overwijk

Efficient-FedRec: Efficient Federated Learning Framework for Privacy-Preserving News Recommendation

Jingwei Yi, Fangzhao Wu, Chuhan Wu, Ruixuan Liu, Guangzhong Sun, Xing Xie

CAST: Enhancing Code Summarization with Hierarchical Splitting and Reconstruction of Abstract Syntax Trees

Ensheng Shi, Yanlin Wang, Lun Du, Hongyu Zhang, Shi Han, Dongmei Zhang, Hongbin Sun

Interactive Machine Comprehension with Dynamic Knowledge Graphs

Xingdi Yuan

Reference-Centric Models for Grounded Collaborative Dialogue

Daniel Fried, Justin Chiu, Dan Klein

LayoutReader: Pre-training of Text and Layout for Reading Order Detection

Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei

Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training

Bo Zheng, Li Dong, Shaohan Huang, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei

Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding

Yingmei Guo, Linjun Shou (寿林钧), Jian Pei, Ming Gong (YIMING), Mingxing Xu, Zhiyong Wu, Daxin Jiang (姜大昕)

MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs

Zewen Chi, Li Dong, Shuming Ma, Shaohan Huang, Xian-Ling Mao, Heyan Huang, Furu Wei

Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation

Leyang Cui, Yu Wu, Shujie Liu, Yue Zhang

Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting

Wangchunshu Zhou, Tao Ge, Ke Xu, Furu Wei

Jointly Learning to Repair Code and Generate Commit Message

Jiaqi Bai, Long Zhou, Ambrosio Blanco, Shujie Liu, Furu Wei, Ming Zhou, Zhoujun Li

Linguistic dependencies and statistical dependence

Jacob Louis Hoover, Alessandro Sordoni, Wenyu Du, Timothy J. O'Donnell

LayoutReader: Pre-training of Text and Layout for Reading Order Detection

Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei

Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions

Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeffrey Dalton, Mikhail Burtsev

Sentence-Permuted Paragraph Generation

Wenhao Yu, Chenguang Zhu, Tong Zhao, Zhichun Guo, Meng Jiang

Injecting Entity Types into Entity-Guided Text Generation

Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang

Universal Sentence Representations Learning with Conditional Masked Language Model

Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve

Distantly-Supervised Evidence Retrieval Enables Question Answering without Evidence Annotation

Chen Zhao, Chenyan Xiong, Jordan Boyd-Graber, Hal Daumé III

Modular Self-Supervision for Document-Level Relation Extraction

Sheng Zhang, Cliff Wong, Naoto Usuyama, Sarthak Jain, Tristan Naumann, Hoifung Poon

Self-training with Few-shot Rationalization: Teacher Explanations Aid Student in Few-shot NLU

Meghana Moorthy Bhat, Alessandro Sordoni, Subhabrata (Subho) Mukherjee

Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach

Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao

Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression

Canwen Xu, Wangchunshu Zhou, Tao Ge, Ke Xu, Julian McAuley, Furu Wei

Constrained Language Models Yield Few-Shot Semantic Parsers

Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Ben Van Durme

Studying word order through iterative shuffling

Nikolay Malkin, Sameera Lanka, Pranav Goel, Nebojsa Jojic

HittER: Hierarchical Transformers for Knowledge Graph Embeddings

Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji

Levenshtein Training for Word-level Quality Estimation

Shuoyang Ding, Marcin Junczys-Dowmunt, Matt Post, Philipp Koehn

Improving Multilingual Translation by Representation and Gradient Regularization

Yilin Yang, Akiko Eriguchi, Alexandre Muzio, Prasad Tadepalli, Stefan Lee, Hany Hassan Awadalla

A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations

Ziyi Yang, Yinfei Yang, Daniel Cer, Eric Darve

Dialogue State Tracking with a Language Model using Schema-Driven Prompting

Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf

Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy

Colin Clement, Shuai Lu, Xiaoyu Liu, Michele Tufano, Dawn Drain, Nan Duan, Neel Sundaresan, Alexey Svyatkovskiy

Interactive Machine Comprehension with Dynamic Knowledge Graphs

Xingdi Yuan

Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach

Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao

Levenshtein Training for Word-level Quality Estimation

Shuoyang Ding, Marcin Junczys-Dowmunt, Matt Post, Philipp Koehn

Constrained Language Models Yield Few-Shot Semantic Parsers

Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Ben Van Durme

Improving Multilingual Translation by Representation and Gradient Regularization

Yilin Yang, Akiko Eriguchi, Alexandre Muzio, Prasad Tadepalli, Stefan Lee, Hany Hassan Awadalla

Matching-oriented Embedding Quantization For Ad-hoc Retrieval

Shitao Xiao, Zheng Liu, Yingxia Shao, Defu Lian, Xing Xie

Learning Neural Templates for Recommender Dialogue System

Zujie Liang, Huang Hu, Can Xu, Jian Miao, Yingying He, Yining Chen, Xiubo Geng, Fan Liang, Daxin Jiang (姜大昕)

Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders

Guanhua Chen, Shuming Ma, Yun Chen, Li Dong, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei

Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions

Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeffrey Dalton, Mikhail Burtsev

Distantly-Supervised Evidence Retrieval Enables Question Answering without Evidence Annotation

Chen Zhao, Chenyan Xiong, Jordan Boyd-Graber, Hal Daumé III

Jointly Learning to Repair Code and Generate Commit Message

Jiaqi Bai, Long Zhou, Ambrosio Blanco, Shujie Liu, Furu Wei, Ming Zhou, Zhoujun Li

Finetuning Pretrained Transformers into RNNs

Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith

Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression

Canwen Xu, Wangchunshu Zhou, Tao Ge, Ke Xu, Julian McAuley, Furu Wei

Studying word order through iterative shuffling

Nikolay Malkin, Sameera Lanka, Pranav Goel, Nebojsa Jojic

HittER: Hierarchical Transformers for Knowledge Graph Embeddings

Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji