Neural Machine Translation

We are working on neural machine translation, using deep neural networks for machine translation. We achieved human parity (opens in new tab) in translating news from Chinese to English.

Our Papers
Xu Tan, Yi Ren, Di He, Tao Qin, Tie-Yan Liu, Multilingual Neural Machine Translation with Knowledge Distillation (opens in new tab), ICLR 2019.
Yiren Wang, Fei Tian, Di He, Tao Qin, Chengxiang Zhai, Tie-Yan Liu, Non-Autoregressive Machine Translation with Auxiliary Regularization (opens in new tab), AAAI 2019.
Junliang Guo, Xu Tan, Di He, Tao Qin, and Tie-Yan Liu, Non-Autoregressive Neural Machine Translation with Enhanced Decoder Input (opens in new tab), AAAI 2019.
Yingce Xia, Tianyu He, Xu Tan, Fei Tian, Di He, and Tao Qin, Tied Transformers: Neural Machine Translation with Shared Encoder and Decoder (opens in new tab), AAAI 2019.
Tianyu He, Xu Tan, Yingce Xia, Di He, Tao Qin, Zhibo Chen, and Tie-Yan Liu, Layer-Wise Coordination between Encoder and Decoder for Neural Machine Translation (opens in new tab), NIPS 2018.
Lijun Wu, Fei Tian, Tao Qin, Jianhuang Lai and Tie-Yan Liu, A Study of Reinforcement Learning for Neural Machine Translation (opens in new tab), EMNLP 2018.
Xu Tan, Lijun Wu, Di He, Fei Tian, Tao Qin, Jianhuang Lai, and Tie-Yan Liu, Beyond Error Propagation in Neural Machine Translation: Characteristics of Language Also Matter (opens in new tab), EMNLP 2018.
Lijun Wu, Yingce Xia, Li Zhao, Fei Tian, Tao Qin, Jianhuang Lai, and Tie-Yan Liu, Adversarial Neural Machine Translation (opens in new tab), ACML 2018.
Hany Hassan, Anthony Aue, Chang Chen, Vishal Chowdhary, Jonathan Clark, Christian Federmann, Xuedong Huang, Marcin Junczys-Dowmunt, William Lewis, Mu Li, Shujie Liu, Tie-Yan Liu, Renqian Luo, Arul Menezes, Tao Qin, Frank Seide, Xu Tan, Fei Tian, Lijun Wu, Shuangzhi Wu, Yingce Xia, Dongdong Zhang, Zhirui Zhang, Ming Zhou, Achieving Human Parity on Automatic Chinese to English News Translation (opens in new tab), arXiv 2018.
Yanyao Shen, Xu Tan, Di He, Tao QIN, and Tie-Yan Liu, Dense Information Flow for Neural Machine Translation (opens in new tab), NAACL 2018. [code (opens in new tab)]
Yijun Wang, Yingce Xia, Li Zhao, Jiang Bian, Tao Qin, Guiquan Liu, and Tie-Yan Liu, Dual Transfer Learning for Neural Machine Translation with Marginal Distribution Regularization (opens in new tab), AAAI 2018.
Di He, Hanqing Lu, Yingce Xia, Tao Qin, Liwei Wang, and Tie-Yan Liu, Decoding with Value Networks for Neural Machine Translation (opens in new tab), NIPS 2017.
Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tie-Yan Liu, and Wei-Ying Ma, Dual Learning for Machine Translation (opens in new tab), NIPS 2016.