Microsoft at NeurIPS 2020

Azure Cognitive Services Research

The Knowledge and Language Team is part of the Azure AI Cognitive Services Research (CSR) group, focusing on cutting edge research and the development of the next generation framework for knowledge and natural language processing.

We are working on problems including knowledge-boosted language modeling, knowledge extraction, knowledge graph, summarization, language understanding and generation. We conduct large-scale pre-training and domain-specific fine-tuning on internal and public data sets to develop state-of-the-art deep learning technologies for core knowledge and language problems in various real applications.

Our work has resulted in multiple publications in top NLP conferences and first place submissions to the CommonsenseQA and FEVER leaderboards.

Our recent work covers:

  • How to simultaneously pre-train knowledge graph and language model
  • Increase factual correctness of abstractive summaries via knowledge graph
  • Summarize multi-party meeting transcripts
  • Utilize positional bias in news articles for zero-shot summarization