Shuohang Wang

About

I am a Principal Researcher in GenAI team led by Weizhu Chen. I am working on Phi model pretraining, especially PhiMoE (opens in new tab) and GRIN-MoE (opens in new tab). My research mainly focuses on LLM Pretraining, LLM Efficiency, and Knowledge Distillation. I worked on Question Answering, Multilingual NLU, Summarization with deep learning, reinforcement learning, and few-shot learning. My previous work has led to top place in a number of NLP competitions, including achieving human parity in CommonsenseQA (opens in new tab) and HellaSwag (opens in new tab).