Fan Yang

Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation

Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang

OSDI 2024 | July 2024

Publication Github

nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training

Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou

OSDI 2024 | July 2024

Publication Github

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu

OSDI 2024 | May 2024

Publication Github

MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels

Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang

2024 The Web Conference | May 2024

Publication

OneSparse: A Unified System for Multi-index Vector Search

Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang

2024 The Web Conference | May 2024

Publication

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Published by Microsoft

Publication Download Project

Amanda: Unified Instrumentation Framework for Deep Neural Networks

Yue Guan, Yuxian Qiu, Jingwen Leng, Fan Yang, Shuo Yu, Yunxin Liu, Yu Feng, Yuhao Zhu, Lidong Zhou, Yun Liang, Chen Zhang, Chao Li, Minyi Guo

ASPLOS | April 2024

Publication

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

ICML 2024 | February 2024

DOI Publication Publication

Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning

Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang

arXiv | February 2024

Preprint

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

arXiv | February 2024

Preprint

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

SPFresh: Incremental In-Place Update for Billion-Scale Vector Search

Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang

SOSP'23 | October 2023

Publication

Model-enhanced Vector Index

Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui

NeurIPS 2023 | October 2023

Publication

NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation

Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong (YIMING), Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan

ACL 2023 | July 2023

Publication

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning

Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication Project

Optimizing Dynamic Neural Networks with Brainstorm

Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo

OSDI'23 | July 2023

Publication

VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity

Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou

OSDI'23 | July 2023

Publication

Welder: Scheduling Deep Learning Memory Access via Tile-graph

Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication Project

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023

Publication Project

OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization

Cong Guo, Jiaming Tang, Jingwen Leng, Weiming Hu, Chen Zhang, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu

ISCA | June 2023

PDF Project

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou

EuroSys 2023 | May 2023

Publication

On Modular Learning of Distributed Systems for Predicting End-to-End Latency

Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou

NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023

Publication

ElasticFlow: An Elastic Serverless Training Platform for Distributed Deep Learning

Diandian Gu, Yihao Zhao, Yinmin Zhong, Yifan Xiong, Zhenhua Han, Peng Cheng, Fan Yang, Gang Huang, Xin Jin, Xuanzhe Liu

ASPLOS 2023 | March 2023

Publication

ANT: Exploiting Adaptive Numerical Data Type for Low-Bit Deep Neural Network Quantization

Cong Guo, Chen Zhang, Jingwen Leng, Zihan Liu, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu

MICRO | October 2022

IEEE Micro Top Picks 2023 Honorable Mention

PDF

PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training

Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo

2022 USENIX Annual Technical Conference | July 2022

PDF

Roller: Fast and Efficient Tensor Compilation for Deep Learning

Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko

The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022

Publication Project

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project Project

Tutel: Adaptive Mixture-of-Experts at Scale

Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong

July 2022

Publication

Distill-VQ: Learning Retrieval Oriented Vector Quantization by Distilling Knowledge from Dense Embeddings

Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie

SIGIR 2022 | April 2022

Publication

SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo

ICLR 2022 | April 2022

Publication

NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion

Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang (姜大昕), Nan Duan

November 2021

DOI PDF

A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou

MSR-TR-2021-20 | August 2021

Published by Microsoft

Publication

HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang

2020 Operating Systems Design and Implementation | November 2020

Publication Project

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks

Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou

14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020

Publication Project

Retiarii: A Deep Learning Exploratory-Training Framework

Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou

2020 Operating Systems Design and Implementation | November 2020

Publication Video

XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation

Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong (YIMING), Linjun Shou (寿林钧), Daxin Jiang (姜大昕), Guihong Cao, Xiaodong Fan, Bruce Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Ming Zhou

EMNLP 2020 | April 2020

Publication PDF Github Github Github Project

Capuchin: Tensor-based GPU Memory Management for Deep Learning

Quan Peng, Xuanhua Shi, Hulin Dai, Hai Jin, Weiliang Ma, Qian Xiong, Fan Yang, Xuehai Qian

ASPLOS | March 2020

Publication Project

Analysis of Large-Scale Multi-Tenant {GPU} Clusters for {DNN} Training Workloads

Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang

2019 USENIX Annual Technical Conference | May 2019

PDF Publication Github Project Project

Gandiva: Introspective Cluster Scheduling for Deep Learning

Wencong Xiao, Romil Bhardwaj, Ramachandran Ramjee, Muthian Sivathanu, Nipun Kwatra, Zhenhua Han, Pratyush Patel, Xuan Peng, Hanyu Zhao, Quanlu Zhang, Fan Yang, Lidong Zhou

13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2018) | October 2018

Publication Project Project Project

Multi-tenant GPU Clusters for Deep Learning Workloads: Analysis and Implications (TR)

Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang

MSR-TR-2018-13 | May 2018

Published by Microsoft

Publication Github Project

GraM: Scaling Graph Computation to the Trillions

Ming Wu, Fan Yang, Jilong Xue, Wencong Xiao, Youshan Miao, Lan Wei, Haoxiang Lin, Yafei Dai, Lidong Zhou

SoCC 2015 | August 2015

The 6th ACM Symposium on Cloud Computing

Publication DOI Project

ImmortalGraph: A System for Storage and Analysis of Temporal Graphs

Youshan Miao, Wentao Han, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Enhong Chen, Wenguang Chen, Fan Yang, Lidong Zhou

ACM Transactions on Storage (TOS) | July 2015

Publication Publication Project

Arming Cloud Services with Task Aspects

Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou

MSR-TR-2014-150 | November 2014

Published by Microsoft

Publication

Chronos: A Graph Engine for Temporal Graph Analysis

Wentao Han, Youshan Miao, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Wenguang Chen, Enhong Chen, Fan Yang, Lidong Zhou

EuroSys | April 2014

Publication Publication Publication Project

Kineograph: taking the pulse of a fast-changing and connected world

Raymond Cheng, Ji Hong, Aapo Kyrola, Youshan Miao, Xuetian Weng, Ming Wu, Fan Yang, Lidong Zhou, Feng Zhao, Enhong Chen

ACM Eurosys | April 2012

Publication Publication Publication Project

Sonora: A Platform for Continuous Mobile-Cloud Computing

Xiuwei Chen, Ivan Beschastnikh, Li Zhuang, Fan Yang, Zhengping Qian, Lidong Zhou, Guobin Shen, Jacky Shen

MSR-TR-2012-34 | March 2012

Publication Publication

Modeling path capacity in multi-hop IEEE 802.11 networks for QoS services

Kun Wang, Fan Yang, Qian Zhang, Yinlong Xu

IEEE Transactions on Wireless Communications | February 2007, Vol 6(2): pp. 738-749

DOI Publication Publication Publication Publication Publication

Distributed Channel Assignment and Routing in Multi-radio Multi-channel Multi-hop Wireless Networks

Haitao Wu, Fan Yang, Kun Tan, Jie Chen, Qian Zhang, Zhensheng Zhang

MSR-TR-2006-165 | November 2006

Publication

AMTP: a multipath multimedia streaming protocol for mobile ad hoc networks

K. Rojviboonchai, Fan Yang, Q. Zhang, H. Aida, W. Zhu

May 2005

Publication Publication

LION: Layered Overlay Multicast with Network Coding

J. Zhao, Fan Yang, Q. Zhang, Zhensheng Zhang, Fuyan Zhang

IEEE Transactions on Multimedia | May 2004

End-to-End TCP-Friendly Streaming Protocol and Bit Allocation for Scalable Video over Wireless Internet

Q. Zhang, F. Yang, W. Zhu, Y.-Q. Zhang, Fan Yang

IEEE Journal on Selected Areas in Communications | February 2004, Vol 22(6)

Publication

nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training

Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou

OSDI 2024 | July 2024

Publication Github

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu

OSDI 2024 | May 2024

Publication Github

OneSparse: A Unified System for Multi-index Vector Search

Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang

2024 The Web Conference | May 2024

Publication

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Published by Microsoft

Publication Download Project

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

ICML 2024 | February 2024

DOI Publication Publication

Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning

Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang

arXiv | February 2024

Preprint

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

arXiv | February 2024

Preprint

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

Model-enhanced Vector Index

Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui

NeurIPS 2023 | October 2023

Publication

NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation

Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong (YIMING), Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan

ACL 2023 | July 2023

Publication

Distill-VQ: Learning Retrieval Oriented Vector Quantization by Distilling Knowledge from Dense Embeddings

Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie

SIGIR 2022 | April 2022

Publication

SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo

ICLR 2022 | April 2022

Publication

NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion

Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang (姜大昕), Nan Duan

November 2021

DOI PDF

A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou

MSR-TR-2021-20 | August 2021

Published by Microsoft

Publication

XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation

Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong (YIMING), Linjun Shou (寿林钧), Daxin Jiang (姜大昕), Guihong Cao, Xiaodong Fan, Bruce Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Ming Zhou

EMNLP 2020 | April 2020

Publication PDF Github Github Github Project

nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training

Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou

OSDI 2024 | July 2024

Publication Github

Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation

Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang

OSDI 2024 | July 2024

Publication Github

MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels

Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang

2024 The Web Conference | May 2024

Publication

Amanda: Unified Instrumentation Framework for Deep Neural Networks

Yue Guan, Yuxian Qiu, Jingwen Leng, Fan Yang, Shuo Yu, Yunxin Liu, Yu Feng, Yuhao Zhu, Lidong Zhou, Yun Liang, Chen Zhang, Chao Li, Minyi Guo

ASPLOS | April 2024

Publication

SPFresh: Incremental In-Place Update for Billion-Scale Vector Search

Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang

SOSP'23 | October 2023

Publication

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

Optimizing Dynamic Neural Networks with Brainstorm

Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo

OSDI'23 | July 2023

Publication

VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity

Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou

OSDI'23 | July 2023

Publication

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning

Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication Project

Welder: Scheduling Deep Learning Memory Access via Tile-graph

Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication Project

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023

Publication Project

OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization

Cong Guo, Jiaming Tang, Jingwen Leng, Weiming Hu, Chen Zhang, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu

ISCA | June 2023

PDF Project

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou

EuroSys 2023 | May 2023

Publication

On Modular Learning of Distributed Systems for Predicting End-to-End Latency

Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou

NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023

Publication

ElasticFlow: An Elastic Serverless Training Platform for Distributed Deep Learning

Diandian Gu, Yihao Zhao, Yinmin Zhong, Yifan Xiong, Zhenhua Han, Peng Cheng, Fan Yang, Gang Huang, Xin Jin, Xuanzhe Liu

ASPLOS 2023 | March 2023

Publication

ANT: Exploiting Adaptive Numerical Data Type for Low-Bit Deep Neural Network Quantization

Cong Guo, Chen Zhang, Jingwen Leng, Zihan Liu, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu

MICRO | October 2022

IEEE Micro Top Picks 2023 Honorable Mention

PDF

PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training

Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo

2022 USENIX Annual Technical Conference | July 2022

PDF

Tutel: Adaptive Mixture-of-Experts at Scale

Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong

July 2022

Publication

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project Project

Roller: Fast and Efficient Tensor Compilation for Deep Learning

Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko

The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022

Publication Project

A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou

MSR-TR-2021-20 | August 2021

Published by Microsoft

Publication

HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang

2020 Operating Systems Design and Implementation | November 2020

Publication Project

Retiarii: A Deep Learning Exploratory-Training Framework

Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou

2020 Operating Systems Design and Implementation | November 2020

Publication Video

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks

Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou

14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020

Publication Project

Capuchin: Tensor-based GPU Memory Management for Deep Learning

Quan Peng, Xuanhua Shi, Hulin Dai, Hai Jin, Weiliang Ma, Qian Xiong, Fan Yang, Xuehai Qian

ASPLOS | March 2020

Publication Project

Analysis of Large-Scale Multi-Tenant {GPU} Clusters for {DNN} Training Workloads

Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang

2019 USENIX Annual Technical Conference | May 2019

PDF Publication Github Project Project

Gandiva: Introspective Cluster Scheduling for Deep Learning

Wencong Xiao, Romil Bhardwaj, Ramachandran Ramjee, Muthian Sivathanu, Nipun Kwatra, Zhenhua Han, Pratyush Patel, Xuan Peng, Hanyu Zhao, Quanlu Zhang, Fan Yang, Lidong Zhou

13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2018) | October 2018

Publication Project Project Project

Multi-tenant GPU Clusters for Deep Learning Workloads: Analysis and Implications (TR)

Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang

MSR-TR-2018-13 | May 2018

Published by Microsoft

Publication Github Project

GraM: Scaling Graph Computation to the Trillions

Ming Wu, Fan Yang, Jilong Xue, Wencong Xiao, Youshan Miao, Lan Wei, Haoxiang Lin, Yafei Dai, Lidong Zhou

SoCC 2015 | August 2015

The 6th ACM Symposium on Cloud Computing

Publication DOI Project

ImmortalGraph: A System for Storage and Analysis of Temporal Graphs

Youshan Miao, Wentao Han, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Enhong Chen, Wenguang Chen, Fan Yang, Lidong Zhou

ACM Transactions on Storage (TOS) | July 2015

Publication Publication Project

Arming Cloud Services with Task Aspects

Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou

MSR-TR-2014-150 | November 2014

Published by Microsoft

Publication

Chronos: A Graph Engine for Temporal Graph Analysis

Wentao Han, Youshan Miao, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Wenguang Chen, Enhong Chen, Fan Yang, Lidong Zhou

EuroSys | April 2014

Publication Publication Publication Project

Kineograph: taking the pulse of a fast-changing and connected world

Raymond Cheng, Ji Hong, Aapo Kyrola, Youshan Miao, Xuetian Weng, Ming Wu, Fan Yang, Lidong Zhou, Feng Zhao, Enhong Chen

ACM Eurosys | April 2012

Publication Publication Publication Project

Sonora: A Platform for Continuous Mobile-Cloud Computing

Xiuwei Chen, Ivan Beschastnikh, Li Zhuang, Fan Yang, Zhengping Qian, Lidong Zhou, Guobin Shen, Jacky Shen

MSR-TR-2012-34 | March 2012

Publication Publication

Distributed Channel Assignment and Routing in Multi-radio Multi-channel Multi-hop Wireless Networks

Haitao Wu, Fan Yang, Kun Tan, Jie Chen, Qian Zhang, Zhensheng Zhang

MSR-TR-2006-165 | November 2006

Publication

End-to-End TCP-Friendly Streaming Protocol and Bit Allocation for Scalable Video over Wireless Internet

Q. Zhang, F. Yang, W. Zhu, Y.-Q. Zhang, Fan Yang

IEEE Journal on Selected Areas in Communications | February 2004, Vol 22(6)

Publication

MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels

Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang

2024 The Web Conference | May 2024

Publication

Model-enhanced Vector Index

Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui

NeurIPS 2023 | October 2023

Publication

NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation

Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong (YIMING), Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan

ACL 2023 | July 2023

Publication

NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion

Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang (姜大昕), Nan Duan

November 2021

DOI PDF

XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation

Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong (YIMING), Linjun Shou (寿林钧), Daxin Jiang (姜大昕), Guihong Cao, Xiaodong Fan, Bruce Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Ming Zhou

EMNLP 2020 | April 2020

Publication PDF Github Github Github Project

Arming Cloud Services with Task Aspects

Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou

MSR-TR-2014-150 | November 2014

Published by Microsoft

Publication

Modeling path capacity in multi-hop IEEE 802.11 networks for QoS services

Kun Wang, Fan Yang, Qian Zhang, Yinlong Xu

IEEE Transactions on Wireless Communications | February 2007, Vol 6(2): pp. 738-749

DOI Publication Publication Publication Publication Publication

AMTP: a multipath multimedia streaming protocol for mobile ad hoc networks

K. Rojviboonchai, Fan Yang, Q. Zhang, H. Aida, W. Zhu

May 2005

Publication Publication

LION: Layered Overlay Multicast with Network Coding

J. Zhao, Fan Yang, Q. Zhang, Zhensheng Zhang, Fuyan Zhang

IEEE Transactions on Multimedia | May 2004

nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training

Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou

OSDI 2024 | July 2024

Publication Github

Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation

Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang

OSDI 2024 | July 2024

Publication Github

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu

OSDI 2024 | May 2024

Publication Github

MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels

Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang

2024 The Web Conference | May 2024

Publication

OneSparse: A Unified System for Multi-index Vector Search

Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang

2024 The Web Conference | May 2024

Publication

Amanda: Unified Instrumentation Framework for Deep Neural Networks

Yue Guan, Yuxian Qiu, Jingwen Leng, Fan Yang, Shuo Yu, Yunxin Liu, Yu Feng, Yuhao Zhu, Lidong Zhou, Yun Liang, Chen Zhang, Chao Li, Minyi Guo

ASPLOS | April 2024

Publication

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

ICML 2024 | February 2024

DOI Publication Publication

Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning

Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang

arXiv | February 2024

Preprint

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

arXiv | February 2024

Preprint

SPFresh: Incremental In-Place Update for Billion-Scale Vector Search

Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang

SOSP'23 | October 2023

Publication

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

Model-enhanced Vector Index

Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui

NeurIPS 2023 | October 2023

Publication

NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation

Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong (YIMING), Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan

ACL 2023 | July 2023

Publication

Optimizing Dynamic Neural Networks with Brainstorm

Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo

OSDI'23 | July 2023

Publication

VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity

Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou

OSDI'23 | July 2023

Publication

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning

Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication Project

Welder: Scheduling Deep Learning Memory Access via Tile-graph

Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication Project

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023

Publication Project

OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization

Cong Guo, Jiaming Tang, Jingwen Leng, Weiming Hu, Chen Zhang, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu

ISCA | June 2023

PDF Project

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou

EuroSys 2023 | May 2023

Publication

On Modular Learning of Distributed Systems for Predicting End-to-End Latency

Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou

NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023

Publication

ElasticFlow: An Elastic Serverless Training Platform for Distributed Deep Learning

Diandian Gu, Yihao Zhao, Yinmin Zhong, Yifan Xiong, Zhenhua Han, Peng Cheng, Fan Yang, Gang Huang, Xin Jin, Xuanzhe Liu

ASPLOS 2023 | March 2023

Publication

ANT: Exploiting Adaptive Numerical Data Type for Low-Bit Deep Neural Network Quantization

Cong Guo, Chen Zhang, Jingwen Leng, Zihan Liu, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu

MICRO | October 2022

IEEE Micro Top Picks 2023 Honorable Mention

PDF

PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training

Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo

2022 USENIX Annual Technical Conference | July 2022

PDF

Tutel: Adaptive Mixture-of-Experts at Scale

Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong

July 2022

Publication

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project Project

Roller: Fast and Efficient Tensor Compilation for Deep Learning

Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko

The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022

Publication Project

Distill-VQ: Learning Retrieval Oriented Vector Quantization by Distilling Knowledge from Dense Embeddings

Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie

SIGIR 2022 | April 2022

Publication

SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo

ICLR 2022 | April 2022

Publication

HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang

2020 Operating Systems Design and Implementation | November 2020

Publication Project

Retiarii: A Deep Learning Exploratory-Training Framework

Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou

2020 Operating Systems Design and Implementation | November 2020

Publication Video

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks

Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou

14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020

Publication Project

XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation

Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong (YIMING), Linjun Shou (寿林钧), Daxin Jiang (姜大昕), Guihong Cao, Xiaodong Fan, Bruce Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Ming Zhou

EMNLP 2020 | April 2020

Publication PDF Github Github Github Project

Capuchin: Tensor-based GPU Memory Management for Deep Learning

Quan Peng, Xuanhua Shi, Hulin Dai, Hai Jin, Weiliang Ma, Qian Xiong, Fan Yang, Xuehai Qian

ASPLOS | March 2020

Publication Project

Analysis of Large-Scale Multi-Tenant {GPU} Clusters for {DNN} Training Workloads

Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang

2019 USENIX Annual Technical Conference | May 2019

PDF Publication Github Project Project

Gandiva: Introspective Cluster Scheduling for Deep Learning

Wencong Xiao, Romil Bhardwaj, Ramachandran Ramjee, Muthian Sivathanu, Nipun Kwatra, Zhenhua Han, Pratyush Patel, Xuan Peng, Hanyu Zhao, Quanlu Zhang, Fan Yang, Lidong Zhou

13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2018) | October 2018

Publication Project Project Project

GraM: Scaling Graph Computation to the Trillions

Ming Wu, Fan Yang, Jilong Xue, Wencong Xiao, Youshan Miao, Lan Wei, Haoxiang Lin, Yafei Dai, Lidong Zhou

SoCC 2015 | August 2015

The 6th ACM Symposium on Cloud Computing

Publication DOI Project

Chronos: A Graph Engine for Temporal Graph Analysis

Wentao Han, Youshan Miao, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Wenguang Chen, Enhong Chen, Fan Yang, Lidong Zhou

EuroSys | April 2014

Publication Publication Publication Project

Kineograph: taking the pulse of a fast-changing and connected world

Raymond Cheng, Ji Hong, Aapo Kyrola, Youshan Miao, Xuetian Weng, Ming Wu, Fan Yang, Lidong Zhou, Feng Zhao, Enhong Chen

ACM Eurosys | April 2012

Publication Publication Publication Project

AMTP: a multipath multimedia streaming protocol for mobile ad hoc networks

K. Rojviboonchai, Fan Yang, Q. Zhang, H. Aida, W. Zhu

May 2005

Publication Publication

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Published by Microsoft

Publication Download Project

A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou

MSR-TR-2021-20 | August 2021

Published by Microsoft

Publication

Multi-tenant GPU Clusters for Deep Learning Workloads: Analysis and Implications (TR)

Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang

MSR-TR-2018-13 | May 2018

Published by Microsoft

Publication Github Project

Arming Cloud Services with Task Aspects

Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou

MSR-TR-2014-150 | November 2014

Published by Microsoft

Publication

Sonora: A Platform for Continuous Mobile-Cloud Computing

Xiuwei Chen, Ivan Beschastnikh, Li Zhuang, Fan Yang, Zhengping Qian, Lidong Zhou, Guobin Shen, Jacky Shen

MSR-TR-2012-34 | March 2012

Publication Publication

Distributed Channel Assignment and Routing in Multi-radio Multi-channel Multi-hop Wireless Networks

Haitao Wu, Fan Yang, Kun Tan, Jie Chen, Qian Zhang, Zhensheng Zhang

MSR-TR-2006-165 | November 2006

Publication

NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion

Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang (姜大昕), Nan Duan

November 2021

DOI PDF

ImmortalGraph: A System for Storage and Analysis of Temporal Graphs

Youshan Miao, Wentao Han, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Enhong Chen, Wenguang Chen, Fan Yang, Lidong Zhou

ACM Transactions on Storage (TOS) | July 2015

Publication Publication Project

Modeling path capacity in multi-hop IEEE 802.11 networks for QoS services

Kun Wang, Fan Yang, Qian Zhang, Yinlong Xu

IEEE Transactions on Wireless Communications | February 2007, Vol 6(2): pp. 738-749

DOI Publication Publication Publication Publication Publication

LION: Layered Overlay Multicast with Network Coding

J. Zhao, Fan Yang, Q. Zhang, Zhensheng Zhang, Fuyan Zhang

IEEE Transactions on Multimedia | May 2004

End-to-End TCP-Friendly Streaming Protocol and Bit Allocation for Scalable Video over Wireless Internet

Q. Zhang, F. Yang, W. Zhu, Y.-Q. Zhang, Fan Yang

IEEE Journal on Selected Areas in Communications | February 2004, Vol 22(6)

Publication