Uncovering Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
Siran Liu, Chengxiang Qi, Ying Cao, Chao Yang, Weifang Hu, Xuanhua Shi, Fan Yang, Mao Yang
SOSP | November 2024
Mao Yang
Assistant Managing Director
Publications
Publications by Year
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
IRGen: Generative Modeling for Image Retrieval
Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
ECCV'24 | October 2024
Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
September 2024
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
Arxiv | August 2024
LordNet: An efficient neural network for learning to solve parametric partial differential equations without simulated data
Xinquan Huang, Wenlei Shi, Xiaotian Gao, Xinran wei, Jia Zhang, Jiang Bian, Mao Yang, Tie-Yan Liu
Neural Networks | August 2024
Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
OSDI 2024 | July 2024
nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
OSDI | July 2024
Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang
ISCA 2024 | July 2024
Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-july-15-2024/
Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
OneSparse: A Unified System for Multi-index Vector Search
Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
2024 The Web Conference | May 2024
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search
Chengquan Feng, Li Lyna Zhang, Yuanchi Liu, Jiahang Xu, Chengruidong Zhang, Zhiyuan Wang, Ting Cao, Mao Yang, Haisheng Tan
NSDI 2024 | April 2024
PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'24) | April 2024
ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores
Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang
The 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP ’24) | March 2024
Best paper award
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
EMNLP | February 2024
-
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
The 29th ACM Symposium on Operating Systems Principles | October 2023
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://www.microsoft.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-november-8-2023/
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
OSDI'23 | July 2023
NN-Stretch: Automatic Neural Network Branching for Parallel Inference on Heterogeneous Multi-Processors
Jianyu Wei, Ting Cao, Shijie Cao, Shiqi Jiang, Shaowei Fu, Mao Yang, Yanyong Zhang, Yunxin Liu
The 21st International Conference on Mobile Systems, Applications, and Services (MobiSys ’23) | June 2023
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
FrozenHot Cache: Rethinking Cache Management for Modern Hardware
Ziyue Qiu, Juncheng Yang, Juncheng Zhang, Cheng Li, Xiaosong Ma, Qi Chen, Mao Yang, Yinlong Xu
EuroSys'23 | May 2023
On Modular Learning of Distributed Systems for Predicting End-to-End Latency
Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
-
A Neural Corpus Indexer for Document Retrieval
Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, Mao Yang
NeurIPS 2022 | November 2022
Outstanding Paper
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
ACM International Conference on Information and Knowledge Management (CIKM'22) | October 2022
Roller: Fast and Efficient Tensor Compilation for Deep Learning
Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
OSDI 2022 | July 2022
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
-
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
Argus: A Fully Transparent Incentive System for Anti-Piracy Campaigns
Xian Zhang, Xiaobing Guo, Zixuan Zeng, Wenyan Liu, Zhongxin Guo, Yang Chen, Shuo Chen, Qiufeng Yin, Mao Yang
The 40th International Symposium on Reliable Distributed Systems (SRDS) | September 2021
A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
MSR-TR-2021-20 | August 2021
Published by Microsoft
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
OpEvo: An Evolutionary Method for Tensor Operator Optimization
Xiaotian Gao, Wei Cui, Lintao Zhang, Mao Yang
AAAI 2021 | May 2021
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network (Tech Report)
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
MSR-TR-2021-3 | February 2021
Published by Microsoft
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees
Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang
2020 Operating Systems Design and Implementation | November 2020
Retiarii: A Deep Learning Exploratory-Training Framework
Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou
2020 Operating Systems Design and Implementation | November 2020
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
AutoSys: The Design and Operation of Learning-Augmented Systems
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou, Lifei Zhu, Zhao Lucis Li, Zibo Wang, Qi Chen, Quanlu Zhang, Chuanjie Liu, Wenjun Dai
ATC (USENIX Annual Technical Conference) | July 2020
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
MSR-TR-2020-20 | May 2020
Published by Microsoft
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
MSR-TR-2019-36 | November 2019
Published by Microsoft
The Case for Learning-and-System Co-design
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou
ACM SIGOPS Operating Systems Review | July 2019, Vol 53(1): pp. 68-74
-
Arming Cloud Services with Task Aspects
Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
MSR-TR-2014-150 | November 2014
Published by Microsoft
Rex: Replication at the Speed of Multi-core
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
EuroSys '14: Proceedings of the Ninth European Conference on Computer Systems | January 2014
-
Failure Recovery: When the Cure Is Worse Than the Disease
Zhenyu Guo, Sean McDirmid, Mao Yang, Li Zhuang, Pu Zhang, Yingwei Luo, Tom Bergan, Peter Bodík, Madan Musuvathi, Zheng Zhang, Lidong Zhou
HotOS | May 2013
HotOS
-
Paxos Made Parallel
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
MSR-TR-2012-118 | November 2012
-
G2: A Graph Processing System for Diagnosing Distributed Systems
Zhenyu Guo, Dong Zhou, Haoxiang Lin, Mao Yang, Fan Long, Chaoqiang Deng, Changshu Liu, Lidong Zhou
USENIX ATC 2011 | June 2011
The 2011 USENIX Annual Technical Conference
-
On the Efficiency and Programmability of Large Graph Processing in the Cloud
Rishan Chen, Xuetian Weng, Bingsheng He, Mao Yang, Byron Choi, Xiaoming Li
MSR-TR-2010-44 | May 2010
-
Comet: Batched Stream Processing in Data Intensive Distributed Computing
Bingsheng He, Mao Yang, Zhenyu Guo, Rishan Chen, Bing Su, Wei Lin, Lidong Zhou
MSR-TR-2009-180 | December 2009
MODIST: Transparent Model Checking of Unmodified Distributed Systems
Junfeng Yang, Tisheng Chen, Ming Wu, Zhilei Xu, Xuezheng Liu, Haoxiang Lin, Mao Yang, Fan Long, Lintao Zhang, Lidong Zhou
NSDI 2009 | April 2009
The 6th Symposium on Networked Systems Design and Implementation
Wave Computing in the Cloud
Mao Yang, Zhenyu Guo, Wei Lin, Bing Su, Lidong Zhou, Saven He
HotOS | April 2009
-
PacificA: Replication in Log-Based Distributed Storage Systems
Wei Lin, Mao Yang, Lintao Zhang, Lidong Zhou
MSR-TR-2008-25 | February 2008
-
A Multi-dimensional Reputation System Combined with Trust and Incentive Mechanisms in P2P File Sharing Systems
Mao Yang, Qinyuan Feng, Yafei Dai, Zheng Zhang
June 2007
An Empirical Study of Collusion Behavior in the Maze P2P File-Sharing System
Qiao Lian, Zheng Zhang, Mao Yang, Ben Y. Zhao, Yafei Dai, Xiaoming Li
MSR-TR-2006-14 | June 2007
-
Robust Incentives via Multi-level Tit-for-tat
Qiao Lian, Peng Yu, Mao Yang, Zheng Zhang, Yafei Dai, Xiaoming Li, Roger (Peng) Yu
February 2006
-
An Empirical Study of Free-Riding Behavior in the Maze P2P File-Sharing System
Mao Yang, Zhengyou Zhang
February 2005
-
Deployment of a Large-scale Peer-to-Peer Social Network
Mao Yang, Hua Chen, Ben Y. Zhao, Yafei Dai, Zhengyou Zhang
USENIX | December 2004
Publications by Research Area
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
IRGen: Generative Modeling for Image Retrieval
Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
ECCV'24 | October 2024
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
Arxiv | August 2024
LordNet: An efficient neural network for learning to solve parametric partial differential equations without simulated data
Xinquan Huang, Wenlei Shi, Xiaotian Gao, Xinran wei, Jia Zhang, Jiang Bian, Mao Yang, Tie-Yan Liu
Neural Networks | August 2024
nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
OSDI | July 2024
Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024
OneSparse: A Unified System for Multi-index Vector Search
Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
2024 The Web Conference | May 2024
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
EMNLP | February 2024
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
The 29th ACM Symposium on Operating Systems Principles | October 2023
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
A Neural Corpus Indexer for Document Retrieval
Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, Mao Yang
NeurIPS 2022 | November 2022
Outstanding Paper
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
ACM International Conference on Information and Knowledge Management (CIKM'22) | October 2022
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
MSR-TR-2021-20 | August 2021
Published by Microsoft
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network (Tech Report)
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
MSR-TR-2021-3 | February 2021
Published by Microsoft
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
MSR-TR-2020-20 | May 2020
Published by Microsoft
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
MSR-TR-2019-36 | November 2019
Published by Microsoft
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
Uncovering Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
Siran Liu, Chengxiang Qi, Ying Cao, Chao Yang, Weifang Hu, Xuanhua Shi, Fan Yang, Mao Yang
SOSP | November 2024
Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
September 2024
nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
OSDI | July 2024
Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
OSDI 2024 | July 2024
Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang
ISCA 2024 | July 2024
Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-july-15-2024/
Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search
Chengquan Feng, Li Lyna Zhang, Yuanchi Liu, Jiahang Xu, Chengruidong Zhang, Zhiyuan Wang, Ting Cao, Mao Yang, Haisheng Tan
NSDI 2024 | April 2024
PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'24) | April 2024
ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores
Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang
The 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP ’24) | March 2024
Best paper award
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://www.microsoft.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
The 29th ACM Symposium on Operating Systems Principles | October 2023
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-november-8-2023/
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
OSDI'23 | July 2023
Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
NN-Stretch: Automatic Neural Network Branching for Parallel Inference on Heterogeneous Multi-Processors
Jianyu Wei, Ting Cao, Shijie Cao, Shiqi Jiang, Shaowei Fu, Mao Yang, Yanyong Zhang, Yunxin Liu
The 21st International Conference on Mobile Systems, Applications, and Services (MobiSys ’23) | June 2023
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
On Modular Learning of Distributed Systems for Predicting End-to-End Latency
Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
OSDI 2022 | July 2022
Roller: Fast and Efficient Tensor Compilation for Deep Learning
Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
MSR-TR-2021-20 | August 2021
Published by Microsoft
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
OpEvo: An Evolutionary Method for Tensor Operator Optimization
Xiaotian Gao, Wei Cui, Lintao Zhang, Mao Yang
AAAI 2021 | May 2021
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network (Tech Report)
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
MSR-TR-2021-3 | February 2021
Published by Microsoft
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees
Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang
2020 Operating Systems Design and Implementation | November 2020
Retiarii: A Deep Learning Exploratory-Training Framework
Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou
2020 Operating Systems Design and Implementation | November 2020
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
AutoSys: The Design and Operation of Learning-Augmented Systems
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou, Lifei Zhu, Zhao Lucis Li, Zibo Wang, Qi Chen, Quanlu Zhang, Chuanjie Liu, Wenjun Dai
ATC (USENIX Annual Technical Conference) | July 2020
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
MSR-TR-2020-20 | May 2020
Published by Microsoft
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
MSR-TR-2019-36 | November 2019
Published by Microsoft
The Case for Learning-and-System Co-design
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou
ACM SIGOPS Operating Systems Review | July 2019, Vol 53(1): pp. 68-74
Arming Cloud Services with Task Aspects
Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
MSR-TR-2014-150 | November 2014
Published by Microsoft
Rex: Replication at the Speed of Multi-core
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
EuroSys '14: Proceedings of the Ninth European Conference on Computer Systems | January 2014
Failure Recovery: When the Cure Is Worse Than the Disease
Zhenyu Guo, Sean McDirmid, Mao Yang, Li Zhuang, Pu Zhang, Yingwei Luo, Tom Bergan, Peter Bodík, Madan Musuvathi, Zheng Zhang, Lidong Zhou
HotOS | May 2013
HotOS
Paxos Made Parallel
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
MSR-TR-2012-118 | November 2012
G2: A Graph Processing System for Diagnosing Distributed Systems
Zhenyu Guo, Dong Zhou, Haoxiang Lin, Mao Yang, Fan Long, Chaoqiang Deng, Changshu Liu, Lidong Zhou
USENIX ATC 2011 | June 2011
The 2011 USENIX Annual Technical Conference
Comet: Batched Stream Processing in Data Intensive Distributed Computing
Bingsheng He, Mao Yang, Zhenyu Guo, Rishan Chen, Bing Su, Wei Lin, Lidong Zhou
MSR-TR-2009-180 | December 2009
MODIST: Transparent Model Checking of Unmodified Distributed Systems
Junfeng Yang, Tisheng Chen, Ming Wu, Zhilei Xu, Xuezheng Liu, Haoxiang Lin, Mao Yang, Fan Long, Lintao Zhang, Lidong Zhou
NSDI 2009 | April 2009
The 6th Symposium on Networked Systems Design and Implementation
PacificA: Replication in Log-Based Distributed Storage Systems
Wei Lin, Mao Yang, Lintao Zhang, Lidong Zhou
MSR-TR-2008-25 | February 2008
A Multi-dimensional Reputation System Combined with Trust and Incentive Mechanisms in P2P File Sharing Systems
Mao Yang, Qinyuan Feng, Yafei Dai, Zheng Zhang
June 2007
An Empirical Study of Collusion Behavior in the Maze P2P File-Sharing System
Qiao Lian, Zheng Zhang, Mao Yang, Ben Y. Zhao, Yafei Dai, Xiaoming Li
MSR-TR-2006-14 | June 2007
Robust Incentives via Multi-level Tit-for-tat
Qiao Lian, Peng Yu, Mao Yang, Zheng Zhang, Yafei Dai, Xiaoming Li, Roger (Peng) Yu
February 2006
-
Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
September 2024
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network (Tech Report)
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
MSR-TR-2021-3 | February 2021
Published by Microsoft
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
MSR-TR-2020-20 | May 2020
Published by Microsoft
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
MSR-TR-2019-36 | November 2019
Published by Microsoft
Arming Cloud Services with Task Aspects
Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
MSR-TR-2014-150 | November 2014
Published by Microsoft
On the Efficiency and Programmability of Large Graph Processing in the Cloud
Rishan Chen, Xuetian Weng, Bingsheng He, Mao Yang, Byron Choi, Xiaoming Li
MSR-TR-2010-44 | May 2010
-
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
FrozenHot Cache: Rethinking Cache Management for Modern Hardware
Ziyue Qiu, Juncheng Yang, Juncheng Zhang, Cheng Li, Xiaosong Ma, Qi Chen, Mao Yang, Yinlong Xu
EuroSys'23 | May 2023
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
-
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
-
Argus: A Fully Transparent Incentive System for Anti-Piracy Campaigns
Xian Zhang, Xiaobing Guo, Zixuan Zeng, Wenyan Liu, Zhongxin Guo, Yang Chen, Shuo Chen, Qiufeng Yin, Mao Yang
The 40th International Symposium on Reliable Distributed Systems (SRDS) | September 2021
-
MODIST: Transparent Model Checking of Unmodified Distributed Systems
Junfeng Yang, Tisheng Chen, Ming Wu, Zhilei Xu, Xuezheng Liu, Haoxiang Lin, Mao Yang, Fan Long, Lintao Zhang, Lidong Zhou
NSDI 2009 | April 2009
The 6th Symposium on Networked Systems Design and Implementation
-
Wave Computing in the Cloud
Mao Yang, Zhenyu Guo, Wei Lin, Bing Su, Lidong Zhou, Saven He
HotOS | April 2009
-
An Empirical Study of Free-Riding Behavior in the Maze P2P File-Sharing System
Mao Yang, Zhengyou Zhang
February 2005
Deployment of a Large-scale Peer-to-Peer Social Network
Mao Yang, Hua Chen, Ben Y. Zhao, Yafei Dai, Zhengyou Zhang
USENIX | December 2004
Publications by Type
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
Uncovering Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
Siran Liu, Chengxiang Qi, Ying Cao, Chao Yang, Weifang Hu, Xuanhua Shi, Fan Yang, Mao Yang
SOSP | November 2024
IRGen: Generative Modeling for Image Retrieval
Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
ECCV'24 | October 2024
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
Arxiv | August 2024
nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
OSDI | July 2024
Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
OSDI 2024 | July 2024
Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang
ISCA 2024 | July 2024
Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-july-15-2024/
Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
OneSparse: A Unified System for Multi-index Vector Search
Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
2024 The Web Conference | May 2024
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search
Chengquan Feng, Li Lyna Zhang, Yuanchi Liu, Jiahang Xu, Chengruidong Zhang, Zhiyuan Wang, Ting Cao, Mao Yang, Haisheng Tan
NSDI 2024 | April 2024
PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'24) | April 2024
ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores
Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang
The 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP ’24) | March 2024
Best paper award
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
EMNLP | February 2024
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://www.microsoft.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
The 29th ACM Symposium on Operating Systems Principles | October 2023
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-november-8-2023/
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
OSDI'23 | July 2023
Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
NN-Stretch: Automatic Neural Network Branching for Parallel Inference on Heterogeneous Multi-Processors
Jianyu Wei, Ting Cao, Shijie Cao, Shiqi Jiang, Shaowei Fu, Mao Yang, Yanyong Zhang, Yunxin Liu
The 21st International Conference on Mobile Systems, Applications, and Services (MobiSys ’23) | June 2023
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
FrozenHot Cache: Rethinking Cache Management for Modern Hardware
Ziyue Qiu, Juncheng Yang, Juncheng Zhang, Cheng Li, Xiaosong Ma, Qi Chen, Mao Yang, Yinlong Xu
EuroSys'23 | May 2023
On Modular Learning of Distributed Systems for Predicting End-to-End Latency
Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
A Neural Corpus Indexer for Document Retrieval
Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, Mao Yang
NeurIPS 2022 | November 2022
Outstanding Paper
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
ACM International Conference on Information and Knowledge Management (CIKM'22) | October 2022
SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
OSDI 2022 | July 2022
Roller: Fast and Efficient Tensor Compilation for Deep Learning
Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
Argus: A Fully Transparent Incentive System for Anti-Piracy Campaigns
Xian Zhang, Xiaobing Guo, Zixuan Zeng, Wenyan Liu, Zhongxin Guo, Yang Chen, Shuo Chen, Qiufeng Yin, Mao Yang
The 40th International Symposium on Reliable Distributed Systems (SRDS) | September 2021
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
OpEvo: An Evolutionary Method for Tensor Operator Optimization
Xiaotian Gao, Wei Cui, Lintao Zhang, Mao Yang
AAAI 2021 | May 2021
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees
Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang
2020 Operating Systems Design and Implementation | November 2020
Retiarii: A Deep Learning Exploratory-Training Framework
Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou
2020 Operating Systems Design and Implementation | November 2020
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
AutoSys: The Design and Operation of Learning-Augmented Systems
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou, Lifei Zhu, Zhao Lucis Li, Zibo Wang, Qi Chen, Quanlu Zhang, Chuanjie Liu, Wenjun Dai
ATC (USENIX Annual Technical Conference) | July 2020
Rex: Replication at the Speed of Multi-core
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
EuroSys '14: Proceedings of the Ninth European Conference on Computer Systems | January 2014
Failure Recovery: When the Cure Is Worse Than the Disease
Zhenyu Guo, Sean McDirmid, Mao Yang, Li Zhuang, Pu Zhang, Yingwei Luo, Tom Bergan, Peter Bodík, Madan Musuvathi, Zheng Zhang, Lidong Zhou
HotOS | May 2013
HotOS
G2: A Graph Processing System for Diagnosing Distributed Systems
Zhenyu Guo, Dong Zhou, Haoxiang Lin, Mao Yang, Fan Long, Chaoqiang Deng, Changshu Liu, Lidong Zhou
USENIX ATC 2011 | June 2011
The 2011 USENIX Annual Technical Conference
MODIST: Transparent Model Checking of Unmodified Distributed Systems
Junfeng Yang, Tisheng Chen, Ming Wu, Zhilei Xu, Xuezheng Liu, Haoxiang Lin, Mao Yang, Fan Long, Lintao Zhang, Lidong Zhou
NSDI 2009 | April 2009
The 6th Symposium on Networked Systems Design and Implementation
Wave Computing in the Cloud
Mao Yang, Zhenyu Guo, Wei Lin, Bing Su, Lidong Zhou, Saven He
HotOS | April 2009
A Multi-dimensional Reputation System Combined with Trust and Incentive Mechanisms in P2P File Sharing Systems
Mao Yang, Qinyuan Feng, Yafei Dai, Zheng Zhang
June 2007
Robust Incentives via Multi-level Tit-for-tat
Qiao Lian, Peng Yu, Mao Yang, Zheng Zhang, Yafei Dai, Xiaoming Li, Roger (Peng) Yu
February 2006
An Empirical Study of Free-Riding Behavior in the Maze P2P File-Sharing System
Mao Yang, Zhengyou Zhang
February 2005
Deployment of a Large-scale Peer-to-Peer Social Network
Mao Yang, Hua Chen, Ben Y. Zhao, Yafei Dai, Zhengyou Zhang
USENIX | December 2004
-
-
LordNet: An efficient neural network for learning to solve parametric partial differential equations without simulated data
Xinquan Huang, Wenlei Shi, Xiaotian Gao, Xinran wei, Jia Zhang, Jiang Bian, Mao Yang, Tie-Yan Liu
Neural Networks | August 2024
The Case for Learning-and-System Co-design
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou
ACM SIGOPS Operating Systems Review | July 2019, Vol 53(1): pp. 68-74
-
A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
MSR-TR-2021-20 | August 2021
Published by Microsoft
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network (Tech Report)
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
MSR-TR-2021-3 | February 2021
Published by Microsoft
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
MSR-TR-2020-20 | May 2020
Published by Microsoft
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
MSR-TR-2019-36 | November 2019
Published by Microsoft
Arming Cloud Services with Task Aspects
Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
MSR-TR-2014-150 | November 2014
Published by Microsoft
Paxos Made Parallel
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
MSR-TR-2012-118 | November 2012
On the Efficiency and Programmability of Large Graph Processing in the Cloud
Rishan Chen, Xuetian Weng, Bingsheng He, Mao Yang, Byron Choi, Xiaoming Li
MSR-TR-2010-44 | May 2010
Comet: Batched Stream Processing in Data Intensive Distributed Computing
Bingsheng He, Mao Yang, Zhenyu Guo, Rishan Chen, Bing Su, Wei Lin, Lidong Zhou
MSR-TR-2009-180 | December 2009
PacificA: Replication in Log-Based Distributed Storage Systems
Wei Lin, Mao Yang, Lintao Zhang, Lidong Zhou
MSR-TR-2008-25 | February 2008
An Empirical Study of Collusion Behavior in the Maze P2P File-Sharing System
Qiao Lian, Zheng Zhang, Mao Yang, Ben Y. Zhao, Yafei Dai, Xiaoming Li
MSR-TR-2006-14 | June 2007