Yuqing Yang

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Project

Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation

Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang

OSDI 2024 | July 2024

Publication Github

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu

OSDI 2024 | May 2024

Publication Github

Real-Time Neural Video Recovery and Enhancement on Mobile Devices

Yifan Yang, Yuqing Yang, Lili Qiu

CoNEXT 2024 - International Conference on emerging Networking EXperiments and Technologies | April 2024

Preprint

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

SPFresh: Incremental In-Place Update for Billion-Scale Vector Search

Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang

SOSP'23 | October 2023

Publication

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices

Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang

ICCV 2023 | October 2023

Publication

SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference

Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang

ICCV 2023 | October 2023

Publication

Attentive Mask CLIP

Yifan Yang, Houwen Peng, Xinyang Jiang, Huiqiang Jiang, Yuqing Yang, Lili Qiu

2023 International Conference on Computer Vision | October 2023

Publication

ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation

Yasheng Sun, Yifan Yang, Houwen Peng, Yifei Shen, Yuqing Yang, Han Hu, Lili Qiu, Hideki Koike, Yuqing Yang

NeurIPS 2023 | October 2023

Publication

Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers

Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, Yuqing Yang

ICLR 2024 | September 2023

Publication Publication

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

End-to-End Word-Level Pronunciation Assessment with MASK Pre-training

Yukang Liang, Kaitao Song, Shaoguang Mao, Huiqiang Jiang, Luna K. Qiu, Yuqing Yang, Dongsheng Li, Linli Xu, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference

Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang

KDD 2023 | August 2023

Publication

Optimizing Dynamic Neural Networks with Brainstorm

Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo

OSDI'23 | July 2023

Publication

VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity

Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou

OSDI'23 | July 2023

Publication

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023

Publication Project

EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention

Xinyu Liu, Houwen Peng, Ningxin Zheng, Yuqing Yang, Han Hu, Yixuan Yuan

June 2023

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Publication

Enabling Real-time Neural Recovery for Cloud Gaming on Mobile Devices

Yifan Yang, Lili Qiu, Yuqing Yang

June 2023

Preprint

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou

EuroSys 2023 | May 2023

Publication

Online Video Super-Resolution with Convolutional Kernel Bypass Graft

Jun Xiao, Xinyang Jiang, Ningxin Zheng, Huan Yang, Yifan Yang, Yuqing Yang, Dongsheng Li, Kin-Man Lam

IEEE Transactions on Multimedia | February 2023

Publication Project

Towards Inference Efficient Deep Ensemble Learning

Ziyue Li, Kan Ren, Yifan Yang, Xinyang Jiang, Yuqing Yang, Dongsheng Li

AAAI 23 | February 2023

Author's Version

Reinforcement Learning with Automated Auxiliary Loss Search

Tairan He, Yuge Zhang, Kan Ren, Minghuan Liu, Che Wang, Weinan Zhang, Yuqing Yang, Dongsheng Li

2022 Neural Information Processing Systems | October 2022

Publication

PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training

Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo

2022 USENIX Annual Technical Conference | July 2022

PDF

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project Project

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

Privacy-preserving Online AutoML for Domain-Specific Face Detection

Chenqian Yan, Yuge Zhang, Quanlu Zhang, Yaming Yang, Xinyang Jiang, Yuqing Yang, Baoyuan Wang

CVPR 2022 | May 2022

Publication

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

ICLR 2022 | April 2022

Publication

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

2022 International Conference on Learning Representations | March 2022

Publication

nn-METER: Towards Accurate Latency Prediction of DNN Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

GetMobile: Mobile Computing and Communications | December 2021, Vol 25(4): pp. 19-23

SigMobile Research Highlight

Publication

Towards Generating Real-World Time Series Data

Hengzhi Pei, Kan Ren, Yuqing Yang, Chang Liu, Tao Qin, Dongsheng Li

ICDM 21 | November 2021

Publication Publication Publication

AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing

Yuge Zhang, Chenqian Yan, Quanlu Zhang, Li Lyna Zhang, Yaming Yang, Xiaotian Gao, Yuqing Yang

August 2021

Published by: arXiv | August 2021

Publication

nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'21) | June 2021

Best Paper Award

Publication

Fast Hardware-Aware Neural Architecture Search

Li Lyna Zhang, Yuqing Yang, Yuhang Jiang, Wenwu Zhu, Yunxin Liu

CVPRW (Joint Workshop on Efficient Deep Learning in Computer Vision) | June 2020

DOI PDF Publication

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Project

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu

OSDI 2024 | May 2024

Publication Github

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices

Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang

ICCV 2023 | October 2023

Publication

SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference

Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang

ICCV 2023 | October 2023

Publication

Attentive Mask CLIP

Yifan Yang, Houwen Peng, Xinyang Jiang, Huiqiang Jiang, Yuqing Yang, Lili Qiu

2023 International Conference on Computer Vision | October 2023

Publication

ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation

Yasheng Sun, Yifan Yang, Houwen Peng, Yifei Shen, Yuqing Yang, Han Hu, Lili Qiu, Hideki Koike, Yuqing Yang

NeurIPS 2023 | October 2023

Publication

Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers

Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, Yuqing Yang

ICLR 2024 | September 2023

Publication Publication

End-to-End Word-Level Pronunciation Assessment with MASK Pre-training

Yukang Liang, Kaitao Song, Shaoguang Mao, Huiqiang Jiang, Luna K. Qiu, Yuqing Yang, Dongsheng Li, Linli Xu, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference

Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang

KDD 2023 | August 2023

Publication

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

Towards Inference Efficient Deep Ensemble Learning

Ziyue Li, Kan Ren, Yifan Yang, Xinyang Jiang, Yuqing Yang, Dongsheng Li

AAAI 23 | February 2023

Author's Version

Reinforcement Learning with Automated Auxiliary Loss Search

Tairan He, Yuge Zhang, Kan Ren, Minghuan Liu, Che Wang, Weinan Zhang, Yuqing Yang, Dongsheng Li

2022 Neural Information Processing Systems | October 2022

Publication

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

ICLR 2022 | April 2022

Publication

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

2022 International Conference on Learning Representations | March 2022

Publication

AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing

Yuge Zhang, Chenqian Yan, Quanlu Zhang, Li Lyna Zhang, Yaming Yang, Xiaotian Gao, Yuqing Yang

August 2021

Published by: arXiv | August 2021

Publication

nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'21) | June 2021

Best Paper Award

Publication

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Project

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Project

Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation

Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang

OSDI 2024 | July 2024

Publication Github

Real-Time Neural Video Recovery and Enhancement on Mobile Devices

Yifan Yang, Yuqing Yang, Lili Qiu

CoNEXT 2024 - International Conference on emerging Networking EXperiments and Technologies | April 2024

Preprint

SPFresh: Incremental In-Place Update for Billion-Scale Vector Search

Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang

SOSP'23 | October 2023

Publication

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices

Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang

ICCV 2023 | October 2023

Publication

SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference

Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang

ICCV 2023 | October 2023

Publication

Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference

Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang

KDD 2023 | August 2023

Publication

Optimizing Dynamic Neural Networks with Brainstorm

Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo

OSDI'23 | July 2023

Publication

VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity

Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou

OSDI'23 | July 2023

Publication

Enabling Real-time Neural Recovery for Cloud Gaming on Mobile Devices

Yifan Yang, Lili Qiu, Yuqing Yang

June 2023

Preprint

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023

Publication Project

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou

EuroSys 2023 | May 2023

Publication

PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training

Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo

2022 USENIX Annual Technical Conference | July 2022

PDF

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project Project

nn-METER: Towards Accurate Latency Prediction of DNN Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

GetMobile: Mobile Computing and Communications | December 2021, Vol 25(4): pp. 19-23

SigMobile Research Highlight

Publication

nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'21) | June 2021

Best Paper Award

Publication

Fast Hardware-Aware Neural Architecture Search

Li Lyna Zhang, Yuqing Yang, Yuhang Jiang, Wenwu Zhu, Yunxin Liu

CVPRW (Joint Workshop on Efficient Deep Learning in Computer Vision) | June 2020

DOI PDF Publication

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

Towards Inference Efficient Deep Ensemble Learning

Ziyue Li, Kan Ren, Yifan Yang, Xinyang Jiang, Yuqing Yang, Dongsheng Li

AAAI 23 | February 2023

Author's Version

Towards Generating Real-World Time Series Data

Hengzhi Pei, Kan Ren, Yuqing Yang, Chang Liu, Tao Qin, Dongsheng Li

ICDM 21 | November 2021

Publication Publication Publication

End-to-End Word-Level Pronunciation Assessment with MASK Pre-training

Yukang Liang, Kaitao Song, Shaoguang Mao, Huiqiang Jiang, Luna K. Qiu, Yuqing Yang, Dongsheng Li, Linli Xu, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention

Xinyu Liu, Houwen Peng, Ningxin Zheng, Yuqing Yang, Han Hu, Yixuan Yuan

June 2023

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Publication

Online Video Super-Resolution with Convolutional Kernel Bypass Graft

Jun Xiao, Xinyang Jiang, Ningxin Zheng, Huan Yang, Yifan Yang, Yuqing Yang, Dongsheng Li, Kin-Man Lam

IEEE Transactions on Multimedia | February 2023

Publication Project

Privacy-preserving Online AutoML for Domain-Specific Face Detection

Chenqian Yan, Yuge Zhang, Quanlu Zhang, Yaming Yang, Xinyang Jiang, Yuqing Yang, Baoyuan Wang

CVPR 2022 | May 2022

Publication

Towards Generating Real-World Time Series Data

Hengzhi Pei, Kan Ren, Yuqing Yang, Chang Liu, Tao Qin, Dongsheng Li

ICDM 21 | November 2021

Publication Publication Publication

nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'21) | June 2021

Best Paper Award

Publication

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

Enabling Real-time Neural Recovery for Cloud Gaming on Mobile Devices

Yifan Yang, Lili Qiu, Yuqing Yang

June 2023

Preprint

EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention

Xinyu Liu, Houwen Peng, Ningxin Zheng, Yuqing Yang, Han Hu, Yixuan Yuan

June 2023

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Publication

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Project

Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation

Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang

OSDI 2024 | July 2024

Publication Github

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu

OSDI 2024 | May 2024

Publication Github

Real-Time Neural Video Recovery and Enhancement on Mobile Devices

Yifan Yang, Yuqing Yang, Lili Qiu

CoNEXT 2024 - International Conference on emerging Networking EXperiments and Technologies | April 2024

Preprint

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

SPFresh: Incremental In-Place Update for Billion-Scale Vector Search

Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang

SOSP'23 | October 2023

Publication

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices

Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang

ICCV 2023 | October 2023

Publication

SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference

Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang

ICCV 2023 | October 2023

Publication

Attentive Mask CLIP

Yifan Yang, Houwen Peng, Xinyang Jiang, Huiqiang Jiang, Yuqing Yang, Lili Qiu

2023 International Conference on Computer Vision | October 2023

Publication

ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation

Yasheng Sun, Yifan Yang, Houwen Peng, Yifei Shen, Yuqing Yang, Han Hu, Lili Qiu, Hideki Koike, Yuqing Yang

NeurIPS 2023 | October 2023

Publication

Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers

Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, Yuqing Yang

ICLR 2024 | September 2023

Publication Publication

End-to-End Word-Level Pronunciation Assessment with MASK Pre-training

Yukang Liang, Kaitao Song, Shaoguang Mao, Huiqiang Jiang, Luna K. Qiu, Yuqing Yang, Dongsheng Li, Linli Xu, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference

Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang

KDD 2023 | August 2023

Publication

Optimizing Dynamic Neural Networks with Brainstorm

Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo

OSDI'23 | July 2023

Publication

VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity

Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou

OSDI'23 | July 2023

Publication

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023

Publication Project

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou

EuroSys 2023 | May 2023

Publication

Towards Inference Efficient Deep Ensemble Learning

Ziyue Li, Kan Ren, Yifan Yang, Xinyang Jiang, Yuqing Yang, Dongsheng Li

AAAI 23 | February 2023

Author's Version

Reinforcement Learning with Automated Auxiliary Loss Search

Tairan He, Yuge Zhang, Kan Ren, Minghuan Liu, Che Wang, Weinan Zhang, Yuqing Yang, Dongsheng Li

2022 Neural Information Processing Systems | October 2022

Publication

PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training

Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo

2022 USENIX Annual Technical Conference | July 2022

PDF

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project Project

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

Privacy-preserving Online AutoML for Domain-Specific Face Detection

Chenqian Yan, Yuge Zhang, Quanlu Zhang, Yaming Yang, Xinyang Jiang, Yuqing Yang, Baoyuan Wang

CVPR 2022 | May 2022

Publication

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

ICLR 2022 | April 2022

Publication

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

2022 International Conference on Learning Representations | March 2022

Publication

Towards Generating Real-World Time Series Data

Hengzhi Pei, Kan Ren, Yuqing Yang, Chang Liu, Tao Qin, Dongsheng Li

ICDM 21 | November 2021

Publication Publication Publication

nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'21) | June 2021

Best Paper Award

Publication

Fast Hardware-Aware Neural Architecture Search

Li Lyna Zhang, Yuqing Yang, Yuhang Jiang, Wenwu Zhu, Yunxin Liu

CVPRW (Joint Workshop on Efficient Deep Learning in Computer Vision) | June 2020

DOI PDF Publication

Online Video Super-Resolution with Convolutional Kernel Bypass Graft

Jun Xiao, Xinyang Jiang, Ningxin Zheng, Huan Yang, Yifan Yang, Yuqing Yang, Dongsheng Li, Kin-Man Lam

IEEE Transactions on Multimedia | February 2023

Publication Project

nn-METER: Towards Accurate Latency Prediction of DNN Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

GetMobile: Mobile Computing and Communications | December 2021, Vol 25(4): pp. 19-23

SigMobile Research Highlight

Publication

AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing

Yuge Zhang, Chenqian Yan, Quanlu Zhang, Li Lyna Zhang, Yaming Yang, Xiaotian Gao, Yuqing Yang

August 2021

Published by: arXiv | August 2021

Publication