DéjàVu: KV-cache Streaming for Fast, Fault-tolerant Generative LLM Serving
Foteini Strati, Sara Mcallister, Amar Phanishayee, Jakub Tarnawski, Ana Klimovic
ICML 2024 | July 2024
July 21, 2024 –
July 27, 2024
Microsoft at ICML 2024
Central European Summer Time (UTC +2)
Location: Vienna, Austria
Publications
Publications
Publications by Year
-
Integrated Hardware Architecture and Device Placement Search
Irene Wang, Jakub Tarnawski, Amar Phanishayee, Divya Mahajan
2024 International Conference on Machine Learning | July 2024
Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyond
Xutong Liu, Siwei Wang, Jinhang Zuo, Han Zhong, Xuchuang Wang, Zhiyong Wang, Shuai Li, Mohammad Hajiesmaili, John C.S. Lui, Wei Chen
Proceedings of the 41st International Conference on Machine Learning (ICML) | July 2024
Intersecting-Boundary-Sensitive Fingerprinting for Tampering Detection of DNN Models
2024 International Conference on Machine Learning | July 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin
ICML 2024 | July 2024
Spotlight
OAK: Enriching Document Representations using Auxiliary Knowledge for Extreme Classification
Shikhar Mohan, Deepak Saini, Anshul Mittal, Sayak Roy Chowdhury, Bhawna Paliwal, Jian Jiao, Manish Gupta, Manik Varma
2024 International Conference on Machine Learning | July 2024
Submodular Framework for Structured-Sparse Optimal Transport
Piyushi Manupriya, Pratik Jawanpuria, Karthik S. Gurumoorthy, S. Jagarlapudi, Bamdev Mishra
ICML 2024 | June 2024
PRISE: LLM-Style Sequence Compression for Learning Temporal Action Abstractions in Control
Ruijie Zheng, Ching-An Cheng, Hal Daumé III, Furong Huang, Andrey Kolobov
ICML 2024 | June 2024
ORAL
Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective
Fabian Falck, Ziyu Wang, Chris Holmes
ICML 2024 | June 2024
NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models
Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
ICML | June 2024
Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problems
Yifan Xia, Xianliang Yang, Zichuan Liu, Zhihao Liu, Lei Song, Jiang Bian
2024 International Conference on Machine Learning | June 2024
Riemannian coordinate descent algorithms on matrix manifolds
Andi Han, Pratik Jawanpuria, Bamdev Mishra
ICML 2024 | June 2024
Safe and Robust Subgame Exploitation in Imperfect Information Games
Zhenxing Ge, Zheng Xu, Tianyu Ding, Linjian Meng, Bo An, Wenbin Li, Yang Gao
ICML 2024 | June 2024
Think Before You Act: Decision Transformers with Internal Working Memory
Jikun Kang, Romain Laroche, Xingdi Yuan, Adam Trischler, Xuefei Liu, Jie Fu
ICML 2024 | May 2024
Towards Modular LLMs by Building and Reusing a Library of LoRAs
O. Ostapenko, Zhan Su, E. Ponti, Laurent Charlin, Nicolas Le Roux, Matheus Pereira, Lucas Caccia, Alessandro Sordoni
ICML 2024 | May 2024
TimeX++: Learning Time-Series Explanations with Information Bottleneck
Zichuan Liu, Tianchun Wang, Jimeng Shi, Xu Zheng, Zhuomin Chen, Lei Song, Wenqian Dong, J. Obeysekera, Farhad Shirani, Dongsheng Luo
ICML 2024 | May 2024
Generalizing Knowledge Graph Embedding with Universal Orthogonal Parameterization
Rui Li, Chaozhuo Li, Yanming Shen, Zeyu Zhang, Xu Chen
ICML 2024 | May 2024
A Fixed-Point Approach for Causal Generative Modeling
Meyer Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma
ICML 2024 | May 2024
Precise Accuracy / Robustness Tradeoffs in Regression: Case of General Norms
Elvis Dohmatob, Meyer Scetbon
ICML 2024 | May 2024
Provably Robust DPO: Aligning Language Models with Noisy Feedback
Sayak Ray Chowdhury, Anush Kini, Nagarajan Natarajan
ICML 2024 | May 2024
Debiased Distribution Compression
Lingxiao Li, Raaz Dwivedi, Lester Mackey
ICML 2024 | April 2024
Token-level Direct Preference Optimization
Yongcheng Zeng, Guoqing Liu, Weiyu Ma, Ning Yang, Haifeng Zhang, Jun Wang
ICML 2024 | April 2024
Provable Interactive Learning with Hindsight Instruction Feedback
Dipendra Misra, Aldo Pacchiano, Robert E. Schapire
ICML 2024 | April 2024
FiP: A Fixed-Point Approach for Causal Generative Modeling
M. Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma
ICML 2024 | April 2024
Out-of-Distribution Detection via Deep Multi-Comprehension Ensemble
Chenhui Xu, Fuxun Yu, Zirui Xu, Nathan Inkawhich, Xiang Chen
ICML 2024 | March 2024
Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction
He Zhang, Chang Liu, Zun Wang, Xinran wei, Siyuan Liu, Nanning Zheng, Bin Shao, Tie-Yan Liu
ICML 2024 | March 2024
Rethinking Generative Large Language Model Evaluation for Semantic Comprehension
Fangyun Wei, Xi Chen, Linzi Luo
ICML 2024 | March 2024
Scalable Online Exploration via Coverability
P. Amortila, Dylan Foster, Akshay Krishnamurthy
ICML 2024 | March 2024
Stabilizing Policy Gradients for Stochastic Differential Equations via Consistency with Perturbation Process
Xiangxin Zhou, Liang Wang, Yichi Zhou
ICML 2024 | March 2024
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin
ICML 2024 | March 2024
Spotlight
Provable Risk-Sensitive Distributional Reinforcement Learning with General Function Approximation
Yu Chen, Xiangcheng Zhang, Siwei Wang, Longbo Huang
ICML 2024 | February 2024
Clifford-Steerable Convolutional Neural Networks
Maksim Zhdanov, David Ruhe, Maurice Weiler, Ana Lucic, Johannes Brandstetter, Patrick Forr'e
ICML 2024 | February 2024
DyVal 2: Dynamic Evaluation of Large Language Models by Meta Probing Agents
Kaijie Zhu, Jindong Wang, Qinlin Zhao, Ruochen Xu, Xing Xie
ICML 2024 | February 2024
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
PRISE: Learning Temporal Action Abstractions as a Sequence Compression Problem
Ruijie Zheng, Ching-An Cheng, Hal Daumé III, Furong Huang, Andrey Kolobov
ICML 2024 | February 2024
Using Left and Right Brains Together: Towards Vision and Language Planning
Jun Cen, Chenfei Wu, Xiao Liu, Sheng-Siang Yin, Yixuan Pei, Jinglong Yang, Qifeng Chen, Nan Duan, Jianguo Zhang
ICML 2024 | February 2024
ChemReasoner: Heuristic Search over a Large Language Model’s Knowledge Space using Quantum-Chemical Feedback
Henry W Sprueill, Carl N. Edwards, Khushbu Agarwal, Mariefel V. Olarte, Udishnu Sanyal, Conrad Johnston, Hongbin Liu, Heng Ji, Sutanay Choudhury
ICML 2024 | February 2024
DoRA: Weight-Decomposed Low-Rank Adaptation
Shih-yang Liu, Chien-Yi Wang, Hongxu Yin, Pavlo Molchanov, Yu-Chiang Frank Wang, Kwang-Ting Cheng, Min-Hung Chen
ICML 2024 | February 2024
Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models
Francesca-Zhoufan Li, Ava P. Amini, Yisong Yue, Kevin Yang, Alex Lu
ICML 2024 | February 2024
Efficient Contextual Bandits with Uninformed Feedback Graphs
Mengxiao Zhang, Yuheng Zhang, Haipeng Luo, Paul Mineiro
ICML 2024 | February 2024
Understanding the Training Speedup from Sampling with Approximate Losses
Rudrajit Das, Xi Chen, Bertram Ieong, Parikshit Bansal, Sujay Sanghavi
ICML 2024 | February 2024
Premier-TACO is a Few-Shot Policy Learner: Pretraining Multitask Representation via Temporal Action-Driven Contrastive Loss
Ruijie Zheng, Yongyuan Liang, Xiyao Wang, Shuang Ma, Hal Daumé III, Huazhe Xu, John Langford, Praveen Palanisamy, Kalyan Shankar Basu, Furong Huang
ICML 2024 | February 2024
Open-Vocabulary Calibration for Vision-Language Models
Shuoyuan Wang, Jindong Wang, Guoqing Wang, Bob Zhang, Kaiyang Zhou, Hongxin Wei
ICML 2024 | February 2024
AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Calls
Yu Du, Fangyun Wei, Hongyang Zhang
ICML 2024 | February 2024
DistiLLM: Towards Streamlined Distillation for Large Language Models
Jongwoo Ko, Sungnyun Kim, Tianyi Chen, Se-Young Yun
ICML 2024 | February 2024
HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal
Mantas Mazeika, Long Phan, Xuwang Yin, Andy Zou, Zifan Wang, Norman Mu, Elham Sakhaee, Nathaniel Li, Steven Basart, Bo Li, David Forsyth, Dan Hendrycks
ICML 2024 | February 2024
Tag-LLM: Repurposing General-Purpose LLMs for Specialized Domains
Junhong Shen, Neil Tenenholtz, James Hall, David Alvarez-Melis, Nicolo Fusi
ICML 2024 | February 2024
A General Framework for Learning from Weak Supervision
Hao Chen, Jindong Wang, Lei Feng, Xiang Li, Yidong Wang, Xing Xie, Masashi Sugiyama, Rita Singh, Bhiksha Raj
ICML 2024 | February 2024
Efficient and Effective Time-Series Forecasting with Spiking Neural Networks
Changze Lv, Yansen Wang, Dongqi Han, Xiaoqing Zheng, Xuanjing Huang, Dongsheng Li
ICML 2024 | February 2024
Mission Critical – Satellite Data is a Distinct Modality in Machine Learning
Esther Rolf, Konstantin Klemmer, Caleb Robinson, Hannah Kerner
ICML 2024 | February 2024
StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis
Zecheng Tang, Chenfei Wu, Zekai Zhang, Mingheng Ni, Sheng-Siang Yin, Yu Liu, Zhengyuan Yang, Lijuan Wang, Zicheng Liu, Juntao Li, Nan Duan
ICML 2024 | January 2024
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang Zhang, Fangyun Wei
ICML 2024 | January 2024
Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation
Haoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan, Lingfeng Shen, Benjamin Van Durme, Kenton Murray, Young Jin Kim
ICML 2024 | January 2024
TrustLLM: Trustworthiness in Large Language Models
Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao
ICML 2024 | January 2024
-
Principled Gradient-based Markov Chain Monte Carlo for Text Generation
Li Du, Afra Amini, Lucas Torroba Hennigen, Xinyan Velocity Yu, Jason Eisner, Holden Lee, Ryan Cotterell
ICML 2024 | December 2023
The Good, The Bad, and Why: Unveiling Emotions in Generative AI
Cheng Li, Jindong Wang, Yixuan Zhang, Kaijie Zhu, Xinyi Wang, Wenxin Hou, Jianxun Lian, Fang Luo, Qiang Yang, Xing Xie
ICML 2024 | December 2023
How Far Can Fairness Constraints Help Recover From Biased Data?
Mohit Sharma, Amit Deshpande
ICML 2024 | December 2023
Improved Differentially Private and Lazy Online Convex Optimization
Naman Agarwal, Satyen Kale, Karan Singh, Abhradeep Thakurta
ICML 2024 | December 2023
PcLast: Discovering Plannable Continuous Latent States
Anurag Koul, Shivakanth Sujit, Shaoru Chen, Ben Evans, Lili Wu, Byron Xu, Rajan Chari, Riashat Islam, Raihan Seraj, Yonathan Efroni, Lekan Molu, Miro Dudík, John Langford, Alex Lamb
ICML 2024 | November 2023
CompeteAI: Understanding the Competition Behaviors in Large Language Model-based Agents
Qinlin Zhao, Jindong Wang, Yixuan Zhang, Yiqiao Jin, Kaijie Zhu, Hao Chen, Xing Xie
ICML 2024 | October 2023
HumanTOMATO: Text-aligned Whole-body Motion Generation
Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing-de Lin, Ruimao Zhang, Lei Zhang, Heung-Yeung Shum
ICML 2024 | October 2023
Completing Visual Objects via Bridging Generation and Segmentation
Xiang Li, Yinpeng Chen, Chung-Ching Lin, Rita Singh, Bhiksha Raj, Lijuan Wang, Zicheng Liu
IMCL 2024 | September 2023
Towards Causal Foundation Model: on Duality between Causal Inference and Attention
Jiaqi Zhang, Joel Jennings, Cheng Zhang, Chao Ma
ICML 2024 | September 2023
UniAudio: An Audio Foundation Model Toward Universal Audio Generation
Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, Helen Meng
ICML 2024 | September 2023
Breaking through the learning plateaus of in-context learning in Transformer
Jingwen Fu, T. Yang, Yuwang Wang, Yan Lu, Nanning Zheng
ICML 2024 | September 2023
MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities
Weihao Yu, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Zicheng Liu, Xinchao Wang, Lijuan Wang
ICML 2024 | August 2023
Safe Exploration in Dose Finding Clinical Trials with Heterogeneous Participants
Isabel Chien, Richard Turner, Javier González
ICML 2024 | July 2023
MGit: A Model Versioning and Management System
Wei Hao, Daniel Mendoza, Rafael da Silva, Deepak Narayanan, Amar Phanishayee
ICML 2024 | July 2023
Selective Mixup Helps with Distribution Shifts, But Not (Only) because of Mixup
Damien Teney, Jindong Wang, Ehsan Abbasnejad
ICML 2024 | May 2023
Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling
Weijia Xu, Andrzej Banburski-Fahey, Nebojsa Jojic
ICML 2024 | May 2023
Publications by Research Area
-
Intersecting-Boundary-Sensitive Fingerprinting for Tampering Detection of DNN Models
2024 International Conference on Machine Learning | July 2024
OAK: Enriching Document Representations using Auxiliary Knowledge for Extreme Classification
Shikhar Mohan, Deepak Saini, Anshul Mittal, Sayak Roy Chowdhury, Bhawna Paliwal, Jian Jiao, Manish Gupta, Manik Varma
2024 International Conference on Machine Learning | July 2024
-
Intersecting-Boundary-Sensitive Fingerprinting for Tampering Detection of DNN Models
2024 International Conference on Machine Learning | July 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin
ICML 2024 | July 2024
Spotlight
-
Integrated Hardware Architecture and Device Placement Search
Irene Wang, Jakub Tarnawski, Amar Phanishayee, Divya Mahajan
2024 International Conference on Machine Learning | July 2024
DéjàVu: KV-cache Streaming for Fast, Fault-tolerant Generative LLM Serving
Foteini Strati, Sara Mcallister, Amar Phanishayee, Jakub Tarnawski, Ana Klimovic
ICML 2024 | July 2024
Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyond
Xutong Liu, Siwei Wang, Jinhang Zuo, Han Zhong, Xuchuang Wang, Zhiyong Wang, Shuai Li, Mohammad Hajiesmaili, John C.S. Lui, Wei Chen
Proceedings of the 41st International Conference on Machine Learning (ICML) | July 2024
OAK: Enriching Document Representations using Auxiliary Knowledge for Extreme Classification
Shikhar Mohan, Deepak Saini, Anshul Mittal, Sayak Roy Chowdhury, Bhawna Paliwal, Jian Jiao, Manish Gupta, Manik Varma
2024 International Conference on Machine Learning | July 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin
ICML 2024 | July 2024
Spotlight
Submodular Framework for Structured-Sparse Optimal Transport
Piyushi Manupriya, Pratik Jawanpuria, Karthik S. Gurumoorthy, S. Jagarlapudi, Bamdev Mishra
ICML 2024 | June 2024
PRISE: LLM-Style Sequence Compression for Learning Temporal Action Abstractions in Control
Ruijie Zheng, Ching-An Cheng, Hal Daumé III, Furong Huang, Andrey Kolobov
ICML 2024 | June 2024
ORAL
Safe and Robust Subgame Exploitation in Imperfect Information Games
Zhenxing Ge, Zheng Xu, Tianyu Ding, Linjian Meng, Bo An, Wenbin Li, Yang Gao
ICML 2024 | June 2024
Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective
Fabian Falck, Ziyu Wang, Chris Holmes
ICML 2024 | June 2024
Riemannian coordinate descent algorithms on matrix manifolds
Andi Han, Pratik Jawanpuria, Bamdev Mishra
ICML 2024 | June 2024
NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models
Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
ICML | June 2024
Think Before You Act: Decision Transformers with Internal Working Memory
Jikun Kang, Romain Laroche, Xingdi Yuan, Adam Trischler, Xuefei Liu, Jie Fu
ICML 2024 | May 2024
Towards Modular LLMs by Building and Reusing a Library of LoRAs
O. Ostapenko, Zhan Su, E. Ponti, Laurent Charlin, Nicolas Le Roux, Matheus Pereira, Lucas Caccia, Alessandro Sordoni
ICML 2024 | May 2024
TimeX++: Learning Time-Series Explanations with Information Bottleneck
Zichuan Liu, Tianchun Wang, Jimeng Shi, Xu Zheng, Zhuomin Chen, Lei Song, Wenqian Dong, J. Obeysekera, Farhad Shirani, Dongsheng Luo
ICML 2024 | May 2024
Generalizing Knowledge Graph Embedding with Universal Orthogonal Parameterization
Rui Li, Chaozhuo Li, Yanming Shen, Zeyu Zhang, Xu Chen
ICML 2024 | May 2024
Precise Accuracy / Robustness Tradeoffs in Regression: Case of General Norms
Elvis Dohmatob, Meyer Scetbon
ICML 2024 | May 2024
A Fixed-Point Approach for Causal Generative Modeling
Meyer Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma
ICML 2024 | May 2024
Provably Robust DPO: Aligning Language Models with Noisy Feedback
Sayak Ray Chowdhury, Anush Kini, Nagarajan Natarajan
ICML 2024 | May 2024
Token-level Direct Preference Optimization
Yongcheng Zeng, Guoqing Liu, Weiyu Ma, Ning Yang, Haifeng Zhang, Jun Wang
ICML 2024 | April 2024
Debiased Distribution Compression
Lingxiao Li, Raaz Dwivedi, Lester Mackey
ICML 2024 | April 2024
Provable Interactive Learning with Hindsight Instruction Feedback
Dipendra Misra, Aldo Pacchiano, Robert E. Schapire
ICML 2024 | April 2024
FiP: A Fixed-Point Approach for Causal Generative Modeling
M. Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma
ICML 2024 | April 2024
Out-of-Distribution Detection via Deep Multi-Comprehension Ensemble
Chenhui Xu, Fuxun Yu, Zirui Xu, Nathan Inkawhich, Xiang Chen
ICML 2024 | March 2024
Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction
He Zhang, Chang Liu, Zun Wang, Xinran wei, Siyuan Liu, Nanning Zheng, Bin Shao, Tie-Yan Liu
ICML 2024 | March 2024
Rethinking Generative Large Language Model Evaluation for Semantic Comprehension
Fangyun Wei, Xi Chen, Linzi Luo
ICML 2024 | March 2024
Scalable Online Exploration via Coverability
P. Amortila, Dylan Foster, Akshay Krishnamurthy
ICML 2024 | March 2024
Stabilizing Policy Gradients for Stochastic Differential Equations via Consistency with Perturbation Process
Xiangxin Zhou, Liang Wang, Yichi Zhou
ICML 2024 | March 2024
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin
ICML 2024 | March 2024
Spotlight
Provable Risk-Sensitive Distributional Reinforcement Learning with General Function Approximation
Yu Chen, Xiangcheng Zhang, Siwei Wang, Longbo Huang
ICML 2024 | February 2024
Clifford-Steerable Convolutional Neural Networks
Maksim Zhdanov, David Ruhe, Maurice Weiler, Ana Lucic, Johannes Brandstetter, Patrick Forr'e
ICML 2024 | February 2024
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
DyVal 2: Dynamic Evaluation of Large Language Models by Meta Probing Agents
Kaijie Zhu, Jindong Wang, Qinlin Zhao, Ruochen Xu, Xing Xie
ICML 2024 | February 2024
PRISE: Learning Temporal Action Abstractions as a Sequence Compression Problem
Ruijie Zheng, Ching-An Cheng, Hal Daumé III, Furong Huang, Andrey Kolobov
ICML 2024 | February 2024
Using Left and Right Brains Together: Towards Vision and Language Planning
Jun Cen, Chenfei Wu, Xiao Liu, Sheng-Siang Yin, Yixuan Pei, Jinglong Yang, Qifeng Chen, Nan Duan, Jianguo Zhang
ICML 2024 | February 2024
ChemReasoner: Heuristic Search over a Large Language Model’s Knowledge Space using Quantum-Chemical Feedback
Henry W Sprueill, Carl N. Edwards, Khushbu Agarwal, Mariefel V. Olarte, Udishnu Sanyal, Conrad Johnston, Hongbin Liu, Heng Ji, Sutanay Choudhury
ICML 2024 | February 2024
Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models
Francesca-Zhoufan Li, Ava P. Amini, Yisong Yue, Kevin Yang, Alex Lu
ICML 2024 | February 2024
DoRA: Weight-Decomposed Low-Rank Adaptation
Shih-yang Liu, Chien-Yi Wang, Hongxu Yin, Pavlo Molchanov, Yu-Chiang Frank Wang, Kwang-Ting Cheng, Min-Hung Chen
ICML 2024 | February 2024
Efficient Contextual Bandits with Uninformed Feedback Graphs
Mengxiao Zhang, Yuheng Zhang, Haipeng Luo, Paul Mineiro
ICML 2024 | February 2024
Understanding the Training Speedup from Sampling with Approximate Losses
Rudrajit Das, Xi Chen, Bertram Ieong, Parikshit Bansal, Sujay Sanghavi
ICML 2024 | February 2024
Premier-TACO is a Few-Shot Policy Learner: Pretraining Multitask Representation via Temporal Action-Driven Contrastive Loss
Ruijie Zheng, Yongyuan Liang, Xiyao Wang, Shuang Ma, Hal Daumé III, Huazhe Xu, John Langford, Praveen Palanisamy, Kalyan Shankar Basu, Furong Huang
ICML 2024 | February 2024
Open-Vocabulary Calibration for Vision-Language Models
Shuoyuan Wang, Jindong Wang, Guoqing Wang, Bob Zhang, Kaiyang Zhou, Hongxin Wei
ICML 2024 | February 2024
Tag-LLM: Repurposing General-Purpose LLMs for Specialized Domains
Junhong Shen, Neil Tenenholtz, James Hall, David Alvarez-Melis, Nicolo Fusi
ICML 2024 | February 2024
HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal
Mantas Mazeika, Long Phan, Xuwang Yin, Andy Zou, Zifan Wang, Norman Mu, Elham Sakhaee, Nathaniel Li, Steven Basart, Bo Li, David Forsyth, Dan Hendrycks
ICML 2024 | February 2024
DistiLLM: Towards Streamlined Distillation for Large Language Models
Jongwoo Ko, Sungnyun Kim, Tianyi Chen, Se-Young Yun
ICML 2024 | February 2024
AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Calls
Yu Du, Fangyun Wei, Hongyang Zhang
ICML 2024 | February 2024
Mission Critical – Satellite Data is a Distinct Modality in Machine Learning
Esther Rolf, Konstantin Klemmer, Caleb Robinson, Hannah Kerner
ICML 2024 | February 2024
Efficient and Effective Time-Series Forecasting with Spiking Neural Networks
Changze Lv, Yansen Wang, Dongqi Han, Xiaoqing Zheng, Xuanjing Huang, Dongsheng Li
ICML 2024 | February 2024
A General Framework for Learning from Weak Supervision
Hao Chen, Jindong Wang, Lei Feng, Xiang Li, Yidong Wang, Xing Xie, Masashi Sugiyama, Rita Singh, Bhiksha Raj
ICML 2024 | February 2024
StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis
Zecheng Tang, Chenfei Wu, Zekai Zhang, Mingheng Ni, Sheng-Siang Yin, Yu Liu, Zhengyuan Yang, Lijuan Wang, Zicheng Liu, Juntao Li, Nan Duan
ICML 2024 | January 2024
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang Zhang, Fangyun Wei
ICML 2024 | January 2024
Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation
Haoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan, Lingfeng Shen, Benjamin Van Durme, Kenton Murray, Young Jin Kim
ICML 2024 | January 2024
TrustLLM: Trustworthiness in Large Language Models
Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao
ICML 2024 | January 2024
Principled Gradient-based Markov Chain Monte Carlo for Text Generation
Li Du, Afra Amini, Lucas Torroba Hennigen, Xinyan Velocity Yu, Jason Eisner, Holden Lee, Ryan Cotterell
ICML 2024 | December 2023
The Good, The Bad, and Why: Unveiling Emotions in Generative AI
Cheng Li, Jindong Wang, Yixuan Zhang, Kaijie Zhu, Xinyi Wang, Wenxin Hou, Jianxun Lian, Fang Luo, Qiang Yang, Xing Xie
ICML 2024 | December 2023
How Far Can Fairness Constraints Help Recover From Biased Data?
Mohit Sharma, Amit Deshpande
ICML 2024 | December 2023
Improved Differentially Private and Lazy Online Convex Optimization
Naman Agarwal, Satyen Kale, Karan Singh, Abhradeep Thakurta
ICML 2024 | December 2023
PcLast: Discovering Plannable Continuous Latent States
Anurag Koul, Shivakanth Sujit, Shaoru Chen, Ben Evans, Lili Wu, Byron Xu, Rajan Chari, Riashat Islam, Raihan Seraj, Yonathan Efroni, Lekan Molu, Miro Dudík, John Langford, Alex Lamb
ICML 2024 | November 2023
CompeteAI: Understanding the Competition Behaviors in Large Language Model-based Agents
Qinlin Zhao, Jindong Wang, Yixuan Zhang, Yiqiao Jin, Kaijie Zhu, Hao Chen, Xing Xie
ICML 2024 | October 2023
HumanTOMATO: Text-aligned Whole-body Motion Generation
Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing-de Lin, Ruimao Zhang, Lei Zhang, Heung-Yeung Shum
ICML 2024 | October 2023
UniAudio: An Audio Foundation Model Toward Universal Audio Generation
Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, Helen Meng
ICML 2024 | September 2023
Towards Causal Foundation Model: on Duality between Causal Inference and Attention
Jiaqi Zhang, Joel Jennings, Cheng Zhang, Chao Ma
ICML 2024 | September 2023
Completing Visual Objects via Bridging Generation and Segmentation
Xiang Li, Yinpeng Chen, Chung-Ching Lin, Rita Singh, Bhiksha Raj, Lijuan Wang, Zicheng Liu
IMCL 2024 | September 2023
Breaking through the learning plateaus of in-context learning in Transformer
Jingwen Fu, T. Yang, Yuwang Wang, Yan Lu, Nanning Zheng
ICML 2024 | September 2023
MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities
Weihao Yu, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Zicheng Liu, Xinchao Wang, Lijuan Wang
ICML 2024 | August 2023
Safe Exploration in Dose Finding Clinical Trials with Heterogeneous Participants
Isabel Chien, Richard Turner, Javier González
ICML 2024 | July 2023
MGit: A Model Versioning and Management System
Wei Hao, Daniel Mendoza, Rafael da Silva, Deepak Narayanan, Amar Phanishayee
ICML 2024 | July 2023
Selective Mixup Helps with Distribution Shifts, But Not (Only) because of Mixup
Damien Teney, Jindong Wang, Ehsan Abbasnejad
ICML 2024 | May 2023
Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling
Weijia Xu, Andrzej Banburski-Fahey, Nebojsa Jojic
ICML 2024 | May 2023
-
Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyond
Xutong Liu, Siwei Wang, Jinhang Zuo, Han Zhong, Xuchuang Wang, Zhiyong Wang, Shuai Li, Mohammad Hajiesmaili, John C.S. Lui, Wei Chen
Proceedings of the 41st International Conference on Machine Learning (ICML) | July 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin
ICML 2024 | July 2024
Spotlight
Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problems
Yifan Xia, Xianliang Yang, Zichuan Liu, Zhihao Liu, Lei Song, Jiang Bian
2024 International Conference on Machine Learning | June 2024
-
NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models
Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
ICML | June 2024
-
Integrated Hardware Architecture and Device Placement Search
Irene Wang, Jakub Tarnawski, Amar Phanishayee, Divya Mahajan
2024 International Conference on Machine Learning | July 2024
DéjàVu: KV-cache Streaming for Fast, Fault-tolerant Generative LLM Serving
Foteini Strati, Sara Mcallister, Amar Phanishayee, Jakub Tarnawski, Ana Klimovic
ICML 2024 | July 2024
-
Safe Exploration in Dose Finding Clinical Trials with Heterogeneous Participants
Isabel Chien, Richard Turner, Javier González
ICML 2024 | July 2023
-
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin
ICML 2024 | July 2024
Spotlight
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
-
HumanTOMATO: Text-aligned Whole-body Motion Generation
Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing-de Lin, Ruimao Zhang, Lei Zhang, Heung-Yeung Shum
ICML 2024 | October 2023
Publications by Type
-
Integrated Hardware Architecture and Device Placement Search
Irene Wang, Jakub Tarnawski, Amar Phanishayee, Divya Mahajan
2024 International Conference on Machine Learning | July 2024
DéjàVu: KV-cache Streaming for Fast, Fault-tolerant Generative LLM Serving
Foteini Strati, Sara Mcallister, Amar Phanishayee, Jakub Tarnawski, Ana Klimovic
ICML 2024 | July 2024
Intersecting-Boundary-Sensitive Fingerprinting for Tampering Detection of DNN Models
2024 International Conference on Machine Learning | July 2024
Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyond
Xutong Liu, Siwei Wang, Jinhang Zuo, Han Zhong, Xuchuang Wang, Zhiyong Wang, Shuai Li, Mohammad Hajiesmaili, John C.S. Lui, Wei Chen
Proceedings of the 41st International Conference on Machine Learning (ICML) | July 2024
OAK: Enriching Document Representations using Auxiliary Knowledge for Extreme Classification
Shikhar Mohan, Deepak Saini, Anshul Mittal, Sayak Roy Chowdhury, Bhawna Paliwal, Jian Jiao, Manish Gupta, Manik Varma
2024 International Conference on Machine Learning | July 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin
ICML 2024 | July 2024
Spotlight
Submodular Framework for Structured-Sparse Optimal Transport
Piyushi Manupriya, Pratik Jawanpuria, Karthik S. Gurumoorthy, S. Jagarlapudi, Bamdev Mishra
ICML 2024 | June 2024
PRISE: LLM-Style Sequence Compression for Learning Temporal Action Abstractions in Control
Ruijie Zheng, Ching-An Cheng, Hal Daumé III, Furong Huang, Andrey Kolobov
ICML 2024 | June 2024
ORAL
Safe and Robust Subgame Exploitation in Imperfect Information Games
Zhenxing Ge, Zheng Xu, Tianyu Ding, Linjian Meng, Bo An, Wenbin Li, Yang Gao
ICML 2024 | June 2024
Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective
Fabian Falck, Ziyu Wang, Chris Holmes
ICML 2024 | June 2024
Riemannian coordinate descent algorithms on matrix manifolds
Andi Han, Pratik Jawanpuria, Bamdev Mishra
ICML 2024 | June 2024
Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problems
Yifan Xia, Xianliang Yang, Zichuan Liu, Zhihao Liu, Lei Song, Jiang Bian
2024 International Conference on Machine Learning | June 2024
NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models
Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
ICML | June 2024
Think Before You Act: Decision Transformers with Internal Working Memory
Jikun Kang, Romain Laroche, Xingdi Yuan, Adam Trischler, Xuefei Liu, Jie Fu
ICML 2024 | May 2024
Towards Modular LLMs by Building and Reusing a Library of LoRAs
O. Ostapenko, Zhan Su, E. Ponti, Laurent Charlin, Nicolas Le Roux, Matheus Pereira, Lucas Caccia, Alessandro Sordoni
ICML 2024 | May 2024
TimeX++: Learning Time-Series Explanations with Information Bottleneck
Zichuan Liu, Tianchun Wang, Jimeng Shi, Xu Zheng, Zhuomin Chen, Lei Song, Wenqian Dong, J. Obeysekera, Farhad Shirani, Dongsheng Luo
ICML 2024 | May 2024
Generalizing Knowledge Graph Embedding with Universal Orthogonal Parameterization
Rui Li, Chaozhuo Li, Yanming Shen, Zeyu Zhang, Xu Chen
ICML 2024 | May 2024
Precise Accuracy / Robustness Tradeoffs in Regression: Case of General Norms
Elvis Dohmatob, Meyer Scetbon
ICML 2024 | May 2024
A Fixed-Point Approach for Causal Generative Modeling
Meyer Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma
ICML 2024 | May 2024
Provably Robust DPO: Aligning Language Models with Noisy Feedback
Sayak Ray Chowdhury, Anush Kini, Nagarajan Natarajan
ICML 2024 | May 2024
Token-level Direct Preference Optimization
Yongcheng Zeng, Guoqing Liu, Weiyu Ma, Ning Yang, Haifeng Zhang, Jun Wang
ICML 2024 | April 2024
Debiased Distribution Compression
Lingxiao Li, Raaz Dwivedi, Lester Mackey
ICML 2024 | April 2024
Provable Interactive Learning with Hindsight Instruction Feedback
Dipendra Misra, Aldo Pacchiano, Robert E. Schapire
ICML 2024 | April 2024
FiP: A Fixed-Point Approach for Causal Generative Modeling
M. Scetbon, Joel Jennings, Agrin Hilmkil, Cheng Zhang, Chao Ma
ICML 2024 | April 2024
Out-of-Distribution Detection via Deep Multi-Comprehension Ensemble
Chenhui Xu, Fuxun Yu, Zirui Xu, Nathan Inkawhich, Xiang Chen
ICML 2024 | March 2024
Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction
He Zhang, Chang Liu, Zun Wang, Xinran wei, Siyuan Liu, Nanning Zheng, Bin Shao, Tie-Yan Liu
ICML 2024 | March 2024
Rethinking Generative Large Language Model Evaluation for Semantic Comprehension
Fangyun Wei, Xi Chen, Linzi Luo
ICML 2024 | March 2024
Scalable Online Exploration via Coverability
P. Amortila, Dylan Foster, Akshay Krishnamurthy
ICML 2024 | March 2024
Stabilizing Policy Gradients for Stochastic Differential Equations via Consistency with Perturbation Process
Xiangxin Zhou, Liang Wang, Yichi Zhou
ICML 2024 | March 2024
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin
ICML 2024 | March 2024
Spotlight
Provable Risk-Sensitive Distributional Reinforcement Learning with General Function Approximation
Yu Chen, Xiangcheng Zhang, Siwei Wang, Longbo Huang
ICML 2024 | February 2024
Clifford-Steerable Convolutional Neural Networks
Maksim Zhdanov, David Ruhe, Maurice Weiler, Ana Lucic, Johannes Brandstetter, Patrick Forr'e
ICML 2024 | February 2024
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
DyVal 2: Dynamic Evaluation of Large Language Models by Meta Probing Agents
Kaijie Zhu, Jindong Wang, Qinlin Zhao, Ruochen Xu, Xing Xie
ICML 2024 | February 2024
PRISE: Learning Temporal Action Abstractions as a Sequence Compression Problem
Ruijie Zheng, Ching-An Cheng, Hal Daumé III, Furong Huang, Andrey Kolobov
ICML 2024 | February 2024
Using Left and Right Brains Together: Towards Vision and Language Planning
Jun Cen, Chenfei Wu, Xiao Liu, Sheng-Siang Yin, Yixuan Pei, Jinglong Yang, Qifeng Chen, Nan Duan, Jianguo Zhang
ICML 2024 | February 2024
ChemReasoner: Heuristic Search over a Large Language Model’s Knowledge Space using Quantum-Chemical Feedback
Henry W Sprueill, Carl N. Edwards, Khushbu Agarwal, Mariefel V. Olarte, Udishnu Sanyal, Conrad Johnston, Hongbin Liu, Heng Ji, Sutanay Choudhury
ICML 2024 | February 2024
Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models
Francesca-Zhoufan Li, Ava P. Amini, Yisong Yue, Kevin Yang, Alex Lu
ICML 2024 | February 2024
DoRA: Weight-Decomposed Low-Rank Adaptation
Shih-yang Liu, Chien-Yi Wang, Hongxu Yin, Pavlo Molchanov, Yu-Chiang Frank Wang, Kwang-Ting Cheng, Min-Hung Chen
ICML 2024 | February 2024
Efficient Contextual Bandits with Uninformed Feedback Graphs
Mengxiao Zhang, Yuheng Zhang, Haipeng Luo, Paul Mineiro
ICML 2024 | February 2024
Understanding the Training Speedup from Sampling with Approximate Losses
Rudrajit Das, Xi Chen, Bertram Ieong, Parikshit Bansal, Sujay Sanghavi
ICML 2024 | February 2024
Premier-TACO is a Few-Shot Policy Learner: Pretraining Multitask Representation via Temporal Action-Driven Contrastive Loss
Ruijie Zheng, Yongyuan Liang, Xiyao Wang, Shuang Ma, Hal Daumé III, Huazhe Xu, John Langford, Praveen Palanisamy, Kalyan Shankar Basu, Furong Huang
ICML 2024 | February 2024
Open-Vocabulary Calibration for Vision-Language Models
Shuoyuan Wang, Jindong Wang, Guoqing Wang, Bob Zhang, Kaiyang Zhou, Hongxin Wei
ICML 2024 | February 2024
Tag-LLM: Repurposing General-Purpose LLMs for Specialized Domains
Junhong Shen, Neil Tenenholtz, James Hall, David Alvarez-Melis, Nicolo Fusi
ICML 2024 | February 2024
HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal
Mantas Mazeika, Long Phan, Xuwang Yin, Andy Zou, Zifan Wang, Norman Mu, Elham Sakhaee, Nathaniel Li, Steven Basart, Bo Li, David Forsyth, Dan Hendrycks
ICML 2024 | February 2024
DistiLLM: Towards Streamlined Distillation for Large Language Models
Jongwoo Ko, Sungnyun Kim, Tianyi Chen, Se-Young Yun
ICML 2024 | February 2024
AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Calls
Yu Du, Fangyun Wei, Hongyang Zhang
ICML 2024 | February 2024
Mission Critical – Satellite Data is a Distinct Modality in Machine Learning
Esther Rolf, Konstantin Klemmer, Caleb Robinson, Hannah Kerner
ICML 2024 | February 2024
Efficient and Effective Time-Series Forecasting with Spiking Neural Networks
Changze Lv, Yansen Wang, Dongqi Han, Xiaoqing Zheng, Xuanjing Huang, Dongsheng Li
ICML 2024 | February 2024
A General Framework for Learning from Weak Supervision
Hao Chen, Jindong Wang, Lei Feng, Xiang Li, Yidong Wang, Xing Xie, Masashi Sugiyama, Rita Singh, Bhiksha Raj
ICML 2024 | February 2024
StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis
Zecheng Tang, Chenfei Wu, Zekai Zhang, Mingheng Ni, Sheng-Siang Yin, Yu Liu, Zhengyuan Yang, Lijuan Wang, Zicheng Liu, Juntao Li, Nan Duan
ICML 2024 | January 2024
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang Zhang, Fangyun Wei
ICML 2024 | January 2024
Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation
Haoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan, Lingfeng Shen, Benjamin Van Durme, Kenton Murray, Young Jin Kim
ICML 2024 | January 2024
TrustLLM: Trustworthiness in Large Language Models
Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao
ICML 2024 | January 2024
Principled Gradient-based Markov Chain Monte Carlo for Text Generation
Li Du, Afra Amini, Lucas Torroba Hennigen, Xinyan Velocity Yu, Jason Eisner, Holden Lee, Ryan Cotterell
ICML 2024 | December 2023
The Good, The Bad, and Why: Unveiling Emotions in Generative AI
Cheng Li, Jindong Wang, Yixuan Zhang, Kaijie Zhu, Xinyi Wang, Wenxin Hou, Jianxun Lian, Fang Luo, Qiang Yang, Xing Xie
ICML 2024 | December 2023
How Far Can Fairness Constraints Help Recover From Biased Data?
Mohit Sharma, Amit Deshpande
ICML 2024 | December 2023
Improved Differentially Private and Lazy Online Convex Optimization
Naman Agarwal, Satyen Kale, Karan Singh, Abhradeep Thakurta
ICML 2024 | December 2023
PcLast: Discovering Plannable Continuous Latent States
Anurag Koul, Shivakanth Sujit, Shaoru Chen, Ben Evans, Lili Wu, Byron Xu, Rajan Chari, Riashat Islam, Raihan Seraj, Yonathan Efroni, Lekan Molu, Miro Dudík, John Langford, Alex Lamb
ICML 2024 | November 2023
CompeteAI: Understanding the Competition Behaviors in Large Language Model-based Agents
Qinlin Zhao, Jindong Wang, Yixuan Zhang, Yiqiao Jin, Kaijie Zhu, Hao Chen, Xing Xie
ICML 2024 | October 2023
HumanTOMATO: Text-aligned Whole-body Motion Generation
Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing-de Lin, Ruimao Zhang, Lei Zhang, Heung-Yeung Shum
ICML 2024 | October 2023
UniAudio: An Audio Foundation Model Toward Universal Audio Generation
Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, Helen Meng
ICML 2024 | September 2023
Towards Causal Foundation Model: on Duality between Causal Inference and Attention
Jiaqi Zhang, Joel Jennings, Cheng Zhang, Chao Ma
ICML 2024 | September 2023
Completing Visual Objects via Bridging Generation and Segmentation
Xiang Li, Yinpeng Chen, Chung-Ching Lin, Rita Singh, Bhiksha Raj, Lijuan Wang, Zicheng Liu
IMCL 2024 | September 2023
Breaking through the learning plateaus of in-context learning in Transformer
Jingwen Fu, T. Yang, Yuwang Wang, Yan Lu, Nanning Zheng
ICML 2024 | September 2023
MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities
Weihao Yu, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Zicheng Liu, Xinchao Wang, Lijuan Wang
ICML 2024 | August 2023
Safe Exploration in Dose Finding Clinical Trials with Heterogeneous Participants
Isabel Chien, Richard Turner, Javier González
ICML 2024 | July 2023
MGit: A Model Versioning and Management System
Wei Hao, Daniel Mendoza, Rafael da Silva, Deepak Narayanan, Amar Phanishayee
ICML 2024 | July 2023
Selective Mixup Helps with Distribution Shifts, But Not (Only) because of Mixup
Damien Teney, Jindong Wang, Ehsan Abbasnejad
ICML 2024 | May 2023
Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling
Weijia Xu, Andrzej Banburski-Fahey, Nebojsa Jojic
ICML 2024 | May 2023