Nikos Karampatziakis

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Publié par Microsoft

Publication Download Project

LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models

Yixiao Li, Yifan Yu, Chen Liang, Pengcheng He, Nikos Karampatziakis, Weizhu Chen, Tuo Zhao

ICLR 2024 | October 2023

DOI PDF

Meet in the Middle: A New Pre-training Paradigm

Anh Nguyen, Nikos Karampatziakis, Weizhu Chen

NeurIPS 2023 | October 2023

Publication

Contextual Bandit Applications in a Customer Support Bot

Sandra Sajeev, Jade Huang, Nikos Karampatziakis, Sebastian Kochman, Matthew Hall, Wei Chen

August 2021

Off-Policy Confidence Sequences

Nikos Karampatziakis, Paul Mineiro, Aaditya Ramdas

2021 International Conference on Machine Learning | July 2021

Publication Publication

Logarithmic Time One-Against-Some

Hal Daumé III, Nikos Karampatziakis, John Langford, Paul Mineiro

ICML 2017 | April 2019

Publication

Least Squares Revisited: Scalable Approaches for Multi-class Prediction

Alekh Agarwal, Sham Kakade, Nikos Karampatziakis, Le Song, Gregory Valiant

July 2014

Publication Publication

Distributed and Scalable PCA in the Cloud

Arun Kumar, Vijay Narayanan, Nikos Karampatziakis, Paul Mineiro, Markus Weimer

MSR-TR-2014-165 | January 2014

Publié par Microsoft

Apache Reef Research Paper

PDF

Using File Relationships in Malware Classification

Nikos Karampatziakis, Jack W. Stokes, Anil Thomas, Mady Marinescu

Proceedings of Conference on Detection of Intrusions and Malware & Vulnerability Assessment | September 2012

Proceedings of Conference on Detection of Intrusions and Malware & Vulnerability Assessment

Publication Projet

Efficient optimal learning for contextual bandits

Nikos Karampatziakis, John Langford, Miroslav Dudik, Lev Reyzin, Tong Zhang, Miro Dudík

Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI-11) | July 2011

Publication Projet

Online Importance Weight Aware Updates

Nikos Karampatziakis, John Langford

June 2011

Publication

Parallel Online Learning

Daniel Hsu, Nikos Karampatziakis, John Langford, Alex J. Smola

March 2011

Publication

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Publié par Microsoft

Publication Download Project

LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models

Yixiao Li, Yifan Yu, Chen Liang, Pengcheng He, Nikos Karampatziakis, Weizhu Chen, Tuo Zhao

ICLR 2024 | October 2023

DOI PDF

Meet in the Middle: A New Pre-training Paradigm

Anh Nguyen, Nikos Karampatziakis, Weizhu Chen

NeurIPS 2023 | October 2023

Publication

Contextual Bandit Applications in a Customer Support Bot

Sandra Sajeev, Jade Huang, Nikos Karampatziakis, Sebastian Kochman, Matthew Hall, Wei Chen

August 2021

Off-Policy Confidence Sequences

Nikos Karampatziakis, Paul Mineiro, Aaditya Ramdas

2021 International Conference on Machine Learning | July 2021

Publication Publication

Logarithmic Time One-Against-Some

Hal Daumé III, Nikos Karampatziakis, John Langford, Paul Mineiro

ICML 2017 | April 2019

Publication

Efficient optimal learning for contextual bandits

Nikos Karampatziakis, John Langford, Miroslav Dudik, Lev Reyzin, Tong Zhang, Miro Dudík

Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI-11) | July 2011

Publication Projet

Online Importance Weight Aware Updates

Nikos Karampatziakis, John Langford

June 2011

Publication

Parallel Online Learning

Daniel Hsu, Nikos Karampatziakis, John Langford, Alex J. Smola

March 2011

Publication

Distributed and Scalable PCA in the Cloud

Arun Kumar, Vijay Narayanan, Nikos Karampatziakis, Paul Mineiro, Markus Weimer

MSR-TR-2014-165 | January 2014

Publié par Microsoft

Apache Reef Research Paper

PDF

Least Squares Revisited: Scalable Approaches for Multi-class Prediction

Alekh Agarwal, Sham Kakade, Nikos Karampatziakis, Le Song, Gregory Valiant

July 2014

Publication Publication

Using File Relationships in Malware Classification

Nikos Karampatziakis, Jack W. Stokes, Anil Thomas, Mady Marinescu

Proceedings of Conference on Detection of Intrusions and Malware & Vulnerability Assessment | September 2012

Proceedings of Conference on Detection of Intrusions and Malware & Vulnerability Assessment

Publication Projet

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Publié par Microsoft

Publication Download Project

Distributed and Scalable PCA in the Cloud

Arun Kumar, Vijay Narayanan, Nikos Karampatziakis, Paul Mineiro, Markus Weimer

MSR-TR-2014-165 | January 2014

Publié par Microsoft

Apache Reef Research Paper

PDF

LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models

Yixiao Li, Yifan Yu, Chen Liang, Pengcheng He, Nikos Karampatziakis, Weizhu Chen, Tuo Zhao

ICLR 2024 | October 2023

DOI PDF

Meet in the Middle: A New Pre-training Paradigm

Anh Nguyen, Nikos Karampatziakis, Weizhu Chen

NeurIPS 2023 | October 2023

Publication

Off-Policy Confidence Sequences

Nikos Karampatziakis, Paul Mineiro, Aaditya Ramdas

2021 International Conference on Machine Learning | July 2021

Publication Publication

Logarithmic Time One-Against-Some

Hal Daumé III, Nikos Karampatziakis, John Langford, Paul Mineiro

ICML 2017 | April 2019

Publication

Least Squares Revisited: Scalable Approaches for Multi-class Prediction

Alekh Agarwal, Sham Kakade, Nikos Karampatziakis, Le Song, Gregory Valiant

July 2014

Publication Publication

Using File Relationships in Malware Classification

Nikos Karampatziakis, Jack W. Stokes, Anil Thomas, Mady Marinescu

Proceedings of Conference on Detection of Intrusions and Malware & Vulnerability Assessment | September 2012

Proceedings of Conference on Detection of Intrusions and Malware & Vulnerability Assessment

Publication Projet

Efficient optimal learning for contextual bandits

Nikos Karampatziakis, John Langford, Miroslav Dudik, Lev Reyzin, Tong Zhang, Miro Dudík

Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI-11) | July 2011

Publication Projet

Contextual Bandit Applications in a Customer Support Bot

Sandra Sajeev, Jade Huang, Nikos Karampatziakis, Sebastian Kochman, Matthew Hall, Wei Chen

August 2021

Online Importance Weight Aware Updates

Nikos Karampatziakis, John Langford

June 2011

Publication

Parallel Online Learning

Daniel Hsu, Nikos Karampatziakis, John Langford, Alex J. Smola

March 2011

Publication