Bridging the Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs
Somnath Kumar, Vaibhav Balloli, Mercy Ranjit, Kabir Ahuja, Tanuja Ganu, Sunayana Sitaram, Kalika Bali, Akshay Nambi
May 2024
Sunayana Sitaram
Principal Researcher
Publications
Publications by Year
-
PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models
Ishaan Watts, Varun Gumma, Aditya Yadavalli, Vivek Seshadri, Swami Manohar, Sunayana Sitaram
May 2024
TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
Nishanth Chandran, Sunayana Sitaram, Divya Gupta, Rahul Sharma, Kashish Mittal, Swami Manohar
February 2024
DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures
Agrima Seth, Sanchit Ahuja, Kalika Bali, Sunayana Sitaram
February 2024
CultureLLM: Incorporating Cultural Differences into Large Language Models
Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, Xing Xie
NeurIPS 2024 | February 2024
-
MEGA: Multilingual Evaluation of Generative AI
Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Nambi, Tanuja Ganu, Sameer Segal, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram
EMNLP 2023 | October 2023
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
Rishav Hada, Varun Gumma, Adrian de Wynter, Harshita Diddee, Mohamed Ahmed, M. Choudhury, Kalika Bali, Sunayana Sitaram
2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) | September 2023, pp. 1051-1070
A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models
Krithika Ramesh, Arnav Chavan, Shrey Pandit, Sunayana Sitaram
ACL 2023 | July 2023
ACL 2023 Multilingual Models Tutorial Slides
Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Barun Patra, Vishrav Chaudhary, Kabir Ahuja
July 2023
On Evaluating and Mitigating Gender Biases in Multilingual Settings
Aniket Vashishtha, Kabir Ahuja, Sunayana Sitaram
ACL 2023 | July 2023
-
A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies
A. Seza Doğruöz, Sunayana Sitaram, Barbara E. Bullock, Almeida Jacqueline Toribio
2021 Meeting of the Association for Computational Linguistics | August 2021
DOI PDF Publication Publication Publication Publication Publication Project
Multilingual and code-switching ASR challenges for low resource Indian languages
Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham
Interspeech 2021 | August 2021
A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist
Shaily Bhatt, Rahul Jain, Sandipan Dandapat, Sunayana Sitaram
Workshop on Human Evaluation of NLP Systems | April 2021
GCM: A Toolkit for Generating Synthetic Code-mixed Text
Mohd Sanad Zaki Rizvi, Anirudh Srinivasan, Tanuja Ganu, Monojit Choudhury, Sunayana Sitaram
2021 Conference of the European Chapter of the Association for Computational Linguistics | April 2021
-
GLUECoS: An Evaluation Benchmark for Code-Switched NLP
Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
ACL 2020 | July 2020
GLUECoS: An Evaluation Benchmark for Code-Switched NLP
Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
Association for Computational Linguistics (ACL) | June 2020
Learning not to Discriminate: Task Agnostic Learning for Improving Monolingual and Code-switched Speech Recognition
Gurunath Reddy Madhumani, Sanket Shah, Basil Abraham, Vikas Joshi, Sunayana Sitaram
arXiv preprint arXiv:2006.05257 | June 2020
A New Dataset for Natural Language Inference from Code-mixed Conversations
Simran Khanuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury
Workshop on Computational Approaches to Code Switching | May 2020
Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers
Basil Abraham, Danish Goel, Divya Siddarth, Kalika Bali, Manu Chopra, Monojit Choudhury, Pratik Joshi, Preethi Jyothi, Sunayana Sitaram, Vivek Seshadri
Language Resources and Evaluation Conference (LREC) | May 2020
-
Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities.
Pratik Joshi, Christain Barnes, Sebastin Santy, Simran Khanuja, Sanket Shah, Anirudh Srinivasan, Satwik Bhattamishra, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
International Conference on Natural Language Processing (ICON) | December 2019
Deploying Language Technologies for Underserved Communities
Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Sebastin Santy
UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
ELLORA: Enabling Low Resource Languages with Technology
Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Vivek Seshadri
UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
CoSSAT: Code-Switched Speech Annotation Tool
Sanket Shah, Pratik Joshi, Sunayana Sitaram (susitara), Sebastin Santy
EMNLP AnnoNLP workshop | November 2019
Using Monolingual Speech Recognition for Spoken Term Detection in Code-switched Hindi-English Speech
Sanket Shah, Sunayana Sitaram
International Conference on Data Mining | November 2019
End-to-End ASR for Code-switched Hindi-English Speech
Brij Mohan Lal Srivastava, Basil Abraham, Sunayana Sitaram, Rupesh K. Mehta, Preethi Jyothi
arXiv preprint arXiv:1906.09426 | June 2019
A Survey of Code-switched Speech and Language Processing
Sunayana Sitaram, Khyathi Raghavi Chandu, Sai Krishna Rallabandi, Alan W. Black
March 2019
-
Word Embeddings for Code-Mixed Language Processing
Adithya Pratapa, Monojit Choudhury, Sunayana Sitaram
Empirical Methods in Natural Language Processing (EMNLP) | November 2018
Effect of TTS Generated Audio on OOV Detection and Word Error Rate in ASR for Low-resource Languages
Savitha Murthy, Dinkar Sitaram, Sunayana Sitaram
Interspeech 2018 | September 2018
Homophone Identification and Merging for Code-switched Speech Recognition
Brij Mohan Lal Srivastava, Sunayana Sitaram
Interspeech 2018 | September 2018
Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages.
Brij Mohan Lal Srivastava, Sunayana Sitaram, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
Workshop Spoken Language Technologies for Under-resourced Languages | August 2018
Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages
Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
SLTU | August 2018
Automatic Detection of Code-switching Style from Acoustics
SaiKrishna Rallabandi, Sunayana Sitaram, Alan W Black
Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
Phone Merging For Code-switched Speech Recognition
Sunit Sivasankaran, Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Monojit Choudhury
Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data
Adithya Pratapa, Gayatri Bhat, Monojit Choudhury, Sunayana Sitaram, Sandipan Dandapat, Kalika Bali
Proceedings of ACL 2018 | July 2018
Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
LREC 2018 | May 2018
Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
Language Resources and Evaluation (LREC) | April 2018
-
Curriculum Design for Code-switching: Experiments with Language Identification and Language Modeling with Deep Neural Networks
Ashutosh Baheti, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
ICON 2017 | December 2017
Speech Synthesis for Mixed-Language Navigation Instructions
Khythiraghavi Chandu, Sai Krishna Rallabandi, Sunayana Sitaram, Alan W Black
Interspeech 2017 | August 2017
-
Experiments with Cross-lingual Systems for Synthesis of Code-Mixed Text
Sunayana Sitaram, Sai Krishna Rallabandi, Shruti Rijhwani, Alan W Black
Speech Synthesis Workshop 8 | August 2016
Publications by Research Area
-
Bridging the Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs
Somnath Kumar, Vaibhav Balloli, Mercy Ranjit, Kabir Ahuja, Tanuja Ganu, Sunayana Sitaram, Kalika Bali, Akshay Nambi
May 2024
PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models
Ishaan Watts, Varun Gumma, Aditya Yadavalli, Vivek Seshadri, Swami Manohar, Sunayana Sitaram
May 2024
DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures
Agrima Seth, Sanchit Ahuja, Kalika Bali, Sunayana Sitaram
February 2024
CultureLLM: Incorporating Cultural Differences into Large Language Models
Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, Xing Xie
NeurIPS 2024 | February 2024
MEGA: Multilingual Evaluation of Generative AI
Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Nambi, Tanuja Ganu, Sameer Segal, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram
EMNLP 2023 | October 2023
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
Rishav Hada, Varun Gumma, Adrian de Wynter, Harshita Diddee, Mohamed Ahmed, M. Choudhury, Kalika Bali, Sunayana Sitaram
2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) | September 2023, pp. 1051-1070
-
-
PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models
Ishaan Watts, Varun Gumma, Aditya Yadavalli, Vivek Seshadri, Swami Manohar, Sunayana Sitaram
May 2024
DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures
Agrima Seth, Sanchit Ahuja, Kalika Bali, Sunayana Sitaram
February 2024
MEGA: Multilingual Evaluation of Generative AI
Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Nambi, Tanuja Ganu, Sameer Segal, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram
EMNLP 2023 | October 2023
ACL 2023 Multilingual Models Tutorial Slides
Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Barun Patra, Vishrav Chaudhary, Kabir Ahuja
July 2023
On Evaluating and Mitigating Gender Biases in Multilingual Settings
Aniket Vashishtha, Kabir Ahuja, Sunayana Sitaram
ACL 2023 | July 2023
A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models
Krithika Ramesh, Arnav Chavan, Shrey Pandit, Sunayana Sitaram
ACL 2023 | July 2023
A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies
A. Seza Doğruöz, Sunayana Sitaram, Barbara E. Bullock, Almeida Jacqueline Toribio
2021 Meeting of the Association for Computational Linguistics | August 2021
DOI PDF Publication Publication Publication Publication Publication Project
Multilingual and code-switching ASR challenges for low resource Indian languages
Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham
Interspeech 2021 | August 2021
GCM: A Toolkit for Generating Synthetic Code-mixed Text
Mohd Sanad Zaki Rizvi, Anirudh Srinivasan, Tanuja Ganu, Monojit Choudhury, Sunayana Sitaram
2021 Conference of the European Chapter of the Association for Computational Linguistics | April 2021
A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist
Shaily Bhatt, Rahul Jain, Sandipan Dandapat, Sunayana Sitaram
Workshop on Human Evaluation of NLP Systems | April 2021
GLUECoS: An Evaluation Benchmark for Code-Switched NLP
Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
ACL 2020 | July 2020
GLUECoS: An Evaluation Benchmark for Code-Switched NLP
Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
Association for Computational Linguistics (ACL) | June 2020
Learning not to Discriminate: Task Agnostic Learning for Improving Monolingual and Code-switched Speech Recognition
Gurunath Reddy Madhumani, Sanket Shah, Basil Abraham, Vikas Joshi, Sunayana Sitaram
arXiv preprint arXiv:2006.05257 | June 2020
A New Dataset for Natural Language Inference from Code-mixed Conversations
Simran Khanuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury
Workshop on Computational Approaches to Code Switching | May 2020
Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers
Basil Abraham, Danish Goel, Divya Siddarth, Kalika Bali, Manu Chopra, Monojit Choudhury, Pratik Joshi, Preethi Jyothi, Sunayana Sitaram, Vivek Seshadri
Language Resources and Evaluation Conference (LREC) | May 2020
Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities.
Pratik Joshi, Christain Barnes, Sebastin Santy, Simran Khanuja, Sanket Shah, Anirudh Srinivasan, Satwik Bhattamishra, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
International Conference on Natural Language Processing (ICON) | December 2019
Deploying Language Technologies for Underserved Communities
Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Sebastin Santy
UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
ELLORA: Enabling Low Resource Languages with Technology
Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Vivek Seshadri
UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
Using Monolingual Speech Recognition for Spoken Term Detection in Code-switched Hindi-English Speech
Sanket Shah, Sunayana Sitaram
International Conference on Data Mining | November 2019
CoSSAT: Code-Switched Speech Annotation Tool
Sanket Shah, Pratik Joshi, Sunayana Sitaram (susitara), Sebastin Santy
EMNLP AnnoNLP workshop | November 2019
End-to-End ASR for Code-switched Hindi-English Speech
Brij Mohan Lal Srivastava, Basil Abraham, Sunayana Sitaram, Rupesh K. Mehta, Preethi Jyothi
arXiv preprint arXiv:1906.09426 | June 2019
A Survey of Code-switched Speech and Language Processing
Sunayana Sitaram, Khyathi Raghavi Chandu, Sai Krishna Rallabandi, Alan W. Black
March 2019
Word Embeddings for Code-Mixed Language Processing
Adithya Pratapa, Monojit Choudhury, Sunayana Sitaram
Empirical Methods in Natural Language Processing (EMNLP) | November 2018
Effect of TTS Generated Audio on OOV Detection and Word Error Rate in ASR for Low-resource Languages
Savitha Murthy, Dinkar Sitaram, Sunayana Sitaram
Interspeech 2018 | September 2018
Homophone Identification and Merging for Code-switched Speech Recognition
Brij Mohan Lal Srivastava, Sunayana Sitaram
Interspeech 2018 | September 2018
Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages.
Brij Mohan Lal Srivastava, Sunayana Sitaram, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
Workshop Spoken Language Technologies for Under-resourced Languages | August 2018
Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages
Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
SLTU | August 2018
Automatic Detection of Code-switching Style from Acoustics
SaiKrishna Rallabandi, Sunayana Sitaram, Alan W Black
Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
Phone Merging For Code-switched Speech Recognition
Sunit Sivasankaran, Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Monojit Choudhury
Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data
Adithya Pratapa, Gayatri Bhat, Monojit Choudhury, Sunayana Sitaram, Sandipan Dandapat, Kalika Bali
Proceedings of ACL 2018 | July 2018
Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
LREC 2018 | May 2018
Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
Language Resources and Evaluation (LREC) | April 2018
Curriculum Design for Code-switching: Experiments with Language Identification and Language Modeling with Deep Neural Networks
Ashutosh Baheti, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
ICON 2017 | December 2017
Speech Synthesis for Mixed-Language Navigation Instructions
Khythiraghavi Chandu, Sai Krishna Rallabandi, Sunayana Sitaram, Alan W Black
Interspeech 2017 | August 2017
Experiments with Cross-lingual Systems for Synthesis of Code-Mixed Text
Sunayana Sitaram, Sai Krishna Rallabandi, Shruti Rijhwani, Alan W Black
Speech Synthesis Workshop 8 | August 2016
-
Multilingual and code-switching ASR challenges for low resource Indian languages
Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham
Interspeech 2021 | August 2021
-
Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities.
Pratik Joshi, Christain Barnes, Sebastin Santy, Simran Khanuja, Sanket Shah, Anirudh Srinivasan, Satwik Bhattamishra, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
International Conference on Natural Language Processing (ICON) | December 2019
ELLORA: Enabling Low Resource Languages with Technology
Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Vivek Seshadri
UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
Publications by Type
-
CultureLLM: Incorporating Cultural Differences into Large Language Models
Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, Xing Xie
NeurIPS 2024 | February 2024
MEGA: Multilingual Evaluation of Generative AI
Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Nambi, Tanuja Ganu, Sameer Segal, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram
EMNLP 2023 | October 2023
On Evaluating and Mitigating Gender Biases in Multilingual Settings
Aniket Vashishtha, Kabir Ahuja, Sunayana Sitaram
ACL 2023 | July 2023
A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models
Krithika Ramesh, Arnav Chavan, Shrey Pandit, Sunayana Sitaram
ACL 2023 | July 2023
A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies
A. Seza Doğruöz, Sunayana Sitaram, Barbara E. Bullock, Almeida Jacqueline Toribio
2021 Meeting of the Association for Computational Linguistics | August 2021
DOI PDF Publication Publication Publication Publication Publication Project
Multilingual and code-switching ASR challenges for low resource Indian languages
Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan, Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham
Interspeech 2021 | August 2021
GCM: A Toolkit for Generating Synthetic Code-mixed Text
Mohd Sanad Zaki Rizvi, Anirudh Srinivasan, Tanuja Ganu, Monojit Choudhury, Sunayana Sitaram
2021 Conference of the European Chapter of the Association for Computational Linguistics | April 2021
A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist
Shaily Bhatt, Rahul Jain, Sandipan Dandapat, Sunayana Sitaram
Workshop on Human Evaluation of NLP Systems | April 2021
GLUECoS: An Evaluation Benchmark for Code-Switched NLP
Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
ACL 2020 | July 2020
GLUECoS: An Evaluation Benchmark for Code-Switched NLP
Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury
Association for Computational Linguistics (ACL) | June 2020
A New Dataset for Natural Language Inference from Code-mixed Conversations
Simran Khanuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury
Workshop on Computational Approaches to Code Switching | May 2020
Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers
Basil Abraham, Danish Goel, Divya Siddarth, Kalika Bali, Manu Chopra, Monojit Choudhury, Pratik Joshi, Preethi Jyothi, Sunayana Sitaram, Vivek Seshadri
Language Resources and Evaluation Conference (LREC) | May 2020
Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities.
Pratik Joshi, Christain Barnes, Sebastin Santy, Simran Khanuja, Sanket Shah, Anirudh Srinivasan, Satwik Bhattamishra, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
International Conference on Natural Language Processing (ICON) | December 2019
Deploying Language Technologies for Underserved Communities
Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Sebastin Santy
UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
ELLORA: Enabling Low Resource Languages with Technology
Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Vivek Seshadri
UNESCO International Conference on Language Technologies for all (LT4All) | December 2019
Using Monolingual Speech Recognition for Spoken Term Detection in Code-switched Hindi-English Speech
Sanket Shah, Sunayana Sitaram
International Conference on Data Mining | November 2019
CoSSAT: Code-Switched Speech Annotation Tool
Sanket Shah, Pratik Joshi, Sunayana Sitaram (susitara), Sebastin Santy
EMNLP AnnoNLP workshop | November 2019
Word Embeddings for Code-Mixed Language Processing
Adithya Pratapa, Monojit Choudhury, Sunayana Sitaram
Empirical Methods in Natural Language Processing (EMNLP) | November 2018
Effect of TTS Generated Audio on OOV Detection and Word Error Rate in ASR for Low-resource Languages
Savitha Murthy, Dinkar Sitaram, Sunayana Sitaram
Interspeech 2018 | September 2018
Homophone Identification and Merging for Code-switched Speech Recognition
Brij Mohan Lal Srivastava, Sunayana Sitaram
Interspeech 2018 | September 2018
Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages.
Brij Mohan Lal Srivastava, Sunayana Sitaram, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
Workshop Spoken Language Technologies for Under-resourced Languages | August 2018
Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages
Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak
SLTU | August 2018
Automatic Detection of Code-switching Style from Acoustics
SaiKrishna Rallabandi, Sunayana Sitaram, Alan W Black
Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
Phone Merging For Code-switched Speech Recognition
Sunit Sivasankaran, Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Monojit Choudhury
Workshop on Computational Approaches to Linguistic Code Switching, 2018 | July 2018
Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data
Adithya Pratapa, Gayatri Bhat, Monojit Choudhury, Sunayana Sitaram, Sandipan Dandapat, Kalika Bali
Proceedings of ACL 2018 | July 2018
Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
LREC 2018 | May 2018
Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach
Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve
Language Resources and Evaluation (LREC) | April 2018
Curriculum Design for Code-switching: Experiments with Language Identification and Language Modeling with Deep Neural Networks
Ashutosh Baheti, Sunayana Sitaram, Monojit Choudhury, Kalika Bali
ICON 2017 | December 2017
Speech Synthesis for Mixed-Language Navigation Instructions
Khythiraghavi Chandu, Sai Krishna Rallabandi, Sunayana Sitaram, Alan W Black
Interspeech 2017 | August 2017
Experiments with Cross-lingual Systems for Synthesis of Code-Mixed Text
Sunayana Sitaram, Sai Krishna Rallabandi, Shruti Rijhwani, Alan W Black
Speech Synthesis Workshop 8 | August 2016
-
Bridging the Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs
Somnath Kumar, Vaibhav Balloli, Mercy Ranjit, Kabir Ahuja, Tanuja Ganu, Sunayana Sitaram, Kalika Bali, Akshay Nambi
May 2024
PARIKSHA: A Scalable, Democratic, Transparent Evaluation Platform for Assessing Indic Large Language Models
Ishaan Watts, Varun Gumma, Aditya Yadavalli, Vivek Seshadri, Swami Manohar, Sunayana Sitaram
May 2024
A Survey of Code-switched Speech and Language Processing
Sunayana Sitaram, Khyathi Raghavi Chandu, Sai Krishna Rallabandi, Alan W. Black
March 2019
-
TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
Nishanth Chandran, Sunayana Sitaram, Divya Gupta, Rahul Sharma, Kashish Mittal, Swami Manohar
February 2024
DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures
Agrima Seth, Sanchit Ahuja, Kalika Bali, Sunayana Sitaram
February 2024
ACL 2023 Multilingual Models Tutorial Slides
Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Barun Patra, Vishrav Chaudhary, Kabir Ahuja
July 2023
-
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
Rishav Hada, Varun Gumma, Adrian de Wynter, Harshita Diddee, Mohamed Ahmed, M. Choudhury, Kalika Bali, Sunayana Sitaram
2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) | September 2023, pp. 1051-1070
Learning not to Discriminate: Task Agnostic Learning for Improving Monolingual and Code-switched Speech Recognition
Gurunath Reddy Madhumani, Sanket Shah, Basil Abraham, Vikas Joshi, Sunayana Sitaram
arXiv preprint arXiv:2006.05257 | June 2020
End-to-End ASR for Code-switched Hindi-English Speech
Brij Mohan Lal Srivastava, Basil Abraham, Sunayana Sitaram, Rupesh K. Mehta, Preethi Jyothi
arXiv preprint arXiv:1906.09426 | June 2019