Sunayana Sitaram
- CultureLLM: Incorporating Cultural Differences into Large Language Models
2024/02/09 by Cheng Li, Li, Cheng, Mengzhou Chen +7 · 10 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
2023/09/14 by Rishav Hada, Hada, Rishav, Varun Gumma +13 · 8 citations
Decision Sciences · Health Professions · #Computation and Language (cs.CL) #Evaluation and Performance Assessment #FOS: Computer and information sciences #Interpreting and Communication in Healthcare
- A Survey of Code-switched Speech and Language Processing
2019/03/25 by Sunayana Sitaram, Khyathi Raghavi Chandu, Sitaram, Sunayana +5 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data
2024/06/21 by Ishaan Watts, Watts, Ishaan, Varun Gumma +9 · 9 citations
Computer Science · Health Professions · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Interpreting and Communication in Healthcare #Natural Language Processing Techniques
- On Evaluating and Mitigating Gender Biases in Multilingual Settings
2023/07/04 by Aniket Vashishtha, Kabir Ahuja, Vashishtha, Aniket +3 · 6 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Text Readability and Simplification
- M5 -- A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks
2024/07/04 by Florian Schneider, Sunayana Sitaram, Schneider, Florian +1 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures
2024/02/23 by Agrima Seth, Sanchit Ahuja, Seth, Agrima +5 · 6 citations
Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #Computers and Society (cs.CY) #FOS: Computer and information sciences #Language and cultural evolution
- Predicting the Performance of Multilingual NLP Models
2021/10/17 by Anirudh Srinivasan, Sunayana Sitaram, Srinivasan, Anirudh +9 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- A New Dataset for Natural Language Inference from Code-mixed\n Conversations
2020/04/10 by Simran Khanuja, Khanuja, Simran, Sandipan Dandapat +5 · 2 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- On the Calibration of Massively Multilingual Language Models
2022/10/21 by Kabir Ahuja, Sunayana Sitaram, Ahuja, Kabir +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- METAL: Towards Multilingual Meta-Evaluation
2024/04/02 by Rishav Hada, Hada, Rishav, Varun Gumma +7 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
2024/03/01 by Nishanth Chandran, Rajore, Tanmay, Sunayana Sitaram +10 · 2 citations
Business, Management and Accounting · #International Arbitration and Investment Law
- Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities
2019/12/07 by Pratik Joshi, Christain Barnes, Joshi, Pratik +17 · 1 citation
Computer Science · #Caching and Content Delivery #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #ICT in Developing Communities
- Improving Self Consistency in LLMs through Probabilistic Tokenization
2024/07/04 by Ashutosh Sathe, Divyanshu Aggarwal, Sathe, Ashutosh +3 · 1 voice · 1 citation
Business, Management and Accounting · Computer Science · #Business Process Modeling and Analysis #Semantic Web and Ontologies #cs.CL #cs.LG
- sPhinX: Sample Efficient Multilingual Instruction Fine-Tuning Through N-shot Guided Prompting
2024/07/13 by Sanchit Ahuja, Kumar Tanmay, Ahuja, Sanchit +20 · 2 citations
Computer Science · #Speech and Audio Processing #Video Analysis and Summarization #Speech Recognition and Synthesis
- Uncovering inequalities in new knowledge learning by large language models across different languages
2025/03/06 by Chenglong Wang, Wang, Chenglong, Haoyu Tang +19 · 1 citation
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computational and Text Analysis Methods #Computers and Society (cs.CY) #FOS: Computer and information sciences #Text Readability and Simplification #Topic Modeling
- Contamination Report for Multilingual Benchmarks
2024/10/21 by Sanchit Ahuja, Varun Gumma, Ahuja, Sanchit +3 · 1 citation
Health Professions · Environmental Science · #Interpreting and Communication in Healthcare #International Environmental Law and Policies
- HEALTH-PARIKSHA: Assessing RAG Models for Health Chatbots in Real-World Multilingual Settings
2024/10/17 by Varun Gumma, Gumma, Varun, Raghunath, Ananditha +4 · 1 citation
Computer Science · Psychology · #AI in Service Interactions #Computation and Language (cs.CL) #Digital Mental Health Interventions #FOS: Computer and information sciences