Gumma, Varun
- IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languages
2023/05/25 by Jay Gala, Pranjal A. Chitale, Gala, Jay +25 · 24 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
2023/09/14 by Rishav Hada, Hada, Rishav, Varun Gumma +13 · 8 citations
Decision Sciences · Health Professions · #Computation and Language (cs.CL) #Evaluation and Performance Assessment #FOS: Computer and information sciences #Interpreting and Communication in Healthcare
- PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data
2024/06/21 by Ishaan Watts, Watts, Ishaan, Varun Gumma +9 · 9 citations
Computer Science · Health Professions · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Interpreting and Communication in Healthcare #Natural Language Processing Techniques
- MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks
2023/11/13 by Ahuja, Sanchit, Aggarwal, Divyanshu, Gumma, Varun +8 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- METAL: Towards Multilingual Meta-Evaluation
2024/04/02 by Rishav Hada, Varun Gumma, Hada, Rishav +7 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technology
2024/05/10 by Rishav Hada, Hada, Rishav, Safiya Husain +19 · 2 citations
Arts and Humanities · Economics, Econometrics and Finance · #South Asian Cinema and Culture #Labor market dynamics and wage inequality
- An Empirical Study of Leveraging Knowledge Distillation for Compressing Multilingual Neural Machine Translation Models
2023/04/19 by Varun Gumma, Gumma, Varun, Raj Dabre +3 · 1 citation
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Advanced Neural Network Applications
- Towards Inducing Long-Context Abilities in Multilingual Neural Machine Translation Models
2024/08/21 by Varun Gumma, Pranjal A. Chitale, Gumma, Varun +3 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Contamination Report for Multilingual Benchmarks
2024/10/21 by Sanchit Ahuja, Ahuja, Sanchit, Varun Gumma +3 · 1 citation
Health Professions · Environmental Science · #Interpreting and Communication in Healthcare #International Environmental Law and Policies
- HEALTH-PARIKSHA: Assessing RAG Models for Health Chatbots in Real-World Multilingual Settings
2024/10/17 by Varun Gumma, Gumma, Varun, Raghunath, Ananditha +4 · 1 citation
Computer Science · Psychology · #AI in Service Interactions #Computation and Language (cs.CL) #Digital Mental Health Interventions #FOS: Computer and information sciences
- OffTopicEval: When Large Language Models Enter the Wrong Chat, Almost Always!
2025/09/30 by Lei, Jingdi, Gumma, Varun, Bhardwaj, Rishabh +4 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
2024/06/01 by Ochieng, Millicent, Gumma, Varun, Sitaram, Sunayana +5 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences