Thakur, Nandan
- BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models
2021/04/17 by Thakur, Nandan, Reimers, Nils, Rücklé, Andreas +2 · 181 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for\n Pairwise Sentence Scoring Tasks
2020/10/16 by Nandan Thakur, Thakur, Nandan, Nils Reimers +5 · 13 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- MMTEB: Massive Multilingual Text Embedding Benchmark
2025/02/19 by Enevoldsen, Kenneth, Chung, Isaac, Kerboua, Imene +83 · 34 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval
2021/12/14 by Kexin Wang, Nandan Thakur, Wang, Kexin +5 · 10 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications
- BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
2025/08/08 by Zijian Chen, Xueguang Ma, Chen, Zijian +34 · 40 citations
Computer Science · Materials Science · #Information Retrieval and Search Behavior #Topic Modeling #Machine Learning in Materials Science
- HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attribution
2023/07/31 by Kamalloo, Ehsan, Jafari, Aref, Zhang, Xinyu +2 · 8 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval
2023/11/10 by Nandan Thakur, Thakur, Nandan, Jianmo Ni +9 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor
2024/06/10 by Shivani Upadhyay, Ronak Pradeep, Upadhyay, Shivani +7 · 9 citations
Social Sciences · #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Wikis in Education and Collaboration
- Ragnarök: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track
2024/06/24 by Pradeep, Ronak, Thakur, Nandan, Sharifymoghaddam, Sahel +5 · 7 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languages
2022/10/18 by Xinyu Zhang, Nandan Thakur, Zhang, Xinyu +14 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents
2025/04/17 by Nandan Thakur, Thakur, Nandan, Jimmy Lin +9 · 1 voice · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Information Retrieval and Search Behavior #Topic Modeling
- Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework
2024/11/14 by Ronak Pradeep, Nandan Thakur, Pradeep, Ronak +9 · 6 citations
Earth and Planetary Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Geophysics and Gravity Measurements #Information Retrieval (cs.IR) #Meteorological Phenomena and Simulations #Seismic Imaging and Inversion Techniques
- MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems
2024/10/17 by Nandan Thakur, Thakur, Nandan, Suleman Kazi +7 · 3 citations
Computer Science · #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models
2025/04/21 by Pradeep, Ronak, Thakur, Nandan, Upadhyay, Shivani +3 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look
2024/11/13 by Shivani Upadhyay, Ronak Pradeep, Upadhyay, Shivani +13 · 3 citations
Computer Science · Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Topic Modeling
- Injecting Domain Adaptation with Learning-to-hash for Effective and Efficient Zero-shot Dense Retrieval
2022/05/23 by Thakur, Nandan, Reimers, Nils, Lin, Jimmy · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)
- Evaluating Embedding APIs for Information Retrieval
2023/05/10 by Kamalloo, Ehsan, Zhang, Xinyu, Ogundepo, Odunayo +4 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- SPRINT: A Unified Toolkit for Evaluating and Demystifying Zero-shot Neural Sparse Retrieval
2023/07/19 by Thakur, Nandan, Wang, Kexin, Gurevych, Iryna +1 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)
- Support Evaluation for the TREC 2024 RAG Track: Comparing Human versus LLM Judges
2025/04/21 by Thakur, Nandan, Pradeep, Ronak, Upadhyay, Shivani +3 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- Hard Negatives, Hard Lessons: Revisiting Training Data Quality for Robust Information Retrieval with LLMs
2025/05/22 by Thakur, Nandan, Zhang, Crystina, Ma, Xueguang +1 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)