Indian Legal NLP Benchmarks : A Survey

2021/07/13 by Prathamesh Kalamkar, Kalamkar, Prathamesh, Janani Venugopalan +3
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2107.06056

openalex publication_date 2021/07/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Availability of challenging benchmarks is the key to advancement of AI in a specific field.Since Legal Text is significantly different than normal English text, there is a need to create separate Natural Language Processing benchmarks for Indian Legal Text which are challenging and focus on tasks specific to Legal Systems. This will spur innovation in applications of Natural language Processing for Indian Legal Text and will benefit AI community and Legal fraternity. We review the existing work in this area and propose ideas to create new benchmarks for Indian Legal Natural Language Processing.

Citations

• Collective Classification in Network Data
• Know What You Don't Know: Unanswerable Questions for SQuAD
• DocRED: A Large-Scale Document-Level Relation Extraction Dataset
• CAIL2019-SCM: A Dataset of Similar Case Matching in Legal Domain
• ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation

Related

• IL-TUR: Benchmark for Indian Legal Text Understanding and Reasoning
• Pre-trained Language Models for the Legal Domain: A Case Study on Indian Law
• Natural Language Processing in the Legal Domain
• IndianBailJudgments-1200: A Multi-Attribute Dataset for Legal NLP on Indian Bail Orders
• Evaluating the Role of Large Language Models in Legal Practice in India