2025/10/20 by Marinho, Marina Soares, Daniela Vianna, Livy Real +6
Medicine · Social Sciences · #Artificial Intelligence in Healthcare and Education #Artificial Intelligence in Law #Computation and Language (cs.CL) #Ethics and Social Impacts of AI #FOS: Computer and information sciences
paper · pdf · doi:10.48550/arxiv.2510.18108
openalex publication_date 2025/10/20 · openalex created_date 2025/10/24 · openalex updated_date 2026/07/28
This study presents the Jusbrasil Study on the Use of General-Purpose AIs in Law, proposing an experimental evaluation protocol combining legal theory, such as material correctness, systematic coherence, and argumentative integrity, with empirical assessment by 48 legal professionals. Four systems (JusIA, ChatGPT Free, ChatGPT Pro, and Gemini) were tested in tasks simulating lawyers' daily work. JusIA, a domain-specialized model, consistently outperformed the general-purpose systems, showing that both domain specialization and a theoretically grounded evaluation are essential for reliable legal AI outputs.