Lovering, Charles
- Lessons from the Trenches on Reproducible Evaluation of Language Models
2024/05/23 by Stella Biderman, Biderman, Stella, Hailey Schoelkopf +58 · 2 voices · 41 citations
Computer Science · #Natural Language Processing Techniques
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
2022/11/09 by BigScience Workshop, Workshop, BigScience, Teven Le Scao +784 · 1 voice · 133 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
- DocFinQA: A Long-Context Financial Reasoning Dataset
2024/01/12 by Varshini Reddy, Rik Koncel-Kedziorski, Reddy, Varshini +6 · 18 citations
Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Stock Market Forecasting Methods
- No Free Labels: Limitations of LLM-as-a-Judge Without Human Grounding
2025/03/07 by Krumdick, Michael, Lovering, Charles, Reddy, Varshini +2 · 26 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- BizBench: A Quantitative Reasoning Benchmark for Business and Finance
2023/11/11 by Rik Koncel-Kedziorski, Michael Krumdick, Koncel-Kedziorski, Rik +9 · 8 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multi-Agent Systems and Negotiation
- Are Language Model Logits Calibrated?
2024/10/21 by Charles Lovering, Lovering, Charles, Michael Krumdick +12 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Natural Language Processing Techniques
- SEC-QA: A Systematic Evaluation Corpus for Financial QA
2024/06/20 by Viet Dac Lai, Lai, Viet Dac, Michael Krumdick +9 · 6 citations
Decision Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Stock Market Forecasting Methods
- Evaluation Beyond Task Performance: Analyzing Concepts in AlphaZero in Hex
2022/11/26 by Lovering, Charles, Forde, Jessica Zosa, Konidaris, George +2 · 3 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- Unit Testing for Concepts in Neural Networks
2022/07/28 by Lovering, Charles, Pavlick, Ellie · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences