vix.ing · top · new · best · stats · spec

A Fast and Effective Solution to the Problem of Look-ahead Bias in LLMs

2025/12/07 by Humzah Merchant, Bradford Levy, Merchant, Humzah +1 · 1 voice
Computer Science · #Explainable Artificial Intelligence (XAI) #Machine Learning in Healthcare #Topic Modeling #cs.CL #cs.LG

paper · pdf · doi:10.48550/arxiv.2512.06607

openalex publication_date 2025/12/07 · openalex created_date 2025/12/10 · openalex updated_date 2026/07/28

Abstract

Applying LLMs to predictive tasks in finance is challenging due to look-ahead bias resulting from their training on long time-series data. This precludes the backtests typically employed in finance since retraining frontier models from scratch with a specific knowledge cutoff is prohibitive. In this paper, we introduce a fast, effective, and low-cost alternative. Our method guides generation at inference time by adjusting the logits of a large base model using a pair of smaller, specialized models -- one fine-tuned on information to be forgotten and another on information to be retained. We demonstrate that our method effectively removes both verbatim and semantic knowledge, corrects biases, and outperforms prior methods.

Citations

Discussions

Related