vix.ing · top · new · best · stats · spec

Multi-Task Learning for Heterogeneous Prediction from Video Game State with Transfer Learning

2026/07/23 by Jonas Peché, Aliaksei Tsishurou, Alexander Zap +1
#cs.LG #cs.AI

paper · pdf

Abstract

Multi-task learning (MTL) is a promising approach for prediction tasks derived from video game state data, as modern game telemetry provides multiple related supervision signals from the same structured observations. We study whether a shared model trained jointly across tasks in team-based multiplayer games can improve generalization while reducing training and inference cost compared to specialized single-task models. We adapt a multimodal architecture for endpoint prediction to a general multi-task setting that combines rasterized vision inputs, global match context, and per-unit state information through an image encoder and attention-based interaction modeling. Experiments on a large proprietary World of Tanks dataset compare single-task and multi-task training, evaluate weighting strategies for mixed losses and conflicting gradients, and test pre-training/fine-tuning under limited target-data regimes. We also examine within-game transfer across game maps under structured environment shift.

Citations

Related