vix.ing · top · new · best · stats

Automated Unity Game Template Generation from GDDs via NLP and Multi-Modal LLMs

2025/09/07 by Amna Hassan, Hassan, Amna · 1 citation
Computer Science · Psychology · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Games #Code (set theory) #Code generation #Computation and Language (cs.CL) #Core (optical fiber) #Digital Games and Media #Educational Games and Gamification #FOS: Computer and information sciences #Machine Learning (cs.LG) #Modularity (biology) #Natural language #Natural language generation #Software Engineering (cs.SE) #Template #Video game development

paper · pdf · doi:10.48550/arxiv.2509.08847

published in arXiv (Cornell University) (Cornell University)

openalex publication_date 2025/09/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05

Abstract

This paper presents a novel framework for automated game template generation by transforming Game Design Documents (GDDs) into functional Unity game prototypes using Natural Language Processing (NLP) and multi-modal Large Language Models (LLMs). We introduce an end-to-end system that parses GDDs, extracts structured game specifications, and synthesizes Unity-compatible C# code that implements the core mechanics, systems, and architecture defined in the design documentation. Our approach combines a fine-tuned LLaMA-3 model specialized for Unity code generation with a custom Unity integration package that streamlines the implementation process. Evaluation results demonstrate significant improvements over baseline models, with our fine-tuned model achieving superior performance (4.8/5.0 average score) compared to state-of-the-art LLMs across compilation success, GDD adherence, best practices adoption, and code modularity metrics. The generated templates demonstrate high adherence to GDD specifications across multiple game genres. Our system effectively addresses critical gaps in AI-assisted game development, positioning LLMs as valuable tools in streamlining the transition from game design to implementation.

Citations

Related