vix.ing · top · new · best · stats · spec

Beat-Aligned Spectrogram-to-Sequence Generation of Rhythm-Game Charts

2023/11/22 by Jayeon Yi, Sungho Lee, Yi, Jayeon +3 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Time Series Analysis and Forecasting #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2311.13687

openalex publication_date 2023/11/22 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In the heart of "rhythm games" - games where players must perform actions in sync with a piece of music - are "charts", the directives to be given to players. We newly formulate chart generation as a sequence generation task and train a Transformer using a large dataset. We also introduce tempo-informed preprocessing and training procedures, some of which are suggested to be integral for a successful training. Our model is found to outperform the baselines on a large dataset, and is also found to benefit from pretraining and finetuning.

Cited by

Related