TunesFormer: Forming Irish Tunes with Control Codes by Bar Patching

2023/01/07 by Shangda Wu, Wu, Shangda, Li, Xiaobing +2 · 7 citations
Arts and Humanities · Computer Science · #Audio and Speech Processing (eess.AS) #Diverse Musicological Studies #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2301.02884

openalex publication_date 2023/01/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This paper introduces TunesFormer, an efficient Transformer-based dual-decoder model specifically designed for the generation of melodies that adhere to user-defined musical forms. Trained on 214,122 Irish tunes, TunesFormer utilizes techniques including bar patching and control codes. Bar patching reduces sequence length and generation time, while control codes guide TunesFormer in producing melodies that conform to desired musical forms. Our evaluation demonstrates TunesFormer's superior efficiency, being 3.22 times faster than GPT-2 and 1.79 times faster than a model with linear complexity of equal scale while offering comparable performance in controllability and other metrics. TunesFormer provides a novel tool for musicians, composers, and music enthusiasts alike to explore the vast landscape of Irish music. Our model and code are available at https://github.com/sander-wood/tunesformer.

Cited by

• The Renaissance of Expert Systems: Optical Recognition of Printed Chinese Jianpu Musical Scores with Lyrics
• Text2Score: Generating Sheet Music From Textual Prompts
• ABC-Eval: Benchmarking Large Language Models on Symbolic Music Understanding and Instruction Following
• Difficulty-Aware Score Generation for Piano Sight-Reading
• A Survey on Evaluation Metrics for Music Generation
• SEAM: Semantically Equivalent Across Modalities Benchmark for Vision-Language Models
• Via Score to Performance: Efficient Human-Controllable Long Song Generation with Bar-Level Symbolic Notation

Related

• GANs & Reels: Creating Irish Music using a Generative Adversarial Network
• Editing Music with Melody and Text: Using ControlNet for Diffusion Transformer
• Parsing Musical Structure to Enable Meaningful Variations
• Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions
• The Kolmogorov Complexity of Irish traditional dance music