FLAMO: An Open-Source Library for Frequency-Domain Differentiable Audio Processing

2024/09/13 by Santo, Gloria Dal, De Bortoli, Gian Marco, Prawda, Karolina +2 · 4 citations
#Audio and Speech Processing (eess.AS) #FOS: Electrical engineering #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2409.08723

Abstract

We present FLAMO, a Frequency-sampling Library for Audio-Module Optimization designed to implement and optimize differentiable linear time-invariant audio systems. The library is open-source and built on the frequency-sampling filter design method, allowing for the creation of differentiable modules that can be used stand-alone or within the computation graph of neural networks, simplifying the development of differentiable audio systems. It includes predefined filtering modules and auxiliary classes for constructing, training, and logging the optimized systems, all accessible through an intuitive interface. Practical application of these modules is demonstrated through two case studies: the optimization of an artificial reverberator and an active acoustics system for improved response coloration.

Cited by

• Learning Recursive Attenuation Filters Under Noisy Conditions
• Accelerating Automatic Differentiation of Direct Form Digital Filters
• Matching Reverberant Speech Through Learned Acoustic Embeddings and Feedback Delay Networks
• Differentiable Acoustic Radiance Transfer

Related

• DiffMoog: a Differentiable Modular Synthesizer for Sound Matching
• A Review of Differentiable Digital Signal Processing for Music & Speech Synthesis
• DDX7: Differentiable FM Synthesis of Musical Instrument Sounds
• Biomimetic Frontend for Differentiable Audio Processing
• DDSP: Differentiable Digital Signal Processing