vix.ing · top · new · best · stats · spec

Vision Transformer Segmentation for Visual Bird Sound Denoising

2024/06/13 by Jialu Li, Kumar, Sahil, Li, Jialu +2 · 1 citation
Biochemistry, Genetics and Molecular Biology · Environmental Science · #Animal Vocal Communication and Behavior #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Marine animal studies overview #Sound (cs.SD) #Species Distribution and Climate Change #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2406.09167

openalex publication_date 2024/06/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Audio denoising, especially in the context of bird sounds, remains a challenging task due to persistent residual noise. Traditional and deep learning methods often struggle with artificial or low-frequency noise. In this work, we propose ViTVS, a novel approach that leverages the power of the vision transformer (ViT) architecture. ViTVS adeptly combines segmentation techniques to disentangle clean audio from complex signal mixtures. Our key contributions encompass the development of ViTVS, introducing comprehensive, long-range, and multi-scale representations. These contributions directly tackle the limitations inherent in conventional approaches. Extensive experiments demonstrate that ViTVS outperforms state-of-the-art methods, positioning it as a benchmark solution for real-world bird sound denoising applications. Source code is available at: https://github.com/aiai-4/ViVTS.

Cited by

Related