Sound Event Detection and Localization with Distance Estimation

2024/03/18 by Daniel Krause, Krause, Daniel Aleksander, Archontis Politis +3 · 10 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2403.11827

openalex publication_date 2024/03/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Sound Event Detection and Localization (SELD) is a combined task of identifying sound events and their corresponding direction-of-arrival (DOA). While this task has numerous applications and has been extensively researched in recent years, it fails to provide full information about the sound source position. In this paper, we overcome this problem by extending the task to Sound Event Detection, Localization with Distance Estimation (3D SELD). We study two ways of integrating distance estimation within the SELD core - a multi-task approach, in which the problem is tackled by a separate model output, and a single-task approach obtained by extending the multi-ACCDOA method to include distance information. We investigate both methods for the Ambisonic and binaural versions of STARSS23: Sony-TAU Realistic Spatial Soundscapes 2023. Moreover, our study involves experiments on the loss function related to the distance estimation part. Our results show that it is possible to perform 3D SELD without any degradation of performance in sound event detection and DOA estimation.

Cited by

• Spatial Audio Motion Understanding and Reasoning
• Integrating Spatial and Semantic Embeddings for Stereo Sound Event Localization in Videos
• HDA-SELD: Hierarchical Cross-Modal Distillation with Multi-Level Data Augmentation for Low-Resource Audio-Visual Sound Event Localization and Detection
• Resnet-conformer network with shared weights and attention mechanism for sound event localization, detection, and distance estimation
• Stereo Sound Event Localization and Detection with Onscreen/offscreen Classification
• Spatial and Semantic Embedding Integration for Stereo Sound Event Localization and Detection in Regular Videos
• A Review on Sound Source Localization in Robotics: Focusing on Deep Learning Methods
• Improving Stereo 3D Sound Event Localization and Detection: Perceptual Features, Stereo-specific Data Augmentation, and Distance Normalization
• Adaptive Control Attention Network for Underwater Acoustic Localization and Domain Adaptation
• Reverberation-based Features for Sound Event Localization and Detection with Distance Estimation

Related

• An Experimental Study on Joint Modeling for Sound Event Localization and Detection with Source Distance Estimation
• Reverberation-based Features for Sound Event Localization and Detection with Distance Estimation
• Sound Event Localization and Detection for Real Spatial Sound Scenes: Event-Independent Network and Data Augmentation Chains
• Location-Oriented Sound Event Localization and Detection with Spatial Mapping and Regression Localization
• A Two-Step Learning Framework for Enhancing Sound Event Localization and Detection