vix.ing · top · new · best · stats · spec

Cross-Modal Semantic Communication for Heterogeneous Collaborative Perception

2025/11/25 by Lu, Mingyi, Liu, Guowei, Liang, Le +3
Computer Science · Engineering · #Autonomous Vehicle Technology and Safety #Distributed Sensor Networks and Detection Algorithms #FOS: Electrical engineering #Signal Processing (eess.SP) #Wireless Signal Modulation Classification #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2511.20000

openalex publication_date 2025/11/25 · openalex created_date 2025/11/28 · openalex updated_date 2026/07/28

Abstract

Collaborative perception, an emerging paradigm in autonomous driving, has been introduced to mitigate the limitations of single-vehicle systems, such as limited sensor range and occlusion. To improve the robustness of inter-vehicle data sharing, semantic communication has recently further been integrated into collaborative perception systems to enhance overall performance. However, practical deployment of such systems is challenged by the heterogeneity of sensors across different connected autonomous vehicles (CAVs). This diversity in perceptual data complicates the design of a unified communication framework and impedes the effective fusion of shared information. To address this challenge, we propose a novel cross-modal semantic communication (CMSC) framework to facilitate effective collaboration among CAVs with disparate sensor configurations. Specifically, the framework first transforms heterogeneous perceptual features from different sensor modalities into a unified and standardized semantic space. Subsequently, encoding, transmission, and decoding are performed within this semantic space, enabling seamless and effective information fusion. Extensive experiments demonstrate that CMSC achieves significantly stronger perception performance than existing methods, particularly in low signal-to-noise ratio (SNR) regimes.

Citations

Related