vix.ing · top · new · best · stats · spec

SAMSOD: Rethinking SAM Optimization for RGB-T Salient Object Detection

2025/10/04 by Zhengyi Liu, Xinrui Wang, Liu, Zhengyi +7 · 1 citation
Computer Science · Engineering · #Visual Attention and Saliency Detection #Advanced Neural Network Applications #Infrared Target Detection Methodologies

paper · pdf · doi:10.48550/arxiv.2510.03689

Abstract

RGB-T salient object detection (SOD) aims to segment attractive objects by combining RGB and thermal infrared images. To enhance performance, the Segment Anything Model has been fine-tuned for this task. However, the imbalance convergence of two modalities and significant gradient difference between high- and low- activations are ignored, thereby leaving room for further performance enhancement. In this paper, we propose a model called SAMSOD, which utilizes unimodal supervision to enhance the learning of non-dominant modality and employs gradient deconfliction to reduce the impact of conflicting gradients on model convergence. The method also leverages two decoupled adapters to separately mask high- and low-activation neurons, emphasizing foreground objects by enhancing background learning. Fundamental experiments on RGB-T SOD benchmark datasets and generalizability experiments on scribble supervised RGB-T SOD, fully supervised RGB-D SOD datasets and full-supervised RGB-D rail surface defect detection all demonstrate the effectiveness of our proposed method.

Citations

Cited by

Related