vix.ing · top · new · best · stats · spec

TransVisDrone: Spatio-Temporal Transformer for Vision-based Drone-to-Drone Detection in Aerial Videos

2022/10/16 by Tushar Sangam, Sangam, Tushar, Ishan Rajendrakumar Dave +5 · 2 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics (cs.RO) #UAV Applications and Optimization #Video Surveillance and Tracking Methods

paper · pdf · doi:10.48550/arxiv.2210.08423

openalex publication_date 2022/10/16 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Drone-to-drone detection using visual feed has crucial applications, such as detecting drone collisions, detecting drone attacks, or coordinating flight with other drones. However, existing methods are computationally costly, follow non-end-to-end optimization, and have complex multi-stage pipelines, making them less suitable for real-time deployment on edge devices. In this work, we propose a simple yet effective framework, TransVisDrone, that provides an end-to-end solution with higher computational efficiency. We utilize CSPDarkNet-53 network to learn object-related spatial features and VideoSwin model to improve drone detection in challenging scenarios by learning spatio-temporal dependencies of drone motion. Our method achieves state-of-the-art performance on three challenging real-world datasets (Average [email protected]): NPS 0.95, FLDrones 0.75, and AOT 0.80, and a higher throughput than previous methods. We also demonstrate its deployment capability on edge devices and its usefulness in detecting drone-collision (encounter). Project: \urlhttps://tusharsangam.github.io/TransVisDrone-project-page/.

Cited by

Related