vix.ing · top · new · best · stats · spec

Diving into the Depths of Spotting Text in Multi-Domain Noisy Scenes

2023/10/01 by Alloy Das, Das, Alloy, Sanket Biswas +5
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Fluid Dynamics Simulations and Interactions #Multimodal Machine Learning Applications

paper · pdf · doi:10.48550/arxiv.2310.00558

openalex publication_date 2023/10/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

When used in a real-world noisy environment, the capacity to generalize to multiple domains is essential for any autonomous scene text spotting system. However, existing state-of-the-art methods employ pretraining and fine-tuning strategies on natural scene datasets, which do not exploit the feature interaction across other complex domains. In this work, we explore and investigate the problem of domain-agnostic scene text spotting, i.e., training a model on multi-domain source data such that it can directly generalize to target domains rather than being specialized for a specific domain or scenario. In this regard, we present the community a text spotting validation benchmark called Under-Water Text (UWT) for noisy underwater scenes to establish an important case study. Moreover, we also design an efficient super-resolution based end-to-end transformer baseline called DA-TextSpotter which achieves comparable or superior performance over existing text spotting architectures for both regular and arbitrary-shaped scene text spotting benchmarks in terms of both accuracy and model efficiency. The dataset, code and pre-trained models will be released upon acceptance.

Related