2024/10/17 by Jack Hilliard, Hilliard, Jack, Adrian Hilton +3 · 2 citations
Computer Science · Engineering · Physics and Astronomy · #Color Science and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Image Enhancement Techniques #Industrial Vision Systems and Defect Detection
paper · pdf · doi:10.48550/arxiv.2410.13566
openalex publication_date 2024/10/17 · openalex created_date 2024/10/21 · openalex updated_date 2026/07/28
Recent illumination estimation methods have focused on enhancing the resolution and improving the quality and diversity of the generated textures. However, few have explored tailoring the neural network architecture to the Equirectangular Panorama (ERP) format utilised in image-based lighting. Consequently, high dynamic range images (HDRI) results usually exhibit a seam at the side borders and textures or objects that are warped at the poles. To address this shortcoming we propose a novel architecture, 360U-Former, based on a U-Net style Vision-Transformer which leverages the work of PanoSWIN, an adapted shifted window attention tailored to the ERP format. To the best of our knowledge, this is the first purely Vision-Transformer model used in the field of illumination estimation. We train 360U-Former as a GAN to generate HDRI from a limited field of view low dynamic range image (LDRI). We evaluate our method using current illumination estimation evaluation protocols and datasets, demonstrating that our approach outperforms existing and state-of-the-art methods without the artefacts typically associated with the use of the ERP format.