2022/06/03 by Seonghyeon Nam, Nam, Seonghyeon, Abhijith Punnappurath +5 · 3 citations
Computer Science · Engineering · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Artificial intelligence #CCD and CMOS Imaging Sensors #Computer graphics (images) #Computer science #Computer vision #Metadata #Pixel #RGB color model #Rendering (computer graphics) #cs.CV #eess.IV
paper · pdf · doi:10.48550/arxiv.2206.01813
published in arXiv (Cornell University) (Cornell University) · CVPR 2022 (GitHub: https://github.com/SamsungLabs/content-aware-metadata)
arxiv created 2022/06/03 · openalex publication_date 2022/06/03 · arxiv updated 2022/06/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Most camera images are rendered and saved in the standard RGB (sRGB) format by the camera's hardware. Due to the in-camera photo-finishing routines, nonlinear sRGB images are undesirable for computer vision tasks that assume a direct relationship between pixel values and scene radiance. For such applications, linear raw-RGB sensor images are preferred. Saving images in their raw-RGB format is still uncommon due to the large storage requirement and lack of support by many imaging applications. Several "raw reconstruction" methods have been proposed that utilize specialized metadata sampled from the raw-RGB image at capture time and embedded in the sRGB image. This metadata is used to parameterize a mapping function to de-render the sRGB image back to its original raw-RGB format when needed. Existing raw reconstruction methods rely on simple sampling strategies and global mapping to perform the de-rendering. This paper shows how to improve the de-rendering results by jointly learning sampling and reconstruction. Our experiments show that our learned sampling can adapt to the image content to produce better raw reconstructions than existing methods. We also describe an online fine-tuning strategy for the reconstruction network to improve results further.