vix.ing · top · new · best · stats · spec

Efficient data transport over multimode light-pipes with Megapixel images using differentiable ray tracing and Machine-learning

2023/01/16 by Joowon Lim, Jannes Gladrow, Lim, Joowon +13
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Physical sciences #Neural Networks and Reservoir Computing #Optical Network Technologies #Optics (physics.optics) #Photonic and Optical Devices

paper · pdf · doi:10.48550/arxiv.2301.06496

openalex publication_date 2023/01/16 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Retrieving images transmitted through multi-mode fibers is of growing interest, thanks to their ability to confine and transport light efficiently in a compact system. Here, we demonstrate machine-learning-based decoding of large-scale digital images (pages), maximizing page capacity for optical storage applications. Using a millimeter-sized square cross-section waveguide, we image an 8-bit spatial light modulator, presenting data as a matrix of symbols. Normally, decoders will incur a prohibitive O(n2) computational scaling to decode n symbols in spatially scrambled data. However, by combining a digital twin of the setup with a U-Net, we can retrieve up to 66 kB using efficient convolutional operations only. We compare trainable ray-tracing-based with eigenmode-based twins and show the former to be superior thanks to its ability to overcome the simulation-to-experiment gap by adjusting to optical imperfections. We train the pipeline end-to-end using a differentiable mutual-information estimator based on the von-Mises distribution, generally applicable to phase-coding channels.

Related