2019/10/18 by Rudrasis Chakraborty, Chakraborty, Rudrasis, Yifei Xing +4
Computer Science · Neuroscience · Psychology · #Cognitive Science and Education Research #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Innovative Teaching and Learning Methods #cs.CV
paper · pdf · doi:10.48550/arxiv.1910.11334
12 pages, accepted to TNNLS journal
openalex publication_date 2019/10/18 · arxiv created 2020/11/06 · arxiv updated 2020/11/10 · openalex created_date 2020/11/23 · openalex updated_date 2026/07/28
Complex-valued data is ubiquitous in signal and image processing applications, and complex-valued representations in deep learning have appealing theoretical properties. While these aspects have long been recognized, complex-valued deep learning continues to lag far behind its real-valued counterpart. We propose a principled geometric approach to complex-valued deep learning. Complex-valued data could often be subject to arbitrary complex-valued scaling; as a result, real and imaginary components could co-vary. Instead of treating complex values as two independent channels of real values, we recognize their underlying geometry: We model the space of complex numbers as a product manifold of non-zero scaling and planar rotations. Arbitrary complex-valued scaling naturally becomes a group of transitive actions on this manifold. We propose to extend the property instead of the form of real-valued functions to the complex domain. We define convolution as weighted Fréchet mean on the manifold that is equivariant to the group of scaling/rotation actions, and define distance transform on the manifold that is invariant to the action group. The manifold perspective also allows us to define nonlinear activation functions such as tangent ReLU and G-transport, as well as residual connections on the manifold-valued data. We dub our model SurReal, as our experiments on MSTAR and RadioML deliver high performance with only a fractional size of real-valued and complex-valued baseline models.