vix.ing · top · new · best · stats

Convolutional Neural Networks In Convolution

2018/10/09 by Xiaobo Huang, Huang, Xiaobo
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Generative Adversarial Networks and Image Synthesis #cs.CV #cs.LG #cs.NE

paper · pdf · doi:10.48550/arxiv.1810.03946

9 pages, 2 figures

arxiv created 2018/10/09 · arxiv updated 2018/10/10

Abstract

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the Network In Network(NIN), aiming for higher accuracy without input data transmutation. In our architecture, namely "CNN In Convolution"(CNNIC), a small CNN, instead of the original generalized liner model(GLM) based filters, is convoluted as kernel on the original image, serving as feature extracting layer of this networks. And further classifications are then carried out by a global average pooling layer and a softmax layer. Dropout and orthonormal initialization are applied to overcome training difficulties including slow convergence and over-fitting. Persuasive classification performance is demonstrated on MNIST.

Citations

Related