Adaptive convolution kernel for artificial neural networks
Künye
Tek, F. B., Çam, İ. & Karlı, D. (2021). Adaptive convolution kernel for artificial neural networks. Journal of Visual Communication and Image Representation, 75, 1-11.doi:10.1016/j.jvcir.2020.103015Özet
Many deep neural networks are built by using stacked convolutional layers of fixed and single size (often 3 × 3) kernels. This paper describes a method for learning the size of convolutional kernels to provide varying size kernels in a single layer. The method utilizes a differentiable, and therefore backpropagation-trainable Gaussian envelope which can grow or shrink in a base grid. Our experiments compared the proposed adaptive layers to ordinary convolution layers in a simple two-layer network, a deeper residual network, and a U-Net architecture. The results in the popular image classification datasets such as MNIST, MNIST-CLUTTERED, CIFAR-10, Fashion, and ‘‘Faces in the Wild’’ showed that the adaptive kernels can provide statistically significant improvements on ordinary convolution kernels. A segmentation experiment in the Oxford-Pets dataset demonstrated that replacing ordinary convolution layers in a U-shaped network with 7 × 7 adaptive layers can improve its learning performance and ability to generalize.
Kaynak
Journal of Visual Communication and Image RepresentationCilt
75Aşağıdaki lisans dosyası bu öğe ile ilişkilidir:
İlgili Öğeler
Başlık, yazar, küratör ve konuya göre gösterilen ilgili öğeler.
-
Graph convolutional network based virus-human protein-protein interaction prediction for novel viruses
Koca, Mehmet Burak; Nourani, Esmaeil; Abbasoğlu, Ferda; Karadeniz, İlknur; Sevilgen, Fatih Erdoğan (Elsevier Ltd, 2022-08-13)Computational identification of human-virus protein-protein interactions (PHIs) is a worthwhile step towards understanding infection mechanisms. Analysis of the PHI networks is important for the determination of path-ogenic ... -
Convolutional attention network for MRI-based Alzheimer's disease classification and its interpretability analysis
Türkan, Yasemin; Tek, Faik Boray (IEEE, 2021-09-17)Neuroimaging techniques, such as Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET), help to identify Alzheimer's disease (AD). These techniques generate large-scale, high-dimensional, multimodal ... -
Animal sound classification using a convolutional neural network
Şaşmaz, Emre; Tek, Faik Boray (IEEE, 2018-12-06)In this paper, we investigate the problem of animal sound classification using deep learning and propose a system based on convolutional neural network architecture. As the input to the network, sound files were preprocessed ...