#### Frame-Recurrent Video Super-Resolution

Convolutional Neural Network image motion RNN video

Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from multiple low-resolution (LR) frames to generate high-quality images. Current state-of-the-art methods process a batch of LR frames to generate…

#### Characterizing Types of Convolution in Deep Convolutional Recurrent Neural Networks for Robust Speech Emotion Recognition

audio Convolutional Neural Network DNN RNN speech

Deep convolutional neural networks are being actively investigated in a wide range of speech and audio processing applications including speech recognition, audio event detection and computational paralinguistics, owing to their ability to reduce factors of variations, for learning from speech. How…

#### Cost-Sensitive Convolution based Neural Networks for Imbalanced Time-Series Classification

Convolutional Neural Network DNN

Some deep convolutional neural networks were proposed for time-series classification and class imbalanced problems. However, those models performed degraded and even failed to recognize the minority class of an imbalanced temporal sequences dataset. Minority samples would bring troubles for tempora…

#### Deep learning is a good steganalysis tool when embedding key is reused for different images, even if there is a cover source-mismatch

Convolutional Neural Network DNN image

Since the BOSS competition, in 2010, most steganalysis approaches use a learning methodology involving two steps: feature extraction, such as the Rich Models (RM), for the image representation, and use of the Ensemble Classifier (EC) for the learning step. In 2015, Qian et al. have shown that the u…

#### A guide to convolution arithmetic for deep learning

Convolutional Neural Network DNN

We introduce a guide to help deep learning practitioners understand and manipulate convolutional neural network architectures. The guide clarifies the relationship between various properties (input shape, kernel shape, zero padding, strides and output shape) of convolutional, pooling and transposed…

#### Parametric Exponential Linear Unit for Deep Convolutional Neural Networks

Convolutional Neural Network IMAGENET MNIST

Object recognition is an important task for improving the ability of visual systems to perform complex scene understanding. Recently, the Exponential Linear Unit (ELU) has been proposed as a key component for managing bias shift in Convolutional Neural Networks (CNNs), but defines a parameter that …

#### Generative Models for Stochastic Processes Using Convolutional Neural Networks

The present paper aims to demonstrate the usage of Convolutional Neural Networks as a generative model for stochastic processes, enabling researchers from a wide range of fields (such as quantitative finance and physics) to develop a general tool for forecasts and simulations without the need to id…

#### Lets keep it simple, Using simple architectures to outperform deeper and more complex architectures

ads CIFAR Convolutional Neural Network MNIST

Major winning Convolutional Neural Networks (CNNs), such as AlexNet, VGGNet, ResNet, GoogleNet, include tens to hundreds of millions of parameters, which impose considerable computation and memory overhead. This limits their practical use for training, optimization and memory efficiency. On the con…

#### Exploring Asymmetric Encoder-Decoder Structure for Context-based Sentence Representation Learning

Convolutional Neural Network language RNN

Context information plays an important role in human language understanding, and it is also useful for machines to learn vector representations of language. In this paper, we explore an asymmetric encoder-decoder structure for unsupervised context-based sentence representation learning. As a result…

#### Introspective Classification with Convolutional Nets

Bayes CIFAR Convolutional Neural Network MNIST

We propose introspective convolutional networks (ICN) that emphasize the importance of having convolutional neural networks empowered with generative capabilities. We employ a reclassification-by-synthesis algorithm to perform training using a formulation stemmed from the Bayes theory. Our ICN trie…

#### DENSER: Deep Evolutionary Network Structured Representation

CIFAR Convolutional Neural Network image

Deep Evolutionary Network Structured Representation (DENSER) is a novel approach to automatically design Artificial Neural Networks (ANNs) using Evolutionary Computation (EC). The algorithm not only searches for the best network topology (e.g., number of layers, type of layers), but also tunes hype…

#### Predicting Shot Making in Basketball Learnt from Adversarial Multiagent Trajectories

Convolutional Neural Network DNN gradient image

In this paper, we predict the likelihood of a player making a shot in basketball from multiagent trajectories. Previous approaches to similar problems center on hand-crafting features to capture domain specific knowledge. Although intuitive, recent work in deep learning has shown this approach is p…

#### Deep Architectures for Automated Seizure Detection in Scalp EEGs

Convolutional Neural Network DNN health RNN

Automated seizure detection using clinical electroencephalograms is a challenging machine learning problem because the multichannel signal often has an extremely low signal to noise ratio. Events of interest such as seizures are easily confused with signal artifacts (e.g, eye movements) or benign v…

#### Learning More Universal Representations for Transfer-Learning

Transfer learning is commonly used to address the problem of the prohibitive need in annotated data when one want to classify visual content with a Convolutional Neural Network (CNN). We address the problem of the universality of the CNN-based representation of images in such a context. The state-o…

#### CNN Is All You Need

audio BLEU Convolutional Neural Network DNN image LSTM RNN text

The Convolution Neural Network (CNN) has demonstrated the unique advantage in audio, image and text learning; recently it has also challenged Recurrent Neural Networks (RNNs) with long short-term memory cells (LSTM) in sequence-to-sequence learning, since the computations involved in CNN are easily…

#### Building Robust Deep Neural Networks for Road Sign Detection

car Convolutional Neural Network DNN gradient

Deep Neural Networks are built to generalize outside of training set in mind by using techniques such as regularization, early stopping and dropout. But considerations to make them more resilient to adversarial examples are rarely taken. As deep neural networks become more prevalent in mission-crit…

#### Data-Driven Sparse Structure Selection for Deep Neural Networks

Convolutional Neural Network DNN gradient

Deep convolutional neural networks have liberated its extraordinary power on various tasks. However, it is still very challenging to deploy state-of-the-art models into real-world applications due to their high computational complexity. How can we design a compact and effective network without mass…

#### Dynamic Weight Alignment for Convolutional Neural Networks

In this paper, we propose a method of improving Convolutional Neural Networks (CNN) by determining the optimal alignment of weights and inputs using dynamic programming. Conventional CNNs convolve learnable shared weights, or filters, across the input data. The filters use a linear matching of weig…

#### Automated flow for compressing convolution neural networks for efficient edge-computation with FPGA

Convolutional Neural Network image

Deep convolutional neural networks (CNN) based solutions are the current state- of-the-art for computer vision tasks. Due to the large size of these models, they are typically run on clusters of CPUs or GPUs. However, power requirements and cost budgets can be a major hindrance in adoption of CNN f…

#### “Zero-Shot” Super-Resolution using Deep Internal Learning

Convolutional Neural Network DNN image

Deep Learning has led to a dramatic leap in Super-Resolution (SR) performance in the past few years. However, being supervised, these SR methods are restricted to specific training data, where the acquisition of the low-resolution (LR) images from their high-resolution (HR) counterparts is predeter…

#### Classification Driven Dynamic Image Enhancement

Convolutional Neural Network image

Convolutional neural networks rely on image texture and structure to serve as discriminative features to classify the image content. Image enhancement techniques can be used as preprocessing steps to help improve the overall image quality and in turn improve the overall effectiveness of a CNN. Exis…

#### HDR image reconstruction from a single exposure using deep CNNs

Convolutional Neural Network DNN image

Camera sensors can only capture a limited range of luminance simultaneously, and in order to create high dynamic range (HDR) images a set of different exposures are typically combined. In this paper we address the problem of predicting information that have been lost in saturated image areas, in or…

#### Unified Backpropagation for Multi-Objective Deep Learning

Convolutional Neural Network DNN Support Vector Machine

A common practice in most of deep convolutional neural architectures is to employ fully-connected layers followed by Softmax activation to minimize cross-entropy loss for the sake of classification. Recent studies show that substitution or addition of the Softmax objective to the cost functions of …

#### Multipartite Pooling for Deep Convolutional Neural Networks

We propose a novel pooling strategy that learns how to adaptively rank deep convolutional features for selecting more informative representations. To this end, we exploit discriminative analysis to project the features onto a space spanned by the number of classes in the dataset under study. This m…

#### Graph Convolution: A High-Order and Adaptive Approach

In this paper, we presented a novel convolutional neural network framework for graph modeling, with the introduction of two new modules specially designed for graph-structured data: the $k$-th order convolution operator and the adaptive filtering module. Importantly, our framework of High-order and…