Feature selection algorithm based on Catastrophe model to improve the performance of regression analysis

In this paper we introduce a new feature selection algorithm to remove the irrelevant or redundant features in the data sets. In this algorithm the importance of a feature is based on its fitting to the Catastrophe model. Akaike information crite- rion value is used for ranking the features in the data set. The proposed algorithm is compared with well-known RELIEF feature selection algorithm. Breast Cancer, Parkinson Telemonitoring data and Slice locality data sets are used to evaluate the model.

Batch-Expansion Training: An Efficient Optimization Paradigm for Machine Learning

We propose Batch-Expansion Training (BET), a framework for running a batch optimizer on a gradually expanding dataset. As opposed to stochastic approaches, batches do not need to be resampled i.i.d. at every iteration, thus making BET more resource efficient in a distributed setting, and when disk-access is constrained. Moreover, BET can be easily paired with most batch optimizers, does not require any parameter-tuning, and compares favorably to existing stochastic and batch methods. We show that when the batch size grows exponentially with the number of outer iterations, BET achieves optimal \tilde{O}(1/\epsilon) data-access convergence rate for strongly convex objectives.

Towards Distributed Machine Learning in Shared Clusters: A Dynamically-Partitioned Approach

Many cluster management systems (CMSs) have been proposed to share a single cluster with multiple distributed computing systems. However, none of the existing approaches can handle distributed machine learning (ML) workloads given the following criteria: high resource utilization, fair resource allocation and low sharing overhead. To solve this problem, we propose a new CMS named Dorm, incorporating a dynamically-partitioned cluster management mechanism and an utilization-fairness optimizer. Specifically, Dorm uses the container-based virtualization technique to partition a cluster, runs one application per partition, and can dynamically resize each partition at application runtime for resource efficiency and fairness. Each application directly launches its tasks on the assigned partition without petitioning for resources frequently, so Dorm imposes flat sharing overhead. Extensive performance evaluations showed that Dorm could simultaneously increase the resource utilization by a factor of up to 2.32, reduce the fairness loss by a factor of up to 1.52, and speed up popular distributed ML applications by a factor of up to 2.72, compared to existing approaches. Dorm’s sharing overhead is less than 5% in most cases.

Robust, Deep and Inductive Anomaly Detection

PCA is a classical statistical technique whose simplicity and maturity has seen it find widespread use as an anomaly detection technique. However, it is limited in this regard by being sensitive to gross perturbations of the input, and by seeking a linear subspace that captures normal behaviour. The first issue has been dealt with by robust PCA, a variant of PCA that explicitly allows for some data points to be arbitrarily corrupted, however, this does not resolve the second issue, and indeed introduces the new issue that one can no longer inductively find anomalies on a test set. This paper addresses both issues in a single model, the robust autoencoder. This method learns a nonlinear subspace that captures the majority of data points, while allowing for some data to have arbitrary corruption. The model is simple to train and leverages recent advances in the optimisation of deep neural networks. Experiments on a range of real-world datasets highlight the model’s effectiveness.

Affect-LM: A Neural Language Model for Customizable Affective Text Generation

Human verbal communication includes affective messages which are conveyed through use of emotionally colored words. There has been a lot of research in this direction but the problem of integrating state-of-the-art neural language models with affective information remains an area ripe for exploration. In this paper, we propose an extension to an LSTM (Long Short-Term Memory) language model for generating conversational text, conditioned on affect categories. Our proposed model, Affect-LM enables us to customize the degree of emotional content in generated sentences through an additional design parameter. Perception studies conducted using Amazon Mechanical Turk show that Affect-LM generates naturally looking emotional sentences without sacrificing grammatical correctness. Affect-LM also learns affect-discriminative word representations, and perplexity experiments show that additional affective information in conversational text can improve language model prediction.

A Review on Deep Learning Techniques Applied to Semantic Segmentation

Image semantic segmentation is more and more being of interest for computer vision and machine learning researchers. Many applications on the rise need accurate and efficient segmentation mechanisms: autonomous driving, indoor navigation, and even virtual or augmented reality systems to name a few. This demand coincides with the rise of deep learning approaches in almost every field or application target related to computer vision, including semantic segmentation or scene understanding. This paper provides a review on deep learning methods for semantic segmentation applied to various application areas. Firstly, we describe the terminology of this field as well as mandatory background concepts. Next, the main datasets and challenges are exposed to help researchers decide which are the ones that best suit their needs and their targets. Then, existing methods are reviewed, highlighting their contributions and their significance in the field. Finally, quantitative results are given for the described methods and the datasets in which they were evaluated, following up with a discussion of the results. At last, we point out a set of promising future works and draw our own conclusions about the state of the art of semantic segmentation using deep learning techniques.

A General Theory for Training Learning Machine

Though the deep learning is pushing the machine learning to a new stage, basic theories of machine learning are still limited. The principle of learning, the role of the a prior knowledge, the role of neuron bias, and the basis for choosing neural transfer function and cost function, etc., are still far from clear. In this paper, we present a general theoretical framework for machine learning. We classify the prior knowledge into common and problem-dependent parts, and consider that the aim of learning is to maximally incorporate them. The principle we suggested for maximizing the former is the design risk minimization principle, while the neural transfer function, the cost function, as well as pretreatment of samples, are endowed with the role for maximizing the latter. The role of the neuron bias is explained from a different angle. We develop a Monte Carlo algorithm to establish the input-output responses, and we control the input-output sensitivity of a learning machine by controlling that of individual neurons. Applications of function approaching and smoothing, pattern recognition and classification, are provided to illustrate how to train general learning machines based on our theory and algorithm. Our method may in addition induce new applications, such as the transductive inference.

Naturalizing a Programming Language via Interactive Learning

Our goal is to create a convenient natural language interface for performing well-specified but complex actions such as analyzing data, manipulating text, and querying databases. However, existing natural language interfaces for such tasks are quite primitive compared to the power one wields with a programming language. To bridge this gap, we start with a core programming language and allow users to ‘naturalize’ the core language incrementally by defining alternative, more natural syntax and increasingly complex concepts in terms of compositions of simpler ones. In a voxel world, we show that a community of users can simultaneously teach a common system a diverse language and use it to build hundreds of complex voxel structures. Over the course of three days, these users went from using only the core language to using the naturalized language in 85.9\% of the last 10K utterances.

Bootstrapping for multivariate linear regression models

The multivariate linear regression model is an important tool for investigating relationships between several response variables and several predictor variables. The primary interest is in inference about the unknown regression coefficient matrix. We propose multivariate bootstrap techniques as a means for making inferences about the unknown regression coefficient matrix. These bootstrapping techniques are extensions of those developed in Freedman (1981), which are only appropriate for univariate responses. Extensions to the multivariate linear regression model are made without proof. We formalize this extension and prove its validity.

Elite Bases Regression: A Real-time Algorithm for Symbolic Regression

Symbolic regression is an important but challenging research topic in data mining. It can detect the underlying mathematical models. Genetic programming (GP) is one of the most popular methods for symbolic regression. However, its convergence speed might be too slow for large scale problems with a large number of variables. This drawback has become a bottleneck in practical applications. In this paper, a new non-evolutionary real-time algorithm for symbolic regression, Elite Bases Regression (EBR), is proposed. EBR generates a set of candidate basis functions coded with parse-matrix in specific mapping rules. Meanwhile, a certain number of elite bases are preserved and updated iteratively according to the correlation coefficients with respect to the target model. The regression model is then spanned by the elite bases. A comparative study between EBR and a recent proposed machine learning method for symbolic regression, Fast Function eXtraction (FFX), are conducted. Numerical results indicate that EBR can solve symbolic regression problems more effectively.

Goodness of fit test under progressive Type-I interval censoring

Perfect divisibility and 2-divisibility

Revisiting wireless network jamming by SIR-based considerations and Multiband Robust Optimization

GUB Covers and Power-Indexed formulations for Wireless Network Design

Multi-Objective Deep Q-Learning with Subsumption Architecture

Select and Permute: An Improved Online Framework for Scheduling to Minimize Weighted Completion Time

A cost-effective isogeometric approach for composite plates based on a stress recovery procedure

Shifting the Phase Transition Threshold for Random Graphs and 2-SAT using Degree Constraints

A hybrid exact-ACO algorithm for the joint scheduling, power and cluster assignment in cooperative wireless networks

Scatteract: Automated extraction of data from scatter plots

Improving Semantic Composition with Offset Inference

SREFI: Synthesis of Realistic Example Face Images

Liquid-liquid transition revealed by quasi-static cooling of an ultra-viscous metallic liquid

Continuous monitoring of $\ell_p$ norms in data streams

A dynamic resource allocation decision model for IT security

Face enumeration on matroid base polytopes

Complexity Analysis of the Parallel Guided Ejection Search for the Pickup and Delivery Problem with Time Windows

Distant Supervision for Topic Classification of Tweets in Curated Streams

On Face Segmentation, Face Swapping, and Face Perception

$A_α$-spectrum of a graph obtained by copies of a rooted graph and applications

Asynchronous Distributed Variational Gaussian Processes

Circumcentering the Douglas–Rachford method

Testing Network Structure Using Relations Between Small Subgraph Probabilities

Proactive Edge Computing in Latency-Constrained Fog Networks

ScaleNet: Guiding Object Proposal Generation in Supermarkets and Beyond

Controllability of Linear Positive Systems: An Alternative Formulation

Convolutional Neural Networks for Facial Expression Recognition

Generalized feedback vertex set problems on bounded-treewidth graphs: chordality is the key to single-exponential parameterized algorithms

Formation of Facets for an Effective Model of Crystal Growth

Deep Learning for Content-Based, Cross-Modal Retrieval of Videos and Music

Estimation for multiplicative models under multinomial sampling

Multiuser Millimeter Wave MIMO Channel Estimation with Hybrid Beamforming

Subspace Tracking Algorithms for Millimeter Wave MIMO Channel Estimation with Hybrid Beamforming

Risk Minimization Framework for Multiple Instance Learning from Positive and Unlabeled Bags

On Poisson approximations for the Ewens sampling formula when the mutation parameter grows with the sample size

Sensitivity analysis for optimal control problems governed by nonlinear evolution inclusions

Quantum algorithm for tree size estimation, with applications to backtracking and 2-player games

Joint Computation and Communication Cooperation for Mobile Edge Computing

Lexical Features in Coreference Resolution: To be Used With Caution

A general private information retrieval scheme for MDS coded databases with colluding servers

A new simple and powerful normality test for progressively Type-II censored data

Faster and Non-ergodic O(1/K) Stochastic Alternating Direction Method of Multipliers

Geometric Matrix Completion with Recurrent Multi-Graph Neural Networks

Simulation Theorems via Pseudorandom Properties

Adaptive Cuckoo Filters

Deep Learning based Isolated Arabic Scene Character Recognition

The role of cooperation in spatially explicit economical systems

Deep Learning for Medical Image Processing: Overview, Challenges and Future

The Value of Sharing Intermittent Spectrum

Extreme-Scale Block-Structured Adaptive Mesh Refinement

Sarcasm SIGN: Interpreting Sarcasm with Sentiment Based Monolingual Machine Translation

A Decomposition Algorithm to Solve the Multi-Hop Peer-to-Peer Ride-Matching Problem

Ranking with Fairness Constraints

Medical Text Classification using Convolutional Neural Networks

On the Two-View Geometry of Unsynchronized Cameras

Positive definite functions on Coxeter groups with applications to operator spaces and noncommutative probability

A hybrid primal heuristic for Robust Multiperiod Network Design

Testing from One Sample: Is the casino really using a riffle shuffle?

Deep Multitask Learning for Semantic Dependency Parsing

On the Trade-Off between Computational Load and Reliability for Network Function Virtualization

Relation between the skew-rank of an oriented graph and the independence number of its underlying graph

Argument Mining with Structured SVMs and RNNs

Algorithms for Covering Multiple Barriers

Controlling the Kelvin Force: Basic Strategies and Applications to Magnetic Drug Targeting

Exploring Symmetry in Wireless Propagation Channels

Learning to Skim Text

Moments of inverses of $(m,n,β)$-Laguerre matrices

Deep Keyphrase Generation

Misspecified Linear Bandits

Time-Contrastive Networks: Self-Supervised Learning from Multi-View Observation

An exact algorithm exhibiting RS-RSB/easy-hard correspondence for the maximum independent set problem

Opinion evolution in time-varying social influence networks with prejudiced agents

On Budget-Feasible Mechanism Design for Symmetric Submodular Objectives

Residual Attention Network for Image Classification

Multiple Source Dual Fault Tolerant BFS Trees

Midpoint distribution of directed polymers in the stationary regime: exact result through linear response

Learning weakly supervised multimodal phoneme embeddings

Neural Machine Translation via Binary Code Prediction

Partially separable convexly-constrained optimization with non-Lipschitzian singularities and its complexity

Gomory-Hu trees of infinite graphs with finite total weight

Off-the-grid Two-Dimensional Line Spectral Estimation With Prior Information

Second-order Temporal Pooling for Action Recognition

Reflected Discontinuous Backward Doubly Stochastic Differential Equation With Poisson Jumps

A New Fully Polynomial Time Approximation Scheme for the Interval Subset Sum Problem

Analyzing Large-Scale Multiuser Molecular Communication via 3D Stochastic Geometry

Reconstruction of the core convex topology and its applications in vector optimization and convex analysis

A* CCG Parsing with a Supertag and Dependency Factored Model

A stroll in the jungle of error bounds

Population Seeding Techniques for Rolling Horizon Evolution in General Video Game Playing

On the sharp upper and lower bounds of multiplicative Zagreb indices of graphs with connectivity at most k

General Video Game AI: Learning from Screen Capture

3D Reconstruction of the Magnetic Vector Potential using Model Based Iterative Reconstruction

A Note on the Forward-Douglas–Rachford Splitting for Monotone Inclusion and Convex Optimization

Superadditivity of the classical capacity with limited entanglement assistance

Translating Neuralese

Coherent multiple-antenna block-fading channels at finite blocklength

Proxy Templates for Inverse Compositional Photometric Bundle Adjustment

Differentiable Scheduled Sampling for Credit Assignment

Skeleton Key: Image Captioning by Skeleton-Attribute Decomposition

Preconditioned warm-started Newton-Krylov methods for MPC with discontinuous control

Exploring compression techniques for ROOT IO

Overlapping Variable Clustering with Statistical Guarantees

A Match in Time Saves Nine: Deterministic Online Matching With Delays

Coexistence and extinction for stochastic Kolmogorov systems

Learning to Create and Reuse Words in Open-Vocabulary Neural Language Modeling

Extended ensemble Kalman filters for high-dimensional hierarchical state-space models

Time-Homogeneous Parabolic Wick-Anderson Model in One Space Dimension: Regularity of Solution

On One Property of Tikhonov Regularization Algorithm

Dependent Session Types

Data-adaptive statistics for multiple hypothesis testing in high-dimensional settings

New Two-Stage Automorphism Group Decoders for Cyclic Codes in the Erasure Channel

Binary tree sampling from discrete distributions

Golden-Coded Index Coding

A new SVD approach to optimal topic estimation

Model-based Iterative Restoration for Binary Document Image Compression with Dictionary Learning

Note on the union-closed sets conjecture

Image Compressive Sensing Recovery Using Group Sparse Coding via Non-convex Weighted Lp Minimization

On Robust Tie-line Scheduling in Multi-Area Power Systems

Energy Efficient User Association and Power Allocation in Millimeter Wave Based Ultra Dense Networks with Energy Harvesting Base Stations

Network Slicing Based 5G and Future Mobile Networks: Mobility, Resource Management, and Challenges

Dual equivalence graphs II: Transformations on locally Schur positive graphs

Fast and Accurate Neural Word Segmentation for Chinese

Probabilistic Vehicle Trajectory Prediction over Occupancy Grid Map via Recurrent Neural Network

Using Global Constraints and Reranking to Improve Cognates Detection

A new lower bound for the chromatic number of general Kneser hypergraphs

k-FFNN: A priori knowledge infused Feed-forward Neural Networks

Non-Convex Weighted Schatten p-Norm Minimization based ADMM Framework for Image Restoration

$H(X)$ vs. $H(f(X))$

A Dual Sparse Decomposition Method for Image Denoising

Rerouting flows when links fail

Diffusion geometry unravels the emergence of functional clusters in collective phenomena

Evaluating and Modelling Hanabi-Playing Agents

Camera Pose Filtering with Local Regression Geodesicsc on the Riemannian Manifold of Dual Quaternions

Selective Encoding for Abstractive Sentence Summarization

Analysis of Vanilla Rolling Horizon Evolution Parameters in General Video Game Playing

Exploiting Multi-layer Graph Factorization for Multi-attributed Graph Matching

Target Oriented High Resolution SAR Image Formation via Semantic Information Guided Regularizations

Fast systematic encoding of multiplicity codes

Unified Framework for Automated Person Re-identification and Camera Network Topology Inference in Camera Networks

An efficient methodology for the analysis and modeling of computer experiments with large number of inputs

Robust Incremental Neural Semantic Graph Parsing

Equivalence classes of mesh patterns with a dominating pattern

Cohen-Macaulay binomial edge ideals of cactus graphs

T-joins in infinite graphs as edge-disjoint system of paths matching the vertices in $ T $

Packing tree degree sequences

Regular Decomposition: an information and graph theoretic approach to stochastic block models

Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets

An Analysis of Action Recognition Datasets for Language and Vision Tasks

Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddings

Beeping a Maximal Independent Set Fast

Lexically Constrained Decoding for Sequence Generation Using Grid Beam Search

An Aposteriorical Clusterability Criterion for $k$-Means and Simplicity of Clustering

Bayesian radiocarbon modelling for beginners

Dense 3D Facial Reconstruction from a Single Depth Image in Unconstrained Environment

Bootstrap percolation in random $k$-uniform hypergraphs

Found in Translation: Reconstructing Phylogenetic Language Trees from Translations

A Neural Network model with Bidirectional Whitening

Asymptotic multivariate expectiles

Semi-supervised Multitask Learning for Sequence Labeling

Watset: Automatic Induction of Synsets from a Graph of Synonyms

On the radius and the attachment number of tetravalent half-arc-transitive graphs

Body Joint guided 3D Deep Convolutional Descriptors for Action Recognition

Robust Secure Transmission of Using Main-Lobe-Integration Based Leakage Beaforming in Directional Modulation MU-MIMO Systems

Z2Z4Z8-Cyclic Codes

Monocular Visual Odometry with a Rolling Shutter Camera

Symmetry properties of generalized graph truncations

Scattering Theory of Efficient Quantum Transport across Finite Networks

Exploring the Evolution of Node Neighborhoods in Dynamic Networks

A Simple Proof of Fast Polarization

Stochastic Constraint Programming as Reinforcement Learning

Reinforcement Learning Based Dynamic Selection of Auxiliary Objectives with Preserving of the Best Found Solution

Rainbow spanning trees in properly coloured complete graphs

What is the Essence of a Claim? Cross-Domain Claim Identification

Random Čech Complexes on Riemannian Manifolds

The Structure of One Weight Linear and Cyclic Codes Over Z2^r x (Z2+uZ2)^s

Coloring dense digraphs

Turing at SemEval-2017 Task 8: Sequential Approach to Rumour Stance Classification with Branch-LSTM

Entropic Trace Estimates for Log Determinants

Learning from Comparisons and Choices

Penalized Estimation in Additive Regression with High-Dimensional Data

On the exactness of Lasserre relaxations for compact convex basic closed semialgebraic sets

Scaling Reliably: Improving the Scalability of the Erlang Distributed Actor Platform

Automatic Liver Lesion Segmentation Using A Deep Convolutional Neural Network Method

Supervised Adversarial Networks for Image Saliency Detection

Fast PET reconstruction using Multi-scale Fully Convolutional Neural Networks

Alternation acyclic tournaments

Recognizing Union-Find trees built up using union-by-rank strategy is NP-complete

A finite state projection algorithm for the stationary solution of the chemical master equation

Advanced Multilevel Monte Carlo Methods

Finding, Hitting and Packing Cycles in Subexponential Time on Unit Disk Graphs

Optimal algorithms for hitting (topological) minors on graphs of bounded treewidth

Analytical and simplified models for dynamic analysis of sort skew ridges under moving loads

Joint Modeling of Text and Acoustic-Prosodic Cues for Neural Parsing

Stochastic representation of tau functions of Korteweg-de Vries equation

Measuring the Accuracy of Object Detectors and Trackers

A Real-time Hand Gesture Recognition and Human-Computer Interaction System

Enueration of empty lattice $4$-simplices of width three or more

Relaxations of GF$(4)$-representable matroids

Computational Notions of Quantum Min-Entropy

On 1-uniqueness and dense critical graphs for tree-depth

Sampling Biased Monotonic Surfaces using Exponential Metrics

Accurate Optical Flow via Direct Cost Volume Processing

A Trie-Structured Bayesian Model for Unsupervised Morphological Segmentation

Detecting and Recognizing Human-Object Interactions

Time-Varying Convex Optimization via Time-Varying Averaged Operators

Distribution of suprema for generalized risk processes

Perches, Post-holes and Grids

Investigation of nonlinear effects in glassy matter using dielectric methods

A Non-Gaussian, Nonparametric Structure for Gene-Gene and Gene-Environment Interactions in Case-Control Studies Based on Hierarchies of Dirichlet Processes

Metropolis-Hastings Algorithms for Estimating Betweenness Centrality in Large Networks

A Saddle Point Approach to Structured Low-rank Matrix Learning in Large-scale Applications

Consistency of community detection in multi-layer networks using spectral and matrix factorization methods

Accelerated Nearest Neighbor Search with Quick ADC

Trend and Variable-Phase Seasonality Estimation from Functional Data

The Competition of Roughness and Curvature in Area-Constrained Polymer Models