Cluster validation by measurement of clustering characteristics relevant to the user

There are many cluster analysis methods that can produce quite different clusterings on the same dataset. Cluster validation is about the evaluation of the quality of a clustering; ‘relative cluster validation’ is about using such criteria to compare clusterings. This can be used to select one of a set of clusterings from different methods, or from the same method ran with different parameters such as different numbers of clusters. There are many cluster validation indexes in the literature. Most of them attempt to measure the overall quality of a clustering by a single number, but this can be inappropriate. There are various different characteristics of a clustering that can be relevant in practice, depending on the aim of clustering, such as low within-cluster distances and high between-cluster separation. In this paper, a number of validation criteria will be introduced that refer to different desirable characteristics of a clustering, and that characterise a clustering in a multidimensional way. In specific applications the user may be interested in some of these criteria rather than others. A focus of the paper is on methodology to standardise the different characteristics so that users can aggregate them in a suitable way specifying weights for the various criteria that are relevant in the clustering application at hand.

Fluid Communities: A Community Detection Algorithm

Community detection algorithms are a family of unsupervised graph mining algorithms which group vertices into clusters (i.e., communities). These algorithms provide insight into both the structure of a network and the entities that compose it. In this paper we propose a novel community detection algorithm based on the simple idea of fluids interacting in an environment, expanding and contracting. The fluid communities algorithm is based on the efficient propagation method, which makes it very competitive in computational cost and scalability. At the same time, the quality of its results is close to that of current state-of-the-art community detection algorithms. An interesting novelty of the fluid communities algorithm is that it is the first propagation-based method capable of identifying a variable number of communities within a graph.

Adversarial Transformation Networks: Learning to Generate Adversarial Examples

Multiple different approaches of generating adversarial examples have been proposed to attack deep neural networks. These approaches involve either directly computing gradients with respect to the image pixels, or directly solving an optimization on the image pixels. In this work, we present a fundamentally new method for generating adversarial examples that is fast to execute and provides exceptional diversity of output. We efficiently train feed-forward neural networks in a self-supervised manner to generate adversarial examples against a target network or set of networks. We call such a network an Adversarial Transformation Network (ATN). ATNs are trained to generate adversarial examples that minimally modify the classifier’s outputs given the original input, while constraining the new classification to match an adversarial target class. We present methods to train ATNs and analyze their effectiveness targeting a variety of MNIST classifiers as well as the latest state-of-the-art ImageNet classifier Inception ResNet v2.

Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputs

We present a deep convolutional decoder architecture that can generate volumetric 3D outputs in a compute- and memory-efficient manner by using an octree representation. The network learns to predict both the structure of the octree, and the occupancy values of individual cells. This makes it a particularly valuable technique for generating 3D shapes. In contrast to standard decoders acting on regular voxel grids, the architecture does not have cubic complexity. This allows representing much higher resolution outputs with a limited memory budget. We demonstrate this in several application domains, including 3D convolutional autoencoders, generation of objects and whole scenes from high-level representations, and shape from a single image.

Experimental Analysis of Design Elements of Scalarizing Functions-based Multiobjective Evolutionary Algorithms

In this paper we systematically study the importance, i.e., the influence on performance, of the main design elements that differentiate scalarizing functions-based multiobjective evolutionary algorithms (MOEAs). This class of MOEAs includes Multiobjecitve Genetic Local Search (MOGLS) and Multiobjective Evolutionary Algorithm Based on Decomposition (MOEA/D) and proved to be very successful in multiple computational experiments and practical applications. The two algorithms share the same common structure and differ only in two main aspects. Using three different multiobjective combinatorial optimization problems, i.e., the multiobjective symmetric traveling salesperson problem, the traveling salesperson problem with profits, and the multiobjective set covering problem, we show that the main differentiating design element is the mechanism for parent selection, while the selection of weight vectors, either random or uniformly distributed, is practically negligible if the number of uniform weight vectors is sufficiently large.

Simulated Data Experiments for Time Series Classification Part 1: Accuracy Comparison with Default Settings

There are now a broad range of time series classification (TSC) algorithms designed to exploit different representations of the data. These have been evaluated on a range of problems hosted at the UCR-UEA TSC Archive (, and there have been extensive comparative studies. However, our understanding of why one algorithm outperforms another is still anecdotal at best. This series of experiments is meant to help provide insights into what sort of discriminatory features in the data lead one set of algorithms that exploit a particular representation to be better than other algorithms. We categorise five different feature spaces exploited by TSC algorithms then design data simulators to generate randomised data from each representation. We describe what results we expected from each class of algorithm and data representation, then observe whether these prior beliefs are supported by the experimental evidence. We provide an open source implementation of all the simulators to allow for the controlled testing of hypotheses relating to classifier performance on different data representations. We identify many surprising results that confounded our expectations, and use these results to highlight how an over simplified view of classifier structure can often lead to erroneous prior beliefs. We believe ensembling can often overcome prior bias, and our results support the belief by showing that the ensemble approach adopted by the Hierarchical Collective of Transform based Ensembles (HIVE-COTE) is significantly better than the alternatives when the data representation is unknown, and is significantly better than, or not significantly significantly better than, or not significantly worse than, the best other approach on three out of five of the individual simulators.

A Nonparametric Bayesian Clustering to Discover Latent Covariance Structure of Multiple Time Series

Analyzing time series data is important to predict future events and changes in finance, manufacturing and administrative decisions. Gaussian processes (GPs) solve regression and classification problems by choosing appropriate kernels capturing covariance structure of data. In time series analysis, GP based regression methods recently demonstrate competitive performance by decomposing temporal covariance structure. Such covariance structure decomposition allows exploiting shared parameters over a set of multiple but selected time series. In this paper, we propose an efficient variational inference algorithm for nonparametric clustering over multiple GP covariance structures. We handle multiple time series by placing an Indian Buffet Process (IBP) prior on the presence of the additive shared kernels. We propose a new variational inference algorithm to learn the nonparametric Bayesian models for the clustering and regression problems. Experiments are conducted on both synthetic data sets and real world data sets, showing promising results in term of structure discoveries. In addition, our model learns GP kernels faster but still preserves a good predictive performance.

Early Stopping without a Validation Set

Early stopping is a widely used technique to prevent poor generalization performance when training an over-expressive model by means of gradient-based optimization. To find a good point to halt the optimizer, a common practice is to split the dataset into a training and a smaller validation set to obtain an ongoing estimate of the generalization performance. In this paper we propose a novel early stopping criterion which is based on fast-to-compute, local statistics of the computed gradients and entirely removes the need for a held-out validation set. Our experiments show that this is a viable approach in the setting of least-squares and logistic regression as well as neural networks.

Universal Reasoning, Rational Argumentation and Human-Machine Interaction

Classical higher-order logic, when utilized as a meta-logic in which various other (classical and non-classical) logics can be shallowly embedded, is well suited for realising a universal logic reasoning approach. Universal logic reasoning in turn, as envisioned already by Leibniz, may support the rigorous formalisation and deep logical analysis of rational arguments within machines. A respective universal logic reasoning framework is described and a range of exemplary applications are discussed. In the future, universal logic reasoning in combination with appropriate, controlled forms of rational argumentation may serve as a communication layer between humans and intelligent machines.

An Analysis of Visual Question Answering Algorithms

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are evaluated on them. As a result, evaluation scores are inflated and predominantly determined by answering easier questions, making it difficult to compare different methods. In this paper, we analyze existing VQA algorithms using a new dataset. It contains over 1.6 million questions organized into 12 different categories. We also introduce questions that are meaningless for a given image to force a VQA system to reason about image content. We propose new evaluation schemes that compensate for over-represented question-types and make it easier to study the strengths and weaknesses of algorithms. We analyze the performance of both baseline and state-of-the-art VQA models, including multi-modal compact bilinear pooling (MCB), neural module networks, and recurrent answering units. Our experiments establish how attention helps certain categories more than others, determine which models work better than others, and explain how simple models (e.g. MLP) can surpass more complex models (MCB) by simply learning to answer large, easy question categories.

StyleBank: An Explicit Representation for Neural Image Style Transfer

Coherent Online Video Style Transfer

Adversarial Source Identification Game with Corrupted Training

Discriminative Transfer Learning for General Image Restoration

AdiosStMan: Parallelizing Casacore Table Data System Using Adaptive IO System

New algorithms for the Minimum Coloring Cut Problem

Goal-Driven Dynamics Learning via Bayesian Optimization

Critical properties of the contact process with quenched dilution

Redesigning OP2 Compiler to Use HPX Runtime Asynchronous Techniques

A Unified 2D/3D Large Scale Software Environment for Nonlinear Inverse Problems

Band depths based on multiple time instances

Online Market Intermediation

Radial Subgradient Descent

Femoral ROIs and Entropy for Texture-based Detection of Osteoarthritis from High-Resolution Knee Radiographs

On the Performance of Millimeter Wave-based RF-FSO Multi-hop and Mesh Networks

Most Rigid Representations and Cayley index

Massive-scale estimation of exponential-family random graph models with local dependence

Rabi noise spectroscopy of individual two-level tunneling defects

Implementing Monte Carlo Tests with P-value Buckets

Adaptive Simulation-based Training of AI Decision-makers using Bayesian Optimization

On Data Flow Management: the Multilevel Analysis of Data Center Total Cost

Algorithmic interpretations of fractal dimension

Preserving Stabilization while Practically Bounding State Space

Iterative Noise Injection for Scalable Imitation Learning

Optimizing the fractional power in a model with stochastic PDE constraints

Local Finiteness of Infinite Neighbor Complexes

Localization of fermions in coupled chains with identical disorder

Semidefinite Programming Approach for the Quadratic Assignment Problem with a Sparse Graph

Exact enumeration of self-avoiding walks on BCC and FCC lattices

Graph Regularized Tensor Sparse Coding for Image Representation

Useful redundancy in parameter and time delay estimation for continuous-time models

An analysis of the SPARSEVA estimate for the finite sample data case

A Note on Jing and Li’s Type B Quasischur Functions

Index coding with erroneous side information

Learning and inference in knowledge-based probabilistic model for medical diagnosis

Ensembles of Deep LSTM Learners for Activity Recognition using Wearables

Parameter estimation for fractional Ornstein-Uhlenbeck processes of general Hurst parameter

Distributed Average Tracking of Heterogeneous Physical Second-order Agents With No Input Signals Constraint

More on the $k$-color connection number of a graph

Robust Guided Image Filtering

Exact computation of GMM estimators for instrumental variable quantile regression models

Elliptic Harnack inequalities for symmetric non-local Dirichlet forms

Factoring Exogenous State for Model-Free Monte Carlo

Fast Optimization of Wildfire Suppression Policies with SMAC

Optimal Impulse Control of a Simple Reparable System in a Nonreflexive Banach Space

Mixture of Counting CNNs: Adaptive Integration of CNNs Specialized to Specific Appearance for Crowd Counting

A Fair Power Allocation Approach to NOMA in Multi-user SISO Systems

Solving Non-parametric Inverse Problem in Continuous Markov Random Field using Loopy Belief Propagation

This Just In: Fake News Packs a Lot in Title, Uses Simpler, Repetitive Content in Text Body, More Similar to Satire than Real News

Diving Deep into Clickbaits: Who Use Them to What Extents in Which Topics with What Effects?

On the Falk invariant of signed graphic arrangements

The Cramér-Rao inequality on singular statistical models I

Equilibrium for Time-Inconsistent Stochastic Linear–Quadratic Control under Constraint

Edge-matching Problems with Rotations

Gibbs measures based on 1D (an)harmonic oscillators as mean-field limits

On the longest gap between power-rate arrivals

Weak, Strong and Linear Convergence of a Double-Layer Fixed Point Algorithm

Biased polls and the psychology of voter indecisiveness

Explicit expression for the stationary distribution of reflected brownian motion in a wedge

Out-of-time-order correlators in quantum mechanics

Evaluation of Classifiers for Image Segmentation: Applications for Eucalypt Forest Inventory

A practical approach to dialogue response generation in closed domains

Kinetics of the Crystalline Nuclei Growth in Glassy Systems

SEGAN: Speech Enhancement Generative Adversarial Network

Learned Spectral Super-Resolution

Adversarial Image Perturbation for Privacy Protection — A Game Theory Perspective

Index of Environmental Awareness in Russia – MIMIC Approaches for Different Economic Situations

Robust Depth-based Person Re-identification

Convergence of the Forward-Backward Algorithm: Beyond the Worst Case with the Help of Geometry

Metastable Markov chains

Nonequilibrium Kosterlitz-Thouless Transition in a Three-Dimensional Driven Disordered System

Locally Preserving Projection on Symmetric Positive Definite Matrix Lie Group

A Note on Matchings Constructed during Edmonds’ Weighted Perfect Matching Algorithm

L2-constrained Softmax Loss for Discriminative Face Verification

Partially Observable Risk-Sensitive Stopping Problems in Discrete Time

Mining Best Closed Itemsets for Projection-antimonotonic Constraints in Polynomial Time

Existence of a critical layer thickness in PS/PMMA nanolayered films

Existence and Continuity of Differential Entropy for a Class of Distributions

Is This a Joke? Detecting Humor in Spanish Tweets

Objects as context for part detection

A Bayesian nonparametric approach to log-concave density estimation

Routing in Polygons with Holes

How Compressible are Sparse Innovation Processes?

Palgol: A High-Level DSL for Vertex-Centric Graph Processing with Remote Data Access

Variations on the sum-product problem II

Important New Developments in Arabographic Optical Character Recognition (OCR)

Polytopal realizations of finite type $\mathbf{g}$-vector fans

Patterns in Random Fractals

Lucid Data Dreaming for Object Tracking

Optimal Design of Energy-Efficient Millimeter Wave Hybrid Transceivers for Wireless Backhaul

Cross-layer Optimization for Ultra-reliable and Low-latency Radio Access Networks

Spectral statistics of the uni-modular ensemble

Universal inequalities in Ehrhart Theory

How many zombies are needed to catch the survivor on toroidal grids?

Effective limit theorems for Markov chains with a spectral gap

Learning and Refining of Privileged Information-based RNNs for Action Recognition from Depth Sequences

Robust estimators for generalized linear models with a dispersion parameter

Algebraic Variety Models for High-Rank Matrix Completion

Hybrid Clustering based on Content and Connection Structure using Joint Nonnegative Matrix Factorization

An orthogonal basis expansion method for solving path-independent stochastic differential equations

Categorizing User Sessions at Pinterest

On the Efficiency of Sharing Economy Networks

Transmission Game in MIMO Interference Channels With Radio-Frequency Energy Harvesting

On the Profile of Multiplicities of Complete Subgraphs

On multicolor Ramsey numbers for loose $k$-paths of length three

The world of long-range interactions: A bird’s eye view

Efficient Two-Dimensional Sparse Coding Using Tensor-Linear Combination

Semi and Weakly Supervised Semantic Segmentation Using Generative Adversarial Network