Learning Topic-Sensitive Word Representations

Distributed word representations are widely used for modeling words in NLP tasks. Most of the existing models generate one representation per word and do not consider different meanings of a word. We present two approaches to learn multiple topic-sensitive representations per word by using Hierarchical Dirichlet Process. We observe that by modeling topics and integrating topic distributions for each document we obtain representations that are able to distinguish between different meanings of a given word. Our models yield statistically significant improvements for the lexical substitution task indicating that commonly used single word representations, even when combined with contextual information, are insufficient for this task.


A System for Accessible Artificial Intelligence

While artificial intelligence (AI) has become widespread, many commercial AI systems are not yet accessible to individual researchers nor the general public due to the deep knowledge of the systems required to use them. We believe that AI has matured to the point where it should be an accessible technology for everyone. We present an ongoing project whose ultimate goal is to deliver an open source, user-friendly AI system that is specialized for machine learning analysis of complex data in the biomedical and health care domains. We discuss how genetic programming can aid in this endeavor, and highlight specific examples where genetic programming has automated machine learning analyses in previous projects.


Clustering with Adaptive Structure Learning: A Kernel Approach

Many similarity-based clustering methods work in two separate steps including similarity matrix computation and subsequent spectral clustering. However, similarity measurement is challenging because it is usually impacted by many factors, e.g., the choice of similarity metric, neighborhood size, scale of data, noise and outliers. Thus the learned similarity matrix is often not suitable, let alone optimal, for the subsequent clustering. In addition, nonlinear similarity often exists in many real world data which, however, has not been effectively considered by most existing methods. To tackle these two challenges, we propose a model to simultaneously learn cluster indicator matrix and similarity information in kernel spaces in a principled way. We show theoretical relationships to kernel k-means, k-means, and spectral clustering methods. Then, to address the practical issue of how to select the most suitable kernel for a particular clustering task, we further extend our model with a multiple kernel learning ability. With this joint model, we can automatically accomplish three subtasks of finding the best cluster indicator matrix, the most accurate similarity relations and the optimal combination of multiple kernels. By leveraging the interactions between these three subtasks in a joint framework, each subtask can be iteratively boosted by using the results of the others towards an overall optimal solution. Extensive experiments are performed to demonstrate the effectiveness of our method.


A Tutorial on Fisher Information

In many statistical applications that concern mathematical psychologists, the concept of Fisher information plays an important role. In this tutorial we clarify the concept of Fisher information as it manifests itself across three different statistical paradigms. First, in the frequentist paradigm, Fisher information is used to construct hypothesis tests and confidence intervals using maximum likelihood estimators; second, in the Bayesian paradigm, Fisher information is used to define a default prior; finally, in the minimum description length paradigm, Fisher information is used to measure model complexity.


An improved Ant Colony System for the Sequential Ordering Problem

It is not rare that the performance of one metaheuristic algorithm can be improved by incorporating ideas taken from another. In this article we present how Simulated Annealing (SA) can be used to improve the efficiency of the Ant Colony System (ACS) and Enhanced ACS when solving the Sequential Ordering Problem (SOP). Moreover, we show how the very same ideas can be applied to improve the convergence of a dedicated local search, i.e. the SOP-3-exchange algorithm. A statistical analysis of the proposed algorithms both in terms of finding suitable parameter values and the quality of the generated solutions is presented based on a series of computational experiments conducted on SOP instances from the well-known TSPLIB and SOPLIB2006 repositories. The proposed ACS-SA and EACS-SA algorithms often generate solutions of better quality than the ACS and EACS, respectively. Moreover, the EACS-SA algorithm combined with the proposed SOP-3-exchange-SA local search was able to find 10 new best solutions for the SOP instances from the SOPLIB2006 repository, thus improving the state-of-the-art results as known from the literature. Overall, the best known or improved solutions were found in 41 out of 48 cases.


Scalable Twin Neural Networks for Classification of Unbalanced Data

Network Monitoring under Strategic Disruptions

Nonparametric Cusum Charts for Angular Data with Applications in Health Science and Astrophysics

Search for Evergreens in Science: A Functional Data Analysis

Real-Time Salient Closed Boundary Tracking via Line Segments Perceptual Grouping

Some remarks regarding generalized Fibonacci-Lucas numbers and generalized Fibonacci-Lucas quaternions

Revisiting Recurrent Networks for Paraphrastic Sentence Embeddings

Predicting Foreground Object Ambiguity and Efficiently Crowdsourcing the Segmentation(s)

How to Read Many-Objective Solution Sets in Parallel Coordinates

Optimal stopping of a Brownian bridge with an unknown pinning point

Targeted matrix completion

Self-dual Harmonicity: the planar case

Common greedy wiring and rewiring heuristics do not guarantee maximum assortative graphs of given degree

A Generalized Probabilistic Version of Modus Ponens

Middleware Technologies for Cloud of Things – a survey

Adversarial PoseNet: A Structure-aware Convolutional Network for Human Pose Estimation

Duluth at SemEval–2016 Task 14 : Extending Gloss Overlaps to Enrich Semantic Taxonomies

Level Playing Field for Million Scale Face Recognition

Stochastic Divergence Minimization for Biterm Topic Model

Inverse Moment Methods for Sufficient Forecasting using High-Dimensional Predictors

Einstein-Hilbert Path Integrals in $\mathbb{R}^4$

Matrix completion with queries

Computing the projected reachable set of switched affine systems: an application to systems biology

Dependency Parsing with Dilated Iterated Graph CNNs

On the Sub-optimality of Single-Letter Coding over Networks

Capacity Region of the Symmetric Injective K-User Deterministic Interference Channel

Parallel Construction of Compact Planar Embeddings

Nonlinearity in Data with Gaps: Application to Ecological and Meteorological Datasets

$L_2$-Small Deviations for Weighted Stationary Processes

Model Transfer for Tagging Low-resource Languages using a Bilingual Dictionary

Existence and coalescence of directed infinite geodesics in the percolation cone

Polynomial-Time Algorithms for Sliding Tokens on Cactus Graphs and Block Graphs

Sub-Pixel Registration of Wavelet-Encoded Images

A Statistical Model for Simultaneous Template Estimation, Bias Correction, and Registration of 3D Brain Images

Explicit asymptotic formulae for sub exponentially growing multiplicative structures

Data Augmentation for Low-Resource Neural Machine Translation

Detecting Drivable Area for Self-driving Cars: An Unsupervised Approach

Autocorrelation Function for Dispersion-Free Fiber Channels with Distributed Amplification

Queue-length balance equations in multiclass multiserver queues and their generalizations

Group-sparse block PCA and explained variance

Spectrum Monitoring for Radar Bands using Deep Convolutional Neural Networks

Shearlet-based compressed sensing for fast 3D cardiac MR imaging using iterative reweighting

Speech-Based Visual Question Answering

Maximum likelihood estimators based on the block maxima method

A Riemannian gossip approach to decentralized subspace learning on Grassmann manifold

Learning Multimodal Transition Dynamics for Model-Based Reinforcement Learning

Edmonds’ Branching Theorem in Digraphs without Forward-infinite Paths

Bases with two expansions

Fronthaul Quantization as Artificial Noise for Enhanced Secret Communication in C-RAN

Highly connected infinite digraphs without edge-disjoint back and forth paths between a certain vertex pair

Orientations of 1-Factorizations and the List Chromatic Index of Small Graphs

Generalized orderless pooling performs implicit salient matching

Orthogonal Code-based Block Transmission for Burst Transmission

Multimode Gaussian optimizers for the Wehrl entropy and quantum Gaussian channels

Role of Structural Morphology in Urban Heat Islands at Night Time

Paradoxes in instrumental variable studies with missing data and one-sided noncompliance

Regularized Residual Quantization: a multi-layer sparse dictionary learning approach

Massive MIMO has Unlimited Capacity

Large deviations for the dynamic $Φ^{2n}_d$ model

Rank Maximal Equal Contribution: a Probabilistic Social Choice Function

Labelled network motifs reveal stylistic subtleties in written texts

Riemann-Langevin Particle Filtering in Track-Before-Detect

Performance tradeoffs of dynamically controlled grid-connected inverters in low inertia power systems

Multifractal properties of sample paths of ground state-transformed jump processes

A weaker structural Markov property for decomposable graph laws

Group actions, the Mattila integral and continuous sum-product problems

WebAPIRec: Recommending Web APIs to Software Projects via Personalized Ranking

Lancaster A at SemEval-2017 Task 5: Evaluation metrics matter: predicting sentiment from financial news headlines

Forced to Learn: Discovering Disentangled Representations Without Exhaustive Labels

Towards effective research recommender systems for repositories

Query-adaptive Video Summarization via Quality-aware Relevance Estimation

Statistical Multiplexing and Traffic Shaping Games for Network Slicing

Bootstrap confidence bands for spectral estimation of Lévy densities under high-frequency observations

Towards well-specified semi-supervised model-based classifiers via structural adaptation

The Promise of Premise: Harnessing Question Premises in Visual Question Answering

Spotting the Difference: Context Retrieval and Analysis for Improved Forgery Detection and Localization

Stochastic Learning on Imbalanced Data: Determinantal Point Processes for Mini-batch Diversification

Mind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptation

Many-body self-localization in a translation-invariant Hamiltonian

Characterizing the many-body localization transition through the entanglement spectrum

Counterfactual-based Incrementality Measurement in a Digital Ad-Buying Platform

On codimension two flats in Fermat-type arrangements

Bispectrum Inversion with Application to Multireference Alignment

Rogozin’s convolution inequality for locally compact groups

Spatiotemporal modelling of sea duck abundance: implications for marine spatial planning

‘Liar, Liar Pants on Fire’: A New Benchmark Dataset for Fake News Detection

Efficient Natural Language Response Suggestion for Smart Reply

A Non-Intrusive Parallel-in-Time Adjoint Solver with the XBraid Library

Bayesian Image Quality Transfer with CNNs: Exploring Uncertainty in dMRI Super-Resolution

Regularity of the speed of biased random walk in a one-dimensional percolation model

Portfolio Choice with Small Temporary and Transient Price Impact

MACA: A Modular Architecture for Conversational Agents

Vertex Nomination Via Local Neighborhood Matching

A Distributed Method for Optimal Capacity Reservation

Thinned Coprime Arrays for DOA Estimation

Convex-constrained Sparse Additive Modeling and Its Extensions

Detecting multivariate interactions in spatial point patterns with Gibbs models and variable selection

Particle systems with singular interaction through hitting times: application in systemic risk modeling

Diffusion limited aggregation in the Boolean lattice

A polynomial time algorithm for the Lambek calculus with brackets of bounded order

From Imitation to Prediction, Data Compression vs Recurrent Neural Networks for Natural Language Processing

Submodular Trajectory Optimization for Aerial 3D Scanning

Adaptive Singular Value Thresholding

Computing Tropical Prevarieties in Parallel

Nonlinear Kalman Filtering with Divergence Minimization

Number-conserving cellular automata with a von Neumann neighborhood of range one

Hyperspectral Image Segmentation with Markov Random Fields and a Convolutional Neural Network

Maximum scattered $\mathbb{F}_q$-linear sets of $\mathrm{PG}(1,q^4)$

Argumentation-based Security for Social Good

Regularizing Model Complexity and Label Structure for Multi-Label Text Classification

A Strategy for an Uncompromising Incremental Learner

Chat Detection in an Intelligent Assistant: Combining Task-oriented and Non-task-oriented Spoken Dialogue Systems

A Teacher-Student Framework for Zero-Resource Neural Machine Translation

Dense-Captioning Events in Videos

Many-Body Localization: Stability and Instability

The mirror conjecture for minuscule flag varieties

Controllability of Conjunctive Boolean Networks with Application to Gene Regulation

Quantum Fourier Sampling is Guaranteed to Fail to Compute Automorphism Groups of Easy Graphs

Improved Bounds for Universal One-Bit Compressive Sensing

Aligned Image Sets and the Generalized Degrees of Freedom of Symmetric MIMO Interference Channel with Partial CSIT

Galois LCD Codes over Finite Fields

Lesion detection and Grading of Diabetic Retinopathy via Two-stages Deep Convolutional Neural Networks

A Semismooth Newton Method for Fast, Generic Convex Programming

Finding Minimal Spanning Forests in a Grap

Sum-MSE performance gain of DFT-based channel estimator over frequency-domain LS one in full-duplex OFDM systems with colored interference

Peano-Gosper curves and the local isomorphism property

Offline Handwritten Recognition of Malayalam District Name – A Holistic Approach

One-Class Semi-Supervised Learning: Detecting Linearly Separable Class by its Mean

On 3-equivalenced weakly distance-regular digraphs

Fisher Information Maximization for Distributed Vector Estimation in Wireless Sensor Networks

Minimax Estimation of the $L_1$ Distance

Zero discord quantum states arising from weighted digraphs

Semidefinite approximations of the matrix logarithm

Transforming Bell’s Inequalities into State Classifiers with Machine Learning

Statistical learning of rational wavelet transform for natural images

Sample average approximation with heavier tails I: non-asymptotic bounds with weak assumptions and stochastic constraints

STAIR Captions: Constructing a Large-Scale Japanese Image Caption Dataset

Multi-view Unsupervised Feature Selection by Cross-diffused Matrix Alignment

Some new results on the total domination polynomial of a graph

BLENDER: Enabling Local Search with a Hybrid Differential Privacy Model

Investigation of Different Skeleton Features for CNN-based 3D Action Recognition

Pointed subspace approach to incomplete data

Scalable MCMC for Bayes Shrinkage Priors

Edge arboricity : Do we need equitabilility ?

Improved Average Complexity for Comparison-Based Sorting

Redundancy in active paths of deep networks: a random active path model

Activity statistics in a colloidal glass former: experimental evidence for a dynamical transition

Partially-Connected Hybrid Precoding in mm-Wave Systems With Dynamic Phase Shifter Networks

Deep Neural Machine Translation with Linear Associative Unit

Towards the Exact Simulation Using Hyperbolic Brownian Motion

Transfer Learning by Ranking for Weakly Supervised Object Annotation

Quantifying the relation between performance and success in soccer

On Balder’s Existence Theorem for Infinite-Horizon Optimal Control Problems

A Novel Approach to Forecasting Financial Volatility with Gaussian Process Envelopes

Weighted network estimation by the use of topological graph metrics

Talking Open Data

King-serf duo by monochromatic paths in k-edge-coloured tournaments

When intuition fails in assessing conditional risks: the example of the frog riddle

On complete localization for the one-dimensional multi-particle Anderson-Bernoulli model with infinite range interaction

On mono-unary algebras corresponding to n-ary groupoids

Decentralized demand response for temperature-constrained appliances

Broadband DOA estimation using Convolutional neural networks trained with noise signals

Local Stability of the Resolvent Flow under Dyson Brownian Motion

$(22_4)$ and $(26_4)$ configurations of lines

A note on the super domination number of Cartesian product graphs

Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner

Enumeration small classes of 1324 and other two $4$-letter patterns

Quasi-linear compressed sensing via non-convex fraction function penalty

Error Corrective Boosting for Learning Fully Convolutional Networks with Limited Data

Optimal control of a non-smooth semilinear elliptic equation

Clifford Gates in the Holant Framework

Variable selection in model-based clustering and discriminant analysis with a regularization approach

Robust reputation-based ranking on multipartite rating networks

Scalable Surface Reconstruction from Point Clouds with Extreme Scale and Density Diversity

A mean score method for sensitivity analysis to departures from the missing at random assumption in randomised trials

Experimental Design for Non-Parametric Correction of Misspecified Dynamical Models

Determinant-Preserving Sparsification of SDDM Matrices with Applications to Counting and Sampling Spanning Trees

Stochastic Geometric Coverage Analysis in mmWave Cellular Networks with a Realistic Channel Model

Path-space moderate deviation principles for the random field Curie-Weiss model

Non-Asymptotic Rates for Manifold, Tangent Space, and Curvature Estimation

On Perfect Matchings and tilings in uniform Hypergraphs

Fuzzy Approach Topic Discovery in Health and Medical Corpora

Dynamic Space Efficient Hashing

Approximate Balancing Weights: Characterizations from a Shrinkage Estimation Perspective

Robust Location-Aided Beam Alignment in Millimeter Wave Massive MIMO

Active Image-based Modeling

Deep Learning for Tumor Classification in Imaging Mass Spectrometry

Independent and maximal branching packing in infinite matroid-rooted digraphs

Modeling Source Syntax for Neural Machine Translation

A projection pursuit framework for testing general high-dimensional hypothesis

Differential algebra of cubic planar graphs

On the total co-independent domination number of graphs

Noise-induced stabilization of collective dynamics

Estimating the Information Rate of a Channel with Classical Input and Output and a Quantum State (Extended Version)

Entity Linking with people entity on Wikipedia

Controllability of the 1D Schrödinger equation using flatness

Pilot Reuse Strategy Maximizing the Weighted-Sum-Rate in Massive MIMO Systems

Efficient computation of statistical properties of coupled oscillators

Algorithms of Inertial Mirror Descent in Convex Problems of Stochastic Optimization

Analysis, simulation and optimal control of a SEIR model for Ebola virus with demographic effects

The Power of Shared Randomness in Uncertain Communication

Comparison of Gabay-Toulouse and de Almeida-Thouless instabilities for the spin glass XY model in a field on sparse random graphs

Visual Attribute Transfer through Deep Image Analogy

PDE approach to the problem of online prediction with expert advice: a construction of potential-based strategies

Advertisements