A Tutorial on Kernel Density Estimation and Recent Advances

This tutorial provides a gentle introduction to kernel density estimation (KDE) and recent advances regarding confidence bands and geometric/topological features. We begin with a discussion of basic properties of KDE: the convergence rate under various metrics, density derivative estimation, and bandwidth selection. Then, we introduce common approaches to the construction of confidence intervals/bands, and we discuss how to handle bias. Next, we talk about recent advances in the inference of geometric and topological features of a density function using KDE. Finally, we illustrate how one can use KDE to estimate a cumulative distribution function and a receiver operating characteristic curve. We provide R implementations related to this tutorial at the end.

A Position-Aware Deep Model for Relevance Matching in Information Retrieval

In order to adopt deep learning for ad-hoc information retrieval, it is essential to establish suitable representations of query-document pairs and to design neural architectures that are able to digest such representations. In particular, they ought to capture all relevant information required to assess the relevance of a document for a given user query, including term overlap as well as positional information such as proximity and term dependencies. While previous work has successfully captured unigram term matches, none has successfully used position-dependent information on a standard benchmark test collection. In this work, we address this gap by encoding the relevance matching in terms of similarity matrices and using a deep model to digest such matrices. We present a novel model architecture consisting of convolutional layers to capture term dependencies and proximity among query term occurrences, followed by a recurrent layer to capture relevance over different query terms. Extensive experiments on TREC Web Track data confirm that the proposed model with similarity matrix representations yields improved search results.

Dempster-Shafer Belief Function – A New Interpretation

We develop our interpretation of the joint belief distribution and of evidential updating that matches the following basic requirements: * there must exist an efficient method for reasoning within this framework * there must exist a clear correspondence between the contents of the knowledge base and the real world * there must be a clear correspondence between the reasoning method and some real world process * there must exist a clear correspondence between the results of the reasoning process and the results of the real world process corresponding to the reasoning process.

ZigZag: A new approach to adaptive online learning

We develop a novel family of algorithms for the online learning setting with regret against any data sequence bounded by the empirical Rademacher complexity of that sequence. To develop a general theory of when this type of adaptive regret bound is achievable we establish a connection to the theory of decoupling inequalities for martingales in Banach spaces. When the hypothesis class is a set of linear functions bounded in some norm, such a regret bound is achievable if and only if the norm satisfies certain decoupling inequalities for martingales. Donald Burkholder’s celebrated geometric characterization of decoupling inequalities (1984) states that such an inequality holds if and only if there exists a special function called a Burkholder function satisfying certain restricted concavity properties. Our online learning algorithms are efficient in terms of queries to this function. We realize our general theory by giving novel efficient algorithms for classes including lp norms, Schatten p-norms, group norms, and reproducing kernel Hilbert spaces. The empirical Rademacher complexity regret bound implies — when used in the i.i.d. setting — a data-dependent complexity bound for excess risk after online-to-batch conversion. To showcase the power of the empirical Rademacher complexity regret bound, we derive improved rates for a supervised learning generalization of the online learning with low rank experts task and for the online matrix prediction task. In addition to obtaining tight data-dependent regret bounds, our algorithms enjoy improved efficiency over previous techniques based on Rademacher complexity, automatically work in the infinite horizon setting, and are scale-free. To obtain such adaptive methods, we introduce novel machinery, and the resulting algorithms are not based on the standard tools of online convex optimization.

Optimal Threshold Design for Quanta Image Sensor

Approximating the Largest Root and Applications to Interlacing Families

What’s in a Question: Using Visual Questions as a Form of Supervision

Forcing in Ramsey theory

Deep Reinforcement Learning-based Image Captioning with Embedding Reward

Nonparametric Collective Spectral Density Estimation and Clustering

Higher-order clustering in networks

Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution

Decomposition Algorithm for Distributionally Robust Optimization using Wasserstein Metric

Provable Self-Representation Based Outlier Detection in a Union of Subspaces

Value Directed Exploration in Multi-Armed Bandits with Structured Priors

On the Quantitative Hardness of CVP

Status updates through M/G/1/1 queues with HARQ

Beyond Uniform Priors in Bayesian Network Structure Learning

Discriminative Bimodal Networks for Visual Localization and Detection with Natural Language Queries

Asymmetric Feature Maps with Application to Sketch Based Retrieval

Virtual to Real Reinforcement Learning for Autonomous Driving

Small and Strong Formulations for Unions of Convex Sets from the Cayley Embedding

Incremental Skip-gram Model with Negative Sampling

Efficient Sparse Subspace Clustering by Nearest Neighbour Filtering

Tractable Clustering of Data on the Curve Manifold

Collaborative Low-Rank Subspace Clustering

Convergence analysis of the information matrix in Gaussian belief propagation

Efficient and Effective Tail Latency Minimization in Multi-Stage Retrieval Systems

On the effect of Batch Normalization and Weight Normalization in Generative Adversarial Networks

Virtual Adversarial Training: a Regularization Method for Supervised and Semi-supervised Learning

2D-3D Pose Consistency-based Conditional Random Fields for 3D Human Pose Estimation

Mobile Keyboard Input Decoding with Finite-State Transducers

Fully Distributed and Asynchronized Stochastic Gradient Descent for Networked Systems

ApproxDBN: Approximate Computing for Discriminative Deep Belief Networks

Optimal experimental design that minimizes the width of simultaneous confidence bands

Matroid Theory and Storage Codes: Bounds and Constructions

A Neural Model for User Geolocation and Lexical Dialectology

Cotorsion pairs in cluster categories of type $A_{\infty}^{\infty}$

Interspecies Knowledge Transfer for Facial Keypoint Detection

Infinite Sparse Structured Factor Analysis

Zero-order Reverse Filtering

3D Deep Learning for Biological Function Prediction from Physical Fields

Nonparametric inference of gradual changes in the jump behaviour of time-continuous processes

Adaptive Neighboring Selection Algorithm Based on Curvature Prediction in Manifold Learning

Saliency-guided Adaptive Seeding for Supervoxel Segmentation

Land Cover Classification via Multi-temporal Spatial Data by Recurrent Neural Networks

DCFNet: Discriminant Correlation Filters Network for Visual Tracking

Solving ill-posed inverse problems using iterative deep neural networks

Bounds on metric dimension for families of planar graphs

Bridging between short-range and long-range dependence with mixed spatio-temporal Ornstein-Uhlenbeck processes

Optimal Spraying in Biological Control of Pests

Existence of optimal controls for SPDE with locally monotone coefficientes

Learning to Estimate Pose by Watching Videos

Constructions of optimal LCD codes over large finite fields

Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis

Semiparametric Regression for Discrete Time-to-Event Data

Equivariant division

Recognizing Activities of Daily Living from Egocentric Images

Cross-lingual and cross-domain discourse segmentation of entire documents

On the moments of the characteristic polynomial of a Ginibre random matrix

DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks

From Data to Decisions: Distributionally Robust Optimization is Optimal

A Search for Improved Performance in Regular Expressions

Tight upper bound on the maximum anti-forcing numbers of graphs

Single Image Super-Resolution based on Wiener Filter in Similarity Domain

Neural Face Editing with Intrinsic Image Disentangling

Explaining the Unexplained: A CLass-Enhanced Attentive Response (CLEAR) Approach to Understanding Deep Neural Networks

Fashion Conversation Data on Instagram

A Procedural Texture Generation Framework Based on Semantic Descriptions

Symplectic Runge-Kutta Methods for Hamiltonian Systems Driven by Gaussian Rough Paths

On a Class of Graphs with Large Total Domination Number

Joint Transfer of Energy and Information in a Two-hop Relay Channel

The distinguishing number and the distinguishing index of Cayley graphs

Learning Joint Multilingual Sentence Representations with Neural Machine Translation

Timely Updates over an Erasure Channel

I-MMSE relations in random linear estimation and a sub-extensive interpolation method

Spectrum Approximation Beyond Fast Matrix Multiplication: Algorithms and Hardness

Intelligent Home Energy Management System for Distributed Renewable Generators, Dispatchable Residential Loads and Distributed Energy Storage Devices

A symmetry-adapted numerical scheme for SDEs

Super-Ricci flows and improved gradient and transport estimates

Blind Demixing and Deconvolution at Near-Optimal Rate

Formal duality in finite cyclic groups

Video Acceleration Magnification

Metrically Regular Generalized Equations: A Case Study in Electronic Circuits

Vessel Tracking via Sub-Riemannian Geodesics on $\mathbb{R}^2 \times P^{1}$

Room for improvement in automatic image description: an error analysis

Evolution and Analysis of Embodied Spiking Neural Networks Reveals Task-Specific Clusters of Effective Networks

Branching processes with interactions: the subcritical cooperative regime

Hybridizing Non-dominated Sorting Algorithms: Divide-and-Conquer Meets Best Order Sort

Molecular Communication using Magnetic Nanoparticles

Managing Service-Heterogeneity using Osmotic Computing

Learning Latent Representations for Speech Generation and Transformation

Spatial Memory for Context Reasoning in Object Detection

Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localization