Tests based on characterizations, and their efficiencies: a survey

A survey of goodness-of-fit and symmetry tests based on the characterization properties of distributions is presented. This approach became popular in recent years. In most cases the test statistics are functionals of U-empirical processes. The limiting distributions and large deviations of new statistics under the null hypothesis are described. Their local Bahadur efficiency for various parametric alternatives is calculated and compared with each other as well as with diverse previously known tests. We also describe new directions of possible research in this domain.

A Deep Network with Visual Text Composition Behavior

While natural languages are compositional, how state-of-the-art neural models achieve compositionality is still unclear. We propose a deep network, which not only achieves competitive accuracy for text classification, but also exhibits compositional behavior. That is, while creating hierarchical representations of a piece of text, such as a sentence, the lower layers of the network distribute their layer-specific attention weights to individual words. In contrast, the higher layers compose meaningful phrases and clauses, whose lengths increase as the networks get deeper until fully composing the sentence.

Cross-Lingual Sentiment Analysis Without (Good) Translation

Current approaches to cross-lingual sentiment analysis try to leverage the wealth of labeled English data using bilingual lexicons, bilingual vector space embeddings, or machine translation systems. Here we show that it is possible to use a single linear transformation, with as few as 2000 word pairs, to capture fine-grained sentiment relationships between words in a cross-lingual setting. We apply these cross-lingual sentiment models to a diverse set of tasks to demonstrate their functionality in a non-English context. By effectively leveraging English sentiment knowledge without the need for accurate translation, we can analyze and extract features from other languages with scarce data at a very low cost, thus making sentiment and related analyses for many languages inexpensive.

Dual Path Networks

In this work, we present a simple, highly efficient and modularized Dual Path Network (DPN) for image classification which presents a new topology of connection paths internally. By revealing the equivalence of the state-of-the-art Residual Network (ResNet) and Densely Convolutional Network (DenseNet) within the HORNN framework, we find that ResNet enables feature re-usage while DenseNet enables new features exploration which are both important for learning good representations. To enjoy the benefits from both path topologies, our proposed Dual Path Network shares common features while maintaining the flexibility to explore new features through dual path architectures. Extensive experiments on three benchmark datasets, ImagNet-1k, Places365 and PASCAL VOC, clearly demonstrate superior performance of the proposed DPN over state-of-the-arts. In particular, on the ImagNet-1k dataset, a shallow DPN surpasses the best ResNeXt-101(64x4d) with 26% smaller model size, 25% less computational cost and 8% lower memory consumption, and a deeper DPN (DPN-131) further pushes the state-of-the-art single model performance with more than 3 times faster training speed. Experiments on the Places365 large-scale scene dataset, PASCAL VOC detection dataset, and PASCAL VOC segmentation dataset also demonstrate its consistently better performance than DenseNet, ResNet and the latest ResNeXt model over various applications.

Center of mass and the probability distribution

In this paper, we consider a flat plate (called a lamina) with uniform density \rho that occupies a region \mathfrak R of the plane. We show that the location of the center of mass, also known as the centroid, of the region equals the expected vector of a bivariate continuous random variable with a uniform probability distribution taking values on the region \mathfrak R. Using this property, we prove that the Voronoi regions of the points in an optimal set of two-means with respect to the uniform distribution defined on a disc partition the disc into two regions bounded by the semicircles. Besides, we show that if an isosceles triangle is partitioned into an isosceles triangle and an isosceles trapezoid in the Golden ratio, then their centers of mass form a centroidal Voronoi tessellation of the triangle. In addition, using the properties of center of mass we determine the optimal sets of two-means and the corresponding quantization error for a uniform distribution defined on a region with uniform density bounded by a rhombus.

Convergence Analysis of Optimization Algorithms

The regret bound of an optimization algorithms is one of the basic criteria for evaluating the performance of the given algorithm. By inspecting the differences between the regret bounds of traditional algorithms and adaptive one, we provide a guide for choosing an optimizer with respect to the given data set and the loss function. For analysis, we assume that the loss function is convex and its gradient is Lipschitz continuous.

An Embedded Deep Learning based Word Prediction

Recent developments in deep learning with application to language modeling have led to success in tasks of text processing, summarizing and machine translation. However, deploying huge language models for mobile device such as on-device keyboards poses computation as a bottle-neck due to their puny computation capacities. In this work we propose an embedded deep learning based word prediction method that optimizes run-time memory and also provides a real time prediction environment. Our model size is 7.40MB and has average prediction time of 6.47 ms. We improve over the existing methods for word prediction in terms of key stroke savings and word prediction rate.

On the Role of Text Preprocessing in Neural Network Architectures: An Evaluation Study on Text Categorization and Sentiment Analysis

In this paper we investigate the impact of simple text preprocessing decisions (particularly tokenizing, lemmatizing, lowercasing and multiword grouping on the performance of a state-of-the-art text classifier based on convolutional neural networks. Despite potentially affecting the final performance of any given model, this aspect has not received a substantial interest in the deep learning literature. We perform an extensive evaluation in standard benchmarks from text categorization and sentiment analysis. Our results show that a simple tokenization of the input text is often enough, but also highlight the importance of being consistent in the preprocessing of the evaluation set and the corpus used for training word embeddings.

ACO for Continuous Function Optimization: A Performance Analysis

The performance of the meta-heuristic algorithms often depends on their parameter settings. Appropriate tuning of the underlying parameters can drastically improve the performance of a meta-heuristic. The Ant Colony Optimization (ACO), a population based meta-heuristic algorithm inspired by the foraging behavior of the ants, is no different. Fundamentally, the ACO depends on the construction of new solutions, variable by variable basis using Gaussian sampling of the selected variables from an archive of solutions. A comprehensive performance analysis of the underlying parameters such as: selection strategy, distance measure metric and pheromone evaporation rate of the ACO suggests that the Roulette Wheel Selection strategy enhances the performance of the ACO due to its ability to provide non-uniformity and adequate diversity in the selection of a solution. On the other hand, the Squared Euclidean distance-measure metric offers better performance than other distance-measure metrics. It is observed from the analysis that the ACO is sensitive towards the evaporation rate. Experimental analysis between classical ACO and other meta-heuristic suggested that the performance of the well-tuned ACO surpasses its counterparts.

A Survey on Geographically Distributed Big-Data Processing using MapReduce

Hadoop and Spark are widely used distributed processing frameworks for large-scale data processing in an efficient and fault-tolerant manner on private or public clouds. These big-data processing systems are extensively used by many industries, e.g., Google, Facebook, and Amazon, for solving a large class of problems, e.g., search, clustering, log analysis, different types of join operations, matrix multiplication, pattern matching, and social network analysis. However, all these popular systems have a major drawback in terms of locally distributed computations, which prevent them in implementing geographically distributed data processing. The increasing amount of geographically distributed massive data is pushing industries and academia to rethink the current big-data processing systems. The novel frameworks, which will be beyond state-of-the-art architectures and technologies involved in the current system, are expected to process geographically distributed data at their locations without moving entire raw datasets to a single location. In this paper, we investigate and discuss challenges and requirements in designing geographically distributed data processing frameworks and protocols. We classify and study batch processing (MapReduce-based systems), stream processing (Spark-based systems), and SQL-style processing geo-distributed frameworks, models, and algorithms with their overhead issues.

An Interactive Tool for Natural Language Processing on Clinical Text

Natural Language Processing (NLP) systems often make use of machine learning techniques that are unfamiliar to end- users who are interested in analyzing clinical records. Al- though NLP has been widely used in extracting information from clinical text, current systems generally do not support model revision based on feedback from domain experts. We present a prototype tool that allows end users to visual- ize and review the outputs of an NLP system that extracts binary variables from clinical text. Our tool combines mul- tiple visualizations to help the users understand these results and make any necessary corrections, thus forming a feedback loop and helping improve the accuracy of the NLP models. We have tested our prototype in a formative think-aloud user study with clinicians and researchers involved in colonoscopy research. Results from semi-structured interviews and a Sys- tem Usability Scale (SUS) analysis show that the users are able to quickly start refining NLP models, despite having very little or no experience with machine learning. Observations from these sessions suggest revisions to the interface to better support review workflow and interpretation of results.

Context Aware Document Embedding
On the Fusion of Compton Scatter and Attenuation Data for Limited-view X-ray Tomographic Applications
A Turán theorem for extensions via an Erdős-Ko-Rado theorem for Lagrangians
On random exchange-stable matchings
Early stopping for kernel boosting algorithms: A general analysis with localized complexities
Agent based simulation of the evolution of society as an alternate maximization problem
Domination and 2-packing numbers in graphs
Stability conditions for a discrete-time decentralised medium access algorithm
Information-gain computation
Improved User-Private Information Retrieval via Finite Geometry
Invex Optimization Revisited
Critical and Griffiths-McCoy singularities in quantum Ising spin-glasses on d-dimensional hypercubic lattices: A series expansion study
Statistical comparison of (brain) networks
Random polymers on the complete graph
Fairness at Equilibrium in the Labor Market
A Data Science Approach to Understanding Residential Water Contamination in Flint
Topology Estimation in Bulk Power Grids: Guarantees on Exact Recovery
Stability of entrainment of a continuum of coupled oscillators
Reversibility of the non-backtracking random walk
On Differential Modulation in Downlink Multiuser MIMO Systems
The random (n-k)-cycle to transpositions walk on the symmetric group
Multimedia Semantic Integrity Assessment Using Joint Embedding Of Images And Text
Tradeoffs Between Information and Ordinal Approximation for Bipartite Matching
SSGAN: Secure Steganography Based on Generative Adversarial Networks
A continuous analogue of lattice path enumeration
RIDDLE: Race and ethnicity Imputation from Disease history with Deep LEarning
Optimal Vehicle Dispatching Schemes via Dynamic Pricing
On a Generalization of the Bipartite Graph $D(k,q)$
Graphs with conflict-free connection number two
An HTM based cortical algorithm for detection of seismic waves
Online Job Scheduling with Redundancy and Opportunistic Checkpointing: A Speedup-Function-Based Analysis
Extracting analytic proofs from numerically solved Shannon-type Inequalities
Distributed Event-Based State Estimation for Networked Systems: An LMI-Approach
Parallel Particle MCMC with Poisson Resampling
An optimal regularity result on the quasi-invariant Gaussian measures for the cubic fourth order nonlinear Schrödinger equation
The Matroid Structure of Representative Triple Sets and Triple-Closure Computation
Energy Efficient Predictive Resource Allocation for VoD and Real-time Services
The Borel-Cantelli Lemmas for contaminated events, and small maxima
Quadratic obstructions to controllability: from ODEs to PDEs
RON: Reverse Connection with Objectness Prior Networks for Object Detection
Sparsity information and regularization in the horseshoe and other shrinkage priors
Basin stability measure of different steady states in coupled oscillators
Pipelined Parallel FFT Architecture
Automated Lane Detection in Crowds using Proximity Graphs
CNN features are also great at unsupervised classification
When the Optimum is also Blind: a New Perspective on Universal Optimization
Local Nonparametric Estimation for Second-Order Jump-Diffusion Model Using Gamma Asymmetric Kernels
Minimax rates for statistical inverse problems under general source conditions
Mode-Seeking Clustering and Density Ridge Estimation via Direct Estimation of Density-Derivative-Ratios
On recurrence of the multidimensional Lindley process
A Common Generalization to Theorems on Set Systems with $\mathcal{L}$-intersections
Stein-like Estimators for Causal Mediation Analysis in Randomized Trials
On pre-Lie Magnus expansion
Application of Fuzzy Assessing for Reliability Decision Making
A new and improved algorithm for online bin packing
Cross-linguistic differences and similarities in image descriptions
Fast Compressed Self-Indexes with Deterministic Linear-Time Construction
Why we live in hierarchies: a quantitative treatise
Verifying Strong Eventual Consistency in Distributed Systems
Some intriguing upper bounds for separating hash families
A Variational Principle for the Specific Entropy for Symbolic Systems with Uncountable Alphabets
Bernstein – von Mises theorems for statistical inverse problems I: Schrödinger equation
The logarithmic derivative for point processes with equivalent Palm measures
Discrete rough paths and limit theorems
Tensor-Train Recurrent Neural Networks for Video Classification
A Simple Approach to Learn Polysemous Word Embeddings
Hardness of learning noisy halfspaces using polynomial thresholds
Turing Kernelization for Finding Long Paths in Graph Classes Excluding a Topological Minor
Simultaneous Optimization of Neural Network Weights and Active Nodes using Metaheuristics
Harmonic measure for biased random walk in a supercritical Galton-Watson tree
Fast and Feasible Estimation of Generalized Linear Models with Many Two-Way Fixed Effects
Common Counterfactual Belief of Rationality Subsumes Superrationality On Symmetric Games
Convergence, Fluctuations and Large Deviations for finite state Mean Field Games via the Master equation
Convergence Analysis of Backpropagation Algorithm for Designing an Intelligent System for Sensing Manhole Gases
Nonparametric Marginal Analysis of Recurrent Events Data under Competing Risks
List-Distinguishing Cartesian Products of Cliques
Climbing the Kaggle Leaderboard by Exploiting the Log-Loss Oracle
Indefinite Kernel Logistic Regression
Single-Queue Decoding for Neural Machine Translation
Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networks
A statistical analysis of particle trajectories in living cells
Negative association, ordering and convergence of resampling methods
On User Pairing in NOMA Uplink
Minimal Sum of Powered Distances from the Sides of a Triangle
Non-Poisson Renewal Events and Memory
LinNet: Probabilistic Lineup Evaluation Through Network Embedding
A Robust Interrupted Time Series Model for Analyzing Complex Healthcare Intervention Data
Blockchains Consensus Protocols in the Wild
Maximizing the mean subtree order
Calibrated Fairness in Bandits
Changing Views on Curves and Surfaces
New Cameron-Liebler line classes with parameter $\frac{q^2+1}{2}$
Fourth moment theorems on the Poisson space in any dimension
Trust-PCL: An Off-Policy Trust Region Method for Continuous Control