A Note on Learning Algorithms for Quadratic Assignment with Graph Neural Networks

Many inverse problems are formulated as optimization problems over certain appropriate input distributions. Recently, there has been a growing interest in understanding the computational hardness of these optimization problems, not only in the worst case, but in an average-complexity sense under this same input distribution. In this note, we are interested in studying another aspect of hardness, related to the ability to learn how to solve a problem by simply observing a collection of previously solved instances. These are used to supervise the training of an appropriate predictive model that parametrizes a broad class of algorithms, with the hope that the resulting ‘algorithm’ will provide good accuracy-complexity tradeoffs in the average sense. We illustrate this setup on the Quadratic Assignment Problem, a fundamental problem in Network Science. We observe that data-driven models based on Graph Neural Networks offer intriguingly good performance, even in regimes where standard relaxation based techniques appear to suffer.


Causal Inference in Travel Demand Modeling (and the lack thereof)

This paper is about the general disconnect that we see, both in practice and in literature, between the disciplines of travel demand modeling and causal inference. In this paper, we assert that travel demand modeling should be one of the many fields that focuses on the production of valid causal inferences, and we hypothesize about reasons for the current disconnect between the two bodies of research. Furthermore, we explore the potential benefits of uniting these two disciplines. We consider what travel demand modeling can gain from greater incorporation of techniques and perspectives from the causal inference literatures, and we briefly discuss what the causal inference literature might gain from the work of travel demand modelers. In this paper, we do not attempt to ‘solve’ issues related to the drawing of causal inferences from travel demand models. Instead, we hope to spark a larger discussion both within and between the travel demand modeling and causal inference literatures. In particular, we hope to incite discussion about the necessity of drawing causal inferences in travel demand applications and the methods by which one might credibly do so.


Inter-Session Modeling for Session-Based Recommendation

In recent years, research has been done on applying Recurrent Neural Networks (RNNs) as recommender systems. Results have been promising, especially in the session-based setting where RNNs have been shown to outperform state-of-the-art models. In many of these experiments, the RNN could potentially improve the recommendations by utilizing information about the user’s past sessions, in addition to its own interactions in the current session. A problem for session-based recommendation, is how to produce accurate recommendations at the start of a session, before the system has learned much about the user’s current interests. We propose a novel approach that extends a RNN recommender to be able to process the user’s recent sessions, in order to improve recommendations. This is done by using a second RNN to learn from recent sessions, and predict the user’s interest in the current session. By feeding this information to the original RNN, it is able to improve its recommendations. Our experiments on two different datasets show that the proposed approach can significantly improve recommendations throughout the sessions, compared to a single RNN working only on the current session. The proposed model especially improves recommendations at the start of sessions, and is therefore able to deal with the cold start problem within sessions.


ParVecMF: A Paragraph Vector-based Matrix Factorization Recommender System

Review-based recommender systems have gained noticeable ground in recent years. In addition to the rating scores, those systems are enriched with textual evaluations of items by the users. Neural language processing models, on the other hand, have already found application in recommender systems, mainly as a means of encoding user preference data, with the actual textual description of items serving only as side information. In this paper, a novel approach to incorporating the aforementioned models into the recommendation process is presented. Initially, a neural language processing model and more specifically the paragraph vector model is used to encode textual user reviews of variable length into feature vectors of fixed length. Subsequently this information is fused along with the rating scores in a probabilistic matrix factorization algorithm, based on maximum a-posteriori estimation. The resulting system, ParVecMF, is compared to a ratings’ matrix factorization approach on a reference dataset. The obtained preliminary results on a set of two metrics are encouraging and may stimulate further research in this area.


Sampling Matters in Deep Embedding Learning

Deep embeddings answer one simple question: How similar are two images? Learning these embeddings is the bedrock of verification, zero-shot learning, and visual search. The most prominent approaches optimize a deep convolutional network with a suitable loss function, such as contrastive loss or triplet loss. While a rich line of work focuses solely on the loss functions, we show in this paper that selecting training examples plays an equally important role. We propose distance weighted sampling, which selects more informative and stable examples than traditional approaches. In addition, we show that a simple margin based loss is sufficient to outperform all other loss functions. We evaluate our approach on the Stanford Online Products, CAR196, and the CUB200-2011 datasets for image retrieval and clustering, and on the LFW dataset for face verification. Our method achieves state-of-the-art performance on all of them.


Causal Embeddings for Recommendation

Recommendations are treatments. While todays recommender systems attempt to emulate the naturally occurring user behaviour by predicting either missing entries in the user-item matrix or computing the most likely continuation of user sessions, we need to start thinking of recommendations in terms of optimal interventions with respect to specific goals, such as the increase of number of user conversions on a E-Commerce website. This objective is known as Incremental Treatment Effect prediction (ITE) in the causal community. We propose a new way of factorizing user-item matrices created from a large sample of biased data collected using a control recommendation policy and from limited randomized recommendation data collected using a treatment recommendation policy in order to jointly optimize the prediction of outcomes of the treatment policy and its incremental treatment effect with respect to the control policy. We compare our method against both state-of-the-art factorization methods and against new approaches of causal recommendation and show significant improvements in performance.


A Variance Maximization Criterion for Active Learning

Active learning aims to train a classifier as fast as possible with as few labels as possible. The core element in virtually any active learning strategy is the criterion that measures the usefulness of the unlabeled data. We propose a novel approach which we refer to as maximizing variance for active learning or MVAL for short. MVAL measures the value of unlabeled instances by evaluating the rate of change of output variables caused by changes in the next sample to be queried and its potential labelling. In a sense, this criterion measures how unstable the classifier’s output is for the unlabeled data points under perturbations of the training data. MVAL maintains, what we will refer to as, retraining information matrices to keep track of these output scores and exploits two kinds of variance to measure the informativeness and representativeness, respectively. By fusing these variances, MVAL is able to select the instances which are both informative and representative. We employ our technique both in combination with logistic regression and support vector machines and demonstrate that MVAL achieves state-of-the-art performance in experiments on a large number of standard benchmark datasets.


Contextual Sequence Modeling for Recommendation with Recurrent Neural Networks

Recommendations can greatly benefit from good representations of the user state at recommendation time. Recent approaches that leverage Recurrent Neural Networks (RNNs) for session-based recommendations have shown that Deep Learning models can provide useful user representations for recommendation. However, current RNN modeling approaches summarize the user state by only taking into account the sequence of items that the user has interacted with in the past, without taking into account other essential types of context information such as the associated types of user-item interactions, the time gaps between events and the time of day for each interaction. To address this, we propose a new class of Contextual Recurrent Neural Networks for Recommendation (CRNNs) that can take into account the contextual information both in the input and output layers and modifying the behavior of the RNN by combining the context embedding with the item embedding and more explicitly, in the model dynamics, by parametrizing the hidden unit transitions as a function of context information. We compare our CRNNs approach with RNNs and non-sequential baselines and show good improvements on the next event prediction task.


End-to-end Conversation Modeling Track in DSTC6
Deep Transfer Learning: A new deep learning glitch classification method for advanced LIGO
Nonparametric Bayesian estimation of a Hölder continuous diffusion coefficient
The Extremal Function and Colin de Verdière Graph Parameter
Learning Spatial-Aware Regressions for Visual Tracking
The Rees algebra of a two-Borel ideal is Koszul
The Cost of Transportation : Spatial Analysis of US Fuel Prices
Uniquely Pressable Graphs: Characterization, Enumeration, and Recognition
Parameterized Approximation Algorithms for some Location Problems in Graphs
Binary Latent Representations for Efficient Ranking: Empirical Assessment
Dimensional Crossover in Anisotropic Percolation on $Z^{d+s}$
Some algebraic aspects of mesoprimary decomposition
Uncertainty quantification for kinetic models in socio-economic and life sciences
Personalization in Goal-Oriented Dialog
Fractal dimension analysis for automatic morphological galaxy classification
Clustering with Noisy Queries
Pathwise Least Angle Regression and a Significance Test for the Elastic Net
Comparing Neural and Attractiveness-based Visual Features for Artwork Recommendation
Extreme value statistics for the roots of a complex Kac polynomial
Neural Machine Translation with Gumbel-Greedy Decoding
Interoperable Convergence of Storage, Networking and Computation
Deep Hashing Network for Unsupervised Domain Adaptation
Communication-Aware Computing for Edge Processing
Nonlinear Embedding Transform for Unsupervised Domain Adaptation
Coupled Support Vector Machines for Supervised Domain Adaptation
Model Selection with Nonlinear Embedding for Unsupervised Domain Adaptation
A Combinatorial Methodology for Optimizing Non-Binary Graph-Based Codes: Theoretical Analysis and Applications in Data Storage
Multiresolution Match Kernels for Gesture Video Classification
High Performance Non-Binary Spatially-Coupled Codes for Flash Memories
Efficient Approximate Solutions to Mutual Information Based Global Feature Selection
Listen to Your Face: Inferring Facial Action Units from Audio Channel
Retrodirective Multi-User Wireless Power Transfer with Massive MIMO
Shape-constrained partial identification of a population mean under unknown probabilities of sample selection
Toward Goal-Driven Neural Network Models for the Rodent Whisker-Trigeminal System
A-NICE-MC: Adversarial Training for MCMC
Least Squares Polynomial Chaos Expansion: A Review of Sampling Strategies
Heterogeneous MPSoCs for Mixed Criticality Systems: Challenges and Opportunities
Numerical studies of Thompson’s group F and related groups
Affine processes with compact state space
Cross-validation failure: small sample sizes lead to large error bars
Fundamental Limits of Universal Variable-to-Fixed Length Coding of Parametric Sources
Global algorithms for maximal eigenpair
Multi-sequence segmentation via score and higher-criticism tests
Joint Prediction of Depths, Normals and Surface Curvature from RGB Images using CNNs
Kleshchev multipartitions and extended Young diagrams
Named Entity Recognition with stack residual LSTM and trainable bias decoding
A Mecke-type characterization of the Dirichlet-Ferguson measure
A $(2 + ε)$-approximation for precedence constrained single machine scheduling with release dates and total weighted completion time objective
Consistent Estimation in General Sublinear Preferential Attachment Trees
Tree-ansatz percolation of hard spheres
Revisiting Autotagging Toward Faultless Instrumental Playlists Generation
Markov processes of cubic stochastic matrices: {\it Quadratic stochastic processes}
Adaptive Similar Triangles Method: a Stable Alternative to Sinkhorn’s Algorithm for Regularized Optimal Transport
Approximation of smooth convex bodies by random polytopes
Specializing Joint Representations for the task of Product Recommendation
Fundamental Limits on Delivery Time in Cloud- and Cache-Aided Heterogeneous Networks
New cubic self-dual codes of length 54, 60 and 66
Privacy Preserving Randomized Gossip Algorithms
How Much Data is Enough? A Statistical Approach with Case Study on Longitudinal Driving Behavior
Computer-aided implant design for the restoration of cranial defects
Semi-discrete optimal transport – the case p=1
Non-commutative Discretize-then-Optimize Algorithms for Elliptic PDE-Constrained Optimal Control Problems
Adsorbing staircase polygons subject to a force
Estimation and adaptive-to-model testing for regressions with diverging number of predictors
Testing Piecewise Functions
A Bayesian approach to modeling mortgage default and prepayment
ECO-AMLP: A Decision Support System using an Enhanced Class Outlier with Automatic Multilayer Perceptron for Diabetes Prediction
Training Adversarial Discriminators for Cross-channel Abnormal Event Detection in Crowds
Multivariate Geometric Skew-Normal Distribution
Point and Interval Estimation of Weibull Parameters Based on Joint Progressively Censored Data
Spatially filtered unconditional quantile regression
Study Morphology of Minimum Spanning Tree Problem and Generalized Algorithms
Asymptotics of ABC
Quartic Tensor Models
Query Complexity of Clustering with Side Information
Path-by-path uniqueness of infinite-dimensional stochastic differential equations
Common-Message Broadcast Channels with Feedback in the Nonasymptotic Regime: Full Feedback
First passage sets of the 2D continuum Gaussian free field
Robust transition from diffusive to subdiffusive transport for the long-range coupled Heisenberg-chain
The first exit problem and metastability of generic scalar dissipative reaction-diffusion equations subject to multiplicative regularly varying Lévy noise at small intensity
Asymmetric Matrix-Valued Covariances for Multivariate Random Fields on Spheres
Bayesian Penalized Regression
Optimizing the Performance of Reactive Molecular Dynamics Simulations for Multi-Core Architectures
A recipe for irreproducible results
On Single-Antenna Rayleigh Block-Fading Channels at Finite Blocklength
Comparison of Modified Kneser-Ney and Witten-Bell Smoothing Techniques in Statistical Language Model of Bahasa Indonesia

Advertisements