FILM: A Fast, Interpretable, and Low-rank Metric Learning Approach for Sentence Matching

10/12/2020
by   Xiangru Tang, et al.
0

Detection of semantic similarity plays a vital role in sentence matching. It requires to learn discriminative representations of natural language. Recently, owing to more and more sophisticated model architecture, impressive progress has been made, along with a time-consuming training process and not-interpretable inference. To alleviate this problem, we explore a metric learning approach, named FILM (Fast, Interpretable, and Low-rank Metric learning) to efficiently find a high discriminative projection of the high-dimensional data. We construct this metric learning problem as a manifold optimization problem and solve it with the Cayley transformation method with the Barzilai-Borwein step size. In experiments, we apply FILM with triplet loss minimization objective to the Quora Challenge and Semantic Textual Similarity (STS) Task. The results demonstrate that the FILM method achieves superior performance as well as the fastest computation speed, which is consistent with our theoretical analysis of time complexity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/13/2019

Fast Low-rank Metric Learning for Large-scale and High-dimensional Data

Low-rank metric learning aims to learn better discrimination of data sub...
research
09/11/2023

The Effect of Intrinsic Dimension on Metric Learning under Compression

Metric learning aims at finding a suitable distance metric over the inpu...
research
10/30/2009

Metric and Kernel Learning using a Linear Transformation

Metric and kernel learning are important in several machine learning app...
research
05/28/2019

Matching on What Matters: A Pseudo-Metric Learning Approach to Matching Estimation in High Dimensions

When pre-processing observational data via matching, we seek to approxim...
research
10/23/2020

Beyond the Deep Metric Learning: Enhance the Cross-Modal Matching with Adversarial Discriminative Domain Regularization

Matching information across image and text modalities is a fundamental c...
research
12/25/2012

Large Scale Strongly Supervised Ensemble Metric Learning, with Applications to Face Verification and Retrieval

Learning Mahanalobis distance metrics in a high- dimensional feature spa...
research
09/08/2023

Perceptual adjustment queries and an inverted measurement paradigm for low-rank metric learning

We introduce a new type of query mechanism for collecting human feedback...

Please sign up or login with your details

Forgot password? Click here to reset