Similarity between Units of Natural Language: The Transition from Coarse to Fine Estimation

by   Wenchuan Mu, et al.

Capturing the similarities between human language units is crucial for explaining how humans associate different objects, and therefore its computation has received extensive attention, research, and applications. With the ever-increasing amount of information around us, calculating similarity becomes increasingly complex, especially in many cases, such as legal or medical affairs, measuring similarity requires extra care and precision, as small acts within a language unit can have significant real-world effects. My research goal in this thesis is to develop regression models that account for similarities between language units in a more refined way. Computation of similarity has come a long way, but approaches to debugging the measures are often based on continually fitting human judgment values. To this end, my goal is to develop an algorithm that precisely catches loopholes in a similarity calculation. Furthermore, most methods have vague definitions of the similarities they compute and are often difficult to interpret. The proposed framework addresses both shortcomings. It constantly improves the model through catching different loopholes. In addition, every refinement of the model provides a reasonable explanation. The regression model introduced in this thesis is called progressively refined similarity computation, which combines attack testing with adversarial training. The similarity regression model of this thesis achieves state-of-the-art performance in handling edge cases.


Measuring Sentences Similarity: A Survey

This study is to review the approaches used for measuring sentences simi...

Surprises in adversarially-trained linear regression

State-of-the-art machine learning models can be vulnerable to very small...

Semantic Similarity from Natural Language and Ontology Analysis

Artificial Intelligence federates numerous scientific fields in the aim ...

Parallels of human language in the behavior of bottlenose dolphins

A short review of similarities between dolphins and humans with the help...

Cascade Attention Network for Person Search: Both Image and Text-Image Similarity Selection

Person search with natural language aims to retrieve the corresponding p...

Embarrassingly Simple Performance Prediction for Abductive Natural Language Inference

The task of abductive natural language inference (αnli), to decide which...

Task-aware Similarity Learning for Event-triggered Time Series

Time series analysis has achieved great success in diverse applications ...

Please sign up or login with your details

Forgot password? Click here to reset