Made of Steel? Learning Plausible Materials for Components in the Vehicle Repair Domain

04/28/2023
by   Annerose Eichel, et al.
0

We propose a novel approach to learn domain-specific plausible materials for components in the vehicle repair domain by probing Pretrained Language Models (PLMs) in a cloze task style setting to overcome the lack of annotated datasets. We devise a new method to aggregate salient predictions from a set of cloze query templates and show that domain-adaptation using either a small, high-quality or a customized Wikipedia corpus boosts performance. When exploring resource-lean alternatives, we find a distilled PLM clearly outperforming a classic pattern-based algorithm. Further, given that 98 domain-specific components are multiword expressions, we successfully exploit the compositionality assumption as a way to address data sparsity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2022

WikiDoMiner: Wikipedia Domain-specific Miner

We introduce WikiDoMiner, a tool for automatically generating domain-spe...
research
08/27/2023

Domain-Specificity Inducing Transformers for Source-Free Domain Adaptation

Conventional Domain Adaptation (DA) methods aim to learn domain-invarian...
research
04/20/2023

Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health

Pretrained language models have been used in various natural language pr...
research
08/03/2023

Domain specificity and data efficiency in typo tolerant spell checkers: the case of search in online marketplaces

Typographical errors are a major source of frustration for visitors of o...
research
04/02/2023

A Data-centric Framework for Improving Domain-specific Machine Reading Comprehension Datasets

Low-quality data can cause downstream problems in high-stakes applicatio...
research
10/06/2022

Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering

Retrieval Augment Generation (RAG) is a recent advancement in Open-Domai...
research
11/05/2019

OtoMechanic: Auditory Automobile Diagnostics via Query-by-Example

Early detection and repair of failing components in automobiles reduces ...

Please sign up or login with your details

Forgot password? Click here to reset