research
∙
03/18/2023
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models
The pre-training and fine-tuning paradigm has contributed to a number of...
share
research
∙
05/25/2022
Towards Understanding Label Regularization for Fine-tuning Pre-trained Language Models
Knowledge Distillation (KD) is a prominent neural model compression tech...
research
∙
09/13/2021
How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding
Knowledge Distillation (KD) is a model compression algorithm that helps ...
research
∙
09/08/2021
Unsupervised Pre-training with Structured Knowledge for Improving Natural Language Inference
While recent research on natural language inference has considerably ben...
research
∙
12/22/2020
Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems
Task-oriented conversational modeling with unstructured knowledge access...
research
∙
04/08/2020
DialBERT: A Hierarchical Pre-Trained Model for Conversation Disentanglement
Disentanglement is a problem in which multiple conversations occur in th...
research
∙
04/07/2020
Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
In this paper, we study the problem of employing pre-trained language mo...
research
∙
04/04/2020
Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems
The NOESIS II challenge, as the Track 2 of the 8th Dialogue System Techn...
research
∙
04/27/2019