Static and Dynamic Feature Selection in Morphosyntactic Analyzers

03/21/2016
by   Bernd Bohnet, et al.
0

We study the use of greedy feature selection methods for morphosyntactic tagging under a number of different conditions. We compare a static ordering of features to a dynamic ordering based on mutual information statistics, and we apply the techniques to standalone taggers as well as joint systems for tagging and parsing. Experiments on five languages show that feature selection can result in more compact models as well as higher accuracy under all conditions, but also that a dynamic ordering works better than a static ordering and that joint systems benefit more than standalone taggers. We also show that the same techniques can be used to select which morphosyntactic categories to predict in order to maximize syntactic accuracy in a joint system. Our final results represent a substantial improvement of the state of the art for several languages, while at the same time reducing both the number of features and the running time by up to 80

READ FULL TEXT
research
01/02/2023

Learning to Maximize Mutual Information for Dynamic Feature Selection

Feature selection helps reduce data acquisition costs in ML, but the sta...
research
10/30/2014

Training for Fast Sequential Prediction Using Dynamic Feature Selection

We present paired learning and inference algorithms for significantly re...
research
09/24/2015

A Review of Feature Selection Methods Based on Mutual Information

In this work we present a review of the state of the art of information ...
research
11/05/2021

Automated Supervised Feature Selection for Differentiated Patterns of Care

An automated feature selection pipeline was developed using several stat...
research
10/21/2022

A GA-like Dynamic Probability Method With Mutual Information for Feature Selection

Feature selection plays a vital role in promoting the classifier's perfo...
research
03/01/2018

Online Feature Ranking for Intrusion Detection Systems

Many current approaches to the design of intrusion detec- tion systems a...
research
11/11/2017

Feature Selection based on the Local Lift Dependence Scale

This paper uses a classical approach to feature selection: minimization ...

Please sign up or login with your details

Forgot password? Click here to reset