Multi-Label Learning with Deep Forest

11/15/2019
by   Liang Yang, et al.
22

In multi-label learning, each instance is associated with multiple labels and the crucial task is how to leverage label correlations in building models. Deep neural network methods usually jointly embed the feature and label information into a latent space to exploit label correlations. However, the success of these methods highly depends on the precise choice of model depth. Deep forest is a recent deep learning framework based on tree model ensembles, which does not rely on backpropagation. We consider the advantages of deep forest models are very appropriate for solving multi-label problems. Therefore we design the Multi-Label Deep Forest (MLDF) method with two mechanisms: measure-aware feature reuse and measure-aware layer growth. The measure-aware feature reuse mechanism reuses the good representation in the previous layer guided by confidence. The measure-aware layer growth mechanism ensures MLDF gradually increase the model complexity by performance measure. MLDF handles two challenging problems at the same time: one is restricting the model complexity to ease the overfitting issue; another is optimizing the performance measure on user's demand since there are many different measures in the multi-label evaluation. Experiments show that our proposal not only beats the compared methods over six measures on benchmark datasets but also enjoys label correlation discovery and other desired properties in multi-label learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/15/2018

Distribution-based Label Space Transformation for Multi-label Learning

Multi-label learning problems have manifested themselves in various mach...
research
11/03/2020

Deep tree-ensembles for multi-output prediction

Recently, deep neural networks have expanded the state-of-art in various...
research
07/05/2022

Local Multi-Label Explanations for Random Forest

Multi-label classification is a challenging task, particularly in domain...
research
11/21/2019

Multi-Label Classification with Label Graph Superimposing

Images or videos always contain multiple objects or actions. Multi-label...
research
09/18/2020

Compact Learning for Multi-Label Classification

Multi-label classification (MLC) studies the problem where each instance...
research
11/16/2020

Multi-label classification: do Hamming loss and subset accuracy really conflict with each other?

Various evaluation measures have been developed for multi-label classifi...
research
02/14/2021

Comprehensive Comparative Study of Multi-Label Classification Methods

Multi-label classification (MLC) has recently received increasing intere...

Please sign up or login with your details

Forgot password? Click here to reset