Studying The Effect of MIL Pooling Filters on MIL Tasks

06/02/2020
by   Mustafa Umit Oner, et al.
7

There are different multiple instance learning (MIL) pooling filters used in MIL models. In this paper, we study the effect of different MIL pooling filters on the performance of MIL models in real world MIL tasks. We designed a neural network based MIL framework with 5 different MIL pooling filters: `max', `mean', `attention', `distribution' and `distribution with attention'. We also formulated 5 different MIL tasks on a real world lymph node metastases dataset. We found that the performance of our framework in a task is different for different filters. We also observed that the performances of the five pooling filters are also different from task to task. Hence, the selection of a correct MIL pooling filter for each MIL task is crucial for better performance. Furthermore, we noticed that models with `distribution' and `distribution with attention' pooling filters consistently perform well in almost all of the tasks. We attribute this phenomena to the amount of information captured by `distribution' based pooling filters. While point estimate based pooling filters, like `max' and `mean', produce point estimates of distributions, `distribution' based pooling filters capture the full information in distributions. Lastly, we compared the performance of our neural network model with `distribution' pooling filter with the performance of the best MIL methods in the literature on classical MIL datasets and our model outperformed the others.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2021

Comparison of Methods Generalizing Max- and Average-Pooling

Max- and average-pooling are the most popular pooling methods for downsa...
research
05/01/2020

Why and when should you pool? Analyzing Pooling in Recurrent Architectures

Pooling-based recurrent neural architectures consistently outperform the...
research
05/31/2021

Analysis of convolutional neural network image classifiers in a hierarchical max-pooling model with additional local pooling

Image classification is considered, and a hierarchical max-pooling model...
research
08/25/2023

MMBAttn: Max-Mean and Bit-wise Attention for CTR Prediction

With the increasing complexity and scale of click-through rate (CTR) pre...
research
04/28/2021

Filter Distribution Templates in Convolutional Networks for Image Classification Tasks

Neural network designers have reached progressive accuracy by increasing...
research
09/21/2018

Understanding Convolutional Neural Networks for Text Classification

We present an analysis into the inner workings of Convolutional Neural N...
research
05/27/2022

Group-invariant max filtering

Given a real inner product space V and a group G of linear isometries, w...

Please sign up or login with your details

Forgot password? Click here to reset