An Exact Algorithm for Semi-supervised Minimum Sum-of-Squares Clustering

11/30/2021
by   Veronica Piccialli, et al.
0

The minimum sum-of-squares clustering (MSSC), or k-means type clustering, is traditionally considered an unsupervised learning task. In recent years, the use of background knowledge to improve the cluster quality and promote interpretability of the clustering process has become a hot research topic at the intersection of mathematical optimization and machine learning research. The problem of taking advantage of background information in data clustering is called semi-supervised or constrained clustering. In this paper, we present a new branch-and-bound algorithm for semi-supervised MSSC, where background knowledge is incorporated as pairwise must-link and cannot-link constraints. For the lower bound procedure, we solve the semidefinite programming relaxation of the MSSC discrete optimization model, and we use a cutting-plane procedure for strengthening the bound. For the upper bound, instead, by using integer programming tools, we propose an adaptation of the k-means algorithm to the constrained case. For the first time, the proposed global optimization algorithm efficiently manages to solve real-world instances up to 800 data points with different combinations of must-link and cannot-link constraints and with a generic number of features. This problem size is about four times larger than the one of the instances solved by state-of-the-art exact algorithms.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

03/16/2020

A semi-supervised sparse K-Means algorithm

We consider the problem of data clustering with unidentified feature qua...
09/23/2016

Constraint-Based Clustering Selection

Semi-supervised clustering methods incorporate a limited amount of super...
05/31/2013

Privileged Information for Data Clustering

Many machine learning algorithms assume that all input samples are indep...
02/01/2016

Semi-supervised K-means++

Traditionally, practitioners initialize the k-means algorithm with cent...
03/02/2021

Fairness, Semi-Supervised Learning, and More: A General Framework for Clustering with Stochastic Pairwise Constraints

Metric clustering is fundamental in areas ranging from Combinatorial Opt...
07/24/2019

Constrained K-means with General Pairwise and Cardinality Constraints

In this work, we study constrained clustering, where constraints are uti...
12/17/2021

Semi-Supervised Clustering via Markov Chain Aggregation

We connect the problem of semi-supervised clustering to constrained Mark...

Code Repositories

pc-sos-sdp

An Exact Solver for Semi-supervised Minimum Sum-of-Squares Clustering


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.