Hybrid Clustering based on Content and Connection Structure using Joint Nonnegative Matrix Factorization

03/28/2017
by   Rundong Du, et al.
0

We present a hybrid method for latent information discovery on the data sets containing both text content and connection structure based on constrained low rank approximation. The new method jointly optimizes the Nonnegative Matrix Factorization (NMF) objective function for text clustering and the Symmetric NMF (SymNMF) objective function for graph clustering. We propose an effective algorithm for the joint NMF objective function, based on a block coordinate descent (BCD) framework. The proposed hybrid method discovers content associations via latent connections found using SymNMF. The method can also be applied with a natural conversion of the problem when a hypergraph formulation is used or the content is associated with hypergraph edges. Experimental results show that by simultaneously utilizing both content and connection structure, our hybrid method produces higher quality clustering results compared to the other NMF clustering methods that uses content alone (standard NMF) or connection structure alone (SymNMF). We also present some interesting applications to several types of real world data such as citation recommendations of papers. The hybrid method proposed in this paper can also be applied to general data expressed with both feature space vectors and pairwise similarities and can be extended to the case with multiple feature spaces or multiple similarity measures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/06/2022

Rethinking Symmetric Matrix Factorization: A More General and Better Clustering Perspective

Nonnegative matrix factorization (NMF) is widely used for clustering wit...
research
12/07/2020

Nonnegative Matrix Factorization with Zellner Penalty

Nonnegative matrix factorization (NMF) is a relatively new unsupervised ...
research
11/12/2019

Text Mining using Nonnegative Matrix Factorization and Latent Semantic Analysis

Text clustering is arguably one of the most important topics in modern d...
research
10/05/2020

Algorithms for Nonnegative Matrix Factorization with the Kullback-Leibler Divergence

Nonnegative matrix factorization (NMF) is a standard linear dimensionali...
research
08/07/2020

Nyström Approximation with Nonnegative Matrix Factorization

Motivated by the needs of estimating the proximity clustering with parti...
research
01/22/2015

Bi-Objective Nonnegative Matrix Factorization: Linear Versus Kernel-Based Models

Nonnegative matrix factorization (NMF) is a powerful class of feature ex...
research
06/29/2021

Joint Majorization-Minimization for Nonnegative Matrix Factorization with the β-divergence

This article proposes new multiplicative updates for nonnegative matrix ...

Please sign up or login with your details

Forgot password? Click here to reset