Exploring Partially Observed Networks with Nonparametric Bandits

04/19/2018
by   Kaushalya Madhawa, et al.
0

Real-world networks such as social and communication networks are too large to be observed entirely. Such networks are often partially observed such that network size, network topology, and nodes of the original network are unknown. In this paper we formalize the Adaptive Graph Exploring problem. We assume that we are given an incomplete snapshot of a large network and additional nodes can be discovered by querying nodes in the currently observed network. The goal of this problem is to maximize the number of observed nodes within a given query budget. Querying which set of nodes maximizes the size of the observed network? We formulate this problem as an exploration-exploitation problem and propose a novel nonparametric multi-arm bandit (MAB) algorithm for identifying which nodes to be queried. Our contributions include: (1) iKNN-UCB, a novel nonparametric MAB algorithm, applies k-nearest neighbor UCB to the setting when the arms are presented in a vector space, (2) provide theoretical guarantee that iKNN-UCB algorithm has sublinear regret, and (3) applying iKNN-UCB algorithm on synthetic networks and real-world networks from different domains, we show that our method discovers up to 40 compared to existing baselines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/09/2020

Understanding the Limitations of Network Online Learning

Studies of networked phenomena, such as interactions in online social me...
research
08/03/2019

Nonparametric Contextual Bandits in an Unknown Metric Space

Consider a nonparametric contextual multi-arm bandit problem where each ...
research
06/06/2021

Multi-facet Contextual Bandits: A Neural Network Perspective

Contextual multi-armed bandit has shown to be an effective tool in recom...
research
04/08/2021

Incentivizing Exploration in Linear Bandits under Information Gap

We study the problem of incentivizing exploration for myopic users in li...
research
06/08/2022

Neural Bandit with Arm Group Graph

Contextual bandits aim to identify among a set of arms the optimal one w...
research
03/01/2021

Nonparametric estimation of the preferential attachment function from one network snapshot

Measuring preferential attachment in growing networks is an important to...
research
04/24/2015

Information Gathering in Networks via Active Exploration

How should we gather information in a network, where each node's visibil...

Please sign up or login with your details

Forgot password? Click here to reset