Branch Ranking for Efficient Mixed-Integer Programming via Offline Ranking-based Policy Learning

07/26/2022
by   Zeren Huang, et al.
4

Deriving a good variable selection strategy in branch-and-bound is essential for the efficiency of modern mixed-integer programming (MIP) solvers. With MIP branching data collected during the previous solution process, learning to branch methods have recently become superior over heuristics. As branch-and-bound is naturally a sequential decision making task, one should learn to optimize the utility of the whole MIP solving process instead of being myopic on each step. In this work, we formulate learning to branch as an offline reinforcement learning (RL) problem, and propose a long-sighted hybrid search scheme to construct the offline MIP dataset, which values the long-term utilities of branching decisions. During the policy training phase, we deploy a ranking-based reward assignment scheme to distinguish the promising samples from the long-term or short-term view, and train the branching model named Branch Ranking via offline policy learning. Experiments on synthetic MIP benchmarks and real-world tasks demonstrate that Branch Rankink is more efficient and robust, and can better generalize to large scales of MIP instances compared to the widely used heuristics and state-of-the-art learning-based branching models.

READ FULL TEXT
research
05/20/2020

Reinforcement Learning for Variable Selection in a Branch and Bound Algorithm

Mixed integer linear programs are commonly solved by Branch and Bound al...
research
07/08/2020

Learning Efficient Search Approximation in Mixed Integer Branch and Bound

In line with the growing trend of using machine learning to improve solv...
research
05/23/2022

Learning to branch with Tree MDPs

State-of-the-art Mixed Integer Linear Program (MILP) solvers combine sys...
research
08/11/2022

Learning Computation Bounds for Branch-and-Bound Algorithms to k-plex Extraction

k-plex is a representative definition of communities in networks. While ...
research
05/28/2021

Learning to Select Cuts for Efficient Mixed-Integer Programming

Cutting plane methods play a significant role in modern solvers for tack...
research
01/17/2022

An Improved Reinforcement Learning Algorithm for Learning to Branch

Most combinatorial optimization problems can be formulated as mixed inte...
research
05/28/2022

Reinforcement Learning for Branch-and-Bound Optimisation using Retrospective Trajectories

Combinatorial optimisation problems framed as mixed integer linear progr...

Please sign up or login with your details

Forgot password? Click here to reset