Log In Sign Up

New Recruiter and Jobs: The Largest Enterprise Data Migration at LinkedIn

by   Xie Lu, et al.

In August 2019, we introduced to our members and customers the idea of moving LinkedIn's two core talent products – Jobs and Recruiter – onto a single platform to help talent professionals be even more productive. This single platform is called the New Recruiter Jobs. A critical and difficult part of this effort is migrating their existing data from the legacy database to the new database and ensure there is no data discrepancy and no down time. In this article, we will discuss the general architecture for a successful data migration and the thought process we followed. Then we expand these ideas to our circumstances and explain in more detail about our specific challenges and solutions. In the Ramp Process section, we explain the inherent difficulties in satisfying our success criteria and describe how we overcome these difficulties and fulfill the success criteria practically.


page 1

page 2

page 3

page 4


Bin stretching with migration on two hierarchical machines

In this paper, we consider semi-online scheduling with migration on two ...

Dynamic Transparent General Purpose Process Migration For Linux

Process migration refers to the act of transferring a process in the mid...

Scheduling to Optimize Sojourn Time of Successful Jobs

Deep neural networks training jobs and other iterative computations freq...

Cloud Migration Methodologies Preliminary Findings

Research around cloud computing has largely been dedicated to ad-dressin...

Job Transitions in a Time of Automation and Labor Market Crises

Job security can never be taken for granted, especially in times of rapi...

Improving the Effective Utilization of Supercomputer Resources by Adding Low-Priority Containerized Jobs

We propose an approach to utilize idle computational resources of superc...