DeepAI
Log In Sign Up

Attend and Predict: Understanding Gene Regulation by Selective Attention on Chromatin

08/01/2017
by   Ritambhara Singh, et al.
0

The past decade has seen a revolution in genomic technologies that enable a flood of genome-wide profiling of chromatin marks. Recent literature tried to understand gene regulation by predicting gene expression from large-scale chromatin measurements. Two fundamental challenges exist for such learning tasks: (1) genome-wide chromatin signals are spatially structured, high-dimensional and highly modular; and (2) the core aim is to understand what are the relevant factors and how they work together? Previous studies either failed to model complex dependencies among input signals or relied on separate feature analysis to explain the decisions. This paper presents an attention-based deep learning approach; we call AttentiveChrome, that uses a unified architecture to model and to interpret dependencies among chromatin factors for controlling gene regulation. AttentiveChrome uses a hierarchy of multiple Long short-term memory (LSTM) modules to encode the input signals and to model how various chromatin marks cooperate automatically. AttentiveChrome trains two levels of attention jointly with the target prediction, enabling it to attend differentially to relevant marks and to locate important positions per mark. We evaluate the model across 56 different cell types (tasks) in human. Not only is the proposed architecture more accurate, but its attention scores also provide a better interpretation than state-of-the-art feature visualization methods such as saliency map. Code and data are shared at www.deepchrome.org

READ FULL TEXT

page 3

page 15

07/10/2018

DeepDiff: Deep-learning for predicting Differential gene expression from histone modifications

Computational methods that predict differential gene expression from his...
12/15/2020

SimpleChrome: Encoding of Combinatorial Effects for Predicting Gene Expression

Due to recent breakthroughs in state-of-the-art DNA sequencing technolog...
01/30/2018

Structured Memory based Deep Model to Detect as well as Characterize Novel Inputs

While deep learning has pushed the boundaries in various machine learnin...
04/08/2019

Controlling Steering Angle for Cooperative Self-driving Vehicles utilizing CNN and LSTM-based Deep Networks

A fundamental challenge in autonomous vehicles is adjusting the steering...
08/26/2021

Gene Transformer: Transformers for the Gene Expression-based Classification of Cancer Subtypes

Adenocarcinoma and squamous cell carcinoma constitute approximately 40 3...
10/18/2018

Structured gene-environment interaction analysis

For the etiology, progression, and treatment of complex diseases, gene-e...
05/23/2016

Genetic Architect: Discovering Genomic Structure with Learned Neural Architectures

Each human genome is a 3 billion base pair set of encoding instructions....