Boltzmann machine learning and regularization methods for inferring evolutionary fields and couplings from a multiple sequence alignment

09/10/2019
by   Sanzo Miyazawa, et al.
0

The inverse Potts problem to infer the Boltzmann distribution for homologous protein sequences from their single-site and pairwise frequencies recently attracts a great deal of attention due to its capacity to accurately predict residue-residue contacts in a 3D protein complex. A Boltzmann machine for the accurate estimation of the field and coupling interactions, which is required for other studies in protein evolution and folding, is studied about learning methods, regularization models and a tuning method of regularization parameters in order to infer the interactions with reasonable characteristics. Using L_2 regularization for fields, group L_1 for couplings is shown to be very effective for parse couplings in comparison with L_2 and with L_1. Two regularization parameters for fields and couplings are tuned to yield equal values for both the sample average and the ensemble average of evolutionary energies of natural proteins. Both the averages along a learning process smoothly change and converge, but their profiles are very different between the learning methods. Most per-parameter adaptive learning methods invented for machine learning cannot learn reasonable parameters for sparse-interaction systems. A modified Adam (ModAdam) method is invented to make step-size proportional to the partial derivative for sparse couplings and to use a soft thresholding function for group L_1. It is shown by first inferring interactions from protein sequences and then from Monte Carlo samples that the fields and couplings can be well recovered by the group L_1 and the ModAdam method. However, the distribution of evolutionary energies over natural proteins is shifted towards lower energies from that of Monte Carlo samples, indicating that there may be higher-order interactions to favor natural sequences.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/25/2022

Estimating Boltzmann Averages for Protein Structural Quantities Using Sequential Monte Carlo

Sequential Monte Carlo (SMC) methods are widely used to draw samples fro...
research
06/10/2021

Adaptive machine learning for protein engineering

Machine-learning models that learn from data to predict how protein sequ...
research
12/16/2014

Boltzmann-Machine Learning of Prior Distributions of Binarized Natural Images

Prior distributions of binarized natural images are learned by using a B...
research
12/10/2013

Protein Contact Prediction by Integrating Joint Evolutionary Coupling Analysis and Supervised Learning

Protein contacts contain important information for protein structure and...
research
02/28/2017

Can Boltzmann Machines Discover Cluster Updates ?

Boltzmann machines are physics informed generative models with wide appl...
research
02/18/2019

Learning Compositional Representations of Interacting Systems with Restricted Boltzmann Machines: Comparative Study of Lattice Proteins

A Restricted Boltzmann Machine (RBM) is an unsupervised machine-learning...
research
10/14/2014

Detection of cheating by decimation algorithm

We expand the item response theory to study the case of "cheating studen...

Please sign up or login with your details

Forgot password? Click here to reset