
Descending through a Crowded Valley – Benchmarking Deep Learning Optimizers
Choosing the optimizer is among the most crucial decisions of deep learn...
read it

Bayesian ODE Solvers: The Maximum A Posteriori Estimate
It has recently been established that the numerical solution of ordinary...
read it

Fast Predictive Uncertainty for Classification with Bayesian Deep Networks
In Bayesian Deep Learning, distributions over the output of classificati...
read it

Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networks
The point estimates of ReLU classification networks—arguably the most wi...
read it

Differentiable Likelihoods for Fast Inversion of 'LikelihoodFree' Dynamical Systems
Likelihoodfree (a.k.a. simulationbased) inference problems are inverse...
read it

BackPACK: Packing more into backprop
Automatic differentiation frameworks are optimized for exactly one thing...
read it

Conjugate Gradients for Kernel Machines
Regularized leastsquares (kernelridge / Gaussian process) regression i...
read it

Integrals over Gaussians under Linear Domain Constraints
Integrals of linearly constrained multivariate Gaussian densities are a ...
read it

Classified Regression for Bayesian Optimization: Robot Learning with Unknown Penalties
Learning robot controllers by minimizing a blackbox objective cost usin...
read it

Uncertainty Estimates for Ordinal Embeddings
To investigate objects without a describable notion of distance, one can...
read it

Limitations of the Empirical Fisher Approximation
Natural gradient descent, which preconditions a gradient descent update ...
read it

Convergence Guarantees for Adaptive Bayesian Quadrature Methods
Adaptive Bayesian quadrature (ABQ) is a powerful approach to numerical i...
read it

DeepOBS: A Deep Learning Optimizer Benchmark Suite
Because the choice and tuning of the optimizer affects the speed, and ul...
read it

Active Probabilistic Inference on Matrices for PreConditioning in Stochastic Optimization
Preconditioning is a wellknown concept that can significantly improve ...
read it

A Modular Approach to Blockdiagonal Hessian Approximations for Secondorder Optimization Methods
We propose a modular extension of the backpropagation algorithm for comp...
read it

Fast and Robust Shortest Paths on Manifolds Learned from Data
We propose a fast, simple and robust algorithm for computing shortest pa...
read it

Probabilistic Solutions To Ordinary Differential Equations As NonLinear Bayesian Filtering: A New Perspective
We formulate probabilistic numerical approximations to solutions of ordi...
read it

Probabilistic Linear Solvers: A Unifying View
Several recent works have developed a new, probabilistic interpretation ...
read it

Convergence Rates of Gaussian ODE Filters
A recentlyintroduced class of probabilistic (uncertaintyaware) solvers...
read it

Gaussian Processes and Kernel Methods: A Review on Connections and Equivalences
This paper is an attempt to bridge the conceptual gaps between researche...
read it

Bayesian Filtering for ODEs with Bounded Derivatives
Recently there has been increasing interest in probabilistic solvers for...
read it

On the Design of LQR Kernels for Efficient Controller Learning
Finding optimal feedback controllers for nonlinear dynamic systems from ...
read it

Probabilistic Active Learning of Functions in Structural Causal Models
We consider the problem of learning the functions computing children fro...
read it

Krylov Subspace Recycling for Fast Iterative LeastSquares in Machine Learning
Solving symmetric positive definite linear problems is a fundamental com...
read it

Follow the Signs for Robust Stochastic Optimization
Stochastic noise on gradients is now a common feature in machine learnin...
read it

Probabilistic Line Searches for Stochastic Optimization
In deterministic optimization, line searches are a standard tool ensurin...
read it

Early Stopping without a Validation Set
Early stopping is a widely used technique to prevent poor generalization...
read it

Coupling Adaptive Batch Sizes with Learning Rates
Minibatch stochastic gradient descent and variants thereof have become ...
read it

A probabilistic model for the numerical solution of initial value problems
Like many numerical methods, solvers for initial value problems (IVPs) o...
read it

Exact Sampling from Determinantal Point Processes
Determinantal point processes (DPPs) are an important concept in random ...
read it

Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasets
Bayesian optimization has become a successful tool for hyperparameter op...
read it

Active Uncertainty Calibration in Bayesian ODE Solvers
There is resurging interest, in statistics and machine learning, in solv...
read it

Dual Control for Approximate Bayesian Reinforcement Learning
Control of nonepisodic, finitehorizon dynamical systems with uncertain...
read it

Probabilistic Numerics and Uncertainty in Computations
We deliver a call to arms for probabilistic numerical methods: algorithm...
read it

Batch Bayesian Optimization via Local Penalization
The popularity of Bayesian optimization methods for efficient exploratio...
read it

Sampling for Inference in Probabilistic Models with Fast Bayesian Quadrature
We propose a novel sampling framework for inference in probabilistic mod...
read it

Probabilistic Interpretation of Linear Solvers
This manuscript proposes a probabilistic framework for algorithms that i...
read it

Probabilistic Solutions to Differential Equations and their Application to Riemannian Statistics
We study a probabilistic numerical method for the solution of both bound...
read it

The Randomized Dependence Coefficient
We introduce the Randomized Dependence Coefficient (RDC), a measure of n...
read it

Entropy Search for InformationEfficient Global Optimization
Contemporary global optimization algorithms are based on local measures ...
read it

Gaussian Probabilities and Expectation Propagation
While Gaussian probability densities are omnipresent in applied mathemat...
read it

Kernel Topic Models
Latent Dirichlet Allocation models discrete data as a mixture of discret...
read it

Optimal Reinforcement Learning for Gaussian Systems
The explorationexploitation tradeoff is among the central challenges o...
read it

Expectation Propagation on the Maximum of Correlated Normal Variables
Many inference problems involving questions of optimality ask for the ma...
read it
Philipp Hennig
is this you? claim profile
Max Planck Research Group Leader at Max Planck Institute for Intelligent Systems