Harvesting Brownian Motion: Zero Energy Computational Sampling

09/13/2023
by   David Doty, et al.
0

The key factor currently limiting the advancement of computational power of electronic computation is no longer the manufacturing density and speed of components, but rather their high energy consumption. While it has been widely argued that reversible computation can escape the fundamental Landauer limit of k_B Tln(2) Joules per irreversible computational step, there is disagreement around whether indefinitely reusable computation can be achieved without energy dissipation. Here we focus on the relatively simpler context of sampling problems, which take no input, so avoids modeling the energy costs of the observer perturbing the machine to change its input. Given an algorithm A for generating samples from a distribution, we desire a device that can perpetually generate samples from that distribution driven entirely by Brownian motion. We show that such a device can efficiently execute algorithm A in the sense that we must wait only O(time(A)^2) between samples. We consider two output models: Las Vegas, which samples from the exact probability distribution every 4 tries in expectation, and Monte Carlo, in which every try succeeds but the distribution is only approximated. We base our model on continuous-time random walks over the state space graph of a general computational machine, with a space-bounded Turing machine as one instantiation. The problem of sampling a computationally complex probability distribution with no energy dissipation informs our understanding of the energy requirements of computation, and may lead to more energy efficient randomized algorithms.

READ FULL TEXT

page 9

page 11

page 12

page 17

research
07/15/2020

Hardware Acceleration of Monte-Carlo Sampling for Energy Efficient Robust Robot Manipulation

Algorithms based on Monte-Carlo sampling have been widely adapted in rob...
research
12/10/2019

Accelerated Sampling on Discrete Spaces with Non-Reversible Markov Processes

We consider the task of MCMC sampling from a distribution defined on a d...
research
06/10/2016

Deep Directed Generative Models with Energy-Based Probability Estimation

Training energy-based probabilistic models is confronted with apparently...
research
06/16/2019

Randomized Computation of Continuous Data: Is Brownian Motion Computable?

We consider randomized computation of continuous data in the sense of Co...
research
06/04/2021

Exposing the Implicit Energy Networks behind Masked Language Models via Metropolis–Hastings

While recent work has shown that scores from models trained by the ubiqu...
research
11/03/2021

Hamiltonian Dynamics with Non-Newtonian Momentum for Rapid Sampling

Sampling from an unnormalized probability distribution is a fundamental ...
research
04/19/2020

Zig-zag sampling for discrete structures and non-reversible phylogenetic MCMC

We construct a zig-zag process targeting posterior distributions arising...

Please sign up or login with your details

Forgot password? Click here to reset