The Hardware Lottery

09/14/2020
by   Sara Hooker, et al.
0

Hardware, systems and algorithms research communities have historically had different incentive structures and fluctuating motivation to engage with each other explicitly. This historical treatment is odd given that hardware and software have frequently determined which research ideas succeed (and fail). This essay introduces the term hardware lottery to describe when a research idea wins because it is suited to the available software and hardware and not because the idea is superior to alternative research directions. Examples from early computer science history illustrate how hardware lotteries can delay research progress by casting successful ideas as failures. These lessons are particularly salient given the advent of domain specialized hardware which make it increasingly costly to stray off of the beaten path of research ideas. This essay posits that the gains from progress in computing are likely to become even more uneven, with certain research directions moving into the fast-lane while progress on others is further obstructed.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 8

page 10

research
09/12/2023

The Grand Illusion: The Myth of Software Portability and Implications for ML Progress

Pushing the boundaries of machine learning often requires exploring diff...
research
02/17/2019

Deep Modulation Embedding

Deep neural network has recently shown very promising applications in di...
research
10/21/2019

Homo Cyberneticus: The Era of Human-AI Integration

This article is submitted and accepted as ACM UIST 2019 Visions. UIST Vi...
research
08/17/2022

Physical Computing for Materials Acceleration Platforms

A ”technology lottery” describes a research idea or technology succeedin...
research
04/20/2023

Geometry of Tensors: Open problems and research directions

This is a collection of open problems and research ideas following the p...
research
12/27/2018

Adaptive virtual organisms: A compositional model for complex hardware-software binding

The relation between a structure and the function running on that struct...
research
03/08/2022

Adapt𝒪r: Objective-Centric Adaptation Framework for Language Models

Progress in natural language processing research is catalyzed by the pos...

Please sign up or login with your details

Forgot password? Click here to reset