The Slodderwetenschap (Sloppy Science) of Stochastic Parrots – A Plea for Science to NOT take the Route Advocated by Gebru and Bender

01/11/2021
by   Michael Lissack, et al.
0

This article is a position paper written in reaction to the now-infamous paper titled "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?" by Timnit Gebru, Emily Bender, and others who were, as of the date of this writing, still unnamed. I find the ethics of the Parrot Paper lacking, and in that lack, I worry about the direction in which computer science, machine learning, and artificial intelligence are heading. At best, I would describe the argumentation and evidentiary practices embodied in the Parrot Paper as Slodderwetenschap (Dutch for Sloppy Science) – a word which the academic world last widely used in conjunction with the Diederik Stapel affair in psychology [2]. What is missing in the Parrot Paper are three critical elements: 1) acknowledgment that it is a position paper/advocacy piece rather than research, 2) explicit articulation of the critical presuppositions, and 3) explicit consideration of cost/benefit trade-offs rather than a mere recitation of potential "harms" as if benefits did not matter. To leave out these three elements is not good practice for either science or research.

READ FULL TEXT
research
12/01/2017

The mind as a computational system

The present document is an excerpt of an essay that I wrote as part of m...
research
06/03/2022

Oxford-style Debates in Telecommunication and Computer Science Education

Oxford-style debating is a well-known tool in social sciences. Such form...
research
04/16/2018

A survey of comics research in computer science

Graphical novels such as comics and mangas are well known all over the w...
research
06/03/2023

Towards Coding Social Science Datasets with Language Models

Researchers often rely on humans to code (label, annotate, etc.) large s...
research
11/23/2019

Inflationary Constant Factors and Why Python is Faster Than C++

Constant-factor differences are frequently ignored when analyzing the co...
research
07/09/2022

Reflections on the Evolution of Computer Science Education

Computer Science education has been evolving over the years to reflect a...

Please sign up or login with your details

Forgot password? Click here to reset