Just What do You Think You're Doing, Dave?' A Checklist for Responsible Data Use in NLP

09/14/2021
by   Anna Rogers, et al.
11

A key part of the NLP ethics movement is responsible use of data, but exactly what that means or how it can be best achieved remain unclear. This position paper discusses the core legal and ethical principles for collection and sharing of textual data, and the tensions between them. We propose a potential checklist for responsible data (re-)use that could both standardise the peer review of conference submissions, as well as enable a more in-depth view of published research across the community. Our proposal aims to contribute to the development of a consistent standard for data (re-)use, embraced across NLP conferences.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/08/2020

What Can We Do to Improve Peer Review in NLP?

Peer review is our best tool for judging the quality of conference submi...
research
09/12/2022

Responsible AI Pattern Catalogue: A Multivocal Literature Review

Responsible AI has been widely considered as one of the greatest scienti...
research
04/20/2021

Beyond Fair Pay: Ethical Implications of NLP Crowdsourcing

The use of crowdworkers in NLP research is growing rapidly, in tandem wi...
research
04/29/2022

Handling and Presenting Harmful Text

Textual data can pose a risk of serious harm. These harms can be categor...
research
05/27/2020

Give Me Convenience and Give Her Death: Who Should Decide What Uses of NLP are Appropriate, and on What Basis?

As part of growing NLP capabilities, coupled with an awareness of the et...
research
03/10/2021

CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review

Many specialized domains remain untouched by deep learning, as large lab...
research
12/20/2022

Evaluation for Change

Evaluation is the central means for assessing, understanding, and commun...

Please sign up or login with your details

Forgot password? Click here to reset