The Self-Perception and Political Biases of ChatGPT

04/14/2023
by   Jérôme Rutinowski, et al.
0

This contribution analyzes the self-perception and political biases of OpenAI's Large Language Model ChatGPT. Taking into account the first small-scale reports and studies that have emerged, claiming that ChatGPT is politically biased towards progressive and libertarian points of view, this contribution aims to provide further clarity on this subject. For this purpose, ChatGPT was asked to answer the questions posed by the political compass test as well as similar questionnaires that are specific to the respective politics of the G7 member states. These eight tests were repeated ten times each and revealed that ChatGPT seems to hold a bias towards progressive views. The political compass test revealed a bias towards progressive and libertarian views, with the average coordinates on the political compass being (-6.48, -5.99) (with (0, 0) the center of the compass, i.e., centrism and the axes ranging from -10 to 10), supporting the claims of prior research. The political questionnaires for the G7 member states indicated a bias towards progressive views but no significant bias between authoritarian and libertarian views, contradicting the findings of prior reports, with the average coordinates being (-3.27, 0.58). In addition, ChatGPT's Big Five personality traits were tested using the OCEAN test and its personality type was queried using the Myers-Briggs Type Indicator (MBTI) test. Finally, the maliciousness of ChatGPT was evaluated using the Dark Factor test. These three tests were also repeated ten times each, revealing that ChatGPT perceives itself as highly open and agreeable, has the Myers-Briggs personality type ENFJ, and is among the 15 test-takers with the least pronounced dark traits.

READ FULL TEXT

page 4

page 5

research
08/07/2016

Automating Political Bias Prediction

Every day media generate large amounts of text. An unbiased view on medi...
research
01/03/2020

Judicial Favoritism of Politicians: Evidence from Small Claims Court

Multiple studies have documented racial, gender, political ideology, or ...
research
05/20/2021

Enabling News Consumers to View and Understand Biased News Coverage: A Study on the Perception and Visualization of Media Bias

Traditional media outlets are known to report political news in a biased...
research
05/23/2023

Diverse Perspectives Can Mitigate Political Bias in Crowdsourced Content Moderation

In recent years, social media companies have grappled with defining and ...
research
04/30/2021

Mitigating Political Bias in Language Models Through Reinforced Calibration

Current large-scale language models can be politically biased as a resul...
research
09/07/2023

OpinionGPT: Modelling Explicit Biases in Instruction-Tuned LLMs

Instruction-tuned Large Language Models (LLMs) have recently showcased r...
research
08/30/2023

Intergroup Bias in Attitudes Toward Restrictions on Uncivil Political Expression and Its Underlying Mechanisms

There appears to be a dilemma between the freedom of expression and prot...

Please sign up or login with your details

Forgot password? Click here to reset