The Geometry of Culture: Analyzing Meaning through Word Embeddings

03/25/2018
by   Austin C. Kozlowski, et al.
0

We demonstrate the utility of a new methodological tool, neural-network word embedding models, for large-scale text analysis, revealing how these models produce richer insights into cultural associations and categories than possible with prior methods. Word embeddings represent semantic relations between words as geometric relationships between vectors in a high-dimensional space, operationalizing a relational model of meaning consistent with contemporary theories of identity and culture. We show that dimensions induced by word differences (e.g. man - woman, rich - poor, black - white, liberal - conservative) in these vector spaces closely correspond to dimensions of cultural meaning, and the projection of words onto these dimensions reflects widely shared cultural connotations when compared to surveyed responses and labeled historical data. We pilot a method for testing the stability of these associations, then demonstrate applications of word embeddings for macro-cultural investigation with a longitudinal analysis of the coevolution of gender and class associations in the United States over the 20th century and a comparative analysis of historic distinctions between markers of gender and class in the U.S. and Britain. We argue that the success of these high-dimensional models motivates a move towards "high-dimensional theorizing" of meanings, identities and cultural processes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/22/2021

Theoretical foundations and limits of word embeddings: what types of meaning can they capture?

Measuring meaning is a central problem in cultural sociology and word em...
research
06/06/2020

ValNorm: A New Word Embedding Intrinsic Evaluation Method Reveals Valence Biases are Consistent Across Languages and Over Decades

Word embeddings learn implicit biases from linguistic regularities captu...
research
05/19/2020

Word-Emoji Embeddings from large scale Messaging Data reflect real-world Semantic Associations of Expressive Icons

We train word-emoji embeddings on large scale messaging data obtained fr...
research
07/09/2020

Cultural Cartography with Word Embeddings

Using the presence or frequency of keywords is a classic approach in the...
research
11/29/2016

Identity-sensitive Word Embedding through Heterogeneous Networks

Most existing word embedding approaches do not distinguish the same word...
research
07/20/2020

The Geometry of Information Cocoon: Analyzing the Cultural Space with Word Embedding Models

Accompanied by the rapid development of digital media, the threat of inf...
research
08/04/2016

Words, Concepts, and the Geometry of Analogy

This paper presents a geometric approach to the problem of modelling the...

Please sign up or login with your details

Forgot password? Click here to reset