Semantic Feature Verification in FLAN-T5

04/12/2023
by   Siddharth Suresh, et al.
0

This study evaluates the potential of a large language model for aiding in generation of semantic feature norms - a critical tool for evaluating conceptual structure in cognitive science. Building from an existing human-generated dataset, we show that machine-verified norms capture aspects of conceptual structure beyond what is expressed in human norms alone, and better explain human judgments of semantic similarity amongst items that are distally related. The results suggest that LLMs can greatly enhance traditional methods of semantic feature norm verification, with implications for our understanding of conceptual representation in humans and machines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/11/2023

Human-machine cooperation for semantic feature listing

Semantic feature norms, lists of features that concepts do and do not po...
research
04/05/2023

Behavioral estimates of conceptual structure are robust across tasks in humans but not large language models

Neural network models of language have long been used as a tool for deve...
research
07/31/2017

Understanding tree: a tool for estimating an individual's understanding of conceptual knowledge

People learn whenever and wherever possible, and whatever they like or e...
research
02/08/2022

Semantic features of object concepts generated with GPT-3

Semantic features have been playing a central role in investigating the ...
research
10/16/2022

NormSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Fly

Norm discovery is important for understanding and reasoning about the ac...
research
04/07/2023

Probing Conceptual Understanding of Large Visual-Language Models

We present a novel framework for probing and improving relational, compo...
research
12/07/2021

On Information Processing Limitations In Humans and Machines

Information theory is concerned with the study of transmission, processi...

Please sign up or login with your details

Forgot password? Click here to reset