Psychologically-informed chain-of-thought prompts for metaphor understanding in large language models

09/16/2022
by   Ben Prystawski, et al.
0

Probabilistic models of language understanding are interpretable and structured, for instance models of metaphor understanding describe inference about latent topics and features. However, these models are manually designed for a specific task. Large language models (LLMs) can perform many tasks through in-context learning, but they lack the clear structure of probabilistic models. In this paper, we use chain-of-thought prompts to introduce structures from probabilistic models into LLMs. These prompts lead the model to infer latent variables and reason about their relationships to choose appropriate paraphrases for metaphors. The latent variables and relationships chosen are informed by theories of metaphor understanding from cognitive psychology. We apply these prompts to the two largest versions of GPT-3 and show that they can improve paraphrase selection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/28/2023

Language Models are Pragmatic Speakers

How do language models "think"? This paper formulates a probabilistic co...
research
08/10/2023

Metacognitive Prompting Improves Understanding in Large Language Models

In Large Language Models (LLMs), there have been consistent advancements...
research
08/29/2023

FedLogic: Interpretable Federated Multi-Domain Chain-of-Thought Prompt Selection for Large Language Models

Leveraging “chain-of-thought (CoT)” reasoning to elicit rapid and precis...
research
10/04/2022

ThinkSum: Probabilistic reasoning over sets using large language models

Large language models (LLMs) have a substantial capacity for high-level ...
research
07/21/2022

Language Model Cascades

Prompted models have demonstrated impressive few-shot learning abilities...
research
05/24/2023

Revisiting Parallel Context Windows: A Frustratingly Simple Alternative and Chain-of-Thought Deterioration

We identify two crucial limitations in the evaluation of recent parallel...
research
07/06/2023

Training Models to Generate, Recognize, and Reframe Unhelpful Thoughts

Many cognitive approaches to well-being, such as recognizing and reframi...

Please sign up or login with your details

Forgot password? Click here to reset