Harnessing the Power of Adversarial Prompting and Large Language Models for Robust Hypothesis Generation in Astronomy

06/20/2023
by   Ioana Ciucă, et al.
0

This study investigates the application of Large Language Models (LLMs), specifically GPT-4, within Astronomy. We employ in-context prompting, supplying the model with up to 1000 papers from the NASA Astrophysics Data System, to explore the extent to which performance can be improved by immersing the model in domain-specific literature. Our findings point towards a substantial boost in hypothesis generation when using in-context prompting, a benefit that is further accentuated by adversarial prompting. We illustrate how adversarial prompting empowers GPT-4 to extract essential details from a vast knowledge base to produce meaningful hypotheses, signaling an innovative step towards employing LLMs for scientific research in Astronomy.

READ FULL TEXT

page 2

page 7

research
04/12/2023

Galactic ChitChat: Using Large Language Models to Converse with Astronomy Literature

We demonstrate the potential of the state-of-the-art OpenAI GPT-4 large ...
research
09/07/2023

Can Large Language Models Discern Evidence for Scientific Hypotheses? Case Studies in the Social Sciences

Hypothesis formulation and testing are central to empirical research. A ...
research
06/17/2021

Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study

Biomedical knowledge graphs (KGs) hold rich information on entities such...
research
08/07/2023

KITLM: Domain-Specific Knowledge InTegration into Language Models for Question Answering

Large language models (LLMs) have demonstrated remarkable performance in...
research
06/09/2023

Measuring and Modifying Factual Knowledge in Large Language Models

Large Language Models (LLMs) store an extensive amount of factual knowle...
research
09/15/2023

Using Large Language Models for Knowledge Engineering (LLMKE): A Case Study on Wikidata

In this work, we explore the use of Large Language Models (LLMs) for kno...
research
02/20/2017

MOLIERE: Automatic Biomedical Hypothesis Generation System

Hypothesis generation is becoming a crucial time-saving technique which ...

Please sign up or login with your details

Forgot password? Click here to reset