Towards Reasoning in Large Language Models: A Survey

12/20/2022
by   Jie Huang, et al.
0

Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in natural language processing, and there is observation that these models may exhibit reasoning abilities when they are sufficiently large. However, it is not yet clear to what extent LLMs are capable of reasoning. This paper provides a comprehensive overview of the current state of knowledge on reasoning in LLMs, including techniques for improving and eliciting reasoning in these models, methods and benchmarks for evaluating reasoning abilities, findings and implications of previous research in this field, and suggestions on future directions. Our aim is to provide a detailed and up-to-date review of this topic and stimulate meaningful discussion and future work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/29/2023

Large Language Models on the Chessboard: A Study on ChatGPT's Formal Language Comprehension and Complex Reasoning Skills

While large language models have made strides in natural language proces...
research
12/20/2022

A Survey of Deep Learning for Mathematical Reasoning

Mathematical reasoning is a fundamental aspect of human intelligence and...
research
08/24/2023

GPTEval: A Survey on Assessments of ChatGPT and GPT-4

The emergence of ChatGPT has generated much speculation in the press abo...
research
12/19/2022

Reasoning with Language Model Prompting: A Survey

Reasoning, as an essential ability for complex problem-solving, can prov...
research
06/11/2023

Inductive reasoning in humans and large language models

The impressive recent performance of large language models has led many ...
research
09/12/2023

Re-Reading Improves Reasoning in Language Models

Reasoning presents a significant and challenging issue for Large Languag...
research
05/15/2023

What's the Meaning of Superhuman Performance in Today's NLU?

In the last five years, there has been a significant focus in Natural La...

Please sign up or login with your details

Forgot password? Click here to reset