Performance of ChatGPT on the US Fundamentals of Engineering Exam: Comprehensive Assessment of Proficiency and Potential Implications for Professional Environmental Engineering

04/20/2023
by   Vinay Pursnani, et al.
0

In recent years, advancements in artificial intelligence (AI) have led to the development of large language models like GPT-4, demonstrating potential applications in various fields, including education. This study investigates the feasibility and effectiveness of using ChatGPT, a GPT-4 based model, in achieving satisfactory performance on the Fundamentals of Engineering (FE) Environmental Exam. This study further shows a significant improvement in the model's accuracy when answering FE exam questions through noninvasive prompt modifications, substantiating the utility of prompt modification as a viable approach to enhance AI performance in educational contexts. Furthermore, the findings reflect remarkable improvements in mathematical capabilities across successive iterations of ChatGPT models, showcasing their potential in solving complex engineering problems. Our paper also explores future research directions, emphasizing the importance of addressing AI challenges in education, enhancing accessibility and inclusion for diverse student populations, and developing AI-resistant exam questions to maintain examination integrity. By evaluating the performance of ChatGPT in the context of the FE Environmental Exam, this study contributes valuable insights into the potential applications and limitations of large language models in educational settings. As AI continues to evolve, these findings offer a foundation for further research into the responsible and effective integration of AI models across various disciplines, ultimately optimizing the learning experience and improving student outcomes.

READ FULL TEXT

page 8

page 9

page 10

page 11

page 13

page 15

research
06/23/2022

Experts' View on Challenges and Needs for Fairness in Artificial Intelligence for Education

In recent years, there has been a stimulating discussion on how artifici...
research
05/31/2023

Contextualizing Problems to Student Interests at Scale in Intelligent Tutoring System Using Large Language Models

Contextualizing problems to align with student interests can significant...
research
06/15/2023

Can ChatGPT pass the Vietnamese National High School Graduation Examination?

This research article highlights the potential of AI-powered chatbots in...
research
04/18/2023

Creating Large Language Model Resistant Exams: Guidelines and Strategies

The proliferation of Large Language Models (LLMs), such as ChatGPT, has ...
research
06/30/2023

Performance of ChatGPT on USMLE: Unlocking the Potential of Large Language Models for AI-Assisted Medical Education

Artificial intelligence is gaining traction in more ways than ever befor...
research
06/01/2023

Enhancing Physics Learning with ChatGPT, Bing Chat, and Bard as Agents-to-Think-With: A Comparative Case Study

The rise of AI has brought remarkable advancements in education, with AI...

Please sign up or login with your details

Forgot password? Click here to reset